-- Logs begin at Thu 2022-10-27 08:15:30 UTC, end at Thu 2022-10-27 11:04:32 UTC. -- Oct 27 08:48:58.790978 n-d-858383-16 systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 08:48:58.799696 n-d-858383-16 devstack@n-api.service[104582]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 08:48:58 2022] *** Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: nodename: n-d-858383-16 Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: machine: x86_64 Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: clock source: unix Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: pcre jit disabled Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: detected number of CPU cores: 4 Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: current working directory: / Oct 27 08:48:58.801628 n-d-858383-16 devstack@n-api.service[104582]: detected binary path: /usr/bin/uwsgi-core Oct 27 08:48:58.802347 n-d-858383-16 devstack@n-api.service[104582]: your processes number limit is 47680 Oct 27 08:48:58.802347 n-d-858383-16 devstack@n-api.service[104582]: your memory page size is 4096 bytes Oct 27 08:48:58.802347 n-d-858383-16 devstack@n-api.service[104582]: detected max file descriptor number: 2048 Oct 27 08:48:58.802347 n-d-858383-16 devstack@n-api.service[104582]: lock engine: pthread robust mutexes Oct 27 08:48:58.802347 n-d-858383-16 devstack@n-api.service[104582]: thunder lock: enabled Oct 27 08:48:58.802347 n-d-858383-16 devstack@n-api.service[104582]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 08:48:58.802347 n-d-858383-16 devstack@n-api.service[104582]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 08:48:58.841651 n-d-858383-16 devstack@n-api.service[104582]: Python main interpreter initialized at 0x55d208aa49c0 Oct 27 08:48:58.841651 n-d-858383-16 devstack@n-api.service[104582]: python threads support enabled Oct 27 08:48:58.841651 n-d-858383-16 devstack@n-api.service[104582]: your server socket listen backlog is limited to 100 connections Oct 27 08:48:58.841651 n-d-858383-16 devstack@n-api.service[104582]: your mercy for graceful operations on workers is 90 seconds Oct 27 08:48:58.842058 n-d-858383-16 devstack@n-api.service[104582]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 08:48:58.842058 n-d-858383-16 devstack@n-api.service[104582]: *** Operational MODE: preforking *** Oct 27 08:48:58.842306 n-d-858383-16 devstack@n-api.service[104582]: *** uWSGI is running in multiple interpreter mode *** Oct 27 08:48:58.842306 n-d-858383-16 devstack@n-api.service[104582]: spawned uWSGI master process (pid: 104582) Oct 27 08:48:58.842487 n-d-858383-16 systemd[1]: Started Devstack devstack@n-api.service. Oct 27 08:48:58.843028 n-d-858383-16 devstack@n-api.service[104582]: spawned uWSGI worker 1 (pid: 104583, cores: 1) Oct 27 08:48:58.843368 n-d-858383-16 devstack@n-api.service[104582]: spawned uWSGI worker 2 (pid: 104584, cores: 1) Oct 27 08:48:58.843533 n-d-858383-16 devstack@n-api.service[104582]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 08:48:59.499720 n-d-858383-16 devstack@n-api.service[104584]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 08:48:59.505091 n-d-858383-16 devstack@n-api.service[104583]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 08:49:00.574703 n-d-858383-16 devstack@n-api.service[104584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 08:49:00.574703 n-d-858383-16 devstack@n-api.service[104584]: from cryptography.utils import int_from_bytes Oct 27 08:49:00.575296 n-d-858383-16 devstack@n-api.service[104584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 08:49:00.575296 n-d-858383-16 devstack@n-api.service[104584]: from cryptography.utils import int_from_bytes Oct 27 08:49:00.575505 n-d-858383-16 devstack@n-api.service[104583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 08:49:00.575505 n-d-858383-16 devstack@n-api.service[104583]: from cryptography.utils import int_from_bytes Oct 27 08:49:00.575957 n-d-858383-16 devstack@n-api.service[104583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 08:49:00.575957 n-d-858383-16 devstack@n-api.service[104583]: from cryptography.utils import int_from_bytes Oct 27 08:49:03.080492 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 08:49:03.081059 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 08:49:03.081262 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 08:49:03.081623 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 08:49:03.081879 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 08:49:03.082266 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.082593 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.082918 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.083233 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.083604 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.083895 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.084215 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.084533 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.084887 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.085083 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 08:49:03.085458 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.085538 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 08:49:03.085624 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.085761 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-16 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.085866 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 08:49:03.086083 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.086213 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 08:49:03.086391 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.086487 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 08:49:03.086700 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.086848 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.087015 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.087174 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.087318 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.087498 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.087659 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.087850 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.087966 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.088183 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.088462 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.088875 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.088875 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.089016 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.089118 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.089200 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.089450 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.089541 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.089723 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.089839 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.090021 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.090177 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.090354 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-16 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.090499 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.090686 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.090790 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.090997 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.091097 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.091310 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.091416 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.091636 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.091738 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.091981 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.092077 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-16 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.092307 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.092392 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.092615 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.092711 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.092940 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.093128 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.093349 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.093438 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.093659 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.093770 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.093968 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.094070 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.094283 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.094377 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.094606 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.094703 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.094913 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.095000 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.095239 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.095326 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.095556 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.095681 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.095897 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.095991 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.096208 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.096311 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.096510 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.096597 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-16 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.096818 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.096918 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.097127 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.097221 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.097443 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.097530 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.097747 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.097899 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.098049 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.098212 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.098309 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.098523 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.098621 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.098846 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.098957 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.099183 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.099280 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.099493 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.099628 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.099771 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.099925 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.100022 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.100159 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.100882 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.101180 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.101335 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.101528 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.101715 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.101891 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.102184 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.102362 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.102665 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.102753 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.102977 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.103125 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.103283 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.103460 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.103611 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.103804 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.103910 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.104120 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.104221 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.104374 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.104528 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.104690 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.104851 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.105017 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.105159 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.105344 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.105478 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.105674 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.105878 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.105967 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.106134 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.106266 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.106441 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.106529 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.106784 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.106875 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.107093 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.107180 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.107396 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.107492 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.107731 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.107833 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.108044 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.108132 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.108349 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.108448 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.108654 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.108750 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.108959 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.109048 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.109268 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.109369 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.109591 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.109679 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.109891 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.109976 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.110143 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.110240 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.110442 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.110529 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.110746 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.110833 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.111062 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.111218 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.111365 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.111475 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.111689 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.111813 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.111992 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.112155 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.112291 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.112478 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.112594 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.112790 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.112891 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.113111 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.113199 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.113436 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.113528 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.113744 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.113846 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.114050 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.114154 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.114350 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.114439 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.114657 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.114778 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.114960 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.115053 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.115445 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.115539 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.115539 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.115704 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.115840 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.116022 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.116708 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.116821 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.117036 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.117127 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.117345 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.117441 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.117649 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.117735 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.117954 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.118054 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.118259 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.118348 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.118560 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.118647 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.118866 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.118965 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.119170 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.119267 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.119473 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.119592 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.119814 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.119904 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.120120 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.120208 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.120424 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.120518 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.120731 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.120819 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.121029 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.121122 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.121333 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.121421 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.121650 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.121738 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.121953 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.122048 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.122254 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.122350 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.122554 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.122642 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.122854 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.122942 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.123296 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.123416 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.123537 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.123706 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.123836 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.123921 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.124043 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.124145 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.124342 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.124430 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.124658 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.124744 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.124975 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.125077 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.125281 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.125374 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.125586 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.125681 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.125889 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.125989 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.126206 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.126293 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.126509 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.126598 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.126819 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.126920 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.127140 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.127228 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.127450 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.127537 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.127787 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.127877 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.128090 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.128185 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.128394 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.128482 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.128699 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.128789 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.129004 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.129098 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.129308 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.129407 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.129613 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.129702 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.129915 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.130010 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.130234 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.130323 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.130547 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.130635 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.130855 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.130941 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.131169 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.131270 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.131476 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.132074 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.132327 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.132413 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:49:03.132646 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.132746 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.132957 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.133044 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.133275 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.133362 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.133602 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.133705 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.133923 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.134101 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.134234 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.134332 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.134574 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.134676 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.134888 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.134976 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.135205 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.135293 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.135532 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.135653 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.135871 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.135968 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.136181 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.136267 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.136490 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.136586 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.136806 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.136894 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.137124 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.137210 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.137444 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.137539 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.137754 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.137841 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.138071 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.138158 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.138379 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.138466 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.138693 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.138781 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.139002 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.139092 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.139313 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.139410 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.139647 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.139739 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.139961 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.140047 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.140271 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.140373 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.140607 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.140696 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.140923 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.141024 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.141246 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.141343 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.141562 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.141649 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.141872 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.141972 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.142185 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.142272 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.142492 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.142577 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.142803 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.142899 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.143113 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.143201 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.143419 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.143506 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.143748 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.143848 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.144055 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.144150 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.144364 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.144454 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.144668 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.144768 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.144989 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.145092 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.145303 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.145391 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.145609 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.145697 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.145921 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.146015 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.146233 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.146326 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.146542 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.146637 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.146857 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.146946 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.147234 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.147886 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.148070 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.148160 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.148393 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.148482 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.148703 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.148798 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.149016 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.149108 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.149324 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.149453 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.149633 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.149733 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.149938 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.150025 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.150246 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.150333 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.150557 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.150652 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.150862 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.150949 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.151175 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.151262 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.151488 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.151608 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.151838 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.151926 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.152175 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.152263 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.152487 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.152588 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.152802 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.152898 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.153113 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.153199 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.153425 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.153513 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.153736 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.153824 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.154051 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.154184 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.154367 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.154464 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.154678 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.154766 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.155001 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.155087 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.155313 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.155401 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.155642 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.155733 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.155954 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.156054 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.156259 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.156361 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.156566 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.156655 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.156880 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.156976 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.157192 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.157280 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.157497 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.157584 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.157803 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.157964 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.158108 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.158203 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.158413 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.158508 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.158718 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.158818 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.159039 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.159126 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.159346 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.159431 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.159677 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.159782 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.159983 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.160080 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.160288 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.160376 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.160629 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.160725 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.160937 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.161025 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.161271 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.161366 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.161585 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.161682 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.161895 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.161984 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.162208 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.162296 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.162520 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.162609 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.162861 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.162956 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.163169 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.163256 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.163480 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.163597 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.163814 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.163901 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.164125 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.164265 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.164436 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.164526 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.164746 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.164832 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.165063 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.165159 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.165372 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.165459 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.165675 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.165762 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.165981 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.166078 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.166299 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.166386 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.166607 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.166695 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.166927 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.167023 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.167268 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.167363 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.167617 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.167709 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.167935 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.168023 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.168253 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.168340 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.168562 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.168655 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.168875 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.168963 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.169183 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.169269 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.169495 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.169582 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.169805 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.169893 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.170115 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.170202 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.170427 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.170513 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.170736 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.170822 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.171054 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.171142 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.171362 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.171448 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.171707 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.171813 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.172025 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.172146 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.172331 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.172435 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.172636 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.172723 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.172948 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.173043 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.173277 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.173373 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.173608 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.173697 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.173918 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.174013 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.174228 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.174369 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.174547 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.174703 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.174856 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.174943 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.175166 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.175263 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.175475 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.175627 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.175805 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.175894 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.176114 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.176204 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.176424 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.176512 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.176738 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.176834 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.177050 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.177185 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.177358 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.177445 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.177664 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.177753 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.177977 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.178074 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.178285 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.178394 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.178611 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.178698 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.178916 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.179006 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.179226 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.179322 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.179547 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.179676 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.179890 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.179980 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.180215 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.180302 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.180531 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.180628 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.180838 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.180925 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.181141 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.181302 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.181450 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.181548 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.181760 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.181848 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.182063 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.182160 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.182367 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.182468 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.182672 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.182769 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.182984 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.183073 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.183294 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.183383 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.183867 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.183978 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.184191 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.184279 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.184500 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.184597 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.184809 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.184896 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.185120 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.185210 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.185432 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.185528 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.185738 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.185825 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.186060 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.186149 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.186375 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.186464 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.186681 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.186768 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.186989 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.187076 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.187298 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.187388 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.187630 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.187723 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.187939 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.188044 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.188248 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.188336 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.188553 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.188639 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.188861 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.188957 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.189171 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.189259 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.189475 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.189563 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.189783 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.189916 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.190101 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.190191 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.190412 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.190668 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.190765 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.191000 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.191095 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.191313 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.191400 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.191659 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.191763 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.191976 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.192064 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.192288 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.192386 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.192603 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.192692 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.192919 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.193015 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.193233 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.193322 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.193538 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.193624 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.193849 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.193938 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.194680 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.194778 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.194986 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.195113 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.195297 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.195388 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.195629 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.195731 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.195937 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.196024 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.196242 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.196331 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.196551 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.196806 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.196897 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.197145 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.197242 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.197446 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.197533 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.197751 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.197838 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.198064 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.198153 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.198370 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.198466 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.198679 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.198767 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.198982 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.199086 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.199304 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.199391 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.199636 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.199728 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.199944 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.200048 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.200247 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.200348 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.200550 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.200650 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.200863 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.200960 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.201173 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.201261 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.201482 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.201570 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.201790 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.201886 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.202103 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.202192 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.202411 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.202507 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.202720 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.202809 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.203028 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.203117 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.203338 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.203424 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.203676 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.203766 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.203982 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.204068 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.204289 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.204378 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.204595 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.204683 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.204895 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.204981 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.205204 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.205300 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.205511 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.205598 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.205818 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.205905 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.206122 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.206217 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.206424 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.206560 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.206734 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.206823 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.207045 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.207142 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.207363 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.207452 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.207698 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.207790 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.208004 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.208105 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.208309 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.208405 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.208619 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.208707 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.208928 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.209018 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.209233 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.209327 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.209540 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.209627 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.210386 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.210477 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.210698 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.210793 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.211000 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.211087 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.211305 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.211394 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.211637 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.211729 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.211950 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.212038 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.212262 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.212360 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.212564 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.212652 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.212876 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.212974 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.213183 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.213270 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.213486 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.213576 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.213792 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.213889 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.214098 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.214185 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.214399 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.214485 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.214704 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.214799 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.215014 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.215108 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.215323 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.215411 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.215664 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.215771 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.215973 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.216061 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.216282 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.216367 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.216584 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.216682 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.216890 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.216978 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.217193 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.217279 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.217500 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.217589 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.217802 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.217889 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.218104 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.218192 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.218405 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.218494 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.218707 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.218795 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.219009 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.219096 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.219319 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.219407 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.219655 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.219785 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.219961 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.220066 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.220270 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.220401 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.220572 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.220660 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.220901 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.220994 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.221206 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.221293 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.221519 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.221606 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.221833 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.221930 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.222140 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.222229 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.222446 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.222534 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.222754 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.222850 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.223061 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.223154 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.223366 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.223453 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.223695 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.223845 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.224002 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.224092 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.224310 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.224396 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.224617 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.224712 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.224919 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.225005 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.225221 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.225825 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.226067 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.226156 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.226378 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.226466 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.226687 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.226775 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.227014 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.227102 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.227332 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.227419 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.227680 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.227769 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.227989 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.228085 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.228295 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.228383 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.228604 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.228705 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.228911 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.228999 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.229221 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.229309 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.229530 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.229629 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.229837 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.229925 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.230146 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.230241 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.230455 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.230551 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.230761 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.230849 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.231067 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.231156 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.231374 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.231475 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.231707 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.231797 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.232016 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.232106 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.232319 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.232408 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.232640 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.232728 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.232947 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.233034 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.233251 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.233341 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.233559 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.233647 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.233862 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.233950 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.234170 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.234260 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.234494 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.234584 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.234789 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.234887 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.235104 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.235193 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.235418 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.235505 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.235761 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.235929 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.236080 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.236172 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.236394 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.236484 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.236708 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.236804 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.237018 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.237106 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.237322 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.237408 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.237633 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.237730 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.237942 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.238030 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.238271 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.238359 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.238582 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.238681 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.238891 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.238980 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.239203 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.239291 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.239510 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.239619 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.239858 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.239947 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.240163 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.240289 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.240469 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.240589 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.240775 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.241005 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.241679 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.241816 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.241979 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.242130 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.242297 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.242446 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.242714 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.242801 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.243026 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.243117 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.243334 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.243422 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.243696 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.243801 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.244077 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.244164 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.244386 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.244481 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.244708 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.244809 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.245032 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.245121 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.245343 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.245434 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.245647 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.245741 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.245957 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.246045 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.246262 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.246349 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.246583 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.246682 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.246895 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.246985 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.247204 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.247313 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.247514 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.247637 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.247841 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.247943 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.248162 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.248252 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.248483 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.248591 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.248795 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.248890 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.249117 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.249205 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.249530 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.249618 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.249854 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.249947 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.250166 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.250255 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.250488 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.250577 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.250813 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.250947 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.251120 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.251209 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.251426 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.251515 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.251759 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.251851 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.252064 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.252154 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.252370 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.252537 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.252694 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.252785 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.252999 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.253087 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.253310 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.253409 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.253618 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.253706 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.253922 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.254021 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.254227 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.254325 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.254530 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.254618 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.254851 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.254939 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.255155 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.255274 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.255478 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.255628 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.255816 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.255949 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.256140 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.256278 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.256460 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.256633 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.256794 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.256945 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.257116 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.257257 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.257424 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.257573 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.257728 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.257881 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.258031 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.258192 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.258336 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.258521 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.258662 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.258830 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.258969 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.259144 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.259289 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.259459 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.259638 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.259799 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.259973 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.260110 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.260284 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.260419 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.260615 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.260746 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.260944 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.261060 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.261264 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.261387 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.261574 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.261703 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.261892 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.262030 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.262218 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.262355 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.262525 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.262666 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.262832 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.262988 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.263143 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.263298 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.263448 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.263624 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.263775 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.263934 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.264080 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.264242 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.264390 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.264586 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.264689 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.264898 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.264988 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.265221 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.265319 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.265554 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.265647 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.265874 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.265963 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.266187 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.266284 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.266492 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.266580 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.266801 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.266897 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.267105 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.267194 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.267407 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.267494 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.267769 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.267860 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.268076 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.268166 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.268397 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.268485 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.268705 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.268801 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.269018 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.269107 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.269328 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.269416 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.269636 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.269724 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.269944 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.270042 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.270256 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.270342 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.270561 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.270657 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.270872 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.270968 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.271180 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.271269 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.271484 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.271691 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.271822 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.271911 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.272159 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.272261 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.272469 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.272567 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.272777 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.272984 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.273072 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.273319 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.273408 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.273643 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.273754 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.273961 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.274058 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.274276 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.274380 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.274591 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.274682 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.274906 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.274997 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.275268 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.275374 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.275527 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.275704 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.275861 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.275950 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.276172 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.276272 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.276489 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.276578 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.276808 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.276897 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.277127 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.277231 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.277440 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.277530 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.277759 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.277850 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.278074 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.278162 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.278390 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.278528 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.278705 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.278905 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.279060 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.279241 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.279375 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.279562 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.279707 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.279901 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.280021 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.280219 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.280336 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.280536 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.280653 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.280856 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.280967 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.281171 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.281260 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.281486 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.281589 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.281803 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.281895 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.282117 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.282206 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.282448 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.282546 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.282771 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.282861 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.283085 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.283174 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.283408 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.283505 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.283760 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.283852 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.284082 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.284169 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.284398 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.284498 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.284715 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.284813 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.285032 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.285121 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.285373 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.285548 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.285674 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.285865 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.285991 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.286200 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.286297 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.286527 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.286616 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.286858 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.286954 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.287176 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.287266 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.287497 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.287605 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.288374 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.288474 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.288682 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.288781 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.288990 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.289087 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.289301 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.289390 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.289611 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.289700 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.289914 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.289999 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.290234 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.290330 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.290543 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.290632 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.290845 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.290932 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.291164 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.291261 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.291475 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.291583 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.292026 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.292115 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.292343 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.292444 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.292676 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.292764 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.293004 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.293092 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.293329 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.293426 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.293645 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.293733 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.293952 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.294039 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.294278 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.294376 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.294586 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.294674 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.294892 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.294981 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.295203 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.295299 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.295512 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.295628 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.295842 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.295932 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.296149 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.296246 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.296459 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.296547 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.296764 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.296851 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.297067 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.297154 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.297385 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.297473 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.297690 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.297912 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.298013 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.298262 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.298363 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.298583 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.298711 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.298891 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.298987 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.299200 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.299289 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.299506 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.299615 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.299838 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.299928 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.300144 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.300233 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.300450 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.300540 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.300763 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.300853 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.301069 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.301161 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.301378 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.301475 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.301686 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.301776 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.301992 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.302087 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.302306 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.302404 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.302619 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.302708 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.302927 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.303015 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.303241 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.303340 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.304129 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.304225 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.304464 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.304554 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.304778 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.304877 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.305088 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.305183 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.305395 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.305483 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.305710 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.305807 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.306020 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.306110 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.306327 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.306415 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.306636 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.306733 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.306946 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.307189 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.307278 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.307532 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.307653 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.307877 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.307967 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.308186 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.308274 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.308501 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.308599 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.309083 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.309175 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.309391 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.309480 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.309699 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.309799 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.310024 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.310113 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.310334 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.310421 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.310644 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.310734 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.310953 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.311078 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.311263 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.311351 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.311675 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.311769 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.311908 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.311996 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.312220 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.312308 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.312529 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.312620 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.312838 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.312927 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.313150 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.313450 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.313541 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.313757 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.313856 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.314068 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.314157 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.314378 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.314467 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.314692 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.314780 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.315036 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.315125 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.315346 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.315434 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.315683 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.315820 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.315999 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.316089 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.316317 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.316413 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.316625 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.316712 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.316937 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.317033 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.317248 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.317336 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.317559 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.317646 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.317869 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.317965 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.318182 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.318279 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.318494 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.318583 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.318796 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.318892 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.319132 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.319449 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.319537 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.319789 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.319891 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.320104 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.320200 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.320417 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.320506 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.320734 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.320836 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.321070 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.321217 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.321395 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.321483 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.321708 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.321804 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.322027 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.322130 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.322344 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.322452 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.322658 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.322785 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.323012 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.323287 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.323399 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.323596 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.323706 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.323907 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.323996 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.324234 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.324322 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.324569 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.324671 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.324879 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.324969 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.325251 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.325344 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.325499 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.325878 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.325984 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.326249 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.326343 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.326534 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.326637 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.326870 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.326961 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.327529 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.327627 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.327711 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.327795 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.327876 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.327954 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.328108 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.328205 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.328402 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.328499 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.328710 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.328805 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.329019 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.329138 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.329323 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.329423 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.329628 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.329750 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.329933 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.330083 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.330241 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.330380 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.330594 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.330692 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.330853 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.330994 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.331157 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.331311 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.331462 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.331665 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.331794 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.331981 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.332130 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.332292 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.332464 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.332603 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.332780 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.332918 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.333105 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.333231 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.333420 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.333578 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.333767 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.333908 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.334129 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.334218 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.334386 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.334519 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.334781 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.334874 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.335080 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.335194 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.335368 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.335464 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.335693 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.335827 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.336133 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.336233 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.336326 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.336443 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.336593 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.336711 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.336907 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.337147 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.337241 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.337471 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.337680 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.337830 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.338024 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.338218 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.338374 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.338529 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.338681 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.338857 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.339002 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.339147 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.339300 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.339636 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.339844 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.339993 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.340154 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.340481 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.340648 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.340804 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.340976 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.341181 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.341362 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.341514 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.341705 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.341871 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.342016 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.342168 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.342371 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.342617 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.342774 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.342958 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.343138 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.343345 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.343496 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.343694 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.343841 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.344056 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.344212 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.344370 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.344519 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.344726 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.344894 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.345047 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.345247 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.345432 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.345579 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.345733 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.345877 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.346039 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.346255 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.346405 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.346562 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.346797 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.346959 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.347103 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.347256 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.347400 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.347552 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.347743 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.347888 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348041 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348185 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348336 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348488 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348631 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348784 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 08:49:03.348929 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348929 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348929 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348929 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.348929 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.349694 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.349694 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.349975 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.350127 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.350975 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.351293 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.351652 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.351986 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.352345 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.352664 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.353014 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.353351 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.353674 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.353988 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.354299 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:49:03.354545 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 08:49:03.502532 n-d-858383-16 devstack@n-api.service[104584]: INFO dbcounter [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Registered counter for database nova_api Oct 27 08:49:03.508917 n-d-858383-16 devstack@n-api.service[104583]: INFO dbcounter [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Registered counter for database nova_api Oct 27 08:49:03.524902 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:49:03.528426 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_db.sqlalchemy.engines [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:49:03.531578 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writer thread running {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:49:03.534757 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writer thread running {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:49:03.588424 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.context [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) {{(pid=104584) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 08:49:03.590886 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.context [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) {{(pid=104583) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 08:49:03.592241 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_concurrency.lockutils [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:49:03.592717 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_concurrency.lockutils [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:49:03.594307 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_concurrency.lockutils [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:49:03.594719 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:49:03.595026 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_concurrency.lockutils [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:49:03.595197 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:49:03.595474 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_concurrency.lockutils [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:49:03.596822 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:49:03.597534 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_concurrency.lockutils [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:49:03.597627 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:49:03.597978 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:49:03.599530 n-d-858383-16 devstack@n-api.service[104584]: INFO dbcounter [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Registered counter for database nova_cell0 Oct 27 08:49:03.600097 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:49:03.602127 n-d-858383-16 devstack@n-api.service[104583]: INFO dbcounter [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Registered counter for database nova_cell0 Oct 27 08:49:03.603874 n-d-858383-16 devstack@n-api.service[104584]: INFO dbcounter [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Registered counter for database nova_cell1 Oct 27 08:49:03.606168 n-d-858383-16 devstack@n-api.service[104583]: INFO dbcounter [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Registered counter for database nova_cell1 Oct 27 08:49:03.611180 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:49:03.613617 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:49:03.614428 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_db.sqlalchemy.engines [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:49:03.618519 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_db.sqlalchemy.engines [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:49:03.620105 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writer thread running {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:49:03.620971 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writer thread running {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:49:03.623530 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writer thread running {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:49:03.756154 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writer thread running {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:49:03.766071 n-d-858383-16 devstack@n-api.service[104584]: INFO dbcounter [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Registered counter for database nova_cell0 Oct 27 08:49:03.766353 n-d-858383-16 devstack@n-api.service[104583]: INFO dbcounter [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Registered counter for database nova_cell0 Oct 27 08:49:03.773754 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_db.sqlalchemy.engines [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:49:03.777242 n-d-858383-16 devstack@n-api.service[104584]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:49:03.778461 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writer thread running {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:49:03.781912 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writer thread running {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:49:04.117276 n-d-858383-16 devstack@n-api.service[104583]: WARNING keystonemiddleware.auth_token [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 08:49:04.121702 n-d-858383-16 devstack@n-api.service[104584]: WARNING keystonemiddleware.auth_token [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 08:49:04.124635 n-d-858383-16 devstack@n-api.service[104583]: WARNING keystonemiddleware.auth_token [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 08:49:04.128984 n-d-858383-16 devstack@n-api.service[104584]: WARNING keystonemiddleware.auth_token [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 08:49:04.468726 n-d-858383-16 devstack@n-api.service[104583]: WARNING keystonemiddleware.auth_token [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 08:49:04.473883 n-d-858383-16 devstack@n-api.service[104584]: WARNING keystonemiddleware.auth_token [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 08:49:04.474676 n-d-858383-16 devstack@n-api.service[104583]: WARNING keystonemiddleware.auth_token [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 08:49:04.479868 n-d-858383-16 devstack@n-api.service[104584]: WARNING keystonemiddleware.auth_token [None req-c9f889dd-5761-43f6-b8ed-ec6e431ce943 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 08:49:04.480012 n-d-858383-16 devstack@n-api.service[104583]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d208aa49c0 pid: 104583 (default app) Oct 27 08:49:04.482085 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:49:04.483262 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Oct 27 08:49:04.484002 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Thu Oct 27 08:49:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:49:04.485132 n-d-858383-16 devstack@n-api.service[104584]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d208aa49c0 pid: 104584 (default app) Oct 27 08:50:24.861536 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:24.862989 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Oct 27 08:50:24.863378 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:24.875254 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writing DB stats nova_api:SELECT=3 {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:50:24.876073 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writing DB stats nova_cell1:SELECT=3 {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:50:24.876778 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writing DB stats nova_cell0:SELECT=3 {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:50:24.879934 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:50:25.749678 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-2bf3dd63-9859-4ede-8483-4e63ce1a439a admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:25.782495 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-2bf3dd63-9859-4ede-8483-4e63ce1a439a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912393 Oct 27 08:50:25.783226 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Oct 27 08:50:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 08:50:28.407523 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:28.408763 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-11bfc54b-e3fc-43e5-abe4-c751ece1da99 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 27 08:50:28.409273 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:28.856692 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-cf302dd0-1d3b-41bc-9912-abdb8d2c2e02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:28.902515 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-cf302dd0-1d3b-41bc-9912-abdb8d2c2e02 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487248 Oct 27 08:50:28.903066 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:50:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:50:28.917165 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_api:SELECT=3 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:50:28.917983 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_cell0:SELECT=3 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:50:28.920057 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_cell1:SELECT=3 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:50:28.920796 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:50:29.124673 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-9c5b5aee-8583-47fd-b1f4-01e1c5761ad4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:29.191697 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-9c5b5aee-8583-47fd-b1f4-01e1c5761ad4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279649 Oct 27 08:50:29.192498 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Oct 27 08:50:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 08:50:31.815777 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-cf302dd0-1d3b-41bc-9912-abdb8d2c2e02 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:31.816806 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-cf302dd0-1d3b-41bc-9912-abdb8d2c2e02 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 27 08:50:31.817389 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:32.607827 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-cd2a13d1-c3cb-4817-bcf8-3622ccf997e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "id": "d1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:32.660727 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-cd2a13d1-c3cb-4817-bcf8-3622ccf997e3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.834858 Oct 27 08:50:32.668221 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:50:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:50:32.673648 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-eb9559e3-b44a-4a3c-b6c4-35ea32e9a5d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:32.736888 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-eb9559e3-b44a-4a3c-b6c4-35ea32e9a5d4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067445 Oct 27 08:50:32.738300 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Oct 27 08:50:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:50:35.598034 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-cd2a13d1-c3cb-4817-bcf8-3622ccf997e3 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:35.599114 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-cd2a13d1-c3cb-4817-bcf8-3622ccf997e3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Oct 27 08:50:35.605041 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:36.148002 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-bce3d449-8ebd-485f-84d1-73d9eda22281 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:36.168481 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-bce3d449-8ebd-485f-84d1-73d9eda22281 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.561090 Oct 27 08:50:36.169023 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:50:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 08:50:36.181548 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-f3b53267-5a93-4b06-9489-6ab827159da9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:36.211761 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-f3b53267-5a93-4b06-9489-6ab827159da9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034011 Oct 27 08:50:36.213024 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Oct 27 08:50:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 08:50:38.809132 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-bce3d449-8ebd-485f-84d1-73d9eda22281 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:38.810077 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-bce3d449-8ebd-485f-84d1-73d9eda22281 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 27 08:50:38.810473 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:39.256705 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-bd9f1052-8fe2-486c-b0b7-160510634038 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:39.281320 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-bd9f1052-8fe2-486c-b0b7-160510634038 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464665 Oct 27 08:50:39.282472 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:50:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:50:39.295314 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-dc719ae0-8309-420e-80fc-a4e6f706af9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:39.341871 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-dc719ae0-8309-420e-80fc-a4e6f706af9e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050263 Oct 27 08:50:39.342432 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Oct 27 08:50:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:50:42.056204 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-bd9f1052-8fe2-486c-b0b7-160510634038 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:42.058466 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-bd9f1052-8fe2-486c-b0b7-160510634038 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002828 Oct 27 08:50:42.059587 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:42.495860 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-782c1765-fcd9-44db-9bf3-60e11f8bbf14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:42.517807 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-782c1765-fcd9-44db-9bf3-60e11f8bbf14 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451578 Oct 27 08:50:42.518352 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:50:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:50:42.530374 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-3fce2cad-c7a9-4854-82ca-2f3243ed76b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:42.555314 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-3fce2cad-c7a9-4854-82ca-2f3243ed76b9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028589 Oct 27 08:50:42.567593 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Oct 27 08:50:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 08:50:45.199860 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-782c1765-fcd9-44db-9bf3-60e11f8bbf14 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:45.200879 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-782c1765-fcd9-44db-9bf3-60e11f8bbf14 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 27 08:50:45.201280 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:45.714399 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-6ef8c279-b732-41fb-bee3-3a7e7de4226a admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:45.739816 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-6ef8c279-b732-41fb-bee3-3a7e7de4226a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.532385 Oct 27 08:50:45.740361 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Oct 27 08:50:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:50:48.463277 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-782c1765-fcd9-44db-9bf3-60e11f8bbf14 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:48.464585 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-782c1765-fcd9-44db-9bf3-60e11f8bbf14 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Oct 27 08:50:48.465143 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:48.954668 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-b2598f1f-228b-44eb-9817-efd70bf8b5f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:48.977238 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-b2598f1f-228b-44eb-9817-efd70bf8b5f9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.503743 Oct 27 08:50:48.977962 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:50:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:50:48.994968 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-fa03978a-7c8c-4245-a603-79809f009366 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:49.029825 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-fa03978a-7c8c-4245-a603-79809f009366 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040225 Oct 27 08:50:49.030630 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Oct 27 08:50:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:50:51.788777 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-b2598f1f-228b-44eb-9817-efd70bf8b5f9 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:51.789825 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-b2598f1f-228b-44eb-9817-efd70bf8b5f9 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 27 08:50:51.790232 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:52.181508 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-f6dfd116-9905-4092-92c5-313918aeb6c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:52.200804 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-f6dfd116-9905-4092-92c5-313918aeb6c2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.404541 Oct 27 08:50:52.201345 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:50:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:50:52.214070 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-8ad0ecb8-64d3-4625-9f9a-f81255a8813a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:52.238874 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-8ad0ecb8-64d3-4625-9f9a-f81255a8813a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028442 Oct 27 08:50:52.239449 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Oct 27 08:50:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:50:54.824925 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-f6dfd116-9905-4092-92c5-313918aeb6c2 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:54.825938 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-f6dfd116-9905-4092-92c5-313918aeb6c2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 27 08:50:54.826331 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:55.259538 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-854eafac-6188-486f-8f2b-f853f6450d8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "swap": 0}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:55.282275 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-854eafac-6188-486f-8f2b-f853f6450d8f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449501 Oct 27 08:50:55.282832 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:50:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 08:50:55.295368 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-93e9ed64-a2d3-4a00-aea0-94a109e988cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:55.300271 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:50:55.325030 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-93e9ed64-a2d3-4a00-aea0-94a109e988cd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033078 Oct 27 08:50:55.325966 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Oct 27 08:50:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:50:57.955187 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-854eafac-6188-486f-8f2b-f853f6450d8f admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:50:57.956177 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-854eafac-6188-486f-8f2b-f853f6450d8f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 27 08:50:57.956740 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:50:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:50:58.413460 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-98672b22-f885-43a7-a631-f3ba8189e93a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "disk": 80, "vcpus": 4}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:58.433849 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-98672b22-f885-43a7-a631-f3ba8189e93a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471259 Oct 27 08:50:58.434415 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:50:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 08:50:58.447102 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-f298b14e-9292-44b5-8195-83dc39d51fac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:50:58.471471 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-f298b14e-9292-44b5-8195-83dc39d51fac admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028163 Oct 27 08:50:58.472233 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Oct 27 08:50:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:51:01.101638 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-98672b22-f885-43a7-a631-f3ba8189e93a admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:01.102657 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-98672b22-f885-43a7-a631-f3ba8189e93a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 27 08:51:01.103053 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:51:01.543884 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-06115576-917b-4e36-a586-a0e9a6203ecd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "ram": 16384, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:51:01.551331 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:51:01.567112 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-06115576-917b-4e36-a586-a0e9a6203ecd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458031 Oct 27 08:51:01.567688 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Oct 27 08:51:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 08:51:01.585184 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-eeeaeff4-450d-4f29-b98b-6e64e3a623e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:51:01.612963 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-eeeaeff4-450d-4f29-b98b-6e64e3a623e1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032252 Oct 27 08:51:01.613549 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Oct 27 08:51:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:51:23.818458 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-06115576-917b-4e36-a586-a0e9a6203ecd admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:23.819476 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-06115576-917b-4e36-a586-a0e9a6203ecd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 27 08:51:23.819932 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:51:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:51:23.831193 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:51:24.261118 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-6136726c-29f2-4ed4-8c3a-2ce9ca53b6d6 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:24.279103 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-6136726c-29f2-4ed4-8c3a-2ce9ca53b6d6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.452887 Oct 27 08:51:24.279673 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Oct 27 08:51:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:51:25.589004 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-06115576-917b-4e36-a586-a0e9a6203ecd admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:25.590003 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-06115576-917b-4e36-a586-a0e9a6203ecd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 27 08:51:25.590400 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:51:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:51:26.126699 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-e8924b72-d820-455d-b9e5-cd84d9944785 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:26.132059 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.wsgi [None req-e8924b72-d820-455d-b9e5-cd84d9944785 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-e8924b72-d820-455d-b9e5-cd84d9944785 admin admin] Request method failure captured: Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: Accept: application/json Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: Accept-Encoding: gzip, deflate Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: Connection: keep-alive Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: Content-Length: 0 Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: Host: 10.222.0.25 Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: Openstack-Api-Version: compute 2.92 Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: Openstack-System-Scope: None Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: User-Agent: python-novaclient Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Auth-Token: gAAAAABjWkaNK3me3AwKl3eOuXTmmS8qrP9go5kyI9BP_dnRzCpsc_n4-NWvnS5sPU_TRoQD9lqwE-0LuIzDP_BznbwMGOQI5nT58rZOZ2bvo26e_WyWrpKyXnUFJsYu9bJR8pal70vE86YglbgdUgS1fG6bgbjfkatV4k_zaujSB5pXBiLw0ko Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Domain-Id: None Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Domain-Name: None Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Identity-Status: Confirmed Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Is-Admin-Project: True Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Domain-Id: default Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Domain-Name: Default Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Name: admin Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Role: admin,member,reader Oct 27 08:51:26.135263 n-d-858383-16 devstack@n-api.service[104584]: X-Roles: admin,member,reader Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3f6a11e88164e99b669c57fd37ce47d"}]}] Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: X-Tenant: admin Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: X-Tenant-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: X-Tenant-Name: admin Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: X-User: admin Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: X-User-Domain-Id: default Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: X-User-Domain-Name: Default Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: X-User-Id: 3ac90e71bd4c415e9ee71df2dc9b28a4 Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: X-User-Name: admin Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: method: > Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: exception: Flavor 42 could not be found. Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: action_args: {'id': '42'} Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:51:26.136833 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:26.137732 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.138984 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-e8924b72-d820-455d-b9e5-cd84d9944785 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:51:26.140363 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-e8924b72-d820-455d-b9e5-cd84d9944785 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390471 Oct 27 08:51:26.140363 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Oct 27 08:51:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 08:51:26.146971 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-c0035539-2eba-4c7b-a71f-72bb550dd651 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:26.168480 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-c0035539-2eba-4c7b-a71f-72bb550dd651 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025146 Oct 27 08:51:26.169001 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Oct 27 08:51:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:51:26.184058 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-e905f1c8-892e-4be0-8466-93eaf2572b2d admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:26.206411 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-e905f1c8-892e-4be0-8466-93eaf2572b2d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027122 Oct 27 08:51:26.206936 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Oct 27 08:51:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:51:26.216190 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-480a3771-8101-4f0f-add1-536fda3f7d87 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:26.221715 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.wsgi [None req-480a3771-8101-4f0f-add1-536fda3f7d87 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-480a3771-8101-4f0f-add1-536fda3f7d87 admin admin] Request method failure captured: Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: Accept: application/json Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: Accept-Encoding: gzip, deflate Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: Connection: keep-alive Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: Content-Length: 0 Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: Host: 10.222.0.25 Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: Openstack-Api-Version: compute 2.92 Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: Openstack-System-Scope: None Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: User-Agent: python-novaclient Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Auth-Token: gAAAAABjWkaNK3me3AwKl3eOuXTmmS8qrP9go5kyI9BP_dnRzCpsc_n4-NWvnS5sPU_TRoQD9lqwE-0LuIzDP_BznbwMGOQI5nT58rZOZ2bvo26e_WyWrpKyXnUFJsYu9bJR8pal70vE86YglbgdUgS1fG6bgbjfkatV4k_zaujSB5pXBiLw0ko Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Domain-Id: None Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Domain-Name: None Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Identity-Status: Confirmed Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Is-Admin-Project: True Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Domain-Id: default Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Domain-Name: Default Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Name: admin Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Role: admin,member,reader Oct 27 08:51:26.225234 n-d-858383-16 devstack@n-api.service[104583]: X-Roles: admin,member,reader Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3f6a11e88164e99b669c57fd37ce47d"}]}] Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: X-Tenant: admin Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: X-Tenant-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: X-Tenant-Name: admin Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: X-User: admin Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: X-User-Domain-Id: default Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: X-User-Domain-Name: Default Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: X-User-Id: 3ac90e71bd4c415e9ee71df2dc9b28a4 Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: X-User-Name: admin Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: method: > Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: exception: Flavor 42 could not be found. Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: action_args: {'id': '42'} Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:51:26.226668 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:26.227476 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:26.228681 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-480a3771-8101-4f0f-add1-536fda3f7d87 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:51:26.230229 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-480a3771-8101-4f0f-add1-536fda3f7d87 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014211 Oct 27 08:51:26.230229 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Oct 27 08:51:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 08:51:27.416819 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-e905f1c8-892e-4be0-8466-93eaf2572b2d admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:27.417826 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-e905f1c8-892e-4be0-8466-93eaf2572b2d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 27 08:51:27.418243 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:51:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:51:27.955629 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-dad24775-51f8-4fbe-a0c9-08520b4b9684 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:27.960676 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.wsgi [None req-dad24775-51f8-4fbe-a0c9-08520b4b9684 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-dad24775-51f8-4fbe-a0c9-08520b4b9684 admin admin] Request method failure captured: Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: Accept: application/json Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: Accept-Encoding: gzip, deflate Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: Connection: keep-alive Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: Content-Length: 0 Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: Host: 10.222.0.25 Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: Openstack-Api-Version: compute 2.92 Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: Openstack-System-Scope: None Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: User-Agent: python-novaclient Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Auth-Token: gAAAAABjWkaPJ-umACQJxrOzEBfUj6oN8Dr25KMPUb-NyUImtXKYqUOqi0OrTnwVVdvMYf9MNVoud6FJxQnS5LGVcvSWiFlz3maRjO5xQlVfOQqExXEYZiTFuU0J8pfhSW4g1EJ5EjoFN6lswKwJrgSvt_iJSWcOKYdLDx8gTteooWWvOGwfldU Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Domain-Id: None Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Domain-Name: None Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Identity-Status: Confirmed Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Is-Admin-Project: True Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Domain-Id: default Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Domain-Name: Default Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Name: admin Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Role: admin,member,reader Oct 27 08:51:27.962163 n-d-858383-16 devstack@n-api.service[104583]: X-Roles: admin,member,reader Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3f6a11e88164e99b669c57fd37ce47d"}]}] Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: X-Tenant: admin Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: X-Tenant-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: X-Tenant-Name: admin Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: X-User: admin Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: X-User-Domain-Id: default Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: X-User-Domain-Name: Default Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: X-User-Id: 3ac90e71bd4c415e9ee71df2dc9b28a4 Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: X-User-Name: admin Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: method: > Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: exception: Flavor 84 could not be found. Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: action_args: {'id': '84'} Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:51:27.963778 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:27.964840 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:27.966273 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-dad24775-51f8-4fbe-a0c9-08520b4b9684 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:51:27.967546 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-dad24775-51f8-4fbe-a0c9-08520b4b9684 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.409203 Oct 27 08:51:27.967546 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Oct 27 08:51:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 08:51:27.973876 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-9c245b55-3a18-4f6b-b14a-64e8b14238e1 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:27.988882 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-9c245b55-3a18-4f6b-b14a-64e8b14238e1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018584 Oct 27 08:51:27.989443 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Oct 27 08:51:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:51:27.999221 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-1f184b1b-00c5-4472-88f3-2204618d354c admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:28.015139 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-1f184b1b-00c5-4472-88f3-2204618d354c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019337 Oct 27 08:51:28.015738 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Oct 27 08:51:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:51:28.026794 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-293e8adb-adc7-45a7-9baa-d1284273de33 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:28.033187 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.wsgi [None req-293e8adb-adc7-45a7-9baa-d1284273de33 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-293e8adb-adc7-45a7-9baa-d1284273de33 admin admin] Request method failure captured: Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: Accept: application/json Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: Accept-Encoding: gzip, deflate Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: Connection: keep-alive Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: Content-Length: 0 Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: Host: 10.222.0.25 Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: Openstack-Api-Version: compute 2.92 Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: Openstack-System-Scope: None Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: User-Agent: python-novaclient Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Auth-Token: gAAAAABjWkaPJ-umACQJxrOzEBfUj6oN8Dr25KMPUb-NyUImtXKYqUOqi0OrTnwVVdvMYf9MNVoud6FJxQnS5LGVcvSWiFlz3maRjO5xQlVfOQqExXEYZiTFuU0J8pfhSW4g1EJ5EjoFN6lswKwJrgSvt_iJSWcOKYdLDx8gTteooWWvOGwfldU Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Domain-Id: None Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Domain-Name: None Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Identity-Status: Confirmed Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Is-Admin-Project: True Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Domain-Id: default Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Domain-Name: Default Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Name: admin Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Role: admin,member,reader Oct 27 08:51:28.034699 n-d-858383-16 devstack@n-api.service[104584]: X-Roles: admin,member,reader Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3f6a11e88164e99b669c57fd37ce47d"}]}] Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: X-Tenant: admin Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: X-Tenant-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: X-Tenant-Name: admin Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: X-User: admin Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: X-User-Domain-Id: default Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: X-User-Domain-Name: Default Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: X-User-Id: 3ac90e71bd4c415e9ee71df2dc9b28a4 Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: X-User-Name: admin Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: method: > Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: exception: Flavor 84 could not be found. Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: action_args: {'id': '84'} Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:51:28.036188 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:28.036960 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:28.038158 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-293e8adb-adc7-45a7-9baa-d1284273de33 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:51:28.039169 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-293e8adb-adc7-45a7-9baa-d1284273de33 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013767 Oct 27 08:51:28.039169 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Oct 27 08:51:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 27 08:51:29.341357 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-1f184b1b-00c5-4472-88f3-2204618d354c admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:29.342363 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-1f184b1b-00c5-4472-88f3-2204618d354c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 27 08:51:29.342761 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 08:51:29.886857 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-c147f9aa-c917-4631-8ea2-613cbec24b75 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:29.893394 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.wsgi [None req-c147f9aa-c917-4631-8ea2-613cbec24b75 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-c147f9aa-c917-4631-8ea2-613cbec24b75 admin admin] Request method failure captured: Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: Accept: application/json Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: Accept-Encoding: gzip, deflate Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: Connection: keep-alive Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: Content-Length: 0 Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: Host: 10.222.0.25 Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: Openstack-Api-Version: compute 2.92 Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: Openstack-System-Scope: None Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: User-Agent: python-novaclient Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Auth-Token: gAAAAABjWkaRQokgCdplAMQljRWkBZ7TApPbBXVt3sczYE63vYVNvr9i7EnswUuiNA-w3lFqf_Esak2AzagXOgjgyBAXnmp7XRR3oKt3mJ4sRS6ja5Jpc7S2dSnfsI0r2QF-TbnrqiEaM6hrWag6ffbXcUx17oEHtFMNPRMg5Qp2Srx0eIOAD0g Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Domain-Id: None Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Domain-Name: None Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Identity-Status: Confirmed Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Is-Admin-Project: True Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Domain-Id: default Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Domain-Name: Default Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Project-Name: admin Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Role: admin,member,reader Oct 27 08:51:29.894931 n-d-858383-16 devstack@n-api.service[104584]: X-Roles: admin,member,reader Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3f6a11e88164e99b669c57fd37ce47d"}]}] Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: X-Tenant: admin Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: X-Tenant-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: X-Tenant-Name: admin Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: X-User: admin Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: X-User-Domain-Id: default Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: X-User-Domain-Name: Default Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: X-User-Id: 3ac90e71bd4c415e9ee71df2dc9b28a4 Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: X-User-Name: admin Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: method: > Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: exception: Flavor 451 could not be found. Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: action_args: {'id': '451'} Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:51:29.896457 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:29.897378 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.898540 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-c147f9aa-c917-4631-8ea2-613cbec24b75 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:51:29.899827 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-c147f9aa-c917-4631-8ea2-613cbec24b75 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.405574 Oct 27 08:51:29.899827 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Oct 27 08:51:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 08:51:29.906332 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-fa6aaf45-f1d7-4af3-8034-b2987fe4984c admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:29.921030 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-fa6aaf45-f1d7-4af3-8034-b2987fe4984c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018346 Oct 27 08:51:29.921548 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Oct 27 08:51:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:51:29.930785 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:29.946251 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018997 Oct 27 08:51:29.946760 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Oct 27 08:51:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 08:51:29.956230 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-0b27e918-8ff0-4345-9ba1-07a91f9b26c8 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:29.961022 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.wsgi [None req-0b27e918-8ff0-4345-9ba1-07a91f9b26c8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-0b27e918-8ff0-4345-9ba1-07a91f9b26c8 admin admin] Request method failure captured: Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: Accept: application/json Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: Accept-Encoding: gzip, deflate Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: Connection: keep-alive Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: Content-Length: 0 Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: Host: 10.222.0.25 Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: Openstack-Api-Version: compute 2.92 Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: Openstack-System-Scope: None Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: User-Agent: python-novaclient Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Auth-Token: gAAAAABjWkaRQokgCdplAMQljRWkBZ7TApPbBXVt3sczYE63vYVNvr9i7EnswUuiNA-w3lFqf_Esak2AzagXOgjgyBAXnmp7XRR3oKt3mJ4sRS6ja5Jpc7S2dSnfsI0r2QF-TbnrqiEaM6hrWag6ffbXcUx17oEHtFMNPRMg5Qp2Srx0eIOAD0g Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Domain-Id: None Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Domain-Name: None Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Identity-Status: Confirmed Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Is-Admin-Project: True Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Domain-Id: default Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Domain-Name: Default Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Project-Name: admin Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Role: admin,member,reader Oct 27 08:51:29.962505 n-d-858383-16 devstack@n-api.service[104583]: X-Roles: admin,member,reader Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3f6a11e88164e99b669c57fd37ce47d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3f6a11e88164e99b669c57fd37ce47d"}]}] Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: X-Tenant: admin Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: X-Tenant-Id: c3f6a11e88164e99b669c57fd37ce47d Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: X-Tenant-Name: admin Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: X-User: admin Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: X-User-Domain-Id: default Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: X-User-Domain-Name: Default Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: X-User-Id: 3ac90e71bd4c415e9ee71df2dc9b28a4 Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: X-User-Name: admin Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: method: > Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: exception: Flavor 451 could not be found. Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: action_args: {'id': '451'} Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:51:29.964040 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:29.965168 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: ERROR nova.api.openstack.wsgi Oct 27 08:51:29.966597 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-0b27e918-8ff0-4345-9ba1-07a91f9b26c8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:51:29.967927 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-0b27e918-8ff0-4345-9ba1-07a91f9b26c8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011650 Oct 27 08:51:29.967927 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Oct 27 08:51:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 08:51:31.272211 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:31.273538 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 Oct 27 08:51:31.274073 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:51:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:51:31.844805 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-2240e25b-50d0-4bd5-bcd5-84784d115c27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:51:31.864161 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-2240e25b-50d0-4bd5-bcd5-84784d115c27 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.449025 Oct 27 08:51:31.864700 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Oct 27 08:51:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 08:51:33.086247 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:33.087292 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 27 08:51:33.087720 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:51:33.628411 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-ed4e83dc-df81-40e7-ac8b-465cdd5bd4b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:51:33.647108 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-ed4e83dc-df81-40e7-ac8b-465cdd5bd4b6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.419800 Oct 27 08:51:33.647689 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Oct 27 08:51:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 08:51:34.885510 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:34.886509 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 27 08:51:34.886903 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:51:35.433918 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-7cc2dedf-ce70-405d-ad8e-ada29aa69cf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:51:35.455127 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-7cc2dedf-ce70-405d-ad8e-ada29aa69cf0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.429047 Oct 27 08:51:35.455699 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Oct 27 08:51:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:51:36.682237 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:36.683507 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Oct 27 08:51:36.683944 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:51:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:51:37.209613 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-d591645f-58e6-475c-9754-4612ca0dc285 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:51:37.228265 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-d591645f-58e6-475c-9754-4612ca0dc285 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.407372 Oct 27 08:51:37.228736 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Oct 27 08:51:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:51:38.436174 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:38.437646 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Oct 27 08:51:38.438102 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:51:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:51:38.951806 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-b1c88271-fa1a-4622-8768-37b973239894 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:51:38.972438 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-b1c88271-fa1a-4622-8768-37b973239894 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397875 Oct 27 08:51:38.972981 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Thu Oct 27 08:51:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:52:35.394663 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:52:35.395718 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-143c2cd2-31c7-4e9e-9fa9-051ff725d952 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 27 08:52:35.396129 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Thu Oct 27 08:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:52:35.407155 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:52:35.779950 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-e7899c80-ee9c-44b6-97cd-99b6581e0d58 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:52:35.800283 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-e7899c80-ee9c-44b6-97cd-99b6581e0d58 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398206 Oct 27 08:52:35.800820 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Oct 27 08:52:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 08:52:35.823012 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writing DB stats nova_api:SELECT=14 {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:52:35.827507 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-d0cd23a7-5e98-4470-bd66-dde7bb06e222 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:52:35.834695 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-d0cd23a7-5e98-4470-bd66-dde7bb06e222 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013099 Oct 27 08:52:35.835206 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Oct 27 08:52:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:52:35.846703 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-fa6843b1-7049-453c-b511-e7523e25cd85 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:52:35.853856 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-fa6843b1-7049-453c-b511-e7523e25cd85 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010703 Oct 27 08:52:35.854365 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Oct 27 08:52:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 08:52:35.865385 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-33727de8-85a7-41cd-bf86-070f45b5e7c8 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:52:35.872395 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-33727de8-85a7-41cd-bf86-070f45b5e7c8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010466 Oct 27 08:52:35.872907 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Oct 27 08:52:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:52:35.884402 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-10be772d-c63e-40c4-bf1b-22533afb754f admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:52:35.891975 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-10be772d-c63e-40c4-bf1b-22533afb754f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011124 Oct 27 08:52:35.892493 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Oct 27 08:52:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:57:55.908348 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-33727de8-85a7-41cd-bf86-070f45b5e7c8 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:57:55.909393 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-33727de8-85a7-41cd-bf86-070f45b5e7c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Oct 27 08:57:55.909809 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:57:56.049017 n-d-858383-16 devstack@n-api.service[104583]: DEBUG dbcounter [-] [104583] Writing DB stats nova_api:SELECT=6 {{(pid=104583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:57:56.199309 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-80b65d71-d501-4aa8-928c-566272c86447 admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:57:56.204504 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-80b65d71-d501-4aa8-928c-566272c86447 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:57:56.205104 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-80b65d71-d501-4aa8-928c-566272c86447 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:57:56.205532 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-80b65d71-d501-4aa8-928c-566272c86447 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:57:56.206321 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-80b65d71-d501-4aa8-928c-566272c86447 admin admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:57:56.206912 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-80b65d71-d501-4aa8-928c-566272c86447 admin admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:57:56.207978 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-80b65d71-d501-4aa8-928c-566272c86447 admin admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:57:56.248756 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-80b65d71-d501-4aa8-928c-566272c86447 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.200854 Oct 27 08:57:56.249320 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Oct 27 08:57:56 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:57:57.332999 n-d-858383-16 devstack@n-api.service[104584]: DEBUG nova.api.openstack.wsgi [None req-33727de8-85a7-41cd-bf86-070f45b5e7c8 admin admin] Calling method '>' {{(pid=104584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:57:57.334027 n-d-858383-16 devstack@n-api.service[104584]: INFO nova.api.openstack.requestlog [None req-33727de8-85a7-41cd-bf86-070f45b5e7c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Oct 27 08:57:57.334429 n-d-858383-16 devstack@n-api.service[104584]: [pid: 104584|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Oct 27 08:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:57:57.531986 n-d-858383-16 devstack@n-api.service[104583]: DEBUG nova.api.openstack.wsgi [None req-cce077b1-0fc9-4944-8c66-5d35a2ee668a admin admin] Calling method '>' {{(pid=104583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:57:57.535898 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-cce077b1-0fc9-4944-8c66-5d35a2ee668a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:57:57.536375 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-cce077b1-0fc9-4944-8c66-5d35a2ee668a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:57:57.536825 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-cce077b1-0fc9-4944-8c66-5d35a2ee668a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:57:57.537541 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-cce077b1-0fc9-4944-8c66-5d35a2ee668a admin admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:57:57.537985 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-cce077b1-0fc9-4944-8c66-5d35a2ee668a admin admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:57:57.538400 n-d-858383-16 devstack@n-api.service[104583]: DEBUG oslo_concurrency.lockutils [None req-cce077b1-0fc9-4944-8c66-5d35a2ee668a admin admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:57:57.562314 n-d-858383-16 devstack@n-api.service[104583]: INFO nova.api.openstack.requestlog [None req-cce077b1-0fc9-4944-8c66-5d35a2ee668a admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.084593 Oct 27 08:57:57.562796 n-d-858383-16 devstack@n-api.service[104583]: [pid: 104583|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Oct 27 08:57:57 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:58:45.431826 n-d-858383-16 devstack@n-api.service[104582]: Thu Oct 27 08:58:45 2022 - graceful shutdown triggered... Oct 27 08:58:45.432403 n-d-858383-16 devstack@n-api.service[104584]: Gracefully killing worker 2 (pid: 104584)... Oct 27 08:58:45.431848 n-d-858383-16 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 08:58:45.433766 n-d-858383-16 devstack@n-api.service[104583]: Gracefully killing worker 1 (pid: 104583)... Oct 27 08:58:45.557804 n-d-858383-16 devstack@n-api.service[104584]: DEBUG dbcounter [-] [104584] Writing DB stats nova_api:SELECT=4 {{(pid=104584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:58:46.432848 n-d-858383-16 devstack@n-api.service[104582]: worker 1 buried after 1 seconds Oct 27 08:58:46.432848 n-d-858383-16 devstack@n-api.service[104582]: worker 2 buried after 1 seconds Oct 27 08:58:46.432848 n-d-858383-16 devstack@n-api.service[104582]: goodbye to uWSGI. Oct 27 08:58:46.434687 n-d-858383-16 systemd[1]: devstack@n-api.service: Succeeded. Oct 27 08:58:46.435301 n-d-858383-16 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 08:58:46.438152 n-d-858383-16 systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 08:58:46.456799 n-d-858383-16 devstack@n-api.service[120592]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 08:58:46 2022] *** Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: nodename: n-d-858383-16 Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: machine: x86_64 Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: clock source: unix Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: pcre jit disabled Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: detected number of CPU cores: 4 Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: current working directory: / Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: detected binary path: /usr/bin/uwsgi-core Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: your processes number limit is 47680 Oct 27 08:58:46.477021 n-d-858383-16 devstack@n-api.service[120592]: your memory page size is 4096 bytes Oct 27 08:58:46.477973 n-d-858383-16 devstack@n-api.service[120592]: detected max file descriptor number: 2048 Oct 27 08:58:46.477973 n-d-858383-16 devstack@n-api.service[120592]: lock engine: pthread robust mutexes Oct 27 08:58:46.477973 n-d-858383-16 devstack@n-api.service[120592]: thunder lock: enabled Oct 27 08:58:46.477973 n-d-858383-16 devstack@n-api.service[120592]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 08:58:46.477973 n-d-858383-16 devstack@n-api.service[120592]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 08:58:46.517861 n-d-858383-16 devstack@n-api.service[120592]: Python main interpreter initialized at 0x55668c0ab9c0 Oct 27 08:58:46.517861 n-d-858383-16 devstack@n-api.service[120592]: python threads support enabled Oct 27 08:58:46.517861 n-d-858383-16 devstack@n-api.service[120592]: your server socket listen backlog is limited to 100 connections Oct 27 08:58:46.517861 n-d-858383-16 devstack@n-api.service[120592]: your mercy for graceful operations on workers is 90 seconds Oct 27 08:58:46.518255 n-d-858383-16 devstack@n-api.service[120592]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 08:58:46.518255 n-d-858383-16 devstack@n-api.service[120592]: *** Operational MODE: preforking *** Oct 27 08:58:46.518473 n-d-858383-16 devstack@n-api.service[120592]: *** uWSGI is running in multiple interpreter mode *** Oct 27 08:58:46.518473 n-d-858383-16 devstack@n-api.service[120592]: spawned uWSGI master process (pid: 120592) Oct 27 08:58:46.518677 n-d-858383-16 systemd[1]: Started Devstack devstack@n-api.service. Oct 27 08:58:46.520874 n-d-858383-16 devstack@n-api.service[120592]: spawned uWSGI worker 1 (pid: 120602, cores: 1) Oct 27 08:58:46.520874 n-d-858383-16 devstack@n-api.service[120592]: spawned uWSGI worker 2 (pid: 120603, cores: 1) Oct 27 08:58:46.520874 n-d-858383-16 devstack@n-api.service[120592]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 08:58:47.175591 n-d-858383-16 devstack@n-api.service[120603]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 08:58:47.190733 n-d-858383-16 devstack@n-api.service[120602]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 08:58:48.403319 n-d-858383-16 devstack@n-api.service[120603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 08:58:48.403319 n-d-858383-16 devstack@n-api.service[120603]: from cryptography.utils import int_from_bytes Oct 27 08:58:48.403957 n-d-858383-16 devstack@n-api.service[120603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 08:58:48.403957 n-d-858383-16 devstack@n-api.service[120603]: from cryptography.utils import int_from_bytes Oct 27 08:58:48.425681 n-d-858383-16 devstack@n-api.service[120602]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 08:58:48.425681 n-d-858383-16 devstack@n-api.service[120602]: from cryptography.utils import int_from_bytes Oct 27 08:58:48.426240 n-d-858383-16 devstack@n-api.service[120602]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 08:58:48.426240 n-d-858383-16 devstack@n-api.service[120602]: from cryptography.utils import int_from_bytes Oct 27 08:58:50.859641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 08:58:50.860709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 08:58:50.860709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 08:58:50.860709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 08:58:50.861654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 08:58:50.862010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.862471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.862847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.863171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.863510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.863857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.864209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.864491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.864818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.865074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.865390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.865711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-16 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.866031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.866339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.866647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.867069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.867254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.867788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.868264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.868949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.870847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.870847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.870847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.870847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.871447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.871447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.871772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.871934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.872330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.872538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.872980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-16 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.873156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.873467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.873771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.874186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.874508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.874823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.875139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.875454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.875855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.876260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.876682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.877078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.877078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.877831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.877831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.878491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.878491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.879118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.879118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.879118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.879830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.879830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.880324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.880324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.881046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.881046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.881500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.881500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.882033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.882033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.882461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.882694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.882917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.883281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.883501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.883758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.884085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.884385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.884703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.885012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.885334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.885724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.885951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.886192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 08:58:50.886942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.887171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 08:58:50.887400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.887653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 08:58:50.887903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.887903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.888359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 08:58:50.888598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.888835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 08:58:50.889076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.889307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.889529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.889766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.889979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.889979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.890397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.890631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.890880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.891212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.891431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.891664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.891933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.892174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.892174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.892686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.892919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.893122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.893454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.893686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.893902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.894124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.894360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.894581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.894814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.895038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-16 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.895275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.895275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.895770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.896000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.896218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.896456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.896684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.896912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.897129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.897370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.897599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.897833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.897833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.898272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.898489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.898715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.898939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.898939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.899378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.899670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.899915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.900142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.900368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.900597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.900825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.901067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.901407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.901646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.901882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.902109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.902345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.902608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.902608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.903068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.903303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.903688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.903914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.904151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.904376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.904591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.904923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.905149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-16 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.905389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.905619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.905833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.905833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.906276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.906610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.906844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.907057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.907272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.908095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.908333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.908553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.908553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.908941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.909175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.909385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.909620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.909857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.910125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.910350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.910578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.910808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.911036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.911275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.911611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.911611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.912051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.912284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.912516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.912765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.912993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.913228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.913450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.913693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.914044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.914285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.914285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.914699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.914932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.915159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.915393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.915706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.915936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.916162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.916382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.916595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.916826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.917057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.917275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.917493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.917718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.917950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.918175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.918413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.918623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.918854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.919085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.919323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.919530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.919791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.920020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.920242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.920478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.920478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.920914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.921176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.921400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.921739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.922021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.922247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.922492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.922729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.922958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.923743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.924021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.924355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.924571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.924807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.925051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.925288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.925510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.925724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.925724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.926165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.926394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.926797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.927018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.927236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.927464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.927464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.928028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.928275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.928488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.928730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.928951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.929169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.929390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.929612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.929835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.930042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.930255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.930476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.930707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.930942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.931179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.931423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.931423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.932001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.932245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.932473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.932710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.932953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.933418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.933622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.933857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.934086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.934353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.934689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.934919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.935135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.935382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.935625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.935860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.936224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.936444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.936660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.936899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.937111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.937329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.937329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.937755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.937977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.938205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.938434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.938649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.939418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.939662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.939897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.940123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.940349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.940349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.940762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.941001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.941247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.941476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.941704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.941939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.942238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.942466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.942713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.942938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.943151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.943377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.943634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.943871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.943871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.944334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.944566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.944910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.945142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.945371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.945608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.945842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.946067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.946287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.946520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.946520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.946964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.947196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.947406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.947763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.947988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.948195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.948413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.948630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.948853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.949138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.949365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.949601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.949819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.950872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.951143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.951378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.951378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.951849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.952078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.952439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.952664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.952899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.953137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.953368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.953584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.953812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.954060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.954284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.955192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.955420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.955705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.955934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.956178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.956395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.956612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.956834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.957060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.957286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.957526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.957526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.957979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.957979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.958394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.958612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.958846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.959078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.959286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.959286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.959824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.960042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.960289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.960525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.960748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.960946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.961163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.961390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.961611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.961834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.962070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.962317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.962317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.962847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 08:58:50.963080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.963303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.963529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.963777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.963988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.963988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.964421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.964636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.964859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.965073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.965438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.965674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.965903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.966123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.966326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.966571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.966801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.967066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.967285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.967527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.967527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.967994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.968228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.968457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.968689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.968919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.969151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.969421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.969643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.969886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.970125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.970372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.970588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.970821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.971078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.971284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.971528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.971865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.972113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.972361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.972619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.972933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.973158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.973368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.973587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.973811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.974043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.974317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.974540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.974540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.974969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.975211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.975474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.975856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.976094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.976323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.976553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.976782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.977002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.977234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.977494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.977744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.977963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.978217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.978217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.978619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.978845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.979067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.979302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.979514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.979807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.980037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.980249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.980470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.980731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.980731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.981289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.981527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.981766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.981994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.982230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.983342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.983642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.983884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.984104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.984345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.984860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.985090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.985283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.985526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.985954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.986106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.986333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.986479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.986621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.986754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.986886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.987026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.987165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.987304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.987304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.987548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.987779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.987990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.988200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.988414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.988629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.988832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.989058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.989258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.989472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.989472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.989894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.990111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.990336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.990558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.990782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.991008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.991223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.991454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.991835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.992084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.992300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.992568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.992568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.993019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.993368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.993640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.993855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.994107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.994336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.994587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.994800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.995048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.995259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.995495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.995735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.996003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.996321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.996568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.996788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.996788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.997224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.997475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.997699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.997911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.998132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.998343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.998553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.998777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.998989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.999200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.999421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.999675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:50.999929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.000286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.000504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.000716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.000945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.001174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.001938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.002202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.002425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.002651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.002886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.003133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.003133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.003606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.003859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.004125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.004338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.004584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.004840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.005058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.005278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.005500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.005803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.005803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.006290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.006623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.006873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.007105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.007332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.007586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.007807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.008023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.008232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.008232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.008640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.008640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.009069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.009312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.009548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.009789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.010015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.010292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.010516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.010768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.011042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.011278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.011509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.011773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.011993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.012234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.012481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.012762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.013025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.013240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.013506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.013732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.013967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.014230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.016689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.017643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.017885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.018138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.018138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.019500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.019804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.020214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.020473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.020731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.020979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.021223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.022489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.022746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.023014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.023014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.023542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.023832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.024086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.024316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.024577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.024879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.025137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.025390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.025390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.025867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.026111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.026344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.026607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.026833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.027101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.027429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.027704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.027963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.028189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.028415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.028663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.028890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.029184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.029184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.029690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.029936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.030180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.030415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.030683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.030933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.031217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.031491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.031757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.031987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.032218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.032526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.032889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.033156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.033156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.033738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.033982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.034252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.034464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.034708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.034943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.035177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.035411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.035411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.036033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.036382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.036613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.036872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.037120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.037362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.037692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.037946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.038242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.038654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.038654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.039265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.039265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.039747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.039747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.039747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.040501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.040501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.040501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.041239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.041579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.041811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.042050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.042382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.042656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.043058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.043317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.043638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.043638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.044218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.044443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.044740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.044973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.045200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.045425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.045665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.045896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.046133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.046372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.046607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.046836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.046836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.047371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.047795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.048107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.048368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.048599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.048845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.049082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.049082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.049082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.049082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.049082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.049082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.049082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.050707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.050707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.051481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.051481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.052492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.052769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.053083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.053312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.053585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.053855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.054078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.054324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.054651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.054963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.055193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.055454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.055703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.055942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.056278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.056496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.056774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.056994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.057232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.057469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.057696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.057696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.058534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.058785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.059015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.059015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.059015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.059694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.060138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.060415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.060632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.060890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.061132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.061378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.061631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.061857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.061857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.062295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.062522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.062851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.063075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.063336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.063609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.064461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.064710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.065048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.065317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.065547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.065782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.066027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.066298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.066690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.066968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.067711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.067844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.067952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.068963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.069047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.069167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.069283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.069371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.069481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.069600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.069696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.069895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.069992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.070928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.071932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.072983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.073846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.074407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.074407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.074587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.074666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.074736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.074806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.074925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.075987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.076919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.077122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.077335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.077438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.077525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.077618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.077709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.077709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.077862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.077946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.078983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.079068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.079198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.079316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.080993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.081982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.082968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.083980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.084092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.084188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.084290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.084426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.084517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.084613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.084744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.084744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.084925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.085910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.086943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.087946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.088977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.089977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.090963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.091063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.091160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.091285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.091385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.091471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.091616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.091724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.091811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.091895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.092925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.093060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.093185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.093185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.093185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.093462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.093580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.093669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.093754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.093882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.094000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.094106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.094225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.094314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.094406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.094538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.094538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.094814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.095469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.095469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.095716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.095815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.095914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.096915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.097964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.098782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.099984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.100266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.101032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.101032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.101369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.101456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.101570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.101668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.101812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.101945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.102806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.103943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.104121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.104215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.104307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.104435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.104552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.104655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.104784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.104928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.105063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.105168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.105255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.105361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.105480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.105569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.105653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.105777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.105932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.106973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.107096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.107197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.107284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.107389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.107481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.107620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.107776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.107868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.107868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.108869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.109032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.109197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.109317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.109410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.109545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.109725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.109827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.109923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.110052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.110052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.110232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.110348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.110438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.110530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.110667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.111313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.111421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.111504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.111647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.111647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.111835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.111938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.112925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.113927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.114022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.114115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.114237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.114343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.114419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.114518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.114634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.114790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.114915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.115059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.115192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.115313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.115390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.115542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.115688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.115688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.115868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.115995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.116096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.116189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.116284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.116396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.116493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.116566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.116649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.116862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.116967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.117169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.117276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.117477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.117569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.117867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.118001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.118152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.118285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.118379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.118540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.118690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.118786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.119000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.119141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.119299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.119390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.119667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.119785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.120021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.120118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.120333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.120435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.120671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.120773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.120986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.121078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.121298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.121396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.121618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.121725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.121933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.122035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.122256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.122366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.122572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.122673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.122891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.122991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.123211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.123381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.123537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.123665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.123875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.124120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.124232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.124463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.124557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.124792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.124884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.125134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.125370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.125476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.125708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.125803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.126028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.126192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.126404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.126502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.126725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.126825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.127048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.127178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.127369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.127497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.127708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.127842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.128067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.128181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.128323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.128443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.128635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.128736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.128944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.129053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.129304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.129423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.129599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.129740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.129912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.130102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.130268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.130433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.130582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.130724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.130866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.131019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.131173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.131316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.131456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.131657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.131771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.131859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.132074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.132167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.132395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.132493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.132715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.132819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.133033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.133129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.133349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.133461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.133663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.133771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.133978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.134082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.134296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.134410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.134616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.134719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.134928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.135030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.135252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.135427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.135557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.135684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.135907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.136025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.136243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.136383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.136591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.136684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.136914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.137023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.137229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.137339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.137546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.137660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.137872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.138076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.138213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.138428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.138536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.138767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.138869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.139098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.139208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.139432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.139545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.139780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.139891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.140105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.140207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.140416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.140509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.140726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.140818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.141034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.141126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.141343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.141443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.141658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.141751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.142469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.142572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.142781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.142885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.143086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.143189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.143398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.143498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.143731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.143826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.144042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.144147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.144355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.144633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.144728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.144998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.145106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.145260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.145372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.145662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.145769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.145864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.146008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.146149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.146345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.146522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.146707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.146859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.147027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.147180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.147345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.147503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.147698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.147804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.147903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.147991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.148206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.148335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.148514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.148607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.148822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.148924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.149140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.149241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.149562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.149678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.149875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.149970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.150192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.150294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.150504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.150608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.150842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.151086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.151189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.151451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.151558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.151794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.151898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.152117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.152229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.152428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.152540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.152739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.152841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.153050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.153145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.153360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.153455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.153675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.153772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.153984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.154085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.154300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.154403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.154610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.154705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.154927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.155030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.155263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.155371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.155769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.155872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.155960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.156034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.156217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.156492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.156808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.157064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.157382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.157564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.158343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.158484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.158649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.158752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.159008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.159138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.159346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.159462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.159698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.159851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.160063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.160166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.160388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.160490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.160715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.160808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.161031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.161281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.161390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.161629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.161737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.161967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.162069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.162295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.162388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.162612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.162714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.162938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.163030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.163254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.163355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.163611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.163720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.163927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.164037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.164242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.164345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.164592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.164685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.164912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.165011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.165229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.165323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.165536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.165627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.165882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 08:58:51.166007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.166150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.166470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.166791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.167103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.167417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.167755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.168072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.168389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.168708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.169052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.169375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.169700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.170041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.170348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.170665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.171703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.172043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.172368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.172883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.173326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.173657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.173977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.174417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.174742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.175073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.175407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.175752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.176086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.176419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.176741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.177071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.177390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.177730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.178081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.178432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.178756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.179070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.179384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.179722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.180043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.180369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.180716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.180993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.181343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.181664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.181981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.182419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.182591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.182894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.183472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.183927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.184111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.184421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.184733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.185042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.185393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.185720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.186044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.186328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.186599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.186909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.187215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.187825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.188300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.188599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.189056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.189430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.189768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.190138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.190554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.191005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.191336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.191681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.192035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.192350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.192731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.193050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.194150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.194479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.194803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.195352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.195717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.196038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.196380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.196708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.197035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.197356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.197679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.198018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.198341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.198661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.198975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.199316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.199638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.199966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.200288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.200608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.200939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.201251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.201588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.201929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.202247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.202579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.202914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.203270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.203612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.203967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.204820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.205149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.205470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.205782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 08:58:51.206031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 08:58:51.234012 n-d-858383-16 devstack@n-api.service[120602]: INFO dbcounter [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Registered counter for database nova_api Oct 27 08:58:51.255997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_db.sqlalchemy.engines [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:58:51.268066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writer thread running {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:58:51.270827 n-d-858383-16 devstack@n-api.service[120603]: INFO dbcounter [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Registered counter for database nova_api Oct 27 08:58:51.291153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:58:51.299022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:58:51.327402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.context [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) {{(pid=120602) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 08:58:51.331514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:58:51.332031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:58:51.337135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:58:51.337135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:58:51.337135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:58:51.337135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:58:51.338912 n-d-858383-16 devstack@n-api.service[120602]: INFO dbcounter [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Registered counter for database nova_cell0 Oct 27 08:58:51.343402 n-d-858383-16 devstack@n-api.service[120602]: INFO dbcounter [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Registered counter for database nova_cell1 Oct 27 08:58:51.351269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_db.sqlalchemy.engines [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:58:51.353720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_db.sqlalchemy.engines [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:58:51.358530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.context [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) {{(pid=120603) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 08:58:51.361344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writer thread running {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:58:51.363138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:58:51.363644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:58:51.365264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:58:51.366017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:58:51.366468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:58:51.368628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:58:51.370695 n-d-858383-16 devstack@n-api.service[120603]: INFO dbcounter [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Registered counter for database nova_cell0 Oct 27 08:58:51.374884 n-d-858383-16 devstack@n-api.service[120603]: INFO dbcounter [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Registered counter for database nova_cell1 Oct 27 08:58:51.383757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:58:51.387164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:58:51.394911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:58:51.396248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:58:51.502312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writer thread running {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:58:51.513127 n-d-858383-16 devstack@n-api.service[120602]: INFO dbcounter [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Registered counter for database nova_cell0 Oct 27 08:58:51.520025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_db.sqlalchemy.engines [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:58:51.524478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writer thread running {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:58:51.544208 n-d-858383-16 devstack@n-api.service[120603]: INFO dbcounter [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Registered counter for database nova_cell0 Oct 27 08:58:51.553482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 08:58:51.559010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 08:58:51.848571 n-d-858383-16 devstack@n-api.service[120602]: WARNING keystonemiddleware.auth_token [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 08:58:51.856026 n-d-858383-16 devstack@n-api.service[120602]: WARNING keystonemiddleware.auth_token [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 08:58:51.875790 n-d-858383-16 devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 08:58:51.883808 n-d-858383-16 devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 08:58:52.200982 n-d-858383-16 devstack@n-api.service[120602]: WARNING keystonemiddleware.auth_token [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 08:58:52.206929 n-d-858383-16 devstack@n-api.service[120602]: WARNING keystonemiddleware.auth_token [None req-75639f77-72ad-46f0-b281-d848635e7772 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 08:58:52.212357 n-d-858383-16 devstack@n-api.service[120602]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55668c0ab9c0 pid: 120602 (default app) Oct 27 08:58:52.223858 n-d-858383-16 devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 08:58:52.229847 n-d-858383-16 devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-49b7d5fe-cc76-4838-9338-ca1aa7625621 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 08:58:52.235068 n-d-858383-16 devstack@n-api.service[120603]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55668c0ab9c0 pid: 120603 (default app) Oct 27 08:59:31.919960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:31.922880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:31.924133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:31.925672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:33.515916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aef8ca10-ed4a-481a-8aab-4395057d75cf tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-536653318", "ram": 512, "vcpus": 1, "disk": 10, "id": 175138695, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:33.580309 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aef8ca10-ed4a-481a-8aab-4395057d75cf tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 1.675822 Oct 27 08:59:33.580894 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:31 2022] POST /compute/v2.1/flavors => generated 412 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:33.588491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:33.589086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:33.589830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:33.591380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:33.604209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8853f6d5-8d0d-459a-9ad4-3a31855379d2 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:33.662192 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8853f6d5-8d0d-459a-9ad4-3a31855379d2 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/175138695/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063732 Oct 27 08:59:33.663468 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2/2] 10.222.0.25 () {60 vars in 1221 bytes} [Thu Oct 27 08:59:33 2022] POST /compute/v2.1/flavors/175138695/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:34.166040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f429db4e-f77b-41b6-af09-26a98d115cf0 tempest-FlavorsExtraSpecsTestJSON-998327164 tempest-FlavorsExtraSpecsTestJSON-998327164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:34.208593 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f429db4e-f77b-41b6-af09-26a98d115cf0 tempest-FlavorsExtraSpecsTestJSON-998327164 tempest-FlavorsExtraSpecsTestJSON-998327164-project] 10.222.0.25 "GET /compute/v2.1/flavors/175138695/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.527860 Oct 27 08:59:34.226382 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3/3] 10.222.0.25 () {58 vars in 1200 bytes} [Thu Oct 27 08:59:33 2022] GET /compute/v2.1/flavors/175138695/os-extra_specs => generated 66 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:34.227775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f429db4e-f77b-41b6-af09-26a98d115cf0 tempest-FlavorsExtraSpecsTestJSON-998327164 tempest-FlavorsExtraSpecsTestJSON-998327164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:34.228774 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f429db4e-f77b-41b6-af09-26a98d115cf0 tempest-FlavorsExtraSpecsTestJSON-998327164 tempest-FlavorsExtraSpecsTestJSON-998327164-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001323 Oct 27 08:59:34.237358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4/4] 10.222.0.25 () {56 vars in 886 bytes} [Thu Oct 27 08:59:34 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 08:59:34.242540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2a623378-a03e-4851-9ffc-117d9663b195 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:34.317155 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2a623378-a03e-4851-9ffc-117d9663b195 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/175138695/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078625 Oct 27 08:59:34.317748 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 5/5] 10.222.0.25 () {60 vars in 1221 bytes} [Thu Oct 27 08:59:34 2022] POST /compute/v2.1/flavors/175138695/os-extra_specs => generated 66 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:34.905249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47810362-29ae-4c44-88f9-c4e6d8ec72b7 tempest-AZAdminNegativeTestJSON-206676476 tempest-AZAdminNegativeTestJSON-206676476-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:34.906911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-47810362-29ae-4c44-88f9-c4e6d8ec72b7 tempest-AZAdminNegativeTestJSON-206676476 tempest-AZAdminNegativeTestJSON-206676476-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'f472c27af3b14f85892c3bedeada157f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55e6987c774f4f1fa6b66e1a73281703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47810362-29ae-4c44-88f9-c4e6d8ec72b7 tempest-AZAdminNegativeTestJSON-206676476 tempest-AZAdminNegativeTestJSON-206676476-project] Request method failure captured: Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkhzmQ6gNNSHYA7mVryGHbJwwlZ8Ngl53Mzw5nh4sriCCJ8yDn_FBCQxpeDrX43rTie0l1MgdE0D_lOWepYwQ0Ie6CJE917FJlY-n_Hx3BF6cdevqHs-kJiyneG-x_Sabu2g2d3ueyo8NU_Ol1pTJ0hyfMIzVrM5lsjeV0_Jm1mj39A Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 55e6987c774f4f1fa6b66e1a73281703 Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AZAdminNegativeTestJSON-206676476 Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 08:59:34.911216 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/55e6987c774f4f1fa6b66e1a73281703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_55e6987c774f4f1fa6b66e1a73281703"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/55e6987c774f4f1fa6b66e1a73281703"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/55e6987c774f4f1fa6b66e1a73281703"}]}] Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AZAdminNegativeTestJSON-206676476 Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 55e6987c774f4f1fa6b66e1a73281703 Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-206676476 Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AZAdminNegativeTestJSON-206676476-project Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: f472c27af3b14f85892c3bedeada157f Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AZAdminNegativeTestJSON-206676476-project Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 08:59:34.912491 n-d-858383-16 devstack@n-api.service[120602]: action_args: {} Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 08:59:34.913056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:34.914076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47810362-29ae-4c44-88f9-c4e6d8ec72b7 tempest-AZAdminNegativeTestJSON-206676476 tempest-AZAdminNegativeTestJSON-206676476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:59:34.915221 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47810362-29ae-4c44-88f9-c4e6d8ec72b7 tempest-AZAdminNegativeTestJSON-206676476 tempest-AZAdminNegativeTestJSON-206676476-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.582719 Oct 27 08:59:34.923521 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 6/6] 10.222.0.25 () {58 vars in 1185 bytes} [Thu Oct 27 08:59:34 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 604 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 08:59:34.930990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ec558170-ee54-4658-b55d-085d7fbe47cd tempest-FlavorsExtraSpecsTestJSON-998327164 tempest-FlavorsExtraSpecsTestJSON-998327164-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:34.957919 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ec558170-ee54-4658-b55d-085d7fbe47cd tempest-FlavorsExtraSpecsTestJSON-998327164 tempest-FlavorsExtraSpecsTestJSON-998327164-project] 10.222.0.25 "GET /compute/v2.1/flavors/175138695/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.033161 Oct 27 08:59:34.958482 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 7/7] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 08:59:34 2022] GET /compute/v2.1/flavors/175138695/os-extra_specs/hw:numa_nodes => generated 22 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:35.597193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '.version_select at 0x7f31abd9af70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:35.621694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) {{(pid=120603) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 27 08:59:35.622462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:35.622948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:35.623381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:35.691640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:35.692148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:35.692590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:35.733613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:35.738668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:35.739148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:35.751395 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e64a0d7e-1ed4-47f5-88cb-f7fccd61d589 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 2.169090 Oct 27 08:59:35.763048 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1/8] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Oct 27 08:59:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:35.768850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5cfc1d6-161d-4d4c-a87d-82e2307e50dc tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:35.862264 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5cfc1d6-161d-4d4c-a87d-82e2307e50dc tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/175138695/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.097593 Oct 27 08:59:35.863542 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2/9] 10.222.0.25 () {60 vars in 1221 bytes} [Thu Oct 27 08:59:35 2022] POST /compute/v2.1/flavors/175138695/os-extra_specs => generated 66 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:35.910944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a25f41f-8a62-4749-a74d-02506d0ee911 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:35.912660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a25f41f-8a62-4749-a74d-02506d0ee911 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:35.913286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a25f41f-8a62-4749-a74d-02506d0ee911 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:35.913879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a25f41f-8a62-4749-a74d-02506d0ee911 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:35.914882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a25f41f-8a62-4749-a74d-02506d0ee911 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:35.915462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a25f41f-8a62-4749-a74d-02506d0ee911 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:35.918800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a25f41f-8a62-4749-a74d-02506d0ee911 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:36.013221 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a25f41f-8a62-4749-a74d-02506d0ee911 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.046396 Oct 27 08:59:36.014363 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 8/10] 10.222.0.25 () {58 vars in 1164 bytes} [Thu Oct 27 08:59:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:36.019512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bc4a149-e975-418d-af5b-36a3193ebd9f tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1971219220", "name": "tempest-test_aggregate-653801877"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:36.043360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.aggregate [None req-7bc4a149-e975-418d-af5b-36a3193ebd9f tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Generated uuid 2f1db576-ed49-4e6a-a86e-a0b022ec6a37 for aggregate {{(pid=120602) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 08:59:36.139908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Calling method '.version_select at 0x7f31abc62ee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.147816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:36.151594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:36.153033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:36.181689 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7bc4a149-e975-418d-af5b-36a3193ebd9f tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.163381 Oct 27 08:59:36.193450 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 9/11] 10.222.0.25 () {60 vars in 1165 bytes} [Thu Oct 27 08:59:36 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:36.200607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:36.203346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:36.204687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:36.204820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf932f14-1f3b-4ce5-b588-de42270f5280 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.225593 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf932f14-1f3b-4ce5-b588-de42270f5280 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/175138695/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030592 Oct 27 08:59:36.226250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:36.227157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:36.227842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:36.228529 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 10/12] 10.222.0.25 () {58 vars in 1200 bytes} [Thu Oct 27 08:59:36 2022] GET /compute/v2.1/flavors/175138695/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:36.241381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9065ccb-9400-4876-90c0-b70c946a5ca0 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.248158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9065ccb-9400-4876-90c0-b70c946a5ca0 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:36.249967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9065ccb-9400-4876-90c0-b70c946a5ca0 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:36.254688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9065ccb-9400-4876-90c0-b70c946a5ca0 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:36.256065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9065ccb-9400-4876-90c0-b70c946a5ca0 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:36.257971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9065ccb-9400-4876-90c0-b70c946a5ca0 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:36.258355 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f98f6bb-9017-42e6-882c-73f0da136d44 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.392847 Oct 27 08:59:36.259602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3/13] 10.222.0.25 () {60 vars in 1208 bytes} [Thu Oct 27 08:59:35 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:59:36.264208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44c2624a-e341-4901-88c4-8e8674573b38 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.276303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9065ccb-9400-4876-90c0-b70c946a5ca0 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:36.290311 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44c2624a-e341-4901-88c4-8e8674573b38 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.029246 Oct 27 08:59:36.290885 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4/14] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 08:59:36 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:36.296243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e561ddf-3a96-49ce-b64c-55444030e03c tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:36.363413 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9065ccb-9400-4876-90c0-b70c946a5ca0 tempest-AZAdminV2TestJSON-909573743 tempest-AZAdminV2TestJSON-909573743-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.133695 Oct 27 08:59:36.366179 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 11/15] 10.222.0.25 () {58 vars in 1185 bytes} [Thu Oct 27 08:59:36 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:36.376752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b0a198ed-52de-439f-85df-e5ba244a7a48 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:36.395778 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e561ddf-3a96-49ce-b64c-55444030e03c tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/175138695/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.103390 Oct 27 08:59:36.401304 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 5/16] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 08:59:36 2022] PUT /compute/v2.1/flavors/175138695/os-extra_specs/hw:numa_nodes => generated 22 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:36.420023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0a198ed-52de-439f-85df-e5ba244a7a48 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:36.420998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0a198ed-52de-439f-85df-e5ba244a7a48 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:36.422111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0a198ed-52de-439f-85df-e5ba244a7a48 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:36.423209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c13af880-d5dc-4d00-9496-71d8a15466f0 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.462174 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c13af880-d5dc-4d00-9496-71d8a15466f0 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/175138695/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054103 Oct 27 08:59:36.474332 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 6/17] 10.222.0.25 () {58 vars in 1200 bytes} [Thu Oct 27 08:59:36 2022] GET /compute/v2.1/flavors/175138695/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:36.485030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe67dc3f-4688-4e25-9d02-d4e8fd9f28ec tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.553445 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe67dc3f-4688-4e25-9d02-d4e8fd9f28ec tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/175138695/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.076903 Oct 27 08:59:36.556758 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 7/18] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 08:59:36 2022] DELETE /compute/v2.1/flavors/175138695/os-extra_specs/hw:numa_nodes => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 08:59:36.571292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ca42426-2d4b-4f2c-8281-9d11f6694080 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.619510 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ca42426-2d4b-4f2c-8281-9d11f6694080 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/175138695/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.057896 Oct 27 08:59:36.620769 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 8/19] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 08:59:36 2022] DELETE /compute/v2.1/flavors/175138695/os-extra_specs/hw:cpu_policy => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 08:59:36.636157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e1bb532-0340-45b3-bf17-58e5bc8d9640 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.651812 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e1bb532-0340-45b3-bf17-58e5bc8d9640 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/175138695/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024726 Oct 27 08:59:36.653146 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 9/20] 10.222.0.25 () {58 vars in 1200 bytes} [Thu Oct 27 08:59:36 2022] GET /compute/v2.1/flavors/175138695/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:36.672099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e42caf2-6269-4885-8c07-eec0c90fa3c2 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.742398 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e42caf2-6269-4885-8c07-eec0c90fa3c2 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/175138695" status: 202 len: 0 microversion: 2.1 time: 0.082476 Oct 27 08:59:36.746424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 10/21] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 08:59:36 2022] DELETE /compute/v2.1/flavors/175138695 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:36.762883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c94ca504-128a-4962-906b-bba3a9107bb6 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:36.855365 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c94ca504-128a-4962-906b-bba3a9107bb6 tempest-FlavorsExtraSpecsTestJSON-1598140892 tempest-FlavorsExtraSpecsTestJSON-1598140892-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.101248 Oct 27 08:59:36.871171 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 11/22] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:37.990853 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b0a198ed-52de-439f-85df-e5ba244a7a48 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.621965 Oct 27 08:59:38.003402 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 12/23] 10.222.0.25 () {60 vars in 1191 bytes} [Thu Oct 27 08:59:36 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:39.143177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1805812045", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "availability_zone": "tempest-test_az-1971219220"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:39.184690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:39.185179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:39.185615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:39.186409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:39.187394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:39.187846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:40.584613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 08:59:40.817656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 08:59:40.818076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 08:59:40.818546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 08:59:40.818946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 08:59:40.819344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 08:59:40.834434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:40.834823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:40.835256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:40.836156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:40.836581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:40.837150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:40.877041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Getting quotas for project 44fbb7f650c648a294c2674fb46b313c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 08:59:40.887355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Getting quotas for user ff580f5cbc814eeea503c570dfcf8e38 and project 44fbb7f650c648a294c2674fb46b313c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 08:59:40.902024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 08:59:40.905684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 08:59:41.011085 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b50f5664-821b-4560-9d67-448f34bf4df1 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.381090 Oct 27 08:59:41.011938 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 12/24] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 08:59:41.024422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0cd7b2a7-1258-4f13-a059-0c484b121822 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:41.025136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0cd7b2a7-1258-4f13-a059-0c484b121822 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:41.827790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Calling method '.version_select at 0x7f31abb01b80>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:41.832551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:41.833040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:41.833474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:41.868333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:41.868922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:41.869374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:41.957645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:41.960927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:41.966402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:41.991384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:41.991908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:41.992346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:42.031968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:42.047439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:42.050871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:42.065342 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8481fc3b-773e-4919-b062-265f64d7d8c8 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1575 microversion: 2.53 time: 0.750803 Oct 27 08:59:42.066441 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 13/25] 10.222.0.25 () {60 vars in 1243 bytes} [Thu Oct 27 08:59:41 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1575 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 08:59:42.084981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Calling method '.version_select at 0x7f31ab255ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:42.089642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:42.090248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:42.091170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:42.118167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:42.120087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:42.121759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:42.154673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:42.155177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:42.155849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:42.183335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:42.186260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:42.187183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:42.214748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:42.215310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:42.215707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:42.233076 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18771991-b091-4aa1-b8c2-6ab947c90683 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 267 microversion: 2.53 time: 0.151723 Oct 27 08:59:42.250225 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 14/26] 10.222.0.25 () {60 vars in 1222 bytes} [Thu Oct 27 08:59:42 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 08:59:42.260693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4d8ede4-5a06-4b99-9da7-20d5b65e6588 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Calling method '.version_select at 0x7f31ab255d30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:42.277722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d8ede4-5a06-4b99-9da7-20d5b65e6588 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:42.278226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d8ede4-5a06-4b99-9da7-20d5b65e6588 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:42.278670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d8ede4-5a06-4b99-9da7-20d5b65e6588 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:42.344113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=81,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:42.356853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d8ede4-5a06-4b99-9da7-20d5b65e6588 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:42.360315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d8ede4-5a06-4b99-9da7-20d5b65e6588 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:42.361093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d8ede4-5a06-4b99-9da7-20d5b65e6588 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:42.388709 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4d8ede4-5a06-4b99-9da7-20d5b65e6588 tempest-HypervisorAdminV253TestBase-1044451152 tempest-HypervisorAdminV253TestBase-1044451152-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/836bb94e-f666-4f2a-bf56-2e57dde11067" status: 200 len: 793 microversion: 2.53 time: 0.131525 Oct 27 08:59:42.402333 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 15/27] 10.222.0.25 () {60 vars in 1298 bytes} [Thu Oct 27 08:59:42 2022] GET /compute/v2.1/os-hypervisors/836bb94e-f666-4f2a-bf56-2e57dde11067 => generated 793 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 08:59:42.596413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0cd7b2a7-1258-4f13-a059-0c484b121822 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:42.634628 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0cd7b2a7-1258-4f13-a059-0c484b121822 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1243 microversion: 2.1 time: 1.614269 Oct 27 08:59:42.635195 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 13/28] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:41 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1243 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:43.662922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:43.664620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:43.703849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:43.705242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:43.706491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:43.707881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:43.709746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:43.710591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:43.954619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:43.998740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f6ce319c-7ee5-4534-9e63-91f12161e095 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1291 microversion: 2.1 time: 0.340803 Oct 27 08:59:44.016767 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 16/29] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:43 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1291 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:45.027157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:45.028508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:45.035194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:45.035945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:45.036668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:45.037634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:45.038244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:45.038975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:45.231342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:45.258861 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25725abf-0cb5-433d-a666-436f2aae769b tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1297 microversion: 2.1 time: 0.237291 Oct 27 08:59:45.259612 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 14/30] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:45 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1297 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:46.283863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:46.285588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:46.306059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:46.306558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:46.307038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:46.308268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:46.317110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:46.317707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:46.392518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:46.450995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4671875-623d-4ab1-bc35-3a813028f186 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1199925961", "id": 1211740663, "os-flavor-access:is_public": "True"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:46.546470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:46.550407 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4671875-623d-4ab1-bc35-3a813028f186 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.791032 Oct 27 08:59:46.551058 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 17/31] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:45 2022] POST /compute/v2.1/flavors => generated 430 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:46.570503 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-400ce28a-63d5-4b77-99e5-c7c170b60ade tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1297 microversion: 2.1 time: 0.291230 Oct 27 08:59:46.572853 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 15/32] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:46 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1297 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:46.590008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8430d2db-6791-4379-99bc-45baff5c4edd tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:46.661384 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8430d2db-6791-4379-99bc-45baff5c4edd tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1211740663" status: 202 len: 0 microversion: 2.1 time: 0.085890 Oct 27 08:59:46.663936 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 16/33] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 08:59:46 2022] DELETE /compute/v2.1/flavors/1211740663 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:46.679020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f3df521-66c9-4711-8bf0-d7f28d041217 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:46.766543 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f3df521-66c9-4711-8bf0-d7f28d041217 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097543 Oct 27 08:59:46.768470 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 17/34] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:46.791795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2fe6c728-c907-4fe8-99dc-62e031e28e8e tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-221203266", "id": 1076373239, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:46.871496 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2fe6c728-c907-4fe8-99dc-62e031e28e8e tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.081320 Oct 27 08:59:46.873633 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 18/35] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:46 2022] POST /compute/v2.1/flavors => generated 416 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 08:59:46.887534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f43d33c-55c7-4b84-b174-304c1bca8536 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:46.995159 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f43d33c-55c7-4b84-b174-304c1bca8536 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.104864 Oct 27 08:59:46.997759 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 19/36] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:46 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:47.025824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e703a709-7fe5-419a-ba1d-63e7d6dd7ccb tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:47.093276 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e703a709-7fe5-419a-ba1d-63e7d6dd7ccb tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1076373239" status: 202 len: 0 microversion: 2.1 time: 0.068130 Oct 27 08:59:47.098440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 20/37] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 08:59:47 2022] DELETE /compute/v2.1/flavors/1076373239 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:47.122210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b798921d-5e74-4732-a43f-abfbf117b8f9 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:47.231454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b798921d-5e74-4732-a43f-abfbf117b8f9 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.124179 Oct 27 08:59:47.236284 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 21/38] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 08:59:47.271788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98f492af-f65c-4487-9b23-6d622149b49e tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2004686644", "id": 204151262, "os-flavor-access:is_public": "True"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:47.306588 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98f492af-f65c-4487-9b23-6d622149b49e tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.036934 Oct 27 08:59:47.317649 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 22/39] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:47 2022] POST /compute/v2.1/flavors => generated 426 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 08:59:47.333041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-420cda8e-d132-47e0-a3bb-17fc93e19b76 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:47.375621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:47.388134 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-420cda8e-d132-47e0-a3bb-17fc93e19b76 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/204151262" status: 202 len: 0 microversion: 2.1 time: 0.069118 Oct 27 08:59:47.393397 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 23/40] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 08:59:47 2022] DELETE /compute/v2.1/flavors/204151262 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:47.400753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c47db44a-72e6-4538-a54d-00522afcca06 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:47.451409 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c47db44a-72e6-4538-a54d-00522afcca06 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056682 Oct 27 08:59:47.477059 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 24/41] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:47.489937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5af68690-159c-448a-87e4-8f6842e5149c tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-296497988", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:47.525691 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5af68690-159c-448a-87e4-8f6842e5149c tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.039566 Oct 27 08:59:47.536932 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 25/42] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:47 2022] POST /compute/v2.1/flavors => generated 506 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:47.550807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ea127c4-56ed-4b31-8735-ed1cc9bdd613 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:47.599280 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ea127c4-56ed-4b31-8735-ed1cc9bdd613 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2ad4aafa-de18-4333-8e26-59eaf8873a2f" status: 202 len: 0 microversion: 2.1 time: 0.059760 Oct 27 08:59:47.603590 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 26/43] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 08:59:47 2022] DELETE /compute/v2.1/flavors/2ad4aafa-de18-4333-8e26-59eaf8873a2f => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:47.609324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:47.613721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:47.626483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:47.628855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:47.629395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:47.632564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:47.633347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:47.634454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:47.802635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1d66a53f-d3d6-46f5-a4a9-0736981acaea tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Action: 'update', calling method: .version_select at 0x7f31ab1e41f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:47.988074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:47.998274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-58e85bb3-3e45-4965-89d1-85c7e16204cf tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.392979 Oct 27 08:59:48.001752 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 27/44] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:47 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:48.012530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d3f727db-ff3c-4739-8892-3cd01f71afe7 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:48.051929 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d3f727db-ff3c-4739-8892-3cd01f71afe7 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047296 Oct 27 08:59:48.069320 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 28/45] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:48.074314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dcc7fa74-3b1a-4e6d-8ba6-17215aa6573d tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1021350918", "id": "af853690-d324-42e8-9396-70fb81ef7f60", "os-flavor-access:is_public": "True"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:48.102260 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dcc7fa74-3b1a-4e6d-8ba6-17215aa6573d tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.031201 Oct 27 08:59:48.112938 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 29/46] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:48 2022] POST /compute/v2.1/flavors => generated 507 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 08:59:48.127277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1bb18897-6966-435b-bc51-b95110e1d757 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:48.189530 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1bb18897-6966-435b-bc51-b95110e1d757 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/af853690-d324-42e8-9396-70fb81ef7f60" status: 202 len: 0 microversion: 2.1 time: 0.069834 Oct 27 08:59:48.196848 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 30/47] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 08:59:48 2022] DELETE /compute/v2.1/flavors/af853690-d324-42e8-9396-70fb81ef7f60 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:48.210169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f819fca6-bb6a-4aee-a052-0da5782db5b2 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:48.266477 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f819fca6-bb6a-4aee-a052-0da5782db5b2 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064132 Oct 27 08:59:48.267762 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 31/48] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:48.291057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d3e7c39e-1d4e-4716-b156-de5430bd390e tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1855246424", "id": 948140456, "os-flavor-access:is_public": "True"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:48.372738 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d3e7c39e-1d4e-4716-b156-de5430bd390e tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.085709 Oct 27 08:59:48.381290 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 32/49] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:48 2022] POST /compute/v2.1/flavors => generated 411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:48.397956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f15a509d-cee3-457f-9fab-48d91ae3a8be tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:48.417835 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f15a509d-cee3-457f-9fab-48d91ae3a8be tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/948140456" status: 200 len: 411 microversion: 2.1 time: 0.034837 Oct 27 08:59:48.431899 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 33/50] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 08:59:48 2022] GET /compute/v2.1/flavors/948140456 => generated 411 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:48.891218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d66a53f-d3d6-46f5-a4a9-0736981acaea tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:48.894446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d66a53f-d3d6-46f5-a4a9-0736981acaea tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:48.897684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d66a53f-d3d6-46f5-a4a9-0736981acaea tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:48.898742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d66a53f-d3d6-46f5-a4a9-0736981acaea tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:48.901481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d66a53f-d3d6-46f5-a4a9-0736981acaea tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:48.912312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d66a53f-d3d6-46f5-a4a9-0736981acaea tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:49.072491 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1d66a53f-d3d6-46f5-a4a9-0736981acaea tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/dc37095c97004c41a39d8e22d98dfe7e" status: 200 len: 240 microversion: 2.36 time: 2.512996 Oct 27 08:59:49.073818 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 18/51] 10.222.0.25 () {62 vars in 1303 bytes} [Thu Oct 27 08:59:46 2022] PUT /compute/v2.1/os-quota-sets/dc37095c97004c41a39d8e22d98dfe7e => generated 240 bytes in 2515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:59:49.175551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cdf5233f-c21f-4dd4-b628-6b8f85080a5d tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:49.272706 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cdf5233f-c21f-4dd4-b628-6b8f85080a5d tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.836391 Oct 27 08:59:49.276257 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 34/52] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:48 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:49.518695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2049468585", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:49.650962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 08:59:49.788399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77acaa7f-1887-42c5-a94c-2db6b0135872 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Calling method '.version_select at 0x7f31ab1d58b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:49.791272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77acaa7f-1887-42c5-a94c-2db6b0135872 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '4785dbf8a4614515bd8c496b2566cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4860ef7ea4555ae01db34b84c9cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77acaa7f-1887-42c5-a94c-2db6b0135872 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Request method failure captured: Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkiAX0eImyukfeLOcWysEcC5aoJlKM-Nq8g7ffEnNs8n5iAW0qJlYyx6ssy08s3VDaWh5z8Xe7NuXIQzv-YyKLkZ2YpxLPDH6AWn_i57G600jJwbQXVjatzYcdVvrBq2jjIOOtAjvQq2WmSQELhrozDfcZ0CVhaf2tlJV0-OKuBA6y0 Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 08:59:49.793642 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30f4860ef7ea4555ae01db34b84c9cea"}]}] Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4785dbf8a4614515bd8c496b2566cafd Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: action_args: {} Oct 27 08:59:49.794825 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 08:59:49.795531 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 27 08:59:49.796623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:49.806407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77acaa7f-1887-42c5-a94c-2db6b0135872 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:59:49.808059 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77acaa7f-1887-42c5-a94c-2db6b0135872 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.530934 Oct 27 08:59:49.809270 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 35/53] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Oct 27 08:59:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 533 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 08:59:49.826609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:49.833724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:49.857484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:49.858520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:49.859333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:49.860427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:49.861146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:49.861799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:50.116903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 08:59:50.117682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 08:59:50.118061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 08:59:50.118480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 08:59:50.119081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 08:59:50.142331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:50.142833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:50.154286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:50.155952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:50.156450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:50.156892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:50.242140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Getting quotas for project fb0978e9d8254ba4a5a1f0466baeb2eb. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 08:59:50.256987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:50.259042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Getting quotas for user b616958081564aea82d0c3d93c3c026f and project fb0978e9d8254ba4a5a1f0466baeb2eb. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 08:59:50.270758 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-060ad5a9-c855-4e6e-8b9e-4068f70435eb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.459567 Oct 27 08:59:50.285512 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 36/54] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:49 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:50.289148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 08:59:50.299162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 08:59:50.313030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-503972ed-9278-4fe8-a248-055e52b57d0b tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Calling method '.version_select at 0x7f31abb8be50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:50.435600 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-47d25689-39e1-47da-87d6-902bcb7ae18e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360330 Oct 27 08:59:50.438173 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 19/55] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 08:59:50.444306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-540153ae-9b82-4b40-abc4-7f7ae49f4a53 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:50.476820 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-540153ae-9b82-4b40-abc4-7f7ae49f4a53 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/948140456" status: 202 len: 0 microversion: 2.1 time: 0.036941 Oct 27 08:59:50.481679 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 20/56] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 08:59:50 2022] DELETE /compute/v2.1/flavors/948140456 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:50.495800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d9a4f5a-99e4-43a5-8293-0b5a544b07b1 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Calling method '.version_select at 0x7f31ab1b8280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:50.497950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d9a4f5a-99e4-43a5-8293-0b5a544b07b1 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '4785dbf8a4614515bd8c496b2566cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4860ef7ea4555ae01db34b84c9cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d9a4f5a-99e4-43a5-8293-0b5a544b07b1 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Request method failure captured: Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiAX0eImyukfeLOcWysEcC5aoJlKM-Nq8g7ffEnNs8n5iAW0qJlYyx6ssy08s3VDaWh5z8Xe7NuXIQzv-YyKLkZ2YpxLPDH6AWn_i57G600jJwbQXVjatzYcdVvrBq2jjIOOtAjvQq2WmSQELhrozDfcZ0CVhaf2tlJV0-OKuBA6y0 Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 08:59:50.542137 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30f4860ef7ea4555ae01db34b84c9cea"}]}] Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4785dbf8a4614515bd8c496b2566cafd Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: action_args: {} Oct 27 08:59:50.543317 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 08:59:50.544057 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 27 08:59:50.544996 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:50.547601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d9a4f5a-99e4-43a5-8293-0b5a544b07b1 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:59:50.550091 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d9a4f5a-99e4-43a5-8293-0b5a544b07b1 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.067162 Oct 27 08:59:50.564340 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 21/57] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:50 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 82 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 08:59:50.584742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35fc0659-6697-42dc-aab7-56be8ab8ce53 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:50.586657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35fc0659-6697-42dc-aab7-56be8ab8ce53 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:50.686690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-35fc0659-6697-42dc-aab7-56be8ab8ce53 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:50.706470 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35fc0659-6697-42dc-aab7-56be8ab8ce53 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1220 microversion: 2.1 time: 0.138663 Oct 27 08:59:50.707938 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 22/58] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:50 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:50.713664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3200132b-968c-4dc9-8fbd-dfd6b3665eb9 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:50.739444 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3200132b-968c-4dc9-8fbd-dfd6b3665eb9 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029728 Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 23/59] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1afb2c38-3106-41c2-a475-5bb66e882982 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Calling method '.version_select at 0x7f31ab1379d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1afb2c38-3106-41c2-a475-5bb66e882982 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '4785dbf8a4614515bd8c496b2566cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4860ef7ea4555ae01db34b84c9cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1afb2c38-3106-41c2-a475-5bb66e882982 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Request method failure captured: Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 08:59:50.753227 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiAX0eImyukfeLOcWysEcC5aoJlKM-Nq8g7ffEnNs8n5iAW0qJlYyx6ssy08s3VDaWh5z8Xe7NuXIQzv-YyKLkZ2YpxLPDH6AWn_i57G600jJwbQXVjatzYcdVvrBq2jjIOOtAjvQq2WmSQELhrozDfcZ0CVhaf2tlJV0-OKuBA6y0 Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30f4860ef7ea4555ae01db34b84c9cea"}]}] Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:50.754129 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4785dbf8a4614515bd8c496b2566cafd Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: action_args: {} Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 08:59:50.754889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 08:59:50.757979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 08:59:50.759275 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 27 08:59:50.759275 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:50.759275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1afb2c38-3106-41c2-a475-5bb66e882982 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:59:50.759275 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1afb2c38-3106-41c2-a475-5bb66e882982 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010765 Oct 27 08:59:50.759275 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 24/60] 10.222.0.25 () {58 vars in 1179 bytes} [Thu Oct 27 08:59:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 08:59:50.767800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ead6cb5-fa09-48c5-8446-936c2ff1c0da tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2098261365", "id": 809406246, "os-flavor-access:is_public": "False"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:50.813995 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ead6cb5-fa09-48c5-8446-936c2ff1c0da tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.052352 Oct 27 08:59:50.822418 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 25/61] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:50 2022] POST /compute/v2.1/flavors => generated 427 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:50.840835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-503972ed-9278-4fe8-a248-055e52b57d0b tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:50.841332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-503972ed-9278-4fe8-a248-055e52b57d0b tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:50.844947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-503972ed-9278-4fe8-a248-055e52b57d0b tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:50.846719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-503972ed-9278-4fe8-a248-055e52b57d0b tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:50.847451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-503972ed-9278-4fe8-a248-055e52b57d0b tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:50.849275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-503972ed-9278-4fe8-a248-055e52b57d0b tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:50.965925 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-503972ed-9278-4fe8-a248-055e52b57d0b tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/dc37095c97004c41a39d8e22d98dfe7e/detail" status: 200 len: 672 microversion: 2.36 time: 0.678498 Oct 27 08:59:50.981812 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 37/62] 10.222.0.25 () {60 vars in 1304 bytes} [Thu Oct 27 08:59:50 2022] GET /compute/v2.1/os-quota-sets/dc37095c97004c41a39d8e22d98dfe7e/detail => generated 672 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:59:50.995893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f361045-dbbd-4697-8dd2-9810bdf500c3 tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "809406246"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:51.015469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Calling method '.version_select at 0x7f31ab1b81f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:51.018566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.022325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.026242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.054747 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-0f361045-dbbd-4697-8dd2-9810bdf500c3 tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] HTTP exception thrown: Flavor 809406246 could not be found. Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f361045-dbbd-4697-8dd2-9810bdf500c3 tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] Request method failure captured: Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 106 Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkh-a6mBYQR4cCqDRJgOXX_tpS7DW1qTx6vC9bbp_RfAeWDB928MNO20TTddZdL9AQiq0ei3Gq9qyUCpVXxkW68PM-jDCgGTeTl3gVSrpMsNQN2nNlB_SgPpj6MdLKNleIG976typSNUUhXJ1V0cBUFAfdn7NNQ4SQUpiDu4i7IumLE Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 8bf73f02feb34d8a9592d5016aa10cc3 Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FlavorsAdminTestJSON-443737580 Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 08:59:51.075497 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bf73f02feb34d8a9592d5016aa10cc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8bf73f02feb34d8a9592d5016aa10cc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bf73f02feb34d8a9592d5016aa10cc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8bf73f02feb34d8a9592d5016aa10cc3"}]}] Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FlavorsAdminTestJSON-443737580 Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 8bf73f02feb34d8a9592d5016aa10cc3 Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-443737580 Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FlavorsAdminTestJSON-443737580-project Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0035e8bce29f417fa7a5b29105f8ee1e Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FlavorsAdminTestJSON-443737580-project Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "test", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "809406246"}} Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 08:59:51.076711 n-d-858383-16 devstack@n-api.service[120602]: exception: Flavor 809406246 could not be found. Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '809406246'}}} Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 809406246 could not be found. Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.077552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 809406246 could not be found. Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.078817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:51.080089 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:51.080089 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 08:59:51.080089 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 08:59:51.080089 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 809406246 could not be found. Oct 27 08:59:51.080089 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.081372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f361045-dbbd-4697-8dd2-9810bdf500c3 tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] Returning 400 to user: Flavor 809406246 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:59:51.081372 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f361045-dbbd-4697-8dd2-9810bdf500c3 tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.098336 Oct 27 08:59:51.084802 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 38/63] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:50 2022] POST /compute/v2.1/servers => generated 80 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 08:59:51.088132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.088910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.089425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.134135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.134739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.137755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.161641 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e8d116a-6bcb-44ed-97ca-5c806f6b0f1b tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.343772 Oct 27 08:59:51.162475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3ec2e8f-ecd9-4407-9a85-f33c784469f1 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:51.170524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 26/64] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:51.178063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0f4b924-4e73-4322-adda-ed47ab41f636 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Calling method '.version_select at 0x7f31ab0c95e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:51.198358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0f4b924-4e73-4322-adda-ed47ab41f636 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '4785dbf8a4614515bd8c496b2566cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4860ef7ea4555ae01db34b84c9cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0f4b924-4e73-4322-adda-ed47ab41f636 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Request method failure captured: Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiAX0eImyukfeLOcWysEcC5aoJlKM-Nq8g7ffEnNs8n5iAW0qJlYyx6ssy08s3VDaWh5z8Xe7NuXIQzv-YyKLkZ2YpxLPDH6AWn_i57G600jJwbQXVjatzYcdVvrBq2jjIOOtAjvQq2WmSQELhrozDfcZ0CVhaf2tlJV0-OKuBA6y0 Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 08:59:51.206433 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30f4860ef7ea4555ae01db34b84c9cea"}]}] Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4785dbf8a4614515bd8c496b2566cafd Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '1'} Oct 27 08:59:51.207722 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 08:59:51.208883 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 27 08:59:51.210175 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.211030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0f4b924-4e73-4322-adda-ed47ab41f636 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:59:51.214599 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0f4b924-4e73-4322-adda-ed47ab41f636 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.040737 Oct 27 08:59:51.229426 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 27/65] 10.222.0.25 () {58 vars in 1173 bytes} [Thu Oct 27 08:59:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 08:59:51.247961 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c3ec2e8f-ecd9-4407-9a85-f33c784469f1 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/809406246" status: 202 len: 0 microversion: 2.1 time: 0.161440 Oct 27 08:59:51.249468 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 39/66] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 08:59:51 2022] DELETE /compute/v2.1/flavors/809406246 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:51.259732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae2cdab4-0596-4ec0-b83a-1c89d98a74a1 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:51.260560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-16ec3e83-bcf4-404b-abe0-77620470f89e tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Calling method '.version_select at 0x7f31ab235c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:51.269197 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-16ec3e83-bcf4-404b-abe0-77620470f89e tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] HTTP exception thrown: Hypervisor with ID 'f02b4a23-5cd7-4c4b-b242-7470099f2e1e' could not be found. Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-16ec3e83-bcf4-404b-abe0-77620470f89e tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Request method failure captured: Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hypervisors/f02b4a23-5cd7-4c4b-b242-7470099f2e1e/uptime HTTP/1.1 Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiEuQ1C-JsGWoHCXz6FMP2W4h-3bltBwraE_8iPXQKHKotpC8LAc50VOm-OXu0v-bjt-sgv7LEHuJn37ym-XmbkJ8OepHnCzxEfeyMJRTlH_Nrxhpp5fUXMWNlSoQZWDPaALXc58vQXlhDAMxFRXLHkFUu0EHJjUoBptoak72Ye85M Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: f351874af2a442d4b29a490e621e550e Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-53320489 Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 08:59:51.300327 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f351874af2a442d4b29a490e621e550e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f351874af2a442d4b29a490e621e550e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f351874af2a442d4b29a490e621e550e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f351874af2a442d4b29a490e621e550e"}]}] Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-53320489 Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: f351874af2a442d4b29a490e621e550e Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-53320489 Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 646cf5b6bf774b43b021a05957cc4efe Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: exception: Hypervisor with ID 'f02b4a23-5cd7-4c4b-b242-7470099f2e1e' could not be found. Oct 27 08:59:51.301973 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f02b4a23-5cd7-4c4b-b242-7470099f2e1e'} Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f02b4a23-5cd7-4c4b-b242-7470099f2e1e' Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 27 08:59:51.303160 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f02b4a23-5cd7-4c4b-b242-7470099f2e1e' could not be found. Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:51.305471 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.308048 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.308048 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:51.308048 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:51.308048 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 08:59:51.308048 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 08:59:51.308048 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f02b4a23-5cd7-4c4b-b242-7470099f2e1e' could not be found. Oct 27 08:59:51.308048 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.313867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-16ec3e83-bcf4-404b-abe0-77620470f89e tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Returning 404 to user: Hypervisor with ID 'f02b4a23-5cd7-4c4b-b242-7470099f2e1e' could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:59:51.315106 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-16ec3e83-bcf4-404b-abe0-77620470f89e tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/f02b4a23-5cd7-4c4b-b242-7470099f2e1e/uptime" status: 404 len: 123 microversion: 2.1 time: 0.070673 Oct 27 08:59:51.320381 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 28/67] 10.222.0.25 () {58 vars in 1278 bytes} [Thu Oct 27 08:59:51 2022] GET /compute/v2.1/os-hypervisors/f02b4a23-5cd7-4c4b-b242-7470099f2e1e/uptime => generated 123 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 08:59:51.345166 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae2cdab4-0596-4ec0-b83a-1c89d98a74a1 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089884 Oct 27 08:59:51.362041 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 40/68] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:51.362199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:51.362847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:51.378240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Calling method '.version_select at 0x7f31ab0d4d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:51.383115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.383478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.384169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.385085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.385685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.386379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.399006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) {{(pid=120602) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 27 08:59:51.401076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.403596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.404240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.465755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.468241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.482051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.587485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.588328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.589579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.604882 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-046462ee-1e83-4f24-88a3-4ba9ac16105d tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.240817 Oct 27 08:59:51.620509 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 41/69] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:51 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:51.632989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Action: 'update', calling method: .version_select at 0x7f31ab0d4820>, body: {"quota_set": {"ram": "2048"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:51.771832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:51.786907 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5987bdb-f911-4c35-9d17-d0d999bc7efb tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.465055 Oct 27 08:59:51.810697 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 29/70] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:51 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:51.821354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7333b9fd-0ffc-4879-a59e-27370a34c305 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-385384273", "id": 769953291, "os-flavor-access:is_public": "False"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:51.862542 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7333b9fd-0ffc-4879-a59e-27370a34c305 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.048869 Oct 27 08:59:51.871020 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 30/71] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:51 2022] POST /compute/v2.1/flavors => generated 411 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:51.877728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fff72edd-b3fd-4503-adb6-ff1dec9c2591 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Calling method '.version_select at 0x7f31ab09e280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:51.879562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fff72edd-b3fd-4503-adb6-ff1dec9c2591 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '4785dbf8a4614515bd8c496b2566cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4860ef7ea4555ae01db34b84c9cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fff72edd-b3fd-4503-adb6-ff1dec9c2591 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Request method failure captured: Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiAX0eImyukfeLOcWysEcC5aoJlKM-Nq8g7ffEnNs8n5iAW0qJlYyx6ssy08s3VDaWh5z8Xe7NuXIQzv-YyKLkZ2YpxLPDH6AWn_i57G600jJwbQXVjatzYcdVvrBq2jjIOOtAjvQq2WmSQELhrozDfcZ0CVhaf2tlJV0-OKuBA6y0 Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 08:59:51.881326 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30f4860ef7ea4555ae01db34b84c9cea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30f4860ef7ea4555ae01db34b84c9cea"}]}] Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 30f4860ef7ea4555ae01db34b84c9cea Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-189210251 Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4785dbf8a4614515bd8c496b2566cafd Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-189210251-project Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '1'} Oct 27 08:59:51.882862 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 08:59:51.883739 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 27 08:59:51.884920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:51.886842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fff72edd-b3fd-4503-adb6-ff1dec9c2591 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:59:51.886842 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fff72edd-b3fd-4503-adb6-ff1dec9c2591 tempest-HypervisorAdminNegativeTestJSON-189210251 tempest-HypervisorAdminNegativeTestJSON-189210251-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.013272 Oct 27 08:59:51.887057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.890424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 31/72] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 08:59:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 08:59:51.895411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1fad0b6c-0c47-48c9-a28a-0c27cd7083e4 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:51.896056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1fad0b6c-0c47-48c9-a28a-0c27cd7083e4 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:51.903756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.906352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.910832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:51.914317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:51.915424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:51.976896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1fad0b6c-0c47-48c9-a28a-0c27cd7083e4 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:51.985495 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1fad0b6c-0c47-48c9-a28a-0c27cd7083e4 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1220 microversion: 2.1 time: 0.093936 Oct 27 08:59:51.997090 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 32/73] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:51 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:52.008189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a9ee4c9-0283-4216-ade8-ac2a28d550fe tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-631295662", "id": 1292563296, "os-flavor-access:is_public": "True"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:52.068593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:52.069392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:52.070467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:52.071549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:52.072183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:52.072805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:52.090301 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a9ee4c9-0283-4216-ade8-ac2a28d550fe tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.091798 Oct 27 08:59:52.116644 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 33/74] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:51 2022] POST /compute/v2.1/flavors => generated 413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:52.122091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-102eb484-e99b-45aa-bb7a-ad92227a6672 tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Calling method '.version_select at 0x7f31ab0c9c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.125229 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-102eb484-e99b-45aa-bb7a-ad92227a6672 tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] HTTP exception thrown: Hypervisor with ID '52322d9e-1650-4be1-9153-fc35e7efb628' could not be found. Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-102eb484-e99b-45aa-bb7a-ad92227a6672 tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Request method failure captured: Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hypervisors/52322d9e-1650-4be1-9153-fc35e7efb628 HTTP/1.1 Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiEuQ1C-JsGWoHCXz6FMP2W4h-3bltBwraE_8iPXQKHKotpC8LAc50VOm-OXu0v-bjt-sgv7LEHuJn37ym-XmbkJ8OepHnCzxEfeyMJRTlH_Nrxhpp5fUXMWNlSoQZWDPaALXc58vQXlhDAMxFRXLHkFUu0EHJjUoBptoak72Ye85M Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: f351874af2a442d4b29a490e621e550e Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-53320489 Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 08:59:52.128145 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f351874af2a442d4b29a490e621e550e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f351874af2a442d4b29a490e621e550e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f351874af2a442d4b29a490e621e550e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f351874af2a442d4b29a490e621e550e"}]}] Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-53320489 Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: f351874af2a442d4b29a490e621e550e Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-53320489 Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 646cf5b6bf774b43b021a05957cc4efe Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: exception: Hypervisor with ID '52322d9e-1650-4be1-9153-fc35e7efb628' could not be found. Oct 27 08:59:52.129419 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '52322d9e-1650-4be1-9153-fc35e7efb628'} Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '52322d9e-1650-4be1-9153-fc35e7efb628' Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 27 08:59:52.130252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 08:59:52.131382 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '52322d9e-1650-4be1-9153-fc35e7efb628' could not be found. Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '52322d9e-1650-4be1-9153-fc35e7efb628' could not be found. Oct 27 08:59:52.133588 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 08:59:52.134924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-102eb484-e99b-45aa-bb7a-ad92227a6672 tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] Returning 404 to user: Hypervisor with ID '52322d9e-1650-4be1-9153-fc35e7efb628' could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 08:59:52.137276 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-102eb484-e99b-45aa-bb7a-ad92227a6672 tempest-HypervisorAdminNegativeTestJSON-53320489 tempest-HypervisorAdminNegativeTestJSON-53320489-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/52322d9e-1650-4be1-9153-fc35e7efb628" status: 404 len: 123 microversion: 2.1 time: 0.018632 Oct 27 08:59:52.139158 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 34/75] 10.222.0.25 () {58 vars in 1257 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/os-hypervisors/52322d9e-1650-4be1-9153-fc35e7efb628 => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 08:59:52.158324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf427f6e-4db1-4e4e-bc4e-4d4b4690e6a4 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.212214 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf427f6e-4db1-4e4e-bc4e-4d4b4690e6a4 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.068327 Oct 27 08:59:52.215085 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 35/76] 10.222.0.25 () {58 vars in 1169 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:52.241115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dacf06ef-d22f-42ce-8c7d-715eb80da0ee tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.246987 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-420db4b0-5c56-42e0-a1ea-697354c488e1 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/dc37095c97004c41a39d8e22d98dfe7e?user_id=37ff1c9cbf1643f498d600c11be04d83" status: 200 len: 240 microversion: 2.36 time: 0.617206 Oct 27 08:59:52.248292 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 42/77] 10.222.0.25 () {62 vars in 1384 bytes} [Thu Oct 27 08:59:51 2022] PUT /compute/v2.1/os-quota-sets/dc37095c97004c41a39d8e22d98dfe7e?user_id=37ff1c9cbf1643f498d600c11be04d83 => generated 240 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:59:52.266251 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dacf06ef-d22f-42ce-8c7d-715eb80da0ee tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.043257 Oct 27 08:59:52.267341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4451b599-a7b8-4b1b-8a9c-9adc7db22798 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] Calling method '.version_select at 0x7f31ab0d4940>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.267498 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 36/78] 10.222.0.25 () {58 vars in 1177 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:52.284740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50a7d513-cb0b-4740-bb90-8457c0914c1d tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.318342 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50a7d513-cb0b-4740-bb90-8457c0914c1d tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.038028 Oct 27 08:59:52.321434 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 37/79] 10.222.0.25 () {58 vars in 1171 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:52.333705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01528a98-8cf9-44ed-8d41-d28ef53b416c tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.396288 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01528a98-8cf9-44ed-8d41-d28ef53b416c tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.067977 Oct 27 08:59:52.430271 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 38/80] 10.222.0.25 () {58 vars in 1169 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:52.454004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62495807-fed1-4a04-b9c7-7b1cd7f60761 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.500489 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4451b599-a7b8-4b1b-8a9c-9adc7db22798 tempest-QuotasAdminTestV236-1734653716 tempest-QuotasAdminTestV236-1734653716-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/dc37095c97004c41a39d8e22d98dfe7e?user_id=37ff1c9cbf1643f498d600c11be04d83" status: 200 len: 282 microversion: 2.36 time: 0.235621 Oct 27 08:59:52.511901 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 43/81] 10.222.0.25 () {60 vars in 1364 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/os-quota-sets/dc37095c97004c41a39d8e22d98dfe7e?user_id=37ff1c9cbf1643f498d600c11be04d83 => generated 282 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 08:59:52.538630 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62495807-fed1-4a04-b9c7-7b1cd7f60761 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.090841 Oct 27 08:59:52.555357 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 39/82] 10.222.0.25 () {58 vars in 1169 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:52.561682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d1da3825-3123-4ecb-b556-2813c8b8cdf4 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.638240 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1da3825-3123-4ecb-b556-2813c8b8cdf4 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.073760 Oct 27 08:59:52.640250 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 44/83] 10.222.0.25 () {58 vars in 1175 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:52.660936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0ec0064-0e79-4cbc-94aa-d125188a38e8 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.731279 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0ec0064-0e79-4cbc-94aa-d125188a38e8 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.076906 Oct 27 08:59:52.731922 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 40/84] 10.222.0.25 () {58 vars in 1173 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:52.768775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8664c939-cf72-4c9a-9de0-7ff22ed255e8 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.819330 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8664c939-cf72-4c9a-9de0-7ff22ed255e8 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.071374 Oct 27 08:59:52.826781 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 41/85] 10.222.0.25 () {58 vars in 1169 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:52.839525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:52.848495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:52.865302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:52.871606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:52.872257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:52.874506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:52.882307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:52.884137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:53.280478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1f105af0-9378-4d81-9d59-03d72d98a3af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:53.298264 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1f105af0-9378-4d81-9d59-03d72d98a3af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.556890 Oct 27 08:59:53.302533 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 45/86] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:53.315384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00463c66-d8e9-4c24-bae0-6df81bf63cdf tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:53.332189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=10,nova_api:INSERT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:53.362838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:53.371906 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bef94005-5662-4496-9d68-256b152da715 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.542711 Oct 27 08:59:53.378956 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 42/87] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:52 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:53.384176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:53.398884 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00463c66-d8e9-4c24-bae0-6df81bf63cdf tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1292563296" status: 202 len: 0 microversion: 2.1 time: 0.092582 Oct 27 08:59:53.399420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:53.403597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 46/88] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 08:59:53 2022] DELETE /compute/v2.1/flavors/1292563296 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:53.413882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:53.423542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:53.424306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:53.432416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:53.435539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:53.436194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:53.664908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:53.679534 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-75b1b9a2-68d4-4e4c-8957-b2bb39ad5f7c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1280 microversion: 2.1 time: 0.299037 Oct 27 08:59:53.707729 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 43/89] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:53 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:53.715789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-044714b4-65da-4c7e-81ae-bfef88d34b2e tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:53.796285 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-044714b4-65da-4c7e-81ae-bfef88d34b2e tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088524 Oct 27 08:59:53.796936 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 44/90] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:53.821310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-419c4661-d7f3-4da8-aae2-886fffa8c8d8 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:53.885147 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-419c4661-d7f3-4da8-aae2-886fffa8c8d8 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/769953291" status: 202 len: 0 microversion: 2.1 time: 0.067385 Oct 27 08:59:53.888536 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 45/91] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 08:59:53 2022] DELETE /compute/v2.1/flavors/769953291 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 08:59:53.907197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98c40c24-9a24-4883-a629-f7c281d82149 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:53.914739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 08:59:53.981396 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-98c40c24-9a24-4883-a629-f7c281d82149 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085103 Oct 27 08:59:53.991749 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 46/92] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:54.006717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7fd9dbbc-ba57-4383-b01a-9cde19debe73 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-256354566", "id": 1073287530, "os-flavor-access:is_public": "False"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:54.062377 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7fd9dbbc-ba57-4383-b01a-9cde19debe73 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.061570 Oct 27 08:59:54.064124 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 47/93] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:53 2022] POST /compute/v2.1/flavors => generated 414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:54.078097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8824abc-a069-40c0-b78d-786a66440526 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:54.130793 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8824abc-a069-40c0-b78d-786a66440526 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057899 Oct 27 08:59:54.135644 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 48/94] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:54.159427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d185f1e8-046c-44c9-bbf7-05ac0613a4cf tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:54.238909 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d185f1e8-046c-44c9-bbf7-05ac0613a4cf tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084592 Oct 27 08:59:54.243447 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 49/95] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:54.268225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-044cf85f-36d6-4043-98b0-3a63c3d8d9ef tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:54.314179 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-044cf85f-36d6-4043-98b0-3a63c3d8d9ef tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1073287530" status: 202 len: 0 microversion: 2.1 time: 0.050073 Oct 27 08:59:54.318097 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 50/96] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 08:59:54 2022] DELETE /compute/v2.1/flavors/1073287530 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:54.339029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc182d26-a0ec-423c-9eb0-907ff8c92f58 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:54.404080 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc182d26-a0ec-423c-9eb0-907ff8c92f58 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075915 Oct 27 08:59:54.410601 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 51/97] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 08:59:54.424350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:54.425049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:54.465572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:54.466205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:54.466689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:54.467438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:54.482944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:54.483719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:54.592599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ff439249-ac91-4847-b72a-eebdaf01a8d9 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-910375619", "id": 1997814556, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:54.629402 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ff439249-ac91-4847-b72a-eebdaf01a8d9 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 1.224319 Oct 27 08:59:54.630572 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 47/98] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:53 2022] POST /compute/v2.1/flavors => generated 424 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:54.641717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-71a6e1c2-3c87-4934-aef6-1fafc16d7a9f tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1401109803", "id": 1225417508, "os-flavor-access:is_public": "True"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:54.673819 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-71a6e1c2-3c87-4934-aef6-1fafc16d7a9f tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.041871 Oct 27 08:59:54.678487 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 48/99] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:54 2022] POST /compute/v2.1/flavors => generated 414 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:54.683828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-06cfcd15-c7a5-481f-a9dd-d9af3b2a5292 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:54.700776 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-06cfcd15-c7a5-481f-a9dd-d9af3b2a5292 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020956 Oct 27 08:59:54.707811 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 49/100] 10.222.0.25 () {58 vars in 1182 bytes} [Thu Oct 27 08:59:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:54.713211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dce7346b-a6e5-4303-a085-75c07749e162 tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:54.765697 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dce7346b-a6e5-4303-a085-75c07749e162 tempest-FlavorsAdminTestJSON-443737580 tempest-FlavorsAdminTestJSON-443737580-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.056441 Oct 27 08:59:54.770399 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 50/101] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:54 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:54.776026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:54.780533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:54.796256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:54.797022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:54.797605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:54.800492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:54.801137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:54.803018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:55.073812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:55.083730 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8fdcb167-647c-4e63-a3e0-91fd874b9c22 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1278 microversion: 2.1 time: 0.311994 Oct 27 08:59:55.113685 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 51/102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:54 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1278 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:55.128410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f69f5e06-9bc5-4de4-a171-0b0aed0f4828 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1015691061", "id": 1109119856, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:55.184575 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f69f5e06-9bc5-4de4-a171-0b0aed0f4828 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.060086 Oct 27 08:59:55.194284 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 52/103] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 08:59:55 2022] POST /compute/v2.1/flavors => generated 425 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:55.240716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:55.288477 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fac1d739-f290-4053-bed2-042be77ac246 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.869193 Oct 27 08:59:55.292764 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 52/104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:54 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:55.321011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44deecd4-3a30-4751-bd77-dee7332f37cf tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:55.429463 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44deecd4-3a30-4751-bd77-dee7332f37cf tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1225417508" status: 202 len: 0 microversion: 2.1 time: 0.127868 Oct 27 08:59:55.430161 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 53/105] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 08:59:55 2022] DELETE /compute/v2.1/flavors/1225417508 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 08:59:55.444971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73c5ec1a-92e1-4970-a3c1-57c13bbd2bb4 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:55.506569 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73c5ec1a-92e1-4970-a3c1-57c13bbd2bb4 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.070835 Oct 27 08:59:55.520892 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 54/106] 10.222.0.25 () {58 vars in 1182 bytes} [Thu Oct 27 08:59:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 08:59:55.544984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-454baab2-3484-4be7-9747-37bcc13bff66 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:55.632113 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-454baab2-3484-4be7-9747-37bcc13bff66 tempest-FlavorsAdminTestJSON-1261963725 tempest-FlavorsAdminTestJSON-1261963725-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.105714 Oct 27 08:59:55.637406 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 55/107] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 08:59:55 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:55.655419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61ebcecb-4995-4c3a-acba-a7bb04a7e953 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Action: 'create', calling method: .version_select at 0x7f31ab09e5e0>, body: {"keypair": {"name": "tempest-keypair-1745641971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpRrSF+CzFYBOGGhojph6JTTF97xHK7Pj1SrWZ4Vd7Yv6UyCknSccLvDwKmQS8gTLrvxS0pQlsTd5syMVIoMo0nCrE4vByNSbB6xL6zHtXaKIajkmeKwH9GXAgQ9Wnotw=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:55.682797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-cae9658c-b121-464f-9496-0b6107c12087 req-bde8be98-068e-4ded-afc8-0dd1a1b3e07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fed6968-5fcf-49af-ae89-89d67b3f3a71", "tag": "c6320a03-5e72-449c-ac37-2bd14c4ff9df"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 08:59:55.715217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cae9658c-b121-464f-9496-0b6107c12087 req-bde8be98-068e-4ded-afc8-0dd1a1b3e07d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:55.716739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cae9658c-b121-464f-9496-0b6107c12087 req-bde8be98-068e-4ded-afc8-0dd1a1b3e07d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:55.718240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cae9658c-b121-464f-9496-0b6107c12087 req-bde8be98-068e-4ded-afc8-0dd1a1b3e07d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:55.742054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-61ebcecb-4995-4c3a-acba-a7bb04a7e953 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Getting quotas for project 7ee4717f40ee493aa3aa1c7f37d5ffbe. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 08:59:55.752002 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-cae9658c-b121-464f-9496-0b6107c12087 req-bde8be98-068e-4ded-afc8-0dd1a1b3e07d service nova] Creating event network-changed:c6320a03-5e72-449c-ac37-2bd14c4ff9df for instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 on n-h1-858383-16 Oct 27 08:59:55.752828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cae9658c-b121-464f-9496-0b6107c12087 req-bde8be98-068e-4ded-afc8-0dd1a1b3e07d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 08:59:55.753419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cae9658c-b121-464f-9496-0b6107c12087 req-bde8be98-068e-4ded-afc8-0dd1a1b3e07d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 08:59:55.755457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f1f08-23c2-4a0f-b0c4-b134731cb02f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:55.756260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f1f08-23c2-4a0f-b0c4-b134731cb02f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:55.756908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f1f08-23c2-4a0f-b0c4-b134731cb02f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:55.757898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f1f08-23c2-4a0f-b0c4-b134731cb02f None None] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:55.758643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f1f08-23c2-4a0f-b0c4-b134731cb02f None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:55.759357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f1f08-23c2-4a0f-b0c4-b134731cb02f None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:55.761853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-61ebcecb-4995-4c3a-acba-a7bb04a7e953 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Getting quotas for user 57135e8924954c2da220af70744f9a2b and project 7ee4717f40ee493aa3aa1c7f37d5ffbe. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 08:59:55.773288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.rpcapi [None req-081f1f08-23c2-4a0f-b0c4-b134731cb02f None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 27 08:59:55.774496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f1f08-23c2-4a0f-b0c4-b134731cb02f None None] Releasing lock "compute-rpcapi-router" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 08:59:55.830156 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-081f1f08-23c2-4a0f-b0c4-b134731cb02f None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.624174 Oct 27 08:59:55.834321 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 53/108] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 08:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:55.877717 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61ebcecb-4995-4c3a-acba-a7bb04a7e953 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.237085 Oct 27 08:59:55.878406 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 56/109] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 08:59:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 08:59:56.135008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:56.138503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:56.195711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:56.196259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:56.196725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:56.221119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:56.224941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:56.228807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:56.321217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:56.323145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:56.340469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:56.342020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:56.344200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:56.359950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:56.362116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:56.364521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:56.505833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:56.516414 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a02409ed-e801-4f3b-abc0-6306a7eaa353 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1278 microversion: 2.1 time: 0.393395 Oct 27 08:59:56.524429 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 54/110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:56 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1278 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:56.794766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:56.814746 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d380e27-ceba-4451-b27d-09191f397e2c tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.499727 Oct 27 08:59:56.834275 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 57/111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:56 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 08:59:57.548553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:57.549280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:57.581165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:57.584051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:57.584619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:57.585466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:57.586067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:57.586585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:57.851658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 08:59:57.860033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 08:59:57.917479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:57.918277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:57.919047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:57.920842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 08:59:57.924274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 08:59:57.937788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 08:59:59.794721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 08:59:59.803335 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-094d199e-dd14-48ef-a953-eb26c76a1bf6 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 2.260760 Oct 27 08:59:59.816392 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 55/112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:57 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:00.105944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:00.120016 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5fc9c2cc-ef91-49ac-868a-8ab31f7ccf32 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 2.279569 Oct 27 09:00:00.141653 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 58/113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 08:59:57 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 2302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:00.787347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e3621406-e222-4b9f-ba3f-db5568d65f15 req-05078c3f-79d7-43d1-b1db-a9ca43558b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6df8c1b-2593-4504-a709-cac84e2d7609", "tag": "826b19be-4d0b-4a04-a125-5a61dd079805"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:00.837680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e3621406-e222-4b9f-ba3f-db5568d65f15 req-05078c3f-79d7-43d1-b1db-a9ca43558b04 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:00.838370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e3621406-e222-4b9f-ba3f-db5568d65f15 req-05078c3f-79d7-43d1-b1db-a9ca43558b04 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:00.838573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e3621406-e222-4b9f-ba3f-db5568d65f15 req-05078c3f-79d7-43d1-b1db-a9ca43558b04 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:00.839423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:00.841891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:00.846488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:00.866414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:00.867376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:00.868019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:00.871491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:00.872441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:00.873998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:00.942194 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e3621406-e222-4b9f-ba3f-db5568d65f15 req-05078c3f-79d7-43d1-b1db-a9ca43558b04 service nova] Creating event network-changed:826b19be-4d0b-4a04-a125-5a61dd079805 for instance f6df8c1b-2593-4504-a709-cac84e2d7609 on n-h2-858383-16 Oct 27 09:00:00.969113 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e3621406-e222-4b9f-ba3f-db5568d65f15 req-05078c3f-79d7-43d1-b1db-a9ca43558b04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181522 Oct 27 09:00:00.969788 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 56/114] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:01.171642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:01.174837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:01.216639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:01.223380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:01.223944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:01.233449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:01.235936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:01.238221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:02.252783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:02.267474 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33590b21-f4b4-4b04-9ac9-c48a7c852563 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 1.431791 Oct 27 09:00:02.271561 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 59/115] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:00 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:02.328480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:02.344445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=74 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:02.370640 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83d0c43e-2252-40b8-ad68-1e8d8e13e902 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 1.207391 Oct 27 09:00:02.397771 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 57/116] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:01 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:03.306740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:03.308932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:03.320421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:03.342372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:03.343456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:03.344707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:03.345737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:03.346549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:03.353496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:03.398277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:03.398879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:03.400839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=20 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:03.410247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:03.412187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:03.412649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:03.413385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:03.413849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:03.414287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:03.698877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:03.723050 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c89a9cee-0bcb-4e3b-8201-d471585a8e5b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.418087 Oct 27 09:00:03.730282 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 60/117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:03 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:03.832462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:03.846782 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-274ca423-baf6-4cef-adbd-c47bf9e10af8 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.452288 Oct 27 09:00:03.849479 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 58/118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:03 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:00:04.340326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1677491063", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "1109119856", "adminPass": "***", "networks": [{"uuid": "11ff25de-be4a-46e6-bdd1-d8c7391433b5"}], "security_groups": [{"name": "tempest-securitygroup--690748186"}], "key_name": "tempest-keypair-1745641971", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:04.589805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] validate_networks() for [('11ff25de-be4a-46e6-bdd1-d8c7391433b5', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:00:04.750967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:04.751589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:04.762344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:04.766882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:04.767494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:04.773838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:04.774337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:04.774784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:05.541790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:05.574669 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd14c164-5197-4edd-9e6f-3dc7dcdbe419 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.826593 Oct 27 09:00:05.577182 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 59/119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:04 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:05.604310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:05.607622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:05.623465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:05.627415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:05.629499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:05.632373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:05.634640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:05.636752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:05.771444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=9 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:05.795402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=28 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:05.990886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:06.004507 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-080bf34d-5d09-48e1-a08d-e1458784c2e4 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.424890 Oct 27 09:00:06.008030 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 60/120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:05 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:06.578731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Calling method '.version_select at 0x7f31aafd1af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:06.583395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:06.584243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:06.584501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:06.647022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:06.650755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:06.653362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:06.699384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:06.699889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:06.700339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:06.731869 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1fbbc276-737e-4388-85b7-7bb077f5fba1 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.722388 Oct 27 09:00:06.733068 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 61/121] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:00:06 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:06.758776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:06.778512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:06.812624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:06.813197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:06.813647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:06.814506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:06.814821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:06.815255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:07.693523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:07.708987 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d68df941-e0c5-46d0-a460-22955995aa7a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.954105 Oct 27 09:00:07.710880 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 62/122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:06 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:07.729878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:00:07.731004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:00:07.731739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:00:07.732918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:00:07.733517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:00:07.744265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:07.745018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:07.745648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:07.746553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:07.747182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:07.747851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:07.770047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Getting quotas for project 7ee4717f40ee493aa3aa1c7f37d5ffbe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:07.775108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Getting quotas for user 57135e8924954c2da220af70744f9a2b and project 7ee4717f40ee493aa3aa1c7f37d5ffbe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:07.788546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:00:07.791205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:00:07.849364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd4c932b-a585-4118-b6dc-d7b5116d07d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.518282 Oct 27 09:00:07.850418 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 61/123] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:00:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 3520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:00:07.855748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:07.856361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:07.863959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:07.864448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:07.865045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:07.866007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:07.866645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:07.867216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:08.105462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:08.120615 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2333ce2-918c-429d-b8be-0d796a6036f7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.266747 Oct 27 09:00:08.121889 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 62/124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:07 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:08.132460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-904a4802-7261-46bd-b871-9d9cabb19af7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:08.133075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-904a4802-7261-46bd-b871-9d9cabb19af7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:08.231973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-904a4802-7261-46bd-b871-9d9cabb19af7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:08.245510 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-904a4802-7261-46bd-b871-9d9cabb19af7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1265 microversion: 2.1 time: 0.122180 Oct 27 09:00:08.247462 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 63/125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:08 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:08.395296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6457a5de-3bc5-487f-98d5-4b002c6e3c98 tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] Calling method '.version_select at 0x7f31ab078790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:08.398298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6457a5de-3bc5-487f-98d5-4b002c6e3c98 tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'cde8f7d21051424aaadf1ced8c842b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c93e657736d44d2a87a37290ab4aacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6457a5de-3bc5-487f-98d5-4b002c6e3c98 tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] Request method failure captured: Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-hypervisors/n-h1-858383-16/search HTTP/1.1 Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkiTDlfJJ-8topDFwS7uNhGvqc3uCNQtWGp_K6ack6mUfWjK_v_A7IlKXmsr2TO98pQJjdiY0vSTr1MHX35zish7S-8Xu02UTTzyQ1QSrdF9RjLLH7rPuh8vSpPTgztlRvpqQAUmjVjmOyXxWG1zeI-znB9Ia_V2ZWEaxB1IH3oVZW0 Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0c93e657736d44d2a87a37290ab4aacf Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1485039314 Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:08.407856 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c93e657736d44d2a87a37290ab4aacf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c93e657736d44d2a87a37290ab4aacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c93e657736d44d2a87a37290ab4aacf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c93e657736d44d2a87a37290ab4aacf"}]}] Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1485039314 Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0c93e657736d44d2a87a37290ab4aacf Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1485039314 Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: cde8f7d21051424aaadf1ced8c842b6b Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 09:00:08.409235 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'n-h1-858383-16'} Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:08.410214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 27 09:00:08.411480 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.413726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6457a5de-3bc5-487f-98d5-4b002c6e3c98 tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:08.418051 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6457a5de-3bc5-487f-98d5-4b002c6e3c98 tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-858383-16/search" status: 403 len: 117 microversion: 2.1 time: 0.704964 Oct 27 09:00:08.419103 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 63/126] 10.222.0.25 () {58 vars in 1212 bytes} [Thu Oct 27 09:00:07 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-16/search => generated 117 bytes in 707 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:08.428444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ede4b8c5-bfdb-4ab5-9c4a-5592bc548edd tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Calling method '.version_select at 0x7f31ab07f280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:08.431146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede4b8c5-bfdb-4ab5-9c4a-5592bc548edd tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:08.431862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede4b8c5-bfdb-4ab5-9c4a-5592bc548edd tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:08.432379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede4b8c5-bfdb-4ab5-9c4a-5592bc548edd tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:08.461492 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ede4b8c5-bfdb-4ab5-9c4a-5592bc548edd tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ede4b8c5-bfdb-4ab5-9c4a-5592bc548edd tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Request method failure captured: Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiV50eMZb06jYNFbYF__IKW2hjcLRc5b8cmmz6zI9MVJnSA3hMcFuIoTA0s8b1MKE0ALvLhn2uNFdgg2oQxcHnjCDO6Pfh3Xo5d__36w4KJ1rSgE3JaT-A4ZF8VioKqZ59uCrZnOcR2HlnYDBxTc9-OvWM_6fIfROcwzy4CxKd6Kcw Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 4d52e999483c4111832d13ba224d7f3d Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848348868 Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:08.469559 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d52e999483c4111832d13ba224d7f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d52e999483c4111832d13ba224d7f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d52e999483c4111832d13ba224d7f3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d52e999483c4111832d13ba224d7f3d"}]}] Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1848348868 Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 4d52e999483c4111832d13ba224d7f3d Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848348868 Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5370b8272da84bf7ba218304a5841d93 Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 09:00:08.471064 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:08.471899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:08.473039 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:08.473039 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:08.473039 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:08.473039 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 27 09:00:08.473039 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.473039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ede4b8c5-bfdb-4ab5-9c4a-5592bc548edd tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:08.474689 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ede4b8c5-bfdb-4ab5-9c4a-5592bc548edd tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.050683 Oct 27 09:00:08.480247 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 64/127] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:00:08 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:08.492880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Calling method '.version_select at 0x7f31ab0d49d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:08.495788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:08.496434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:08.496880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:08.521314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:08.521886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:08.522644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:08.536956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:08.537542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:08.537976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:08.544633 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f67e6797-807c-46f4-a908-b64ef3976050 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.062824 Oct 27 09:00:08.546152 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 64/128] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:00:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:08.558804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72cd36c4-2000-4e4c-bd47-3d08b9c10fdc tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] Calling method '.version_select at 0x7f31ab050f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:08.561798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-72cd36c4-2000-4e4c-bd47-3d08b9c10fdc tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'cde8f7d21051424aaadf1ced8c842b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c93e657736d44d2a87a37290ab4aacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72cd36c4-2000-4e4c-bd47-3d08b9c10fdc tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] Request method failure captured: Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiTDlfJJ-8topDFwS7uNhGvqc3uCNQtWGp_K6ack6mUfWjK_v_A7IlKXmsr2TO98pQJjdiY0vSTr1MHX35zish7S-8Xu02UTTzyQ1QSrdF9RjLLH7rPuh8vSpPTgztlRvpqQAUmjVjmOyXxWG1zeI-znB9Ia_V2ZWEaxB1IH3oVZW0 Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0c93e657736d44d2a87a37290ab4aacf Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1485039314 Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:08.563270 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c93e657736d44d2a87a37290ab4aacf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c93e657736d44d2a87a37290ab4aacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c93e657736d44d2a87a37290ab4aacf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c93e657736d44d2a87a37290ab4aacf"}]}] Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1485039314 Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0c93e657736d44d2a87a37290ab4aacf Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1485039314 Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: cde8f7d21051424aaadf1ced8c842b6b Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 09:00:08.564522 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '1'} Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:08.565378 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 27 09:00:08.566421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.567457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72cd36c4-2000-4e4c-bd47-3d08b9c10fdc tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:08.567457 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72cd36c4-2000-4e4c-bd47-3d08b9c10fdc tempest-HypervisorAdminNegativeUnderV252Test-1485039314 tempest-HypervisorAdminNegativeUnderV252Test-1485039314-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.013361 Oct 27 09:00:08.570024 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 65/129] 10.222.0.25 () {58 vars in 1176 bytes} [Thu Oct 27 09:00:08 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:08.584340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bce2d875-c676-40b0-bc35-6da45e6a3840 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Calling method '.version_select at 0x7f31aaff0ca0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:08.587233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bce2d875-c676-40b0-bc35-6da45e6a3840 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:08.588375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bce2d875-c676-40b0-bc35-6da45e6a3840 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:08.589388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bce2d875-c676-40b0-bc35-6da45e6a3840 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:08.606478 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-bce2d875-c676-40b0-bc35-6da45e6a3840 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] HTTP exception thrown: No hypervisor matching '2f27f311-cc97-4619-8dfa-5e2458902219' could be found. Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bce2d875-c676-40b0-bc35-6da45e6a3840 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Request method failure captured: Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-hypervisors/2f27f311-cc97-4619-8dfa-5e2458902219/servers HTTP/1.1 Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkiV50eMZb06jYNFbYF__IKW2hjcLRc5b8cmmz6zI9MVJnSA3hMcFuIoTA0s8b1MKE0ALvLhn2uNFdgg2oQxcHnjCDO6Pfh3Xo5d__36w4KJ1rSgE3JaT-A4ZF8VioKqZ59uCrZnOcR2HlnYDBxTc9-OvWM_6fIfROcwzy4CxKd6Kcw Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 4d52e999483c4111832d13ba224d7f3d Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848348868 Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:08.608600 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d52e999483c4111832d13ba224d7f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d52e999483c4111832d13ba224d7f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d52e999483c4111832d13ba224d7f3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d52e999483c4111832d13ba224d7f3d"}]}] Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1848348868 Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 4d52e999483c4111832d13ba224d7f3d Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848348868 Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5370b8272da84bf7ba218304a5841d93 Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: exception: No hypervisor matching '2f27f311-cc97-4619-8dfa-5e2458902219' could be found. Oct 27 09:00:08.610606 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '2f27f311-cc97-4619-8dfa-5e2458902219'} Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '2f27f311-cc97-4619-8dfa-5e2458902219' could be found. Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.611655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:08.612645 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:08.612645 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:08.612645 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:08.612645 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:08.612645 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '2f27f311-cc97-4619-8dfa-5e2458902219' could be found. Oct 27 09:00:08.612645 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:08.614339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bce2d875-c676-40b0-bc35-6da45e6a3840 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] Returning 404 to user: No hypervisor matching '2f27f311-cc97-4619-8dfa-5e2458902219' could be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:08.615579 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bce2d875-c676-40b0-bc35-6da45e6a3840 tempest-HypervisorAdminNegativeUnderV252Test-1848348868 tempest-HypervisorAdminNegativeUnderV252Test-1848348868-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2f27f311-cc97-4619-8dfa-5e2458902219/servers" status: 404 len: 123 microversion: 2.1 time: 0.040398 Oct 27 09:00:08.616758 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 65/130] 10.222.0.25 () {58 vars in 1281 bytes} [Thu Oct 27 09:00:08 2022] GET /compute/v2.1/os-hypervisors/2f27f311-cc97-4619-8dfa-5e2458902219/servers => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:08.739473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:08.750944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:08.774537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:08.775741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:08.776200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:08.778920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:08.783474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:08.784006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:08.989816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:08.999413 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff030ac1-a708-48b1-ab4e-8165242a0336 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.266051 Oct 27 09:00:09.002128 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 66/131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:08 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:09.155337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:09.155974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:09.167859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:09.168351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:09.168787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:09.169487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:09.170507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:09.170931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:09.332446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:09.350304 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f67698b-924a-4471-87ab-9817d971ccb3 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.199784 Oct 27 09:00:09.351194 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 67/132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:09 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:00:09.360466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:09.361075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:09.367610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:09.368381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:09.369126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:09.370078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:09.370706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:09.371378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:09.446375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5923e7b-e90f-4296-a827-6b8ab61c129e tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Calling method '.version_select at 0x7f31ab0d4ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:09.448800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:09.458665 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94cd6438-9597-4fc0-af14-e0bb2ddebc30 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1339 microversion: 2.1 time: 0.106227 Oct 27 09:00:09.459524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 68/133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:09 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:10.041123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:10.043392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:10.052865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:10.053420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:10.053872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:10.054717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:10.055287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:10.055657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:10.151355 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f5923e7b-e90f-4296-a827-6b8ab61c129e tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/48dcd0642b824e388fded750d8ed0a0c" status: 200 len: 371 microversion: 2.1 time: 1.198615 Oct 27 09:00:10.151982 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 66/134] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 09:00:08 2022] GET /compute/v2.1/os-quota-sets/48dcd0642b824e388fded750d8ed0a0c => generated 371 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:10.166093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-09193de5-48c6-435b-9035-c8acc87bf22f tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Action: 'update', calling method: .version_select at 0x7f31ab07af70>, body: {"quota_set": {"ram": "5120"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:10.379137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09193de5-48c6-435b-9035-c8acc87bf22f tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:10.382408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09193de5-48c6-435b-9035-c8acc87bf22f tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:10.382864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09193de5-48c6-435b-9035-c8acc87bf22f tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:10.383800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09193de5-48c6-435b-9035-c8acc87bf22f tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:10.385952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09193de5-48c6-435b-9035-c8acc87bf22f tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:10.386412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09193de5-48c6-435b-9035-c8acc87bf22f tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:10.439519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:10.448382 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e2ff38a-f9a0-4989-9843-9776734531c8 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.419566 Oct 27 09:00:10.448974 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 69/135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:10 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:10.460772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:10.461394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:10.472553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:10.477623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:10.479107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:10.483410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:10.484004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:10.484444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:10.507801 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-09193de5-48c6-435b-9035-c8acc87bf22f tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/48dcd0642b824e388fded750d8ed0a0c" status: 200 len: 328 microversion: 2.1 time: 0.346651 Oct 27 09:00:10.517192 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 67/136] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:00:10 2022] PUT /compute/v2.1/os-quota-sets/48dcd0642b824e388fded750d8ed0a0c => generated 328 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:00:10.526417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:10.527198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:10.546265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:10.546872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:10.548613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:10.549522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:10.550125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:10.550628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:10.740491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:10.753399 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0d6863fd-61e3-4795-9e87-e782dcc36d9e tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1345 microversion: 2.1 time: 0.234571 Oct 27 09:00:10.754639 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 68/137] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:10 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1345 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:10.765520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03de0078-f254-4cfa-bfd6-8104e87b3cce tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:10.814064 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-03de0078-f254-4cfa-bfd6-8104e87b3cce tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/48dcd0642b824e388fded750d8ed0a0c" status: 202 len: 0 microversion: 2.1 time: 0.058327 Oct 27 09:00:10.815434 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 69/138] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:00:10 2022] DELETE /compute/v2.1/os-quota-sets/48dcd0642b824e388fded750d8ed0a0c => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:10.837076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08830ee6-2066-4677-8b5b-c83f6f0e5af2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Calling method '.version_select at 0x7f31aaf95af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:11.089705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:11.102653 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8273135-6042-4fe6-bf91-0c71780a85a7 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.652648 Oct 27 09:00:11.103725 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 70/139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:10 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:11.338359 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08830ee6-2066-4677-8b5b-c83f6f0e5af2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/48dcd0642b824e388fded750d8ed0a0c" status: 200 len: 371 microversion: 2.1 time: 0.518770 Oct 27 09:00:11.340972 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 70/140] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 09:00:10 2022] GET /compute/v2.1/os-quota-sets/48dcd0642b824e388fded750d8ed0a0c => generated 371 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:00:11.484303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cbe73b51-03d2-4647-8bc0-5a1b0fe5e8e6 req-3b7a5715-c350-4727-a249-e7045fea2b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fed6968-5fcf-49af-ae89-89d67b3f3a71", "name": "network-vif-plugged", "status": "completed", "tag": "c6320a03-5e72-449c-ac37-2bd14c4ff9df"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:11.485143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:11.487682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:11.507777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:11.508547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:11.512098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:11.514838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:11.515881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:11.517297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:11.531345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cbe73b51-03d2-4647-8bc0-5a1b0fe5e8e6 req-3b7a5715-c350-4727-a249-e7045fea2b36 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:11.531890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cbe73b51-03d2-4647-8bc0-5a1b0fe5e8e6 req-3b7a5715-c350-4727-a249-e7045fea2b36 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:11.533999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cbe73b51-03d2-4647-8bc0-5a1b0fe5e8e6 req-3b7a5715-c350-4727-a249-e7045fea2b36 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:11.596566 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cbe73b51-03d2-4647-8bc0-5a1b0fe5e8e6 req-3b7a5715-c350-4727-a249-e7045fea2b36 service nova] Creating event network-vif-plugged:c6320a03-5e72-449c-ac37-2bd14c4ff9df for instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 on n-h1-858383-16 Oct 27 09:00:11.597359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cbe73b51-03d2-4647-8bc0-5a1b0fe5e8e6 req-3b7a5715-c350-4727-a249-e7045fea2b36 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:00:11.597897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cbe73b51-03d2-4647-8bc0-5a1b0fe5e8e6 req-3b7a5715-c350-4727-a249-e7045fea2b36 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:00:11.600250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b0ab65-215f-4a12-91ce-96c38c39d63f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:11.603542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b0ab65-215f-4a12-91ce-96c38c39d63f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:11.604249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b0ab65-215f-4a12-91ce-96c38c39d63f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:11.605179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b0ab65-215f-4a12-91ce-96c38c39d63f None None] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:11.606753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b0ab65-215f-4a12-91ce-96c38c39d63f None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:11.609021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b0ab65-215f-4a12-91ce-96c38c39d63f None None] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:11.620821 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.compute.rpcapi [None req-a5b0ab65-215f-4a12-91ce-96c38c39d63f None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 27 09:00:11.621957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b0ab65-215f-4a12-91ce-96c38c39d63f None None] Releasing lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:00:11.650842 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5b0ab65-215f-4a12-91ce-96c38c39d63f None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.513755 Oct 27 09:00:11.651539 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 71/141] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:11.778755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:11.780262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:11.804033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:11.804033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:11.804033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:11.804033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:11.804637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:11.804873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:11.906228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:11.917381 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5dacd7d8-2af3-4e4f-891d-f9ea571a9494 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.446396 Oct 27 09:00:11.917954 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 71/142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:11 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:11.935696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86c2c686-0f13-41dc-a481-8a8f44943269 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Calling method '.version_select at 0x7f31ab0d4790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:12.156068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:12.172067 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70e638e7-fc2a-4d92-8d93-5a8dd3130abc tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1412 microversion: 2.1 time: 0.392147 Oct 27 09:00:12.173465 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 72/143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:11 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1412 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:12.178841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:12.181474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:12.197488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:12.204218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:12.206523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:12.208519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:12.209787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:12.212195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:12.613240 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86c2c686-0f13-41dc-a481-8a8f44943269 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/1648d1bfd8f34d9793778f804f57fd50/defaults" status: 200 len: 371 microversion: 2.1 time: 0.693887 Oct 27 09:00:12.614694 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 72/144] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:00:11 2022] GET /compute/v2.1/os-quota-sets/1648d1bfd8f34d9793778f804f57fd50/defaults => generated 371 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:12.631171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:12.641011 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e5cd3b1-c534-4fa9-9510-cc390e9bcf84 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.466071 Oct 27 09:00:12.641754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 73/145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:12 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:12.945797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:12.946900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:12.976914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:12.978353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:12.980862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:12.983406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:12.986892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:12.988435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:13.200270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:13.201686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:13.226142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:13.227489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:13.230554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:13.246426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:13.247490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:13.248964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:13.380479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:13.393243 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77d025ac-740f-4dd2-a1ea-5446e7c56705 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.455201 Oct 27 09:00:13.398508 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 73/146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:12 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:13.409470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0d292725-f826-4de9-8420-e0a02852e4ae req-32f6f2ab-8a25-4738-b240-f9b12823c8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d008a476-b957-43e1-a895-4c894f28710c", "tag": "c78cff33-79a1-4f60-af2e-aa6e1fa0007e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:13.433104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0d292725-f826-4de9-8420-e0a02852e4ae req-32f6f2ab-8a25-4738-b240-f9b12823c8ce service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:13.440053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0d292725-f826-4de9-8420-e0a02852e4ae req-32f6f2ab-8a25-4738-b240-f9b12823c8ce service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:13.443922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0d292725-f826-4de9-8420-e0a02852e4ae req-32f6f2ab-8a25-4738-b240-f9b12823c8ce service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:13.505308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:13.515536 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-26c4676f-209d-4437-81b6-101307d0237f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1412 microversion: 2.1 time: 0.322536 Oct 27 09:00:13.516674 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 74/147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:13 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1412 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:13.533522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-deecc826-3b4b-46f1-a73a-627ca9d7aa5b tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Action: 'update', calling method: .version_select at 0x7f31ab050790>, body: {"quota_set": {"ram": "5120"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:13.723188 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0d292725-f826-4de9-8420-e0a02852e4ae req-32f6f2ab-8a25-4738-b240-f9b12823c8ce service nova] Creating event network-changed:c78cff33-79a1-4f60-af2e-aa6e1fa0007e for instance d008a476-b957-43e1-a895-4c894f28710c on n-h1-858383-16 Oct 27 09:00:13.731032 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0d292725-f826-4de9-8420-e0a02852e4ae req-32f6f2ab-8a25-4738-b240-f9b12823c8ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331151 Oct 27 09:00:13.734732 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 74/148] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:13.744933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:13.749491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:13.762724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:13.763424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:13.764104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:13.766290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:13.766957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:13.768083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:14.033763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:14.060143 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0dd13d72-c8af-4c9c-91cd-0888124d8509 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1339 microversion: 2.1 time: 0.321089 Oct 27 09:00:14.063020 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 75/149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:13 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1339 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:14.179713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deecc826-3b4b-46f1-a73a-627ca9d7aa5b tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:14.180490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deecc826-3b4b-46f1-a73a-627ca9d7aa5b tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:14.181215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deecc826-3b4b-46f1-a73a-627ca9d7aa5b tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:14.182713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deecc826-3b4b-46f1-a73a-627ca9d7aa5b tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:14.183325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deecc826-3b4b-46f1-a73a-627ca9d7aa5b tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:14.195338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deecc826-3b4b-46f1-a73a-627ca9d7aa5b tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:14.250299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:14.336078 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-deecc826-3b4b-46f1-a73a-627ca9d7aa5b tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/117e34cb4d3f411d99d4d7710712ffe5" status: 200 len: 328 microversion: 2.1 time: 0.805878 Oct 27 09:00:14.337738 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 75/150] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:00:13 2022] PUT /compute/v2.1/os-quota-sets/117e34cb4d3f411d99d4d7710712ffe5 => generated 328 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:00:14.349967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8709e006-07d2-4a6a-801e-a68a797e73d7 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Calling method '.version_select at 0x7f31aafafd30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:14.421648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:14.422449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:14.460438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:14.462096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:14.465370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:14.466978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:14.467687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:14.468361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:14.745277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:14.758734 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db0efe68-a544-41f8-99fa-4078a38f8f0a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.342874 Oct 27 09:00:14.762175 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 76/151] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:14 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:00:14.781181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:14.785082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:14.815441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:14.825884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:14.827120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:14.832962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:14.833647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:14.835064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:15.200665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8709e006-07d2-4a6a-801e-a68a797e73d7 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:15.204673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8709e006-07d2-4a6a-801e-a68a797e73d7 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:15.206228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8709e006-07d2-4a6a-801e-a68a797e73d7 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:15.207178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8709e006-07d2-4a6a-801e-a68a797e73d7 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:15.215327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8709e006-07d2-4a6a-801e-a68a797e73d7 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:15.216060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8709e006-07d2-4a6a-801e-a68a797e73d7 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:15.301884 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8709e006-07d2-4a6a-801e-a68a797e73d7 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/117e34cb4d3f411d99d4d7710712ffe5/detail" status: 200 len: 916 microversion: 2.1 time: 0.955543 Oct 27 09:00:15.320332 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 76/152] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:00:14 2022] GET /compute/v2.1/os-quota-sets/117e34cb4d3f411d99d4d7710712ffe5/detail => generated 916 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:15.358074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:15.361991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:15.382506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:15.385753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:15.386612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:15.389158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:15.389868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:15.390629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:15.760142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:15.786997 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0ea7726-ac16-441a-89aa-18451102cbe3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1412 microversion: 2.1 time: 1.018500 Oct 27 09:00:15.798962 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 77/153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:14 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1412 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:15.803727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d55f0d80-0802-45c5-8419-62d5911801a6 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Calling method '.version_select at 0x7f31ab09e9d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:15.846196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:15.876450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d244565-8eba-4036-869d-4aa0535b47b9 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1489 microversion: 2.1 time: 0.553677 Oct 27 09:00:15.877955 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 77/154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:15 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1489 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:15.887313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Action: 'update', calling method: .version_select at 0x7f31ab1adc10>, body: {"quota_set": {"ram": "2048"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:15.933980 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d55f0d80-0802-45c5-8419-62d5911801a6 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb" status: 200 len: 637 microversion: 2.1 time: 0.138737 Oct 27 09:00:15.937119 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 78/155] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:00:15 2022] GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb => generated 637 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:15.960139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:15.963681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:15.989638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:15.990924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:15.992008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:15.993776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:15.995960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:15.997773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:16.280535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:16.281902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:16.282565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:16.289778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:16.290359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:16.291085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:16.291917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:16.310962 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5f019b8f-ec10-4ef8-94f4-3579180355d7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.372045 Oct 27 09:00:16.313083 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 79/156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:15 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:16.321507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8f9a1ae-2d7a-46d8-a2d1-888deb29c4df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:16.322681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8f9a1ae-2d7a-46d8-a2d1-888deb29c4df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:16.330294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8f9a1ae-2d7a-46d8-a2d1-888deb29c4df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:16.331279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8f9a1ae-2d7a-46d8-a2d1-888deb29c4df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:16.331941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8f9a1ae-2d7a-46d8-a2d1-888deb29c4df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:16.332854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8f9a1ae-2d7a-46d8-a2d1-888deb29c4df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:16.333502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8f9a1ae-2d7a-46d8-a2d1-888deb29c4df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:16.334217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8f9a1ae-2d7a-46d8-a2d1-888deb29c4df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:16.341985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:16.424069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:16.428485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:16.430740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:16.432774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:16.436263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:16.438222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:16.551335 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d2e8cde9-005f-41af-bc26-b0efbc06e6f2 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/117e34cb4d3f411d99d4d7710712ffe5?user_id=df64b7bc1c1c49bfbb5b7e5a11c9a944" status: 200 len: 328 microversion: 2.1 time: 0.671657 Oct 27 09:00:16.552816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 78/157] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:00:15 2022] PUT /compute/v2.1/os-quota-sets/117e34cb4d3f411d99d4d7710712ffe5?user_id=df64b7bc1c1c49bfbb5b7e5a11c9a944 => generated 328 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:16.558457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de27e698-0714-4101-bc58-8e6ca1fd348e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Action: 'update_all', calling method: .version_select at 0x7f31aafafca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:16.643856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-de27e698-0714-4101-bc58-8e6ca1fd348e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:16.648670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-de27e698-0714-4101-bc58-8e6ca1fd348e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for user 518d7e635e814075906d43994ec04b1c and project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:16.851393 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8f9a1ae-2d7a-46d8-a2d1-888deb29c4df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1642 microversion: 2.1 time: 0.536743 Oct 27 09:00:16.856592 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 80/158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:16 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1642 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:17.054352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-67960546", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:17.143748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:00:17.221221 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de27e698-0714-4101-bc58-8e6ca1fd348e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.666977 Oct 27 09:00:17.221983 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 79/159] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:00:16 2022] PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 61 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:17.233017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e22ce2fc-410d-4725-bafc-7a2c6e85d1dc tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Calling method '.version_select at 0x7f31aaf95670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:17.406607 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e22ce2fc-410d-4725-bafc-7a2c6e85d1dc tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/117e34cb4d3f411d99d4d7710712ffe5?user_id=df64b7bc1c1c49bfbb5b7e5a11c9a944" status: 200 len: 370 microversion: 2.1 time: 0.182765 Oct 27 09:00:17.407602 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 80/160] 10.222.0.25 () {58 vars in 1323 bytes} [Thu Oct 27 09:00:17 2022] GET /compute/v2.1/os-quota-sets/117e34cb4d3f411d99d4d7710712ffe5?user_id=df64b7bc1c1c49bfbb5b7e5a11c9a944 => generated 370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:17.428102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:17.430565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:17.445102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:17.446381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:17.447398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:17.448789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:17.449775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:17.452206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:17.613721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:00:17.614417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:00:17.615202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:00:17.615882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:00:17.616522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:00:17.648311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:17.649129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:17.650121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:17.651326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:17.652305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:17.652892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:17.720432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:17.732257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for user 0566a978e2924137973615346b1afaa3 and project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:17.746215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:00:17.748833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:17.749577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:00:17.759894 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5f4b32a-3694-4cb7-b32e-d373e339a3c3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1412 microversion: 2.1 time: 0.351024 Oct 27 09:00:17.779258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 81/161] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:17 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1412 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:17.785282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:17.786005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:17.793232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:17.793903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:17.795917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:17.796814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:17.797461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:17.798095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:17.809777 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9653a59c-2d46-454b-be55-d5356a48d853 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951654 Oct 27 09:00:17.811489 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 81/162] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:00:17.823313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-254c5272-b2f0-463d-a5e3-b1f87e40485c tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Calling method '.version_select at 0x7f31aafcb160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:17.863257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:00:18.005717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:18.089929 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c272c5b-4abf-43f9-8a26-bb8d060c1f2f tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 204 len: 0 microversion: 2.1 time: 0.309230 Oct 27 09:00:18.102640 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 82/163] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:00:17 2022] DELETE /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:00:18.114568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:18.117927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:18.127633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:18.128666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:18.129365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:18.130639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:18.132054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:18.132844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:18.215401 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-254c5272-b2f0-463d-a5e3-b1f87e40485c tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "DELETE /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.398275 Oct 27 09:00:18.217345 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 82/164] 10.222.0.25 () {58 vars in 1296 bytes} [Thu Oct 27 09:00:17 2022] DELETE /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata/os_version => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:00:18.222302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-837a888a-cbf5-43a6-ab48-e6afc7028fa9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:18.223823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-837a888a-cbf5-43a6-ab48-e6afc7028fa9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:18.339830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-837a888a-cbf5-43a6-ab48-e6afc7028fa9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:18.350916 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-837a888a-cbf5-43a6-ab48-e6afc7028fa9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1211 microversion: 2.1 time: 0.132443 Oct 27 09:00:18.376489 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 83/165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:18 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1211 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:18.389551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b15e81c1-8b34-42f5-9ab5-a9de55280e49 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Calling method '.version_select at 0x7f31ab07f820>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:18.418833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:18.432154 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ada5aee-5651-42b8-b1b2-1688d4446630 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.327772 Oct 27 09:00:18.434898 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 83/166] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:18 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:18.439971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:18.442506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:18.457759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:18.459516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:18.460207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:18.462918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:18.463653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:18.464256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:18.765511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:18.774750 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6feff33-3f50-40e6-944f-1b66ebbbc6f6 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1495 microversion: 2.1 time: 0.338055 Oct 27 09:00:18.775767 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 84/167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:18 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1495 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:18.801772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ec6dc1a-c62e-429b-ac24-0debb1ed4b3c tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Calling method '.version_select at 0x7f31ab07aa60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:18.803775 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b15e81c1-8b34-42f5-9ab5-a9de55280e49 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/1648d1bfd8f34d9793778f804f57fd50/defaults" status: 200 len: 371 microversion: 2.1 time: 0.425738 Oct 27 09:00:18.811932 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 84/168] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:00:18 2022] GET /compute/v2.1/os-quota-sets/1648d1bfd8f34d9793778f804f57fd50/defaults => generated 371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:18.821633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:18.822361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:18.840276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:18.840929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:18.842098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:18.842839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:18.846544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:18.847004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:18.850841 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3ec6dc1a-c62e-429b-ac24-0debb1ed4b3c tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 37 microversion: 2.1 time: 0.056026 Oct 27 09:00:18.851420 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 85/169] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:00:18 2022] GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 37 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:18.862288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ac25e40-99f6-42f5-b86e-86c95914c1fb tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Action: 'update', calling method: .version_select at 0x7f31ab0d4940>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:18.964042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac25e40-99f6-42f5-b86e-86c95914c1fb tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:18.964457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac25e40-99f6-42f5-b86e-86c95914c1fb tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:18.964894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac25e40-99f6-42f5-b86e-86c95914c1fb tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:18.965624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac25e40-99f6-42f5-b86e-86c95914c1fb tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:18.966733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac25e40-99f6-42f5-b86e-86c95914c1fb tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:18.967401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ac25e40-99f6-42f5-b86e-86c95914c1fb tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:19.199131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:19.207465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:19.213100 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6de2d68d-a915-4668-ac4d-34b8a17a84fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1412 microversion: 2.1 time: 0.406481 Oct 27 09:00:19.221304 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 85/170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:18 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1412 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:19.235450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab081825-317a-4ff3-a552-f772c68a3296 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Action: 'update_all', calling method: .version_select at 0x7f31ab0c9790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:19.337511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ab081825-317a-4ff3-a552-f772c68a3296 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:19.350201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ab081825-317a-4ff3-a552-f772c68a3296 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for user 518d7e635e814075906d43994ec04b1c and project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:19.394399 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ac25e40-99f6-42f5-b86e-86c95914c1fb tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1648d1bfd8f34d9793778f804f57fd50" status: 200 len: 329 microversion: 2.1 time: 0.535738 Oct 27 09:00:19.395617 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 86/171] 10.222.0.25 () {60 vars in 1263 bytes} [Thu Oct 27 09:00:18 2022] PUT /compute/v2.1/os-quota-sets/1648d1bfd8f34d9793778f804f57fd50 => generated 329 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:19.407349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0638ff89-0cf2-41d8-adc7-843d4e87beee req-77f0808f-8cc3-4ed2-b9ac-e31589656362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6df8c1b-2593-4504-a709-cac84e2d7609", "name": "network-vif-plugged", "status": "completed", "tag": "826b19be-4d0b-4a04-a125-5a61dd079805"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:19.420218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0638ff89-0cf2-41d8-adc7-843d4e87beee req-77f0808f-8cc3-4ed2-b9ac-e31589656362 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:19.421414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0638ff89-0cf2-41d8-adc7-843d4e87beee req-77f0808f-8cc3-4ed2-b9ac-e31589656362 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:19.422007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0638ff89-0cf2-41d8-adc7-843d4e87beee req-77f0808f-8cc3-4ed2-b9ac-e31589656362 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:19.442934 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0638ff89-0cf2-41d8-adc7-843d4e87beee req-77f0808f-8cc3-4ed2-b9ac-e31589656362 service nova] Creating event network-vif-plugged:826b19be-4d0b-4a04-a125-5a61dd079805 for instance f6df8c1b-2593-4504-a709-cac84e2d7609 on n-h2-858383-16 Oct 27 09:00:19.449594 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0638ff89-0cf2-41d8-adc7-843d4e87beee req-77f0808f-8cc3-4ed2-b9ac-e31589656362 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052228 Oct 27 09:00:19.450194 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 87/172] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:19.455944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:19.457091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:19.465096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:19.466251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:19.467161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:19.468061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:19.468768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:19.469404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:19.589456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:19.598269 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00a790c2-2f73-4b15-bbeb-917a5a0a49fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1263 microversion: 2.1 time: 0.146669 Oct 27 09:00:19.598865 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 88/173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:19 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:19.611723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6517de6-0c54-407b-9579-0901eaa6d950 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Action: 'update', calling method: .version_select at 0x7f31ab016160>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:19.747835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6517de6-0c54-407b-9579-0901eaa6d950 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:19.748331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6517de6-0c54-407b-9579-0901eaa6d950 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:19.748840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6517de6-0c54-407b-9579-0901eaa6d950 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:19.755856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6517de6-0c54-407b-9579-0901eaa6d950 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:19.758730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6517de6-0c54-407b-9579-0901eaa6d950 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:19.759451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6517de6-0c54-407b-9579-0901eaa6d950 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:19.792094 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab081825-317a-4ff3-a552-f772c68a3296 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.568676 Oct 27 09:00:19.792916 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 86/174] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:00:19 2022] PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 61 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:19.798135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:19.798753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:19.806821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:19.807617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:19.808071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:19.808785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:19.809244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:19.810235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:19.838838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=16,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:20.289173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:20.327411 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6517de6-0c54-407b-9579-0901eaa6d950 tempest-QuotasAdminTestJSON-1369251548 tempest-QuotasAdminTestJSON-1369251548-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1648d1bfd8f34d9793778f804f57fd50" status: 200 len: 329 microversion: 2.1 time: 0.727450 Oct 27 09:00:20.336940 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 89/175] 10.222.0.25 () {60 vars in 1263 bytes} [Thu Oct 27 09:00:19 2022] PUT /compute/v2.1/os-quota-sets/1648d1bfd8f34d9793778f804f57fd50 => generated 329 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:20.341876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-350807e5-69bf-44c4-a1df-86fd0275587a tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Calling method '.version_select at 0x7f31ab07a820>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:20.414893 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-350807e5-69bf-44c4-a1df-86fd0275587a tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.076771 Oct 27 09:00:20.415709 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 90/176] 10.222.0.25 () {58 vars in 1290 bytes} [Thu Oct 27 09:00:20 2022] GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata/os_distro => generated 33 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:20.423807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:20.431464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:20.443200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:20.450952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:20.451692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:20.452626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:20.453264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:20.453881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:20.512962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:20.524458 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9653ddd1-4e61-4fbf-8513-2144462e1a73 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.730313 Oct 27 09:00:20.525183 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 87/177] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:19 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:20.642999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1200642542", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ff9a447f-bbfd-4e05-944d-b9d8c867cecf"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:20.735179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] validate_networks() for [('ff9a447f-bbfd-4e05-944d-b9d8c867cecf', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:00:20.910117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:20.921511 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d6c588c1-47bd-47f3-9502-e82ffba0e765 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1495 microversion: 2.1 time: 0.504505 Oct 27 09:00:20.938546 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 91/178] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:20 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1495 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:20.938546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:20.938546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:20.946468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:20.948490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:20.948936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:20.949667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:20.950124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:20.951083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:21.441609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:21.453725 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6696f75f-4a9b-4b3b-9cb2-9aa9bb3eaf41 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1412 microversion: 2.1 time: 0.527831 Oct 27 09:00:21.454558 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 92/179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:20 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1412 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:21.460595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ccff1f47-7929-4471-b168-9e463b4c5f36 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Action: 'update_all', calling method: .version_select at 0x7f31aaeda670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:21.538690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ccff1f47-7929-4471-b168-9e463b4c5f36 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:21.546754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ccff1f47-7929-4471-b168-9e463b4c5f36 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for user 518d7e635e814075906d43994ec04b1c and project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:21.742025 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ccff1f47-7929-4471-b168-9e463b4c5f36 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.286265 Oct 27 09:00:21.743161 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 93/180] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:00:21 2022] PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 61 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:21.748660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:21.749577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:21.756781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:21.757820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:21.758849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:21.760019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:21.760687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:21.761314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:21.998417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:22.012024 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fe9f9704-8d38-480e-b86c-30d2934ef977 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1269 microversion: 2.1 time: 0.263559 Oct 27 09:00:22.012687 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 94/181] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:21 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1269 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:22.049003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:22.050083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:22.058066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:22.058931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:22.060198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:22.061733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:22.062424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:22.063250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:22.289181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:00:22.289701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:00:22.290141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:00:22.290545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:00:22.291008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:00:22.306761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:22.307526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:22.309039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:22.312330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:22.314046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:22.317112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:22.346921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for project 37b756ad383a4cf18b7da7565a51572e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:22.353048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for user aff1721693734cc8937a84d9b8a483dd and project 37b756ad383a4cf18b7da7565a51572e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:22.358525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:22.368049 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-579a3ce5-a40d-44d4-aaf5-82efec1790a0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1320 microversion: 2.1 time: 0.353667 Oct 27 09:00:22.368639 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 95/182] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:22 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1320 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:22.384632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:00:22.390782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:00:22.392608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9962d6c-7d67-45ba-b9b2-445d126e80e5 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Calling method '.version_select at 0x7f31aaff0040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:22.444734 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9962d6c-7d67-45ba-b9b2-445d126e80e5 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.055983 Oct 27 09:00:22.445829 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 96/183] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:00:22 2022] GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 61 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:22.450768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:22.451361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:22.469214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:22.469981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:22.470586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:22.471446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:22.472094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:22.472741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:22.564213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:22.564620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:22.569137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:22.569914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lazy-loading 'fault' on Instance uuid 5fed6968-5fcf-49af-ae89-89d67b3f3a71 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:00:22.633354 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4eee686e-cab8-40eb-8141-05b2288a0494 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.082900 Oct 27 09:00:22.636954 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 88/184] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:00:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:00:22.785946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d3f30eb9-108e-49ea-bdad-4e754d18361b req-c748f5e7-495f-47f3-9a8c-3a098fa153bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fed6968-5fcf-49af-ae89-89d67b3f3a71", "name": "network-vif-deleted", "tag": "c6320a03-5e72-449c-ac37-2bd14c4ff9df"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:22.801006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d3f30eb9-108e-49ea-bdad-4e754d18361b req-c748f5e7-495f-47f3-9a8c-3a098fa153bb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:22.821994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d3f30eb9-108e-49ea-bdad-4e754d18361b req-c748f5e7-495f-47f3-9a8c-3a098fa153bb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:22.824695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d3f30eb9-108e-49ea-bdad-4e754d18361b req-c748f5e7-495f-47f3-9a8c-3a098fa153bb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:22.850129 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d3f30eb9-108e-49ea-bdad-4e754d18361b req-c748f5e7-495f-47f3-9a8c-3a098fa153bb service nova] Creating event network-vif-deleted:c6320a03-5e72-449c-ac37-2bd14c4ff9df for instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 on n-h1-858383-16 Oct 27 09:00:22.857991 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d3f30eb9-108e-49ea-bdad-4e754d18361b req-c748f5e7-495f-47f3-9a8c-3a098fa153bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216870 Oct 27 09:00:22.859201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 89/185] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:22.865514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8915981e-7d5a-47fd-86ad-b3cbd2bdf53e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Action: 'update_all', calling method: .version_select at 0x7f31ab09e280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:22.935287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8915981e-7d5a-47fd-86ad-b3cbd2bdf53e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:22.941285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8915981e-7d5a-47fd-86ad-b3cbd2bdf53e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for user 518d7e635e814075906d43994ec04b1c and project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:23.151777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff580f5cbc814eeea503c570dfcf8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fbb7f650c648a294c2674fb46b313c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:23.159812 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-05fda310-b0e2-4557-ad75-11f4e72a4e28 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 200 len: 1329 microversion: 2.1 time: 0.711846 Oct 27 09:00:23.161934 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 97/186] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:22 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 1329 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:23.180495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:23.181118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:23.189793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:23.200013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:23.200900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:23.202089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:23.202699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:23.203270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:23.207333 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8915981e-7d5a-47fd-86ad-b3cbd2bdf53e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.346553 Oct 27 09:00:23.208208 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 90/187] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:00:22 2022] PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 61 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:23.213233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-32481065-1b71-446c-affe-efa00ee33972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:23.214164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-32481065-1b71-446c-affe-efa00ee33972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:23.475747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-32481065-1b71-446c-affe-efa00ee33972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:23.484980 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-32481065-1b71-446c-affe-efa00ee33972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1211 microversion: 2.1 time: 0.275750 Oct 27 09:00:23.485760 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 91/188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:23 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1211 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:23.491807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:23.492417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:23.499041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:23.499537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:23.500145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:23.501097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:23.501770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:23.502688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:23.676248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:23.687446 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b367f27f-b448-4360-8283-c114af6c37dd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1269 microversion: 2.1 time: 0.199164 Oct 27 09:00:23.695748 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 92/189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:23 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1269 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:23.718189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d293913-aded-478e-9112-2318b389cfba tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Action: 'update_all', calling method: .version_select at 0x7f31ab1b8e50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:23.780850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:23.790766 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3a2c16a4-8fdc-49e7-8ea1-7e94b9ed39d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1412 microversion: 2.1 time: 0.627227 Oct 27 09:00:23.791358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 98/190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:23 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1412 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:23.799654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8d293913-aded-478e-9112-2318b389cfba tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:23.803901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-921c403b-53c0-4027-acbc-ac1765944d44 req-c34989f3-c8e4-454d-9402-526692fdd89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d008a476-b957-43e1-a895-4c894f28710c", "name": "network-vif-plugged", "status": "completed", "tag": "c78cff33-79a1-4f60-af2e-aa6e1fa0007e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:23.813090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8d293913-aded-478e-9112-2318b389cfba tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for user 518d7e635e814075906d43994ec04b1c and project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:23.824102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-921c403b-53c0-4027-acbc-ac1765944d44 req-c34989f3-c8e4-454d-9402-526692fdd89b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:23.824863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-921c403b-53c0-4027-acbc-ac1765944d44 req-c34989f3-c8e4-454d-9402-526692fdd89b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:23.825730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-921c403b-53c0-4027-acbc-ac1765944d44 req-c34989f3-c8e4-454d-9402-526692fdd89b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:23.843243 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-921c403b-53c0-4027-acbc-ac1765944d44 req-c34989f3-c8e4-454d-9402-526692fdd89b service nova] Creating event network-vif-plugged:c78cff33-79a1-4f60-af2e-aa6e1fa0007e for instance d008a476-b957-43e1-a895-4c894f28710c on n-h1-858383-16 Oct 27 09:00:23.851274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-921c403b-53c0-4027-acbc-ac1765944d44 req-c34989f3-c8e4-454d-9402-526692fdd89b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057329 Oct 27 09:00:23.853674 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 99/191] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:23.877699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:23.878618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:23.899682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:23.900490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:23.901426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:23.902434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:23.903110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:23.904012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:24.306201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:24.319694 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ca285aeb-14cf-41ca-adfd-d6ada01bbf94 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1470 microversion: 2.1 time: 0.457887 Oct 27 09:00:24.320300 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 100/192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:23 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1470 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:24.332556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:24.333166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:24.352146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:24.352632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:24.353445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:24.354730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:24.354730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:24.355421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:24.360353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d293913-aded-478e-9112-2318b389cfba tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 64 microversion: 2.1 time: 0.647303 Oct 27 09:00:24.360969 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 93/193] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:00:23 2022] PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 64 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:24.387063 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] HTTP exception thrown: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Request method failure captured: Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 HTTP/1.1 Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkhyIHjgBgvUmgx7GKVGTylG7eKudP_kJo9wcECJtINvBnxlL5XIhpnlL86FjfjgKSQZ8Bun4DREMvsvd7twt7epHpgsnn314-NTMx2_R2c-_2S0dQHWHkhHm6SNxym4DjIBqk-eXjpHlWDURVCI4m1f4jv549brMqjfMd_w94bZ5wY Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 44fbb7f650c648a294c2674fb46b313c Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminTestJSON-869423919 Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:24.391175 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/44fbb7f650c648a294c2674fb46b313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_44fbb7f650c648a294c2674fb46b313c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/44fbb7f650c648a294c2674fb46b313c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/44fbb7f650c648a294c2674fb46b313c"}]}] Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminTestJSON-869423919 Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 44fbb7f650c648a294c2674fb46b313c Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-869423919 Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminTestJSON-869423919-project Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: ff580f5cbc814eeea503c570dfcf8e38 Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminTestJSON-869423919-project Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:24.392895 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5fed6968-5fcf-49af-ae89-89d67b3f3a71'} Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:24.393731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:24.395132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:24.396752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Returning 404 to user: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:24.410477 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-416a5e61-576e-40c8-a791-b2db6c16bc90 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 404 len: 111 microversion: 2.1 time: 0.085665 Oct 27 09:00:24.414376 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 101/194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:24 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:24.420191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-edc122ea-e407-453d-a32f-67a0506107fc tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Calling method '.version_select at 0x7f31aae36a60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:24.505168 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-edc122ea-e407-453d-a32f-67a0506107fc tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 64 microversion: 2.1 time: 0.088565 Oct 27 09:00:24.506032 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 102/195] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:00:24 2022] GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 64 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:24.527322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b498b171-7294-45a8-8358-99dcced2ace0 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:24.573422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b498b171-7294-45a8-8358-99dcced2ace0 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:24.576388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b498b171-7294-45a8-8358-99dcced2ace0 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:24.578422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b498b171-7294-45a8-8358-99dcced2ace0 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:24.882071 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b498b171-7294-45a8-8358-99dcced2ace0 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.374637 Oct 27 09:00:24.884220 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 103/196] 10.222.0.25 () {60 vars in 1191 bytes} [Thu Oct 27 09:00:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:24.898499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:24.903730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:24.911034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:24.911748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:24.912351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:24.913429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:24.914136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:24.914822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:24.978412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:24.981996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:24.996657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:24.997868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:24.998499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:24.999386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:25.000079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:25.006934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:25.074629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:00:25.087548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:25.102428 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-757064ff-9aa1-4830-9581-5334eecdb4c6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1281 microversion: 2.1 time: 0.215992 Oct 27 09:00:25.104310 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 104/197] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:24 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1281 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:25.113864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7afc101c-c754-4ff0-9957-80d6abf648cb tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Action: 'update_all', calling method: .version_select at 0x7f31aae363a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:25.204751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:UPDATE=14,nova_api:SELECT=72,nova_api:INSERT=13,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:25.215314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7afc101c-c754-4ff0-9957-80d6abf648cb tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:25.223699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7afc101c-c754-4ff0-9957-80d6abf648cb tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for user 518d7e635e814075906d43994ec04b1c and project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:25.399465 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5df7e30-afaa-4ac7-8c7f-736b178e4e14 tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 204 len: 0 microversion: 2.1 time: 1.036819 Oct 27 09:00:25.400193 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 94/198] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:00:24 2022] DELETE /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:00:25.409976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:25.414769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:25.433048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:25.433865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:25.435242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:25.436522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:25.437208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:25.437863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:25.788564 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7afc101c-c754-4ff0-9957-80d6abf648cb tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.681448 Oct 27 09:00:25.789316 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 105/199] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:00:25 2022] PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 61 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:25.795433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:25.795587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:25.806308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:25.806796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:25.807513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:25.813628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:25.814277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:25.820279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:25.888324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:25.897752 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0cae9806-3bc3-4db0-8831-ef7b8e58fd0d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1311 microversion: 2.1 time: 0.492345 Oct 27 09:00:25.907401 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 95/200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:25 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1311 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:25.914387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53c900a4-a12c-4a89-8eb5-e818b42641af tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:25.941417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:25.970930 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53c900a4-a12c-4a89-8eb5-e818b42641af tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.061679 Oct 27 09:00:25.971995 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 96/201] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:25 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:26.111927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:26.136490 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-67b26fee-7701-4490-bf06-e8d0f9fc3647 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1588 microversion: 2.1 time: 0.345527 Oct 27 09:00:26.138760 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 106/202] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:25 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1588 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:26.148931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:26.162434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:26.177052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:26.177562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:26.178061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:26.178785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:26.181319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:26.181777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:26.209617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1515836289", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:26.287964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:00:26.492683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:26.506987 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cdc836b3-a81f-4b05-915f-52937e9d74f0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1476 microversion: 2.1 time: 0.367014 Oct 27 09:00:26.520646 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 107/203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:26 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:26.530692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ef68d40d-2653-444f-915f-30d533f7d97a tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Action: 'update', calling method: .version_select at 0x7f31aadcd1f0>, body: {"meta": {"os_version": "alt"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:26.592127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ef68d40d-2653-444f-915f-30d533f7d97a tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:26.596895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ef68d40d-2653-444f-915f-30d533f7d97a tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for user 518d7e635e814075906d43994ec04b1c and project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:26.637232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:00:26.639232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:00:26.640218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:00:26.640981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:00:26.641650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:00:26.658280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:26.660258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:26.660958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:26.661935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:26.667551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:26.668442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:26.706750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Getting quotas for project 0ca5eb57a6524b0daedc08c09cba2251. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:26.721648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Getting quotas for user fa798c1e8c8c445cb287ecc314c3b0ea and project 0ca5eb57a6524b0daedc08c09cba2251. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:26.757427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:00:26.760986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:00:26.819823 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4305ef8b-7cbb-411d-902e-1f9c41da284b tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846504 Oct 27 09:00:26.820707 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 97/204] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:00:26.831287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-24068f46-a79a-4a33-88ce-ad0cfb1eb95a tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1416821613"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:26.837517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-24068f46-a79a-4a33-88ce-ad0cfb1eb95a tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Generated uuid 0f573122-abea-4b08-b3b9-b8d353ef3f85 for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:26.877356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-24068f46-a79a-4a33-88ce-ad0cfb1eb95a tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055362 Oct 27 09:00:26.879910 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 98/205] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:26.892072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:26.893906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:26.912726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:26.913403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:26.914000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:26.914707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:26.915166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:26.915620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:26.963008 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ef68d40d-2653-444f-915f-30d533f7d97a tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.440931 Oct 27 09:00:26.963941 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 108/206] 10.222.0.25 () {60 vars in 1313 bytes} [Thu Oct 27 09:00:26 2022] PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata/os_version => generated 31 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:26.969547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9fd83320-27bb-4b13-a0b2-7029d05c4269 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:26.973583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9fd83320-27bb-4b13-a0b2-7029d05c4269 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:26.984694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd83320-27bb-4b13-a0b2-7029d05c4269 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:26.986195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd83320-27bb-4b13-a0b2-7029d05c4269 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:26.986841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd83320-27bb-4b13-a0b2-7029d05c4269 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:26.987747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd83320-27bb-4b13-a0b2-7029d05c4269 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:26.989143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd83320-27bb-4b13-a0b2-7029d05c4269 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:26.989879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd83320-27bb-4b13-a0b2-7029d05c4269 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:27.027517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:27.228600 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9fd83320-27bb-4b13-a0b2-7029d05c4269 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.262860 Oct 27 09:00:27.238431 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 109/207] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:00:26 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:27.243314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e5c8688b-b541-430b-a8ee-e1b848a889bf req-9e6bc91a-1838-49c8-80c2-a2a8a91c5775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba26e0a-7168-465e-b2f2-3b763456fe6c", "tag": "083ab409-0cbd-467f-85a9-e03ea9c7779b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:27.254838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e5c8688b-b541-430b-a8ee-e1b848a889bf req-9e6bc91a-1838-49c8-80c2-a2a8a91c5775 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:27.256290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e5c8688b-b541-430b-a8ee-e1b848a889bf req-9e6bc91a-1838-49c8-80c2-a2a8a91c5775 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:27.256913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e5c8688b-b541-430b-a8ee-e1b848a889bf req-9e6bc91a-1838-49c8-80c2-a2a8a91c5775 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:27.276060 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e5c8688b-b541-430b-a8ee-e1b848a889bf req-9e6bc91a-1838-49c8-80c2-a2a8a91c5775 service nova] Creating event network-changed:083ab409-0cbd-467f-85a9-e03ea9c7779b for instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c on n-h2-858383-16 Oct 27 09:00:27.284138 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e5c8688b-b541-430b-a8ee-e1b848a889bf req-9e6bc91a-1838-49c8-80c2-a2a8a91c5775 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044370 Oct 27 09:00:27.285554 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 110/208] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:27.291548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb2ca23c-4cfb-4108-a8fa-a287049fbc61 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:27.292279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cb2ca23c-4cfb-4108-a8fa-a287049fbc61 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:27.460358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cb2ca23c-4cfb-4108-a8fa-a287049fbc61 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:27.469029 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb2ca23c-4cfb-4108-a8fa-a287049fbc61 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1222 microversion: 2.1 time: 0.182288 Oct 27 09:00:27.470030 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 111/209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:27 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1222 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:27.475080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5174f54-b2cf-4006-9267-eb321fef14a9 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:27.489475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5174f54-b2cf-4006-9267-eb321fef14a9 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:27.490110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5174f54-b2cf-4006-9267-eb321fef14a9 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:27.490941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5174f54-b2cf-4006-9267-eb321fef14a9 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:27.643830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:27.650110 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5174f54-b2cf-4006-9267-eb321fef14a9 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.178730 Oct 27 09:00:27.652944 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 112/210] 10.222.0.25 () {60 vars in 1191 bytes} [Thu Oct 27 09:00:27 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:27.658417 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-afe4f315-d0b0-49e1-ba5b-9d403dfe35f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1311 microversion: 2.1 time: 0.777212 Oct 27 09:00:27.659222 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 99/211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:26 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1311 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:27.672349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f053c16-2311-4358-af81-7b2516e74554 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Calling method '.version_select at 0x7f31ab0250d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:27.678195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:27.678195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:27.692332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:27.693028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:27.693833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:27.695071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:27.695849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:27.696437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:27.734470 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f053c16-2311-4358-af81-7b2516e74554 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 58 microversion: 2.1 time: 0.073900 Oct 27 09:00:27.742905 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 100/212] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:00:27 2022] GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 58 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:27.748164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-bf90ef67-9368-4568-bcd5-b6d8c8cbb01c req-a5d052d3-eed2-406a-b44a-f362e6dca4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5ae277-3562-4d0b-8169-2820971f9aa7", "tag": "b09e8afc-87cf-4ace-af3f-18ab1dfab2b9"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:27.758149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bf90ef67-9368-4568-bcd5-b6d8c8cbb01c req-a5d052d3-eed2-406a-b44a-f362e6dca4d6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:27.758846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bf90ef67-9368-4568-bcd5-b6d8c8cbb01c req-a5d052d3-eed2-406a-b44a-f362e6dca4d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:27.760099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bf90ef67-9368-4568-bcd5-b6d8c8cbb01c req-a5d052d3-eed2-406a-b44a-f362e6dca4d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:27.775750 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-bf90ef67-9368-4568-bcd5-b6d8c8cbb01c req-a5d052d3-eed2-406a-b44a-f362e6dca4d6 service nova] Creating event network-changed:b09e8afc-87cf-4ace-af3f-18ab1dfab2b9 for instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 on n-h1-858383-16 Oct 27 09:00:27.781893 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-bf90ef67-9368-4568-bcd5-b6d8c8cbb01c req-a5d052d3-eed2-406a-b44a-f362e6dca4d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037458 Oct 27 09:00:27.783137 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 101/213] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:27.788828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:27.789523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:27.796260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:27.796764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:27.797196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:27.797896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:27.798558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:27.799136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:28.374390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:28.382345 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1047a979-254b-4059-a0c6-f3849dcb30c1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1311 microversion: 2.1 time: 0.714931 Oct 27 09:00:28.382926 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 113/214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:27 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1311 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:28.387330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:28.401431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f2de3219-e067-486e-95d4-55797477d2e5 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:28.402824 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d11bbc1-983b-4cb4-9db2-21b2ea73ac37 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1476 microversion: 2.1 time: 0.618033 Oct 27 09:00:28.403978 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 102/215] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:27 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1476 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:28.408211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68c1c76a-2270-4ff0-ad9a-6944c07a5ddd tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Action: 'update_all', calling method: .version_select at 0x7f31ab025af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:28.421437 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f2de3219-e067-486e-95d4-55797477d2e5 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.032465 Oct 27 09:00:28.422285 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 114/216] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:00:28 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:28.436998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c7d0d7a-5282-423a-b8cc-5d4b98e925df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:28.449425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c7d0d7a-5282-423a-b8cc-5d4b98e925df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:28.450969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c7d0d7a-5282-423a-b8cc-5d4b98e925df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:28.451854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c7d0d7a-5282-423a-b8cc-5d4b98e925df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:28.471434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-68c1c76a-2270-4ff0-ad9a-6944c07a5ddd tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:28.476197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-68c1c76a-2270-4ff0-ad9a-6944c07a5ddd tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for user 518d7e635e814075906d43994ec04b1c and project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:28.586361 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c7d0d7a-5282-423a-b8cc-5d4b98e925df tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.154070 Oct 27 09:00:28.588293 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 115/217] 10.222.0.25 () {60 vars in 1191 bytes} [Thu Oct 27 09:00:28 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:28.599318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:28.601295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:28.608396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:28.609098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:28.609614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:28.610421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:28.610949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:28.611448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:28.722859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:28.732396 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b4bc5c04-dbc7-418d-bd4f-6fbfa6f56d33 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1282 microversion: 2.1 time: 0.141469 Oct 27 09:00:28.748708 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 116/218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:28 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:28.748708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d99ac0d-6e61-4d63-9639-98a90b0d3137 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:28.765482 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d99ac0d-6e61-4d63-9639-98a90b0d3137 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.031226 Oct 27 09:00:28.766377 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 117/219] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:28 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:28.771235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:28.772055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:28.773473 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68c1c76a-2270-4ff0-ad9a-6944c07a5ddd tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.368829 Oct 27 09:00:28.774134 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 103/220] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:00:28 2022] PUT /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 61 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:28.779722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34568ccb-ec02-4334-8f0f-6c0d64e2dfcf tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-97232171"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:28.783456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:28.783938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-34568ccb-ec02-4334-8f0f-6c0d64e2dfcf tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Generated uuid 84e544b9-9285-4a83-a455-43c3e312aa39 for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:28.784047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:28.784402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:28.786049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:28.786544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:28.786968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:28.811541 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34568ccb-ec02-4334-8f0f-6c0d64e2dfcf tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.036216 Oct 27 09:00:28.812526 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 104/221] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:28 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:28.818388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3ff760c-2ba2-485d-89d3-71bdc7363dd2 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Action: 'create', calling method: .version_select at 0x7f31aaeef550>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:28.874240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-a3ff760c-2ba2-485d-89d3-71bdc7363dd2 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:28.879305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-a3ff760c-2ba2-485d-89d3-71bdc7363dd2 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Getting quotas for user 518d7e635e814075906d43994ec04b1c and project afde02f58f7a471190c5c2684d35da27. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:29.162852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:29.172358 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56d9e555-b779-430f-a573-1cdf1f7004be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1311 microversion: 2.1 time: 0.404438 Oct 27 09:00:29.172636 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 118/222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:28 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1311 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:29.177340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b3e125be-5ea7-4ffc-a8e4-e188195c203c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:29.188297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3e125be-5ea7-4ffc-a8e4-e188195c203c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.188847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3e125be-5ea7-4ffc-a8e4-e188195c203c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.189511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3e125be-5ea7-4ffc-a8e4-e188195c203c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.221186 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3ff760c-2ba2-485d-89d3-71bdc7363dd2 tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "POST /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 85 microversion: 2.1 time: 0.406969 Oct 27 09:00:29.222073 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 105/223] 10.222.0.25 () {60 vars in 1281 bytes} [Thu Oct 27 09:00:28 2022] POST /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 85 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:29.231824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1682384-572c-4795-a12a-2a65e5f96e4e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] Calling method '.version_select at 0x7f31ab025ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:29.279595 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1682384-572c-4795-a12a-2a65e5f96e4e tempest-ImagesMetadataTestJSON-1061541485 tempest-ImagesMetadataTestJSON-1061541485-project] 10.222.0.25 "GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata" status: 200 len: 85 microversion: 2.1 time: 0.051686 Oct 27 09:00:29.280165 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 106/224] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:00:29 2022] GET /compute/v2.1/images/4bd75cb3-a432-4616-80b0-6cdbae6811fb/metadata => generated 85 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:29.361284 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b3e125be-5ea7-4ffc-a8e4-e188195c203c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.186485 Oct 27 09:00:29.362444 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 119/225] 10.222.0.25 () {60 vars in 1191 bytes} [Thu Oct 27 09:00:29 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:29.378069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c05df9d-05cc-4771-a5c8-068c2b1a194d tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:29.388509 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c05df9d-05cc-4771-a5c8-068c2b1a194d tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.016022 Oct 27 09:00:29.389669 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 107/226] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:00:29 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:29.404077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ff03b643-ab23-4903-9097-174fff98425c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:29.405534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:29.406415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:29.413870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.414410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.414877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.415746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.416358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.416792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.419053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff03b643-ab23-4903-9097-174fff98425c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.420247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff03b643-ab23-4903-9097-174fff98425c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.421180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff03b643-ab23-4903-9097-174fff98425c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.558424 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ff03b643-ab23-4903-9097-174fff98425c tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 225 microversion: 2.1 time: 0.159048 Oct 27 09:00:29.562920 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 120/227] 10.222.0.25 () {60 vars in 1191 bytes} [Thu Oct 27 09:00:29 2022] POST /compute/v2.1/os-aggregates/3/action => generated 225 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:00:29.568901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:29.569846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:29.579035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.579753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.580434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.581675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.582015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.582599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.629152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.629972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.630386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.631178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lazy-loading 'fault' on Instance uuid f6df8c1b-2593-4504-a709-cac84e2d7609 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:00:29.708783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:29.724315 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2dda736b-aa68-443a-932e-36cb2d5f7c56 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1310 microversion: 2.1 time: 0.160211 Oct 27 09:00:29.725929 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 121/228] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:29 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1310 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:29.730082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:29.731386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6b9129c-2850-4db3-a89c-75f2a15fc7ae tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:29.737997 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-648efb49-6222-4cbe-9cf2-222708d5db9e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1311 microversion: 2.1 time: 0.337164 Oct 27 09:00:29.738571 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 108/229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:29 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1311 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:29.744666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:29.745595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:29.754809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.755589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.756452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.757822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.758714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.759102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.770001 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6b9129c-2850-4db3-a89c-75f2a15fc7ae tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.041839 Oct 27 09:00:29.774160 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 122/230] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:29 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:29.782920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d0c2d833-d489-4987-8f27-1b4d1af76551 req-faacf678-ea6e-400e-93f8-ddb2fc73371e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d008a476-b957-43e1-a895-4c894f28710c", "tag": "c78cff33-79a1-4f60-af2e-aa6e1fa0007e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:29.791633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=13 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:29.802128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d0c2d833-d489-4987-8f27-1b4d1af76551 req-faacf678-ea6e-400e-93f8-ddb2fc73371e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.803006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d0c2d833-d489-4987-8f27-1b4d1af76551 req-faacf678-ea6e-400e-93f8-ddb2fc73371e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.803534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d0c2d833-d489-4987-8f27-1b4d1af76551 req-faacf678-ea6e-400e-93f8-ddb2fc73371e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.818216 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d0c2d833-d489-4987-8f27-1b4d1af76551 req-faacf678-ea6e-400e-93f8-ddb2fc73371e service nova] Creating event network-changed:c78cff33-79a1-4f60-af2e-aa6e1fa0007e for instance d008a476-b957-43e1-a895-4c894f28710c on n-h1-858383-16 Oct 27 09:00:29.824078 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d0c2d833-d489-4987-8f27-1b4d1af76551 req-faacf678-ea6e-400e-93f8-ddb2fc73371e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047957 Oct 27 09:00:29.825009 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 123/231] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:29.829953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:29.830640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:29.839282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.840130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.841092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.842590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:29.843274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:29.843772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:29.934012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:29.945396 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0185265b-f354-4da5-bf30-f604361b0c51 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1282 microversion: 2.1 time: 0.118806 Oct 27 09:00:29.946329 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 124/232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:29 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:29.952269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf5a8ebf-9f71-42e0-88a2-e07303834844 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-157491859"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:29.955525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.aggregate [None req-cf5a8ebf-9f71-42e0-88a2-e07303834844 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Generated uuid ab35f82e-8999-4ffa-bea7-c6d8d7ac858f for aggregate {{(pid=120602) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:30.023365 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf5a8ebf-9f71-42e0-88a2-e07303834844 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074784 Oct 27 09:00:30.024473 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 125/233] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:29 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:30.035446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-241e5d22-99a2-497d-9bc2-99bcf7f5805b req-03c41f41-4c79-40f3-acda-c325d7560391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6df8c1b-2593-4504-a709-cac84e2d7609", "name": "network-vif-deleted", "tag": "826b19be-4d0b-4a04-a125-5a61dd079805"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:30.060217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:30.070508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-241e5d22-99a2-497d-9bc2-99bcf7f5805b req-03c41f41-4c79-40f3-acda-c325d7560391 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.071038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-241e5d22-99a2-497d-9bc2-99bcf7f5805b req-03c41f41-4c79-40f3-acda-c325d7560391 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.071486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-241e5d22-99a2-497d-9bc2-99bcf7f5805b req-03c41f41-4c79-40f3-acda-c325d7560391 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:30.073656 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7191efa4-9f59-436d-9f2b-6cc0ab82c285 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 200 len: 1588 microversion: 2.1 time: 0.333811 Oct 27 09:00:30.074257 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 109/234] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:29 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 1588 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:30.091297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-27390fa5-90a8-41f8-a1e6-1edc05d3d760 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:30.099374 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-241e5d22-99a2-497d-9bc2-99bcf7f5805b req-03c41f41-4c79-40f3-acda-c325d7560391 service nova] Creating event network-vif-deleted:826b19be-4d0b-4a04-a125-5a61dd079805 for instance f6df8c1b-2593-4504-a709-cac84e2d7609 on n-h2-858383-16 Oct 27 09:00:30.112168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27390fa5-90a8-41f8-a1e6-1edc05d3d760 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.113228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27390fa5-90a8-41f8-a1e6-1edc05d3d760 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.113918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27390fa5-90a8-41f8-a1e6-1edc05d3d760 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:30.114193 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-241e5d22-99a2-497d-9bc2-99bcf7f5805b req-03c41f41-4c79-40f3-acda-c325d7560391 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088497 Oct 27 09:00:30.117467 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 126/235] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:30.199284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:30.200371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:30.211673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.212177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.212624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:30.213337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.213794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.214224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:30.582504 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-27390fa5-90a8-41f8-a1e6-1edc05d3d760 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.505025 Oct 27 09:00:30.583524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 110/236] 10.222.0.25 () {60 vars in 1191 bytes} [Thu Oct 27 09:00:30 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:30.603411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f1dde3f-e2d3-41e1-b97f-230675173341 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-16"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:30.608092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:30.621428 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-832c0c13-c0ab-481b-b20f-ba9839acd4d6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1311 microversion: 2.1 time: 0.426661 Oct 27 09:00:30.623093 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 127/237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:30 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1311 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:30.633743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f1dde3f-e2d3-41e1-b97f-230675173341 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.635889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f1dde3f-e2d3-41e1-b97f-230675173341 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.639460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f1dde3f-e2d3-41e1-b97f-230675173341 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:30.752610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:30.753603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:30.772591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.776079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.776706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:30.778594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.782560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.784619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:30.864697 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f1dde3f-e2d3-41e1-b97f-230675173341 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.271906 Oct 27 09:00:30.865712 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 111/238] 10.222.0.25 () {60 vars in 1191 bytes} [Thu Oct 27 09:00:30 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:30.878723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:30.879830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:30.883735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.884241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.885504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:30.885947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lazy-loading 'fault' on Instance uuid f6df8c1b-2593-4504-a709-cac84e2d7609 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:00:30.888079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.888830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.889498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:30.890435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:30.891097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:30.891756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:31.029032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:31.039830 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79078d02-40ed-4d81-ab69-4d8755ac3edc tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 200 len: 1310 microversion: 2.1 time: 0.292955 Oct 27 09:00:31.055464 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 128/239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:30 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 1310 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:31.055464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97111c47-0e77-4bdd-aa8f-e1dff7afb168 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:31.055464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:31.086256 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97111c47-0e77-4bdd-aa8f-e1dff7afb168 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.044259 Oct 27 09:00:31.086959 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 129/240] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:31 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:31.110579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:31.111424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:31.120248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:31.126144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:31.126913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:31.127950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:31.128735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:31.129313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:31.406673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:31.417685 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-980e091d-9640-4caf-9388-f460411e1906 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1280 microversion: 2.1 time: 0.327709 Oct 27 09:00:31.417685 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 130/241] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:31 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:31.436491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:31.441479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-683d4a26-68f9-4b27-bee1-401dd7fac22d tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1865473407"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:31.445758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.aggregate [None req-683d4a26-68f9-4b27-bee1-401dd7fac22d tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Generated uuid 073be3fa-ddf8-451d-9633-565f46928bb7 for aggregate {{(pid=120602) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:31.449042 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b53cb0b4-47ac-4daf-a21b-56eacfcfef9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1311 microversion: 2.1 time: 0.574904 Oct 27 09:00:31.449636 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 112/242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:30 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1311 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:31.454131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72d7851b-eb01-4faa-8888-1e4c149363e6 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1521048764"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:31.457567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-72d7851b-eb01-4faa-8888-1e4c149363e6 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Generated uuid 9775f888-f157-4093-850d-ebc5d35fabb2 for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:31.493561 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-683d4a26-68f9-4b27-bee1-401dd7fac22d tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059978 Oct 27 09:00:31.499938 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 131/243] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:31.500969 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72d7851b-eb01-4faa-8888-1e4c149363e6 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.049445 Oct 27 09:00:31.501794 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 113/244] 10.222.0.25 () {62 vars in 1205 bytes} [Thu Oct 27 09:00:31 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:00:31.515880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3bb30d3c-047d-423b-b5cc-ca8314e0c4cd tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:31.518029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60361798-4d9c-46f6-aab4-a7b0c39dbc32 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1764867490"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:31.569888 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3bb30d3c-047d-423b-b5cc-ca8314e0c4cd tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.057239 Oct 27 09:00:31.571197 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 132/245] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:31 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:31.581514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe084118-1f37-4dc7-b2f9-7c02ccf0de61 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:31.590423 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-fe084118-1f37-4dc7-b2f9-7c02ccf0de61 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe084118-1f37-4dc7-b2f9-7c02ccf0de61 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Request method failure captured: Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkh1KnfYxJUZ1HbVelF0GsQQeREbxxRjGrOGlAhGmNCoVSk4t-DzTsGEhGeKlsBUGbnpNVC-NiZO3jqhC22sA-G5sDX7DK0-MlLd-50PpesCVsPllU5VFDl4VTdFcehcAKL4KgYWb2Ad43kieVPMFsHZXR-Ew1SKUPbD0HUSRn8oPAA Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 999a7701259f40419056d77d5b65cf00 Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:31.593558 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/999a7701259f40419056d77d5b65cf00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_999a7701259f40419056d77d5b65cf00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/999a7701259f40419056d77d5b65cf00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/999a7701259f40419056d77d5b65cf00"}]}] Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 999a7701259f40419056d77d5b65cf00 Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminTestJSON-734464620-project-admin Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 2ecce1dc88504a9eb7de1c6dcdfee639 Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminTestJSON-734464620-project-admin Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: exception: Aggregate 5 could not be found. Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5'} Oct 27 09:00:31.595040 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:31.596030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 27 09:00:31.597413 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.598694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe084118-1f37-4dc7-b2f9-7c02ccf0de61 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:31.599702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fe084118-1f37-4dc7-b2f9-7c02ccf0de61 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.023157 Oct 27 09:00:31.600687 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 133/246] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:00:31 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:31.609507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4bf74bd-2648-4404-b41e-0cece48e6553 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:31.633447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d4bf74bd-2648-4404-b41e-0cece48e6553 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4bf74bd-2648-4404-b41e-0cece48e6553 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Request method failure captured: Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkh1KnfYxJUZ1HbVelF0GsQQeREbxxRjGrOGlAhGmNCoVSk4t-DzTsGEhGeKlsBUGbnpNVC-NiZO3jqhC22sA-G5sDX7DK0-MlLd-50PpesCVsPllU5VFDl4VTdFcehcAKL4KgYWb2Ad43kieVPMFsHZXR-Ew1SKUPbD0HUSRn8oPAA Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 999a7701259f40419056d77d5b65cf00 Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:31.637061 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/999a7701259f40419056d77d5b65cf00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_999a7701259f40419056d77d5b65cf00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/999a7701259f40419056d77d5b65cf00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/999a7701259f40419056d77d5b65cf00"}]}] Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 999a7701259f40419056d77d5b65cf00 Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminTestJSON-734464620-project-admin Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 2ecce1dc88504a9eb7de1c6dcdfee639 Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminTestJSON-734464620-project-admin Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: exception: Aggregate 5 could not be found. Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5'} Oct 27 09:00:31.638570 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:31.639316 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:31.640421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:31.642133 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:31.642133 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:31.642133 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:31.642133 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 27 09:00:31.642133 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:31.642133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4bf74bd-2648-4404-b41e-0cece48e6553 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:31.642133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d4bf74bd-2648-4404-b41e-0cece48e6553 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.037227 Oct 27 09:00:31.642978 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 134/247] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:31 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:00:31.647642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:31.648408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:31.656269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:31.656759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:31.657190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:31.658748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:31.659209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:31.659802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:31.684361 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60361798-4d9c-46f6-aab4-a7b0c39dbc32 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.170895 Oct 27 09:00:31.694485 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 114/248] 10.222.0.25 () {62 vars in 1210 bytes} [Thu Oct 27 09:00:31 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:00:31.702172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-da4ce1c8-a0d8-4d38-a1c4-30a5b00e64b3 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1571375362", "name": "tempest-test_aggregate-657664496"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:31.725129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-da4ce1c8-a0d8-4d38-a1c4-30a5b00e64b3 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Generated uuid 68f3dddb-3d4e-426f-a49a-8d59b5c52962 for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:31.755284 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-da4ce1c8-a0d8-4d38-a1c4-30a5b00e64b3 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.058716 Oct 27 09:00:31.756201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 115/249] 10.222.0.25 () {60 vars in 1165 bytes} [Thu Oct 27 09:00:31 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:31.768379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-813b70f2-195c-48b6-9455-d84291f315e9 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:31.786001 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-813b70f2-195c-48b6-9455-d84291f315e9 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.024846 Oct 27 09:00:31.796352 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 116/250] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Oct 27 09:00:31 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:00:31.801566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5db2530b-b4b7-4648-b2e4-6fef4e4065bb tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:31.808157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=3,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:31.826348 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5db2530b-b4b7-4648-b2e4-6fef4e4065bb tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.028350 Oct 27 09:00:31.827099 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 117/251] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:31 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:31.837149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a60a2bd9-ac1b-4c69-9b41-388521d6f190 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:31.851960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a60a2bd9-ac1b-4c69-9b41-388521d6f190 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:31.852737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a60a2bd9-ac1b-4c69-9b41-388521d6f190 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:31.853357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a60a2bd9-ac1b-4c69-9b41-388521d6f190 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:31.983686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:32.000951 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-792f1077-e4a3-4f99-af47-123a77559dbd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1311 microversion: 2.1 time: 0.356951 Oct 27 09:00:32.002312 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 135/252] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:31 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1311 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:32.039435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c96f4f1-7977-4039-8f1c-1357b8f5dd35 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:32.050901 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a60a2bd9-ac1b-4c69-9b41-388521d6f190 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 315 microversion: 2.41 time: 0.222304 Oct 27 09:00:32.051786 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-5c96f4f1-7977-4039-8f1c-1357b8f5dd35 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c96f4f1-7977-4039-8f1c-1357b8f5dd35 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Request method failure captured: Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkh1KnfYxJUZ1HbVelF0GsQQeREbxxRjGrOGlAhGmNCoVSk4t-DzTsGEhGeKlsBUGbnpNVC-NiZO3jqhC22sA-G5sDX7DK0-MlLd-50PpesCVsPllU5VFDl4VTdFcehcAKL4KgYWb2Ad43kieVPMFsHZXR-Ew1SKUPbD0HUSRn8oPAA Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 999a7701259f40419056d77d5b65cf00 Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:32.054653 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/999a7701259f40419056d77d5b65cf00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_999a7701259f40419056d77d5b65cf00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/999a7701259f40419056d77d5b65cf00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/999a7701259f40419056d77d5b65cf00"}]}] Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 999a7701259f40419056d77d5b65cf00 Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminTestJSON-734464620-project-admin Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 2ecce1dc88504a9eb7de1c6dcdfee639 Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminTestJSON-734464620-project-admin Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: exception: Aggregate 7 could not be found. Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7'} Oct 27 09:00:32.056133 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:32.057029 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 27 09:00:32.058699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.059887 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 118/253] 10.222.0.25 () {62 vars in 1232 bytes} [Thu Oct 27 09:00:31 2022] POST /compute/v2.1/os-aggregates/6/action => generated 315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:00:32.060303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c96f4f1-7977-4039-8f1c-1357b8f5dd35 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:32.062264 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c96f4f1-7977-4039-8f1c-1357b8f5dd35 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.032344 Oct 27 09:00:32.067199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:32.067929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:32.068446 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 136/254] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:00:32 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:32.076881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:32.077397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:32.077936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:32.079282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:32.080072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f2e7122-2e46-45fe-8420-16def1c6c7ce tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:32.080509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:32.081265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:32.096049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f2e7122-2e46-45fe-8420-16def1c6c7ce tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:32.096815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f2e7122-2e46-45fe-8420-16def1c6c7ce tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:32.097676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f2e7122-2e46-45fe-8420-16def1c6c7ce tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:32.098108 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] HTTP exception thrown: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Request method failure captured: Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 HTTP/1.1 Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiAnyHnE_7ihRDdTCXmh7hKWTEP3H8JrNJnw9VBzSQ63r3cbM91s8aMOSjTRTKgJA0-HHvjl1GJnFQysbNxqzDh0rmHW1BRZC2s0rI8ievyFK9bpocnx7BnozIoUql4AvmptF0rhSoCh9uK3yoc7lLIjXtgKIgdfVD1QYxwT4Ij6wU Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:32.103609 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}] Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b616958081564aea82d0c3d93c3c026f Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:00:32.105148 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f6df8c1b-2593-4504-a709-cac84e2d7609'} Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:32.105964 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:00:32.107665 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.109804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Returning 404 to user: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:32.109804 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eaf69e8c-1ee8-4063-9733-97bccde684af tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 404 len: 111 microversion: 2.1 time: 0.043769 Oct 27 09:00:32.109804 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 119/255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:32 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:32.111473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c12acfb9-88e4-4726-b282-1d59cbfd4a78 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:32.132030 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-c12acfb9-88e4-4726-b282-1d59cbfd4a78 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c12acfb9-88e4-4726-b282-1d59cbfd4a78 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Request method failure captured: Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkh1KnfYxJUZ1HbVelF0GsQQeREbxxRjGrOGlAhGmNCoVSk4t-DzTsGEhGeKlsBUGbnpNVC-NiZO3jqhC22sA-G5sDX7DK0-MlLd-50PpesCVsPllU5VFDl4VTdFcehcAKL4KgYWb2Ad43kieVPMFsHZXR-Ew1SKUPbD0HUSRn8oPAA Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 999a7701259f40419056d77d5b65cf00 Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:32.136380 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/999a7701259f40419056d77d5b65cf00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_999a7701259f40419056d77d5b65cf00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/999a7701259f40419056d77d5b65cf00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/999a7701259f40419056d77d5b65cf00"}]}] Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 999a7701259f40419056d77d5b65cf00 Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-734464620 Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminTestJSON-734464620-project-admin Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 2ecce1dc88504a9eb7de1c6dcdfee639 Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminTestJSON-734464620-project-admin Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: exception: Aggregate 7 could not be found. Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7'} Oct 27 09:00:32.138161 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:32.139004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:32.140691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:32.142214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:32.142214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:32.142214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:32.142214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 27 09:00:32.142214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:32.142214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c12acfb9-88e4-4726-b282-1d59cbfd4a78 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:32.142214 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c12acfb9-88e4-4726-b282-1d59cbfd4a78 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.031523 Oct 27 09:00:32.142214 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 120/256] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:32 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:32.156293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9a96caa5-340b-49af-bad6-056e9a3e0255 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1123095413"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:32.161776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-9a96caa5-340b-49af-bad6-056e9a3e0255 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Generated uuid 0c81de44-254d-45c0-998e-f79f911813e7 for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:32.189702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a96caa5-340b-49af-bad6-056e9a3e0255 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041369 Oct 27 09:00:32.190855 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 121/257] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:32.203052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0686218c-0e54-401e-98f9-6a26497b7dce tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:32.214915 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0686218c-0e54-401e-98f9-6a26497b7dce tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.016136 Oct 27 09:00:32.221061 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 122/258] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:00:32 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:00:32.233995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6f1093f-ebe3-4218-b84b-f2f2ebf39ac5 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:32.309473 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6f1093f-ebe3-4218-b84b-f2f2ebf39ac5 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.079321 Oct 27 09:00:32.310655 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 123/259] 10.222.0.25 () {60 vars in 1191 bytes} [Thu Oct 27 09:00:32 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:32.316255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1690873416", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:32.348007 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f2e7122-2e46-45fe-8420-16def1c6c7ce tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.275402 Oct 27 09:00:32.348619 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 137/260] 10.222.0.25 () {62 vars in 1232 bytes} [Thu Oct 27 09:00:32 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:00:32.360461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-53be0731-8347-4175-91f3-fca2c7204399 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:32.370369 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-53be0731-8347-4175-91f3-fca2c7204399 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.013491 Oct 27 09:00:32.370951 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 138/261] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:00:32 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:32.377033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40514e2b-532f-4aa2-8457-ea113d9f0679 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:32.429677 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40514e2b-532f-4aa2-8457-ea113d9f0679 tempest-AggregatesAdminTestV241-187428974 tempest-AggregatesAdminTestV241-187428974-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.056906 Oct 27 09:00:32.435806 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 139/262] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Oct 27 09:00:32 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:32.445808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f6c6743-d03a-4021-8b62-914f6b19a517 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:32.454119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:00:32.484239 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f6c6743-d03a-4021-8b62-914f6b19a517 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.049470 Oct 27 09:00:32.484850 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 140/263] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:32 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:32.498029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:32.498742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:32.506130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:32.507164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:32.507678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:32.508386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:32.508837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:32.509254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:32.651684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:32.665712 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f19df064-abf8-460e-88ea-1ed736d8168f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1280 microversion: 2.1 time: 0.175251 Oct 27 09:00:32.667866 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 141/264] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:32 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:32.676024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:32.679967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:32.689791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:32.692335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:32.692867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:32.694876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:32.695437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:32.695975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:32.946414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:00:32.947204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:00:32.948071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:00:32.948751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:00:32.949382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:00:32.966245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:32.966967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:32.973176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:32.974344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:32.974978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:32.975835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:32.991406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=13 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:33.017962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Getting quotas for project fb0978e9d8254ba4a5a1f0466baeb2eb. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:33.047722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Getting quotas for user b616958081564aea82d0c3d93c3c026f and project fb0978e9d8254ba4a5a1f0466baeb2eb. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:33.069343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:00:33.069547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:33.078208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:00:33.085225 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c186ca51-273e-4999-a32d-e5c85fb8a400 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1311 microversion: 2.1 time: 0.415903 Oct 27 09:00:33.085811 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 142/265] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:32 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1311 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:33.099142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-41b029a2-faa5-47ca-98fa-fbba25ab8011 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-759729688", "availability_zone": "tempest-test_az-713675676"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:33.103991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.aggregate [None req-41b029a2-faa5-47ca-98fa-fbba25ab8011 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Generated uuid 0b9777a7-7f8e-47b4-8436-8c445b5cc87f for aggregate {{(pid=120602) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:33.165317 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-41b029a2-faa5-47ca-98fa-fbba25ab8011 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.077969 Oct 27 09:00:33.166793 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 143/266] 10.222.0.25 () {60 vars in 1165 bytes} [Thu Oct 27 09:00:33 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:33.180213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:33.182487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:33.193624 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e0f894c-e7aa-4809-83ef-3f555467039c tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876764 Oct 27 09:00:33.195768 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 124/267] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:00:33.205800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:33.206379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:33.207759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:33.208494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:33.209019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53b17113-552d-44b5-8f3a-4bdc02f471b5 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-759729688_new", "availability_zone": "tempest-test_az-713675676_new"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:33.211149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:33.211836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:33.312234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:33.316755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53b17113-552d-44b5-8f3a-4bdc02f471b5 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:33.318357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53b17113-552d-44b5-8f3a-4bdc02f471b5 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:33.318805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53b17113-552d-44b5-8f3a-4bdc02f471b5 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:33.382505 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53b17113-552d-44b5-8f3a-4bdc02f471b5 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.184367 Oct 27 09:00:33.389614 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 125/268] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:00:33 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:33.390170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-484845e7-df11-4607-9f11-b33ff6fd62c7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:33.390781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-484845e7-df11-4607-9f11-b33ff6fd62c7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:33.504654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-484845e7-df11-4607-9f11-b33ff6fd62c7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:33.512086 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-484845e7-df11-4607-9f11-b33ff6fd62c7 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1220 microversion: 2.1 time: 0.127256 Oct 27 09:00:33.523934 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 126/269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:33 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:33.675594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:33.698301 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd1316b3-219e-4b57-83ad-8c60c103922f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1311 microversion: 2.1 time: 0.526959 Oct 27 09:00:33.703280 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 144/270] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:33 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1311 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:33.728480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5093e45b-6e0f-4189-922b-2ceaab6e8f1f tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:33.748543 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5093e45b-6e0f-4189-922b-2ceaab6e8f1f tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.043799 Oct 27 09:00:33.749460 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 145/271] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:00:33 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:33.754299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:33.755419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:33.763557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:33.764635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:33.764635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:33.765207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:33.765663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:33.766161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:33.969295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2762b08-1a38-41b5-99d8-82e67ab30ec2 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Action: 'create', calling method: .version_select at 0x7f31aad234c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIQqXrBbyPHO4btkTL31bVUG83EYFKM7l+2PTfG7w7WBg9kGfFNn6bBuFfSEnj5Gd6TuRuJaHMUztn1RxiPlDNXnVV3HpU9NmzWYWAqXf6efWmBHUICEGbLUrfrsL3T7Q=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2762b08-1a38-41b5-99d8-82e67ab30ec2 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Request method failure captured: Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 257 Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkixiyQZKFfbu4wPiE-ipIWpPw6YcRJ3tzVk5WYK365CjrL17b-kSCCh_LKBy8pdCD06UnWGr1hdEy6nmI8JSLvzkKXGOiv23M7b60iSQNERVc2ANln8Q5noThCfaYGyhQWYNRThsFzATHJveEqeNcYgqIkYtDLeZF_ZYwrqB1fx03c Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:33.981973 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e03d182f8304d8aaeae5a533ce1a947"}]}] Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b927a1965a294e299c01b0756411f074 Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:33.983534 n-d-858383-16 devstack@n-api.service[120603]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIQqXrBbyPHO4btkTL31bVUG83EYFKM7l+2PTfG7w7WBg9kGfFNn6bBuFfSEnj5Gd6TuRuJaHMUztn1RxiPlDNXnVV3HpU9NmzWYWAqXf6efWmBHUICEGbLUrfrsL3T7Q=="}} Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIQqXrBbyPHO4btkTL31bVUG83EYFKM7l+2PTfG7w7WBg9kGfFNn6bBuFfSEnj5Gd6TuRuJaHMUztn1RxiPlDNXnVV3HpU9NmzWYWAqXf6efWmBHUICEGbLUrfrsL3T7Q=='}}} Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:33.984337 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:33.985490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:00:33.986997 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:00:33.988145 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 27 09:00:33.988145 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:33.990022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2762b08-1a38-41b5-99d8-82e67ab30ec2 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:33.990022 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a2762b08-1a38-41b5-99d8-82e67ab30ec2 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.464460 Oct 27 09:00:33.992231 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 127/272] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:00:33 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 468 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:34.001118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0384e857-9f65-4bfe-a4c4-a80243633778 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:34.034373 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0384e857-9f65-4bfe-a4c4-a80243633778 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.040659 Oct 27 09:00:34.042289 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 128/273] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:33 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:34.050704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3cf96a03-11f8-4aa0-b1bc-9b6a20722f7f tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Action: 'create', calling method: .version_select at 0x7f31aad238b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1192185191", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:34.078398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3cf96a03-11f8-4aa0-b1bc-9b6a20722f7f tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:34.085168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3cf96a03-11f8-4aa0-b1bc-9b6a20722f7f tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for user b927a1965a294e299c01b0756411f074 and project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:34.132332 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-3cf96a03-11f8-4aa0-b1bc-9b6a20722f7f tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3cf96a03-11f8-4aa0-b1bc-9b6a20722f7f tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Request method failure captured: Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 2167 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkixiyQZKFfbu4wPiE-ipIWpPw6YcRJ3tzVk5WYK365CjrL17b-kSCCh_LKBy8pdCD06UnWGr1hdEy6nmI8JSLvzkKXGOiv23M7b60iSQNERVc2ANln8Q5noThCfaYGyhQWYNRThsFzATHJveEqeNcYgqIkYtDLeZF_ZYwrqB1fx03c Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e03d182f8304d8aaeae5a533ce1a947"}]}] Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b927a1965a294e299c01b0756411f074 Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1192185191", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:34.145461 n-d-858383-16 devstack@n-api.service[120603]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1192185191', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:34.147781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3cf96a03-11f8-4aa0-b1bc-9b6a20722f7f tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:34.150375 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3cf96a03-11f8-4aa0-b1bc-9b6a20722f7f tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.103428 Oct 27 09:00:34.154670 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 129/274] 10.222.0.25 () {60 vars in 1160 bytes} [Thu Oct 27 09:00:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:00:34.160856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7466c85-fc13-4583-bc57-dddc8b3b584a tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-907549637"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:34.162224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:34.165261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-a7466c85-fc13-4583-bc57-dddc8b3b584a tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Generated uuid 53d24a8e-8500-4fe3-8795-d558a847a473 for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:34.170765 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1d9f30ad-bd42-47fc-b8c9-4e3d295888c4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1322 microversion: 2.1 time: 0.420187 Oct 27 09:00:34.171277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 146/275] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:33 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:34.178448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:34.179104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:34.193049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.193929 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7466c85-fc13-4583-bc57-dddc8b3b584a tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037968 Oct 27 09:00:34.194595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.196267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.196708 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 130/276] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:34.202726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.203371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.204009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.208758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b22f260-4cf5-47d0-a490-851977c16f91 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Action: 'create', calling method: .version_select at 0x7f31aacec940>, body: {"keypair": {"name": "tempest-keypair-486371312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3uhYcy5UTB8BNaR9Efa7Ym4t/lJgM+geBAVmOTSgv9+aRPUiZR8rCSOht8oKNU+d0IJ0UgHclgoqU1xkEroAUkJDenU2Z2K5IRSmL2h+3fEszuk3ZuQYmW0wi63quWQw=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:34.240808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3b22f260-4cf5-47d0-a490-851977c16f91 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:34.248850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3b22f260-4cf5-47d0-a490-851977c16f91 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for user b927a1965a294e299c01b0756411f074 and project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:34.281514 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b22f260-4cf5-47d0-a490-851977c16f91 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083708 Oct 27 09:00:34.282477 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 131/277] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:00:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:34.287834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f88d2e0-cebc-4dd1-b004-7a282a41c030 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:34.300632 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f88d2e0-cebc-4dd1-b004-7a282a41c030 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.016720 Oct 27 09:00:34.301354 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 132/278] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:00:34 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:34.307418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-195b3b86-771d-4ae8-ac86-07110a1e1fa1 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Action: 'create', calling method: .version_select at 0x7f31aacea5e0>, body: {"keypair": {"name": "tempest-keypair-486371312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1QDDLJ6hz4H3+kmuyqmFfkD8QnhSPsM68rNjD3v6FPz6x/2Z1y+RFsN+CEfbrWwkTGjJZkKKBF9OY7uzGtWIL8u5Mxgc9BFnsP8IJbglegZVibvz79NjKjwYDF5hbSxA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:34.329807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-195b3b86-771d-4ae8-ac86-07110a1e1fa1 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:34.336308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-195b3b86-771d-4ae8-ac86-07110a1e1fa1 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for user b927a1965a294e299c01b0756411f074 and project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:34.349231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=4,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:34.367349 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-195b3b86-771d-4ae8-ac86-07110a1e1fa1 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] HTTP exception thrown: Key pair 'tempest-keypair-486371312' already exists. Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-195b3b86-771d-4ae8-ac86-07110a1e1fa1 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Request method failure captured: Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 272 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkixiyQZKFfbu4wPiE-ipIWpPw6YcRJ3tzVk5WYK365CjrL17b-kSCCh_LKBy8pdCD06UnWGr1hdEy6nmI8JSLvzkKXGOiv23M7b60iSQNERVc2ANln8Q5noThCfaYGyhQWYNRThsFzATHJveEqeNcYgqIkYtDLeZF_ZYwrqB1fx03c Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e03d182f8304d8aaeae5a533ce1a947"}]}] Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b927a1965a294e299c01b0756411f074 Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: {"keypair": {"name": "tempest-keypair-486371312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1QDDLJ6hz4H3+kmuyqmFfkD8QnhSPsM68rNjD3v6FPz6x/2Z1y+RFsN+CEfbrWwkTGjJZkKKBF9OY7uzGtWIL8u5Mxgc9BFnsP8IJbglegZVibvz79NjKjwYDF5hbSxA=="}} Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: exception: Key pair 'tempest-keypair-486371312' already exists. Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-486371312', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1QDDLJ6hz4H3+kmuyqmFfkD8QnhSPsM68rNjD3v6FPz6x/2Z1y+RFsN+CEfbrWwkTGjJZkKKBF9OY7uzGtWIL8u5Mxgc9BFnsP8IJbglegZVibvz79NjKjwYDF5hbSxA=='}}} Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result.read() Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b927a1965a294e299c01b0756411f074-tempest-keypair-486371312' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 27 09:00:34.384180 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result.read() Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 09:00:34.388399 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b927a1965a294e299c01b0756411f074-tempest-keypair-486371312' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 9, 0, 34, 357872), 'updated_at': None, 'name': 'tempest-keypair-486371312', 'user_id': 'b927a1965a294e299c01b0756411f074', 'fingerprint': '19:b8:14:35:5a:33:87:65:c6:6b:64:46:d6:b6:7a:98', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1QDDLJ6hz4H3+kmuyqmFfkD8QnhSPsM68rNjD3v6FPz6x/2Z1y+RFsN+CEfbrWwkTGjJZkKKBF9OY7uzGtWIL8u5Mxgc9BFnsP8IJbglegZVibvz79NjKjwYDF5hbSxA==', 'type': 'ssh'}] Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6779, in import_key_pair Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi keypair.create() Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._create() Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-486371312' already exists. Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 27 09:00:34.392732 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-486371312' already exists. Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-486371312' already exists. Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-195b3b86-771d-4ae8-ac86-07110a1e1fa1 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Returning 409 to user: Key pair 'tempest-keypair-486371312' already exists. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-195b3b86-771d-4ae8-ac86-07110a1e1fa1 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.084320 Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 133/279] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:00:34 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:34.398551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d80fab7-ff19-42cc-ad0e-b63a41767b19 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:34.422211 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d80fab7-ff19-42cc-ad0e-b63a41767b19 tempest-AggregatesAdminTestJSON-734464620 tempest-AggregatesAdminTestJSON-734464620-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.032560 Oct 27 09:00:34.422785 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 134/280] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:34 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:34.427314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c056db7f-dfaa-46e3-8592-5a0c854c74b4 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Calling method '.version_select at 0x7f31aaaed4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:34.455599 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c056db7f-dfaa-46e3-8592-5a0c854c74b4 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486371312" status: 202 len: 0 microversion: 2.1 time: 0.031703 Oct 27 09:00:34.463175 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 135/281] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486371312 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:34.470021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:34.470518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:34.478457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.479320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.480176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.481908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.481908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.482296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.503190 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] HTTP exception thrown: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Request method failure captured: Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 HTTP/1.1 Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkhyIHjgBgvUmgx7GKVGTylG7eKudP_kJo9wcECJtINvBnxlL5XIhpnlL86FjfjgKSQZ8Bun4DREMvsvd7twt7epHpgsnn314-NTMx2_R2c-_2S0dQHWHkhHm6SNxym4DjIBqk-eXjpHlWDURVCI4m1f4jv549brMqjfMd_w94bZ5wY Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 44fbb7f650c648a294c2674fb46b313c Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminTestJSON-869423919 Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/44fbb7f650c648a294c2674fb46b313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_44fbb7f650c648a294c2674fb46b313c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/44fbb7f650c648a294c2674fb46b313c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/44fbb7f650c648a294c2674fb46b313c"}]}] Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminTestJSON-869423919 Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 44fbb7f650c648a294c2674fb46b313c Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-869423919 Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminTestJSON-869423919-project Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: ff580f5cbc814eeea503c570dfcf8e38 Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminTestJSON-869423919-project Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5fed6968-5fcf-49af-ae89-89d67b3f3a71'} Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:00:34.504958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Returning 404 to user: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:34.509028 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad3217d9-ed7a-4f8c-b7cc-827cc4575c27 tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 404 len: 111 microversion: 2.1 time: 0.042013 Oct 27 09:00:34.510726 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 136/282] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:00:34 2022] DELETE /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:34.517558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0d8d847e-713d-4f85-be95-3bb7e09b80bd req-ecc1f4db-ffb2-4460-9076-e5232ade9bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198a8f18-762d-46b1-99ba-59c3af33cf74", "tag": "f06731c0-364a-4965-9db9-9c6e82c13ca5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:34.522347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:34.529934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0d8d847e-713d-4f85-be95-3bb7e09b80bd req-ecc1f4db-ffb2-4460-9076-e5232ade9bab service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.530455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0d8d847e-713d-4f85-be95-3bb7e09b80bd req-ecc1f4db-ffb2-4460-9076-e5232ade9bab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.530862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0d8d847e-713d-4f85-be95-3bb7e09b80bd req-ecc1f4db-ffb2-4460-9076-e5232ade9bab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.543356 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0a596a2-8471-476a-8506-d0af1fa0ff59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1311 microversion: 2.1 time: 0.368958 Oct 27 09:00:34.544110 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0d8d847e-713d-4f85-be95-3bb7e09b80bd req-ecc1f4db-ffb2-4460-9076-e5232ade9bab service nova] Creating event network-changed:f06731c0-364a-4965-9db9-9c6e82c13ca5 for instance 198a8f18-762d-46b1-99ba-59c3af33cf74 on n-h2-858383-16 Oct 27 09:00:34.546900 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 147/283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:34 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1311 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:34.558178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e821e47e-584b-483c-b8e4-c7262d2b00fc tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Action: 'create', calling method: .version_select at 0x7f31aadd4ee0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeBDPJ22sbQzg8U4mTOk8lmwfQd+z1BAK1ailkKTEh1p9dEDqn/bNGbwLq2NkjFU4XT82O/v++9OdwCNpju83K1aM9FlS7Z8OEH5egvPkIcKocUri0cP2hEx7SPxQ5lfA=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:34.563192 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0d8d847e-713d-4f85-be95-3bb7e09b80bd req-ecc1f4db-ffb2-4460-9076-e5232ade9bab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050928 Oct 27 09:00:34.564132 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 137/284] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e821e47e-584b-483c-b8e4-c7262d2b00fc tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Request method failure captured: Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 247 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkixiyQZKFfbu4wPiE-ipIWpPw6YcRJ3tzVk5WYK365CjrL17b-kSCCh_LKBy8pdCD06UnWGr1hdEy6nmI8JSLvzkKXGOiv23M7b60iSQNERVc2ANln8Q5noThCfaYGyhQWYNRThsFzATHJveEqeNcYgqIkYtDLeZF_ZYwrqB1fx03c Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e03d182f8304d8aaeae5a533ce1a947"}]}] Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: b927a1965a294e299c01b0756411f074 Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeBDPJ22sbQzg8U4mTOk8lmwfQd+z1BAK1ailkKTEh1p9dEDqn/bNGbwLq2NkjFU4XT82O/v++9OdwCNpju83K1aM9FlS7Z8OEH5egvPkIcKocUri0cP2hEx7SPxQ5lfA=="}} Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeBDPJ22sbQzg8U4mTOk8lmwfQd+z1BAK1ailkKTEh1p9dEDqn/bNGbwLq2NkjFU4XT82O/v++9OdwCNpju83K1aM9FlS7Z8OEH5egvPkIcKocUri0cP2hEx7SPxQ5lfA=='}}} Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '' Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:00:34.572156 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:00:34.579426 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.581036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:34.581036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] [instance: 5fed6968-5fcf-49af-ae89-89d67b3f3a71] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:34.581217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e821e47e-584b-483c-b8e4-c7262d2b00fc tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:34.581217 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e821e47e-584b-483c-b8e4-c7262d2b00fc tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.029737 Oct 27 09:00:34.581217 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 148/285] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:00:34 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:34.587750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:34.588360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:34.595908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.596939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.597159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.597662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.597787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.598101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.598795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.599170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.599463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.599893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.600841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.601350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.633003 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] HTTP exception thrown: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Request method failure captured: Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 HTTP/1.1 Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkhyIHjgBgvUmgx7GKVGTylG7eKudP_kJo9wcECJtINvBnxlL5XIhpnlL86FjfjgKSQZ8Bun4DREMvsvd7twt7epHpgsnn314-NTMx2_R2c-_2S0dQHWHkhHm6SNxym4DjIBqk-eXjpHlWDURVCI4m1f4jv549brMqjfMd_w94bZ5wY Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 44fbb7f650c648a294c2674fb46b313c Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminTestJSON-869423919 Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/44fbb7f650c648a294c2674fb46b313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_44fbb7f650c648a294c2674fb46b313c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/44fbb7f650c648a294c2674fb46b313c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/44fbb7f650c648a294c2674fb46b313c"}]}] Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminTestJSON-869423919 Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 44fbb7f650c648a294c2674fb46b313c Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-869423919 Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminTestJSON-869423919-project Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: ff580f5cbc814eeea503c570dfcf8e38 Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminTestJSON-869423919-project Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5fed6968-5fcf-49af-ae89-89d67b3f3a71'} Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.642693 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.646452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.646452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.646452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.646452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:34.646452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:34.646452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. Oct 27 09:00:34.646452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.646452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] Returning 404 to user: Instance 5fed6968-5fcf-49af-ae89-89d67b3f3a71 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:34.646452 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-057b27ce-faf3-4ec3-b7a3-bc2f0eda71fd tempest-AggregatesAdminTestJSON-869423919 tempest-AggregatesAdminTestJSON-869423919-project] 10.222.0.25 "GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71" status: 404 len: 111 microversion: 2.1 time: 0.078875 Oct 27 09:00:34.647795 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 138/286] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:34 2022] GET /compute/v2.1/servers/5fed6968-5fcf-49af-ae89-89d67b3f3a71 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:34.669656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c1e1048-0419-4fa1-b112-c91a45be0fd5 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Action: 'create', calling method: .version_select at 0x7f31aaaedc10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1805679496", "public_key": " "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:34.698868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:34.708717 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-deccd501-0a2d-479c-aeae-2ffe7e1e6243 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1272 microversion: 2.1 time: 0.124609 Oct 27 09:00:34.709555 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 149/287] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:34 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:34.716973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8c1e1048-0419-4fa1-b112-c91a45be0fd5 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:34.728001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8c1e1048-0419-4fa1-b112-c91a45be0fd5 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for user b927a1965a294e299c01b0756411f074 and project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:34.729437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:34.730242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:34.748641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.749386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.750948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.752105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:34.752638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:34.755306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:34.767487 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8c1e1048-0419-4fa1-b112-c91a45be0fd5 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c1e1048-0419-4fa1-b112-c91a45be0fd5 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Request method failure captured: Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 95 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkixiyQZKFfbu4wPiE-ipIWpPw6YcRJ3tzVk5WYK365CjrL17b-kSCCh_LKBy8pdCD06UnWGr1hdEy6nmI8JSLvzkKXGOiv23M7b60iSQNERVc2ANln8Q5noThCfaYGyhQWYNRThsFzATHJveEqeNcYgqIkYtDLeZF_ZYwrqB1fx03c Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e03d182f8304d8aaeae5a533ce1a947"}]}] Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b927a1965a294e299c01b0756411f074 Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1805679496", "public_key": " "}} Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1805679496', 'public_key': ' '}}} Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.769726 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c1e1048-0419-4fa1-b112-c91a45be0fd5 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:34.773442 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c1e1048-0419-4fa1-b112-c91a45be0fd5 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.120347 Oct 27 09:00:34.779891 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 139/288] 10.222.0.25 () {60 vars in 1158 bytes} [Thu Oct 27 09:00:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:00:34.803766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df39bda7-33f7-4ee8-a7c5-6a3179803f1d tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Action: 'create', calling method: .version_select at 0x7f31aaaf7ca0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7uuLTepDHFv9/5Xn9f8FtAnY+oxhHIT3zhpwitJQc434/x79qr8SfxzCCfUukXez2p4wg8vqmH6CBeq6Fi7iDiql3K6AHWdN4RWRYIeEgP2La6EOYzYDHfskHxu42a2Q=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df39bda7-33f7-4ee8-a7c5-6a3179803f1d tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Request method failure captured: Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 507 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkixiyQZKFfbu4wPiE-ipIWpPw6YcRJ3tzVk5WYK365CjrL17b-kSCCh_LKBy8pdCD06UnWGr1hdEy6nmI8JSLvzkKXGOiv23M7b60iSQNERVc2ANln8Q5noThCfaYGyhQWYNRThsFzATHJveEqeNcYgqIkYtDLeZF_ZYwrqB1fx03c Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e03d182f8304d8aaeae5a533ce1a947"}]}] Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b927a1965a294e299c01b0756411f074 Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7uuLTepDHFv9/5Xn9f8FtAnY+oxhHIT3zhpwitJQc434/x79qr8SfxzCCfUukXez2p4wg8vqmH6CBeq6Fi7iDiql3K6AHWdN4RWRYIeEgP2La6EOYzYDHfskHxu42a2Q=="}} Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7uuLTepDHFv9/5Xn9f8FtAnY+oxhHIT3zhpwitJQc434/x79qr8SfxzCCfUukXez2p4wg8vqmH6CBeq6Fi7iDiql3K6AHWdN4RWRYIeEgP2La6EOYzYDHfskHxu42a2Q=='}}} Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 27 09:00:34.819432 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 27 09:00:34.822409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.826080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df39bda7-33f7-4ee8-a7c5-6a3179803f1d tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:34.830724 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df39bda7-33f7-4ee8-a7c5-6a3179803f1d tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.036680 Oct 27 09:00:34.832719 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 140/289] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:00:34 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:34.848453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c4dea4e-7880-499d-baeb-c881c3b21549 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Action: 'create', calling method: .version_select at 0x7f31aaaed700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-524584275", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:34.890032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-6c4dea4e-7880-499d-baeb-c881c3b21549 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:34.909053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-6c4dea4e-7880-499d-baeb-c881c3b21549 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Getting quotas for user b927a1965a294e299c01b0756411f074 and project 4e03d182f8304d8aaeae5a533ce1a947. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:34.966543 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6c4dea4e-7880-499d-baeb-c881c3b21549 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c4dea4e-7880-499d-baeb-c881c3b21549 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Request method failure captured: Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 117 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkixiyQZKFfbu4wPiE-ipIWpPw6YcRJ3tzVk5WYK365CjrL17b-kSCCh_LKBy8pdCD06UnWGr1hdEy6nmI8JSLvzkKXGOiv23M7b60iSQNERVc2ANln8Q5noThCfaYGyhQWYNRThsFzATHJveEqeNcYgqIkYtDLeZF_ZYwrqB1fx03c Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e03d182f8304d8aaeae5a533ce1a947"}]}] Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b927a1965a294e299c01b0756411f074 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-524584275", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: exception: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-524584275', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 27 09:00:34.971476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 27 09:00:34.983056 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:34.993571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c4dea4e-7880-499d-baeb-c881c3b21549 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:34.993571 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c4dea4e-7880-499d-baeb-c881c3b21549 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.145028 Oct 27 09:00:35.001641 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 141/290] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:00:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 27 09:00:35.020215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c00f067-2279-4fee-8da4-48c88d013144 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Calling method '.version_select at 0x7f31aacea940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:35.040979 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6c00f067-2279-4fee-8da4-48c88d013144 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-305718120 not found for user b927a1965a294e299c01b0756411f074 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c00f067-2279-4fee-8da4-48c88d013144 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Request method failure captured: Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-305718120 HTTP/1.1 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkixiyQZKFfbu4wPiE-ipIWpPw6YcRJ3tzVk5WYK365CjrL17b-kSCCh_LKBy8pdCD06UnWGr1hdEy6nmI8JSLvzkKXGOiv23M7b60iSQNERVc2ANln8Q5noThCfaYGyhQWYNRThsFzATHJveEqeNcYgqIkYtDLeZF_ZYwrqB1fx03c Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e03d182f8304d8aaeae5a533ce1a947"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e03d182f8304d8aaeae5a533ce1a947"}]}] Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 4e03d182f8304d8aaeae5a533ce1a947 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1480492297 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b927a1965a294e299c01b0756411f074 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1480492297-project Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: exception: Keypair tempest-keypair-non-existent-305718120 not found for user b927a1965a294e299c01b0756411f074 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'tempest-keypair-non-existent-305718120'} Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6863, in delete_key_pair Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6884, in get_key_pair Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-305718120 not found for user b927a1965a294e299c01b0756411f074 Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:35.043802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-305718120 not found for user b927a1965a294e299c01b0756411f074 Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-305718120 not found for user b927a1965a294e299c01b0756411f074 Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c00f067-2279-4fee-8da4-48c88d013144 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] Returning 404 to user: Keypair tempest-keypair-non-existent-305718120 not found for user b927a1965a294e299c01b0756411f074 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c00f067-2279-4fee-8da4-48c88d013144 tempest-KeyPairsNegativeTestJSON-1480492297 tempest-KeyPairsNegativeTestJSON-1480492297-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-305718120" status: 404 len: 144 microversion: 2.1 time: 0.041949 Oct 27 09:00:35.058410 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 142/291] 10.222.0.25 () {58 vars in 1257 bytes} [Thu Oct 27 09:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-305718120 => generated 144 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:35.122203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ccac6a7a-2d17-4e7a-8fa2-246ab3064360 req-0eaa9a74-5e51-429f-81b1-9bc34b8e3bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5ae277-3562-4d0b-8169-2820971f9aa7", "name": "network-vif-plugged", "status": "completed", "tag": "b09e8afc-87cf-4ace-af3f-18ab1dfab2b9"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:35.144382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ccac6a7a-2d17-4e7a-8fa2-246ab3064360 req-0eaa9a74-5e51-429f-81b1-9bc34b8e3bc4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:35.144872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ccac6a7a-2d17-4e7a-8fa2-246ab3064360 req-0eaa9a74-5e51-429f-81b1-9bc34b8e3bc4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:35.144999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:35.145435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ccac6a7a-2d17-4e7a-8fa2-246ab3064360 req-0eaa9a74-5e51-429f-81b1-9bc34b8e3bc4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:35.158012 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f603bb71-5f02-47ed-8efb-aa102790c26f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1311 microversion: 2.1 time: 0.432801 Oct 27 09:00:35.158596 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 150/292] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:34 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1311 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:00:35.164413 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ccac6a7a-2d17-4e7a-8fa2-246ab3064360 req-0eaa9a74-5e51-429f-81b1-9bc34b8e3bc4 service nova] Creating event network-vif-plugged:b09e8afc-87cf-4ace-af3f-18ab1dfab2b9 for instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 on n-h1-858383-16 Oct 27 09:00:35.177445 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ccac6a7a-2d17-4e7a-8fa2-246ab3064360 req-0eaa9a74-5e51-429f-81b1-9bc34b8e3bc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059065 Oct 27 09:00:35.181444 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 143/293] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:00:35.196053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:35.196965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:35.207644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:35.208705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:35.211453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:35.213506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:35.215086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:35.217206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:35.573888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:35.576456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:35.591876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:35.595964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:35.597379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:35.600280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:35.602046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:35.602586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:35.624084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:35.648570 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8906b8ab-a3b2-4c7d-bd3c-0f55128ccec8 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1322 microversion: 2.1 time: 0.454874 Oct 27 09:00:35.661054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:35.666023 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 151/294] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:35 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:35.741161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:35.743102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:35.757109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:35.759954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:35.760996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:35.763238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:35.764854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:35.765664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:35.853962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:35.868462 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f1126ac-5998-42a4-8538-fe9e15e47ac9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1311 microversion: 2.1 time: 0.295316 Oct 27 09:00:35.869560 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 144/295] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:35 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1311 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:35.901797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:35.919289 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a2a4836-be19-4124-9d16-f5e8e34fa245 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1290 microversion: 2.1 time: 0.184299 Oct 27 09:00:35.920201 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 152/296] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:35 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1290 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:36.184782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:36.185683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:36.191936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:36.192417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:36.192920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:36.195102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:36.195810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:36.196435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:36.428819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:36.440496 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb2a425b-3a33-43d1-8831-5784331320ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1311 microversion: 2.1 time: 0.261664 Oct 27 09:00:36.458643 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 145/297] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:36 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1311 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:36.686657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:36.687085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:36.695179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:36.697910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:36.698366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:36.699087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:36.700145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:36.700585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:36.874321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:36.886121 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be247a5a-4df8-4f92-a32d-b89aacd7e692 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1322 microversion: 2.1 time: 0.204510 Oct 27 09:00:36.889461 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 153/298] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:36 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:36.928373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:36.937680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:36.951284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:36.956688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:36.961971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:36.963758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:36.964450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:36.965442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:36.966279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:36.967141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:36.969496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:36.970259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:36.971815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:36.974136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:36.974875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:36.975847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:37.087626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:37.104326 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33b7ff0d-aad3-4698-bd2e-a66335e9c273 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1290 microversion: 2.1 time: 0.163282 Oct 27 09:00:37.104903 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 154/299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:36 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1290 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:37.150489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:37.159361 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8e50718-deab-4a31-a7f3-f374b4058fa1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1311 microversion: 2.1 time: 0.244421 Oct 27 09:00:37.159966 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 146/300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:36 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:37.246324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7878a466-c6db-4da3-978b-ab05688fed63 req-f3ac3334-00f9-4c4a-91b7-fe2aa2b2d0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba26e0a-7168-465e-b2f2-3b763456fe6c", "name": "network-vif-plugged", "status": "completed", "tag": "083ab409-0cbd-467f-85a9-e03ea9c7779b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:37.258104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7878a466-c6db-4da3-978b-ab05688fed63 req-f3ac3334-00f9-4c4a-91b7-fe2aa2b2d0d3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:37.258708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7878a466-c6db-4da3-978b-ab05688fed63 req-f3ac3334-00f9-4c4a-91b7-fe2aa2b2d0d3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:37.259231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7878a466-c6db-4da3-978b-ab05688fed63 req-f3ac3334-00f9-4c4a-91b7-fe2aa2b2d0d3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:37.272975 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7878a466-c6db-4da3-978b-ab05688fed63 req-f3ac3334-00f9-4c4a-91b7-fe2aa2b2d0d3 service nova] Creating event network-vif-plugged:083ab409-0cbd-467f-85a9-e03ea9c7779b for instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c on n-h2-858383-16 Oct 27 09:00:37.280465 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7878a466-c6db-4da3-978b-ab05688fed63 req-f3ac3334-00f9-4c4a-91b7-fe2aa2b2d0d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037662 Oct 27 09:00:37.281194 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 155/301] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:00:37.468145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:37.468865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:37.475710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:37.476782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:37.477431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:37.478335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:37.478722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:37.479160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:37.698404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:37.707438 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00bca8ed-4fbb-44db-b82d-b0366cdeb641 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1494 microversion: 2.1 time: 0.246042 Oct 27 09:00:37.718815 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 147/302] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:37 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1494 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:37.758817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=16 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:38.105183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92864685-8786-44c3-90d0-2c2948cb4542 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:38.110730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92864685-8786-44c3-90d0-2c2948cb4542 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.111221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92864685-8786-44c3-90d0-2c2948cb4542 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.114166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92864685-8786-44c3-90d0-2c2948cb4542 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.115174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92864685-8786-44c3-90d0-2c2948cb4542 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.115814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92864685-8786-44c3-90d0-2c2948cb4542 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.119128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92864685-8786-44c3-90d0-2c2948cb4542 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.171234 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92864685-8786-44c3-90d0-2c2948cb4542 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.416261 Oct 27 09:00:38.178166 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 148/303] 10.222.0.25 () {58 vars in 1176 bytes} [Thu Oct 27 09:00:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:38.192240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:38.197342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b8d2a98-b5c8-45cd-8fae-001a08df9aae tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:38.198219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b8d2a98-b5c8-45cd-8fae-001a08df9aae tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:38.199106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:38.205276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b8d2a98-b5c8-45cd-8fae-001a08df9aae tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.205792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b8d2a98-b5c8-45cd-8fae-001a08df9aae tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.206345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b8d2a98-b5c8-45cd-8fae-001a08df9aae tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.207026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b8d2a98-b5c8-45cd-8fae-001a08df9aae tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.207483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b8d2a98-b5c8-45cd-8fae-001a08df9aae tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.208085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b8d2a98-b5c8-45cd-8fae-001a08df9aae tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.217856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.218618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.219207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.220116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.220726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.221303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.551764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:38.569540 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65f11a95-798c-460c-b0b6-a08d40829031 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1322 microversion: 2.1 time: 0.380548 Oct 27 09:00:38.572279 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 149/304] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:38 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:38.583095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:38.584893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:38.601340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.603279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.604512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.606667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.608011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.609048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.665677 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b8d2a98-b5c8-45cd-8fae-001a08df9aae tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1647 microversion: 2.1 time: 0.920566 Oct 27 09:00:38.669248 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 156/305] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:37 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1647 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:38.681231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:38.683640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:38.697893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.700183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.701238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.703669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.704818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.706576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.810988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:38.826655 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c6e1c25-ccb4-408b-8e65-4389cbb37e6a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1278 microversion: 2.1 time: 0.251885 Oct 27 09:00:38.832593 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 150/306] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:38 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:38.848668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b8597a2-9155-47fd-bf30-91dacee8b870 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1811242273"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:38.858166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-1b8597a2-9155-47fd-bf30-91dacee8b870 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Generated uuid cb5c0fbd-0967-4657-9b30-c5c578e025b7 for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:38.906555 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b8597a2-9155-47fd-bf30-91dacee8b870 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071667 Oct 27 09:00:38.916451 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 151/307] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:38.923331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c184a950-bd9b-4cab-a3b2-43ff336b082f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:38.926551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c184a950-bd9b-4cab-a3b2-43ff336b082f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:38.941155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c184a950-bd9b-4cab-a3b2-43ff336b082f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.942588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c184a950-bd9b-4cab-a3b2-43ff336b082f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.943330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c184a950-bd9b-4cab-a3b2-43ff336b082f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:38.945236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c184a950-bd9b-4cab-a3b2-43ff336b082f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:38.946576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c184a950-bd9b-4cab-a3b2-43ff336b082f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:38.947286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c184a950-bd9b-4cab-a3b2-43ff336b082f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:39.112156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:39.134187 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e46370d6-bacd-44ba-9c1c-7cf81cefa1fd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1311 microversion: 2.1 time: 0.462375 Oct 27 09:00:39.135707 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 157/308] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:38 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1311 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:39.156586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a8a6f67-d486-498e-afae-0a77a6082e2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:39.180620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a8a6f67-d486-498e-afae-0a77a6082e2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:39.181526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a8a6f67-d486-498e-afae-0a77a6082e2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:39.182635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a8a6f67-d486-498e-afae-0a77a6082e2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:39.304603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c184a950-bd9b-4cab-a3b2-43ff336b082f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1647 microversion: 2.1 time: 0.386668 Oct 27 09:00:39.305371 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 152/309] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:38 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1647 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:39.434864 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a8a6f67-d486-498e-afae-0a77a6082e2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.281739 Oct 27 09:00:39.437496 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 158/310] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:00:39 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:39.452744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-759d6e9f-8cb9-4766-9786-aa8b76fe9977 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:39.459179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-759d6e9f-8cb9-4766-9786-aa8b76fe9977 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:39.460386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-759d6e9f-8cb9-4766-9786-aa8b76fe9977 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:39.461074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-759d6e9f-8cb9-4766-9786-aa8b76fe9977 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:39.462295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-759d6e9f-8cb9-4766-9786-aa8b76fe9977 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:39.463034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-759d6e9f-8cb9-4766-9786-aa8b76fe9977 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:39.463741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-759d6e9f-8cb9-4766-9786-aa8b76fe9977 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:39.489801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:39.501494 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-759d6e9f-8cb9-4766-9786-aa8b76fe9977 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.061506 Oct 27 09:00:39.502369 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 159/311] 10.222.0.25 () {58 vars in 1176 bytes} [Thu Oct 27 09:00:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:39.506235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66ec9c42-ae94-4945-a100-459bde735b2c tempest-FlavorMetadataValidation-1743284304 tempest-FlavorMetadataValidation-1743284304-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-498390097", "id": 1022707579, "os-flavor-access:is_public": "True"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:39.516029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-466d0542-977d-4b6a-a482-bcf958fe71e7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:39.534528 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66ec9c42-ae94-4945-a100-459bde735b2c tempest-FlavorMetadataValidation-1743284304 tempest-FlavorMetadataValidation-1743284304-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.227986 Oct 27 09:00:39.536124 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 153/312] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:00:39 2022] POST /compute/v2.1/flavors => generated 470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:00:39.542378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-16", "block_migration": true, "disk_over_commit": false}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:39.546574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:39.552172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-466d0542-977d-4b6a-a482-bcf958fe71e7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:39.554212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-466d0542-977d-4b6a-a482-bcf958fe71e7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:39.554744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-466d0542-977d-4b6a-a482-bcf958fe71e7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:39.555695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:39.556567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:39.557471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:39.558471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:39.559997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:39.560670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:39.613446 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-466d0542-977d-4b6a-a482-bcf958fe71e7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-858383-16. Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-466d0542-977d-4b6a-a482-bcf958fe71e7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Request method failure captured: Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 40 Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki10PkOuhx5_Z0NYkgCE0zgZik2gLpQQaqkIFMg9lV4TeCwnmbh2aSizNJJpdymW9N7TwLmXlb07_DqWNaO-2_kTl5e-_lPpuEhSCo7FyHjmbEUfETVpDLC_qH9c1bscP6Rha-XaTornUmnjWrcozU6V6lQoITWD_dUI0F968-uUSc Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1ee7431727348808d3f2861aec6f20e"}]}] Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c879c6de794c466fab596abd3cc82162 Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: {"add_host": {"host": "n-h1-858383-16"}} Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: exception: Aggregate 11 already has host n-h1-858383-16. Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-858383-16'}}} Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result.read() Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-858383-16-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:39.635165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result.read() Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 09:00:39.640242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-858383-16-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 9, 0, 39, 593103), 'updated_at': None, 'host': 'n-h1-858383-16', 'aggregate_id': 11}] Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6643, in add_host_to_aggregate Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-858383-16. Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-858383-16. Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-858383-16. Oct 27 09:00:39.643846 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:39.651624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-466d0542-977d-4b6a-a482-bcf958fe71e7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-858383-16. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:39.651624 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-466d0542-977d-4b6a-a482-bcf958fe71e7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.138374 Oct 27 09:00:39.667895 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 160/313] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:00:39 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 27 09:00:39.673312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aeae79f7-7219-43e6-9ece-2eb912a1dd7f tempest-FlavorMetadataValidation-1743284304 tempest-FlavorMetadataValidation-1743284304-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:39.680504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lazy-loading 'flavor' on Instance uuid 8b5ae277-3562-4d0b-8169-2820971f9aa7 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:00:39.730440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Going to try to live migrate instance to n-h2-858383-16 {{(pid=120603) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:00:39.892270 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aeae79f7-7219-43e6-9ece-2eb912a1dd7f tempest-FlavorMetadataValidation-1743284304 tempest-FlavorMetadataValidation-1743284304-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1022707579/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.222846 Oct 27 09:00:39.893308 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 161/314] 10.222.0.25 () {62 vars in 1265 bytes} [Thu Oct 27 09:00:39 2022] POST /compute/v2.1/flavors/1022707579/os-extra_specs => generated 62 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:39.904119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:39.905735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:39.914881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:39.916128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:39.916919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:39.918181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:39.919273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:39.920880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:40.144838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:40.160218 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99634d24-fabb-43c3-9d17-aff9f14441af tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1322 microversion: 2.1 time: 0.263877 Oct 27 09:00:40.162041 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 162/315] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:39 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:40.178023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61401b2e-a732-4402-9e82-048921a58b2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:40.196338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61401b2e-a732-4402-9e82-048921a58b2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:40.197479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61401b2e-a732-4402-9e82-048921a58b2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:40.198358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61401b2e-a732-4402-9e82-048921a58b2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:40.456765 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61401b2e-a732-4402-9e82-048921a58b2e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.293064 Oct 27 09:00:40.458726 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 163/316] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:00:40 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:40.469129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:40.469874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:40.478865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:40.479477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:40.479949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:40.481777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:40.482081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:40.482547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:40.722554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:40.751127 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94359a18-f9c6-47ba-be4c-2c0345f8819d tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1320 microversion: 2.1 time: 0.289098 Oct 27 09:00:40.753376 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 164/317] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:40 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:40.766493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ee9ac6d9-59e7-4b08-b3de-03d2598ecd94 tempest-FlavorMetadataValidation-1743284304 tempest-FlavorMetadataValidation-1743284304-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:40.797133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ee9ac6d9-59e7-4b08-b3de-03d2598ecd94 tempest-FlavorMetadataValidation-1743284304 tempest-FlavorMetadataValidation-1743284304-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1022707579" status: 202 len: 0 microversion: 2.86 time: 0.041474 Oct 27 09:00:40.798296 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 165/318] 10.222.0.25 () {60 vars in 1202 bytes} [Thu Oct 27 09:00:40 2022] DELETE /compute/v2.1/flavors/1022707579 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:00:40.806738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:40.808377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:40.824830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:40.825824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:40.826664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:40.828838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:40.829570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:40.830338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:41.089273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:41.105725 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-04db798f-5d1b-450c-b2b4-52581dfdbb6a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1461 microversion: 2.1 time: 0.305494 Oct 27 09:00:41.106609 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 166/319] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:40 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1461 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:41.116590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4af8ced7-d909-4b1b-8b57-1d8accd43b14 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:41.161199 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4af8ced7-d909-4b1b-8b57-1d8accd43b14 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.050695 Oct 27 09:00:41.162037 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 167/320] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:41 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:41.176839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-179256bf-e90f-44ea-bbb8-1913649bb35c tempest-FlavorMetadataValidation-1743284304 tempest-FlavorMetadataValidation-1743284304-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:41.218509 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-179256bf-e90f-44ea-bbb8-1913649bb35c tempest-FlavorMetadataValidation-1743284304 tempest-FlavorMetadataValidation-1743284304-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.047730 Oct 27 09:00:41.219402 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 168/321] 10.222.0.25 () {60 vars in 1187 bytes} [Thu Oct 27 09:00:41 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:00:41.480856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1dcf7733-2246-4e15-85b9-3d8db67c1315 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:41.482475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1dcf7733-2246-4e15-85b9-3d8db67c1315 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:41.513495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dcf7733-2246-4e15-85b9-3d8db67c1315 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:41.517083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dcf7733-2246-4e15-85b9-3d8db67c1315 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:41.518008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dcf7733-2246-4e15-85b9-3d8db67c1315 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:41.525123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dcf7733-2246-4e15-85b9-3d8db67c1315 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:41.526582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dcf7733-2246-4e15-85b9-3d8db67c1315 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:41.527218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dcf7733-2246-4e15-85b9-3d8db67c1315 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:42.164227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:42.171124 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1dcf7733-2246-4e15-85b9-3d8db67c1315 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1614 microversion: 2.1 time: 0.950618 Oct 27 09:00:42.176679 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 169/322] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:41 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1614 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:42.189381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e338b905-7fa0-4984-b61c-874deb0a4bad tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-774850590"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:42.218197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.aggregate [None req-e338b905-7fa0-4984-b61c-874deb0a4bad tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Generated uuid 1043945e-de39-46dd-bb15-607eaccd88f1 for aggregate {{(pid=120602) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:42.247848 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e338b905-7fa0-4984-b61c-874deb0a4bad tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068754 Oct 27 09:00:42.250328 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 170/323] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:42.271782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:42.273356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:42.302841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:42.304971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:42.308214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:42.311703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:42.312781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:42.313582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:42.624661 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-20d7682c-8919-4b6c-b3ee-80c895132588 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7/action" status: 202 len: 0 microversion: 2.1 time: 3.086536 Oct 27 09:00:42.625678 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 154/324] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:00:39 2022] POST /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7/action => generated 0 bytes in 3089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:42.631296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c6b882fb-0df5-466f-a7e0-0aba7ffc3985 req-d30e6f78-2e23-48f9-b6a4-dc5e51dcff8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af487f27-d809-4419-b687-f4ed26103070", "tag": "5c3fff53-86cb-4c8e-b81d-2e2ca446d68a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:42.655520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c6b882fb-0df5-466f-a7e0-0aba7ffc3985 req-d30e6f78-2e23-48f9-b6a4-dc5e51dcff8a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:42.656019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c6b882fb-0df5-466f-a7e0-0aba7ffc3985 req-d30e6f78-2e23-48f9-b6a4-dc5e51dcff8a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:42.659343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c6b882fb-0df5-466f-a7e0-0aba7ffc3985 req-d30e6f78-2e23-48f9-b6a4-dc5e51dcff8a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:42.689684 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c6b882fb-0df5-466f-a7e0-0aba7ffc3985 req-d30e6f78-2e23-48f9-b6a4-dc5e51dcff8a service nova] Creating event network-changed:5c3fff53-86cb-4c8e-b81d-2e2ca446d68a for instance af487f27-d809-4419-b687-f4ed26103070 on n-h2-858383-16 Oct 27 09:00:42.701681 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c6b882fb-0df5-466f-a7e0-0aba7ffc3985 req-d30e6f78-2e23-48f9-b6a4-dc5e51dcff8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074463 Oct 27 09:00:42.702187 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 155/325] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:42.708415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:42.715409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:42.733311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:42.733850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:42.734297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:42.735022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:42.735485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:42.735940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:42.949955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:42.963077 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-24af9db9-77e6-4bce-90d1-541d56fdf7d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1322 microversion: 2.1 time: 0.710493 Oct 27 09:00:42.964077 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 171/326] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:42 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1322 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:42.978911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:42.978911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:42.982748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:42.983657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:42.984579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:42.985792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:42.986794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:42.989175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:43.055086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:43.072933 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7cdf918b-67c2-46b5-9ac3-5dd72f4107b0 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1320 microversion: 2.1 time: 0.368191 Oct 27 09:00:43.087611 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 156/327] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:42 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:43.295439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '53a12c42039245cb8f56db798254e016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a94c8f1728143db9c22f3995a036a73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:43.296054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] flavor_id is None. Assuming migration. {{(pid=120602) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 27 09:00:43.296488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120602) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 09:00:43.439675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6dca465c-cec7-4c0b-9cd1-62fc10164f25 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:43.444952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6dca465c-cec7-4c0b-9cd1-62fc10164f25 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0687f6e12cab48f68b1f216d7a3001e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324279c4a4b24f5abac04c34e2b6e6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6dca465c-cec7-4c0b-9cd1-62fc10164f25 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Request method failure captured: Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 40 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWki0BZA-uQmlXag3k2mK2QIfTSMf4O4AS2hpO_JBYazXTG_zQhtAYHhu9U-O01KNOkcFUJ6Jx3CysB7VPkuug6ecJg04UpagiltQ-CkEkkwZvDMeumBdi5OLw1p-ABeTcvgAuUYICyfs_LXKXHM72vvZ-iST4m_aCQW2vAGf0X7HPVs Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/324279c4a4b24f5abac04c34e2b6e6f0"}]}] Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0687f6e12cab48f68b1f216d7a3001e4 Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: {"add_host": {"host": "n-h1-858383-16"}} Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-858383-16'}}} Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 09:00:43.447308 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:43.452335 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:43.452335 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:43.452335 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:43.452335 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:43.452335 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:43.452335 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:43.452335 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:43.452335 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 27 09:00:43.452335 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:43.456679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6dca465c-cec7-4c0b-9cd1-62fc10164f25 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:43.457719 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6dca465c-cec7-4c0b-9cd1-62fc10164f25 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.382453 Oct 27 09:00:43.459096 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 157/328] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:00:43 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 384 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:43.465562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:43.467055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:43.476941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:43.477666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:43.478256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:43.479108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:43.480069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:43.481048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:43.708240 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b02016de-0dcd-406a-b12c-e656f90bf61a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c/action" status: 202 len: 0 microversion: 2.1 time: 0.743059 Oct 27 09:00:43.710788 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 172/329] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:00:42 2022] POST /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:43.734608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf2750fb-78fd-461e-906f-1c115a91597c tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:43.786941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:43.801718 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e46994d4-38e9-4006-9d6d-c1c58d4e08f7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.341264 Oct 27 09:00:43.805118 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 158/330] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:43 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:43.819478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d8e63bdb-8286-447a-9faa-107a67b578c2 req-f84c5d73-c531-419c-b9a3-5b3d608ea908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198a8f18-762d-46b1-99ba-59c3af33cf74", "name": "network-vif-plugged", "status": "completed", "tag": "f06731c0-364a-4965-9db9-9c6e82c13ca5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:43.832710 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf2750fb-78fd-461e-906f-1c115a91597c tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.119485 Oct 27 09:00:43.841387 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 173/331] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:43 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:43.851335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:43.855357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d8e63bdb-8286-447a-9faa-107a67b578c2 req-f84c5d73-c531-419c-b9a3-5b3d608ea908 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:43.857572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:43.858752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d8e63bdb-8286-447a-9faa-107a67b578c2 req-f84c5d73-c531-419c-b9a3-5b3d608ea908 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:43.859319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d8e63bdb-8286-447a-9faa-107a67b578c2 req-f84c5d73-c531-419c-b9a3-5b3d608ea908 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:43.889990 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d8e63bdb-8286-447a-9faa-107a67b578c2 req-f84c5d73-c531-419c-b9a3-5b3d608ea908 service nova] Creating event network-vif-plugged:f06731c0-364a-4965-9db9-9c6e82c13ca5 for instance 198a8f18-762d-46b1-99ba-59c3af33cf74 on n-h2-858383-16 Oct 27 09:00:43.892020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:43.892543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:43.892982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:43.895005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:43.895534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:43.895706 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d8e63bdb-8286-447a-9faa-107a67b578c2 req-f84c5d73-c531-419c-b9a3-5b3d608ea908 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088390 Oct 27 09:00:43.896263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:43.896409 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 159/332] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:43.908262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c6024bf5-85e0-4040-83b6-3b21f34a634c tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-364885115"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:43.913275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-c6024bf5-85e0-4040-83b6-3b21f34a634c tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Generated uuid fb306f06-0acd-4f27-8d4d-769f91587d81 for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:43.960137 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c6024bf5-85e0-4040-83b6-3b21f34a634c tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057603 Oct 27 09:00:43.967548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 160/333] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:43.985868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1637436437"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:44.039472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:44.040391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:44.042069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:44.065090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:44.065904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:44.067381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:44.089271 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1637436437 could not be found. Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Request method failure captured: Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 58 Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWki10PkOuhx5_Z0NYkgCE0zgZik2gLpQQaqkIFMg9lV4TeCwnmbh2aSizNJJpdymW9N7TwLmXlb07_DqWNaO-2_kTl5e-_lPpuEhSCo7FyHjmbEUfETVpDLC_qH9c1bscP6Rha-XaTornUmnjWrcozU6V6lQoITWD_dUI0F968-uUSc Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1ee7431727348808d3f2861aec6f20e"}]}] Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c879c6de794c466fab596abd3cc82162 Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: {"add_host": {"host": "tempest-nonexist_host-1637436437"}} Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: exception: Compute host tempest-nonexist_host-1637436437 could not be found. Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1637436437'}}} Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1637436437' is not mapped to any cell Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 27 09:00:44.096885 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6623, in add_host_to_aggregate Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1637436437 could not be found. Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1637436437 could not be found. Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1637436437 could not be found. Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1637436437 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:44.100534 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bfd8aeb8-e404-431e-ba7f-cd94e612339b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.119869 Oct 27 09:00:44.104861 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 161/334] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:00:43 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:00:44.114673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:44.117309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:44.131594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:44.136501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:44.138064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:44.141590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:44.142507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:44.143024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:44.372246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:44.385658 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-17f822ef-62b2-4c7b-83f6-0f25c5916d05 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1470 microversion: 2.1 time: 0.542302 Oct 27 09:00:44.387318 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 174/335] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:43 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1470 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:44.398383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de42d251-da3c-461a-baae-8d3948598989 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:44.463232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de42d251-da3c-461a-baae-8d3948598989 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.073097 Oct 27 09:00:44.466467 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 175/336] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:44 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:44.474233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:44.480547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:44.498526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:44.499376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:44.500208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:44.501370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:44.502072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:44.502733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:44.758309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:44.777689 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7cf34c78-54de-4a1f-9b34-0d85a328c364 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1322 microversion: 2.1 time: 0.665609 Oct 27 09:00:44.794932 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 162/337] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:44 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1322 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:44.800126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9eb819ea-98e4-4afe-b75e-844548c08d7f tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9eb819ea-98e4-4afe-b75e-844548c08d7f tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Request method failure captured: Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 283 Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWki10PkOuhx5_Z0NYkgCE0zgZik2gLpQQaqkIFMg9lV4TeCwnmbh2aSizNJJpdymW9N7TwLmXlb07_DqWNaO-2_kTl5e-_lPpuEhSCo7FyHjmbEUfETVpDLC_qH9c1bscP6Rha-XaTornUmnjWrcozU6V6lQoITWD_dUI0F968-uUSc Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1ee7431727348808d3f2861aec6f20e"}]}] Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c879c6de794c466fab596abd3cc82162 Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.813355 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:00:44.819456 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:44.824806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9eb819ea-98e4-4afe-b75e-844548c08d7f tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:44.825915 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9eb819ea-98e4-4afe-b75e-844548c08d7f tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.029441 Oct 27 09:00:44.826505 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 163/338] 10.222.0.25 () {60 vars in 1165 bytes} [Thu Oct 27 09:00:44 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:44.836181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:44.837264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:44.840460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:44.861655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:44.862179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:44.862629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:44.863360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:44.863849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:44.864275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:44.930573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=86 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:45.197258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:45.215887 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ea45edb-97c7-48ad-a503-c868514e1894 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1320 microversion: 2.1 time: 0.745598 Oct 27 09:00:45.222608 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 176/339] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:44 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1320 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:45.262290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b47420a2-35b2-42e2-8757-a6d629dd6279 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b47420a2-35b2-42e2-8757-a6d629dd6279 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Request method failure captured: Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 27 Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki10PkOuhx5_Z0NYkgCE0zgZik2gLpQQaqkIFMg9lV4TeCwnmbh2aSizNJJpdymW9N7TwLmXlb07_DqWNaO-2_kTl5e-_lPpuEhSCo7FyHjmbEUfETVpDLC_qH9c1bscP6Rha-XaTornUmnjWrcozU6V6lQoITWD_dUI0F968-uUSc Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1ee7431727348808d3f2861aec6f20e"}]}] Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c879c6de794c466fab596abd3cc82162 Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: {"aggregate": {"name": ""}} Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '' Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:00:45.282732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:00:45.288579 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.291063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b47420a2-35b2-42e2-8757-a6d629dd6279 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:45.300672 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b47420a2-35b2-42e2-8757-a6d629dd6279 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.054844 Oct 27 09:00:45.302061 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 177/340] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:45 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:45.312977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34184f7b-43e2-43c7-94d4-cda46faf1475 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1577739662"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:45.318538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-34184f7b-43e2-43c7-94d4-cda46faf1475 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0687f6e12cab48f68b1f216d7a3001e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324279c4a4b24f5abac04c34e2b6e6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34184f7b-43e2-43c7-94d4-cda46faf1475 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Request method failure captured: Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 60 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki0BZA-uQmlXag3k2mK2QIfTSMf4O4AS2hpO_JBYazXTG_zQhtAYHhu9U-O01KNOkcFUJ6Jx3CysB7VPkuug6ecJg04UpagiltQ-CkEkkwZvDMeumBdi5OLw1p-ABeTcvgAuUYICyfs_LXKXHM72vvZ-iST4m_aCQW2vAGf0X7HPVs Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/324279c4a4b24f5abac04c34e2b6e6f0"}]}] Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0687f6e12cab48f68b1f216d7a3001e4 Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: {"aggregate": {"name": "tempest-test_aggregate-1577739662"}} Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1577739662'}}} Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:45.330154 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34184f7b-43e2-43c7-94d4-cda46faf1475 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34184f7b-43e2-43c7-94d4-cda46faf1475 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.023458 Oct 27 09:00:45.335018 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 178/341] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:45 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:45.380021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85fc8000-f238-4b9b-bb5d-d0a46536548e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2145567466"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:45.391430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.aggregate [None req-85fc8000-f238-4b9b-bb5d-d0a46536548e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Generated uuid 5735c465-a6d9-4e24-a744-45ec9eb6b730 for aggregate {{(pid=120602) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:45.435394 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85fc8000-f238-4b9b-bb5d-d0a46536548e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067456 Oct 27 09:00:45.436750 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 179/342] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:45.444611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:45.446244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:45.457785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:45.460135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:45.470324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:45.471668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:45.473069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:45.473859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:45.707207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:45.733891 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13a1fab8-4752-4067-b435-7dce01f963c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.901507 Oct 27 09:00:45.736003 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 164/343] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:44 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:45.746311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59ff8faa-a854-456b-8206-be6529452874 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2145567466"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:45.754661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-59ff8faa-a854-456b-8206-be6529452874 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Generated uuid 6804e01b-50aa-4654-8eea-54d94b72de88 for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:45.770625 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-59ff8faa-a854-456b-8206-be6529452874 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2145567466 already exists. Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59ff8faa-a854-456b-8206-be6529452874 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Request method failure captured: Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 60 Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWki10PkOuhx5_Z0NYkgCE0zgZik2gLpQQaqkIFMg9lV4TeCwnmbh2aSizNJJpdymW9N7TwLmXlb07_DqWNaO-2_kTl5e-_lPpuEhSCo7FyHjmbEUfETVpDLC_qH9c1bscP6Rha-XaTornUmnjWrcozU6V6lQoITWD_dUI0F968-uUSc Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1ee7431727348808d3f2861aec6f20e"}]}] Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c879c6de794c466fab596abd3cc82162 Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: {"aggregate": {"name": "tempest-test_aggregate-2145567466"}} Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: exception: Aggregate tempest-test_aggregate-2145567466 already exists. Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2145567466'}}} Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6460, in create_aggregate Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2145567466 already exists. Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:45.774003 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2145567466 already exists. Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2145567466 already exists. Oct 27 09:00:45.781553 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:45.786756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59ff8faa-a854-456b-8206-be6529452874 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2145567466 already exists. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:45.788634 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59ff8faa-a854-456b-8206-be6529452874 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.050936 Oct 27 09:00:45.798177 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 165/344] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:45 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:45.807292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1240d057-3aa3-4e05-8d2d-6fd005f354ad tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:45.848802 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1240d057-3aa3-4e05-8d2d-6fd005f354ad tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.047631 Oct 27 09:00:45.850200 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 166/345] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:45.860336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:45.860915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:45.867245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:45.867741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:45.868171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:45.869072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:45.869919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:45.870341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:45.905800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:45.945407 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61eab63a-4dbe-488d-98b8-a3f735f96862 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1470 microversion: 2.1 time: 0.507335 Oct 27 09:00:45.948244 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 180/346] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:45 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:45.970108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a367d9b5-8334-40c0-91c9-3d8647eb7ef7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-454824901"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:45.982045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.aggregate [None req-a367d9b5-8334-40c0-91c9-3d8647eb7ef7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Generated uuid 419f2911-cc9f-4dbe-b0bd-345322371ef3 for aggregate {{(pid=120602) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:46.060705 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a367d9b5-8334-40c0-91c9-3d8647eb7ef7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101115 Oct 27 09:00:46.064411 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 181/347] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:46.086664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2fbc3675-0773-4b1e-8302-55308094966c tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:46.094814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2fbc3675-0773-4b1e-8302-55308094966c tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0687f6e12cab48f68b1f216d7a3001e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324279c4a4b24f5abac04c34e2b6e6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2fbc3675-0773-4b1e-8302-55308094966c tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Request method failure captured: Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki0BZA-uQmlXag3k2mK2QIfTSMf4O4AS2hpO_JBYazXTG_zQhtAYHhu9U-O01KNOkcFUJ6Jx3CysB7VPkuug6ecJg04UpagiltQ-CkEkkwZvDMeumBdi5OLw1p-ABeTcvgAuUYICyfs_LXKXHM72vvZ-iST4m_aCQW2vAGf0X7HPVs Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/324279c4a4b24f5abac04c34e2b6e6f0"}]}] Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0687f6e12cab48f68b1f216d7a3001e4 Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '15'} Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.099401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.103025 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.103025 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:46.103025 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:46.103025 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 27 09:00:46.103025 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.103025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2fbc3675-0773-4b1e-8302-55308094966c tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:46.103025 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2fbc3675-0773-4b1e-8302-55308094966c tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.030449 Oct 27 09:00:46.105709 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 182/348] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:46 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:46.117608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08e56ca3-06d8-42e6-bb00-d7a917c63a59 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:46.184027 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08e56ca3-06d8-42e6-bb00-d7a917c63a59 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.072780 Oct 27 09:00:46.187559 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 183/349] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:46 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:46.205352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f5771d1-c6a3-401e-9f76-4a00958a057b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:46.274452 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-3f5771d1-c6a3-401e-9f76-4a00958a057b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f5771d1-c6a3-401e-9f76-4a00958a057b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Request method failure captured: Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki10PkOuhx5_Z0NYkgCE0zgZik2gLpQQaqkIFMg9lV4TeCwnmbh2aSizNJJpdymW9N7TwLmXlb07_DqWNaO-2_kTl5e-_lPpuEhSCo7FyHjmbEUfETVpDLC_qH9c1bscP6Rha-XaTornUmnjWrcozU6V6lQoITWD_dUI0F968-uUSc Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1ee7431727348808d3f2861aec6f20e"}]}] Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c879c6de794c466fab596abd3cc82162 Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: exception: Aggregate -1 could not be found. Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '-1'} Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.276184 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f5771d1-c6a3-401e-9f76-4a00958a057b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:46.283021 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f5771d1-c6a3-401e-9f76-4a00958a057b tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.082804 Oct 27 09:00:46.290489 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 184/350] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:46 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:46.298593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:46.299251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:46.317518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:46.342402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:46.344374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:46.346819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:46.347766 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ea8158b-c2fc-4479-b5da-a9d84a943b70 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1322 microversion: 2.1 time: 0.489643 Oct 27 09:00:46.349742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:46.351704 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 167/351] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:45 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:46.352402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:46.358252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:46.366948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee83b5c0-a53a-4fa4-8668-aa542fd4abd0 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1247450097"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:46.379981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-ee83b5c0-a53a-4fa4-8668-aa542fd4abd0 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Generated uuid a039d3e4-fed1-4073-93d4-352eeeb5794b for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:46.424501 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee83b5c0-a53a-4fa4-8668-aa542fd4abd0 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070403 Oct 27 09:00:46.425322 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 168/352] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:46.438167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0e2e66c-83f6-4f71-a605-22eb2f7f7372 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:46.448170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0e2e66c-83f6-4f71-a605-22eb2f7f7372 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0687f6e12cab48f68b1f216d7a3001e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324279c4a4b24f5abac04c34e2b6e6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0e2e66c-83f6-4f71-a605-22eb2f7f7372 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Request method failure captured: Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWki0BZA-uQmlXag3k2mK2QIfTSMf4O4AS2hpO_JBYazXTG_zQhtAYHhu9U-O01KNOkcFUJ6Jx3CysB7VPkuug6ecJg04UpagiltQ-CkEkkwZvDMeumBdi5OLw1p-ABeTcvgAuUYICyfs_LXKXHM72vvZ-iST4m_aCQW2vAGf0X7HPVs Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/324279c4a4b24f5abac04c34e2b6e6f0"}]}] Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0687f6e12cab48f68b1f216d7a3001e4 Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '16'} Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.457452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.461230 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.461230 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:46.461230 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:46.461230 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 27 09:00:46.461230 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.463031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0e2e66c-83f6-4f71-a605-22eb2f7f7372 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:46.464083 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0e2e66c-83f6-4f71-a605-22eb2f7f7372 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.030431 Oct 27 09:00:46.468714 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 169/353] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:46 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:46.473625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fabd2cc4-962f-41fd-8d45-e2dfcc844843 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:46.529046 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fabd2cc4-962f-41fd-8d45-e2dfcc844843 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.058930 Oct 27 09:00:46.530420 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 170/354] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:46 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:46.550485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90c9fe80-1bfc-4797-bd00-3e1b5b44d49e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:46.566554 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-90c9fe80-1bfc-4797-bd00-3e1b5b44d49e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90c9fe80-1bfc-4797-bd00-3e1b5b44d49e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Request method failure captured: Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWki10PkOuhx5_Z0NYkgCE0zgZik2gLpQQaqkIFMg9lV4TeCwnmbh2aSizNJJpdymW9N7TwLmXlb07_DqWNaO-2_kTl5e-_lPpuEhSCo7FyHjmbEUfETVpDLC_qH9c1bscP6Rha-XaTornUmnjWrcozU6V6lQoITWD_dUI0F968-uUSc Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1ee7431727348808d3f2861aec6f20e"}]}] Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c879c6de794c466fab596abd3cc82162 Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: exception: Aggregate -1 could not be found. Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '-1'} Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:46.568148 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90c9fe80-1bfc-4797-bd00-3e1b5b44d49e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-90c9fe80-1bfc-4797-bd00-3e1b5b44d49e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.033420 Oct 27 09:00:46.572426 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 171/355] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:00:46 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:00:46.594181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d086ac58-3992-462b-8980-893593c6c863 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:46.595700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d086ac58-3992-462b-8980-893593c6c863 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0687f6e12cab48f68b1f216d7a3001e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324279c4a4b24f5abac04c34e2b6e6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d086ac58-3992-462b-8980-893593c6c863 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Request method failure captured: Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWki0BZA-uQmlXag3k2mK2QIfTSMf4O4AS2hpO_JBYazXTG_zQhtAYHhu9U-O01KNOkcFUJ6Jx3CysB7VPkuug6ecJg04UpagiltQ-CkEkkwZvDMeumBdi5OLw1p-ABeTcvgAuUYICyfs_LXKXHM72vvZ-iST4m_aCQW2vAGf0X7HPVs Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/324279c4a4b24f5abac04c34e2b6e6f0"}]}] Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0687f6e12cab48f68b1f216d7a3001e4 Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: action_args: {} Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:46.597980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:46.601551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:46.601551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:46.601551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:46.601551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 27 09:00:46.601551 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:46.604783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d086ac58-3992-462b-8980-893593c6c863 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:46.606358 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d086ac58-3992-462b-8980-893593c6c863 tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016709 Oct 27 09:00:46.607077 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 172/356] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:00:46 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:46.623775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9fec3de4-0d76-4265-9a42-b93792164c1e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-677926957"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:46.630849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.aggregate [None req-9fec3de4-0d76-4265-9a42-b93792164c1e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Generated uuid 479a1568-ef10-4b05-b808-97b29b04950c for aggregate {{(pid=120603) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:46.669836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:46.682815 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9fec3de4-0d76-4265-9a42-b93792164c1e tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068351 Oct 27 09:00:46.684102 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 173/357] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:00:46.696578 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-291f9dbf-1ce4-47aa-a960-00f53d13c824 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1320 microversion: 2.1 time: 0.404843 Oct 27 09:00:46.698208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-254045e8-d734-4305-a493-dda773762315 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:46.698360 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 185/358] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:46 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:46.719943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-254045e8-d734-4305-a493-dda773762315 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:46.720882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-254045e8-d734-4305-a493-dda773762315 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:46.722204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-254045e8-d734-4305-a493-dda773762315 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:46.771507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:46.773230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:46.796071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:46.796827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:46.799391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:46.801456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:46.803199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:46.803854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:46.817549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:47.022497 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-254045e8-d734-4305-a493-dda773762315 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.329955 Oct 27 09:00:47.031757 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 174/359] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:00:46 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:00:47.038286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:47.039152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:47.057395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:47.058166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:47.058962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:47.062451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:47.063157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:47.064431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:47.066790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:47.077402 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d666f00-4d01-40f7-95d2-d56305f15f92 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.323745 Oct 27 09:00:47.081119 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 186/360] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:46 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:00:47.098541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4cb6f0fc-265b-46a2-8bf3-29e3cf63c26b tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:47.106988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4cb6f0fc-265b-46a2-8bf3-29e3cf63c26b tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0687f6e12cab48f68b1f216d7a3001e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324279c4a4b24f5abac04c34e2b6e6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4cb6f0fc-265b-46a2-8bf3-29e3cf63c26b tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Request method failure captured: Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 43 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki0BZA-uQmlXag3k2mK2QIfTSMf4O4AS2hpO_JBYazXTG_zQhtAYHhu9U-O01KNOkcFUJ6Jx3CysB7VPkuug6ecJg04UpagiltQ-CkEkkwZvDMeumBdi5OLw1p-ABeTcvgAuUYICyfs_LXKXHM72vvZ-iST4m_aCQW2vAGf0X7HPVs Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/324279c4a4b24f5abac04c34e2b6e6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/324279c4a4b24f5abac04c34e2b6e6f0"}]}] Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 324279c4a4b24f5abac04c34e2b6e6f0 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-447936494 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0687f6e12cab48f68b1f216d7a3001e4 Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-447936494-project Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: {"remove_host": {"host": "n-h1-858383-16"}} Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-858383-16'}}} Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 09:00:47.118138 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.122186 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:47.122186 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.122186 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:47.122186 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:47.122186 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:47.122186 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:47.122186 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:47.122186 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 27 09:00:47.122186 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.126746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4cb6f0fc-265b-46a2-8bf3-29e3cf63c26b tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:47.127862 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4cb6f0fc-265b-46a2-8bf3-29e3cf63c26b tempest-AggregatesAdminNegativeTestJSON-447936494 tempest-AggregatesAdminNegativeTestJSON-447936494-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.045686 Oct 27 09:00:47.130317 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 187/361] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:00:47 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:47.142487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a17069f3-d577-427b-a45c-7d0d4ab9dc4a tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:47.193712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:47.209289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17069f3-d577-427b-a45c-7d0d4ab9dc4a tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:47.221225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17069f3-d577-427b-a45c-7d0d4ab9dc4a tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:47.221840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17069f3-d577-427b-a45c-7d0d4ab9dc4a tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:47.442607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:47.454023 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bea90116-8800-4a52-b446-f0b63450a90b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1470 microversion: 2.1 time: 0.420880 Oct 27 09:00:47.455838 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 175/362] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:47 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1470 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:47.462086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:47.462850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:47.486212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:47.486930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:47.487529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:47.488272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:47.488733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:47.489153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:47.560676 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a17069f3-d577-427b-a45c-7d0d4ab9dc4a tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.424736 Oct 27 09:00:47.561770 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 188/363] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:00:47 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:47.576119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03f23b31-54e8-41a3-bfdb-30cfe3cada01 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:47.608020 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-03f23b31-54e8-41a3-bfdb-30cfe3cada01 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.038411 Oct 27 09:00:47.609565 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 189/364] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:47 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 27 09:00:47.624589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfbca01c-251d-428b-b5c3-49a908d3dcf1 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-882047406"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:47.632000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.aggregate [None req-cfbca01c-251d-428b-b5c3-49a908d3dcf1 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Generated uuid da36a946-e5fe-4e71-ad4c-0b4afaf832c5 for aggregate {{(pid=120602) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:00:47.695785 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cfbca01c-251d-428b-b5c3-49a908d3dcf1 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078125 Oct 27 09:00:47.698685 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 190/365] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:00:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:47.714836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:47.760730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:47.762197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:47.763007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:47.769939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:47.784193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:47.784921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:47.785527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:47.789747 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53e3ece2-7fa2-4e81-9713-71402bd46801 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1471 microversion: 2.1 time: 0.332555 Oct 27 09:00:47.791296 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 176/366] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:47 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1471 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:47.797252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:47.798268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:47.805134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:47.806122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:47.806951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:47.809637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:47.810349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:47.811168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:47.836548 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.compute.aggregates [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 27 09:00:47.839458 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Request method failure captured: Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 42 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki10PkOuhx5_Z0NYkgCE0zgZik2gLpQQaqkIFMg9lV4TeCwnmbh2aSizNJJpdymW9N7TwLmXlb07_DqWNaO-2_kTl5e-_lPpuEhSCo7FyHjmbEUfETVpDLC_qH9c1bscP6Rha-XaTornUmnjWrcozU6V6lQoITWD_dUI0F968-uUSc Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1ee7431727348808d3f2861aec6f20e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1ee7431727348808d3f2861aec6f20e"}]}] Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b1ee7431727348808d3f2861aec6f20e Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-709049691 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c879c6de794c466fab596abd3cc82162 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: {"remove_host": {"host": "nonexist_host"}} Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 27 09:00:47.843192 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6685, in remove_host_from_aggregate Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 27 09:00:47.846739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:47.856141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:47.857033 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f612755f-5ef7-4170-8df7-6083aa51beb2 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.150064 Oct 27 09:00:47.857597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 191/367] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:00:47 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:48.047092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:48.060327 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-beb72445-82fd-4157-b637-c852b009159e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1320 microversion: 2.1 time: 0.264036 Oct 27 09:00:48.080005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 177/368] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:47 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:48.087946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ecb2ece-b37e-4ab1-b8ad-5d0f1a551ec7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:48.164508 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ecb2ece-b37e-4ab1-b8ad-5d0f1a551ec7 tempest-AggregatesAdminNegativeTestJSON-709049691 tempest-AggregatesAdminNegativeTestJSON-709049691-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.082555 Oct 27 09:00:48.171874 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 178/369] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:00:48 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:00:48.183980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:48.185347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:48.198786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:48.199708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:48.200383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:48.201428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:48.202042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:48.202704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:48.251240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-941c0a52-da88-4062-b553-ff5068057d78 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:48.251854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-941c0a52-da88-4062-b553-ff5068057d78 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] [instance: 3569be37-4376-4be7-8a59-c4f9bcd3aba3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:48.261400 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-941c0a52-da88-4062-b553-ff5068057d78 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] HTTP exception thrown: Instance 3569be37-4376-4be7-8a59-c4f9bcd3aba3 could not be found. Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-941c0a52-da88-4062-b553-ff5068057d78 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Request method failure captured: Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/3569be37-4376-4be7-8a59-c4f9bcd3aba3/action HTTP/1.1 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 15 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkip-XYb9YKqU1j7pXaGSzEnCFlKjosEHw01Mh8FGFsdI2QVQBRPBHRgLM97makoEPe0T8rP2dilldM9BYXdDth9Zx_jJemv2vGZ7hb9qm-B3wAqg2s5li5eg9GJTaFt1tYvsXxczqRE5vdmsyLH9d9ONfnpkD8Gx_1yh91a7tHZsvc Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b2e3f837a0c14bfeb78a4bd61818d366"}]}] Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4709d6c65bcf4e8799e1d02bac1b6318 Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: {"migrate": {}} Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 3569be37-4376-4be7-8a59-c4f9bcd3aba3 could not be found. Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '3569be37-4376-4be7-8a59-c4f9bcd3aba3', 'body': {'migrate': {}}} Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3569be37-4376-4be7-8a59-c4f9bcd3aba3 could not be found. Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3569be37-4376-4be7-8a59-c4f9bcd3aba3 could not be found. Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:48.263831 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:48.268008 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:48.268008 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:48.268008 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:48.268008 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:48.268008 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3569be37-4376-4be7-8a59-c4f9bcd3aba3 could not be found. Oct 27 09:00:48.268008 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:48.268008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-941c0a52-da88-4062-b553-ff5068057d78 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Returning 404 to user: Instance 3569be37-4376-4be7-8a59-c4f9bcd3aba3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:48.268008 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-941c0a52-da88-4062-b553-ff5068057d78 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/3569be37-4376-4be7-8a59-c4f9bcd3aba3/action" status: 404 len: 111 microversion: 2.1 time: 0.402931 Oct 27 09:00:48.268612 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 192/370] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:00:47 2022] POST /compute/v2.1/servers/3569be37-4376-4be7-8a59-c4f9bcd3aba3/action => generated 111 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:48.397242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:48.408308 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9463bd03-fe41-43d8-a094-765c56322272 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.237004 Oct 27 09:00:48.411034 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 179/371] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:48 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:48.476592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:48.477536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:48.491148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:48.491972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:48.492491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:48.493425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:48.494465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:48.495214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:48.675540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-304939644", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:48.803822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:00:48.887542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:48.906307 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-160486ce-a779-4f65-931e-1ec9e9b4595d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1470 microversion: 2.1 time: 0.431147 Oct 27 09:00:48.924589 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 193/372] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:48 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1470 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:48.937548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-04ac0cb4-962d-4d4e-a6ea-0e9ae723601b req-4a6b3997-b974-4bce-8017-d47ad8c313ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5ae277-3562-4d0b-8169-2820971f9aa7", "name": "network-vif-unplugged", "status": "completed", "tag": "b09e8afc-87cf-4ace-af3f-18ab1dfab2b9"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:48.964889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-04ac0cb4-962d-4d4e-a6ea-0e9ae723601b req-4a6b3997-b974-4bce-8017-d47ad8c313ea service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:48.967816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-04ac0cb4-962d-4d4e-a6ea-0e9ae723601b req-4a6b3997-b974-4bce-8017-d47ad8c313ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:48.971626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-04ac0cb4-962d-4d4e-a6ea-0e9ae723601b req-4a6b3997-b974-4bce-8017-d47ad8c313ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:48.986627 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-04ac0cb4-962d-4d4e-a6ea-0e9ae723601b req-4a6b3997-b974-4bce-8017-d47ad8c313ea service nova] Creating event network-vif-unplugged:b09e8afc-87cf-4ace-af3f-18ab1dfab2b9 for instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 on n-h1-858383-16 Oct 27 09:00:48.995320 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-04ac0cb4-962d-4d4e-a6ea-0e9ae723601b req-4a6b3997-b974-4bce-8017-d47ad8c313ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081269 Oct 27 09:00:49.001826 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 194/373] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:49.089201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:49.091179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:49.099463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:49.100259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:49.100913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:49.101915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:49.102512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:49.103083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:49.310537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:00:49.311147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:00:49.312477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:00:49.313630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:00:49.314408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:00:49.332841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:49.333457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:49.333973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:49.337578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:49.338741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:49.339553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:49.376216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Getting quotas for project 0ca5eb57a6524b0daedc08c09cba2251. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:00:49.381687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Getting quotas for user fa798c1e8c8c445cb287ecc314c3b0ea and project 0ca5eb57a6524b0daedc08c09cba2251. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:00:49.391856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:49.394702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:00:49.397228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:00:49.399482 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-04a7d70e-af29-4b13-9a15-8b4e13b73d7e tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1320 microversion: 2.1 time: 0.316568 Oct 27 09:00:49.400071 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 195/374] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:49 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:00:49.473966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b41411ad-f497-43a2-bb21-09087e1fb0b4 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802035 Oct 27 09:00:49.475497 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 180/375] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:00:49.486676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:49.487920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:49.504353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:49.505764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:49.506295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:49.508149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:49.508683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:49.509120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:49.630982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00608382-9ccc-4617-bc0d-7cb64080ac1b tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-596500834", "ram": 512, "vcpus": 1, "disk": 10, "id": 2109684790, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:49.655719 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00608382-9ccc-4617-bc0d-7cb64080ac1b tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.250949 Oct 27 09:00:49.657061 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 196/376] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:00:49 2022] POST /compute/v2.1/flavors => generated 415 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:49.680597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-923d62a6-69c8-453b-a07f-a887614844f3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:49.682335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-923d62a6-69c8-453b-a07f-a887614844f3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:49.838747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-923d62a6-69c8-453b-a07f-a887614844f3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:49.849904 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-923d62a6-69c8-453b-a07f-a887614844f3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1221 microversion: 2.1 time: 0.187949 Oct 27 09:00:49.850824 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 197/377] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:49 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:49.924577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:49.938795 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebc3463d-7ae3-4bae-a30f-88ca5e40bbec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.460286 Oct 27 09:00:49.939546 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 181/378] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:49 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:49.967081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:49.971930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:50.000188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:50.000687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:50.001161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:50.001845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:50.002314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:50.002723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:50.288628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:50.300980 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9053adab-06dd-4a33-8012-e0816adc1899 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1470 microversion: 2.1 time: 0.360014 Oct 27 09:00:50.302491 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 182/379] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:49 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1470 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:50.374814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4d4be0a-81da-41a3-bbe1-e146667d7e23 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:50.384300 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d4d4be0a-81da-41a3-bbe1-e146667d7e23 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] HTTP exception thrown: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4d4be0a-81da-41a3-bbe1-e146667d7e23 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Request method failure captured: Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/flavors/2109684790/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki_sfRoj_XWEeoHvm6nxTQ-Cbx4ovxbGngGw-uvt93EbqKvOV-T1LfUgmxO2V9aRo5isKabl8vmOokj8XKNrAAEPWJed4RFfu_bRbstog5XcK0y5S4nYs528dAHjfvxKxM0R-1mto1ezdS8Zx5sb_OibV3402HcO93KTkhwJJq6ztQ Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 64033b1efef44df38f15de44ccd97efd Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64033b1efef44df38f15de44ccd97efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64033b1efef44df38f15de44ccd97efd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64033b1efef44df38f15de44ccd97efd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64033b1efef44df38f15de44ccd97efd"}]}] Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 64033b1efef44df38f15de44ccd97efd Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: f82111a57b7c4e0b9fce8a94d49cda3a Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: exception: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'flavor_id': '2109684790', 'id': 'hw:cpu_thread_policy'} Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. Oct 27 09:00:50.386331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.390089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4d4be0a-81da-41a3-bbe1-e146667d7e23 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Returning 404 to user: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:50.390089 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d4d4be0a-81da-41a3-bbe1-e146667d7e23 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] 10.222.0.25 "GET /compute/v2.1/flavors/2109684790/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.522947 Oct 27 09:00:50.393195 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 198/380] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:00:49 2022] GET /compute/v2.1/flavors/2109684790/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 541 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:50.419120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83f218b8-e2ef-4e9e-ae57-ee2ef5e43606 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:50.424009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83f218b8-e2ef-4e9e-ae57-ee2ef5e43606 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'f82111a57b7c4e0b9fce8a94d49cda3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64033b1efef44df38f15de44ccd97efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83f218b8-e2ef-4e9e-ae57-ee2ef5e43606 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Request method failure captured: Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/flavors/2109684790/os-extra_specs HTTP/1.1 Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 66 Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki_sfRoj_XWEeoHvm6nxTQ-Cbx4ovxbGngGw-uvt93EbqKvOV-T1LfUgmxO2V9aRo5isKabl8vmOokj8XKNrAAEPWJed4RFfu_bRbstog5XcK0y5S4nYs528dAHjfvxKxM0R-1mto1ezdS8Zx5sb_OibV3402HcO93KTkhwJJq6ztQ Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 64033b1efef44df38f15de44ccd97efd Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64033b1efef44df38f15de44ccd97efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64033b1efef44df38f15de44ccd97efd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64033b1efef44df38f15de44ccd97efd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64033b1efef44df38f15de44ccd97efd"}]}] Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 64033b1efef44df38f15de44ccd97efd Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: f82111a57b7c4e0b9fce8a94d49cda3a Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'flavor_id': '2109684790', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:50.425954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 27 09:00:50.429809 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.433659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83f218b8-e2ef-4e9e-ae57-ee2ef5e43606 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:50.434818 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83f218b8-e2ef-4e9e-ae57-ee2ef5e43606 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] 10.222.0.25 "POST /compute/v2.1/flavors/2109684790/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.028015 Oct 27 09:00:50.438553 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 199/381] 10.222.0.25 () {60 vars in 1224 bytes} [Thu Oct 27 09:00:50 2022] POST /compute/v2.1/flavors/2109684790/os-extra_specs => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:50.447362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:50.450832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:50.459201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:50.460037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:50.460840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:50.461934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:50.462650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:50.463343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:50.525444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5802eba2-b660-4bce-ade2-c924038324cd tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aaa3b280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-569030889", "description": "tempest-description-566679089"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:50.774210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:50.784620 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82f65a37-117a-4ef0-95ec-e1d8b61ebf84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1320 microversion: 2.1 time: 0.344897 Oct 27 09:00:50.800984 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 200/382] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:50 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:50.808929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-944e4ef4-1cd9-476a-8fe4-7724b83b535a tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:50.845630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-944e4ef4-1cd9-476a-8fe4-7724b83b535a tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2109684790/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041820 Oct 27 09:00:50.848285 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 201/383] 10.222.0.25 () {60 vars in 1224 bytes} [Thu Oct 27 09:00:50 2022] POST /compute/v2.1/flavors/2109684790/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:50.868510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fbfa6587-eb7e-42c2-bcb0-6dcba120c5c8 req-4bc43026-fae6-4050-9fad-6185f20112ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af487f27-d809-4419-b687-f4ed26103070", "name": "network-vif-plugged", "status": "completed", "tag": "5c3fff53-86cb-4c8e-b81d-2e2ca446d68a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:50.881405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fbfa6587-eb7e-42c2-bcb0-6dcba120c5c8 req-4bc43026-fae6-4050-9fad-6185f20112ee service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:50.882108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fbfa6587-eb7e-42c2-bcb0-6dcba120c5c8 req-4bc43026-fae6-4050-9fad-6185f20112ee service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:50.882737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fbfa6587-eb7e-42c2-bcb0-6dcba120c5c8 req-4bc43026-fae6-4050-9fad-6185f20112ee service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:50.898428 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fbfa6587-eb7e-42c2-bcb0-6dcba120c5c8 req-4bc43026-fae6-4050-9fad-6185f20112ee service nova] Creating event network-vif-plugged:5c3fff53-86cb-4c8e-b81d-2e2ca446d68a for instance af487f27-d809-4419-b687-f4ed26103070 on n-h2-858383-16 Oct 27 09:00:50.909724 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fbfa6587-eb7e-42c2-bcb0-6dcba120c5c8 req-4bc43026-fae6-4050-9fad-6185f20112ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057846 Oct 27 09:00:50.910497 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 202/384] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:50.919495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df26da1e-53e0-44f7-a956-3e990a091904 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:50.922455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df26da1e-53e0-44f7-a956-3e990a091904 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'f82111a57b7c4e0b9fce8a94d49cda3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64033b1efef44df38f15de44ccd97efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df26da1e-53e0-44f7-a956-3e990a091904 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Request method failure captured: Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWki_sfRoj_XWEeoHvm6nxTQ-Cbx4ovxbGngGw-uvt93EbqKvOV-T1LfUgmxO2V9aRo5isKabl8vmOokj8XKNrAAEPWJed4RFfu_bRbstog5XcK0y5S4nYs528dAHjfvxKxM0R-1mto1ezdS8Zx5sb_OibV3402HcO93KTkhwJJq6ztQ Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 64033b1efef44df38f15de44ccd97efd Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64033b1efef44df38f15de44ccd97efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64033b1efef44df38f15de44ccd97efd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64033b1efef44df38f15de44ccd97efd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64033b1efef44df38f15de44ccd97efd"}]}] Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 64033b1efef44df38f15de44ccd97efd Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: f82111a57b7c4e0b9fce8a94d49cda3a Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'flavor_id': '2109684790', 'id': 'hw:numa_nodes'} Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.924561 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:50.928059 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:50.928059 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:50.928059 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:50.928059 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:50.928059 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 27 09:00:50.928059 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:50.929231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df26da1e-53e0-44f7-a956-3e990a091904 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:50.931827 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-df26da1e-53e0-44f7-a956-3e990a091904 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018220 Oct 27 09:00:50.933930 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 203/385] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:00:50 2022] DELETE /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:50.941201 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5802eba2-b660-4bce-ade2-c924038324cd tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.637351 Oct 27 09:00:50.942039 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 183/386] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:00:50 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:50.945255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:50.945980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:50.954649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4e369f0-ba4b-4a42-a7c5-c74b18a5bb23 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:50.963992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:50.964651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:50.965650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:50.971464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:50.974118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:50.974575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:51.002477 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b4e369f0-ba4b-4a42-a7c5-c74b18a5bb23 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2109684790/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059184 Oct 27 09:00:51.003670 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 184/387] 10.222.0.25 () {60 vars in 1224 bytes} [Thu Oct 27 09:00:50 2022] POST /compute/v2.1/flavors/2109684790/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:00:51.009770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-774c5115-db47-4cbf-9e78-e1ea82f66429 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aaabea60>, body: {"security_group_rule": {"parent_group_id": "ad69227e-7d60-40df-aa0b-35c75a339e16", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:51.165268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:51.177264 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e9aa4ac5-824d-4272-a9e6-39f120e8ea3f tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1273 microversion: 2.1 time: 0.242246 Oct 27 09:00:51.177867 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 204/388] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:50 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:51.184057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:51.184774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:51.202904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:51.203394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:51.204065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:51.204956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:51.207296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:51.207867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:51.404595 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-774c5115-db47-4cbf-9e78-e1ea82f66429 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.399458 Oct 27 09:00:51.405354 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 185/389] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:00:51 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:51.421353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-adb22615-b0a0-453a-9ec3-cbbded3a332b tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:51.425080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-adb22615-b0a0-453a-9ec3-cbbded3a332b tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'f82111a57b7c4e0b9fce8a94d49cda3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64033b1efef44df38f15de44ccd97efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-adb22615-b0a0-453a-9ec3-cbbded3a332b tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Request method failure captured: Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: request: PUT /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 22 Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWki_sfRoj_XWEeoHvm6nxTQ-Cbx4ovxbGngGw-uvt93EbqKvOV-T1LfUgmxO2V9aRo5isKabl8vmOokj8XKNrAAEPWJed4RFfu_bRbstog5XcK0y5S4nYs528dAHjfvxKxM0R-1mto1ezdS8Zx5sb_OibV3402HcO93KTkhwJJq6ztQ Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 64033b1efef44df38f15de44ccd97efd Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64033b1efef44df38f15de44ccd97efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64033b1efef44df38f15de44ccd97efd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64033b1efef44df38f15de44ccd97efd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64033b1efef44df38f15de44ccd97efd"}]}] Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 64033b1efef44df38f15de44ccd97efd Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: f82111a57b7c4e0b9fce8a94d49cda3a Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: {"hw:numa_nodes": "1"} Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'flavor_id': '2109684790', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 09:00:51.427352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.431406 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:51.431406 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.431406 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:51.431406 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:51.431406 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:51.431406 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:51.431406 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:51.431406 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 27 09:00:51.431406 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.432872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-adb22615-b0a0-453a-9ec3-cbbded3a332b tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:51.434382 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-adb22615-b0a0-453a-9ec3-cbbded3a332b tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364 tempest-FlavorsExtraSpecsNegativeTestJSON-1146632364-project] 10.222.0.25 "PUT /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017754 Oct 27 09:00:51.435082 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 186/390] 10.222.0.25 () {60 vars in 1265 bytes} [Thu Oct 27 09:00:51 2022] PUT /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:51.441540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ca42a789-76c3-4265-8f30-798386065e03 req-8bcbf930-1798-4621-b839-8c0b6cd2b7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5ae277-3562-4d0b-8169-2820971f9aa7", "tag": "b09e8afc-87cf-4ace-af3f-18ab1dfab2b9"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:51.449511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:51.453006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ca42a789-76c3-4265-8f30-798386065e03 req-8bcbf930-1798-4621-b839-8c0b6cd2b7b5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:51.453496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ca42a789-76c3-4265-8f30-798386065e03 req-8bcbf930-1798-4621-b839-8c0b6cd2b7b5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:51.453923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ca42a789-76c3-4265-8f30-798386065e03 req-8bcbf930-1798-4621-b839-8c0b6cd2b7b5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:51.458547 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc38b260-4200-434f-850c-d120197ebcab tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.279628 Oct 27 09:00:51.460391 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 205/391] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:51 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:51.465820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:51.466500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:51.472753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:51.473294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:51.473952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:51.475331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:51.476089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:51.476705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:51.478654 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ca42a789-76c3-4265-8f30-798386065e03 req-8bcbf930-1798-4621-b839-8c0b6cd2b7b5 service nova] Creating event network-changed:b09e8afc-87cf-4ace-af3f-18ab1dfab2b9 for instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 on n-h1-858383-16 Oct 27 09:00:51.484727 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ca42a789-76c3-4265-8f30-798386065e03 req-8bcbf930-1798-4621-b839-8c0b6cd2b7b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047838 Oct 27 09:00:51.485962 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 187/392] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:51.492878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b1e5fd5-90e1-45cc-864c-317675ad3d0b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aa9f4430>, body: {"security_group_rule": {"parent_group_id": "ad69227e-7d60-40df-aa0b-35c75a339e16", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:51.641722 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-3b1e5fd5-90e1-45cc-864c-317675ad3d0b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] HTTP exception thrown: This rule already exists in group ad69227e-7d60-40df-aa0b-35c75a339e16 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b1e5fd5-90e1-45cc-864c-317675ad3d0b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Request method failure captured: Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 138 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjBOjf5RXGHWqiftKwyejny_ukMQ2solUonwVQrFcVdJ5s_pYi6ATrkJ1mappJMTmyQWBhKA_9fjnKzC6OFUSFF8eIfTPEtSvBZeCoDqc8sswAJk01Tj1f418l3Ef13eQ3EQdxbhzReQxGpNVz8g3pX7jfYJU3f8RoGe-HJpW1Df2s Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7dd58c369e1944f6a4d20f1334848d98"}]}] Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 82c7b263214b48fd9600df3934ce1ea8 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: {"security_group_rule": {"parent_group_id": "ad69227e-7d60-40df-aa0b-35c75a339e16", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: exception: This rule already exists in group ad69227e-7d60-40df-aa0b-35c75a339e16 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ad69227e-7d60-40df-aa0b-35c75a339e16', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group ad69227e-7d60-40df-aa0b-35c75a339e16 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group ad69227e-7d60-40df-aa0b-35c75a339e16 Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:51.645167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:51.649623 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:51.649623 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:51.649623 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group ad69227e-7d60-40df-aa0b-35c75a339e16 Oct 27 09:00:51.649623 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.651007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b1e5fd5-90e1-45cc-864c-317675ad3d0b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Returning 400 to user: This rule already exists in group ad69227e-7d60-40df-aa0b-35c75a339e16 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:51.652153 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b1e5fd5-90e1-45cc-864c-317675ad3d0b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.164358 Oct 27 09:00:51.655269 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 188/393] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:00:51 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:51.667124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3867cb31-c005-4c56-9e09-6fabd404e9d9 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:51.693637 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-3867cb31-c005-4c56-9e09-6fabd404e9d9 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] HTTP exception thrown: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3867cb31-c005-4c56-9e09-6fabd404e9d9 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Request method failure captured: Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/flavors/2109684790/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjBWmBabsNrVLCfshfUsx1fQw25pyUjaw_m1u53OKh_oJEk72KuV0ij98hzJeWUooz9JBsBUkjaO42alYG6vx7Iw2TSk4oDbxMBrD3FoCmwXNHTtiRgiGsUnj2Yq3Ym_YVB41BsOh18-h2ZiABFVLg_Vfi01040rhgNrpvwai-FMMw Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a45976b787ed403698a98b7661d00f99 Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a45976b787ed403698a98b7661d00f99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a45976b787ed403698a98b7661d00f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a45976b787ed403698a98b7661d00f99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a45976b787ed403698a98b7661d00f99"}]}] Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a45976b787ed403698a98b7661d00f99 Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 05ea32ff76c14f8ebe7918604c7a238f Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: exception: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'flavor_id': '2109684790', 'id': 'hw:cpu_thread_policy'} Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. Oct 27 09:00:51.695786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:51.701146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3867cb31-c005-4c56-9e09-6fabd404e9d9 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Returning 404 to user: Flavor 2109684790 has no extra specs with key hw:cpu_thread_policy. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:51.702102 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3867cb31-c005-4c56-9e09-6fabd404e9d9 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2109684790/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.045485 Oct 27 09:00:51.703114 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 189/394] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:00:51 2022] DELETE /compute/v2.1/flavors/2109684790/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:51.715918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca544b22-441e-4a31-915d-3639ef51e414 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Calling method '.version_select at 0x7f31aa9f4d30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:52.077165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:52.087864 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-65b90be8-80fa-496f-8489-ee5b3489fc74 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.626247 Oct 27 09:00:52.091848 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 206/395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:51 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:52.103045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1876ab07-2660-4dcd-ba41-9c6a64fea870 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:52.107465 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-1876ab07-2660-4dcd-ba41-9c6a64fea870 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1876ab07-2660-4dcd-ba41-9c6a64fea870 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Request method failure captured: Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 27 Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjBWmBabsNrVLCfshfUsx1fQw25pyUjaw_m1u53OKh_oJEk72KuV0ij98hzJeWUooz9JBsBUkjaO42alYG6vx7Iw2TSk4oDbxMBrD3FoCmwXNHTtiRgiGsUnj2Yq3Ym_YVB41BsOh18-h2ZiABFVLg_Vfi01040rhgNrpvwai-FMMw Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a45976b787ed403698a98b7661d00f99 Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a45976b787ed403698a98b7661d00f99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a45976b787ed403698a98b7661d00f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a45976b787ed403698a98b7661d00f99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a45976b787ed403698a98b7661d00f99"}]}] Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a45976b787ed403698a98b7661d00f99 Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 05ea32ff76c14f8ebe7918604c7a238f Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: {"hw:cpu_policy": "shared"} Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: exception: Request body and URI mismatch Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'flavor_id': '2109684790', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 27 09:00:52.124753 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.129348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1876ab07-2660-4dcd-ba41-9c6a64fea870 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:52.135868 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1876ab07-2660-4dcd-ba41-9c6a64fea870 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.042603 Oct 27 09:00:52.137025 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 207/396] 10.222.0.25 () {60 vars in 1265 bytes} [Thu Oct 27 09:00:52 2022] PUT /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes => generated 73 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:00:52.147490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:52.148285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:52.161049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:52.163987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:52.164689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:52.165772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:52.169578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:52.170201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:52.177686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:52.408302 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca544b22-441e-4a31-915d-3639ef51e414 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/cfa38cc4-38dc-43e2-bdeb-0b5dbeb8039a" status: 202 len: 0 microversion: 2.1 time: 0.703781 Oct 27 09:00:52.408872 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 190/397] 10.222.0.25 () {58 vars in 1287 bytes} [Thu Oct 27 09:00:51 2022] DELETE /compute/v2.1/os-security-group-rules/cfa38cc4-38dc-43e2-bdeb-0b5dbeb8039a => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:52.414798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa276cac-96e9-4a30-8b2b-41f31caa6f95 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa276cac-96e9-4a30-8b2b-41f31caa6f95 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Request method failure captured: Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: request: PUT /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 49 Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjBWmBabsNrVLCfshfUsx1fQw25pyUjaw_m1u53OKh_oJEk72KuV0ij98hzJeWUooz9JBsBUkjaO42alYG6vx7Iw2TSk4oDbxMBrD3FoCmwXNHTtiRgiGsUnj2Yq3Ym_YVB41BsOh18-h2ZiABFVLg_Vfi01040rhgNrpvwai-FMMw Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a45976b787ed403698a98b7661d00f99 Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a45976b787ed403698a98b7661d00f99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a45976b787ed403698a98b7661d00f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a45976b787ed403698a98b7661d00f99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a45976b787ed403698a98b7661d00f99"}]}] Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a45976b787ed403698a98b7661d00f99 Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 05ea32ff76c14f8ebe7918604c7a238f Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'flavor_id': '2109684790', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance: Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:00:52.425340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 27 09:00:52.429199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:52.431049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa276cac-96e9-4a30-8b2b-41f31caa6f95 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:52.432179 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa276cac-96e9-4a30-8b2b-41f31caa6f95 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.021855 Oct 27 09:00:52.442871 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 191/398] 10.222.0.25 () {60 vars in 1265 bytes} [Thu Oct 27 09:00:52 2022] PUT /compute/v2.1/flavors/2109684790/os-extra_specs/hw:numa_nodes => generated 117 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:52.448570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:52.449360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:52.457445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:52.457999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:52.459041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:52.459970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:52.460551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:52.462355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:52.597727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:52.606879 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a00f91e1-0f57-4a1e-ae25-ff4a6bb26f77 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1279 microversion: 2.1 time: 0.162884 Oct 27 09:00:52.607849 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 192/399] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:52 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:52.613623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8158bdb0-bfd9-4546-8d76-61c45c764ac4 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aa9b95e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1122804082", "description": "tempest-description-838030814"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:52.735208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:52.745673 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d40fa978-3556-4098-9be7-5419e46e225b tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1320 microversion: 2.1 time: 0.607223 Oct 27 09:00:52.747561 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 208/400] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:52 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1320 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:52.770597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-04c1690f-cae7-4381-8084-dc1416728e40 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:52.800871 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-04c1690f-cae7-4381-8084-dc1416728e40 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2109684790" status: 202 len: 0 microversion: 2.1 time: 0.048992 Oct 27 09:00:52.803202 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 209/401] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 09:00:52 2022] DELETE /compute/v2.1/flavors/2109684790 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:52.810809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:52.811866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:52.818419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:52.819247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:52.819933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:52.820933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:52.822250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:52.822888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:53.199489 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8158bdb0-bfd9-4546-8d76-61c45c764ac4 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.589803 Oct 27 09:00:53.201076 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 193/402] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:00:52 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:53.205944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10e610d8-68d3-481d-af0b-d202e1ef821a tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:53.249914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:53.257653 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10e610d8-68d3-481d-af0b-d202e1ef821a tempest-FlavorsExtraSpecsNegativeTestJSON-785287625 tempest-FlavorsExtraSpecsNegativeTestJSON-785287625-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.055202 Oct 27 09:00:53.258251 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 194/403] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:00:53 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:53.268712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:53.276200 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2aad6682-dbe9-4f92-80ea-e5dd5f1501e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.470629 Oct 27 09:00:53.277678 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 210/404] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:52 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:53.282571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9d0e1a8-791e-4428-b3b8-0d905d7d95fe tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aad20ee0>, body: {"security_group_rule": {"parent_group_id": "7b73403d-7d0a-49e4-ba98-6249f3c4995c", "ip_protocol": "tcp", "from_port": 354351057, "to_port": 22}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:53.288082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:53.316598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:53.317117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:53.317571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:53.318300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:53.318765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:53.319193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:53.531844 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-b9d0e1a8-791e-4428-b3b8-0d905d7d95fe tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] HTTP exception thrown: Invalid port range 354351057:22. Former value cannot be greater than the later Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9d0e1a8-791e-4428-b3b8-0d905d7d95fe tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Request method failure captured: Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 145 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjBOjf5RXGHWqiftKwyejny_ukMQ2solUonwVQrFcVdJ5s_pYi6ATrkJ1mappJMTmyQWBhKA_9fjnKzC6OFUSFF8eIfTPEtSvBZeCoDqc8sswAJk01Tj1f418l3Ef13eQ3EQdxbhzReQxGpNVz8g3pX7jfYJU3f8RoGe-HJpW1Df2s Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7dd58c369e1944f6a4d20f1334848d98"}]}] Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 82c7b263214b48fd9600df3934ce1ea8 Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: {"security_group_rule": {"parent_group_id": "7b73403d-7d0a-49e4-ba98-6249f3c4995c", "ip_protocol": "tcp", "from_port": 354351057, "to_port": 22}} Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid port range 354351057:22. Former value cannot be greater than the later Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7b73403d-7d0a-49e4-ba98-6249f3c4995c', 'ip_protocol': 'tcp', 'from_port': 354351057, 'to_port': 22}}} Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 354351057:22. Former value cannot be greater than the later Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 354351057:22. Former value cannot be greater than the later Oct 27 09:00:53.534052 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 354351057:22. Former value cannot be greater than the later Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9d0e1a8-791e-4428-b3b8-0d905d7d95fe tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Returning 400 to user: Invalid port range 354351057:22. Former value cannot be greater than the later {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9d0e1a8-791e-4428-b3b8-0d905d7d95fe tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.256682 Oct 27 09:00:53.539357 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 211/405] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:00:53 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:53.545674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08c7a1c1-9b14-4055-b1f0-e0ed9d88de34 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aadd4160>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2070970543", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:53.548744 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-08c7a1c1-9b14-4055-b1f0-e0ed9d88de34 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] HTTP exception thrown: Security group id should be uuid Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08c7a1c1-9b14-4055-b1f0-e0ed9d88de34 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Request method failure captured: Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 131 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjBOjf5RXGHWqiftKwyejny_ukMQ2solUonwVQrFcVdJ5s_pYi6ATrkJ1mappJMTmyQWBhKA_9fjnKzC6OFUSFF8eIfTPEtSvBZeCoDqc8sswAJk01Tj1f418l3Ef13eQ3EQdxbhzReQxGpNVz8g3pX7jfYJU3f8RoGe-HJpW1Df2s Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7dd58c369e1944f6a4d20f1334848d98"}]}] Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 82c7b263214b48fd9600df3934ce1ea8 Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2070970543", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: exception: Security group id should be uuid Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2070970543', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:53.550464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:53.554299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 27 09:00:53.554299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:53.563920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08c7a1c1-9b14-4055-b1f0-e0ed9d88de34 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Returning 400 to user: Security group id should be uuid {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:53.565376 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08c7a1c1-9b14-4055-b1f0-e0ed9d88de34 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.023308 Oct 27 09:00:53.568426 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 212/406] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:00:53 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:00:53.583457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-baebaaa4-b294-4dc2-89a0-7c958e7db372 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aadd4280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1737342601", "description": "tempest-description-569959774"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:53.783710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:53.796433 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-580dfd1c-af88-422f-8544-eacf48f45287 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.530710 Oct 27 09:00:53.798648 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 195/407] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:53 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:53.808992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:53.810029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:53.826612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:53.828052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:53.828924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:53.832914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:53.834761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:53.836281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:54.303223 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-baebaaa4-b294-4dc2-89a0-7c958e7db372 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.731521 Oct 27 09:00:54.309607 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 213/408] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:00:53 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:54.315595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:54.316198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:54.322827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:54.323445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:54.324004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:54.326072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:54.326989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:54.327647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:54.373996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:54.382106 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79bc71c2-35c1-41ad-968e-655b8d613ba6 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1321 microversion: 2.1 time: 0.582153 Oct 27 09:00:54.382754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 196/409] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:53 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:54.389211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ff852074-3e5e-493b-a87a-ff8f35df4606 req-ddafc193-8e00-4aaa-955f-5fbbb77e0385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087a0506-c4be-47ba-b65b-1ac5b4e5876a", "tag": "efb56077-da50-492a-a1f0-04144bd014e4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:54.399066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ff852074-3e5e-493b-a87a-ff8f35df4606 req-ddafc193-8e00-4aaa-955f-5fbbb77e0385 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:54.399796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ff852074-3e5e-493b-a87a-ff8f35df4606 req-ddafc193-8e00-4aaa-955f-5fbbb77e0385 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:54.400369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ff852074-3e5e-493b-a87a-ff8f35df4606 req-ddafc193-8e00-4aaa-955f-5fbbb77e0385 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:54.413882 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ff852074-3e5e-493b-a87a-ff8f35df4606 req-ddafc193-8e00-4aaa-955f-5fbbb77e0385 service nova] Creating event network-changed:efb56077-da50-492a-a1f0-04144bd014e4 for instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a on n-h1-858383-16 Oct 27 09:00:54.420327 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ff852074-3e5e-493b-a87a-ff8f35df4606 req-ddafc193-8e00-4aaa-955f-5fbbb77e0385 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036214 Oct 27 09:00:54.421488 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 197/410] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:54.427807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:54.428685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:54.435132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:54.440772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:54.442433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:54.444315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:54.444941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:54.445716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:54.491265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=6,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:54.585893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:54.596924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a86f04b8-887f-4223-9cbb-796421bc1680 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1470 microversion: 2.1 time: 0.286096 Oct 27 09:00:54.597766 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 214/411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:54 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1470 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:54.616949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23c5a47c-9707-4c45-9a7b-7f4ea7fe761e tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aaae8b80>, body: {"security_group_rule": {"parent_group_id": "1ca46e90-a608-4e96-97d4-9bfe5f4bc5c1", "ip_protocol": "tempest-999-1382283846", "from_port": 22, "to_port": 22}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:54.732153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:54.742960 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6fbe861-4c41-493b-aa81-c08b14037110 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.320011 Oct 27 09:00:54.743866 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 198/412] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:54 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:54.762991 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-23c5a47c-9707-4c45-9a7b-7f4ea7fe761e tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] HTTP exception thrown: Invalid IP protocol tempest-999-1382283846. Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23c5a47c-9707-4c45-9a7b-7f4ea7fe761e tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Request method failure captured: Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 157 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjBOjf5RXGHWqiftKwyejny_ukMQ2solUonwVQrFcVdJ5s_pYi6ATrkJ1mappJMTmyQWBhKA_9fjnKzC6OFUSFF8eIfTPEtSvBZeCoDqc8sswAJk01Tj1f418l3Ef13eQ3EQdxbhzReQxGpNVz8g3pX7jfYJU3f8RoGe-HJpW1Df2s Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7dd58c369e1944f6a4d20f1334848d98"}]}] Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 82c7b263214b48fd9600df3934ce1ea8 Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: {"security_group_rule": {"parent_group_id": "1ca46e90-a608-4e96-97d4-9bfe5f4bc5c1", "ip_protocol": "tempest-999-1382283846", "from_port": 22, "to_port": 22}} Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid IP protocol tempest-999-1382283846. Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1ca46e90-a608-4e96-97d4-9bfe5f4bc5c1', 'ip_protocol': 'tempest-999-1382283846', 'from_port': 22, 'to_port': 22}}} Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1382283846. Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1382283846. Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:54.764911 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:54.768354 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:54.768354 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:54.768354 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:54.768354 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:54.768354 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:54.768354 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:54.768354 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1382283846. Oct 27 09:00:54.768354 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:54.770482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23c5a47c-9707-4c45-9a7b-7f4ea7fe761e tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Returning 400 to user: Invalid IP protocol tempest-999-1382283846. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:54.772489 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23c5a47c-9707-4c45-9a7b-7f4ea7fe761e tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.171875 Oct 27 09:00:54.774008 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 215/413] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:00:54 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:00:54.778710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c60a02de-a066-409c-acf4-19cbdebcb9cd tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:54.785689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c60a02de-a066-409c-acf4-19cbdebcb9cd tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:54.786648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89c47189-a49f-4eaf-97d8-6c5dab6fce53 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aad20c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-257812798", "description": "tempest-description-1691202194"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:54.812077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a02de-a066-409c-acf4-19cbdebcb9cd tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:54.816639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a02de-a066-409c-acf4-19cbdebcb9cd tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:54.817341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a02de-a066-409c-acf4-19cbdebcb9cd tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:54.818916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a02de-a066-409c-acf4-19cbdebcb9cd tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:54.819806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a02de-a066-409c-acf4-19cbdebcb9cd tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:54.821652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a02de-a066-409c-acf4-19cbdebcb9cd tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.008296 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c60a02de-a066-409c-acf4-19cbdebcb9cd tempest-DeleteServersAdminTestJSON-580932760 tempest-DeleteServersAdminTestJSON-580932760-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070/action" status: 202 len: 0 microversion: 2.1 time: 0.245234 Oct 27 09:00:55.009443 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 199/414] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:00:54 2022] POST /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:55.022215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:55.024238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:55.066897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.068483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.070622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.072632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.074619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.076588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.175409 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-89c47189-a49f-4eaf-97d8-6c5dab6fce53 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.395955 Oct 27 09:00:55.184849 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 216/415] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:00:54 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:55.190578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:55.191498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:55.199337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.200866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.202174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.203119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.205600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.205600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.242894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.243629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.244321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.245252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lazy-loading 'fault' on Instance uuid af487f27-d809-4419-b687-f4ed26103070 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:00:55.469536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:55.480858 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1bb4df8d-2abd-4582-9b3e-d17cc7a8bfe8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.469642 Oct 27 09:00:55.481442 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 200/416] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:55 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:55.486256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-344cc294-7a22-48df-9b20-1f185f186445 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aaa05a60>, body: {"security_group_rule": {"parent_group_id": "ad27a501-793b-4256-bd5a-25247230fee1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:55.596645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:55.614025 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3770f29b-0a67-4953-9a97-4a9cd368909a tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1453 microversion: 2.1 time: 0.426272 Oct 27 09:00:55.616134 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 217/417] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:55 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1453 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:55.624587 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-344cc294-7a22-48df-9b20-1f185f186445 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-344cc294-7a22-48df-9b20-1f185f186445 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Request method failure captured: Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 138 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjBOjf5RXGHWqiftKwyejny_ukMQ2solUonwVQrFcVdJ5s_pYi6ATrkJ1mappJMTmyQWBhKA_9fjnKzC6OFUSFF8eIfTPEtSvBZeCoDqc8sswAJk01Tj1f418l3Ef13eQ3EQdxbhzReQxGpNVz8g3pX7jfYJU3f8RoGe-HJpW1Df2s Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7dd58c369e1944f6a4d20f1334848d98"}]}] Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 82c7b263214b48fd9600df3934ce1ea8 Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: {"security_group_rule": {"parent_group_id": "ad27a501-793b-4256-bd5a-25247230fee1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ad27a501-793b-4256-bd5a-25247230fee1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 09:00:55.626225 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-344cc294-7a22-48df-9b20-1f185f186445 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-344cc294-7a22-48df-9b20-1f185f186445 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.145065 Oct 27 09:00:55.629972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 201/418] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:00:55 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:55.642643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:55.643491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:55.652277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:55.654700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:55.655730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.656294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.657769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.658916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.659470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.660575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.668759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.669384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.669898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.670910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.671509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.672073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.713839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:00:55.827847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:55.854718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:55.878401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31c38f81-086e-4690-8405-957e37e5556a tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1321 microversion: 2.1 time: 0.259715 Oct 27 09:00:55.879068 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 218/419] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:55 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:55.888946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-283afd21-b676-4e04-9d68-b95e2dcdf8f0 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aad20a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-602161060", "description": "tempest-description-1381810544"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:55.905264 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7720211-26d8-431a-b8c7-0f72dc760feb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 204 len: 0 microversion: 2.1 time: 0.253500 Oct 27 09:00:55.913781 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 202/420] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:00:55 2022] DELETE /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:00:55.947278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:55.953713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:55.963838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.964434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.965069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:55.965788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:55.966406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:55.966841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:56.119628 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-283afd21-b676-4e04-9d68-b95e2dcdf8f0 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.234616 Oct 27 09:00:56.121364 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 219/421] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:00:55 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:56.126425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:56.127019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:56.136339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:56.136827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:56.137263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:56.141903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:56.142951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:56.143393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:56.185286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:56.185913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:56.186349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:56.186800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lazy-loading 'fault' on Instance uuid af487f27-d809-4419-b687-f4ed26103070 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:00:56.234363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:56.242913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8409d9ac-9e81-4b40-8617-b83faf4ff7d5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.327481 Oct 27 09:00:56.255766 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 203/422] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:55 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:56.264886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eac02f11-15c1-4f4c-a214-3e6377c18bdd tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aaabea60>, body: {"security_group_rule": {"parent_group_id": "ab716c01-c612-49bd-b61e-c891ab6a56b5", "ip_protocol": "tcp", "from_port": 22, "to_port": 173840525}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:56.340953 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-eac02f11-15c1-4f4c-a214-3e6377c18bdd tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] HTTP exception thrown: Invalid port range 22:173840525. Valid TCP ports should be between 1-65535 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eac02f11-15c1-4f4c-a214-3e6377c18bdd tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Request method failure captured: Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 145 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjBOjf5RXGHWqiftKwyejny_ukMQ2solUonwVQrFcVdJ5s_pYi6ATrkJ1mappJMTmyQWBhKA_9fjnKzC6OFUSFF8eIfTPEtSvBZeCoDqc8sswAJk01Tj1f418l3Ef13eQ3EQdxbhzReQxGpNVz8g3pX7jfYJU3f8RoGe-HJpW1Df2s Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7dd58c369e1944f6a4d20f1334848d98"}]}] Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 82c7b263214b48fd9600df3934ce1ea8 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: {"security_group_rule": {"parent_group_id": "ab716c01-c612-49bd-b61e-c891ab6a56b5", "ip_protocol": "tcp", "from_port": 22, "to_port": 173840525}} Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid port range 22:173840525. Valid TCP ports should be between 1-65535 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ab716c01-c612-49bd-b61e-c891ab6a56b5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 173840525}}} Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:173840525. Valid TCP ports should be between 1-65535 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:173840525. Valid TCP ports should be between 1-65535 Oct 27 09:00:56.344356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.348646 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:56.348646 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.348646 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.348646 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:56.348646 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:56.348646 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:56.348646 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:56.348646 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:173840525. Valid TCP ports should be between 1-65535 Oct 27 09:00:56.348646 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.351242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eac02f11-15c1-4f4c-a214-3e6377c18bdd tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Returning 400 to user: Invalid port range 22:173840525. Valid TCP ports should be between 1-65535 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:56.352577 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eac02f11-15c1-4f4c-a214-3e6377c18bdd tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.096629 Oct 27 09:00:56.353957 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 204/423] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:00:56 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:00:56.368740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96bd185e-4858-416a-bee1-ac378eef508b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Action: 'create', calling method: .version_select at 0x7f31aa9b9310>, body: {"security_group_rule": {"parent_group_id": "c62b08d8-75a3-4349-820d-192dec195ba2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:56.405147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:56.415714 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-293e1c85-bf1e-4622-98c5-6f6d6d713c08 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1459 microversion: 2.1 time: 0.292981 Oct 27 09:00:56.416176 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 220/424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:56 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1459 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:56.416291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-96bd185e-4858-416a-bee1-ac378eef508b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c62b08d8-75a3-4349-820d-192dec195ba2 does not exist", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:00:56.416933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.security_group_api [None req-96bd185e-4858-416a-bee1-ac378eef508b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Neutron security group c62b08d8-75a3-4349-820d-192dec195ba2 not found {{(pid=120603) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:00:56.418969 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-96bd185e-4858-416a-bee1-ac378eef508b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] HTTP exception thrown: Security group c62b08d8-75a3-4349-820d-192dec195ba2 does not exist Oct 27 09:00:56.418969 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-cc779710-ec8a-48da-ad33-6eb2eb672ac4'] Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96bd185e-4858-416a-bee1-ac378eef508b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Request method failure captured: Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 138 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjBOjf5RXGHWqiftKwyejny_ukMQ2solUonwVQrFcVdJ5s_pYi6ATrkJ1mappJMTmyQWBhKA_9fjnKzC6OFUSFF8eIfTPEtSvBZeCoDqc8sswAJk01Tj1f418l3Ef13eQ3EQdxbhzReQxGpNVz8g3pX7jfYJU3f8RoGe-HJpW1Df2s Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7dd58c369e1944f6a4d20f1334848d98"}]}] Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 82c7b263214b48fd9600df3934ce1ea8 Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: {"security_group_rule": {"parent_group_id": "c62b08d8-75a3-4349-820d-192dec195ba2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: exception: Security group c62b08d8-75a3-4349-820d-192dec195ba2 does not exist Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-cc779710-ec8a-48da-ad33-6eb2eb672ac4'] Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c62b08d8-75a3-4349-820d-192dec195ba2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:00:56.432681 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c62b08d8-75a3-4349-820d-192dec195ba2 does not exist Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc779710-ec8a-48da-ad33-6eb2eb672ac4'] Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c62b08d8-75a3-4349-820d-192dec195ba2 does not exist Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc779710-ec8a-48da-ad33-6eb2eb672ac4'] Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c62b08d8-75a3-4349-820d-192dec195ba2 does not exist Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc779710-ec8a-48da-ad33-6eb2eb672ac4'] Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c62b08d8-75a3-4349-820d-192dec195ba2 does not exist Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc779710-ec8a-48da-ad33-6eb2eb672ac4'] Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96bd185e-4858-416a-bee1-ac378eef508b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Returning 404 to user: Security group c62b08d8-75a3-4349-820d-192dec195ba2 does not exist Oct 27 09:00:56.436870 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-cc779710-ec8a-48da-ad33-6eb2eb672ac4'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:56.439447 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96bd185e-4858-416a-bee1-ac378eef508b tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.076098 Oct 27 09:00:56.439447 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 205/425] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:00:56 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:56.453819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9d41b908-74a9-4c68-91ad-f3b86d42db05 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Calling method '.version_select at 0x7f31aaa22c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:56.489813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-9d41b908-74a9-4c68-91ad-f3b86d42db05 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule d2761b63-675c-49b3-8b27-cf9824040463 does not exist", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:00:56.490473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.security_group_api [None req-9d41b908-74a9-4c68-91ad-f3b86d42db05 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Neutron security group rule d2761b63-675c-49b3-8b27-cf9824040463 not found {{(pid=120602) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 27 09:00:56.491322 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9d41b908-74a9-4c68-91ad-f3b86d42db05 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] HTTP exception thrown: Security group rule d2761b63-675c-49b3-8b27-cf9824040463 does not exist Oct 27 09:00:56.491322 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-7de885ea-a648-489f-9a6d-2442b1ef0b86'] Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9d41b908-74a9-4c68-91ad-f3b86d42db05 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Request method failure captured: Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-security-group-rules/d2761b63-675c-49b3-8b27-cf9824040463 HTTP/1.1 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjBOjf5RXGHWqiftKwyejny_ukMQ2solUonwVQrFcVdJ5s_pYi6ATrkJ1mappJMTmyQWBhKA_9fjnKzC6OFUSFF8eIfTPEtSvBZeCoDqc8sswAJk01Tj1f418l3Ef13eQ3EQdxbhzReQxGpNVz8g3pX7jfYJU3f8RoGe-HJpW1Df2s Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7dd58c369e1944f6a4d20f1334848d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7dd58c369e1944f6a4d20f1334848d98"}]}] Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7dd58c369e1944f6a4d20f1334848d98 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 82c7b263214b48fd9600df3934ce1ea8 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: exception: Security group rule d2761b63-675c-49b3-8b27-cf9824040463 does not exist Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-7de885ea-a648-489f-9a6d-2442b1ef0b86'] Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd2761b63-675c-49b3-8b27-cf9824040463'} Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:00:56.496852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule d2761b63-675c-49b3-8b27-cf9824040463 does not exist Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7de885ea-a648-489f-9a6d-2442b1ef0b86'] Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule d2761b63-675c-49b3-8b27-cf9824040463 does not exist Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7de885ea-a648-489f-9a6d-2442b1ef0b86'] Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule d2761b63-675c-49b3-8b27-cf9824040463 does not exist Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7de885ea-a648-489f-9a6d-2442b1ef0b86'] Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule d2761b63-675c-49b3-8b27-cf9824040463 does not exist Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7de885ea-a648-489f-9a6d-2442b1ef0b86'] Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9d41b908-74a9-4c68-91ad-f3b86d42db05 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Returning 404 to user: Security group rule d2761b63-675c-49b3-8b27-cf9824040463 does not exist Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-7de885ea-a648-489f-9a6d-2442b1ef0b86'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:56.502416 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9d41b908-74a9-4c68-91ad-f3b86d42db05 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/d2761b63-675c-49b3-8b27-cf9824040463" status: 404 len: 199 microversion: 2.1 time: 0.048603 Oct 27 09:00:56.507589 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 221/426] 10.222.0.25 () {58 vars in 1287 bytes} [Thu Oct 27 09:00:56 2022] DELETE /compute/v2.1/os-security-group-rules/d2761b63-675c-49b3-8b27-cf9824040463 => generated 199 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:56.510951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4164d34b-9b6b-44b3-86ac-0b23789604bc tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Calling method '.version_select at 0x7f31aa8da3a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:56.511651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:56.512759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:56.520641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:56.524769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:56.525439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:56.528377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:56.529968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:56.530565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:56.815543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:56.824734 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-410586ee-d2ab-4946-974f-03331033bc9b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.318131 Oct 27 09:00:56.831082 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 206/427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:56 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:56.865145 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4164d34b-9b6b-44b3-86ac-0b23789604bc tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ab716c01-c612-49bd-b61e-c891ab6a56b5" status: 202 len: 0 microversion: 2.1 time: 0.357997 Oct 27 09:00:56.873135 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 222/428] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:00:56 2022] DELETE /compute/v2.1/os-security-groups/ab716c01-c612-49bd-b61e-c891ab6a56b5 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:56.875346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee905da8-9972-486c-a9c6-33b9ceb13a99 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Calling method '.version_select at 0x7f31aa849310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:56.907329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:56.908423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:56.922786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:56.923599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:56.924208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:56.927052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:56.927719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:56.929923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:57.319068 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee905da8-9972-486c-a9c6-33b9ceb13a99 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ad27a501-793b-4256-bd5a-25247230fee1" status: 202 len: 0 microversion: 2.1 time: 0.448874 Oct 27 09:00:57.327985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:57.342039 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9066045b-2cc5-422b-8eea-c02981051500 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1321 microversion: 2.1 time: 0.439527 Oct 27 09:00:57.346688 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 207/429] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:00:56 2022] DELETE /compute/v2.1/os-security-groups/ad27a501-793b-4256-bd5a-25247230fee1 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:57.347300 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 223/430] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:56 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:00:57.353813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ce9a32f-4426-476f-b202-5ecc8cce36d5 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Calling method '.version_select at 0x7f31aaa225e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:57.364594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:57.368165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:57.381558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:57.382066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:57.382507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:57.384325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:57.384791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:57.387717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:57.629981 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ce9a32f-4426-476f-b202-5ecc8cce36d5 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1ca46e90-a608-4e96-97d4-9bfe5f4bc5c1" status: 202 len: 0 microversion: 2.1 time: 0.279968 Oct 27 09:00:57.630769 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 224/431] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:00:57 2022] DELETE /compute/v2.1/os-security-groups/1ca46e90-a608-4e96-97d4-9bfe5f4bc5c1 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:57.638445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:57.639067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:57.652120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:57.652593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:57.656109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:57.656908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:57.657386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:57.657820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:57.746850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:57.752184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:57.752696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:57.753171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lazy-loading 'fault' on Instance uuid af487f27-d809-4419-b687-f4ed26103070 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:00:57.784156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:57.856677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:57.871900 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-073d971a-cf3e-4b78-91fe-f53cb41b49b3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.523954 Oct 27 09:00:57.872773 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 208/432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:57 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:57.906144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e55e11e-5c0c-4632-bef9-166709ef3e53 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Calling method '.version_select at 0x7f31aa849e50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:58.067204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:58.077089 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94ae2691-cb58-48e4-9a05-c383afeadb14 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1459 microversion: 2.1 time: 0.444220 Oct 27 09:00:58.092973 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 225/433] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:57 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1459 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:58.098152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:58.098765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:58.106711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:58.107206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:58.107667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:58.108373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:58.108827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:58.109249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:58.254708 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e55e11e-5c0c-4632-bef9-166709ef3e53 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/7b73403d-7d0a-49e4-ba98-6249f3c4995c" status: 202 len: 0 microversion: 2.1 time: 0.365061 Oct 27 09:00:58.255743 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 209/434] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:00:57 2022] DELETE /compute/v2.1/os-security-groups/7b73403d-7d0a-49e4-ba98-6249f3c4995c => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:58.265108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4d17ee4-0345-4d1c-8cfd-3cacac405cc2 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] Calling method '.version_select at 0x7f31aa8578b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:58.581628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:58.592020 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-660eced3-c298-4c17-9a82-3ecddc608a13 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.497219 Oct 27 09:00:58.607037 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 226/435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:58 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:58.611044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:58.611682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:58.621808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:58.623331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:58.624459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:58.625412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:58.626326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:58.627275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:58.896766 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b4d17ee4-0345-4d1c-8cfd-3cacac405cc2 tempest-SecurityGroupRulesNegativeTestJSON-1400881701 tempest-SecurityGroupRulesNegativeTestJSON-1400881701-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ad69227e-7d60-40df-aa0b-35c75a339e16" status: 202 len: 0 microversion: 2.1 time: 0.635217 Oct 27 09:00:58.898014 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 210/436] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:00:58 2022] DELETE /compute/v2.1/os-security-groups/ad69227e-7d60-40df-aa0b-35c75a339e16 => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:00:58.989988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:58.998951 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-30a823d7-0a7d-4680-bc36-fc08877521f7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1321 microversion: 2.1 time: 0.394914 Oct 27 09:00:59.006104 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 227/437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:58 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:59.020062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.020948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:59.030495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.032137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.032767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.035526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.036250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.037304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.183053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d857b882-77e2-493a-bd66-90a4cc80432f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Calling method '.version_select at 0x7f31aa8579d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.188324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d857b882-77e2-493a-bd66-90a4cc80432f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.189525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d857b882-77e2-493a-bd66-90a4cc80432f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.190144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d857b882-77e2-493a-bd66-90a4cc80432f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.191020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d857b882-77e2-493a-bd66-90a4cc80432f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.192023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d857b882-77e2-493a-bd66-90a4cc80432f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.192856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d857b882-77e2-493a-bd66-90a4cc80432f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.235604 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d857b882-77e2-493a-bd66-90a4cc80432f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.336192 Oct 27 09:00:59.237039 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 211/438] 10.222.0.25 () {58 vars in 1128 bytes} [Thu Oct 27 09:00:58 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:59.243032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.243950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:59.251548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.252247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.252892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.253791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.254423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.255438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.309195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.310114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.310576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.311134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lazy-loading 'fault' on Instance uuid af487f27-d809-4419-b687-f4ed26103070 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:00:59.389954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:59.403959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:59.413356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a83c9bf2-9531-410d-bc99-f8b68a7f0108 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1417 microversion: 2.1 time: 0.174965 Oct 27 09:00:59.414300 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 212/439] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1417 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:59.496290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:59.513344 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1e90f11-45a8-4d39-be1f-90a8af404291 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.505860 Oct 27 09:00:59.516530 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 228/440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:00:59.537368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-598baf43-ebd4-432d-bec1-948ffa410e3b req-d65520f9-4df7-4092-b710-f94c2926bf01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af487f27-d809-4419-b687-f4ed26103070", "name": "network-vif-deleted", "tag": "5c3fff53-86cb-4c8e-b81d-2e2ca446d68a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:00:59.550414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:59.563376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-598baf43-ebd4-432d-bec1-948ffa410e3b req-d65520f9-4df7-4092-b710-f94c2926bf01 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.563906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-598baf43-ebd4-432d-bec1-948ffa410e3b req-d65520f9-4df7-4092-b710-f94c2926bf01 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.564353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-598baf43-ebd4-432d-bec1-948ffa410e3b req-d65520f9-4df7-4092-b710-f94c2926bf01 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.594905 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-598baf43-ebd4-432d-bec1-948ffa410e3b req-d65520f9-4df7-4092-b710-f94c2926bf01 service nova] Creating event network-vif-deleted:5c3fff53-86cb-4c8e-b81d-2e2ca446d68a for instance af487f27-d809-4419-b687-f4ed26103070 on n-h2-858383-16 Oct 27 09:00:59.608317 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-598baf43-ebd4-432d-bec1-948ffa410e3b req-d65520f9-4df7-4092-b710-f94c2926bf01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073679 Oct 27 09:00:59.622496 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 229/441] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:00:59.643405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.646667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:00:59.669754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.670704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.672188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.675873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:00:59.676739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:00:59.677380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:00:59.708863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ef914a2-f34f-401b-be65-938467bf5572 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Calling method '.version_select at 0x7f31aa9b9af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.715383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ef914a2-f34f-401b-be65-938467bf5572 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '793901694f0444acaa1fd1cc6847e85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf35c64a7d04d2f81f840b256627f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ef914a2-f34f-401b-be65-938467bf5572 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Request method failure captured: Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjJqKGd5SlVAEAKkvBK4x2VmU168c4xiVxbLHuIyunmjdYQXZpRhZs-y4tWhe1dt3wxMFL_lJgMEfdACblvSP7eqdxUkxqaIDKB-sgN2NE35yKHARYnWHKpkOv9fN5qd3QXy4kzoKmej2sxWk9p9zyg8Ho1Ezj_Do3sLVQ7DT-7OUQ Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cf35c64a7d04d2f81f840b256627f02"}]}] Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 793901694f0444acaa1fd1cc6847e85e Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: action_args: {} Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.717306 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ef914a2-f34f-401b-be65-938467bf5572 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ef914a2-f34f-401b-be65-938467bf5572 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.303270 Oct 27 09:00:59.722801 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 213/442] 10.222.0.25 () {58 vars in 1128 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 304 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:59.737717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9fdef0e9-0be7-490d-bfc2-702804645e97 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Calling method '.version_select at 0x7f31aa86d820>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.740431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9fdef0e9-0be7-490d-bfc2-702804645e97 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '793901694f0444acaa1fd1cc6847e85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf35c64a7d04d2f81f840b256627f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9fdef0e9-0be7-490d-bfc2-702804645e97 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Request method failure captured: Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hosts/n-d-858383-16/reboot HTTP/1.1 Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjJqKGd5SlVAEAKkvBK4x2VmU168c4xiVxbLHuIyunmjdYQXZpRhZs-y4tWhe1dt3wxMFL_lJgMEfdACblvSP7eqdxUkxqaIDKB-sgN2NE35yKHARYnWHKpkOv9fN5qd3QXy4kzoKmej2sxWk9p9zyg8Ho1Ezj_Do3sLVQ7DT-7OUQ Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cf35c64a7d04d2f81f840b256627f02"}]}] Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 793901694f0444acaa1fd1cc6847e85e Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'n-d-858383-16'} Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.746403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.750662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.750662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.750662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:59.750662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:59.750662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 27 09:00:59.750662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.754454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9fdef0e9-0be7-490d-bfc2-702804645e97 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:59.755550 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9fdef0e9-0be7-490d-bfc2-702804645e97 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-858383-16/reboot" status: 403 len: 111 microversion: 2.1 time: 0.023191 Oct 27 09:00:59.756629 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 214/443] 10.222.0.25 () {58 vars in 1191 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/os-hosts/n-d-858383-16/reboot => generated 111 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:59.768135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4ad632c-777f-4882-a702-8821a33ee6f3 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Calling method '.version_select at 0x7f31aa849c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.799637 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f4ad632c-777f-4882-a702-8821a33ee6f3 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4ad632c-777f-4882-a702-8821a33ee6f3 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Request method failure captured: Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjK3kdgjt15llYbNbH6IOVxFIeP9C8_rYwQDbQRcYMt0R4kCdw2MWCNrIrtJYts9zQFZB7-cemHxfkTxCT5UJh7GfvzJTloYYAA7G_lCF-trfp4cJM1c3MSr_5QI57IL0gkGaxj2j6qf9gUaagCDwtbAe4At5FsKziEPaNMc6tLzDI Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/79363e1f6cf64036ad6862705c38f758"}]}] Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 980fd5130d694110ab9d437e57901cc1 Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'nonexistent_hostname'} Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.801415 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4ad632c-777f-4882-a702-8821a33ee6f3 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:59.806542 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f4ad632c-777f-4882-a702-8821a33ee6f3 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.038559 Oct 27 09:00:59.809771 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 215/444] 10.222.0.25 () {58 vars in 1212 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:59.817586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-084499e2-0567-4907-97f0-ef304988ef55 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Calling method '.version_select at 0x7f31aa9b9430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.829746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-084499e2-0567-4907-97f0-ef304988ef55 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '793901694f0444acaa1fd1cc6847e85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf35c64a7d04d2f81f840b256627f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-084499e2-0567-4907-97f0-ef304988ef55 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Request method failure captured: Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hosts/n-d-858383-16 HTTP/1.1 Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjJqKGd5SlVAEAKkvBK4x2VmU168c4xiVxbLHuIyunmjdYQXZpRhZs-y4tWhe1dt3wxMFL_lJgMEfdACblvSP7eqdxUkxqaIDKB-sgN2NE35yKHARYnWHKpkOv9fN5qd3QXy4kzoKmej2sxWk9p9zyg8Ho1Ezj_Do3sLVQ7DT-7OUQ Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cf35c64a7d04d2f81f840b256627f02"}]}] Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 793901694f0444acaa1fd1cc6847e85e Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'n-d-858383-16'} Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.831494 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.835685 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.835685 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.835685 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:59.835685 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:59.835685 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 27 09:00:59.835685 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.835685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-084499e2-0567-4907-97f0-ef304988ef55 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:59.835685 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-084499e2-0567-4907-97f0-ef304988ef55 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-858383-16" status: 403 len: 109 microversion: 2.1 time: 0.019713 Oct 27 09:00:59.835685 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 216/445] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/os-hosts/n-d-858383-16 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:59.845839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:00:59.851712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d971ab95-9780-49e4-970d-c5b7a57de3d7 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Calling method '.version_select at 0x7f31aa849af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.866028 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d971ab95-9780-49e4-970d-c5b7a57de3d7 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d971ab95-9780-49e4-970d-c5b7a57de3d7 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Request method failure captured: Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjK3kdgjt15llYbNbH6IOVxFIeP9C8_rYwQDbQRcYMt0R4kCdw2MWCNrIrtJYts9zQFZB7-cemHxfkTxCT5UJh7GfvzJTloYYAA7G_lCF-trfp4cJM1c3MSr_5QI57IL0gkGaxj2j6qf9gUaagCDwtbAe4At5FsKziEPaNMc6tLzDI Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/79363e1f6cf64036ad6862705c38f758"}]}] Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 980fd5130d694110ab9d437e57901cc1 Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'nonexistent_hostname'} Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.869430 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.874311 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.874311 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.874311 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.874311 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:59.874311 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:59.874311 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.874311 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.874311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d971ab95-9780-49e4-970d-c5b7a57de3d7 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:59.877960 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d971ab95-9780-49e4-970d-c5b7a57de3d7 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.034213 Oct 27 09:00:59.878839 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 217/446] 10.222.0.25 () {58 vars in 1191 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:59.890003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eadbaa4b-db61-4e59-852f-33ef64e479d5 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Calling method '.version_select at 0x7f31aa857af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.891845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eadbaa4b-db61-4e59-852f-33ef64e479d5 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '793901694f0444acaa1fd1cc6847e85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf35c64a7d04d2f81f840b256627f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eadbaa4b-db61-4e59-852f-33ef64e479d5 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Request method failure captured: Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hosts/n-d-858383-16/shutdown HTTP/1.1 Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjJqKGd5SlVAEAKkvBK4x2VmU168c4xiVxbLHuIyunmjdYQXZpRhZs-y4tWhe1dt3wxMFL_lJgMEfdACblvSP7eqdxUkxqaIDKB-sgN2NE35yKHARYnWHKpkOv9fN5qd3QXy4kzoKmej2sxWk9p9zyg8Ho1Ezj_Do3sLVQ7DT-7OUQ Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cf35c64a7d04d2f81f840b256627f02"}]}] Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 793901694f0444acaa1fd1cc6847e85e Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'n-d-858383-16'} Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.897035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.902032 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.902032 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.902032 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:59.902032 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:59.902032 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 27 09:00:59.902032 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.902032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eadbaa4b-db61-4e59-852f-33ef64e479d5 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:59.906984 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eadbaa4b-db61-4e59-852f-33ef64e479d5 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-858383-16/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016706 Oct 27 09:00:59.908005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 218/447] 10.222.0.25 () {58 vars in 1197 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/os-hosts/n-d-858383-16/shutdown => generated 113 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:00:59.919999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f85adeac-74e4-476e-a10c-614355dd0884 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Calling method '.version_select at 0x7f31aa9b9820>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.933686 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f85adeac-74e4-476e-a10c-614355dd0884 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f85adeac-74e4-476e-a10c-614355dd0884 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Request method failure captured: Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjK3kdgjt15llYbNbH6IOVxFIeP9C8_rYwQDbQRcYMt0R4kCdw2MWCNrIrtJYts9zQFZB7-cemHxfkTxCT5UJh7GfvzJTloYYAA7G_lCF-trfp4cJM1c3MSr_5QI57IL0gkGaxj2j6qf9gUaagCDwtbAe4At5FsKziEPaNMc6tLzDI Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/79363e1f6cf64036ad6862705c38f758"}]}] Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 980fd5130d694110ab9d437e57901cc1 Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'nonexistent_hostname'} Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.936662 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.940658 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.943132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f85adeac-74e4-476e-a10c-614355dd0884 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:59.944243 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f85adeac-74e4-476e-a10c-614355dd0884 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.029212 Oct 27 09:00:59.949859 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 219/448] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:00:59.959081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3e49224-c046-427b-bfd0-444be656fae1 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Calling method '.version_select at 0x7f31aa849940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.961388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3e49224-c046-427b-bfd0-444be656fae1 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '793901694f0444acaa1fd1cc6847e85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf35c64a7d04d2f81f840b256627f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3e49224-c046-427b-bfd0-444be656fae1 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Request method failure captured: Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hosts/n-d-858383-16/startup HTTP/1.1 Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjJqKGd5SlVAEAKkvBK4x2VmU168c4xiVxbLHuIyunmjdYQXZpRhZs-y4tWhe1dt3wxMFL_lJgMEfdACblvSP7eqdxUkxqaIDKB-sgN2NE35yKHARYnWHKpkOv9fN5qd3QXy4kzoKmej2sxWk9p9zyg8Ho1Ezj_Do3sLVQ7DT-7OUQ Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cf35c64a7d04d2f81f840b256627f02"}]}] Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 793901694f0444acaa1fd1cc6847e85e Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'n-d-858383-16'} Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.963258 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.969853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.969853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.969853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:00:59.969853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:00:59.969853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 27 09:00:59.969853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.971460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3e49224-c046-427b-bfd0-444be656fae1 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:00:59.972539 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3e49224-c046-427b-bfd0-444be656fae1 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-858383-16/startup" status: 403 len: 110 microversion: 2.1 time: 0.021425 Oct 27 09:00:59.978125 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 220/449] 10.222.0.25 () {58 vars in 1194 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/os-hosts/n-d-858383-16/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:00:59.986652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70096aa8-4d82-4b69-8436-f95abf4f5179 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Calling method '.version_select at 0x7f31aaa05040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:00:59.997327 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-70096aa8-4d82-4b69-8436-f95abf4f5179 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70096aa8-4d82-4b69-8436-f95abf4f5179 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Request method failure captured: Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjK3kdgjt15llYbNbH6IOVxFIeP9C8_rYwQDbQRcYMt0R4kCdw2MWCNrIrtJYts9zQFZB7-cemHxfkTxCT5UJh7GfvzJTloYYAA7G_lCF-trfp4cJM1c3MSr_5QI57IL0gkGaxj2j6qf9gUaagCDwtbAe4At5FsKziEPaNMc6tLzDI Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/79363e1f6cf64036ad6862705c38f758"}]}] Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 980fd5130d694110ab9d437e57901cc1 Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'nonexistent_hostname'} Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:00:59.999336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:01:00.002872 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.005541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70096aa8-4d82-4b69-8436-f95abf4f5179 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:00.006913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70096aa8-4d82-4b69-8436-f95abf4f5179 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.025343 Oct 27 09:01:00.012667 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 221/450] 10.222.0.25 () {58 vars in 1215 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:01:00.018230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-492e454d-c73f-407d-ba93-f26e8c9e2933 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Action: 'update', calling method: .version_select at 0x7f31aaa05a60>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-492e454d-c73f-407d-ba93-f26e8c9e2933 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Request method failure captured: Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: request: PUT /compute/v2.1/os-hosts/n-d-858383-16 HTTP/1.1 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 51 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjK3kdgjt15llYbNbH6IOVxFIeP9C8_rYwQDbQRcYMt0R4kCdw2MWCNrIrtJYts9zQFZB7-cemHxfkTxCT5UJh7GfvzJTloYYAA7G_lCF-trfp4cJM1c3MSr_5QI57IL0gkGaxj2j6qf9gUaagCDwtbAe4At5FsKziEPaNMc6tLzDI Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/79363e1f6cf64036ad6862705c38f758"}]}] Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 980fd5130d694110ab9d437e57901cc1 Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: {"status": "enable", "maintenance_mode": "invalid"} Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'n-d-858383-16', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance: Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:01:00.022901 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 09:01:00.028400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.032461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-492e454d-c73f-407d-ba93-f26e8c9e2933 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:00.033580 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-492e454d-c73f-407d-ba93-f26e8c9e2933 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-858383-16" status: 400 len: 199 microversion: 2.1 time: 0.019619 Oct 27 09:01:00.034375 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 222/451] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Oct 27 09:01:00 2022] PUT /compute/v2.1/os-hosts/n-d-858383-16 => generated 199 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:01:00.044326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:00.045236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:00.053695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:00.054496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:00.055179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:00.056096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:00.056670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:00.057468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:00.267691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:00.283973 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e4350500-643e-485d-a104-88ecfbc79a8c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.660047 Oct 27 09:01:00.284917 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 230/452] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:00:59 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:00.296881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-88235cd7-9ab0-4bdf-8b4f-4cdb016bfac2 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Action: 'update', calling method: .version_select at 0x7f31aab73b80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-88235cd7-9ab0-4bdf-8b4f-4cdb016bfac2 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Request method failure captured: Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/os-hosts/n-d-858383-16 HTTP/1.1 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 51 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjK3kdgjt15llYbNbH6IOVxFIeP9C8_rYwQDbQRcYMt0R4kCdw2MWCNrIrtJYts9zQFZB7-cemHxfkTxCT5UJh7GfvzJTloYYAA7G_lCF-trfp4cJM1c3MSr_5QI57IL0gkGaxj2j6qf9gUaagCDwtbAe4At5FsKziEPaNMc6tLzDI Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/79363e1f6cf64036ad6862705c38f758"}]}] Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 980fd5130d694110ab9d437e57901cc1 Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: {"status": "invalid", "maintenance_mode": "enable"} Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'n-d-858383-16', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance: Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:01:00.302091 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-88235cd7-9ab0-4bdf-8b4f-4cdb016bfac2 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:00.305954 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-88235cd7-9ab0-4bdf-8b4f-4cdb016bfac2 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-858383-16" status: 400 len: 189 microversion: 2.1 time: 0.017383 Oct 27 09:01:00.310882 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 231/453] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Oct 27 09:01:00 2022] PUT /compute/v2.1/os-hosts/n-d-858383-16 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:01:00.321740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-35451b40-7b7d-4f63-bcbb-9a7e6882cb10 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Action: 'update', calling method: .version_select at 0x7f31aa8da0d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:00.326765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-35451b40-7b7d-4f63-bcbb-9a7e6882cb10 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '793901694f0444acaa1fd1cc6847e85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf35c64a7d04d2f81f840b256627f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-35451b40-7b7d-4f63-bcbb-9a7e6882cb10 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Request method failure captured: Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/os-hosts/n-d-858383-16 HTTP/1.1 Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 50 Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjJqKGd5SlVAEAKkvBK4x2VmU168c4xiVxbLHuIyunmjdYQXZpRhZs-y4tWhe1dt3wxMFL_lJgMEfdACblvSP7eqdxUkxqaIDKB-sgN2NE35yKHARYnWHKpkOv9fN5qd3QXy4kzoKmej2sxWk9p9zyg8Ho1Ezj_Do3sLVQ7DT-7OUQ Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cf35c64a7d04d2f81f840b256627f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cf35c64a7d04d2f81f840b256627f02"}]}] Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1cf35c64a7d04d2f81f840b256627f02 Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-55466828 Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 793901694f0444acaa1fd1cc6847e85e Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-HostsAdminNegativeTestJSON-55466828-project Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: {"status": "enable", "maintenance_mode": "enable"} Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'n-d-858383-16', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 09:01:00.335951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.340231 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.340231 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.340231 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.340231 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.340231 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.340231 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:01:00.340231 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:01:00.340231 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 27 09:01:00.340231 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.344626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-35451b40-7b7d-4f63-bcbb-9a7e6882cb10 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:00.345765 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-35451b40-7b7d-4f63-bcbb-9a7e6882cb10 tempest-HostsAdminNegativeTestJSON-55466828 tempest-HostsAdminNegativeTestJSON-55466828-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-858383-16" status: 403 len: 111 microversion: 2.1 time: 0.033754 Oct 27 09:01:00.357431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:00.362660 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 232/454] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Oct 27 09:01:00 2022] PUT /compute/v2.1/os-hosts/n-d-858383-16 => generated 111 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:01:00.369034 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ef8e068-dd78-4527-8359-cea205b779d5 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1321 microversion: 2.1 time: 0.328591 Oct 27 09:01:00.371218 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 223/455] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:00 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:00.378996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-953db3bd-a1e2-4f28-a900-633e019e4e90 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Action: 'update', calling method: .version_select at 0x7f31aaa22430>, body: {"status": null, "maintenance_mode": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-953db3bd-a1e2-4f28-a900-633e019e4e90 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Request method failure captured: Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/os-hosts/n-d-858383-16 HTTP/1.1 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 42 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjK3kdgjt15llYbNbH6IOVxFIeP9C8_rYwQDbQRcYMt0R4kCdw2MWCNrIrtJYts9zQFZB7-cemHxfkTxCT5UJh7GfvzJTloYYAA7G_lCF-trfp4cJM1c3MSr_5QI57IL0gkGaxj2j6qf9gUaagCDwtbAe4At5FsKziEPaNMc6tLzDI Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/79363e1f6cf64036ad6862705c38f758"}]}] Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 980fd5130d694110ab9d437e57901cc1 Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: {"status": null, "maintenance_mode": null} Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'n-d-858383-16', 'body': {'status': None, 'maintenance_mode': None}} Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'disable', Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'Enable', Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'Disable', Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance: Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi None Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:01:00.388421 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 27 09:01:00.393453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.395544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-953db3bd-a1e2-4f28-a900-633e019e4e90 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:00.400354 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-953db3bd-a1e2-4f28-a900-633e019e4e90 tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-858383-16" status: 400 len: 127 microversion: 2.1 time: 0.026691 Oct 27 09:01:00.401118 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 233/456] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Oct 27 09:01:00 2022] PUT /compute/v2.1/os-hosts/n-d-858383-16 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:01:00.414526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c49222f0-5c7d-4296-a021-3a5a8f67d88f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa8570d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:00.421160 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.hosts [None req-c49222f0-5c7d-4296-a021-3a5a8f67d88f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Enabling host nonexistent_hostname. Oct 27 09:01:00.439659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:00.440501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:00.447531 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-c49222f0-5c7d-4296-a021-3a5a8f67d88f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c49222f0-5c7d-4296-a021-3a5a8f67d88f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Request method failure captured: Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 50 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjK3kdgjt15llYbNbH6IOVxFIeP9C8_rYwQDbQRcYMt0R4kCdw2MWCNrIrtJYts9zQFZB7-cemHxfkTxCT5UJh7GfvzJTloYYAA7G_lCF-trfp4cJM1c3MSr_5QI57IL0gkGaxj2j6qf9gUaagCDwtbAe4At5FsKziEPaNMc6tLzDI Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/79363e1f6cf64036ad6862705c38f758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/79363e1f6cf64036ad6862705c38f758"}]}] Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 79363e1f6cf64036ad6862705c38f758 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1407176884 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 980fd5130d694110ab9d437e57901cc1 Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1407176884-project-admin Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: {"status": "enable", "maintenance_mode": "enable"} Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.450232 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c49222f0-5c7d-4296-a021-3a5a8f67d88f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:00.453828 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c49222f0-5c7d-4296-a021-3a5a8f67d88f tempest-HostsAdminNegativeTestJSON-1407176884 tempest-HostsAdminNegativeTestJSON-1407176884-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.042925 Oct 27 09:01:00.455228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:00.455308 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 224/457] 10.222.0.25 () {60 vars in 1211 bytes} [Thu Oct 27 09:01:00 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:01:00.455376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:00.455376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:00.455376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:00.455376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:00.455376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:00.527992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:00.528645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:00.528953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:00.529418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lazy-loading 'fault' on Instance uuid af487f27-d809-4419-b687-f4ed26103070 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:01:00.545937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:00.546843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:00.579746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:00.580613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:00.583376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:00.585827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:00.586515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:00.588106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:00.967497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b616958081564aea82d0c3d93c3c026f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0978e9d8254ba4a5a1f0466baeb2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:00.976046 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b29a716-a11e-4cd3-8b16-3a5ed8356a84 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 200 len: 1310 microversion: 2.1 time: 0.540797 Oct 27 09:01:00.985319 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 234/458] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:00 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 1310 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:01.204854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:01.216526 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c72520af-195d-4c62-a08c-59b0f257229f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.678376 Oct 27 09:01:01.217112 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 225/459] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:00 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:01.308872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:01.309851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:01.317978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:01.321796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:01.322314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:01.322986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:01.324017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:01.324448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:01.393366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:01.393980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:01.400206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:01.400703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:01.402581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:01.403325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:01.404448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:01.405051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:01.747554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:01.758873 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72df3a14-9e69-4450-84f0-04f1adc10f53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.454935 Oct 27 09:01:01.760688 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 235/460] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:01 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:01.783836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:01.791739 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df13fa60-6811-4e4f-adc9-763a721d10d3 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1321 microversion: 2.1 time: 0.402699 Oct 27 09:01:01.792612 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 226/461] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:01 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:02.009211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:02.010175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:02.016647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.017519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.018195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.019668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.020346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.020983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.055105 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] HTTP exception thrown: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Request method failure captured: Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 HTTP/1.1 Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkiAnyHnE_7ihRDdTCXmh7hKWTEP3H8JrNJnw9VBzSQ63r3cbM91s8aMOSjTRTKgJA0-HHvjl1GJnFQysbNxqzDh0rmHW1BRZC2s0rI8ievyFK9bpocnx7BnozIoUql4AvmptF0rhSoCh9uK3yoc7lLIjXtgKIgdfVD1QYxwT4Ij6wU Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}] Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: b616958081564aea82d0c3d93c3c026f Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'af487f27-d809-4419-b687-f4ed26103070'} Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.056735 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.061782 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.061782 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.061782 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.061782 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:02.061782 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:02.061782 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.061782 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.064326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Returning 404 to user: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:02.066510 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ee3d9dad-4182-487f-a510-094e53c01480 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 404 len: 111 microversion: 2.1 time: 0.061100 Oct 27 09:01:02.069866 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 236/462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:02 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:01:02.081699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:02.082242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:02.113034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.113819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.114451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.115358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.118206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.122516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.175892 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] HTTP exception thrown: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Request method failure captured: Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 HTTP/1.1 Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiAnyHnE_7ihRDdTCXmh7hKWTEP3H8JrNJnw9VBzSQ63r3cbM91s8aMOSjTRTKgJA0-HHvjl1GJnFQysbNxqzDh0rmHW1BRZC2s0rI8ievyFK9bpocnx7BnozIoUql4AvmptF0rhSoCh9uK3yoc7lLIjXtgKIgdfVD1QYxwT4Ij6wU Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}] Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b616958081564aea82d0c3d93c3c026f Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'af487f27-d809-4419-b687-f4ed26103070'} Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:01:02.178580 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Returning 404 to user: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8fbaac2-f888-4c5c-bc36-1d4f73f16437 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 404 len: 111 microversion: 2.1 time: 0.103426 Oct 27 09:01:02.182389 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 227/463] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:01:02 2022] DELETE /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:01:02.190398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:02.191096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: af487f27-d809-4419-b687-f4ed26103070] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:02.199500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.200244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.202328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.204160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.204822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.205586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.231120 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] HTTP exception thrown: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Request method failure captured: Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 HTTP/1.1 Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkiAnyHnE_7ihRDdTCXmh7hKWTEP3H8JrNJnw9VBzSQ63r3cbM91s8aMOSjTRTKgJA0-HHvjl1GJnFQysbNxqzDh0rmHW1BRZC2s0rI8ievyFK9bpocnx7BnozIoUql4AvmptF0rhSoCh9uK3yoc7lLIjXtgKIgdfVD1QYxwT4Ij6wU Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}] Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: b616958081564aea82d0c3d93c3c026f Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'af487f27-d809-4419-b687-f4ed26103070'} Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.232923 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.238339 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.238339 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.238339 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.238339 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:02.238339 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:02.238339 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. Oct 27 09:01:02.238339 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.245051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:02.246303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:02.251168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Returning 404 to user: Instance af487f27-d809-4419-b687-f4ed26103070 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:02.258347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.259243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.260080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.262134 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9924a615-45b1-49e4-9972-905e1e21e363 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070" status: 404 len: 111 microversion: 2.1 time: 0.074128 Oct 27 09:01:02.262414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.262967 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 237/464] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:02 2022] GET /compute/v2.1/servers/af487f27-d809-4419-b687-f4ed26103070 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:01:02.263400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.264231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.280675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:02.282359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:02.299868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.300596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.301138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.330902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.331782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.342723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.367490 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] HTTP exception thrown: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Request method failure captured: Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 HTTP/1.1 Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkiAnyHnE_7ihRDdTCXmh7hKWTEP3H8JrNJnw9VBzSQ63r3cbM91s8aMOSjTRTKgJA0-HHvjl1GJnFQysbNxqzDh0rmHW1BRZC2s0rI8ievyFK9bpocnx7BnozIoUql4AvmptF0rhSoCh9uK3yoc7lLIjXtgKIgdfVD1QYxwT4Ij6wU Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}] Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: b616958081564aea82d0c3d93c3c026f Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f6df8c1b-2593-4504-a709-cac84e2d7609'} Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:01:02.369183 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.375671 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.378638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Returning 404 to user: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:02.379972 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33de5d39-5277-4886-99a4-9d84d4021aeb tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 404 len: 111 microversion: 2.1 time: 0.112702 Oct 27 09:01:02.381580 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 238/465] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:01:02 2022] DELETE /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:01:02.391197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:02.393157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] [instance: f6df8c1b-2593-4504-a709-cac84e2d7609] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:02.407108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.409244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.410651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.411540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.412036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.412463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.421846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:02.448221 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] HTTP exception thrown: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Request method failure captured: Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 HTTP/1.1 Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkiAnyHnE_7ihRDdTCXmh7hKWTEP3H8JrNJnw9VBzSQ63r3cbM91s8aMOSjTRTKgJA0-HHvjl1GJnFQysbNxqzDh0rmHW1BRZC2s0rI8ievyFK9bpocnx7BnozIoUql4AvmptF0rhSoCh9uK3yoc7lLIjXtgKIgdfVD1QYxwT4Ij6wU Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb0978e9d8254ba4a5a1f0466baeb2eb"}]}] Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: fb0978e9d8254ba4a5a1f0466baeb2eb Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-339702038 Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: b616958081564aea82d0c3d93c3c026f Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersAdminTestJSON-339702038-project Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f6df8c1b-2593-4504-a709-cac84e2d7609'} Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:02.450654 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.455201 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:02.455201 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:02.455201 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:02.455201 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:02.455201 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:02.455201 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. Oct 27 09:01:02.455201 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:02.455201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] Returning 404 to user: Instance f6df8c1b-2593-4504-a709-cac84e2d7609 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:02.455201 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85ce96a9-9f27-451c-b327-0c60ba301d57 tempest-DeleteServersAdminTestJSON-339702038 tempest-DeleteServersAdminTestJSON-339702038-project] 10.222.0.25 "GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609" status: 404 len: 111 microversion: 2.1 time: 0.065834 Oct 27 09:01:02.456691 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 239/466] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:02 2022] GET /compute/v2.1/servers/f6df8c1b-2593-4504-a709-cac84e2d7609 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:01:02.653635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:02.662715 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1508ec9-fb00-4435-8ad9-1b5cd6e2e130 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1504 microversion: 2.1 time: 0.422500 Oct 27 09:01:02.677896 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 228/467] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:02 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:02.782282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:02.783699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:02.794101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.794855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.795850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.799144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.799842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.800424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.818178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:02.818804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:02.833536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.834304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.835437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:02.839456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:02.840483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:02.840877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:03.292333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:03.301004 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f21eeec5-d660-4689-aac0-4c68bb3631db tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1321 microversion: 2.1 time: 0.487213 Oct 27 09:01:03.302661 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 229/468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:02 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:03.345144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:03.369320 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e240ebc6-ae36-4f66-aaea-e721843ddf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.587041 Oct 27 09:01:03.369946 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 240/469] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:02 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:03.704213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:03.705126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:03.716390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:03.717172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:03.717844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:03.718765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:03.720706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:03.725262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:04.004399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-946aedfe-59bd-4626-82a3-82cb271e9675 req-dc4fea54-7e44-4ec9-a399-586fdd56143b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087a0506-c4be-47ba-b65b-1ac5b4e5876a", "name": "network-vif-plugged", "status": "completed", "tag": "efb56077-da50-492a-a1f0-04144bd014e4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:04.016024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-946aedfe-59bd-4626-82a3-82cb271e9675 req-dc4fea54-7e44-4ec9-a399-586fdd56143b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:04.016940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-946aedfe-59bd-4626-82a3-82cb271e9675 req-dc4fea54-7e44-4ec9-a399-586fdd56143b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:04.019561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-946aedfe-59bd-4626-82a3-82cb271e9675 req-dc4fea54-7e44-4ec9-a399-586fdd56143b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:04.039295 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-946aedfe-59bd-4626-82a3-82cb271e9675 req-dc4fea54-7e44-4ec9-a399-586fdd56143b service nova] Creating event network-vif-plugged:efb56077-da50-492a-a1f0-04144bd014e4 for instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a on n-h1-858383-16 Oct 27 09:01:04.045869 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-946aedfe-59bd-4626-82a3-82cb271e9675 req-dc4fea54-7e44-4ec9-a399-586fdd56143b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045097 Oct 27 09:01:04.047297 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 241/470] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:04.204456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:04.224084 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dea43f06-42a9-45f2-a04b-2b1ea39bf24e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1494 microversion: 2.1 time: 0.521523 Oct 27 09:01:04.227331 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 230/471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:03 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1494 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:04.254284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c1ba839-ab58-4191-b4cc-883f83070c8f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '.version_select at 0x7f31aa91dd30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:04.258815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c1ba839-ab58-4191-b4cc-883f83070c8f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:04.259466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c1ba839-ab58-4191-b4cc-883f83070c8f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:04.260094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c1ba839-ab58-4191-b4cc-883f83070c8f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:04.297863 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c1ba839-ab58-4191-b4cc-883f83070c8f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.045609 Oct 27 09:01:04.309208 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 242/472] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:01:04 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:04.314178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-054757e0-5db9-4991-a061-2b45c0a36a1d tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:04.315671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-054757e0-5db9-4991-a061-2b45c0a36a1d tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:04.331261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:04.332423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:04.348497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:04.349754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:04.350520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:04.351405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:04.360656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:04.362079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:04.371881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-054757e0-5db9-4991-a061-2b45c0a36a1d tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:04.379664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-054757e0-5db9-4991-a061-2b45c0a36a1d tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:04.387503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-054757e0-5db9-4991-a061-2b45c0a36a1d tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:04.395521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-054757e0-5db9-4991-a061-2b45c0a36a1d tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:04.397903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-054757e0-5db9-4991-a061-2b45c0a36a1d tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:04.402773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-054757e0-5db9-4991-a061-2b45c0a36a1d tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:04.860290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:04.870689 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cec3864b-a7bb-4267-91ce-eb8cf41e41ee tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1321 microversion: 2.1 time: 0.544031 Oct 27 09:01:04.872992 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 243/473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:04 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:04.893443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:04.894386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:04.909972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:04.910610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:04.911089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:04.912344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:04.914052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:04.915377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:05.042644 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-054757e0-5db9-4991-a061-2b45c0a36a1d tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1647 microversion: 2.1 time: 0.733012 Oct 27 09:01:05.051043 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 231/474] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:04 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1647 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:05.234695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1564977019", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ff9a447f-bbfd-4e05-944d-b9d8c867cecf"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:05.310482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] validate_networks() for [('ff9a447f-bbfd-4e05-944d-b9d8c867cecf', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:01:05.639845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:05.667343 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-170f7790-3953-40aa-a7e7-453c015cee1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.776244 Oct 27 09:01:05.670891 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 244/475] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:04 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:05.897061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:05.898842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:05.919364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:05.921020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:05.922512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:05.925273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:05.925959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:05.926898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:07.061649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:01:07.062928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:01:07.063859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:01:07.064707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:01:07.065486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:01:07.081408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:07.086549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:07.087156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:07.088228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:07.089437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:07.096183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:07.104699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:07.136579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for project 37b756ad383a4cf18b7da7565a51572e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:07.153761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for user aff1721693734cc8937a84d9b8a483dd and project 37b756ad383a4cf18b7da7565a51572e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:07.155197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:07.165113 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0228d7c-c696-464a-83f2-844fe9d3a040 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1321 microversion: 2.1 time: 1.273224 Oct 27 09:01:07.166847 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 245/476] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:05 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1321 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:07.170427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:01:07.173093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:01:07.177538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:07.178154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:07.197500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:07.198650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:07.199799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:07.201637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:07.202121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:07.202620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:07.235032 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ab5b26c-cc68-4a23-a51d-e49de88c8a22 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.004124 Oct 27 09:01:07.236524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 232/477] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:01:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:01:07.933090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Calling method '.version_select at 0x7f31aa8495e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:07.937776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:07.938586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:07.939373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:07.970783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:07.974025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:07.974778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.004559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.007163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.008741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.017019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:08.031547 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e31bca73-258e-4454-af75-ad4a4b4e281b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.863162 Oct 27 09:01:08.032536 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 246/478] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:07 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:08.035828 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd6d0a16-e96f-4b1e-a213-bda5ced05454 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.797869 Oct 27 09:01:08.042230 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 233/479] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:01:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:08.046322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-341547c1-d1f3-438e-b78b-fb39bd3afef6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:08.046981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-341547c1-d1f3-438e-b78b-fb39bd3afef6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:08.052863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Calling method '.version_select at 0x7f31aa86dc10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:08.058342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.062757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.072195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.102735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.106234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.109034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.197937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-341547c1-d1f3-438e-b78b-fb39bd3afef6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:08.199612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.201364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.203301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.212259 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-341547c1-d1f3-438e-b78b-fb39bd3afef6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1211 microversion: 2.1 time: 0.175377 Oct 27 09:01:08.229992 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 247/480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:08 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1211 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:08.234670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:08.235283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:08.239185 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c7408ca-0855-49d5-bf5b-2ebc533f1466 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-858383-16/servers" status: 200 len: 276 microversion: 2.1 time: 0.194376 Oct 27 09:01:08.241611 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 234/481] 10.222.0.25 () {58 vars in 1215 bytes} [Thu Oct 27 09:01:08 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-16/servers => generated 276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:08.245428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.252484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.253052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.254129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.254611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.255038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.269941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Calling method '.version_select at 0x7f31aa86de50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:08.281018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.286635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.298626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.364747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.371531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.374293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.391756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.392725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.393501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.412479 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6460356-2f12-4754-80d6-7c484ebe8ce8 tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.158466 Oct 27 09:01:08.421729 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 235/482] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:01:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:08.440028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6871a9a2-21c2-4ded-9cc9-4d620295516c tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Calling method '.version_select at 0x7f31aa86d1f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:08.445688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6871a9a2-21c2-4ded-9cc9-4d620295516c tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.447871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6871a9a2-21c2-4ded-9cc9-4d620295516c tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.449896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6871a9a2-21c2-4ded-9cc9-4d620295516c tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.484097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6871a9a2-21c2-4ded-9cc9-4d620295516c tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.485007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6871a9a2-21c2-4ded-9cc9-4d620295516c tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.486397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6871a9a2-21c2-4ded-9cc9-4d620295516c tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.499610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:08.515885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6871a9a2-21c2-4ded-9cc9-4d620295516c tempest-HypervisorAdminUnderV252Test-727576905 tempest-HypervisorAdminUnderV252Test-727576905-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-858383-16/search" status: 200 len: 105 microversion: 2.1 time: 0.090837 Oct 27 09:01:08.517736 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 236/483] 10.222.0.25 () {58 vars in 1212 bytes} [Thu Oct 27 09:01:08 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-16/search => generated 105 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:08.762908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:08.773085 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31640d17-72a2-4912-873a-385bfe96de66 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1470 microversion: 2.1 time: 0.549165 Oct 27 09:01:08.797522 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 248/484] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:08 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1470 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:08.808826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:08.810965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:08.825038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.826490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.828181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:08.831030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:08.831892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:08.832978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:09.001485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lazy-loading 'flavor' on Instance uuid 087a0506-c4be-47ba-b65b-1ac5b4e5876a {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:01:09.242695 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-294f0b61-a7e5-4b1f-808f-0e55195fd599 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a/action" status: 202 len: 0 microversion: 2.1 time: 0.442784 Oct 27 09:01:09.249895 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 249/485] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:01:08 2022] POST /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:01:09.264160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:09.268187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:09.282480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:09.283266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:09.284069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:09.299463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:09.300217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:09.305594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:09.433363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-339862d7-ac71-49ae-a767-de1bdb28db83 tempest-FlavorsV261TestJSON-861488878 tempest-FlavorsV261TestJSON-861488878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1117022253", "id": 686535329, "os-flavor-access:is_public": "True"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:09.482884 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-339862d7-ac71-49ae-a767-de1bdb28db83 tempest-FlavorsV261TestJSON-861488878 tempest-FlavorsV261TestJSON-861488878-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.896717 Oct 27 09:01:09.488923 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 237/486] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:01:08 2022] POST /compute/v2.1/flavors => generated 465 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:01:09.500813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:09.505330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:09.522339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:09.522898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:09.530999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:09.531966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:09.532459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:09.532902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:09.794360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:09.803189 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-303b1e6e-dc64-4234-8088-1acb261d8f96 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1271 microversion: 2.1 time: 0.313122 Oct 27 09:01:09.823962 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 238/487] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:09 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1271 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:09.830252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-206df5b5-e7a7-4f51-8412-29060d5d6af8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:09.840619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-206df5b5-e7a7-4f51-8412-29060d5d6af8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:09.847192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-206df5b5-e7a7-4f51-8412-29060d5d6af8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:09.847971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-206df5b5-e7a7-4f51-8412-29060d5d6af8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:09.848595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-206df5b5-e7a7-4f51-8412-29060d5d6af8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:09.855541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-206df5b5-e7a7-4f51-8412-29060d5d6af8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:09.856321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-206df5b5-e7a7-4f51-8412-29060d5d6af8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:09.856944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-206df5b5-e7a7-4f51-8412-29060d5d6af8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:09.865782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:09.876305 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-69273614-8453-40d8-a4d1-e7e3be61333f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.624840 Oct 27 09:01:09.876878 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 250/488] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:09 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:10.326832 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-206df5b5-e7a7-4f51-8412-29060d5d6af8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1631 microversion: 2.1 time: 0.498570 Oct 27 09:01:10.327387 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 239/489] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:09 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1631 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:10.539650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7092749-c35f-4160-a338-4c473de89ab0 tempest-FlavorsV261TestJSON-1799331762 tempest-FlavorsV261TestJSON-1799331762-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:10.560177 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b7092749-c35f-4160-a338-4c473de89ab0 tempest-FlavorsV261TestJSON-1799331762 tempest-FlavorsV261TestJSON-1799331762-project] 10.222.0.25 "GET /compute/v2.1/flavors/686535329" status: 200 len: 465 microversion: 2.61 time: 0.670550 Oct 27 09:01:10.561977 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 251/490] 10.222.0.25 () {60 vars in 1196 bytes} [Thu Oct 27 09:01:09 2022] GET /compute/v2.1/flavors/686535329 => generated 465 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:01:10.575479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a1e2bfa-1ac3-473f-8c8b-77a4c38005ba tempest-FlavorsV261TestJSON-861488878 tempest-FlavorsV261TestJSON-861488878-project-admin] Action: 'update', calling method: .version_select at 0x7f31ac16dd30>, body: {"flavor": {"description": "new"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:10.625419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:10.651916 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a1e2bfa-1ac3-473f-8c8b-77a4c38005ba tempest-FlavorsV261TestJSON-861488878 tempest-FlavorsV261TestJSON-861488878-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/686535329" status: 200 len: 466 microversion: 2.61 time: 0.080539 Oct 27 09:01:10.652474 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 240/491] 10.222.0.25 () {62 vars in 1216 bytes} [Thu Oct 27 09:01:10 2022] PUT /compute/v2.1/flavors/686535329 => generated 466 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:01:10.667233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b82c5659-f7ca-4ac6-ba56-d8292caf970c tempest-FlavorsV261TestJSON-1799331762 tempest-FlavorsV261TestJSON-1799331762-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:10.698185 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b82c5659-f7ca-4ac6-ba56-d8292caf970c tempest-FlavorsV261TestJSON-1799331762 tempest-FlavorsV261TestJSON-1799331762-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.035439 Oct 27 09:01:10.715884 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 252/492] 10.222.0.25 () {60 vars in 1187 bytes} [Thu Oct 27 09:01:10 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:10.724289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb574df9-2431-4c36-ab79-3dc6162b343a tempest-FlavorsV261TestJSON-1799331762 tempest-FlavorsV261TestJSON-1799331762-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:10.761905 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb574df9-2431-4c36-ab79-3dc6162b343a tempest-FlavorsV261TestJSON-1799331762 tempest-FlavorsV261TestJSON-1799331762-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.043262 Oct 27 09:01:10.774732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 241/493] 10.222.0.25 () {60 vars in 1166 bytes} [Thu Oct 27 09:01:10 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:10.781017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-394263e4-91a9-41fa-ad9f-08ff286b8b8c tempest-FlavorsV261TestJSON-861488878 tempest-FlavorsV261TestJSON-861488878-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:10.800875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-394263e4-91a9-41fa-ad9f-08ff286b8b8c tempest-FlavorsV261TestJSON-861488878 tempest-FlavorsV261TestJSON-861488878-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/686535329" status: 202 len: 0 microversion: 2.61 time: 0.023363 Oct 27 09:01:10.801854 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 253/494] 10.222.0.25 () {60 vars in 1199 bytes} [Thu Oct 27 09:01:10 2022] DELETE /compute/v2.1/flavors/686535329 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:01:10.814400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ce12c08-6b2a-4109-a456-e29be60d8044 tempest-FlavorsV261TestJSON-861488878 tempest-FlavorsV261TestJSON-861488878-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:10.831786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:10.832792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:10.839773 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ce12c08-6b2a-4109-a456-e29be60d8044 tempest-FlavorsV261TestJSON-861488878 tempest-FlavorsV261TestJSON-861488878-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.031596 Oct 27 09:01:10.843176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:10.844272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:10.847660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:10.849925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:10.851902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:10.852716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:10.861864 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 242/495] 10.222.0.25 () {60 vars in 1187 bytes} [Thu Oct 27 09:01:10 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:01:10.919256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:10.920459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:10.928866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:10.929572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:10.930544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:10.932900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:10.933594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:10.934269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:11.040909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:11.057883 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e691a53-7d3a-415f-93b5-307f9d6c548a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1269 microversion: 2.1 time: 0.228285 Oct 27 09:01:11.071593 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 254/496] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:10 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1269 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:11.279849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:11.291284 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8887cc96-b3ca-484e-af80-2a66dc23412c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.374393 Oct 27 09:01:11.294657 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 243/497] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:10 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:11.353381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f37d0da-703b-401e-ba88-e7ecf087d5a4 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:11.353971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f37d0da-703b-401e-ba88-e7ecf087d5a4 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:11.364195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f37d0da-703b-401e-ba88-e7ecf087d5a4 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:11.364714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f37d0da-703b-401e-ba88-e7ecf087d5a4 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:11.365166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f37d0da-703b-401e-ba88-e7ecf087d5a4 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:11.374084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f37d0da-703b-401e-ba88-e7ecf087d5a4 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:11.374807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f37d0da-703b-401e-ba88-e7ecf087d5a4 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:11.375383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f37d0da-703b-401e-ba88-e7ecf087d5a4 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:11.688557 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f37d0da-703b-401e-ba88-e7ecf087d5a4 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1614 microversion: 2.1 time: 0.339681 Oct 27 09:01:11.693265 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 255/498] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:11 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1614 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:11.712197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:11.716581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:11.730088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:11.740207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:11.740759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:11.741747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:11.742393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:11.742969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:11.875745 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] HTTP exception thrown: Cannot 'migrate' instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a while it is in vm_state suspended Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Request method failure captured: Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a/action HTTP/1.1 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 15 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkip-XYb9YKqU1j7pXaGSzEnCFlKjosEHw01Mh8FGFsdI2QVQBRPBHRgLM97makoEPe0T8rP2dilldM9BYXdDth9Zx_jJemv2vGZ7hb9qm-B3wAqg2s5li5eg9GJTaFt1tYvsXxczqRE5vdmsyLH9d9ONfnpkD8Gx_1yh91a7tHZsvc Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b2e3f837a0c14bfeb78a4bd61818d366"}]}] Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4709d6c65bcf4e8799e1d02bac1b6318 Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: {"migrate": {}} Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: exception: Cannot 'migrate' instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a while it is in vm_state suspended Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '087a0506-c4be-47ba-b65b-1ac5b4e5876a', 'body': {'migrate': {}}} Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a in vm_state suspended. Cannot resize while the instance is in this state. Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:01:11.877554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a while it is in vm_state suspended Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a while it is in vm_state suspended Oct 27 09:01:11.881899 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.890382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Returning 409 to user: Cannot 'migrate' instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a while it is in vm_state suspended {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:11.891824 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b7e407fb-02d7-4a6e-bccc-6fbfceaa4d77 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a/action" status: 409 len: 148 microversion: 2.1 time: 0.183330 Oct 27 09:01:11.893241 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 244/499] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:01:11 2022] POST /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a/action => generated 148 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:01:11.903896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f4f814f-193d-4814-9d84-783d62230d52 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f4f814f-193d-4814-9d84-783d62230d52 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Request method failure captured: Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74/action HTTP/1.1 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 39 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkip-XYb9YKqU1j7pXaGSzEnCFlKjosEHw01Mh8FGFsdI2QVQBRPBHRgLM97makoEPe0T8rP2dilldM9BYXdDth9Zx_jJemv2vGZ7hb9qm-B3wAqg2s5li5eg9GJTaFt1tYvsXxczqRE5vdmsyLH9d9ONfnpkD8Gx_1yh91a7tHZsvc Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b2e3f837a0c14bfeb78a4bd61818d366"}]}] Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4709d6c65bcf4e8799e1d02bac1b6318 Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: {"os-resetState": {"state": "invalid"}} Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '198a8f18-762d-46b1-99ba-59c3af33cf74', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:01:11.909893 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f4f814f-193d-4814-9d84-783d62230d52 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:11.915288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f4f814f-193d-4814-9d84-783d62230d52 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74/action" status: 400 len: 144 microversion: 2.1 time: 0.013447 Oct 27 09:01:11.916491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 256/500] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:01:11 2022] POST /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:01:11.926673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b26f3b72-d144-42e3-9f6c-c2967b05c5a8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b26f3b72-d144-42e3-9f6c-c2967b05c5a8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Request method failure captured: Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74/action HTTP/1.1 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 31 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkip-XYb9YKqU1j7pXaGSzEnCFlKjosEHw01Mh8FGFsdI2QVQBRPBHRgLM97makoEPe0T8rP2dilldM9BYXdDth9Zx_jJemv2vGZ7hb9qm-B3wAqg2s5li5eg9GJTaFt1tYvsXxczqRE5vdmsyLH9d9ONfnpkD8Gx_1yh91a7tHZsvc Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b2e3f837a0c14bfeb78a4bd61818d366"}]}] Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4709d6c65bcf4e8799e1d02bac1b6318 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: {"os-resetState": {"state": 1}} Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '198a8f18-762d-46b1-99ba-59c3af33cf74', 'body': {'os-resetState': {'state': 1}}} Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 1 Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 09:01:11.932219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b26f3b72-d144-42e3-9f6c-c2967b05c5a8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:11.938074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b26f3b72-d144-42e3-9f6c-c2967b05c5a8 tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74/action" status: 400 len: 120 microversion: 2.1 time: 0.013935 Oct 27 09:01:11.938988 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 245/501] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:01:11 2022] POST /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74/action => generated 120 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:01:11.950727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-44a9b6a4-0f59-4a01-948c-cd2bd34e24ce tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:11.953486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-44a9b6a4-0f59-4a01-948c-cd2bd34e24ce tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Failed to fetch instance by id 999 {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 09:01:11.954210 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-44a9b6a4-0f59-4a01-948c-cd2bd34e24ce tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-44a9b6a4-0f59-4a01-948c-cd2bd34e24ce tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Request method failure captured: Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 37 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkip-XYb9YKqU1j7pXaGSzEnCFlKjosEHw01Mh8FGFsdI2QVQBRPBHRgLM97makoEPe0T8rP2dilldM9BYXdDth9Zx_jJemv2vGZ7hb9qm-B3wAqg2s5li5eg9GJTaFt1tYvsXxczqRE5vdmsyLH9d9ONfnpkD8Gx_1yh91a7tHZsvc Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b2e3f837a0c14bfeb78a4bd61818d366"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b2e3f837a0c14bfeb78a4bd61818d366"}]}] Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b2e3f837a0c14bfeb78a4bd61818d366 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-459476628 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4709d6c65bcf4e8799e1d02bac1b6318 Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdminNegativeTestJSON-459476628-project-admin Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: {"os-resetState": {"state": "error"}} Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 999 could not be found. Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:11.957655 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:11.962596 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:11.962596 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 27 09:01:11.962596 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:11.962596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-44a9b6a4-0f59-4a01-948c-cd2bd34e24ce tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:11.962596 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-44a9b6a4-0f59-4a01-948c-cd2bd34e24ce tempest-ServersAdminNegativeTestJSON-459476628 tempest-ServersAdminNegativeTestJSON-459476628-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.016209 Oct 27 09:01:11.963867 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 257/502] 10.222.0.25 () {60 vars in 1179 bytes} [Thu Oct 27 09:01:11 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:01:11.973463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:11.974284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:11.985507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:11.986497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:11.987170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:11.988290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:11.988977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:11.989769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:12.035912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:01:12.093288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:12.094323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:12.107776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:12.110036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:12.110840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:12.112528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:12.113338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:12.113999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:12.202350 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df790539-3da4-41b4-8f1f-973bf0fdab8e tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 204 len: 0 microversion: 2.1 time: 0.233362 Oct 27 09:01:12.207310 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 246/503] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:01:11 2022] DELETE /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:01:12.216342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:12.217907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:12.226905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:12.227460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:12.228347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:12.230109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:12.230674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:12.231117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:12.321738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:12.333291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8156a891-f6d2-4d20-b269-224057eba3ee tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1269 microversion: 2.1 time: 0.252778 Oct 27 09:01:12.350135 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 258/504] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:12 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1269 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:12.350135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:12.350135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:12.370432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:12.374458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:12.375052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:12.375922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:12.377053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:12.378043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:12.814440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:12.824776 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d07b449-479e-4ee2-8186-37f963fe33c7 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1467 microversion: 2.1 time: 0.615806 Oct 27 09:01:12.828826 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 247/505] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:12 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1467 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:12.962602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:12.973455 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ece0540-0b4c-408a-a772-870ce8e91d53 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1475 microversion: 2.1 time: 0.633726 Oct 27 09:01:12.974591 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 259/506] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:12 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1475 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:13.359958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:13.360576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:13.373949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:13.373949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:13.374188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:13.374891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:13.380296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:13.380971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:13.853135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:13.854605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:13.862740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:13.868001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:13.873929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:13.876993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:13.877688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:13.880030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:13.937014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:13.950662 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa4d062f-63a3-4e90-a5cb-9ebba99a7095 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1311 microversion: 2.1 time: 0.595020 Oct 27 09:01:13.953944 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 248/507] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:13 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1311 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:13.997099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:13.997865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:14.012061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:14.012570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:14.013016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:14.013740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:14.016782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:14.017553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:14.734505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:14.754128 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e3884f1f-30f8-48d9-b17a-6b6fd130b2cc tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1467 microversion: 2.1 time: 0.901682 Oct 27 09:01:14.756510 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 260/508] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:13 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1467 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:14.980187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:14.982084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:15.011024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:15.014855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:15.016086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:15.017733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:15.020124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:15.024241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:15.448930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:15.461030 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-711ab312-734c-4f0e-8181-cd72a4bbc708 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1474 microversion: 2.1 time: 1.468229 Oct 27 09:01:15.484621 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 249/509] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:13 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1474 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:15.503659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-78876f74-a6a5-4eda-9ded-d25d280ccf59 req-3d756548-d802-4584-9bdb-ae53a817daf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba26e0a-7168-465e-b2f2-3b763456fe6c", "name": "network-vif-unplugged", "status": "completed", "tag": "083ab409-0cbd-467f-85a9-e03ea9c7779b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:15.540902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-78876f74-a6a5-4eda-9ded-d25d280ccf59 req-3d756548-d802-4584-9bdb-ae53a817daf1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:15.541421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-78876f74-a6a5-4eda-9ded-d25d280ccf59 req-3d756548-d802-4584-9bdb-ae53a817daf1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:15.541867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-78876f74-a6a5-4eda-9ded-d25d280ccf59 req-3d756548-d802-4584-9bdb-ae53a817daf1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:15.574506 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-78876f74-a6a5-4eda-9ded-d25d280ccf59 req-3d756548-d802-4584-9bdb-ae53a817daf1 service nova] Creating event network-vif-unplugged:083ab409-0cbd-467f-85a9-e03ea9c7779b for instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c on n-h1-858383-16 Oct 27 09:01:15.613530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-78876f74-a6a5-4eda-9ded-d25d280ccf59 req-3d756548-d802-4584-9bdb-ae53a817daf1 service nova] Instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:01:15.655509 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-78876f74-a6a5-4eda-9ded-d25d280ccf59 req-3d756548-d802-4584-9bdb-ae53a817daf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166390 Oct 27 09:01:15.660732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 250/510] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:15.696330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:15.709227 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f320e905-ce76-4f7a-9f4c-2422b6ea9eae tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1311 microversion: 2.1 time: 0.735737 Oct 27 09:01:15.743208 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 261/511] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:14 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1311 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:15.786170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:15.787099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:15.805665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:15.806357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:15.808833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:15.809705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:15.810422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:15.813539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:16.629128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-188439266", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "1a8d8c4c-d7c6-4980-b309-ab63e829200b"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:16.681396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:16.723703 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6cd67fb-d89a-4a66-8538-4ea86c9ae1fb tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 200 len: 1467 microversion: 2.1 time: 0.941441 Oct 27 09:01:16.734028 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 251/512] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:15 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 1467 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:16.756714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6c042953-adfe-408f-a0bb-8e5f73fcde23 req-29a4ef64-f384-40ac-ab67-62d91ac3900b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "224cd91a-b045-40e1-a226-451983e44fa5", "tag": "c5ae8671-fffc-4a9f-9053-5c79098b2c67"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:16.801273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] validate_networks() for [('1a8d8c4c-d7c6-4980-b309-ab63e829200b', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:01:16.836461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6c042953-adfe-408f-a0bb-8e5f73fcde23 req-29a4ef64-f384-40ac-ab67-62d91ac3900b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:16.836965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6c042953-adfe-408f-a0bb-8e5f73fcde23 req-29a4ef64-f384-40ac-ab67-62d91ac3900b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:16.837402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6c042953-adfe-408f-a0bb-8e5f73fcde23 req-29a4ef64-f384-40ac-ab67-62d91ac3900b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:16.888967 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6c042953-adfe-408f-a0bb-8e5f73fcde23 req-29a4ef64-f384-40ac-ab67-62d91ac3900b service nova] Creating event network-changed:c5ae8671-fffc-4a9f-9053-5c79098b2c67 for instance 224cd91a-b045-40e1-a226-451983e44fa5 on n-h1-858383-16 Oct 27 09:01:16.906867 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6c042953-adfe-408f-a0bb-8e5f73fcde23 req-29a4ef64-f384-40ac-ab67-62d91ac3900b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169223 Oct 27 09:01:16.909586 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 252/513] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:16.930100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:16.933293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:16.944466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:16.948525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:16.949328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:16.952970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:16.953879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:16.954930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:17.132283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:17.165251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:17.966868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:17.978285 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-515b9a05-56ca-46fc-83ee-12c1f0e3c722 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1474 microversion: 2.1 time: 1.065057 Oct 27 09:01:17.978986 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 253/514] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:16 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1474 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:17.986126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:17.986744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:18.011596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:18.012101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:18.012542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:18.013260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:18.013741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:18.014152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:18.203516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:18.299221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:18.322171 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67396cd7-49da-45a1-8130-83e3d0b344e0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1311 microversion: 2.1 time: 0.332956 Oct 27 09:01:18.323732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 254/515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:17 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1311 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:18.489480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:01:18.490108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:01:18.490934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:01:18.491763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:01:18.492339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:01:18.536971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:18.538810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:18.539438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:18.545029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:18.548395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:18.550439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:18.577579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:18.611153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:18.624634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for user cf8bc1ce921e4f759cb9c0b5f4340324 and project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:18.652091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:01:18.657613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:01:18.754947 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e2624cc2-c23e-4b60-ae92-24b48aab1009 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.819403 Oct 27 09:01:18.775487 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 262/516] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 09:01:18.790947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:18.792524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 087a0506-c4be-47ba-b65b-1ac5b4e5876a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:18.820811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:18.821309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:18.821751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:18.822519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:18.822979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:18.823410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] HTTP exception thrown: Instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a could not be found. Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Request method failure captured: Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a HTTP/1.1 Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkinjKYG5I61ub8ajZhyG7RpjlN_Hw4UfX0N1dO17TcqITtUpzoQLpg22XPViUR_J0bUC4d_u0HSC8SaNwsZYiiqRJHTAvnGckKlZUIz1mLlQmh_9fqwBhkGqiVDZWuUld9mpO71YZIrq664uVBT2hoLPfGtV_w1dtKMSkb1IOCXIcc Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0ca5eb57a6524b0daedc08c09cba2251 Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-861105261 Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ca5eb57a6524b0daedc08c09cba2251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ca5eb57a6524b0daedc08c09cba2251"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ca5eb57a6524b0daedc08c09cba2251"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ca5eb57a6524b0daedc08c09cba2251"}]}] Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdminNegativeTestJSON-861105261 Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0ca5eb57a6524b0daedc08c09cba2251 Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-861105261 Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdminNegativeTestJSON-861105261-project Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: fa798c1e8c8c445cb287ecc314c3b0ea Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdminNegativeTestJSON-861105261-project Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a could not be found. Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '087a0506-c4be-47ba-b65b-1ac5b4e5876a'} Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a could not be found. Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:01:18.871371 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a could not be found. Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a could not be found. Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Returning 404 to user: Instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-11435aff-57f1-4354-ab3e-3365a596eccf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a" status: 404 len: 111 microversion: 2.1 time: 0.086790 Oct 27 09:01:18.875786 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 263/517] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:18 2022] GET /compute/v2.1/servers/087a0506-c4be-47ba-b65b-1ac5b4e5876a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:01:18.891198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-45a9fe73-9b2d-4096-b5f3-186de3dc27dd req-89cfa879-1770-49ee-8a36-8c380f77c802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087a0506-c4be-47ba-b65b-1ac5b4e5876a", "name": "network-vif-deleted", "tag": "efb56077-da50-492a-a1f0-04144bd014e4"}, {"name": "network-changed", "server_uuid": "3ba26e0a-7168-465e-b2f2-3b763456fe6c", "tag": "083ab409-0cbd-467f-85a9-e03ea9c7779b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:18.922785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-45a9fe73-9b2d-4096-b5f3-186de3dc27dd req-89cfa879-1770-49ee-8a36-8c380f77c802 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:18.923281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-45a9fe73-9b2d-4096-b5f3-186de3dc27dd req-89cfa879-1770-49ee-8a36-8c380f77c802 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:18.923756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-45a9fe73-9b2d-4096-b5f3-186de3dc27dd req-89cfa879-1770-49ee-8a36-8c380f77c802 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:18.947133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-45a9fe73-9b2d-4096-b5f3-186de3dc27dd req-89cfa879-1770-49ee-8a36-8c380f77c802 service nova] Creating event network-vif-deleted:efb56077-da50-492a-a1f0-04144bd014e4 for instance 087a0506-c4be-47ba-b65b-1ac5b4e5876a on n-h1-858383-16 Oct 27 09:01:18.947800 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-45a9fe73-9b2d-4096-b5f3-186de3dc27dd req-89cfa879-1770-49ee-8a36-8c380f77c802 service nova] Creating event network-changed:083ab409-0cbd-467f-85a9-e03ea9c7779b for instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c on n-h1-858383-16 Oct 27 09:01:18.958957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-45a9fe73-9b2d-4096-b5f3-186de3dc27dd req-89cfa879-1770-49ee-8a36-8c380f77c802 service nova] Instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:01:18.978641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1df4da7a-656b-47bb-8e99-0b6f9fb95196 tempest-InstanceUsageAuditLogTestJSON-1121209832 tempest-InstanceUsageAuditLogTestJSON-1121209832-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.006719 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-45a9fe73-9b2d-4096-b5f3-186de3dc27dd req-89cfa879-1770-49ee-8a36-8c380f77c802 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.129649 Oct 27 09:01:19.009231 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 264/518] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:19.022210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4b706315-8353-4c8d-aaca-c4d68d36219c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.023352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4b706315-8353-4c8d-aaca-c4d68d36219c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:19.046225 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1df4da7a-656b-47bb-8e99-0b6f9fb95196 tempest-InstanceUsageAuditLogTestJSON-1121209832 tempest-InstanceUsageAuditLogTestJSON-1121209832-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27 09:01:17" status: 200 len: 318 microversion: 2.1 time: 0.720611 Oct 27 09:01:19.048271 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 255/519] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:01:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2009%3A01%3A17 => generated 318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:19.061748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.062425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:19.077776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.079971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.081143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.084317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.085192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.085953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.126069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4b706315-8353-4c8d-aaca-c4d68d36219c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:19.145285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4b706315-8353-4c8d-aaca-c4d68d36219c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:19.145448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:01:19.147333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4b706315-8353-4c8d-aaca-c4d68d36219c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:19.148209 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4b706315-8353-4c8d-aaca-c4d68d36219c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1261 microversion: 2.25 time: 0.137158 Oct 27 09:01:19.149218 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 265/520] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:19 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1261 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:19.154747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.155370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:19.162627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.169043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.169842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.171185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.171903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.172571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.318017 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0caa522-bdfe-4af1-93d1-ac7b957b35ba tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 204 len: 0 microversion: 2.1 time: 0.267399 Oct 27 09:01:19.318969 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 256/521] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:01:19 2022] DELETE /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:01:19.326741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-969d6ee3-472d-45d5-bc75-7c49f4f0d222 tempest-InstanceUsageAuditLogTestJSON-1121209832 tempest-InstanceUsageAuditLogTestJSON-1121209832-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.344007 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-969d6ee3-472d-45d5-bc75-7c49f4f0d222 tempest-InstanceUsageAuditLogTestJSON-1121209832 tempest-InstanceUsageAuditLogTestJSON-1121209832-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.023075 Oct 27 09:01:19.348721 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 257/522] 10.222.0.25 () {58 vars in 1185 bytes} [Thu Oct 27 09:01:19 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:19.472425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:19.489163 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-020ac6e0-d5ea-48bd-82af-c4a63f679d11 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1474 microversion: 2.1 time: 0.338913 Oct 27 09:01:19.490784 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 266/523] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:19 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:19.498031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.498945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:19.509622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.510930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.511531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.512619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.513285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.513962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.570738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9f03915-a411-4d3e-8fa9-a6c5cdb28509 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Calling method '.version_select at 0x7f31aa79c790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.578175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9f03915-a411-4d3e-8fa9-a6c5cdb28509 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.580035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9f03915-a411-4d3e-8fa9-a6c5cdb28509 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.581646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9f03915-a411-4d3e-8fa9-a6c5cdb28509 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.585907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9f03915-a411-4d3e-8fa9-a6c5cdb28509 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.589777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9f03915-a411-4d3e-8fa9-a6c5cdb28509 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.590777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9f03915-a411-4d3e-8fa9-a6c5cdb28509 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.646218 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9f03915-a411-4d3e-8fa9-a6c5cdb28509 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.296165 Oct 27 09:01:19.650852 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 258/524] 10.222.0.25 () {58 vars in 1128 bytes} [Thu Oct 27 09:01:19 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:19.661676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.663260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:19.674763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.675256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.675762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.676478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.676942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.682822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.689677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:19.804982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:19.821024 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b1fed8c3-ad7e-4320-8ad8-dc7eda0199ed tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1477 microversion: 2.1 time: 0.329158 Oct 27 09:01:19.827943 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 267/525] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:19 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1477 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:19.839870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c8baada-2a6e-45bb-84e1-052a78c8bd87 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Calling method '.version_select at 0x7f31aa8e3790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.843546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8baada-2a6e-45bb-84e1-052a78c8bd87 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.844174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8baada-2a6e-45bb-84e1-052a78c8bd87 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.844731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8baada-2a6e-45bb-84e1-052a78c8bd87 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.845577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8baada-2a6e-45bb-84e1-052a78c8bd87 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.849070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8baada-2a6e-45bb-84e1-052a78c8bd87 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.858965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8baada-2a6e-45bb-84e1-052a78c8bd87 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.896447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c8baada-2a6e-45bb-84e1-052a78c8bd87 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.067190 Oct 27 09:01:19.897580 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 268/526] 10.222.0.25 () {58 vars in 1139 bytes} [Thu Oct 27 09:01:19 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:19.910705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7374daa3-77c0-4013-a350-75abb0118e26 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Calling method '.version_select at 0x7f31aab73ca0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:19.914426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374daa3-77c0-4013-a350-75abb0118e26 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.915048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374daa3-77c0-4013-a350-75abb0118e26 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.916941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374daa3-77c0-4013-a350-75abb0118e26 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.923939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374daa3-77c0-4013-a350-75abb0118e26 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:19.925146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374daa3-77c0-4013-a350-75abb0118e26 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:19.925797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374daa3-77c0-4013-a350-75abb0118e26 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:19.943073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:19.952123 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82f2c5f5-c395-4227-8233-721dc0371bf5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1311 microversion: 2.1 time: 0.299865 Oct 27 09:01:19.964312 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 259/527] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:19 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1311 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:19.990040 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7374daa3-77c0-4013-a350-75abb0118e26 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.083071 Oct 27 09:01:19.990665 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 269/528] 10.222.0.25 () {58 vars in 1145 bytes} [Thu Oct 27 09:01:19 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:01:20.003446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd9df820-98cb-40e0-9103-984a30eecd54 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Calling method '.version_select at 0x7f31aaaf70d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:20.008671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9df820-98cb-40e0-9103-984a30eecd54 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.009488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9df820-98cb-40e0-9103-984a30eecd54 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.010687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9df820-98cb-40e0-9103-984a30eecd54 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.011673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9df820-98cb-40e0-9103-984a30eecd54 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.012586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9df820-98cb-40e0-9103-984a30eecd54 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.013236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd9df820-98cb-40e0-9103-984a30eecd54 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.062393 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd9df820-98cb-40e0-9103-984a30eecd54 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.063370 Oct 27 09:01:20.068693 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 260/529] 10.222.0.25 () {58 vars in 1128 bytes} [Thu Oct 27 09:01:19 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:20.080703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f94072f-454b-49cd-82fb-eae36b6b8173 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Calling method '.version_select at 0x7f31aa8175e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:20.084879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f94072f-454b-49cd-82fb-eae36b6b8173 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.085827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f94072f-454b-49cd-82fb-eae36b6b8173 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.087885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f94072f-454b-49cd-82fb-eae36b6b8173 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.089347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f94072f-454b-49cd-82fb-eae36b6b8173 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.090433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f94072f-454b-49cd-82fb-eae36b6b8173 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.091913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f94072f-454b-49cd-82fb-eae36b6b8173 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.139869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:20.152653 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f94072f-454b-49cd-82fb-eae36b6b8173 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.074170 Oct 27 09:01:20.153912 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 270/530] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:01:20 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:20.165068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72b9423c-b8aa-45df-8804-9a68f248ed89 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Calling method '.version_select at 0x7f31aa79ce50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:20.172053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b9423c-b8aa-45df-8804-9a68f248ed89 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.172750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b9423c-b8aa-45df-8804-9a68f248ed89 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.176199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b9423c-b8aa-45df-8804-9a68f248ed89 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.177880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b9423c-b8aa-45df-8804-9a68f248ed89 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.185572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b9423c-b8aa-45df-8804-9a68f248ed89 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.187009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72b9423c-b8aa-45df-8804-9a68f248ed89 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.200891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:20.201892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:20.208502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.224401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.228586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.229574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.230151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.231307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.270286 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72b9423c-b8aa-45df-8804-9a68f248ed89 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.108964 Oct 27 09:01:20.271422 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 261/531] 10.222.0.25 () {58 vars in 1128 bytes} [Thu Oct 27 09:01:20 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:20.284063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44bb3c34-7aa0-43ca-9c2a-405a668a31f4 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Calling method '.version_select at 0x7f31aa770940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:20.292371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44bb3c34-7aa0-43ca-9c2a-405a668a31f4 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.293139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44bb3c34-7aa0-43ca-9c2a-405a668a31f4 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.293741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44bb3c34-7aa0-43ca-9c2a-405a668a31f4 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.311165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44bb3c34-7aa0-43ca-9c2a-405a668a31f4 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.312093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44bb3c34-7aa0-43ca-9c2a-405a668a31f4 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.312844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44bb3c34-7aa0-43ca-9c2a-405a668a31f4 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.342832 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44bb3c34-7aa0-43ca-9c2a-405a668a31f4 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-858383-16" status: 200 len: 735 microversion: 2.1 time: 0.061829 Oct 27 09:01:20.344449 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 262/532] 10.222.0.25 () {58 vars in 1173 bytes} [Thu Oct 27 09:01:20 2022] GET /compute/v2.1/os-hosts/n-h1-858383-16 => generated 735 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:20.355304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5579049e-c476-476f-af20-b81199f964a9 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Calling method '.version_select at 0x7f31aa770430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:20.364791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5579049e-c476-476f-af20-b81199f964a9 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.365540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5579049e-c476-476f-af20-b81199f964a9 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.366265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5579049e-c476-476f-af20-b81199f964a9 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.381301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:20.381703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5579049e-c476-476f-af20-b81199f964a9 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.382453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5579049e-c476-476f-af20-b81199f964a9 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.383087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5579049e-c476-476f-af20-b81199f964a9 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.400389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:20.402404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:20.403718 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-726d2b57-dce5-473d-b2fe-d0ad965e329b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1265 microversion: 2.25 time: 0.228025 Oct 27 09:01:20.404394 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 271/533] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:20 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:20.405271 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5579049e-c476-476f-af20-b81199f964a9 tempest-HostsAdminTestJSON-533768488 tempest-HostsAdminTestJSON-533768488-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-858383-16" status: 200 len: 603 microversion: 2.1 time: 0.054291 Oct 27 09:01:20.411883 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 263/534] 10.222.0.25 () {58 vars in 1173 bytes} [Thu Oct 27 09:01:20 2022] GET /compute/v2.1/os-hosts/n-h2-858383-16 => generated 603 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:20.523389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:20.524154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:20.546510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.547169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.547763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.548619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.551167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.551812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.851280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:20.852205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:20.858899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.859393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.862290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.865487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.866937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.867978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.944507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:20.956618 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d1ff248-46f1-468a-b57c-5c41590072c3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1474 microversion: 2.1 time: 0.442854 Oct 27 09:01:20.958621 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 272/535] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:20 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1474 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:20.979411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:20.980466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:20.992726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.997698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:20.998377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:20.999261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:20.999906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:21.000478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:21.441113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:21.457468 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1bbb4689-5b33-49ff-a743-abffea27fb93 tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1477 microversion: 2.1 time: 0.609774 Oct 27 09:01:21.459359 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 264/536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:20 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1477 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:21.478725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:21.479347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:21.489063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:21.489715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:21.490285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:21.491121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:21.492759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:21.494799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:21.558746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:21.583061 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-272afd99-aac9-44f8-a8e6-20682f2808c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1311 microversion: 2.1 time: 0.608056 Oct 27 09:01:21.592043 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 273/537] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:20 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1311 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:21.637776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:21.652697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:21.654436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:21.658240 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b9c5ed5-9151-4321-b863-1e296505957d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1319 microversion: 2.25 time: 0.196509 Oct 27 09:01:21.661160 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 265/538] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:21 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:21.987373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:21.989086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:22.008602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:22.011815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:22.013022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:22.015693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:22.018005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:22.029334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:22.355322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:22.365693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7431485c-c500-435f-8ea2-57ed3325428d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1472 microversion: 2.1 time: 0.383207 Oct 27 09:01:22.366345 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 274/539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:21 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1472 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:22.483256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:22.487031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:22.507172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:22.508119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:22.508611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:22.509322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:22.509841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:22.510499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:22.615725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:22.617051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:22.637497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:22.638244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:22.638901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:22.639845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:22.642161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:22.643682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:22.721331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa798c1e8c8c445cb287ecc314c3b0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca5eb57a6524b0daedc08c09cba2251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:22.730444 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8b4db730-758f-4014-a62e-f2d475a41efe tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 200 len: 1435 microversion: 2.1 time: 0.251921 Oct 27 09:01:22.735393 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 266/540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:22 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 1435 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:22.751822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:22.752373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:22.759777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:22.760349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:22.760833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:22.761535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:22.766671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:22.767229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:23.248917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:23.258020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:23.259468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:23.265544 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60347d8d-bb52-4ff2-a8bd-5c4929656ed1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.528251 Oct 27 09:01:23.266166 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 267/541] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:22 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:23.275250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e40f3fd8-40c9-40b1-8597-287b47de5e04 req-c921d7b5-9174-496c-aa0d-5f7e812e509b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198a8f18-762d-46b1-99ba-59c3af33cf74", "name": "network-vif-deleted", "tag": "f06731c0-364a-4965-9db9-9c6e82c13ca5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:23.295875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:23.305693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7119c2dd-75c1-4b6a-ad51-48d620d960c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1311 microversion: 2.1 time: 0.695088 Oct 27 09:01:23.309463 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 275/542] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:22 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1311 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:23.324275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e40f3fd8-40c9-40b1-8597-287b47de5e04 req-c921d7b5-9174-496c-aa0d-5f7e812e509b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:23.325795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e40f3fd8-40c9-40b1-8597-287b47de5e04 req-c921d7b5-9174-496c-aa0d-5f7e812e509b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:23.326701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e40f3fd8-40c9-40b1-8597-287b47de5e04 req-c921d7b5-9174-496c-aa0d-5f7e812e509b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:23.366762 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e40f3fd8-40c9-40b1-8597-287b47de5e04 req-c921d7b5-9174-496c-aa0d-5f7e812e509b service nova] Creating event network-vif-deleted:f06731c0-364a-4965-9db9-9c6e82c13ca5 for instance 198a8f18-762d-46b1-99ba-59c3af33cf74 on n-h2-858383-16 Oct 27 09:01:23.375331 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e40f3fd8-40c9-40b1-8597-287b47de5e04 req-c921d7b5-9174-496c-aa0d-5f7e812e509b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106241 Oct 27 09:01:23.376697 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 268/543] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:23.391125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:23.391811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:23.416101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:23.421204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:23.421967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:23.422937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:23.425886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:23.426577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:23.762344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:23.763753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] [instance: 198a8f18-762d-46b1-99ba-59c3af33cf74] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:23.768347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:23.778683 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a464b6e8-56e1-4b90-8b5b-a75c0bd7fb52 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1472 microversion: 2.1 time: 0.391619 Oct 27 09:01:23.780200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:23.780961 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 276/544] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:23 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:23.781617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:23.782727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:23.787649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:23.788513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:23.792989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:23.833740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] HTTP exception thrown: Instance 198a8f18-762d-46b1-99ba-59c3af33cf74 could not be found. Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Request method failure captured: Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 HTTP/1.1 Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkinjKYG5I61ub8ajZhyG7RpjlN_Hw4UfX0N1dO17TcqITtUpzoQLpg22XPViUR_J0bUC4d_u0HSC8SaNwsZYiiqRJHTAvnGckKlZUIz1mLlQmh_9fqwBhkGqiVDZWuUld9mpO71YZIrq664uVBT2hoLPfGtV_w1dtKMSkb1IOCXIcc Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0ca5eb57a6524b0daedc08c09cba2251 Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-861105261 Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ca5eb57a6524b0daedc08c09cba2251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ca5eb57a6524b0daedc08c09cba2251"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ca5eb57a6524b0daedc08c09cba2251"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ca5eb57a6524b0daedc08c09cba2251"}]}] Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersAdminNegativeTestJSON-861105261 Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0ca5eb57a6524b0daedc08c09cba2251 Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-861105261 Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersAdminNegativeTestJSON-861105261-project Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: fa798c1e8c8c445cb287ecc314c3b0ea Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersAdminNegativeTestJSON-861105261-project Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 198a8f18-762d-46b1-99ba-59c3af33cf74 could not be found. Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '198a8f18-762d-46b1-99ba-59c3af33cf74'} Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198a8f18-762d-46b1-99ba-59c3af33cf74 could not be found. Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198a8f18-762d-46b1-99ba-59c3af33cf74 could not be found. Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:23.836776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:23.841544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:23.841544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:23.841544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:23.841544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:23.841544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:23.841544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:23.841544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198a8f18-762d-46b1-99ba-59c3af33cf74 could not be found. Oct 27 09:01:23.841544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:23.843803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] Returning 404 to user: Instance 198a8f18-762d-46b1-99ba-59c3af33cf74 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:23.844853 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73651107-2ee7-4eb4-8233-bede27bae4bf tempest-ServersAdminNegativeTestJSON-861105261 tempest-ServersAdminNegativeTestJSON-861105261-project] 10.222.0.25 "GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74" status: 404 len: 111 microversion: 2.1 time: 0.089751 Oct 27 09:01:23.845893 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 269/545] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:23 2022] GET /compute/v2.1/servers/198a8f18-762d-46b1-99ba-59c3af33cf74 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:01:24.293980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:24.294576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:24.305869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:24.306464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:24.307058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:24.307782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:24.308228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:24.308635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:24.346221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:24.347021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:24.360828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:24.363075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:24.365218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:24.368081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:24.368891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:24.369634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:24.829636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:24.847823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:24.853878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:24.864133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ff0b1df-97f7-4f01-85ed-a0787b82f362 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.574176 Oct 27 09:01:24.877143 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 277/546] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:24 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:24.900844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:24.901474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:24.912027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:24.912438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:24.914785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:24.916492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:24.918393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:24.919096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:25.227739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:25.238977 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7ce18db-2eca-4616-82fe-652a624d0cfb tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1311 microversion: 2.1 time: 0.907406 Oct 27 09:01:25.256957 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 270/547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:24 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1311 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:25.395743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3bba73e6-eec5-49ae-8281-8763ad5cad9d req-a5115cfa-1b2e-47d0-a81c-ab856926118b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224cd91a-b045-40e1-a226-451983e44fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c5ae8671-fffc-4a9f-9053-5c79098b2c67"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:25.435970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3bba73e6-eec5-49ae-8281-8763ad5cad9d req-a5115cfa-1b2e-47d0-a81c-ab856926118b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:25.438240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3bba73e6-eec5-49ae-8281-8763ad5cad9d req-a5115cfa-1b2e-47d0-a81c-ab856926118b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:25.438858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3bba73e6-eec5-49ae-8281-8763ad5cad9d req-a5115cfa-1b2e-47d0-a81c-ab856926118b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:25.480251 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3bba73e6-eec5-49ae-8281-8763ad5cad9d req-a5115cfa-1b2e-47d0-a81c-ab856926118b service nova] Creating event network-vif-plugged:c5ae8671-fffc-4a9f-9053-5c79098b2c67 for instance 224cd91a-b045-40e1-a226-451983e44fa5 on n-h1-858383-16 Oct 27 09:01:25.502673 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3bba73e6-eec5-49ae-8281-8763ad5cad9d req-a5115cfa-1b2e-47d0-a81c-ab856926118b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110357 Oct 27 09:01:25.503338 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 271/548] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:25.742234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:25.761323 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-81ab270b-f0fe-47f8-bc63-7257000e6fc5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1472 microversion: 2.1 time: 0.881931 Oct 27 09:01:25.775178 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 278/549] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:24 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1472 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:25.895677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:25.896480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:25.908409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:25.911683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:25.912398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:25.914913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:25.917525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:25.918447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:26.168665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4186e494-8314-43f1-87aa-24f1aff873df tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Action: 'create', calling method: .version_select at 0x7f31aa826310>, body: {"keypair": {"name": "tempest-keypair-971548891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfq6zniLcnXaTohYl/BpU34ld3Vx0zMDXyUlT4S5oL0JGpOVJbkTMqKZNeOCYWuFtHYbUjeQFCK0AWqEAMhXnBIulmVM06/4u1ObfMAKUwcAMEJiCP+xquV3aSKWWWhKQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:26.205276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4186e494-8314-43f1-87aa-24f1aff873df tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Getting quotas for project 00f19c40e6554a1f890cc7348bc30065. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:26.220081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4186e494-8314-43f1-87aa-24f1aff873df tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Getting quotas for user eabd7061a0d647d1bb5a9c3d296f6217 and project 00f19c40e6554a1f890cc7348bc30065. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:26.276052 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4186e494-8314-43f1-87aa-24f1aff873df tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.512858 Oct 27 09:01:26.295618 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 272/550] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:01:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:01:26.314061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:26.316355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:26.347175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:26.349816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:26.350595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:26.351554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:26.354032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:26.354770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:26.829634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:26.838752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:26.840231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:26.841345 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf5f1762-f78b-4f24-89cb-3c9cc0eaf872 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.951323 Oct 27 09:01:26.865220 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 279/551] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:25 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:01:26.880978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:26.881591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:26.888115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:26.888708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:26.889015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:26.889716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:26.890165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:26.890590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:26.997316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:27.007760 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51f7bb47-ae75-4f29-a38d-ddbbb1d52d37 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1311 microversion: 2.1 time: 0.708201 Oct 27 09:01:27.009145 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 273/552] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:26 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1311 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:27.168888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:27.188334 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-957e0fd9-555f-4fed-b1b9-1dd3ffda99e1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1469 microversion: 2.1 time: 0.318082 Oct 27 09:01:27.204203 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 280/553] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:26 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:27.214428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-15b5fb0e-91a9-4ce4-810f-34424f628b8b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:27.215338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-15b5fb0e-91a9-4ce4-810f-34424f628b8b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:27.231376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15b5fb0e-91a9-4ce4-810f-34424f628b8b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:27.231945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15b5fb0e-91a9-4ce4-810f-34424f628b8b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:27.232414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15b5fb0e-91a9-4ce4-810f-34424f628b8b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:27.233119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15b5fb0e-91a9-4ce4-810f-34424f628b8b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:27.233637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15b5fb0e-91a9-4ce4-810f-34424f628b8b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:27.234163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15b5fb0e-91a9-4ce4-810f-34424f628b8b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:27.464921 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-15b5fb0e-91a9-4ce4-810f-34424f628b8b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c/action" status: 204 len: 0 microversion: 2.1 time: 0.254259 Oct 27 09:01:27.466754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 274/554] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:01:27 2022] POST /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c/action => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:01:27.498066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:27.502063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:27.512464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:27.533432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:27.534414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:27.544067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:27.545383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:27.549623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:27.549906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:27.694770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23e5d982-9dd5-46ac-90c4-8e6f94174ba1 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Action: 'create', calling method: .version_select at 0x7f31aa8dadc0>, body: {"keypair": {"name": "tempest-keypair-1288691729", "type": "ssh", "user_id": "fa6349b22d0b47d0b42414132b2b9d1a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP67IgkXzF6hs1uJgk15NhO+yi8IOyK5srTlEwwvlorChwR2SPybSgvqaCVQ1roSys83jafD6kB0xpLIyvq6MoS9R6XmFgPoqJs2SXsX216ERR05V4WnBarY7JOnIXIrBA=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:27.758998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-23e5d982-9dd5-46ac-90c4-8e6f94174ba1 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Getting quotas for project 9a040040077e42e3b61513b3b50b08f3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:27.770931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-23e5d982-9dd5-46ac-90c4-8e6f94174ba1 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Getting quotas for user fed3e136e9ec42fc91c314dc11c6193c and project 9a040040077e42e3b61513b3b50b08f3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:27.833722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:27.842076 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-faa6303f-e774-4a7d-a343-1cbfec8d734e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1469 microversion: 2.1 time: 0.360996 Oct 27 09:01:27.848071 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 275/555] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:27 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:27.853020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9cd91383-ce8b-4c31-a3da-ef8ff9f7d524 req-69126236-f93b-4ff1-8fe4-0d07fc5c6e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825baa14-c4b5-47d3-ade1-af3f779cd623", "tag": "b9670495-9893-4b00-a8fa-658c87304fa1"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:27.868525 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23e5d982-9dd5-46ac-90c4-8e6f94174ba1 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.578581 Oct 27 09:01:27.874939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9cd91383-ce8b-4c31-a3da-ef8ff9f7d524 req-69126236-f93b-4ff1-8fe4-0d07fc5c6e6d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:27.875774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9cd91383-ce8b-4c31-a3da-ef8ff9f7d524 req-69126236-f93b-4ff1-8fe4-0d07fc5c6e6d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:27.876416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9cd91383-ce8b-4c31-a3da-ef8ff9f7d524 req-69126236-f93b-4ff1-8fe4-0d07fc5c6e6d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:27.878716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 281/556] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Oct 27 09:01:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 589 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:01:27.888662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:27.891495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:27.892420 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9cd91383-ce8b-4c31-a3da-ef8ff9f7d524 req-69126236-f93b-4ff1-8fe4-0d07fc5c6e6d service nova] Creating event network-changed:b9670495-9893-4b00-a8fa-658c87304fa1 for instance 825baa14-c4b5-47d3-ade1-af3f779cd623 on n-h1-858383-16 Oct 27 09:01:27.898221 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9cd91383-ce8b-4c31-a3da-ef8ff9f7d524 req-69126236-f93b-4ff1-8fe4-0d07fc5c6e6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047928 Oct 27 09:01:27.903927 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 276/557] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:27.905014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:27.905518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:27.909245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:27.910055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:27.910535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:27.910968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:27.911276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-284cbc5c-802b-4651-8f00-29b18f046833 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Action: 'create', calling method: .version_select at 0x7f31aa770160>, body: {"keypair": {"name": "tempest-keypair-96899041", "type": "ssh", "user_id": "fa6349b22d0b47d0b42414132b2b9d1a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbIVPKJQO5T18HsXG/pQ9CrU1A4Lg8wbyUfLGrafKtc1+dZVX9VkUeNku2xVkcBXDKxVG4GXzSNKV7Ap2Qi3/ttXtAE7wgcsCCFQn0IpdN5YOArXYrcaNvGaTy5z6jdtA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:27.929564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-284cbc5c-802b-4651-8f00-29b18f046833 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Getting quotas for project 9a040040077e42e3b61513b3b50b08f3. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:27.945358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-284cbc5c-802b-4651-8f00-29b18f046833 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Getting quotas for user fed3e136e9ec42fc91c314dc11c6193c and project 9a040040077e42e3b61513b3b50b08f3. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:27.980622 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-284cbc5c-802b-4651-8f00-29b18f046833 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.075193 Oct 27 09:01:27.981504 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 277/558] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Oct 27 09:01:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:01:27.992750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-705485e7-0133-4e8b-8804-a99e37e3afc9 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Calling method '.version_select at 0x7f31aa79ce50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:28.036666 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-705485e7-0133-4e8b-8804-a99e37e3afc9 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1288691729?user_id=fa6349b22d0b47d0b42414132b2b9d1a" status: 200 len: 512 microversion: 2.10 time: 0.045990 Oct 27 09:01:28.039960 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 278/559] 10.222.0.25 () {60 vars in 1340 bytes} [Thu Oct 27 09:01:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1288691729?user_id=fa6349b22d0b47d0b42414132b2b9d1a => generated 512 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:01:28.054442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:28.055197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:28.088126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:28.091208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:28.092024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:28.095526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:28.096246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:28.096840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:28.641453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:28.652614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:28.654520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:28.655745 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ac81d6fe-f75a-48e1-bccd-238014a06d63 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.775955 Oct 27 09:01:28.663455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:28.675011 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 282/560] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:27 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:28.680356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9834b4b-517e-43f3-a85e-f37336acbc57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1494 microversion: 2.1 time: 0.638985 Oct 27 09:01:28.691686 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 279/561] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:28 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1494 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:28.692027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28a41895-e7b3-4cd6-b0c6-ee98d48bff54 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Action: 'create', calling method: .version_select at 0x7f31aa8b9820>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-820847076", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtPhXYwZpAz74gEIIc5+uW6ept7e7zcuSX8ePCDv8jEeURg8QiUr6IDAREd2B5HjpjzEkFAFudyU4xASN7+jAMRsUKjuaQR8lpi2uh4cUXL8ceRfXVx5E+/IvwXatbatw=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:28.707145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-32fb7c73-37c5-4466-b0c4-fe0d1a0c49a5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:28.707887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-32fb7c73-37c5-4466-b0c4-fe0d1a0c49a5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:28.717636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32fb7c73-37c5-4466-b0c4-fe0d1a0c49a5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:28.720648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32fb7c73-37c5-4466-b0c4-fe0d1a0c49a5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:28.724290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32fb7c73-37c5-4466-b0c4-fe0d1a0c49a5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:28.726836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32fb7c73-37c5-4466-b0c4-fe0d1a0c49a5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:28.729275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32fb7c73-37c5-4466-b0c4-fe0d1a0c49a5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:28.730802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32fb7c73-37c5-4466-b0c4-fe0d1a0c49a5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:28.735433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-28a41895-e7b3-4cd6-b0c6-ee98d48bff54 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Getting quotas for project 9a040040077e42e3b61513b3b50b08f3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:28.747964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-28a41895-e7b3-4cd6-b0c6-ee98d48bff54 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Getting quotas for user fed3e136e9ec42fc91c314dc11c6193c and project 9a040040077e42e3b61513b3b50b08f3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:28.812518 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28a41895-e7b3-4cd6-b0c6-ee98d48bff54 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.135144 Oct 27 09:01:28.813170 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 283/562] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Oct 27 09:01:28 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:01:28.828454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-095fce77-25d7-44c0-8db9-5865c5324e5e tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Calling method '.version_select at 0x7f31aab73b80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:28.842717 n-d-858383-16 devstack@n-api.service[120602]: WARNING oslo_db.sqlalchemy.utils [None req-095fce77-25d7-44c0-8db9-5865c5324e5e tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 09:01:28.857218 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-095fce77-25d7-44c0-8db9-5865c5324e5e tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=fa6349b22d0b47d0b42414132b2b9d1a" status: 200 len: 724 microversion: 2.10 time: 0.036216 Oct 27 09:01:28.858211 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 284/563] 10.222.0.25 () {60 vars in 1259 bytes} [Thu Oct 27 09:01:28 2022] GET /compute/v2.1/os-keypairs?user_id=fa6349b22d0b47d0b42414132b2b9d1a => generated 724 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:01:28.873166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-235c26c5-d358-49b3-bbfe-148f2b778139 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Calling method '.version_select at 0x7f31aa803ca0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:28.919065 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-235c26c5-d358-49b3-bbfe-148f2b778139 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-820847076" status: 204 len: 0 microversion: 2.10 time: 0.053223 Oct 27 09:01:28.921617 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 285/564] 10.222.0.25 () {60 vars in 1322 bytes} [Thu Oct 27 09:01:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-820847076 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 09:01:28.937892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:28.938826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:28.951385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:28.954809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:28.955259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:28.957212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:28.957698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:28.958255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:29.367893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:29.380065 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4af2f994-e342-4fce-ba14-3369eda202bb tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1469 microversion: 2.1 time: 0.457081 Oct 27 09:01:29.380757 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 286/565] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:28 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1469 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:29.381591 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-32fb7c73-37c5-4466-b0c4-fe0d1a0c49a5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1647 microversion: 2.1 time: 0.679029 Oct 27 09:01:29.382158 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 280/566] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:28 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1647 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:29.387105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7cf99fa0-8ff4-4f8f-8bd1-885104e285ce tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Calling method '.version_select at 0x7f31aa7d2a60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:29.403307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-046d50e3-df70-4bdb-8b2b-6e4766dc36c2 req-42a6b7af-9373-4ab7-a522-c893ca0c3713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba26e0a-7168-465e-b2f2-3b763456fe6c", "name": "network-vif-plugged", "status": "completed", "tag": "083ab409-0cbd-467f-85a9-e03ea9c7779b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:29.413062 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7cf99fa0-8ff4-4f8f-8bd1-885104e285ce tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96899041?user_id=fa6349b22d0b47d0b42414132b2b9d1a" status: 204 len: 0 microversion: 2.10 time: 0.030249 Oct 27 09:01:29.413629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-046d50e3-df70-4bdb-8b2b-6e4766dc36c2 req-42a6b7af-9373-4ab7-a522-c893ca0c3713 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:29.414120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-046d50e3-df70-4bdb-8b2b-6e4766dc36c2 req-42a6b7af-9373-4ab7-a522-c893ca0c3713 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:29.414550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-046d50e3-df70-4bdb-8b2b-6e4766dc36c2 req-42a6b7af-9373-4ab7-a522-c893ca0c3713 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:29.414894 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 287/567] 10.222.0.25 () {60 vars in 1337 bytes} [Thu Oct 27 09:01:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96899041?user_id=fa6349b22d0b47d0b42414132b2b9d1a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:01:29.437667 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-046d50e3-df70-4bdb-8b2b-6e4766dc36c2 req-42a6b7af-9373-4ab7-a522-c893ca0c3713 service nova] Creating event network-vif-plugged:083ab409-0cbd-467f-85a9-e03ea9c7779b for instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c on n-h1-858383-16 Oct 27 09:01:29.440897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:29.444845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-046d50e3-df70-4bdb-8b2b-6e4766dc36c2 req-42a6b7af-9373-4ab7-a522-c893ca0c3713 service nova] Instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:01:29.463096 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-046d50e3-df70-4bdb-8b2b-6e4766dc36c2 req-42a6b7af-9373-4ab7-a522-c893ca0c3713 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074468 Oct 27 09:01:29.469353 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 281/568] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:29.478691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d750750d-a9bf-4338-a16d-4ab37518eae4 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] Calling method '.version_select at 0x7f31aa763700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:29.504985 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d750750d-a9bf-4338-a16d-4ab37518eae4 tempest-KeyPairsV210TestJSON-284522850 tempest-KeyPairsV210TestJSON-284522850-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288691729?user_id=fa6349b22d0b47d0b42414132b2b9d1a" status: 204 len: 0 microversion: 2.10 time: 0.033912 Oct 27 09:01:29.505905 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 282/569] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:01:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288691729?user_id=fa6349b22d0b47d0b42414132b2b9d1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:01:29.514043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-687e0904-651c-4731-8c8f-ca44374bab4e tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:29.514790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-687e0904-651c-4731-8c8f-ca44374bab4e tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:29.521629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-687e0904-651c-4731-8c8f-ca44374bab4e tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:29.521906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-687e0904-651c-4731-8c8f-ca44374bab4e tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:29.522089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-687e0904-651c-4731-8c8f-ca44374bab4e tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:29.526860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-687e0904-651c-4731-8c8f-ca44374bab4e tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:29.527584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-687e0904-651c-4731-8c8f-ca44374bab4e tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:29.528028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-687e0904-651c-4731-8c8f-ca44374bab4e tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:29.675497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fc34999-7563-4d33-9d40-463cfefc5eb1 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:29.679496 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4fc34999-7563-4d33-9d40-463cfefc5eb1 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fc34999-7563-4d33-9d40-463cfefc5eb1 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419-project-admin] Request method failure captured: Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjpSpfZWWOS7Oqq1jS5drY-lrLoXrVaMADxT6MFoTaz-zXqhwFsIgkh6pHKo-Tfo4JQQlxPsE7LJG88mJTrJ6BoAodrJoDhEDg6kq64Tu5pDCS0x6eclXS0RBQ4B_5IQHGLuzDrRGxFjoUjNBsyr5NukvlUqbEXsVacxsOS_WG51iI Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a04654ef637b4149948283259b51cd87 Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419 Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a04654ef637b4149948283259b51cd87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a04654ef637b4149948283259b51cd87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a04654ef637b4149948283259b51cd87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a04654ef637b4149948283259b51cd87"}]}] Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419 Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a04654ef637b4149948283259b51cd87 Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419 Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419-project-admin Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: a16b04aa5b6e490b861ab35c67ec279f Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419-project-admin Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid timestamp for date invalid_time Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'invalid_time'} Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:01:29.693980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:01:29.699997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 27 09:01:29.699997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:01:29.699997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fc34999-7563-4d33-9d40-463cfefc5eb1 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:29.699997 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4fc34999-7563-4d33-9d40-463cfefc5eb1 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419 tempest-InstanceUsageAuditLogNegativeTestJSON-1947011419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.279658 Oct 27 09:01:29.699997 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 288/570] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 27 09:01:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:01:29.704319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:29.704917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:29.711146 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-687e0904-651c-4731-8c8f-ca44374bab4e tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1647 microversion: 2.1 time: 0.204056 Oct 27 09:01:29.713672 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 283/571] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:29 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1647 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:29.729922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:29.732747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:29.733397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:29.734852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:29.735483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:29.736097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:29.760805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:29.954885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:29.968024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:29.969486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:29.971723 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a83f4cb7-47a3-4c5f-8f14-c72f3f36c840 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.272766 Oct 27 09:01:29.973046 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 289/572] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:29 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:29.985526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5cf0400-4aaa-4aba-831c-67df2c5b6745 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:29.992143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5cf0400-4aaa-4aba-831c-67df2c5b6745 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:29.993002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5cf0400-4aaa-4aba-831c-67df2c5b6745 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:29.993451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5cf0400-4aaa-4aba-831c-67df2c5b6745 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:29.997378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5cf0400-4aaa-4aba-831c-67df2c5b6745 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:29.998114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5cf0400-4aaa-4aba-831c-67df2c5b6745 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:29.998330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5cf0400-4aaa-4aba-831c-67df2c5b6745 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:30.025793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b73a42f4-ae7e-4bb6-a688-586e431cf0cd tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:30.027558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b73a42f4-ae7e-4bb6-a688-586e431cf0cd tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '738f1be5154c473190f0cc29fce97b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dce91dcf684aef93d12f40e01cb8f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:30.031748 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5cf0400-4aaa-4aba-831c-67df2c5b6745 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.056751 Oct 27 09:01:30.032364 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 290/573] 10.222.0.25 () {58 vars in 1176 bytes} [Thu Oct 27 09:01:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b73a42f4-ae7e-4bb6-a688-586e431cf0cd tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] Request method failure captured: Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjnQAXxXIW2XKKi9SqVwZ5qDzNb3u7SC40n9HtSCV_Z_bXV7u81G7Cf_KO3V5HYdqC0-9m3NQ6oJi84njU_m8T4Pd_7DZr88_ZQyPXysXSXT1O-lb_vTbTjY6XaWZn0dkdPpdtnPMakGeIS1W-UL4036KqCOWcRUyqA-b6Qb1RwIUk Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 27dce91dcf684aef93d12f40e01cb8f9 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27dce91dcf684aef93d12f40e01cb8f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27dce91dcf684aef93d12f40e01cb8f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27dce91dcf684aef93d12f40e01cb8f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27dce91dcf684aef93d12f40e01cb8f9"}]}] Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 27dce91dcf684aef93d12f40e01cb8f9 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 738f1be5154c473190f0cc29fce97b59 Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: action_args: {} Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:30.037765 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:30.042884 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:30.042884 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:30.042884 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:01:30.042884 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:01:30.042884 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 27 09:01:30.042884 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:30.042884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b73a42f4-ae7e-4bb6-a688-586e431cf0cd tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:30.042884 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b73a42f4-ae7e-4bb6-a688-586e431cf0cd tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.324765 Oct 27 09:01:30.045144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-09eb86a3-c6f1-4409-8f2b-10e0670d046b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:30.045681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-09eb86a3-c6f1-4409-8f2b-10e0670d046b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:30.048295 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 284/574] 10.222.0.25 () {58 vars in 1185 bytes} [Thu Oct 27 09:01:29 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 333 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:01:30.053043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09eb86a3-c6f1-4409-8f2b-10e0670d046b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:30.053545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09eb86a3-c6f1-4409-8f2b-10e0670d046b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:30.054034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09eb86a3-c6f1-4409-8f2b-10e0670d046b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:30.054748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09eb86a3-c6f1-4409-8f2b-10e0670d046b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:30.055243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09eb86a3-c6f1-4409-8f2b-10e0670d046b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:30.056116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09eb86a3-c6f1-4409-8f2b-10e0670d046b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:30.059845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c5d79bc-b528-4b39-a6ea-b042269ae8ab tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:30.066362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5c5d79bc-b528-4b39-a6ea-b042269ae8ab tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '738f1be5154c473190f0cc29fce97b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dce91dcf684aef93d12f40e01cb8f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c5d79bc-b528-4b39-a6ea-b042269ae8ab tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] Request method failure captured: Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2009:01:30 HTTP/1.1 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjnQAXxXIW2XKKi9SqVwZ5qDzNb3u7SC40n9HtSCV_Z_bXV7u81G7Cf_KO3V5HYdqC0-9m3NQ6oJi84njU_m8T4Pd_7DZr88_ZQyPXysXSXT1O-lb_vTbTjY6XaWZn0dkdPpdtnPMakGeIS1W-UL4036KqCOWcRUyqA-b6Qb1RwIUk Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 27dce91dcf684aef93d12f40e01cb8f9 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27dce91dcf684aef93d12f40e01cb8f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27dce91dcf684aef93d12f40e01cb8f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27dce91dcf684aef93d12f40e01cb8f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27dce91dcf684aef93d12f40e01cb8f9"}]}] Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 27dce91dcf684aef93d12f40e01cb8f9 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 738f1be5154c473190f0cc29fce97b59 Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '2022-10-27 09:01:30'} Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:30.070933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:01:30.076128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:01:30.076128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:01:30.076128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:01:30.076128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:01:30.076128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 27 09:01:30.076128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:01:30.076128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c5d79bc-b528-4b39-a6ea-b042269ae8ab tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:01:30.076128 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c5d79bc-b528-4b39-a6ea-b042269ae8ab tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365 tempest-InstanceUsageAuditLogNegativeTestJSON-2005554365-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27 09:01:30" status: 403 len: 128 microversion: 2.1 time: 0.022147 Oct 27 09:01:30.076128 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 285/575] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:01:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-27%2009%3A01%3A30 => generated 128 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:01:30.178662 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-09eb86a3-c6f1-4409-8f2b-10e0670d046b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.137605 Oct 27 09:01:30.179724 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 291/576] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:01:30 2022] POST /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:01:30.189713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68cf70b7-5211-45fb-89e1-ea50a58a19e7 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:30.190658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-68cf70b7-5211-45fb-89e1-ea50a58a19e7 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:30.199553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68cf70b7-5211-45fb-89e1-ea50a58a19e7 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:30.200075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68cf70b7-5211-45fb-89e1-ea50a58a19e7 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:30.204017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68cf70b7-5211-45fb-89e1-ea50a58a19e7 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:30.204782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68cf70b7-5211-45fb-89e1-ea50a58a19e7 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:30.205257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68cf70b7-5211-45fb-89e1-ea50a58a19e7 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:30.205692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68cf70b7-5211-45fb-89e1-ea50a58a19e7 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:30.212028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:30.420073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:30.420860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:30.443800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:30.445187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:30.447510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:30.448922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:30.449472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:30.455598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:30.477008 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68cf70b7-5211-45fb-89e1-ea50a58a19e7 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1652 microversion: 2.1 time: 0.291109 Oct 27 09:01:30.487668 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 286/577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:30 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1652 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:30.784214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:30.793185 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c05c4af1-b606-4677-bdb4-8d074c4b9a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1469 microversion: 2.1 time: 0.378312 Oct 27 09:01:30.805661 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 292/578] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:30 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:31.002503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:31.003483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:31.016059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:31.018882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:31.019710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:31.022449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:31.023195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:31.024484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:31.063438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-989675086", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:31.187867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:01:31.403056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:31.425681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:31.427093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:31.428868 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b66b9f86-05a2-4aa5-a170-a9b56d49c4f0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.430119 Oct 27 09:01:31.456377 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 293/579] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:30 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:31.506050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-04e505c5-bb8f-4bed-8225-e9d1658eeff0 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:31.506981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-04e505c5-bb8f-4bed-8225-e9d1658eeff0 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:31.515497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04e505c5-bb8f-4bed-8225-e9d1658eeff0 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:31.520543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04e505c5-bb8f-4bed-8225-e9d1658eeff0 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:31.520997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04e505c5-bb8f-4bed-8225-e9d1658eeff0 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:31.521716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04e505c5-bb8f-4bed-8225-e9d1658eeff0 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:31.522168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04e505c5-bb8f-4bed-8225-e9d1658eeff0 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:31.522595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04e505c5-bb8f-4bed-8225-e9d1658eeff0 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:31.910271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:01:31.910854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:01:31.911481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:01:31.911929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:01:31.913103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:01:31.930687 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-04e505c5-bb8f-4bed-8225-e9d1658eeff0 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1652 microversion: 2.1 time: 0.416195 Oct 27 09:01:31.930687 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 294/580] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:31 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1652 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:31.930687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:31.930687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:31.943914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:31.944424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:31.944957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:31.945712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:31.946176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:31.947272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:31.952328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:31.952613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:31.953047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:31.953757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:31.954206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:31.954919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:31.988897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Getting quotas for project efbe61afca914be4ad3877de683ae7c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:32.006683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Getting quotas for user 03e58a0c2bb443d68e4df4748455b64b and project efbe61afca914be4ad3877de683ae7c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:32.043525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:01:32.063875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:01:32.195450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:32.207936 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91b2b273-6651-4b6e-a4d8-47746a756c85 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1461 microversion: 2.1 time: 0.285083 Oct 27 09:01:32.208919 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 295/581] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:31 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1461 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:32.224580 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be709bf7-154d-40ec-b749-7ced79f90162 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505245 Oct 27 09:01:32.225680 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 287/582] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:01:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:01:32.237227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b741c28-0137-41f5-a0f1-61c6c2479697 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:32.238150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b741c28-0137-41f5-a0f1-61c6c2479697 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:32.245300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c6f577c2-0f25-44f3-a1d4-8df4b42d51a9 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:32.245916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c6f577c2-0f25-44f3-a1d4-8df4b42d51a9 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:32.290666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f577c2-0f25-44f3-a1d4-8df4b42d51a9 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:32.296264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f577c2-0f25-44f3-a1d4-8df4b42d51a9 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:32.296931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f577c2-0f25-44f3-a1d4-8df4b42d51a9 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:32.298164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f577c2-0f25-44f3-a1d4-8df4b42d51a9 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:32.298674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f577c2-0f25-44f3-a1d4-8df4b42d51a9 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:32.300166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f577c2-0f25-44f3-a1d4-8df4b42d51a9 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:32.458601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b741c28-0137-41f5-a0f1-61c6c2479697 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:32.471068 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b741c28-0137-41f5-a0f1-61c6c2479697 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1213 microversion: 2.1 time: 0.238185 Oct 27 09:01:32.480616 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 296/583] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:32 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1213 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:32.499150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:32.499824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:32.507806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:32.509441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:32.510030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:32.510885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:32.511499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:32.512088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:32.847236 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c6f577c2-0f25-44f3-a1d4-8df4b42d51a9 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1614 microversion: 2.1 time: 0.605363 Oct 27 09:01:32.850078 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 288/584] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:32 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1614 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:32.857953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:32.885989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:32.886484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c2e8c9c-e26b-4bfd-ae36-45e6634ded34 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '.version_select at 0x7f31aa881280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:32.887601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:32.888767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9e7293fd-5c7f-40cc-81c0-028cdc3239d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.407186 Oct 27 09:01:32.891237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c2e8c9c-e26b-4bfd-ae36-45e6634ded34 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:32.892018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c2e8c9c-e26b-4bfd-ae36-45e6634ded34 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:32.892642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c2e8c9c-e26b-4bfd-ae36-45e6634ded34 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:32.911513 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c2e8c9c-e26b-4bfd-ae36-45e6634ded34 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.025352 Oct 27 09:01:32.917476 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 289/585] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:01:32 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:32.923976 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 297/586] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:32 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:32.948863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3d11813-e199-43aa-a32f-c452b41be7bd tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:32.951358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3d11813-e199-43aa-a32f-c452b41be7bd tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:32.967756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3d11813-e199-43aa-a32f-c452b41be7bd tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:32.968960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3d11813-e199-43aa-a32f-c452b41be7bd tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:32.970313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3d11813-e199-43aa-a32f-c452b41be7bd tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:32.972017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3d11813-e199-43aa-a32f-c452b41be7bd tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:32.972793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3d11813-e199-43aa-a32f-c452b41be7bd tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:32.974131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3d11813-e199-43aa-a32f-c452b41be7bd tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:33.157644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1716092138", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:33.262638 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3d11813-e199-43aa-a32f-c452b41be7bd tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1632 microversion: 2.1 time: 0.320013 Oct 27 09:01:33.263679 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 290/587] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:32 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1632 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:33.278371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:01:33.311214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-16", "block_migration": true, "disk_over_commit": false}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:33.324046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:33.341900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:33.345689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:33.347144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:33.352350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:33.355808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:33.356388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:33.438294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lazy-loading 'flavor' on Instance uuid 224cd91a-b045-40e1-a226-451983e44fa5 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:01:33.455174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Going to try to live migrate instance to n-h2-858383-16 {{(pid=120603) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:01:33.822971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:01:33.823393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:01:33.824278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:01:33.824876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:01:33.825286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:01:33.845433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:33.854969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:33.855425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:33.856262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:33.862627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:33.863071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:33.932526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:33.940764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for user 0566a978e2924137973615346b1afaa3 and project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:33.966286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:01:33.973589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:01:34.035959 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d594c962-b063-4d75-a058-0cd6019d1063 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885421 Oct 27 09:01:34.057225 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 298/588] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:01:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:01:34.070725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:34.074624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:34.095191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:34.096174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:34.096861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:34.098217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:34.098921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:34.099825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:34.295862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:34.309781 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9cb9d0fd-0135-4227-a49a-002f8abeca9c tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1265 microversion: 2.1 time: 0.250903 Oct 27 09:01:34.310378 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 299/589] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:34 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:34.375765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:34.376458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:34.399294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:34.402540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:34.411502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:34.412946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:34.414233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:34.417380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:34.421244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:34.817885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:34.832372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:34.838059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:34.843408 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-51139c13-81ba-4ef6-88de-5d3fcaab7060 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.509185 Oct 27 09:01:34.844529 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 300/590] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:34 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:34.858847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-71968103-2cc1-4ab8-83e3-26af58f90733 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:34.860090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-71968103-2cc1-4ab8-83e3-26af58f90733 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:35.000367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-71968103-2cc1-4ab8-83e3-26af58f90733 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:35.008804 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-71968103-2cc1-4ab8-83e3-26af58f90733 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1213 microversion: 2.1 time: 0.161110 Oct 27 09:01:35.009984 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 301/591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:34 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:35.335851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:35.336553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:35.349447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:35.349447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:35.349447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:35.349866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:35.349976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:35.351774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:35.630723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:35.646533 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ddb96b1-99d8-461f-96f4-fb4ead7e273e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1271 microversion: 2.1 time: 0.313432 Oct 27 09:01:35.648106 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 302/592] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:35 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1271 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:35.778988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d67ee19b-babc-46e6-b1ad-e5e70532d047 req-f04e1e0c-6fc1-47a6-9bf3-34cbcf49a3bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825baa14-c4b5-47d3-ade1-af3f779cd623", "name": "network-vif-plugged", "status": "completed", "tag": "b9670495-9893-4b00-a8fa-658c87304fa1"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:35.808875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d67ee19b-babc-46e6-b1ad-e5e70532d047 req-f04e1e0c-6fc1-47a6-9bf3-34cbcf49a3bc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:35.821352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d67ee19b-babc-46e6-b1ad-e5e70532d047 req-f04e1e0c-6fc1-47a6-9bf3-34cbcf49a3bc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:35.821937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d67ee19b-babc-46e6-b1ad-e5e70532d047 req-f04e1e0c-6fc1-47a6-9bf3-34cbcf49a3bc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:35.864651 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d67ee19b-babc-46e6-b1ad-e5e70532d047 req-f04e1e0c-6fc1-47a6-9bf3-34cbcf49a3bc service nova] Creating event network-vif-plugged:b9670495-9893-4b00-a8fa-658c87304fa1 for instance 825baa14-c4b5-47d3-ade1-af3f779cd623 on n-h1-858383-16 Oct 27 09:01:35.874922 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d67ee19b-babc-46e6-b1ad-e5e70532d047 req-f04e1e0c-6fc1-47a6-9bf3-34cbcf49a3bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098102 Oct 27 09:01:35.884931 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 303/593] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:01:35.896065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:35.896856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:35.926405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:35.926938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:35.927386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:35.928119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:35.928586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:35.938708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:36.442981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:36.460318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:36.470918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:36.473958 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-370434f8-ae93-4f0a-b220-cb80b64bcfb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.586648 Oct 27 09:01:36.476124 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 304/594] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:35 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:36.513745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:36.515762 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13cd88fa-4179-4a29-804a-5398e5292054 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5/action" status: 202 len: 0 microversion: 2.1 time: 3.226877 Oct 27 09:01:36.522528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:36.528122 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 291/595] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:01:33 2022] POST /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5/action => generated 0 bytes in 3240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:01:36.543232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:36.545353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:36.564801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:36.565291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:36.565726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:36.566424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:36.566585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:36.566873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:36.567017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:36.572504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:36.573275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:36.574929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:36.581719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:36.583048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:36.818026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:36.826595 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18ddf7e5-719d-495b-9742-c66b91881b42 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1283 microversion: 2.1 time: 0.346634 Oct 27 09:01:36.837227 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 305/596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:36 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1283 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:36.848855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:36.849837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:36.857737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:36.858320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:36.858965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:36.859920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:36.861193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:36.861693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:37.034595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:37.046987 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a696ad3c-97ec-4758-a093-9a4302a3348d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.517098 Oct 27 09:01:37.051896 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 292/597] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:36 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:37.191531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:37.206714 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fcfdc85b-c31b-4bf8-bdda-acca85a8556b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.356114 Oct 27 09:01:37.208698 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 306/598] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:36 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:37.367866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-303656749", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:37.493624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:01:37.509521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:37.510996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:37.531938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:37.533421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:37.534051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:37.535006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:37.535649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:37.536251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:38.288311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:38.319932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:38.326090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:38.338501 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1fc3ff79-fd59-4bb6-9b4a-3940f89838ce tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1361 microversion: 2.25 time: 0.831019 Oct 27 09:01:38.339450 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 307/599] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:37 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1361 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:01:38.366500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:38.367678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:38.376126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:38.376891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:38.377484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:38.382431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:38.383501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:38.384307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:38.387055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:01:38.387599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:01:38.388238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:01:38.388750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:01:38.389465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:01:38.403782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:38.404668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:38.405344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:38.406461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:38.407174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:38.408024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:38.432494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Getting quotas for project fdefc8ef9ac54c2295f8ed1c7e5c0af6. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:38.438819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Getting quotas for user 1b81d8567c74491497aa9005c32412dd and project fdefc8ef9ac54c2295f8ed1c7e5c0af6. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:38.456810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:01:38.462051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:01:38.507877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:38.530496 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ef9a406-0c73-4929-b2c7-5145479a92d1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1271 microversion: 2.1 time: 0.188942 Oct 27 09:01:38.550542 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 308/600] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:38 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:38.565689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:38.571060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:38.584439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:38.584639 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf665c52-cd0d-409a-89e3-c0da2ff66380 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530978 Oct 27 09:01:38.585107 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 293/601] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:01:38.586300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:38.586790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:38.593313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:38.593958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:38.598212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:38.613531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:38.620235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:38.629164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:38.657279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:38.662010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:38.662505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:38.663254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:38.668466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:38.668986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:39.067269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:39.076785 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd701680-7ec0-482c-9a66-dcecccf38629 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.523493 Oct 27 09:01:39.082788 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 309/602] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:38 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:39.104680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2501c9aa-8286-44d3-b245-b4ecdc642569 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:39.105727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2501c9aa-8286-44d3-b245-b4ecdc642569 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:39.237422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2501c9aa-8286-44d3-b245-b4ecdc642569 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:39.259802 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2501c9aa-8286-44d3-b245-b4ecdc642569 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1218 microversion: 2.1 time: 0.174878 Oct 27 09:01:39.260400 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 310/603] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:39 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:39.320662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:39.336033 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-808e9f2b-4fb2-49b0-86d3-18e522ba024b tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.745373 Oct 27 09:01:39.340378 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 294/604] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:38 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:39.365789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:39.366731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:39.379269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:39.379792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:39.380229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:39.381004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:39.381457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:39.381873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:39.561759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:39.562351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:39.569401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:39.570336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:39.570998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:39.572540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:39.573302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:39.573923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:39.798335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:39.816810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:39.821089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:39.825294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:39.826512 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-033ecbcb-b06b-4224-8a64-260b2f55344e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1557 microversion: 2.25 time: 0.464681 Oct 27 09:01:39.830450 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b5ea7a3-ea3c-460d-b0fe-5078f889a38c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1313 microversion: 2.1 time: 0.272746 Oct 27 09:01:39.831831 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 295/605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:39 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:39.848175 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 311/606] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:39 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1557 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:40.059588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:40.060494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:40.073513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:40.074265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:40.074969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:40.076071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:40.077065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:40.077731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:40.106829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:40.107451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:40.122806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:40.123303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:40.123786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:40.124492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:40.124949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:40.125373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:40.639997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:40.672440 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ec7e735-d26e-43c9-9e0f-3329932ec634 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.563352 Oct 27 09:01:40.674025 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 312/607] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:40 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:40.695055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:40.695818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:40.697097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 825baa14-c4b5-47d3-ade1-af3f779cd623 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:01:40.718152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:40.718666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:40.719114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:40.725882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:40.726443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:40.726897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:40.832896 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f36dcfd4-2944-47b2-86be-7064af151e3b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 2051 microversion: 2.25 time: 0.972090 Oct 27 09:01:40.835590 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 296/608] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:39 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 2051 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:40.847047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:40.853342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:40.871873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:40.875487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:40.876154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:40.877069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:40.877653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:40.878160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:40.988554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:41.000380 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d4eea3d2-fa70-4517-a3c9-991e09e5cefa tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1278 microversion: 2.1 time: 0.325228 Oct 27 09:01:41.000981 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 313/609] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:40 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1278 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:41.015660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:41.016285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:41.027696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:41.028126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:41.028568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:41.029280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:41.029738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:41.030165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:41.462467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:41.471998 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8d9725a-d48c-4cbd-a929-86ae468bf9b5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1313 microversion: 2.1 time: 0.466567 Oct 27 09:01:41.476476 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 314/610] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:41 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:41.503642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:41.504606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:41.515135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:41.515675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:41.516119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:41.516844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:41.517304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:41.517731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:41.588393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:41.600258 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1bd6ebdf-36ea-4782-9fc9-451d2e7742f4 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.765051 Oct 27 09:01:41.601683 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 297/611] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:40 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:41.607241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0c7d7b26-ce8d-4f93-adef-1cfe491255df req-77e146db-a5db-473f-aae9-8cc8450ce02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224cd91a-b045-40e1-a226-451983e44fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "c5ae8671-fffc-4a9f-9053-5c79098b2c67"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:41.619180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0c7d7b26-ce8d-4f93-adef-1cfe491255df req-77e146db-a5db-473f-aae9-8cc8450ce02e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:41.620083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0c7d7b26-ce8d-4f93-adef-1cfe491255df req-77e146db-a5db-473f-aae9-8cc8450ce02e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:41.620783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0c7d7b26-ce8d-4f93-adef-1cfe491255df req-77e146db-a5db-473f-aae9-8cc8450ce02e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:41.636425 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0c7d7b26-ce8d-4f93-adef-1cfe491255df req-77e146db-a5db-473f-aae9-8cc8450ce02e service nova] Creating event network-vif-unplugged:c5ae8671-fffc-4a9f-9053-5c79098b2c67 for instance 224cd91a-b045-40e1-a226-451983e44fa5 on n-h1-858383-16 Oct 27 09:01:41.643272 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0c7d7b26-ce8d-4f93-adef-1cfe491255df req-77e146db-a5db-473f-aae9-8cc8450ce02e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040193 Oct 27 09:01:41.644498 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 298/612] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:41.704851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:41.707286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:41.717029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:41.717530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:41.718250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:41.720653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:41.721588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:41.722488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:41.957472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 825baa14-c4b5-47d3-ade1-af3f779cd623 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:01:42.099891 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d01d3a7-eae2-4440-acd9-9e9857eacb1a tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 2051 microversion: 2.25 time: 0.621883 Oct 27 09:01:42.101657 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 315/613] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:41 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 2051 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:42.107925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:42.108900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:42.116462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:42.117269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:42.117942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:42.119017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:42.119738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:42.120396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:42.251495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:42.264642 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1762254-5621-45fe-92ed-f74fde781294 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.570975 Oct 27 09:01:42.265950 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 299/614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:41 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:42.270849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fc145e55-8575-4f96-9867-036ab0c0490c req-d6b16a24-7597-4870-915b-cf0a660d7cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb21e13f-718e-4afe-b3f3-97a05e9be9c6", "tag": "a5a9685d-1d59-4fbb-a249-b32a53d0668d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:42.281779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fc145e55-8575-4f96-9867-036ab0c0490c req-d6b16a24-7597-4870-915b-cf0a660d7cd7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:42.282399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fc145e55-8575-4f96-9867-036ab0c0490c req-d6b16a24-7597-4870-915b-cf0a660d7cd7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:42.282916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fc145e55-8575-4f96-9867-036ab0c0490c req-d6b16a24-7597-4870-915b-cf0a660d7cd7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:42.295812 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fc145e55-8575-4f96-9867-036ab0c0490c req-d6b16a24-7597-4870-915b-cf0a660d7cd7 service nova] Creating event network-changed:a5a9685d-1d59-4fbb-a249-b32a53d0668d for instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 on n-h1-858383-16 Oct 27 09:01:42.302721 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fc145e55-8575-4f96-9867-036ab0c0490c req-d6b16a24-7597-4870-915b-cf0a660d7cd7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034625 Oct 27 09:01:42.303956 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 300/615] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:42.310904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9a1e06c-34ee-425a-89fb-68cd281cc285 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:42.312689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:42.318266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9a1e06c-34ee-425a-89fb-68cd281cc285 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:42.319014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9a1e06c-34ee-425a-89fb-68cd281cc285 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:42.320365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9a1e06c-34ee-425a-89fb-68cd281cc285 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:42.321843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9a1e06c-34ee-425a-89fb-68cd281cc285 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:42.322454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9a1e06c-34ee-425a-89fb-68cd281cc285 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:42.323876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9a1e06c-34ee-425a-89fb-68cd281cc285 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:42.362615 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9a1e06c-34ee-425a-89fb-68cd281cc285 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.057217 Oct 27 09:01:42.364010 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 301/616] 10.222.0.25 () {60 vars in 1217 bytes} [Thu Oct 27 09:01:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:01:42.387952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-16", "block_migration": "auto"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:42.392124 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f13531c4-ce1f-40d6-bce4-7875bb238d65 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1276 microversion: 2.1 time: 0.281863 Oct 27 09:01:42.395739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:42.396599 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 316/617] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:42 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:42.408029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:42.410441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:42.411760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:42.413328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:42.413789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:42.414215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:42.475104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'flavor' on Instance uuid 825baa14-c4b5-47d3-ade1-af3f779cd623 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:01:42.508450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:42.509110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:42.510518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Going to try to live migrate instance to n-h2-858383-16 {{(pid=120603) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:01:42.532587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:42.534070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:42.534749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:42.535661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:42.536422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:42.536929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:42.537859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:43.531366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:43.541369 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4198bb43-9df7-417e-94e0-95e6375c44ac tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1313 microversion: 2.1 time: 1.044764 Oct 27 09:01:43.557052 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 317/618] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:42 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1313 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:43.563677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:43.564937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:43.572011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:43.575034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:43.575806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:43.576725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:43.577192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:43.577776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:43.872021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:43.883967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:43.890194 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-864e258f-00a9-4031-9815-15d414f80bf6 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.331491 Oct 27 09:01:43.893981 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 318/619] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:43 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:43.907042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:43.909094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:43.926721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:43.929017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:43.932330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:43.933330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:43.933963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:43.934732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:44.178917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:44.189482 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33fc4a5d-2666-4d7a-9c17-92438c6af0bc tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.291861 Oct 27 09:01:44.206247 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 319/620] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:43 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:44.217151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:44.218166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:44.231806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:44.232693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:44.233757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:44.239892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:44.241216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:44.242040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:44.565126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:44.581449 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dde1f9d4-26ce-4ec1-8553-fe6dfa1b75b1 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1318 microversion: 2.1 time: 0.369520 Oct 27 09:01:44.585154 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 320/621] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:44 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:44.600348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-26f4c67d-c038-4929-b3b7-3bb857aaaa01 req-a4640901-d90a-4986-884a-5daefcc24f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86540b3-57b5-4a77-9c7b-93af29f15deb", "tag": "34982f27-4a32-4230-8887-24c8c503dc30"}, {"name": "network-changed", "server_uuid": "224cd91a-b045-40e1-a226-451983e44fa5", "tag": "c5ae8671-fffc-4a9f-9053-5c79098b2c67"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:44.613833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-26f4c67d-c038-4929-b3b7-3bb857aaaa01 req-a4640901-d90a-4986-884a-5daefcc24f88 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:44.614414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-26f4c67d-c038-4929-b3b7-3bb857aaaa01 req-a4640901-d90a-4986-884a-5daefcc24f88 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:44.614911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-26f4c67d-c038-4929-b3b7-3bb857aaaa01 req-a4640901-d90a-4986-884a-5daefcc24f88 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:44.630088 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-26f4c67d-c038-4929-b3b7-3bb857aaaa01 req-a4640901-d90a-4986-884a-5daefcc24f88 service nova] Creating event network-changed:34982f27-4a32-4230-8887-24c8c503dc30 for instance c86540b3-57b5-4a77-9c7b-93af29f15deb on n-h2-858383-16 Oct 27 09:01:44.630705 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-26f4c67d-c038-4929-b3b7-3bb857aaaa01 req-a4640901-d90a-4986-884a-5daefcc24f88 service nova] Creating event network-changed:c5ae8671-fffc-4a9f-9053-5c79098b2c67 for instance 224cd91a-b045-40e1-a226-451983e44fa5 on n-h1-858383-16 Oct 27 09:01:44.641453 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-26f4c67d-c038-4929-b3b7-3bb857aaaa01 req-a4640901-d90a-4986-884a-5daefcc24f88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048020 Oct 27 09:01:44.642525 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 321/622] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:44.648218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:44.648910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:44.656671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:44.657161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:44.657662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:44.658364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:44.658859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:44.659342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:44.902830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:44.912796 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-53634e10-87fe-4b73-8e09-3cc390805be4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1313 microversion: 2.1 time: 0.269041 Oct 27 09:01:44.913395 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 322/623] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:44 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:44.920432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:44.921358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:44.927618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:44.928381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:44.929055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:44.930005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:44.930775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:44.931724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:45.182866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:45.199080 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4d7a46ef-02e0-4db3-aacd-e99a7cf53dbf tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.281726 Oct 27 09:01:45.202551 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 323/624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:44 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:45.219168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:45.221311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:45.228698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:45.229205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:45.229648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:45.238881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:45.240178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:45.240647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:45.659599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:45.675628 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c39c3abd-3653-4537-a9b8-1e2d0b1b110e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.461634 Oct 27 09:01:45.681140 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 324/625] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:45 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:45.707731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:45.716975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:45.732225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:45.732729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:45.733541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:45.734682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:45.735188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:45.735688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:46.521863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:46.542205 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59169d0e-7fac-48ad-b01a-089ee8af01f9 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1318 microversion: 2.1 time: 0.859665 Oct 27 09:01:46.542941 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 325/626] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:45 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1318 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:46.559210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:46.560003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:46.607377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:46.607925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:46.608377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:46.609098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:46.617123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:46.618346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:47.441577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:47.459025 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5ba4c96d-cc1b-40d5-8479-c5a09143fa19 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1313 microversion: 2.1 time: 0.914906 Oct 27 09:01:47.460299 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 326/627] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:46 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:47.467028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:47.468074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:47.485457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:47.486204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:47.486777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:47.488345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:47.488985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:47.489592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:47.530124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:47.617331 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-27d968d0-1118-4b06-a7d6-221b19fee8b9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623/action" status: 202 len: 0 microversion: 2.25 time: 5.238228 Oct 27 09:01:47.624488 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 302/628] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:01:42 2022] POST /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623/action => generated 0 bytes in 5248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:01:47.630534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:47.631295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:47.648507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:47.649062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:47.649589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:47.650400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:47.650917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:47.651401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:48.224728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:48.246438 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-65b2d695-976f-4d87-934b-34f4da53f106 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.784727 Oct 27 09:01:48.247028 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 327/629] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:47 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:48.266199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:48.267091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:48.273937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:48.274669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:48.282916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:48.283933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:48.285718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:48.286346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:48.317324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:48.343233 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d893c216-0da8-4420-9a21-b0eccb7bcb13 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.716954 Oct 27 09:01:48.353420 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 303/630] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:47 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:48.360676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:48.362194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:48.372491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:48.373612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:48.375643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:48.376758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:48.378134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:48.379262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:48.452955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=28 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:49.251636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=28 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:49.571818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:49.584069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:49.593510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:49.602933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:49.609653 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b1f5a8ac-f9d9-42bf-9852-735713f19337 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1318 microversion: 2.1 time: 1.346193 Oct 27 09:01:49.614347 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 328/631] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:48 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1318 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:49.620623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:49.622089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:49.625006 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-28c647ea-e06d-4f13-b902-6740ca767e93 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 1.275734 Oct 27 09:01:49.636454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:49.637280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:49.638622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:49.639639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:49.640474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:49.641100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:49.642768 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 304/632] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:48 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:49.653225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-821cf08b-cc8e-4961-9bf1-c3bd21570af4 req-68aa10d8-7beb-40b9-8b5f-ae11175e911b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930", "tag": "9f3c4e6a-f571-473e-9df4-241d19271647"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:49.662894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:49.665792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-821cf08b-cc8e-4961-9bf1-c3bd21570af4 req-68aa10d8-7beb-40b9-8b5f-ae11175e911b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:49.666572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-821cf08b-cc8e-4961-9bf1-c3bd21570af4 req-68aa10d8-7beb-40b9-8b5f-ae11175e911b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:49.667227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-821cf08b-cc8e-4961-9bf1-c3bd21570af4 req-68aa10d8-7beb-40b9-8b5f-ae11175e911b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:49.687514 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-821cf08b-cc8e-4961-9bf1-c3bd21570af4 req-68aa10d8-7beb-40b9-8b5f-ae11175e911b service nova] Creating event network-changed:9f3c4e6a-f571-473e-9df4-241d19271647 for instance b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 on n-h2-858383-16 Oct 27 09:01:49.693708 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-821cf08b-cc8e-4961-9bf1-c3bd21570af4 req-68aa10d8-7beb-40b9-8b5f-ae11175e911b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048738 Oct 27 09:01:49.695249 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 305/633] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:49.702111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:49.703990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:49.711312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:49.713295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:49.713970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:49.715070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:49.715876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:49.716519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:50.156167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:50.165353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46e3e270-36cf-4da2-9619-8f3b00b9fe22 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.468019 Oct 27 09:01:50.184157 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 306/634] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:49 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:50.184157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:50.184157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:50.195128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:50.200556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:50.201296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:50.202244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:50.202877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:50.203836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:50.223193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:50.233609 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b7db8372-1b22-4fcd-9cf2-f07e61a5424c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1313 microversion: 2.1 time: 0.617608 Oct 27 09:01:50.249126 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 329/635] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:49 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:50.269184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2e6f4dc7-abc6-44a7-b89e-7cd93ff93ffa req-d71a29eb-1fac-46ce-8471-3e7dd502a63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86540b3-57b5-4a77-9c7b-93af29f15deb", "name": "network-vif-plugged", "status": "completed", "tag": "34982f27-4a32-4230-8887-24c8c503dc30"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:50.286910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2e6f4dc7-abc6-44a7-b89e-7cd93ff93ffa req-d71a29eb-1fac-46ce-8471-3e7dd502a63d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:50.287396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2e6f4dc7-abc6-44a7-b89e-7cd93ff93ffa req-d71a29eb-1fac-46ce-8471-3e7dd502a63d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:50.291237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2e6f4dc7-abc6-44a7-b89e-7cd93ff93ffa req-d71a29eb-1fac-46ce-8471-3e7dd502a63d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:50.320295 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2e6f4dc7-abc6-44a7-b89e-7cd93ff93ffa req-d71a29eb-1fac-46ce-8471-3e7dd502a63d service nova] Creating event network-vif-plugged:34982f27-4a32-4230-8887-24c8c503dc30 for instance c86540b3-57b5-4a77-9c7b-93af29f15deb on n-h2-858383-16 Oct 27 09:01:50.327971 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2e6f4dc7-abc6-44a7-b89e-7cd93ff93ffa req-d71a29eb-1fac-46ce-8471-3e7dd502a63d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070666 Oct 27 09:01:50.332495 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 330/636] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:50.635427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:50.636230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:50.648580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:50.651415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:50.652125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:50.658098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:50.659751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:50.660450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:50.838921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:50.854590 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ec750d1-01f3-4077-b6ed-2e73633aad66 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.683063 Oct 27 09:01:50.856208 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 307/637] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:50 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:50.861638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:50.862598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:50.872765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:50.873570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:50.874169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:50.879794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:50.881419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:50.885375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:51.155794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:51.179157 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-32594e86-9e88-4751-a797-e6e463696447 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1318 microversion: 2.1 time: 0.548156 Oct 27 09:01:51.191767 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 331/638] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:50 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:51.203637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:51.203637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:51.210709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:51.211869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:51.212899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:51.213801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:51.214576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:51.215453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:51.370965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:51.400607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:51.412715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:51.417045 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-779d1133-6ef1-4721-b113-7bfe44d8272c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.558544 Oct 27 09:01:51.439092 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 308/639] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:50 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:51.456369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:51.457446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:51.476113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:51.477701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:51.478454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:51.479900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:51.480886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:51.482023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:51.742979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:51.752648 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2b231110-875c-4460-9df4-ca3e3895eed8 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.558312 Oct 27 09:01:51.756491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 332/640] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:51 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:01:51.833348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:51.852697 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c79c7dd-8bd1-415f-84a6-bf6b3f42bbf4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1313 microversion: 2.1 time: 0.406137 Oct 27 09:01:51.856209 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 309/641] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:51 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:51.882842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:51.883516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:51.895608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:51.896968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:51.897491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:51.898336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:51.902719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:51.904968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:52.219897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:52.220580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:52.232067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:52.232617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:52.240438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:52.241281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:52.242057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:52.242192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:52.273002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:52.294574 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-195c49e0-a064-4a9f-8993-32334430b8a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.415079 Oct 27 09:01:52.296380 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 333/642] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:51 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:52.363795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:52.389072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8a02d8d8-6792-44dd-9dd2-b3017ca7dc97 req-b5f58b1b-3d86-40d8-a1e5-fbfe4ad15834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb21e13f-718e-4afe-b3f3-97a05e9be9c6", "name": "network-vif-plugged", "status": "completed", "tag": "a5a9685d-1d59-4fbb-a249-b32a53d0668d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:52.435283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8a02d8d8-6792-44dd-9dd2-b3017ca7dc97 req-b5f58b1b-3d86-40d8-a1e5-fbfe4ad15834 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:52.436212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8a02d8d8-6792-44dd-9dd2-b3017ca7dc97 req-b5f58b1b-3d86-40d8-a1e5-fbfe4ad15834 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:52.437074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8a02d8d8-6792-44dd-9dd2-b3017ca7dc97 req-b5f58b1b-3d86-40d8-a1e5-fbfe4ad15834 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:52.460175 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8a02d8d8-6792-44dd-9dd2-b3017ca7dc97 req-b5f58b1b-3d86-40d8-a1e5-fbfe4ad15834 service nova] Creating event network-vif-plugged:a5a9685d-1d59-4fbb-a249-b32a53d0668d for instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 on n-h1-858383-16 Oct 27 09:01:52.468846 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8a02d8d8-6792-44dd-9dd2-b3017ca7dc97 req-b5f58b1b-3d86-40d8-a1e5-fbfe4ad15834 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101975 Oct 27 09:01:52.470192 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 334/643] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:52.477900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:52.487431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:52.529787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:52.530476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:52.531125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:52.538860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:52.539688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:52.547933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:52.895513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:52.908039 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88590ada-7258-447f-b422-a33de02c1f24 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1318 microversion: 2.1 time: 0.693549 Oct 27 09:01:52.924018 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 310/644] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:52 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1318 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:52.933072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:52.933698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:52.950859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:52.951367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:52.951862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:52.952602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:52.953070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:52.953558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:53.105859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:53.116552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:53.118285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:53.119750 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3841393c-f718-4ee8-9766-2d00462a52d7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.646764 Oct 27 09:01:53.120387 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 335/645] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:52 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:53.128418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:53.130112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:53.150239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:53.152711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:53.153163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:53.155852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:53.156540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:53.156973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:53.296221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:53.306960 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-074d83df-1ff8-4723-bd2a-d9e8d39e11aa tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.380898 Oct 27 09:01:53.308848 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 311/646] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:52 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:53.335715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:53.339542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:53.345152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:53.345983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:53.346633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:53.347873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:53.348523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:53.349296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:53.502002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:53.512388 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2385b035-618c-4c98-b765-6aeb1999844f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1313 microversion: 2.1 time: 0.390614 Oct 27 09:01:53.513547 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 336/647] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:53 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:53.598125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:53.608273 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0b7c2fb-2e39-4a45-ac10-3e7c48c37767 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1504 microversion: 2.1 time: 0.279427 Oct 27 09:01:53.609294 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 312/648] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:53 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:53.937255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:53.937863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:53.952504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:53.953379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:53.954018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:53.954808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:53.955610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:53.956128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:54.150337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:54.151024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:54.165866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:54.166933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:54.168887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:54.169910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:54.170575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:54.171028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:54.560646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:54.584828 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa66bb49-cfc5-434a-bc3a-534c07f13353 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1318 microversion: 2.1 time: 0.650476 Oct 27 09:01:54.612659 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 337/649] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:53 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:54.626175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:54.627898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:54.648284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:54.649553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:54.650182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:54.651645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:54.653131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:54.653726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:54.665566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:54.680092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:54.682725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:54.696547 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec015058-40f9-4ad8-9137-1f02c7a49463 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.550758 Oct 27 09:01:54.719211 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 313/650] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:54 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:54.726639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:54.728073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:54.735300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:54.736590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:54.737401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:54.738300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:54.739192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:54.739945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:55.297780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:55.315790 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-166b56a8-974a-4aaf-8991-ed43137fcf81 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1313 microversion: 2.1 time: 0.700757 Oct 27 09:01:55.333516 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 338/651] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:54 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:55.344960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:55.345777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:55.365415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:55.366341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:55.367020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:55.368623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:55.369325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:55.370007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:55.409682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:55.434026 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-20c5fe71-b6ae-49ef-871c-238018844c5a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1463 microversion: 2.1 time: 0.709612 Oct 27 09:01:55.436822 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 314/652] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:54 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1463 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:55.457942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:55.460557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:55.467489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:55.468240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:55.468870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:55.469745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:55.470372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:55.470949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:55.575743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:55.591936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Old instance type m1.heat2, new instance type m1.heat {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 09:01:55.607522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:01:55.609313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:01:55.609569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:01:55.610004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:01:55.610424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:01:55.795473 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1162edb-79f9-4415-8afd-bdf0956508c6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6/action" status: 202 len: 0 microversion: 2.1 time: 0.339911 Oct 27 09:01:55.798784 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 315/653] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:01:55 2022] POST /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:01:55.812601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:55.816387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:55.831536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:55.832841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:55.833734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:55.834812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:55.841975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:55.842655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:55.846480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:55.860600 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-033b411c-a782-4b91-b635-a5ab4e262b53 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1479 microversion: 2.1 time: 0.525763 Oct 27 09:01:55.861528 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 339/654] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:55 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1479 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:55.873881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:55.874939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:55.889181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:55.893123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:55.894192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:55.894726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:55.896183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:55.899827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:56.289984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:56.308803 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f36458da-0ee9-407e-aafa-8079e3fb2388 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1318 microversion: 2.1 time: 0.507805 Oct 27 09:01:56.311507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:56.319734 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 316/655] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:55 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:56.320125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:56.321840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:56.330589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:56.331975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:56.333179 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-355c848f-ebc3-43a8-bef4-82196401f890 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.470527 Oct 27 09:01:56.344501 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 340/656] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:55 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:56.344828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:56.344828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:56.344828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:56.344828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:56.353881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:56.353881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:56.354233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-014fe21b-d978-4a06-b254-d94068dd96c5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '.version_select at 0x7f31aa803d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:56.354233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014fe21b-d978-4a06-b254-d94068dd96c5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:56.354454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014fe21b-d978-4a06-b254-d94068dd96c5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:56.354906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:56.371116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014fe21b-d978-4a06-b254-d94068dd96c5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:56.401604 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-014fe21b-d978-4a06-b254-d94068dd96c5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1916 microversion: 2.1 time: 0.066822 Oct 27 09:01:56.411808 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 341/657] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:01:56 2022] GET /compute/v2.1/os-migrations => generated 1916 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:56.437152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:56.441415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:56.457286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:56.457808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:56.458261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:56.463242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:56.464516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:56.464984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:57.012032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:57.022404 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b50593d1-02ee-4313-823d-e716581e3540 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1462 microversion: 2.1 time: 0.603027 Oct 27 09:01:57.022999 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 342/658] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:56 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1462 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:57.045644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a368c37c-d9cf-425e-ba3b-41804d5fbd83 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:57.046271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a368c37c-d9cf-425e-ba3b-41804d5fbd83 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:57.061063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a368c37c-d9cf-425e-ba3b-41804d5fbd83 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:57.061566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a368c37c-d9cf-425e-ba3b-41804d5fbd83 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:57.062006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a368c37c-d9cf-425e-ba3b-41804d5fbd83 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:57.064063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a368c37c-d9cf-425e-ba3b-41804d5fbd83 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:57.066209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a368c37c-d9cf-425e-ba3b-41804d5fbd83 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:57.066845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a368c37c-d9cf-425e-ba3b-41804d5fbd83 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:57.417771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:57.429149 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1c999d5-8bf5-4cac-be29-cace5b4364e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1472 microversion: 2.1 time: 1.115361 Oct 27 09:01:57.442463 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 317/659] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:56 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1472 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:57.804128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0715361c-0573-4bfd-abd5-56078fd8582e tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Calling method '.version_select at 0x7f31aa71eb80>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:57.826948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0715361c-0573-4bfd-abd5-56078fd8582e tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:57.829032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0715361c-0573-4bfd-abd5-56078fd8582e tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:57.831536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0715361c-0573-4bfd-abd5-56078fd8582e tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:57.858593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0715361c-0573-4bfd-abd5-56078fd8582e tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:57.859340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0715361c-0573-4bfd-abd5-56078fd8582e tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:57.860040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0715361c-0573-4bfd-abd5-56078fd8582e tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:57.887213 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0715361c-0573-4bfd-abd5-56078fd8582e tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/efbe61afca914be4ad3877de683ae7c2?start=2022-10-26T09%3A01%3A57.038407&end=2022-10-28T09%3A01%3A57.038407" status: 200 len: 694 microversion: 2.1 time: 0.448820 Oct 27 09:01:57.888167 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 318/660] 10.222.0.25 () {58 vars in 1412 bytes} [Thu Oct 27 09:01:57 2022] GET /compute/v2.1/os-simple-tenant-usage/efbe61afca914be4ad3877de683ae7c2?start=2022-10-26T09%3A01%3A57.038407&end=2022-10-28T09%3A01%3A57.038407 => generated 694 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:57.893545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:57.894456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:57.907692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:57.908563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:57.909261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:57.910191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:57.910722 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a368c37c-d9cf-425e-ba3b-41804d5fbd83 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1632 microversion: 2.1 time: 0.884014 Oct 27 09:01:57.911129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:57.911789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:57.923592 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 343/661] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:57 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1632 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:57.923592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:57.923592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:57.941104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:57.943917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:57.944736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:57.945959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:57.946666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:57.947338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:58.467972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:58.479224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:58.481087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:58.482831 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47e5c74b-8d24-45f4-80a6-36c0962a8d56 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.568371 Oct 27 09:01:58.483730 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 344/662] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:01:57 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:01:58.488961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:58.489684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:58.490757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:58.496734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:58.497427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:58.498035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:58.498913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:58.499523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:58.500173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:58.502702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7830f8f-afa7-4bde-b15b-b242a46f01b3 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1318 microversion: 2.1 time: 0.613084 Oct 27 09:01:58.505849 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 319/663] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:57 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:58.522417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-05bfdac0-bd79-4f67-ac13-1acbee0a077a tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '.version_select at 0x7f31aa743c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:58.538201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05bfdac0-bd79-4f67-ac13-1acbee0a077a tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:58.545123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05bfdac0-bd79-4f67-ac13-1acbee0a077a tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:58.546036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05bfdac0-bd79-4f67-ac13-1acbee0a077a tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:58.553756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:01:58.559670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:58.566695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05bfdac0-bd79-4f67-ac13-1acbee0a077a tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:58.571034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05bfdac0-bd79-4f67-ac13-1acbee0a077a tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:58.571755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05bfdac0-bd79-4f67-ac13-1acbee0a077a tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:58.593646 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-05bfdac0-bd79-4f67-ac13-1acbee0a077a tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/efbe61afca914be4ad3877de683ae7c2?start=2022-10-26T09%3A01%3A57.038407&end=2022-10-28T09%3A01%3A57.038407" status: 200 len: 693 microversion: 2.1 time: 0.080824 Oct 27 09:01:58.611812 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 320/664] 10.222.0.25 () {58 vars in 1412 bytes} [Thu Oct 27 09:01:58 2022] GET /compute/v2.1/os-simple-tenant-usage/efbe61afca914be4ad3877de683ae7c2?start=2022-10-26T09%3A01%3A57.038407&end=2022-10-28T09%3A01%3A57.038407 => generated 693 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:58.629104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c5cee22-f894-489c-9cba-f1802766a00f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Action: 'create', calling method: .version_select at 0x7f31aa800430>, body: {"keypair": {"name": "tempest-keypair-372968228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ6FGTPvLobLr8HJnSbG3L1U6Np2utpBg4MeAiaii9yUpyUipAjfV/LcUoWi2bpo7jRFPc9tx/vChAifnhHfRuprO9+7/kXoKjuj5uOpM7z/7e9B1R8lAHWKjxiNnaPkA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:58.675949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1c5cee22-f894-489c-9cba-f1802766a00f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for project 37b756ad383a4cf18b7da7565a51572e. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:01:58.687032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1c5cee22-f894-489c-9cba-f1802766a00f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for user aff1721693734cc8937a84d9b8a483dd and project 37b756ad383a4cf18b7da7565a51572e. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:01:58.709701 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-967df5e3-4ed1-4898-9255-eb2da637708b tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 204 len: 0 microversion: 2.1 time: 0.223310 Oct 27 09:01:58.717191 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 345/665] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:01:58 2022] DELETE /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:01:58.731722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:58.736065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:58.749035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:01:58.756129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:58.758880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:58.759379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:58.760252 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c5cee22-f894-489c-9cba-f1802766a00f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.145869 Oct 27 09:01:58.767045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:58.767045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:58.767415 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 321/666] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:01:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:01:58.767551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:58.775134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bdc18a2b-ad39-4dad-83ee-8d921facfcbc tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Calling method '.version_select at 0x7f31aa743ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:58.798462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc18a2b-ad39-4dad-83ee-8d921facfcbc tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:58.801303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc18a2b-ad39-4dad-83ee-8d921facfcbc tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:58.804255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc18a2b-ad39-4dad-83ee-8d921facfcbc tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:58.855531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc18a2b-ad39-4dad-83ee-8d921facfcbc tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:58.860104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc18a2b-ad39-4dad-83ee-8d921facfcbc tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:58.860591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc18a2b-ad39-4dad-83ee-8d921facfcbc tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:58.923392 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bdc18a2b-ad39-4dad-83ee-8d921facfcbc tempest-TenantUsagesTestJSON-2044839449 tempest-TenantUsagesTestJSON-2044839449-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T09%3A01%3A57.038407&end=2022-10-28T09%3A01%3A57.038407&detailed=1" status: 200 len: 7013 microversion: 2.1 time: 0.159037 Oct 27 09:01:58.924526 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 322/667] 10.222.0.25 () {58 vars in 1335 bytes} [Thu Oct 27 09:01:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T09%3A01%3A57.038407&end=2022-10-28T09%3A01%3A57.038407&detailed=1 => generated 7013 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:58.933475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-889018490", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "1997814556", "adminPass": "***", "networks": [{"uuid": "11ff25de-be4a-46e6-bdd1-d8c7391433b5"}], "security_groups": [{"name": "tempest-securitygroup--690748186"}], "key_name": "tempest-keypair-1745641971", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:01:59.649894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] validate_networks() for [('11ff25de-be4a-46e6-bdd1-d8c7391433b5', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:01:59.797398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:01:59.812247 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5df4fa40-cbc7-4ac3-b632-bc882cc76dc6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1472 microversion: 2.1 time: 1.093260 Oct 27 09:01:59.814006 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 346/668] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:01:58 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1472 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:01:59.824155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:01:59.825030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:01:59.834327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:59.840042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:59.841666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:59.843553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:01:59.847871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:01:59.849881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:01:59.911819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:02:00.056852 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4b522fe4-1c22-45d6-837d-832b3a4ef98e tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 204 len: 0 microversion: 2.1 time: 0.239856 Oct 27 09:02:00.058580 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 347/669] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:01:59 2022] DELETE /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:02:00.067926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7fef9bef-74e0-4bca-a603-3672df48d7af req-3f146248-3ec9-4585-a0c2-4c176715f19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930", "name": "network-vif-plugged", "status": "completed", "tag": "9f3c4e6a-f571-473e-9df4-241d19271647"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:00.116560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7fef9bef-74e0-4bca-a603-3672df48d7af req-3f146248-3ec9-4585-a0c2-4c176715f19a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:00.118065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7fef9bef-74e0-4bca-a603-3672df48d7af req-3f146248-3ec9-4585-a0c2-4c176715f19a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:00.119029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7fef9bef-74e0-4bca-a603-3672df48d7af req-3f146248-3ec9-4585-a0c2-4c176715f19a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:00.131908 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7fef9bef-74e0-4bca-a603-3672df48d7af req-3f146248-3ec9-4585-a0c2-4c176715f19a service nova] Creating event network-vif-plugged:9f3c4e6a-f571-473e-9df4-241d19271647 for instance b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 on n-h2-858383-16 Oct 27 09:02:00.138824 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7fef9bef-74e0-4bca-a603-3672df48d7af req-3f146248-3ec9-4585-a0c2-4c176715f19a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078692 Oct 27 09:02:00.139426 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 348/670] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:00.144818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:00.145513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:00.158217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:00.159163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:00.159819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:00.163269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:00.164937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:00.165373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:00.854921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:00.873283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:00.877405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:00.880776 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6f5b1f9-4f0d-4002-b4e4-d8d655aa9bb3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.737989 Oct 27 09:02:00.881452 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 349/671] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:00 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:00.896522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:00.898981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:00.908116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:00.909134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:00.910169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:00.911347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:00.912112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:00.912553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:01.124182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:02:01.125449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:02:01.126136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:02:01.127744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:02:01.128400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:02:01.149754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:01.150419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:01.150962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:01.151888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:01.153758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:01.154310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:01.194713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Getting quotas for project 7ee4717f40ee493aa3aa1c7f37d5ffbe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:02:01.200414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Getting quotas for user 57135e8924954c2da220af70744f9a2b and project 7ee4717f40ee493aa3aa1c7f37d5ffbe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:02:01.212870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:02:01.216337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:02:01.293530 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00de5204-5430-4843-b2c4-bc6383d0d2af tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.367524 Oct 27 09:02:01.296629 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 323/672] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:01:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:02:01.311283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:01.312290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:01.322840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:01.324231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:01.324901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:01.325772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:01.326368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:01.327456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:01.602417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:01.614239 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-729d7494-31f6-458d-91be-4104371c369d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1318 microversion: 2.1 time: 0.728968 Oct 27 09:02:01.618167 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 350/673] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:00 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:01.631778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:01.633213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:01.649452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:01.650185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:01.651734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:01.653955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:01.656493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:01.657316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:02.063460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:02.075960 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f66064c-fa43-4417-8156-9fdb9f662e66 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1468 microversion: 2.1 time: 0.776487 Oct 27 09:02:02.091945 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 324/674] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:01 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1468 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:02.098267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1605774130", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ff9a447f-bbfd-4e05-944d-b9d8c867cecf"}], "security_groups": [{"name": "tempest-securitygroup--1503627225"}], "key_name": "tempest-keypair-372968228", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:02.280182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:02.295182 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7721cf21-a4b9-4f1d-83a2-5422bca5ceed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1472 microversion: 2.1 time: 0.674900 Oct 27 09:02:02.297804 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 351/675] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:01 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1472 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:02.316697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:02.320651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:02.354515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] validate_networks() for [('ff9a447f-bbfd-4e05-944d-b9d8c867cecf', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:02:02.357345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:02.357843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:02.369325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:02.370161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:02.370651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:02.371093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:02.532986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:02.545684 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-73560ef8-12ac-46f9-baa0-1476b25869fa tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1268 microversion: 2.1 time: 0.243702 Oct 27 09:02:02.547524 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 352/676] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:02 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1268 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:02.552402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:02.568686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:02.580229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:02.580984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:02.581589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:02.584203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:02.584891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:02.589428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:03.113996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:03.139244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:03.146179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:03.149190 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-514cb09a-5edb-4e7f-a002-332abd7c0cbf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.599307 Oct 27 09:02:03.152627 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 353/677] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:02 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:03.162403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:03.166236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:03.185486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:03.188486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:03.189137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:03.192210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:03.193887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:03.197501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:03.490557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:02:03.491055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:02:03.491444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:02:03.492690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:02:03.493110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:02:03.518852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:03.519348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:03.519806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:03.524442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:03.525089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:03.528070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:03.593693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for project 37b756ad383a4cf18b7da7565a51572e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:02:03.602434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for user aff1721693734cc8937a84d9b8a483dd and project 37b756ad383a4cf18b7da7565a51572e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:02:03.612848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:03.627168 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2c97b966-8d5a-4742-b170-2c2c41cabddd tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1468 microversion: 2.1 time: 0.473315 Oct 27 09:02:03.632192 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 354/678] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:03 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1468 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:03.643680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b67e5938-1383-43ec-b717-6d77224161fa req-35e85765-7a1c-4f49-acec-6495ef2a8073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825baa14-c4b5-47d3-ade1-af3f779cd623", "name": "network-vif-unplugged", "status": "completed", "tag": "b9670495-9893-4b00-a8fa-658c87304fa1"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:03.666176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:02:03.671762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b67e5938-1383-43ec-b717-6d77224161fa req-35e85765-7a1c-4f49-acec-6495ef2a8073 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:03.673997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b67e5938-1383-43ec-b717-6d77224161fa req-35e85765-7a1c-4f49-acec-6495ef2a8073 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:03.675517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b67e5938-1383-43ec-b717-6d77224161fa req-35e85765-7a1c-4f49-acec-6495ef2a8073 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:03.679372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:02:03.702838 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b67e5938-1383-43ec-b717-6d77224161fa req-35e85765-7a1c-4f49-acec-6495ef2a8073 service nova] Creating event network-vif-unplugged:b9670495-9893-4b00-a8fa-658c87304fa1 for instance 825baa14-c4b5-47d3-ade1-af3f779cd623 on n-h1-858383-16 Oct 27 09:02:03.718413 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b67e5938-1383-43ec-b717-6d77224161fa req-35e85765-7a1c-4f49-acec-6495ef2a8073 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082007 Oct 27 09:02:03.720955 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 355/679] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:03.733148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:03.736915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:03.751903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:03.752746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:03.754256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:03.756814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:03.757491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:03.760534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:03.817578 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-657e2067-76f8-49dd-9ef4-c92d24c711bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.724059 Oct 27 09:02:03.822732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 325/680] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:02:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:02:03.836926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:03.837945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:03.861812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:03.862915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:03.863888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:03.864849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:03.868057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:03.870259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:04.918497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e58a0c2bb443d68e4df4748455b64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbe61afca914be4ad3877de683ae7c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:04.940735 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5bb0dc00-605f-40bf-b3bc-d32d208d1cb3 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 200 len: 1426 microversion: 2.1 time: 1.215093 Oct 27 09:02:04.941388 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 356/681] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:03 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 1426 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:04.959596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1666877544", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f524d10b-7a75-4223-abd8-5f9b3110eb89"}], "security_groups": [{"name": "tempest-securitygroup--1489986502"}], "key_name": "tempest-keypair-971548891", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "a7e4c8d0-63ff-43da-bfeb-43d313ca83c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:05.161395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:05.185066 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ee667af-a165-4d4f-ad5a-90bc8f98e005 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 1.360678 Oct 27 09:02:05.190620 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 326/682] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:03 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:05.215426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:05.217661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:05.231292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:05.232457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:05.233407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:05.235177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:05.236009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:05.236648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:05.296112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] validate_networks() for [('f524d10b-7a75-4223-abd8-5f9b3110eb89', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:02:05.587839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:05.611218 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a7815af-c544-4129-b0af-0414e059e167 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1322 microversion: 2.1 time: 0.415586 Oct 27 09:02:05.612938 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 327/683] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:05 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:05.936798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1728884196", "block_migration": true, "disk_over_commit": false}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:05.941434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:05.964566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:05.965100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:05.965556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:05.968856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:05.969459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:05.975240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:06.048426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lazy-loading 'flavor' on Instance uuid b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:06.096458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Going to try to live migrate instance to tempest-host-1728884196 {{(pid=120603) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:02:06.108713 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] HTTP exception thrown: Compute host tempest-host-1728884196 could not be found. Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Request method failure captured: Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930/action HTTP/1.1 Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 107 Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjwk7iWO9AbyLOPgarfZl4gKHe4uHU8WC_OJOhdsgEtPZqo_DSUKjBQe6twQ3E7gjOANFGpRfWu5gJEn5iT5HBkVR1ltB0I7-V7h7Zc3gyOAT5gUxG3vlR6ZiJ7qfP8JBp74p3fUSPpwbbGPzuV0C9P51yfeSrZkPt0RGyPCrdxOPQ Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 24f768856ab74fc49bb1fc4f7abd582d Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-LiveMigrationNegativeTest-165349976 Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24f768856ab74fc49bb1fc4f7abd582d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24f768856ab74fc49bb1fc4f7abd582d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24f768856ab74fc49bb1fc4f7abd582d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24f768856ab74fc49bb1fc4f7abd582d"}]}] Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-LiveMigrationNegativeTest-165349976 Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 24f768856ab74fc49bb1fc4f7abd582d Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-165349976 Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-LiveMigrationNegativeTest-165349976-project-admin Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 718be7998b2c49caae6ebaf26aeb8e72 Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-LiveMigrationNegativeTest-165349976-project-admin Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: {"os-migrateLive": {"host": "tempest-host-1728884196", "block_migration": true, "disk_over_commit": false}} Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: exception: Compute host tempest-host-1728884196 could not be found. Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930', 'body': {'os-migrateLive': {'host': 'tempest-host-1728884196', 'block_migration': True, 'disk_over_commit': False}}} Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5489, in live_migrate Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 27 09:02:06.130028 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1728884196 could not be found. Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1728884196 could not be found. Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1728884196 could not be found. Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Returning 400 to user: Compute host tempest-host-1728884196 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:06.134492 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cdb5eda6-8434-454d-9e21-3949e411a925 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930/action" status: 400 len: 100 microversion: 2.1 time: 0.516554 Oct 27 09:02:06.140554 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 328/684] 10.222.0.25 () {60 vars in 1279 bytes} [Thu Oct 27 09:02:05 2022] POST /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930/action => generated 100 bytes in 523 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:02:06.150395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:06.151126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:06.166794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:06.168186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:06.168898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:06.169854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:06.170544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:06.171354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:06.509089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:06.520716 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0492a4aa-278c-4b1c-ba2a-99e1ab234086 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1286 microversion: 2.1 time: 0.382773 Oct 27 09:02:06.523935 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 329/685] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:06 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1286 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:06.534648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:06.535292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:06.559174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:06.561628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:06.561628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:06.561628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:06.565353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:06.569287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.079919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:07.096876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:07.099275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:07.100827 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-09c97c9c-dda5-49bf-8945-440d15b50c3e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.575846 Oct 27 09:02:07.102360 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 330/686] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:06 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:07.108914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9220c02b-f273-46a5-883b-7d9cfa0635dd req-a9c52db4-28f5-4ab5-aee2-ee5a35feafd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d008a476-b957-43e1-a895-4c894f28710c", "name": "network-vif-deleted", "tag": "c78cff33-79a1-4f60-af2e-aa6e1fa0007e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:07.112523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Getting quotas for project 00f19c40e6554a1f890cc7348bc30065. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:02:07.123797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Getting quotas for user eabd7061a0d647d1bb5a9c3d296f6217 and project 00f19c40e6554a1f890cc7348bc30065. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:02:07.126345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9220c02b-f273-46a5-883b-7d9cfa0635dd req-a9c52db4-28f5-4ab5-aee2-ee5a35feafd5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.126911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9220c02b-f273-46a5-883b-7d9cfa0635dd req-a9c52db4-28f5-4ab5-aee2-ee5a35feafd5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.133431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9220c02b-f273-46a5-883b-7d9cfa0635dd req-a9c52db4-28f5-4ab5-aee2-ee5a35feafd5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.147950 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9220c02b-f273-46a5-883b-7d9cfa0635dd req-a9c52db4-28f5-4ab5-aee2-ee5a35feafd5 service nova] Creating event network-vif-deleted:c78cff33-79a1-4f60-af2e-aa6e1fa0007e for instance d008a476-b957-43e1-a895-4c894f28710c on n-h1-858383-16 Oct 27 09:02:07.155435 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9220c02b-f273-46a5-883b-7d9cfa0635dd req-a9c52db4-28f5-4ab5-aee2-ee5a35feafd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051305 Oct 27 09:02:07.156870 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 331/687] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:07.162631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:07.163655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] [instance: c86540b3-57b5-4a77-9c7b-93af29f15deb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:07.166759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:07.171940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:02:07.173207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:02:07.173716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:02:07.174045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.174523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:02:07.174523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:02:07.175499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.176204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.177305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.177968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.178607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.205629 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] HTTP exception thrown: Instance c86540b3-57b5-4a77-9c7b-93af29f15deb could not be found. Oct 27 09:02:07.205905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Request method failure captured: Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb HTTP/1.1 Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjodMq5speUBnpQb7IKUhx_HI5aaU3nyJnSzMac-_bingv4mDtrEGlMmOi8FHWmzSm2_mS-tEJyUG-2KDCQq-uOebeUgwcGNlE1nK8sILsGIEP--4sGIUBkcqQ9G2XJlvfbgCpnWG6hP5YIaQeQ8el6t8nLbeG04IpGaL_SDdW0Gzg Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: efbe61afca914be4ad3877de683ae7c2 Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TenantUsagesTestJSON-1433785022 Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efbe61afca914be4ad3877de683ae7c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efbe61afca914be4ad3877de683ae7c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efbe61afca914be4ad3877de683ae7c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efbe61afca914be4ad3877de683ae7c2"}]}] Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TenantUsagesTestJSON-1433785022 Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: efbe61afca914be4ad3877de683ae7c2 Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1433785022 Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TenantUsagesTestJSON-1433785022-project Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 03e58a0c2bb443d68e4df4748455b64b Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TenantUsagesTestJSON-1433785022-project Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance c86540b3-57b5-4a77-9c7b-93af29f15deb could not be found. Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'c86540b3-57b5-4a77-9c7b-93af29f15deb'} Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c86540b3-57b5-4a77-9c7b-93af29f15deb could not be found. Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86540b3-57b5-4a77-9c7b-93af29f15deb could not be found. Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:07.208118 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:07.212943 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:07.212943 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:07.212943 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:07.212943 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:07.212943 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:07.212943 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86540b3-57b5-4a77-9c7b-93af29f15deb could not be found. Oct 27 09:02:07.212943 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:07.213394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.213394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.213394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.213394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.215895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] Returning 404 to user: Instance c86540b3-57b5-4a77-9c7b-93af29f15deb could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:07.216537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.217426 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a45602e3-8d02-4ae9-b292-d64e9e3ad271 tempest-TenantUsagesTestJSON-1433785022 tempest-TenantUsagesTestJSON-1433785022-project] 10.222.0.25 "GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb" status: 404 len: 111 microversion: 2.1 time: 0.059275 Oct 27 09:02:07.218526 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 332/688] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:07 2022] GET /compute/v2.1/servers/c86540b3-57b5-4a77-9c7b-93af29f15deb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:02:07.238982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:07.241268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:07.252739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.258799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.261032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.261990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.262470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.262909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.315865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Getting quotas for project 00f19c40e6554a1f890cc7348bc30065. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:02:07.334204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Getting quotas for user eabd7061a0d647d1bb5a9c3d296f6217 and project 00f19c40e6554a1f890cc7348bc30065. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:02:07.434609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:02:07.437576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7e4c8d0-63ff-43da-bfeb-43d313ca83c0',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:02:07.706975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:07.727218 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ed560e22-bcf7-415c-a03f-71a60ad0f852 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1468 microversion: 2.1 time: 0.495589 Oct 27 09:02:07.743715 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 333/689] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:07 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:07.743715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:07.743715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:07.745283 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bbc0c00d-f666-4300-a65b-1fa3172febd8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.798790 Oct 27 09:02:07.746671 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 357/690] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:02:04 2022] POST /compute/v2.1/servers => generated 407 bytes in 2804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:02:07.761227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2aaf21e4-f4dd-4b1b-9275-a44be82a84de req-7ba597a8-3fb4-4cec-84bd-d75c14641f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825baa14-c4b5-47d3-ade1-af3f779cd623", "tag": "b9670495-9893-4b00-a8fa-658c87304fa1"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:07.776764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.777275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2aaf21e4-f4dd-4b1b-9275-a44be82a84de req-7ba597a8-3fb4-4cec-84bd-d75c14641f57 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.777997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2aaf21e4-f4dd-4b1b-9275-a44be82a84de req-7ba597a8-3fb4-4cec-84bd-d75c14641f57 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.778804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2aaf21e4-f4dd-4b1b-9275-a44be82a84de req-7ba597a8-3fb4-4cec-84bd-d75c14641f57 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.785777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.786344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.787111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.787610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.788052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.794325 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2aaf21e4-f4dd-4b1b-9275-a44be82a84de req-7ba597a8-3fb4-4cec-84bd-d75c14641f57 service nova] Creating event network-changed:b9670495-9893-4b00-a8fa-658c87304fa1 for instance 825baa14-c4b5-47d3-ade1-af3f779cd623 on n-h1-858383-16 Oct 27 09:02:07.801320 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2aaf21e4-f4dd-4b1b-9275-a44be82a84de req-7ba597a8-3fb4-4cec-84bd-d75c14641f57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052966 Oct 27 09:02:07.802741 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 358/691] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:07.825076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:07.827365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:07.836774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.837915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.838816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:07.839854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:07.840742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:07.841377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:08.068437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:08.083289 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-615bfcd8-16ba-413d-9181-ed5923f6d8b7 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1322 microversion: 2.1 time: 0.278944 Oct 27 09:02:08.095627 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 359/692] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:07 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:08.097687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:08.098289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:08.110443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:08.110943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:08.111386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:08.112123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:08.112582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:08.113088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:08.369360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:08.389280 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c7338e0-5aaf-4a98-8a42-0c685477a725 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1292 microversion: 2.1 time: 0.303858 Oct 27 09:02:08.406858 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 360/693] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:08 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1292 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:08.413008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2539b692-b04c-449e-877d-980cd7ecdc62 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:08.413872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2539b692-b04c-449e-877d-980cd7ecdc62 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:08.509128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2539b692-b04c-449e-877d-980cd7ecdc62 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:08.517117 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2539b692-b04c-449e-877d-980cd7ecdc62 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1121 microversion: 2.1 time: 0.108849 Oct 27 09:02:08.533845 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 361/694] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:08 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1121 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:08.541971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1217518247", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:08.574309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:08.583902 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2fac41c5-48c9-4d1d-8422-f4717f53086c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 0.854269 Oct 27 09:02:08.603592 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 334/695] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:07 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:08.603592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:08.603592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:08.611741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:08.612243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:08.612936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:08.613653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:08.614117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:08.614564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:08.623824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:02:09.019608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:09.044890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:09.046628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:09.048054 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c88a7d8f-6e9d-4ffe-b29d-6860d2c9f3a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.455013 Oct 27 09:02:09.049113 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 335/696] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:08 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:09.111044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:09.111696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:09.121995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:09.124593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:09.125095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:09.125841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:09.126315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:09.149949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:09.544759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:02:09.545605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:02:09.545605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:02:09.545936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:02:09.546346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:02:09.572110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:09.573903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:09.574207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:09.575205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:09.575865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:09.576293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:09.601629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Getting quotas for project fdefc8ef9ac54c2295f8ed1c7e5c0af6. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:02:09.613184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Getting quotas for user 1b81d8567c74491497aa9005c32412dd and project fdefc8ef9ac54c2295f8ed1c7e5c0af6. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:02:09.647743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:02:09.651089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:02:09.718049 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ddaac34f-cd2c-4ca4-aac1-9913108a3cea tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.181845 Oct 27 09:02:09.720391 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 362/697] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:02:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:02:09.724392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:09.733612 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0bacb86-596b-4869-89e4-b6b0eea0fd85 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 0.626367 Oct 27 09:02:09.733827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a14b49e9-c865-4f3d-bc2d-c59501124ece req-153c3d98-6d10-4d23-a726-b9c4ae1e788f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86540b3-57b5-4a77-9c7b-93af29f15deb", "name": "network-vif-deleted", "tag": "34982f27-4a32-4230-8887-24c8c503dc30"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:09.738136 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 336/698] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:09 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:09.762319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:09.763214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a14b49e9-c865-4f3d-bc2d-c59501124ece req-153c3d98-6d10-4d23-a726-b9c4ae1e788f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:09.763747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a14b49e9-c865-4f3d-bc2d-c59501124ece req-153c3d98-6d10-4d23-a726-b9c4ae1e788f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:09.764187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a14b49e9-c865-4f3d-bc2d-c59501124ece req-153c3d98-6d10-4d23-a726-b9c4ae1e788f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:09.764521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:09.774891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:09.775693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:09.776287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:09.777159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:09.778148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:09.778735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:09.785802 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a14b49e9-c865-4f3d-bc2d-c59501124ece req-153c3d98-6d10-4d23-a726-b9c4ae1e788f service nova] Creating event network-vif-deleted:34982f27-4a32-4230-8887-24c8c503dc30 for instance c86540b3-57b5-4a77-9c7b-93af29f15deb on n-h2-858383-16 Oct 27 09:02:09.803387 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a14b49e9-c865-4f3d-bc2d-c59501124ece req-153c3d98-6d10-4d23-a726-b9c4ae1e788f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078925 Oct 27 09:02:09.804645 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 363/699] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:09.810980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:09.811893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:09.822384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:09.823208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:09.823934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:09.824855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:09.826426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:09.827301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:09.859226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:10.106839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:10.126712 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b38918b2-a89b-4b52-9595-9f0d275e0c53 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1227 microversion: 2.1 time: 0.319675 Oct 27 09:02:10.127581 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 364/700] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:09 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1227 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:10.144347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:10.145819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:10.160447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:10.161266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:10.172216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:10.173397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:10.176080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:10.177079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:10.789397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:10.806521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c2683a7-b906-46de-8e8f-1fbe3da15591 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1360 microversion: 2.1 time: 1.066679 Oct 27 09:02:10.807153 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 337/701] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:09 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1360 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:10.828653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:10.831698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:10.844597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:10.847316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:10.848926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:10.849865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:10.853932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:10.854334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:11.196687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:11.205231 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7258bc1-b928-40b6-a739-b615ccd3fb1e tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1271 microversion: 2.1 time: 0.396915 Oct 27 09:02:11.206235 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 338/702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:10 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1271 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:11.211482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:11.215329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:11.232100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:11.232842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:11.233476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:11.234347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:11.234953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:11.235531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:11.240246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:11.397703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:11.412901 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f72fa7c-5f42-40f3-a1f2-6dd5d0c041ef tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 1.279286 Oct 27 09:02:11.413486 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 365/703] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:10 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:11.418694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:11.419295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:11.432579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:11.433082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:11.433524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:11.434233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:11.434683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:11.441849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:12.064870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:12.076431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:12.080753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:12.085941 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1d4e4c5-36a5-426b-b172-ad7deca238c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.878443 Oct 27 09:02:12.086631 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 339/704] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:11 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:12.109169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:12.110202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:12.125799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:12.127771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:12.128233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:12.128965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:12.129434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:12.129858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:12.503511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:12.517023 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc2649d5-7a15-427d-9a24-7bad3f840fe5 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 1.101780 Oct 27 09:02:12.518589 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 366/705] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:11 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:12.553801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:12.557867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:12.573262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:12.573769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:12.574213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:12.574926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:12.580026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:12.580536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:13.012114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:13.020055 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1f1b677-b245-4066-a837-19a167afbad3 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1305 microversion: 2.1 time: 0.932125 Oct 27 09:02:13.027663 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 340/706] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:12 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1305 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:13.032582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:13.033195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:13.045185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:13.060395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:13.061441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:13.064070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:13.068628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:13.070215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:13.252847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:13.262095 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46eb8e19-e209-4c4d-8a5e-12cbfcf0eb77 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1360 microversion: 2.1 time: 0.742437 Oct 27 09:02:13.263056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:13.271644 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3753e610-04c1-4019-8a65-a31bd11a5ecc tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1277 microversion: 2.1 time: 0.242702 Oct 27 09:02:13.272244 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 341/707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:13 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:13.277721 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 367/708] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:12 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1360 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:13.292821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:13.296305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:13.297281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:13.298168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:13.310299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:13.314278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:13.318170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:13.318848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:13.321247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:13.321721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:13.331223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:13.332134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:13.333136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:13.343772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:13.352197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:13.352884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:13.551431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:13.629869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=16 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:14.154160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:14.172882 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3d55fd3-b08d-44b0-a122-3cb740cabf96 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 0.895856 Oct 27 09:02:14.173508 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 342/709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:13 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:14.233642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:14.250855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:14.252904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:14.254379 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9fcd46dd-b3cb-4c19-a279-75c11879a8b9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.974980 Oct 27 09:02:14.255502 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 368/710] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:13 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:14.270662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a3fbec69-afa4-46a2-9fc2-87fb1f645c44 req-f30ecf8f-4db5-43c9-994a-8407c5e14f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134f4014-5bbe-4a5a-a204-9044a7ce8134", "tag": "01a80a77-f0f3-4513-baef-52423db0a2cd"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:14.290411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a3fbec69-afa4-46a2-9fc2-87fb1f645c44 req-f30ecf8f-4db5-43c9-994a-8407c5e14f47 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:14.291188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a3fbec69-afa4-46a2-9fc2-87fb1f645c44 req-f30ecf8f-4db5-43c9-994a-8407c5e14f47 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:14.291837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a3fbec69-afa4-46a2-9fc2-87fb1f645c44 req-f30ecf8f-4db5-43c9-994a-8407c5e14f47 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:14.333227 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a3fbec69-afa4-46a2-9fc2-87fb1f645c44 req-f30ecf8f-4db5-43c9-994a-8407c5e14f47 service nova] Creating event network-changed:01a80a77-f0f3-4513-baef-52423db0a2cd for instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 on n-h1-858383-16 Oct 27 09:02:14.353824 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a3fbec69-afa4-46a2-9fc2-87fb1f645c44 req-f30ecf8f-4db5-43c9-994a-8407c5e14f47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093550 Oct 27 09:02:14.359987 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 369/711] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:14.366205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:14.367432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:14.374915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:14.375828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:14.376557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:14.377606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:14.378344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:14.379072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:14.452259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7a8fa7c-cb98-4307-b404-f4264d82a71d tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Calling method '.version_select at 0x7f31aa826700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:14.479881 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e7a8fa7c-cb98-4307-b404-f4264d82a71d tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] HTTP exception thrown: Image not found. Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7a8fa7c-cb98-4307-b404-f4264d82a71d tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Request method failure captured: Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/images/53d63fad-22a3-4875-b352-f0175e97bc7a/metadata/os_distro HTTP/1.1 Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkkVU1xLQCfkopCSK4k8ES99J8IR9jvsRfQpMCj5Bdg-22ShN10LKQKh_r4Xu9y0gjXnPEeZnpvgbRVLVc5aC7pgePnVflWjPm3KSEokK7X6O60PmoWe_gjZmSYbi3sGfOBEao_E2QmAAB49o3Ivxt3Bv7NBztzknB_6hJozk2wwPuA Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36af7a0dd44b4a43920a586dc4ed5cdb"}]}] Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4bae17ebd72a48ee8c5b8ef3e85803c9 Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'image_id': '53d63fad-22a3-4875-b352-f0175e97bc7a', 'id': 'os_distro'} Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 53d63fad-22a3-4875-b352-f0175e97bc7a Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:02:14.488652 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 53d63fad-22a3-4875-b352-f0175e97bc7a could not be found. Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:02:14.492560 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:14.497790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7a8fa7c-cb98-4307-b404-f4264d82a71d tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:14.498909 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7a8fa7c-cb98-4307-b404-f4264d82a71d tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] 10.222.0.25 "DELETE /compute/v2.1/images/53d63fad-22a3-4875-b352-f0175e97bc7a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.324162 Oct 27 09:02:14.500166 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 343/712] 10.222.0.25 () {58 vars in 1293 bytes} [Thu Oct 27 09:02:14 2022] DELETE /compute/v2.1/images/53d63fad-22a3-4875-b352-f0175e97bc7a/metadata/os_distro => generated 62 bytes in 326 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:02:14.507990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-38b56d18-4064-45a5-a2f7-cab0a69817c7 req-ff610b82-f741-4c54-9bdd-a03fea84f18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f858a111-a0dd-4036-9871-3f76198b85c4", "tag": "d2678d7a-fafd-4961-b47b-ada8b2073e9d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:14.521299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-38b56d18-4064-45a5-a2f7-cab0a69817c7 req-ff610b82-f741-4c54-9bdd-a03fea84f18a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:14.522189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-38b56d18-4064-45a5-a2f7-cab0a69817c7 req-ff610b82-f741-4c54-9bdd-a03fea84f18a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:14.523476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-38b56d18-4064-45a5-a2f7-cab0a69817c7 req-ff610b82-f741-4c54-9bdd-a03fea84f18a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:14.546081 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-38b56d18-4064-45a5-a2f7-cab0a69817c7 req-ff610b82-f741-4c54-9bdd-a03fea84f18a service nova] Creating event network-changed:d2678d7a-fafd-4961-b47b-ada8b2073e9d for instance f858a111-a0dd-4036-9871-3f76198b85c4 on n-h2-858383-16 Oct 27 09:02:14.552290 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-38b56d18-4064-45a5-a2f7-cab0a69817c7 req-ff610b82-f741-4c54-9bdd-a03fea84f18a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050478 Oct 27 09:02:14.553492 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 344/713] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:14.559458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:14.560563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:14.568832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:14.569616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:14.570840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:14.571887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:14.572572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:14.573238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:15.149064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:15.153393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:15.162976 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85d1c6c3-eaed-45d7-b1c2-781fc89e26df tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 0.801258 Oct 27 09:02:15.182211 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-75cba142-bd87-4fcb-a959-a64dee61b408 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1305 microversion: 2.1 time: 0.626352 Oct 27 09:02:15.182835 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 345/714] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:14 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1305 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:15.186358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 370/715] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:14 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:15.191521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:15.195681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:15.197119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:15.199752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:15.209710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:15.213091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:15.213782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:15.214380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:15.215295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:15.216370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:15.216806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:15.217818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:15.218467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:15.221360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:15.222169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:15.222611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:15.603269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:15.624895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:15.629485 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd7ec718-563a-4979-8007-007cea63229b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1319 microversion: 2.1 time: 0.443885 Oct 27 09:02:15.639886 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-251defa5-4d54-4a43-91d0-adb407654cf2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1360 microversion: 2.1 time: 0.446904 Oct 27 09:02:15.639886 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 371/716] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:15 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1360 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:15.647329 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 346/717] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:15 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:15.653465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:15.654403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:15.657718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9b65dd5-2986-46f7-8065-e48e25118a97 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Calling method '.version_select at 0x7f31aa6eb430>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:15.666416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:15.668064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:15.668707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:15.671589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:15.672344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:15.672792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:15.689417 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c9b65dd5-2986-46f7-8065-e48e25118a97 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] HTTP exception thrown: Image not found. Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9b65dd5-2986-46f7-8065-e48e25118a97 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Request method failure captured: Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/images/62beff96-7586-4f50-94c3-26351f39e191/metadata/os_version HTTP/1.1 Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkkVU1xLQCfkopCSK4k8ES99J8IR9jvsRfQpMCj5Bdg-22ShN10LKQKh_r4Xu9y0gjXnPEeZnpvgbRVLVc5aC7pgePnVflWjPm3KSEokK7X6O60PmoWe_gjZmSYbi3sGfOBEao_E2QmAAB49o3Ivxt3Bv7NBztzknB_6hJozk2wwPuA Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36af7a0dd44b4a43920a586dc4ed5cdb"}]}] Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4bae17ebd72a48ee8c5b8ef3e85803c9 Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'image_id': '62beff96-7586-4f50-94c3-26351f39e191', 'id': 'os_version'} Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 62beff96-7586-4f50-94c3-26351f39e191 Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:02:15.693389 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62beff96-7586-4f50-94c3-26351f39e191 could not be found. Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9b65dd5-2986-46f7-8065-e48e25118a97 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c9b65dd5-2986-46f7-8065-e48e25118a97 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] 10.222.0.25 "GET /compute/v2.1/images/62beff96-7586-4f50-94c3-26351f39e191/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.041016 Oct 27 09:02:15.699024 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 372/718] 10.222.0.25 () {58 vars in 1293 bytes} [Thu Oct 27 09:02:15 2022] GET /compute/v2.1/images/62beff96-7586-4f50-94c3-26351f39e191/metadata/os_version => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:02:15.706578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:15.706910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:15.714222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:15.714718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:15.715835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:15.716564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:15.717078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:15.717514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.001968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:16.024564 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1fcfbf07-015c-4b4a-855e-8709cc078fa6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 0.375720 Oct 27 09:02:16.025566 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 347/719] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:15 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:16.030880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-196fb090-8589-4b8a-b232-266f3ca13909 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Calling method '.version_select at 0x7f31aa9f48b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:16.046504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:16.055246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:16.057498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:16.058852 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a59b543f-736a-49d4-9631-186f3477f8a6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.361986 Oct 27 09:02:16.060639 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-196fb090-8589-4b8a-b232-266f3ca13909 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] HTTP exception thrown: Image not found. Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-196fb090-8589-4b8a-b232-266f3ca13909 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Request method failure captured: Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/images/8c169c68-c639-4eb2-8354-b9766d6c6c9d/metadata HTTP/1.1 Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkkVU1xLQCfkopCSK4k8ES99J8IR9jvsRfQpMCj5Bdg-22ShN10LKQKh_r4Xu9y0gjXnPEeZnpvgbRVLVc5aC7pgePnVflWjPm3KSEokK7X6O60PmoWe_gjZmSYbi3sGfOBEao_E2QmAAB49o3Ivxt3Bv7NBztzknB_6hJozk2wwPuA Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36af7a0dd44b4a43920a586dc4ed5cdb"}]}] Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4bae17ebd72a48ee8c5b8ef3e85803c9 Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'image_id': '8c169c68-c639-4eb2-8354-b9766d6c6c9d'} Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8c169c68-c639-4eb2-8354-b9766d6c6c9d Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:02:16.063047 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c169c68-c639-4eb2-8354-b9766d6c6c9d could not be found. Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-196fb090-8589-4b8a-b232-266f3ca13909 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-196fb090-8589-4b8a-b232-266f3ca13909 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] 10.222.0.25 "GET /compute/v2.1/images/8c169c68-c639-4eb2-8354-b9766d6c6c9d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039820 Oct 27 09:02:16.069322 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 348/720] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:02:16 2022] GET /compute/v2.1/images/8c169c68-c639-4eb2-8354-b9766d6c6c9d/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:02:16.081152 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 373/721] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:15 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:16.083533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96f85b5a-73ea-4772-a8d4-7a4ca51eec43 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Action: 'update_all', calling method: .version_select at 0x7f31aaabe790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:16.131686 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-96f85b5a-73ea-4772-a8d4-7a4ca51eec43 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] HTTP exception thrown: Image not found. Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96f85b5a-73ea-4772-a8d4-7a4ca51eec43 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Request method failure captured: Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: request: PUT /compute/v2.1/images/16ec76e3-82e6-4a5e-b7c8-a0a00bc4f0f5/metadata HTTP/1.1 Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 57 Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkkVU1xLQCfkopCSK4k8ES99J8IR9jvsRfQpMCj5Bdg-22ShN10LKQKh_r4Xu9y0gjXnPEeZnpvgbRVLVc5aC7pgePnVflWjPm3KSEokK7X6O60PmoWe_gjZmSYbi3sGfOBEao_E2QmAAB49o3Ivxt3Bv7NBztzknB_6hJozk2wwPuA Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36af7a0dd44b4a43920a586dc4ed5cdb"}]}] Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4bae17ebd72a48ee8c5b8ef3e85803c9 Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'image_id': '16ec76e3-82e6-4a5e-b7c8-a0a00bc4f0f5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 16ec76e3-82e6-4a5e-b7c8-a0a00bc4f0f5 Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:02:16.133216 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 16ec76e3-82e6-4a5e-b7c8-a0a00bc4f0f5 could not be found. Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96f85b5a-73ea-4772-a8d4-7a4ca51eec43 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96f85b5a-73ea-4772-a8d4-7a4ca51eec43 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] 10.222.0.25 "PUT /compute/v2.1/images/16ec76e3-82e6-4a5e-b7c8-a0a00bc4f0f5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057307 Oct 27 09:02:16.137280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 349/722] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:02:16 2022] PUT /compute/v2.1/images/16ec76e3-82e6-4a5e-b7c8-a0a00bc4f0f5/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:02:16.149560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7a6e65a-f8b5-40b7-972b-d9054d29cf71 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Action: 'update', calling method: .version_select at 0x7f31aa6d7ee0>, body: {"meta": {"os_distro": "alt"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:16.187207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:16.188525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:16.192697 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d7a6e65a-f8b5-40b7-972b-d9054d29cf71 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] HTTP exception thrown: Image not found. Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7a6e65a-f8b5-40b7-972b-d9054d29cf71 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Request method failure captured: Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/images/a5393f45-a174-4390-81da-e5b6a833150f/metadata/os_distro HTTP/1.1 Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 30 Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkkVU1xLQCfkopCSK4k8ES99J8IR9jvsRfQpMCj5Bdg-22ShN10LKQKh_r4Xu9y0gjXnPEeZnpvgbRVLVc5aC7pgePnVflWjPm3KSEokK7X6O60PmoWe_gjZmSYbi3sGfOBEao_E2QmAAB49o3Ivxt3Bv7NBztzknB_6hJozk2wwPuA Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36af7a0dd44b4a43920a586dc4ed5cdb"}]}] Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4bae17ebd72a48ee8c5b8ef3e85803c9 Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: {"meta": {"os_distro": "alt"}} Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'image_id': 'a5393f45-a174-4390-81da-e5b6a833150f', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a5393f45-a174-4390-81da-e5b6a833150f Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:02:16.195216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a5393f45-a174-4390-81da-e5b6a833150f could not be found. Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7a6e65a-f8b5-40b7-972b-d9054d29cf71 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d7a6e65a-f8b5-40b7-972b-d9054d29cf71 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] 10.222.0.25 "PUT /compute/v2.1/images/a5393f45-a174-4390-81da-e5b6a833150f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.055015 Oct 27 09:02:16.205080 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 374/723] 10.222.0.25 () {60 vars in 1310 bytes} [Thu Oct 27 09:02:16 2022] PUT /compute/v2.1/images/a5393f45-a174-4390-81da-e5b6a833150f/metadata/os_distro => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:02:16.214549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-995aeab9-4349-4a1e-b907-ff9b060acb56 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Action: 'create', calling method: .version_select at 0x7f31aa6688b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:16.214707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:16.214707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:16.216145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.217300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:16.217985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:16.218621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.254927 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-995aeab9-4349-4a1e-b907-ff9b060acb56 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] HTTP exception thrown: Image not found. Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-995aeab9-4349-4a1e-b907-ff9b060acb56 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Request method failure captured: Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/images/e7b4f454-61d2-4460-a482-3bb834c8ef06/metadata HTTP/1.1 Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 57 Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkkVU1xLQCfkopCSK4k8ES99J8IR9jvsRfQpMCj5Bdg-22ShN10LKQKh_r4Xu9y0gjXnPEeZnpvgbRVLVc5aC7pgePnVflWjPm3KSEokK7X6O60PmoWe_gjZmSYbi3sGfOBEao_E2QmAAB49o3Ivxt3Bv7NBztzknB_6hJozk2wwPuA Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36af7a0dd44b4a43920a586dc4ed5cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36af7a0dd44b4a43920a586dc4ed5cdb"}]}] Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 36af7a0dd44b4a43920a586dc4ed5cdb Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810 Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4bae17ebd72a48ee8c5b8ef3e85803c9 Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1479822810-project Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'image_id': 'e7b4f454-61d2-4460-a482-3bb834c8ef06', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e7b4f454-61d2-4460-a482-3bb834c8ef06 Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:02:16.257884 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e7b4f454-61d2-4460-a482-3bb834c8ef06 could not be found. Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-995aeab9-4349-4a1e-b907-ff9b060acb56 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-995aeab9-4349-4a1e-b907-ff9b060acb56 tempest-ImagesMetadataNegativeTestJSON-1479822810 tempest-ImagesMetadataNegativeTestJSON-1479822810-project] 10.222.0.25 "POST /compute/v2.1/images/e7b4f454-61d2-4460-a482-3bb834c8ef06/metadata" status: 404 len: 62 microversion: 2.1 time: 0.056839 Oct 27 09:02:16.262019 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 375/724] 10.222.0.25 () {60 vars in 1281 bytes} [Thu Oct 27 09:02:16 2022] POST /compute/v2.1/images/e7b4f454-61d2-4460-a482-3bb834c8ef06/metadata => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:02:16.282781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:16.289459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:16.291668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:16.305264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:16.305782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:16.306457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.307182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:16.318792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:16.319435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.564652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:16.589383 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e001fc7-4219-41a3-8581-16ff8691b6a3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 0.406498 Oct 27 09:02:16.599646 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 350/725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:16 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:16.599646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0eb65554-9581-4c61-a437-410ae1e60749 req-ca01dcf0-521d-48e1-8b09-7aa57bfeec18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b64fc7-dd59-4a29-b395-8f8e8990cabb", "tag": "bbc5a442-ff28-4a74-95b8-7e5a6187b536"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:16.611636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0eb65554-9581-4c61-a437-410ae1e60749 req-ca01dcf0-521d-48e1-8b09-7aa57bfeec18 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:16.612328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0eb65554-9581-4c61-a437-410ae1e60749 req-ca01dcf0-521d-48e1-8b09-7aa57bfeec18 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:16.612916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0eb65554-9581-4c61-a437-410ae1e60749 req-ca01dcf0-521d-48e1-8b09-7aa57bfeec18 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.632492 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0eb65554-9581-4c61-a437-410ae1e60749 req-ca01dcf0-521d-48e1-8b09-7aa57bfeec18 service nova] Creating event network-changed:bbc5a442-ff28-4a74-95b8-7e5a6187b536 for instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb on n-h2-858383-16 Oct 27 09:02:16.638743 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0eb65554-9581-4c61-a437-410ae1e60749 req-ca01dcf0-521d-48e1-8b09-7aa57bfeec18 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046723 Oct 27 09:02:16.639700 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 351/726] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:16.661734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:16.663401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:16.674098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:16.675049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:16.675693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.678694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:16.680237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:16.680866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.733337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:16.742437 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-368221e3-8816-4d62-9981-538e921a85ab tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1305 microversion: 2.1 time: 0.471868 Oct 27 09:02:16.748363 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 376/727] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:16 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1305 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:16.762886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:16.768523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:16.791382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:16.794051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:16.795983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.798746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:16.799707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:16.803258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:16.981392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:16.989923 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4ee6a8a-d01a-4f37-acbe-b9f4ac97d570 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1319 microversion: 2.1 time: 0.338744 Oct 27 09:02:16.998571 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 352/728] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:16 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:02:17.003931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5a46bc0c-464a-4727-8224-2d1ab9cfabdb req-198a8aa0-6db7-4d3f-b5b5-35114aed0b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145ca530-0213-42f4-adf0-ce76a1e19915", "tag": "6a9c2a64-d42b-4c5d-aedb-b628ab8ac1a5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:17.025296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5a46bc0c-464a-4727-8224-2d1ab9cfabdb req-198a8aa0-6db7-4d3f-b5b5-35114aed0b6b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:17.029378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5a46bc0c-464a-4727-8224-2d1ab9cfabdb req-198a8aa0-6db7-4d3f-b5b5-35114aed0b6b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:17.030083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5a46bc0c-464a-4727-8224-2d1ab9cfabdb req-198a8aa0-6db7-4d3f-b5b5-35114aed0b6b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:17.055355 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5a46bc0c-464a-4727-8224-2d1ab9cfabdb req-198a8aa0-6db7-4d3f-b5b5-35114aed0b6b service nova] Creating event network-changed:6a9c2a64-d42b-4c5d-aedb-b628ab8ac1a5 for instance 145ca530-0213-42f4-adf0-ce76a1e19915 on n-h1-858383-16 Oct 27 09:02:17.064074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5a46bc0c-464a-4727-8224-2d1ab9cfabdb req-198a8aa0-6db7-4d3f-b5b5-35114aed0b6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063778 Oct 27 09:02:17.068602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 353/729] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:17.076130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:17.084501 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f215d44f-7ac2-41da-b9e0-e1cab292478f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1360 microversion: 2.1 time: 0.334535 Oct 27 09:02:17.088635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:17.089558 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 377/730] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:16 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1360 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:17.092061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:17.095950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:17.099659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:17.107833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:17.109666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:17.110616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:17.111275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:17.112318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:17.113001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:17.113670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:17.118303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:17.119781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:17.124123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:17.124123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:17.124123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:17.416825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:17.429885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5be88ebb-e53d-4f3e-b03d-8cf4c53c93c2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 0.358445 Oct 27 09:02:17.431297 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 354/731] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:17 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:17.471306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:17.486369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:17.498365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:17.499709 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5fcdacb-8bbf-4fb2-b519-a88f2e18297d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.408671 Oct 27 09:02:17.510497 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 378/732] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:17 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:17.614702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:17.615249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:17.622181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:17.622979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:17.623637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:17.624885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:17.625532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:17.626141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:17.775230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:17.775713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:17.784853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:17.785526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:17.785928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:17.788808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:17.789558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:17.790153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:17.940919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:17.956080 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ea036bb-74c4-4c8b-8440-7fb254d283a8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 0.345766 Oct 27 09:02:17.972432 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 355/733] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:17 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:18.014074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:18.018212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:18.019353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:18.024883 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d30d382e-eb7e-4210-8a01-fc1d9552e59f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1305 microversion: 2.1 time: 0.255215 Oct 27 09:02:18.025965 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 379/734] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:17 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1305 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:18.032487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:18.033332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:18.034204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:18.035142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:18.035928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:18.036512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:18.120689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:18.121467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:18.130984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:18.132625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:18.133373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:18.136585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:18.137294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:18.137905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:18.223501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:18.235663 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-15bbc5ab-7bf2-4598-9e03-2a20e26df03b tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1319 microversion: 2.1 time: 0.219940 Oct 27 09:02:18.236499 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 356/735] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:18 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:18.458569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:18.460692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:18.462053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:18.470168 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed477d0f-e5fa-4008-84ca-8e4d2622434c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1360 microversion: 2.1 time: 0.353833 Oct 27 09:02:18.471269 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 380/736] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:18 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1360 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:18.483013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:18.486338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:18.487210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:18.492876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:18.493968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:18.494918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:18.530044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:18.532148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:18.549649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:18.550439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:18.553105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:18.555621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:18.558534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:18.560181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:19.016051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:19.037069 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee8bd750-81a0-4521-a4e6-261657b14e6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 0.585273 Oct 27 09:02:19.059108 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 357/737] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:18 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:19.079013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:19.080635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:19.095508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:19.096940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:19.097886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:19.099980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:19.101570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:19.102524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:19.170963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:19.183442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:19.185367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:19.186569 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28bc4036-787a-4a6b-ba23-c60c502b2a0d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.665190 Oct 27 09:02:19.187125 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 381/738] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:18 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:19.205674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:19.206295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:19.215997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:19.216561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:19.217847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:19.218654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:19.219706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:19.220215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:19.491820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:19.528587 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-89d09b44-bdc4-4c46-aba6-c7878eaeb7b1 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 0.454019 Oct 27 09:02:19.543601 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 358/739] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:19 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:19.543601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:19.546310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:19.566250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:19.569619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:19.573646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:19.575101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:19.576160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:19.579104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:19.590151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:19.607480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:19.629347 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-05b01d98-ec5d-4330-8445-19e563b089dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1293 microversion: 2.1 time: 0.435174 Oct 27 09:02:19.633521 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 382/740] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:19 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1293 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:19.651864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:19.653454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:19.658517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=18 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:19.687278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:19.688368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:19.688978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:19.690223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:19.691349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:19.692178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:19.978768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:19.999513 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e69d145e-3913-4b7c-97b5-09b6117bebca tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1319 microversion: 2.1 time: 0.467464 Oct 27 09:02:20.000569 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 359/741] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:19 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:20.083450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:20.096929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:20.107976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:20.108850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:20.112653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:20.120717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:20.122310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:20.123389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:20.124395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:20.129662 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47c45e50-5a8a-4d1b-8043-327a35d2b928 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1360 microversion: 2.1 time: 0.493555 Oct 27 09:02:20.133478 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 383/742] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:19 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1360 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:20.215611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:20.216474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:20.236465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:20.237006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:20.237491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:20.238264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:20.238791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:20.239620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:20.269442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:21.118395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:21.119482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:21.145522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:21.158287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:21.159618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d340790-dd7a-4db1-ac67-b40b247fc68e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 1.083894 Oct 27 09:02:21.176497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:21.178280 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d61aecb4-ca8f-4daf-b515-8b1822a05504 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1567 microversion: 2.25 time: 0.966741 Oct 27 09:02:21.179011 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 384/743] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:20 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1567 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:21.184160 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 360/744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:20 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:02:21.199222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:21.200638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:21.212104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:21.213347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:21.226991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:21.227851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:21.228560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:21.228962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:21.230081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:21.230861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:21.232223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:21.234284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:21.235794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:21.235987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:21.243242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:21.244138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:22.141701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:22.164034 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ad07145-38aa-495e-b294-b04128dc27d8 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 0.978146 Oct 27 09:02:22.168839 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 385/745] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:21 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:22.183344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:22.184413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:22.194037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:22.202279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:22.204991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:22.205718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:22.213604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:22.214585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:22.215269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:22.224610 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c51abab-0dcf-4da2-88e3-4cb6b0525115 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1293 microversion: 2.1 time: 1.038824 Oct 27 09:02:22.225206 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 361/746] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:21 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1293 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:22.233706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:22.234562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:22.257534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:22.258694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:22.259200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:22.259983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:22.260659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:22.261178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:22.748527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:22.762788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:22.768663 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f6bc64c6-06b1-4122-aa75-f0410ee2d8ee tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1319 microversion: 2.1 time: 0.598666 Oct 27 09:02:22.769681 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 386/747] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:22 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:22.779251 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0badbd35-219b-41e1-9074-9b8413866622 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1360 microversion: 2.1 time: 0.552111 Oct 27 09:02:22.780971 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 362/748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:22 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1360 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:22.782612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-4f1e3e0c-41ab-4874-8e8e-b6104eca6c8e req-c4b96264-0d93-4c04-bbc1-47bd902b4ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b64fc7-dd59-4a29-b395-8f8e8990cabb", "name": "network-vif-plugged", "status": "completed", "tag": "bbc5a442-ff28-4a74-95b8-7e5a6187b536"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:22.796596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:22.796596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:22.821698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4f1e3e0c-41ab-4874-8e8e-b6104eca6c8e req-c4b96264-0d93-4c04-bbc1-47bd902b4ebd service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:22.822191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4f1e3e0c-41ab-4874-8e8e-b6104eca6c8e req-c4b96264-0d93-4c04-bbc1-47bd902b4ebd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:22.822629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4f1e3e0c-41ab-4874-8e8e-b6104eca6c8e req-c4b96264-0d93-4c04-bbc1-47bd902b4ebd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:22.830434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:22.830970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:22.831428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:22.832271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:22.832678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:22.840584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:22.881081 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-4f1e3e0c-41ab-4874-8e8e-b6104eca6c8e req-c4b96264-0d93-4c04-bbc1-47bd902b4ebd service nova] Creating event network-vif-plugged:bbc5a442-ff28-4a74-95b8-7e5a6187b536 for instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb on n-h2-858383-16 Oct 27 09:02:22.900243 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-4f1e3e0c-41ab-4874-8e8e-b6104eca6c8e req-c4b96264-0d93-4c04-bbc1-47bd902b4ebd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126758 Oct 27 09:02:22.900733 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 387/749] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:22.910645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:22.911883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:22.931998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:22.932498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:22.933070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:22.933788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:22.934246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:22.934676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:23.516579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:23.526499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:23.534193 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8cd49e7e-9b37-49b4-8df7-ef716e8e2033 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 0.752160 Oct 27 09:02:23.537372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:23.538856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:23.540052 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c994f5b4-80f2-46c2-8eb0-52d20c69503b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1557 microversion: 2.25 time: 0.638057 Oct 27 09:02:23.540579 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 363/750] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:22 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:23.545735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:23.546630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:23.553120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:23.554004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:23.554668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:23.555628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:23.556569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:23.557229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:23.570364 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 388/751] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:22 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1557 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:23.575527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:23.576501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:23.583717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:23.584200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:23.584866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:23.586494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:23.587192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:23.587827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:23.823227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:23.851060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:23.890314 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-03bf7b69-c3d8-49dc-b8b4-5041cc872a89 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 0.346998 Oct 27 09:02:23.911610 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b9ceece-f5d8-4fa1-99ce-25ee63f03f39 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1293 microversion: 2.1 time: 0.339924 Oct 27 09:02:23.913617 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 364/752] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:23 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:23.929508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ddfa99bf-9eec-4168-ac6e-42ce8f816744 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '.version_select at 0x7f31aaa05670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:23.940124 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 389/753] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:23 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1293 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:23.945490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:23.946099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:23.949756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddfa99bf-9eec-4168-ac6e-42ce8f816744 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:23.950257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddfa99bf-9eec-4168-ac6e-42ce8f816744 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:23.950705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddfa99bf-9eec-4168-ac6e-42ce8f816744 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:23.971337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:23.971877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:23.972320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:23.973034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:23.973491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:23.973915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:23.982835 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ddfa99bf-9eec-4168-ac6e-42ce8f816744 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2141 microversion: 2.25 time: 0.068043 Oct 27 09:02:23.999933 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 365/754] 10.222.0.25 () {60 vars in 1184 bytes} [Thu Oct 27 09:02:23 2022] GET /compute/v2.1/os-migrations => generated 2141 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:24.005021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:24.005650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:24.037532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:24.038612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:24.039065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:24.039817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:24.040283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:24.040716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:24.399791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:24.406646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:24.417604 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36c7d35f-ca23-439d-9961-a920d1695a3d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1360 microversion: 2.1 time: 0.416265 Oct 27 09:02:24.420995 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 366/755] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:24 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1360 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:24.442034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:24.445836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:24.461336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:24.463084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:24.464934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:24.471614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:24.472365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:24.473820 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-081f10d3-bc23-4f95-9adc-c7ab99f14094 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1319 microversion: 2.1 time: 0.532277 Oct 27 09:02:24.474045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:24.475816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 390/756] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:23 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:24.584866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:24.588152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:24.606624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:24.609267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:24.610170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:24.613991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:24.615171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:24.617458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:25.009186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:25.018276 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cfd82e3d-bd6b-4019-9837-d33d51c92419 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 0.446539 Oct 27 09:02:25.032018 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 391/757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:24 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:25.040731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:25.041559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:25.055374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:25.056569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:25.057194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:25.058080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:25.058715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:25.061880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:25.346756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 825baa14-c4b5-47d3-ade1-af3f779cd623 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:25.384103 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f57e7bd-6583-4c92-bed8-9698f447c904 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 2051 microversion: 2.25 time: 0.961731 Oct 27 09:02:25.385208 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 367/758] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:24 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 2051 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:25.400787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:25.401799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:25.410330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:25.411360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:25.412028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:25.414371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:25.415168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:25.416039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:25.572869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:25.592732 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8daed5c6-68ce-40cf-adc9-e9ba38ce4085 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 0.558113 Oct 27 09:02:25.603310 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 392/759] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:25 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:25.620309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-eeae0b6e-e84b-4108-852b-0f6559dd2866 req-a77ba280-964e-4b7e-8535-a885fe98c2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134f4014-5bbe-4a5a-a204-9044a7ce8134", "name": "network-vif-plugged", "status": "completed", "tag": "01a80a77-f0f3-4513-baef-52423db0a2cd"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:25.633698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eeae0b6e-e84b-4108-852b-0f6559dd2866 req-a77ba280-964e-4b7e-8535-a885fe98c2a0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:25.634508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eeae0b6e-e84b-4108-852b-0f6559dd2866 req-a77ba280-964e-4b7e-8535-a885fe98c2a0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:25.635180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eeae0b6e-e84b-4108-852b-0f6559dd2866 req-a77ba280-964e-4b7e-8535-a885fe98c2a0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:25.668208 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-eeae0b6e-e84b-4108-852b-0f6559dd2866 req-a77ba280-964e-4b7e-8535-a885fe98c2a0 service nova] Creating event network-vif-plugged:01a80a77-f0f3-4513-baef-52423db0a2cd for instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 on n-h1-858383-16 Oct 27 09:02:25.705023 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-eeae0b6e-e84b-4108-852b-0f6559dd2866 req-a77ba280-964e-4b7e-8535-a885fe98c2a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093526 Oct 27 09:02:25.716636 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 393/760] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:25.733542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:25.735233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:25.767729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:25.777158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:25.778330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:25.780217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:25.782904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:25.784519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:25.875740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:25.884616 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36462e64-ae60-4a09-8b69-bb1f37bc92ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1293 microversion: 2.1 time: 0.490400 Oct 27 09:02:25.885208 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 368/761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:25 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1293 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:25.894538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:25.898996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:25.915664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:25.916175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:25.916614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:25.927258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:25.928078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:25.929305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:26.407649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:26.421184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:26.425437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bce1eb1-4cf5-4f5f-978b-19f1fab3d981 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1319 microversion: 2.1 time: 0.534126 Oct 27 09:02:26.427741 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 369/762] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:25 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:26.442646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1922828707", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "1a8d8c4c-d7c6-4980-b309-ab63e829200b"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:26.478638 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a582f7e8-843a-4718-ad32-0c04c89aa4c0 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1543 microversion: 2.1 time: 0.759363 Oct 27 09:02:26.496016 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 394/763] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:25 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1543 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:26.501963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:26.502583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:26.513387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:26.513894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:26.514339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:26.515227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:26.516030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:26.516532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:26.565596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] validate_networks() for [('1a8d8c4c-d7c6-4980-b309-ab63e829200b', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:02:26.893601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:26.921044 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aff1c6b2-8bf8-4350-91bc-b8115af93497 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 0.423415 Oct 27 09:02:26.921912 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 395/764] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:26 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:26.933524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-39ff3bcd-82cc-4488-8726-a99468e2aee1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:26.936311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-39ff3bcd-82cc-4488-8726-a99468e2aee1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:26.945290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ff3bcd-82cc-4488-8726-a99468e2aee1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:26.946310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ff3bcd-82cc-4488-8726-a99468e2aee1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:26.946851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ff3bcd-82cc-4488-8726-a99468e2aee1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:26.947794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ff3bcd-82cc-4488-8726-a99468e2aee1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:26.948522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ff3bcd-82cc-4488-8726-a99468e2aee1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:26.948963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ff3bcd-82cc-4488-8726-a99468e2aee1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:27.260020 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-39ff3bcd-82cc-4488-8726-a99468e2aee1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.335921 Oct 27 09:02:27.261281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 396/765] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:02:26 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:27.269784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:27.270914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:27.293223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:27.294043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:27.294598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:27.296004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:27.296586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:27.297144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:28.187491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:28.221016 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a1101a3-e288-455b-be51-57559afd2449 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1389 microversion: 2.1 time: 0.956051 Oct 27 09:02:28.223265 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 397/766] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:27 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1389 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:28.248452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:28.249627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:28.266221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:28.266732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:28.267186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:28.274778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:28.278590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:28.279195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:28.835474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:02:28.837384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:02:28.838623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:02:28.839562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:02:28.840707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:02:28.857335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:28.859355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:28.861664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:28.864355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:28.866894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:28.868195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:28.891983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:28.935178 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a4a101a7-569e-4dd2-80a0-dbf595fe5559 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1293 microversion: 2.1 time: 0.708425 Oct 27 09:02:28.948272 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 398/767] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:28 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1293 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:28.955037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:28.956064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:28.967437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:02:28.974189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for user cf8bc1ce921e4f759cb9c0b5f4340324 and project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:02:28.979447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:28.980307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:28.980887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:28.981765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:28.982366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:28.982998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:29.000963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:02:29.007440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:02:29.118509 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cde0942e-17fd-43f0-b81f-4d2032c0bb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.689376 Oct 27 09:02:29.119498 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 370/768] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:02:29.151407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:29.157694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:29.191327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:29.196249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:29.197270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:29.201210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:29.202711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:29.222100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:29.320509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:29.332383 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7959a72-70da-49ed-8015-709c5885b1cb tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1319 microversion: 2.1 time: 0.380827 Oct 27 09:02:29.333001 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 399/769] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:28 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:29.365298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5a2a8abb-ce31-4cf2-9fbe-bcd6049d9460 req-a6c489ec-6ff6-4f71-8c24-d846ba1fd85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145ca530-0213-42f4-adf0-ce76a1e19915", "name": "network-vif-plugged", "status": "completed", "tag": "6a9c2a64-d42b-4c5d-aedb-b628ab8ac1a5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:29.404582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5a2a8abb-ce31-4cf2-9fbe-bcd6049d9460 req-a6c489ec-6ff6-4f71-8c24-d846ba1fd85b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:29.408400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5a2a8abb-ce31-4cf2-9fbe-bcd6049d9460 req-a6c489ec-6ff6-4f71-8c24-d846ba1fd85b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:29.409261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5a2a8abb-ce31-4cf2-9fbe-bcd6049d9460 req-a6c489ec-6ff6-4f71-8c24-d846ba1fd85b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:29.469889 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5a2a8abb-ce31-4cf2-9fbe-bcd6049d9460 req-a6c489ec-6ff6-4f71-8c24-d846ba1fd85b service nova] Creating event network-vif-plugged:6a9c2a64-d42b-4c5d-aedb-b628ab8ac1a5 for instance 145ca530-0213-42f4-adf0-ce76a1e19915 on n-h1-858383-16 Oct 27 09:02:29.519337 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-5a2a8abb-ce31-4cf2-9fbe-bcd6049d9460 req-a6c489ec-6ff6-4f71-8c24-d846ba1fd85b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164071 Oct 27 09:02:29.524815 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 400/770] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:29.822903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:29.831366 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f49da9d-9bba-4cdb-9ff6-4e3f5dd6dd38 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1477 microversion: 2.1 time: 0.710570 Oct 27 09:02:29.840312 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 371/771] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:29 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1477 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:29.857914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-433cdf59-c972-4705-b0f9-1f22f3a0bc1b req-96311d78-0aa1-457d-96db-dc97073628f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b64fc7-dd59-4a29-b395-8f8e8990cabb", "tag": "bbc5a442-ff28-4a74-95b8-7e5a6187b536"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:29.895221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-433cdf59-c972-4705-b0f9-1f22f3a0bc1b req-96311d78-0aa1-457d-96db-dc97073628f6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:29.895741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-433cdf59-c972-4705-b0f9-1f22f3a0bc1b req-96311d78-0aa1-457d-96db-dc97073628f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:29.896178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-433cdf59-c972-4705-b0f9-1f22f3a0bc1b req-96311d78-0aa1-457d-96db-dc97073628f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:29.933503 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-433cdf59-c972-4705-b0f9-1f22f3a0bc1b req-96311d78-0aa1-457d-96db-dc97073628f6 service nova] Creating event network-changed:bbc5a442-ff28-4a74-95b8-7e5a6187b536 for instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb on n-h2-858383-16 Oct 27 09:02:29.949056 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-433cdf59-c972-4705-b0f9-1f22f3a0bc1b req-96311d78-0aa1-457d-96db-dc97073628f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107493 Oct 27 09:02:29.953428 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 372/772] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:29.959252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fae9f320-1547-4bb6-a126-734746580317 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:29.960465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fae9f320-1547-4bb6-a126-734746580317 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:30.075062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d98e03a-ccc4-456e-b976-2cba2f373467 tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] Action: 'create', calling method: .version_select at 0x7f31aa6eb310>, body: {"security_group": {"name": "tempest-securitygroup-450420664", "description": "tempest-description-1046473078"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:30.293782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fae9f320-1547-4bb6-a126-734746580317 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:30.306818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fae9f320-1547-4bb6-a126-734746580317 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:30.317515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fae9f320-1547-4bb6-a126-734746580317 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:30.324210 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fae9f320-1547-4bb6-a126-734746580317 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1262 microversion: 2.25 time: 0.363915 Oct 27 09:02:30.327155 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 373/773] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:29 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1262 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:30.345307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:30.345937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:30.370298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:30.370820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:30.372444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:30.373238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:30.375985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:30.376463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:31.121778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:31.137712 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-41a1d834-14a1-4748-95df-2884aadeef84 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1587 microversion: 2.1 time: 0.809334 Oct 27 09:02:31.138655 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 374/774] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:30 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1587 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:31.146012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:31.147195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:31.156708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:31.157442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:31.158038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:31.158940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:31.159611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:31.160453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:31.723771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:31.732258 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d9ee304-247e-4538-93f0-1ead3eba5ec8 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1293 microversion: 2.1 time: 0.592401 Oct 27 09:02:31.732952 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 375/775] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:31 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1293 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:31.737542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:31.738230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:31.744935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:31.745506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:31.746015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:31.746776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:31.747295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:31.747828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:31.916477 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d98e03a-ccc4-456e-b976-2cba2f373467 tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.384262 Oct 27 09:02:31.918157 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 401/776] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:02:29 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:31.967784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:31.977306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:31.999900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:32.000976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:32.001763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:32.002859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:32.003508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:32.004083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:32.118203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:32.143770 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e763e27-05cf-4d1a-8634-3965966bb9d0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1319 microversion: 2.1 time: 0.409100 Oct 27 09:02:32.146341 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 376/777] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:31 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:32.171227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0dbb5fc-8e99-4046-860e-6948e5c13623 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:32.174349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0dbb5fc-8e99-4046-860e-6948e5c13623 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:32.189533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0dbb5fc-8e99-4046-860e-6948e5c13623 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:32.190431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0dbb5fc-8e99-4046-860e-6948e5c13623 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:32.191414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0dbb5fc-8e99-4046-860e-6948e5c13623 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:32.195453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0dbb5fc-8e99-4046-860e-6948e5c13623 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:32.196896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0dbb5fc-8e99-4046-860e-6948e5c13623 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:32.197894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0dbb5fc-8e99-4046-860e-6948e5c13623 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:32.484364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0dbb5fc-8e99-4046-860e-6948e5c13623 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.335642 Oct 27 09:02:32.485065 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 377/778] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:02:32 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:32.498508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:32.499490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:32.500911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:32.502174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:32.509316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:32.510152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:32.510808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:32.511762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:32.512793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:32.513793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:32.553446 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2b6e8c3c-27a0-4082-b1d6-f77406208499 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1476 microversion: 2.1 time: 0.622474 Oct 27 09:02:32.555181 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 402/779] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:31 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1476 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:32.574054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b45d3365-c221-4edc-8eb3-0cab0615be8c tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] Action: 'create', calling method: .version_select at 0x7f31aa6d7160>, body: {"security_group": {"name": "tempest-securitygroup-1768748761", "description": "tempest-description-1257690493"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:32.717157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:32.729798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:32.732079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:32.733843 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1ece2cc-5fe5-4f3a-a1f6-984e4b8db6b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1332 microversion: 2.25 time: 0.239328 Oct 27 09:02:32.751896 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 378/780] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:32 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1332 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:32.876851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34f84961-c89c-44e6-9389-07ccefdeb009 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Calling method '.version_select at 0x7f31aa8499d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:32.940971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-34f84961-c89c-44e6-9389-07ccefdeb009 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eec6bb10-821f-4582-8e85-070abe85905a does not exist", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:02:32.941587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.security_group_api [None req-34f84961-c89c-44e6-9389-07ccefdeb009 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Neutron security group eec6bb10-821f-4582-8e85-070abe85905a not found {{(pid=120603) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:02:32.942714 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-34f84961-c89c-44e6-9389-07ccefdeb009 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] HTTP exception thrown: Security group eec6bb10-821f-4582-8e85-070abe85905a does not exist Oct 27 09:02:32.942714 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-5d02b601-266b-4fd2-9343-89e4c33aabad'] Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34f84961-c89c-44e6-9389-07ccefdeb009 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Request method failure captured: Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-security-groups/eec6bb10-821f-4582-8e85-070abe85905a HTTP/1.1 Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkknwLjNH8cxCd0-7_UIKAh35Iwt7PseL1LoyhAD_oiSI-NxLUUFEMohiw60smvseNJBv509Vw-U5MWPBpZoaU88DFqnGlehcsfE8u_FvKP8EtN9Fakkopi1mmxo_N8tAwfZWHR9dzr3P_l2dgtlbjzemUkTDj_6nujSiDArLVqfeSQ Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b3b5e8ad6bd4411faff80dcef1a3e7ef Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}] Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b3b5e8ad6bd4411faff80dcef1a3e7ef Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsNegativeTestJSON-1687870039-project Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5024993687984497b4f7413112b51d87 Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039-project Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: exception: Security group eec6bb10-821f-4582-8e85-070abe85905a does not exist Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-5d02b601-266b-4fd2-9343-89e4c33aabad'] Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'eec6bb10-821f-4582-8e85-070abe85905a'} Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:02:32.945589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eec6bb10-821f-4582-8e85-070abe85905a does not exist Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d02b601-266b-4fd2-9343-89e4c33aabad'] Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eec6bb10-821f-4582-8e85-070abe85905a does not exist Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d02b601-266b-4fd2-9343-89e4c33aabad'] Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eec6bb10-821f-4582-8e85-070abe85905a does not exist Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d02b601-266b-4fd2-9343-89e4c33aabad'] Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eec6bb10-821f-4582-8e85-070abe85905a does not exist Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d02b601-266b-4fd2-9343-89e4c33aabad'] Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34f84961-c89c-44e6-9389-07ccefdeb009 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Returning 404 to user: Security group eec6bb10-821f-4582-8e85-070abe85905a does not exist Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-5d02b601-266b-4fd2-9343-89e4c33aabad'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34f84961-c89c-44e6-9389-07ccefdeb009 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/eec6bb10-821f-4582-8e85-070abe85905a" status: 404 len: 194 microversion: 2.1 time: 0.189747 Oct 27 09:02:32.957287 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 379/781] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:02:32 2022] DELETE /compute/v2.1/os-security-groups/eec6bb10-821f-4582-8e85-070abe85905a => generated 194 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:02:32.980044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:32.980044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:32.987150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:32.987776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:32.988233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:32.988993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:32.989457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:32.989883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:33.185489 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b45d3365-c221-4edc-8eb3-0cab0615be8c tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.627927 Oct 27 09:02:33.201817 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 403/782] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:02:32 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:33.209759 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d12eb1bf-7fcd-400b-9a23-0d005a90cce7 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005951 Oct 27 09:02:33.211997 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 404/783] 10.222.0.25 () {58 vars in 1164 bytes} [Thu Oct 27 09:02:33 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 09:02:33.222115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:33.224253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:33.236411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:33.237458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:33.239046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:33.242339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:33.243634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:33.244525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:33.310028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:33.319940 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c05bfd3-c982-40be-95d5-16840b550517 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1293 microversion: 2.1 time: 0.362487 Oct 27 09:02:33.320531 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 380/784] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:32 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1293 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:33.454928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82e144da-d281-4711-ab38-5a0518fae4f5 tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] Action: 'create', calling method: .version_select at 0x7f31aaeef4c0>, body: {"security_group": {"name": "tempest-securitygroup-1744830612", "description": "tempest-description-918769793"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:33.706174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:33.716168 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-39325e3d-889a-4351-9cbb-8f82a3c1a45f tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1468 microversion: 2.1 time: 0.502574 Oct 27 09:02:33.732330 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 405/785] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:33 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1468 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:33.741666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-758210e5-b883-47e0-8102-f8fd7508cd28 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Calling method '.version_select at 0x7f31aa78a790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:34.458940 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-758210e5-b883-47e0-8102-f8fd7508cd28 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.724839 Oct 27 09:02:34.459736 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 406/786] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 09:02:33 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:34.473693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e6c4ea97-561b-4348-864a-9b3427d9a2a9 req-ff6ca5c1-b3a8-481a-a742-2b736f9f0fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f858a111-a0dd-4036-9871-3f76198b85c4", "name": "network-vif-plugged", "status": "completed", "tag": "d2678d7a-fafd-4961-b47b-ada8b2073e9d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:34.484548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e6c4ea97-561b-4348-864a-9b3427d9a2a9 req-ff6ca5c1-b3a8-481a-a742-2b736f9f0fca service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:34.485324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e6c4ea97-561b-4348-864a-9b3427d9a2a9 req-ff6ca5c1-b3a8-481a-a742-2b736f9f0fca service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:34.485940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e6c4ea97-561b-4348-864a-9b3427d9a2a9 req-ff6ca5c1-b3a8-481a-a742-2b736f9f0fca service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:34.504541 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e6c4ea97-561b-4348-864a-9b3427d9a2a9 req-ff6ca5c1-b3a8-481a-a742-2b736f9f0fca service nova] Creating event network-vif-plugged:d2678d7a-fafd-4961-b47b-ada8b2073e9d for instance f858a111-a0dd-4036-9871-3f76198b85c4 on n-h2-858383-16 Oct 27 09:02:34.511190 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e6c4ea97-561b-4348-864a-9b3427d9a2a9 req-ff6ca5c1-b3a8-481a-a742-2b736f9f0fca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041093 Oct 27 09:02:34.512144 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 407/787] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:34.518521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:34.519217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:34.527753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:34.529070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:34.530026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:34.530901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:34.531509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:34.532520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:34.539254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:34.643989 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82e144da-d281-4711-ab38-5a0518fae4f5 tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.319309 Oct 27 09:02:34.645301 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 381/788] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:02:33 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:34.658219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:34.659035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:34.667997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:34.668749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:34.669396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:34.670289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:34.670917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:34.672217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:34.734756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:34.747042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lazy-loading 'flavor' on Instance uuid 145ca530-0213-42f4-adf0-ce76a1e19915 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:34.845887 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6f0552a-6591-49ce-b6db-c340004a6861 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915/action" status: 202 len: 0 microversion: 2.1 time: 0.198823 Oct 27 09:02:34.847646 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 382/789] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:02:34 2022] POST /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:02:34.856074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:34.856791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:34.864156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:34.864893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:34.865588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:34.866566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:34.867630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:34.868561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:34.912553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:34.922989 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1b57a0b-6fd7-4168-ac6b-bf82fff4520b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1474 microversion: 2.1 time: 0.409309 Oct 27 09:02:34.931241 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 408/790] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:34 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1474 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:34.957851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:34.958839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:34.974592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:34.978690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:34.992140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:34.997319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:35.009240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:35.010124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:35.499503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:35.517485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:35.521368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:35.527409 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62e914a1-14dc-4a2c-8a46-700229d13db0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1362 microversion: 2.25 time: 0.677509 Oct 27 09:02:35.529390 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 383/791] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:34 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1362 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:35.540554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:35.542174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:35.557054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:35.559044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:35.560210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:35.562365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:35.563407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:35.564458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:35.595070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:35.631742 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d52003c-7192-4924-93c0-b2bd3783a1dd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1293 microversion: 2.1 time: 0.698432 Oct 27 09:02:35.634716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 409/792] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:34 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1293 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:35.652130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-06312997-ef02-4f4d-b20a-3df05ef9bd3c req-dfae6db1-16f7-4ade-98e1-8300ad492010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134f4014-5bbe-4a5a-a204-9044a7ce8134", "tag": "01a80a77-f0f3-4513-baef-52423db0a2cd"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:35.732367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06312997-ef02-4f4d-b20a-3df05ef9bd3c req-dfae6db1-16f7-4ade-98e1-8300ad492010 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:35.735461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06312997-ef02-4f4d-b20a-3df05ef9bd3c req-dfae6db1-16f7-4ade-98e1-8300ad492010 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:35.736370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06312997-ef02-4f4d-b20a-3df05ef9bd3c req-dfae6db1-16f7-4ade-98e1-8300ad492010 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:35.769658 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-06312997-ef02-4f4d-b20a-3df05ef9bd3c req-dfae6db1-16f7-4ade-98e1-8300ad492010 service nova] Creating event network-changed:01a80a77-f0f3-4513-baef-52423db0a2cd for instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 on n-h1-858383-16 Oct 27 09:02:35.779648 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-06312997-ef02-4f4d-b20a-3df05ef9bd3c req-dfae6db1-16f7-4ade-98e1-8300ad492010 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141801 Oct 27 09:02:35.780272 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 410/793] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:35.796418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90d57421-3735-43fe-b47f-58fbc80b7443 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Calling method '.version_select at 0x7f31aa60e8b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:35.996682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:36.010271 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f77f385e-ad95-48d5-a1b3-53a7b0cb9e9c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1587 microversion: 2.1 time: 0.478410 Oct 27 09:02:36.011615 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 384/794] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:35 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1587 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:36.021523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d133dca7-858d-4c14-9fe1-537a305a78bf tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] Action: 'create', calling method: .version_select at 0x7f31aa95bdc0>, body: {"security_group": {"name": "tempest-securitygroup-288011375", "description": "tempest-description-202300894"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:36.234836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-90d57421-3735-43fe-b47f-58fbc80b7443 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:02:36.235634 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-90d57421-3735-43fe-b47f-58fbc80b7443 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 27 09:02:36.235634 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-66d57ecc-43c9-41d3-b8bd-38fb39898cad'] Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90d57421-3735-43fe-b47f-58fbc80b7443 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Request method failure captured: Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-security-groups/7a4d5ff0-c194-445c-886f-5070546b5fb3 HTTP/1.1 Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkknwLjNH8cxCd0-7_UIKAh35Iwt7PseL1LoyhAD_oiSI-NxLUUFEMohiw60smvseNJBv509Vw-U5MWPBpZoaU88DFqnGlehcsfE8u_FvKP8EtN9Fakkopi1mmxo_N8tAwfZWHR9dzr3P_l2dgtlbjzemUkTDj_6nujSiDArLVqfeSQ Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b3b5e8ad6bd4411faff80dcef1a3e7ef Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}] Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b3b5e8ad6bd4411faff80dcef1a3e7ef Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupsNegativeTestJSON-1687870039-project Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5024993687984497b4f7413112b51d87 Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039-project Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: exception: Insufficient rights for removing default security group. Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-66d57ecc-43c9-41d3-b8bd-38fb39898cad'] Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7a4d5ff0-c194-445c-886f-5070546b5fb3'} Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:02:36.237505 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66d57ecc-43c9-41d3-b8bd-38fb39898cad'] Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66d57ecc-43c9-41d3-b8bd-38fb39898cad'] Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66d57ecc-43c9-41d3-b8bd-38fb39898cad'] Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66d57ecc-43c9-41d3-b8bd-38fb39898cad'] Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90d57421-3735-43fe-b47f-58fbc80b7443 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-66d57ecc-43c9-41d3-b8bd-38fb39898cad'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-90d57421-3735-43fe-b47f-58fbc80b7443 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/7a4d5ff0-c194-445c-886f-5070546b5fb3" status: 400 len: 182 microversion: 2.1 time: 0.457471 Oct 27 09:02:36.242669 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 411/795] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:02:35 2022] DELETE /compute/v2.1/os-security-groups/7a4d5ff0-c194-445c-886f-5070546b5fb3 => generated 182 bytes in 459 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:02:36.253416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:36.254112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:36.279203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:36.279758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:36.280227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:36.281199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:36.281587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:36.282025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:36.602883 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d133dca7-858d-4c14-9fe1-537a305a78bf tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.589495 Oct 27 09:02:36.604121 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 385/796] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:02:36 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:36.618381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:36.620332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:36.638485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:36.638969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:36.639419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:36.640169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:36.640618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:36.641049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:36.642946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:36.688355 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49f6cbc6-fa60-4ed5-8208-87f1b6d91658 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1459 microversion: 2.1 time: 0.446522 Oct 27 09:02:36.704114 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 412/797] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:36 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1459 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:36.710853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a40c90c-e371-47ca-8468-0e64d8d37694 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Calling method '.version_select at 0x7f31aa6d7af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:36.760801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-6a40c90c-e371-47ca-8468-0e64d8d37694 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 does not exist", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:02:36.761517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.security_group_api [None req-6a40c90c-e371-47ca-8468-0e64d8d37694 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Neutron security group 5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 not found {{(pid=120602) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:02:36.762042 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6a40c90c-e371-47ca-8468-0e64d8d37694 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] HTTP exception thrown: Security group 5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 does not exist Oct 27 09:02:36.762042 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-8da2ab3e-99ce-4836-b862-36a35da2006a'] Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a40c90c-e371-47ca-8468-0e64d8d37694 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Request method failure captured: Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-security-groups/5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 HTTP/1.1 Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkknwLjNH8cxCd0-7_UIKAh35Iwt7PseL1LoyhAD_oiSI-NxLUUFEMohiw60smvseNJBv509Vw-U5MWPBpZoaU88DFqnGlehcsfE8u_FvKP8EtN9Fakkopi1mmxo_N8tAwfZWHR9dzr3P_l2dgtlbjzemUkTDj_6nujSiDArLVqfeSQ Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b3b5e8ad6bd4411faff80dcef1a3e7ef Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}] Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b3b5e8ad6bd4411faff80dcef1a3e7ef Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupsNegativeTestJSON-1687870039-project Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5024993687984497b4f7413112b51d87 Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039-project Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: exception: Security group 5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 does not exist Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-8da2ab3e-99ce-4836-b862-36a35da2006a'] Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24'} Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:02:36.763924 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 does not exist Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8da2ab3e-99ce-4836-b862-36a35da2006a'] Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 does not exist Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8da2ab3e-99ce-4836-b862-36a35da2006a'] Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 does not exist Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8da2ab3e-99ce-4836-b862-36a35da2006a'] Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 does not exist Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8da2ab3e-99ce-4836-b862-36a35da2006a'] Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a40c90c-e371-47ca-8468-0e64d8d37694 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Returning 404 to user: Security group 5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 does not exist Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-8da2ab3e-99ce-4836-b862-36a35da2006a'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a40c90c-e371-47ca-8468-0e64d8d37694 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24" status: 404 len: 194 microversion: 2.1 time: 0.059450 Oct 27 09:02:36.769311 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 413/798] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:02:36 2022] GET /compute/v2.1/os-security-groups/5acfe3f1-19be-4d18-b6a0-d8a8aa69ab24 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:02:36.776735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6502dba6-80a2-449a-a49f-6747c8f8a9dd req-48890392-4b75-47c7-9172-faeb61237aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb21e13f-718e-4afe-b3f3-97a05e9be9c6", "name": "network-vif-unplugged", "status": "completed", "tag": "a5a9685d-1d59-4fbb-a249-b32a53d0668d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:36.800140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6502dba6-80a2-449a-a49f-6747c8f8a9dd req-48890392-4b75-47c7-9172-faeb61237aed service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:36.801212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6502dba6-80a2-449a-a49f-6747c8f8a9dd req-48890392-4b75-47c7-9172-faeb61237aed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:36.802185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6502dba6-80a2-449a-a49f-6747c8f8a9dd req-48890392-4b75-47c7-9172-faeb61237aed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:36.839612 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6502dba6-80a2-449a-a49f-6747c8f8a9dd req-48890392-4b75-47c7-9172-faeb61237aed service nova] Creating event network-vif-unplugged:a5a9685d-1d59-4fbb-a249-b32a53d0668d for instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 on n-h1-858383-16 Oct 27 09:02:36.854222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-6502dba6-80a2-449a-a49f-6747c8f8a9dd req-48890392-4b75-47c7-9172-faeb61237aed service nova] Instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:02:36.867397 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6502dba6-80a2-449a-a49f-6747c8f8a9dd req-48890392-4b75-47c7-9172-faeb61237aed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099130 Oct 27 09:02:36.876588 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 414/799] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:36.902518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0c65436e-bb20-4c39-9435-49c687bd5427 req-4ec52a85-d271-4773-8a95-ef050ef73880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b454c4-af92-48f9-859c-dc3e702e22e0", "tag": "ad86b77a-7d3b-4d7e-b22b-f254fe439313"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:36.923708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0c65436e-bb20-4c39-9435-49c687bd5427 req-4ec52a85-d271-4773-8a95-ef050ef73880 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:36.924856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0c65436e-bb20-4c39-9435-49c687bd5427 req-4ec52a85-d271-4773-8a95-ef050ef73880 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:36.925863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0c65436e-bb20-4c39-9435-49c687bd5427 req-4ec52a85-d271-4773-8a95-ef050ef73880 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:36.929299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:36.939226 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44b23fd8-f838-4834-8ca7-cf01f6958ac2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1471 microversion: 2.1 time: 0.333346 Oct 27 09:02:36.939967 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 386/800] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:36 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1471 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:36.947933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:36.951265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:36.951515 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0c65436e-bb20-4c39-9435-49c687bd5427 req-4ec52a85-d271-4773-8a95-ef050ef73880 service nova] Creating event network-changed:ad86b77a-7d3b-4d7e-b22b-f254fe439313 for instance 79b454c4-af92-48f9-859c-dc3e702e22e0 on n-h2-858383-16 Oct 27 09:02:36.965641 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0c65436e-bb20-4c39-9435-49c687bd5427 req-4ec52a85-d271-4773-8a95-ef050ef73880 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084976 Oct 27 09:02:36.971427 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 415/801] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:36.973546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:36.975513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:36.976176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:36.977480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:36.978536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:36.979550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:36.983617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-467995fc-9ab3-4feb-af8c-a1a6ddcca59a tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] Calling method '.version_select at 0x7f31aa6d7c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:37.330169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:37.340524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:37.343748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:37.346230 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-808fa1c0-6b64-48cc-90db-5042cddbe9e2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1362 microversion: 2.25 time: 0.405006 Oct 27 09:02:37.346806 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 387/802] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:36 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1362 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:37.352216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:37.352820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:37.362287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:37.362906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:37.363607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:37.365132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:37.366061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:37.366900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:37.667956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:37.676019 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f6258504-f6de-4413-9b01-af2ae85de438 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1483 microversion: 2.1 time: 0.327958 Oct 27 09:02:37.676600 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 388/803] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:37 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1483 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:37.681814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfbbe835-8de1-42e0-ac4f-c16fc3ad2d18 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:37.682414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dfbbe835-8de1-42e0-ac4f-c16fc3ad2d18 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:37.688694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfbbe835-8de1-42e0-ac4f-c16fc3ad2d18 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:37.689174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfbbe835-8de1-42e0-ac4f-c16fc3ad2d18 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:37.689778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfbbe835-8de1-42e0-ac4f-c16fc3ad2d18 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:37.690642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfbbe835-8de1-42e0-ac4f-c16fc3ad2d18 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:37.691256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfbbe835-8de1-42e0-ac4f-c16fc3ad2d18 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:37.691713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfbbe835-8de1-42e0-ac4f-c16fc3ad2d18 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:38.132127 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dfbbe835-8de1-42e0-ac4f-c16fc3ad2d18 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1612 microversion: 2.1 time: 0.454422 Oct 27 09:02:38.133120 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 389/804] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:37 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1612 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:38.140794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-389619a4-4a25-4733-8b3b-4f91a5198eb4 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Action: 'update', calling method: .version_select at 0x7f31aa743280>, body: {"security_group": {"name": "tempest-sg-1872463", "description": "tempest-description-179050489"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:38.181820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-389619a4-4a25-4733-8b3b-4f91a5198eb4 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3b81291-f045-4f17-a941-f0fab50af5de does not exist", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:02:38.182498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.security_group_api [None req-389619a4-4a25-4733-8b3b-4f91a5198eb4 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Neutron security group d3b81291-f045-4f17-a941-f0fab50af5de not found {{(pid=120603) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:02:38.183110 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-389619a4-4a25-4733-8b3b-4f91a5198eb4 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] HTTP exception thrown: Security group d3b81291-f045-4f17-a941-f0fab50af5de does not exist Oct 27 09:02:38.183110 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-c6838105-d37f-4a26-82ba-496e42bc79d4'] Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-389619a4-4a25-4733-8b3b-4f91a5198eb4 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Request method failure captured: Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: request: PUT /compute/v2.1/os-security-groups/d3b81291-f045-4f17-a941-f0fab50af5de HTTP/1.1 Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 98 Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkknwLjNH8cxCd0-7_UIKAh35Iwt7PseL1LoyhAD_oiSI-NxLUUFEMohiw60smvseNJBv509Vw-U5MWPBpZoaU88DFqnGlehcsfE8u_FvKP8EtN9Fakkopi1mmxo_N8tAwfZWHR9dzr3P_l2dgtlbjzemUkTDj_6nujSiDArLVqfeSQ Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b3b5e8ad6bd4411faff80dcef1a3e7ef Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3b5e8ad6bd4411faff80dcef1a3e7ef"}]}] Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b3b5e8ad6bd4411faff80dcef1a3e7ef Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039 Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsNegativeTestJSON-1687870039-project Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5024993687984497b4f7413112b51d87 Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1687870039-project Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: {"security_group": {"name": "tempest-sg-1872463", "description": "tempest-description-179050489"}} Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: exception: Security group d3b81291-f045-4f17-a941-f0fab50af5de does not exist Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-c6838105-d37f-4a26-82ba-496e42bc79d4'] Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd3b81291-f045-4f17-a941-f0fab50af5de', 'body': {'security_group': {'name': 'tempest-sg-1872463', 'description': 'tempest-description-179050489'}}} Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:02:38.185474 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3b81291-f045-4f17-a941-f0fab50af5de does not exist Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6838105-d37f-4a26-82ba-496e42bc79d4'] Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3b81291-f045-4f17-a941-f0fab50af5de does not exist Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6838105-d37f-4a26-82ba-496e42bc79d4'] Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3b81291-f045-4f17-a941-f0fab50af5de does not exist Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6838105-d37f-4a26-82ba-496e42bc79d4'] Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3b81291-f045-4f17-a941-f0fab50af5de does not exist Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6838105-d37f-4a26-82ba-496e42bc79d4'] Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-389619a4-4a25-4733-8b3b-4f91a5198eb4 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] Returning 404 to user: Security group d3b81291-f045-4f17-a941-f0fab50af5de does not exist Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-c6838105-d37f-4a26-82ba-496e42bc79d4'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-389619a4-4a25-4733-8b3b-4f91a5198eb4 tempest-SecurityGroupsNegativeTestJSON-1687870039 tempest-SecurityGroupsNegativeTestJSON-1687870039-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/d3b81291-f045-4f17-a941-f0fab50af5de" status: 404 len: 194 microversion: 2.1 time: 0.053587 Oct 27 09:02:38.192583 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 390/805] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Oct 27 09:02:38 2022] PUT /compute/v2.1/os-security-groups/d3b81291-f045-4f17-a941-f0fab50af5de => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:02:38.198952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-023276c1-d9d9-43c4-b748-d5779b91d290 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:38.198952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-023276c1-d9d9-43c4-b748-d5779b91d290 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:38.207929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-023276c1-d9d9-43c4-b748-d5779b91d290 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:38.207929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-023276c1-d9d9-43c4-b748-d5779b91d290 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:38.207929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-023276c1-d9d9-43c4-b748-d5779b91d290 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:38.208325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-023276c1-d9d9-43c4-b748-d5779b91d290 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:38.208854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-023276c1-d9d9-43c4-b748-d5779b91d290 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:38.209439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-023276c1-d9d9-43c4-b748-d5779b91d290 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:38.279693 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-023276c1-d9d9-43c4-b748-d5779b91d290 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6/action" status: 204 len: 0 microversion: 2.1 time: 0.089082 Oct 27 09:02:38.281146 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 391/806] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:02:38 2022] POST /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:02:38.292893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d584d0a6-220e-451b-8c67-5bbfd6fbec3b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:38.293868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d584d0a6-220e-451b-8c67-5bbfd6fbec3b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:38.306004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d584d0a6-220e-451b-8c67-5bbfd6fbec3b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:38.306508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d584d0a6-220e-451b-8c67-5bbfd6fbec3b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:38.306947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d584d0a6-220e-451b-8c67-5bbfd6fbec3b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:38.307741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d584d0a6-220e-451b-8c67-5bbfd6fbec3b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:38.308205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d584d0a6-220e-451b-8c67-5bbfd6fbec3b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:38.308635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d584d0a6-220e-451b-8c67-5bbfd6fbec3b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:38.428317 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d584d0a6-220e-451b-8c67-5bbfd6fbec3b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143899 Oct 27 09:02:38.432782 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 392/807] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:02:38 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:38.444477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d9b3fbf-57f4-4c64-9b5c-13ddc40a0bd9 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:38.458093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9b3fbf-57f4-4c64-9b5c-13ddc40a0bd9 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:38.460909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9b3fbf-57f4-4c64-9b5c-13ddc40a0bd9 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:38.463299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9b3fbf-57f4-4c64-9b5c-13ddc40a0bd9 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:38.466111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9b3fbf-57f4-4c64-9b5c-13ddc40a0bd9 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:38.466974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9b3fbf-57f4-4c64-9b5c-13ddc40a0bd9 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:38.470233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9b3fbf-57f4-4c64-9b5c-13ddc40a0bd9 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:38.529605 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d9b3fbf-57f4-4c64-9b5c-13ddc40a0bd9 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.094461 Oct 27 09:02:38.535234 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 393/808] 10.222.0.25 () {58 vars in 1176 bytes} [Thu Oct 27 09:02:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:38.546362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:38.548536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:38.565719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:38.566944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:38.568040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:38.570088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:38.571697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:38.572697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:38.972511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:38.988602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c143624-264c-4cf8-ac75-8306f4367074 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1471 microversion: 2.1 time: 0.451422 Oct 27 09:02:39.005355 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 394/809] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:38 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:39.014206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:39.015428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:39.024610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:39.025752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:39.026808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:39.027772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:39.028409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:39.029253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:39.353220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:39.365105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:39.367892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:39.370246 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0861acff-3a56-40a8-a8bc-345d8858e442 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1362 microversion: 2.25 time: 0.362079 Oct 27 09:02:39.371718 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 395/810] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:39 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:39.380106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-16", "block_migration": true, "disk_over_commit": false}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:39.384513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:39.397711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:39.398903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:39.399742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:39.401043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:39.401882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:39.402668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:39.459069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Lazy-loading 'flavor' on Instance uuid 145ca530-0213-42f4-adf0-ce76a1e19915 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:39.476934 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 145ca530-0213-42f4-adf0-ce76a1e19915 while it is in vm_state suspended Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Request method failure captured: Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915/action HTTP/1.1 Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 98 Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjwk7iWO9AbyLOPgarfZl4gKHe4uHU8WC_OJOhdsgEtPZqo_DSUKjBQe6twQ3E7gjOANFGpRfWu5gJEn5iT5HBkVR1ltB0I7-V7h7Zc3gyOAT5gUxG3vlR6ZiJ7qfP8JBp74p3fUSPpwbbGPzuV0C9P51yfeSrZkPt0RGyPCrdxOPQ Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 24f768856ab74fc49bb1fc4f7abd582d Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-LiveMigrationNegativeTest-165349976 Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24f768856ab74fc49bb1fc4f7abd582d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24f768856ab74fc49bb1fc4f7abd582d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24f768856ab74fc49bb1fc4f7abd582d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24f768856ab74fc49bb1fc4f7abd582d"}]}] Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-LiveMigrationNegativeTest-165349976 Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 24f768856ab74fc49bb1fc4f7abd582d Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-165349976 Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-LiveMigrationNegativeTest-165349976-project-admin Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 718be7998b2c49caae6ebaf26aeb8e72 Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-LiveMigrationNegativeTest-165349976-project-admin Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: {"os-migrateLive": {"host": "n-h2-858383-16", "block_migration": true, "disk_over_commit": false}} Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: exception: Cannot 'os-migrateLive' instance 145ca530-0213-42f4-adf0-ce76a1e19915 while it is in vm_state suspended Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '145ca530-0213-42f4-adf0-ce76a1e19915', 'body': {'os-migrateLive': {'host': 'n-h2-858383-16', 'block_migration': True, 'disk_over_commit': False}}} Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 145ca530-0213-42f4-adf0-ce76a1e19915 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:39.479206 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 145ca530-0213-42f4-adf0-ce76a1e19915 while it is in vm_state suspended Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 145ca530-0213-42f4-adf0-ce76a1e19915 while it is in vm_state suspended Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 145ca530-0213-42f4-adf0-ce76a1e19915 while it is in vm_state suspended {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-711d38c1-6fda-4eb0-bdf6-168421ab37a7 tempest-LiveMigrationNegativeTest-165349976 tempest-LiveMigrationNegativeTest-165349976-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915/action" status: 409 len: 155 microversion: 2.1 time: 0.107843 Oct 27 09:02:39.492043 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 396/811] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:02:39 2022] POST /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915/action => generated 155 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:02:39.504984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:39.505542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:39.515791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:39.516623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:39.517321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:39.518342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:39.518948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:39.520254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:39.562912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:02:39.656409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:39.718245 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b7563c95-bd66-4bd0-bc27-2c2337f9ad7d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "DELETE /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 204 len: 0 microversion: 2.1 time: 0.219275 Oct 27 09:02:39.722742 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 397/812] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:02:39 2022] DELETE /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:02:39.731349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:39.733887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:39.745470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:39.748315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:39.748315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:39.749224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:39.750703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:39.750703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:40.073134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:40.086566 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9e60fcf6-4a26-468e-8fcd-68fb837fa023 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1465 microversion: 2.1 time: 0.360610 Oct 27 09:02:40.088995 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 398/813] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:39 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1465 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:02:40.095897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:40.096760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:40.127602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:40.128104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:40.128549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:40.129266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:40.129726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:40.130228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:40.299206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:40.807886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:40.816220 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-74cb6b46-1580-4a88-9355-c2f41a99caf5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1471 microversion: 2.1 time: 0.725868 Oct 27 09:02:40.817032 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 399/814] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:40 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1471 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:40.831483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-4bacf3cd-b8f3-4816-8948-b623903e9bff req-a0bcc59f-6517-4052-b9b6-de97961dd532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb21e13f-718e-4afe-b3f3-97a05e9be9c6", "name": "network-vif-plugged", "status": "completed", "tag": "a5a9685d-1d59-4fbb-a249-b32a53d0668d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:40.850944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4bacf3cd-b8f3-4816-8948-b623903e9bff req-a0bcc59f-6517-4052-b9b6-de97961dd532 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:40.851453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4bacf3cd-b8f3-4816-8948-b623903e9bff req-a0bcc59f-6517-4052-b9b6-de97961dd532 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:40.851920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4bacf3cd-b8f3-4816-8948-b623903e9bff req-a0bcc59f-6517-4052-b9b6-de97961dd532 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:40.871232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-4bacf3cd-b8f3-4816-8948-b623903e9bff req-a0bcc59f-6517-4052-b9b6-de97961dd532 service nova] Creating event network-vif-plugged:a5a9685d-1d59-4fbb-a249-b32a53d0668d for instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 on n-h1-858383-16 Oct 27 09:02:40.880436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-4bacf3cd-b8f3-4816-8948-b623903e9bff req-a0bcc59f-6517-4052-b9b6-de97961dd532 service nova] Instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:02:40.888224 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-4bacf3cd-b8f3-4816-8948-b623903e9bff req-a0bcc59f-6517-4052-b9b6-de97961dd532 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069980 Oct 27 09:02:40.889223 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 400/815] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:40.908454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:40.909348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:40.923937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:40.924449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:40.924895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:40.925625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:40.926087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:40.926898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:41.498257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:41.512434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:41.514648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:41.516283 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85b5a334-bb18-400c-906a-454198f72244 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1362 microversion: 2.25 time: 0.625632 Oct 27 09:02:41.517418 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 401/816] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:40 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1362 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:41.523046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:41.525041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:41.533428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:41.534380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:41.535365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:41.536542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:41.537744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:41.538394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:42.062270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:42.088468 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44419909-cd2c-4d43-9870-e9c3efb716a8 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1465 microversion: 2.1 time: 0.569432 Oct 27 09:02:42.112860 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 402/817] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:41 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1465 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:42.135692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:42.137341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:42.147780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:42.148997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:42.150233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:42.151659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:42.152661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:42.153612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:42.574084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:42.593593 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2438a367-c288-4072-9d7f-f3411ec5bdd2 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1483 microversion: 2.1 time: 0.477749 Oct 27 09:02:42.595528 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 403/818] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:42 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1483 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:42.607067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d9be6a8c-a4fe-4641-96dd-22b562151d64 req-03f27f2a-b761-4fbd-89da-ee8859d22589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f858a111-a0dd-4036-9871-3f76198b85c4", "tag": "d2678d7a-fafd-4961-b47b-ada8b2073e9d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:42.686384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d9be6a8c-a4fe-4641-96dd-22b562151d64 req-03f27f2a-b761-4fbd-89da-ee8859d22589 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:42.687873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d9be6a8c-a4fe-4641-96dd-22b562151d64 req-03f27f2a-b761-4fbd-89da-ee8859d22589 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:42.689977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d9be6a8c-a4fe-4641-96dd-22b562151d64 req-03f27f2a-b761-4fbd-89da-ee8859d22589 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:42.721971 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d9be6a8c-a4fe-4641-96dd-22b562151d64 req-03f27f2a-b761-4fbd-89da-ee8859d22589 service nova] Creating event network-changed:d2678d7a-fafd-4961-b47b-ada8b2073e9d for instance f858a111-a0dd-4036-9871-3f76198b85c4 on n-h2-858383-16 Oct 27 09:02:42.733479 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d9be6a8c-a4fe-4641-96dd-22b562151d64 req-03f27f2a-b761-4fbd-89da-ee8859d22589 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135956 Oct 27 09:02:42.735862 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 404/819] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:42.742414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:42.743378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:42.751786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:42.752431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:42.753130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:42.754059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:42.754733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:42.755414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:42.985823 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-467995fc-9ab3-4feb-af8c-a1a6ddcca59a tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13668 microversion: 2.1 time: 6.011077 Oct 27 09:02:42.986643 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 416/820] 10.222.0.25 () {58 vars in 1191 bytes} [Thu Oct 27 09:02:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13668 bytes in 6014 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:02:42.991199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:42.993172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:43.007280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:43.013568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:43.014224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:43.015154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:43.015811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:43.016402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:43.201127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:43.214782 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ec70a1c-4a5f-4718-ba18-3e1e9a51e547 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1463 microversion: 2.1 time: 0.475810 Oct 27 09:02:43.215804 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 405/821] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:42 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1463 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:43.223166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47ad3746-bb49-4b03-bef5-e50cb50488e3 tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] Calling method '.version_select at 0x7f31aaa05f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:43.392359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:43.421581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:43.423062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:43.424245 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a56a5019-ea73-48f1-b2b5-dca1f1fdc3b5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1362 microversion: 2.25 time: 0.437332 Oct 27 09:02:43.428723 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 417/822] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:42 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:43.434032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:43.435513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:43.442744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:43.443692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:43.444295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:43.445808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:43.446633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:43.447505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:43.557368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:43.572464 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-891c3281-6748-4428-8038-b9b50c88339d tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 200 len: 1423 microversion: 2.1 time: 0.142589 Oct 27 09:02:43.576176 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 418/823] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:43 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 1423 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:43.588680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:43.592803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:43.614713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:43.616942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:43.619913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:43.621349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:43.627036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:43.628342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:43.787590 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-47ad3746-bb49-4b03-bef5-e50cb50488e3 tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.569966 Oct 27 09:02:43.788269 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 406/824] 10.222.0.25 () {58 vars in 1191 bytes} [Thu Oct 27 09:02:43 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:43.793079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-886ad8d6-582f-4905-a8f2-0bc707f6fcb9 req-00a08e17-a453-46e2-a1a4-9eb151588bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145ca530-0213-42f4-adf0-ce76a1e19915", "name": "network-vif-deleted", "tag": "6a9c2a64-d42b-4c5d-aedb-b628ab8ac1a5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:43.837005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-886ad8d6-582f-4905-a8f2-0bc707f6fcb9 req-00a08e17-a453-46e2-a1a4-9eb151588bc8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:43.841623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-886ad8d6-582f-4905-a8f2-0bc707f6fcb9 req-00a08e17-a453-46e2-a1a4-9eb151588bc8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:43.842080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-886ad8d6-582f-4905-a8f2-0bc707f6fcb9 req-00a08e17-a453-46e2-a1a4-9eb151588bc8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:43.862896 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-886ad8d6-582f-4905-a8f2-0bc707f6fcb9 req-00a08e17-a453-46e2-a1a4-9eb151588bc8 service nova] Creating event network-vif-deleted:6a9c2a64-d42b-4c5d-aedb-b628ab8ac1a5 for instance 145ca530-0213-42f4-adf0-ce76a1e19915 on n-h1-858383-16 Oct 27 09:02:43.872998 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-886ad8d6-582f-4905-a8f2-0bc707f6fcb9 req-00a08e17-a453-46e2-a1a4-9eb151588bc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083139 Oct 27 09:02:43.881800 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 407/825] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:43.887302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a0c52f4-838e-433b-9121-339943ac9206 tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] Calling method '.version_select at 0x7f31aa5e0670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:44.072593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:44.081178 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f6af8e03-357e-4fd9-a5fc-e2ad35dfe504 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1463 microversion: 2.1 time: 0.501650 Oct 27 09:02:44.084650 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 419/826] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:43 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1463 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:44.116015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38284f24-c15a-4b42-b833-bd5432f28d9d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'create', calling method: .version_select at 0x7f31aa6eb700>, body: {"keypair": {"name": "tempest-keypair-1216726483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFggIbT5X2CMC/UsTSC3fxggh4qe31baLXsjsQPWhMiynmIOBMQOEOwFQnud+A09WGF+9FLwL0UeW2okn8etaYuDY4h2kcIhyL04ocTlRjiP8nRu/rlM4MXQai3I0KRK6g=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:44.139728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-38284f24-c15a-4b42-b833-bd5432f28d9d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:02:44.149027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-38284f24-c15a-4b42-b833-bd5432f28d9d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for user 0566a978e2924137973615346b1afaa3 and project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:02:44.192931 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38284f24-c15a-4b42-b833-bd5432f28d9d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082120 Oct 27 09:02:44.193579 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 420/827] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:02:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:02:44.433535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-187b3e74-81a7-401f-8285-e83e121c1406 req-f3950b44-6782-47c8-a861-b5a40e1da186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b454c4-af92-48f9-859c-dc3e702e22e0", "name": "network-vif-plugged", "status": "completed", "tag": "ad86b77a-7d3b-4d7e-b22b-f254fe439313"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:44.450677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-187b3e74-81a7-401f-8285-e83e121c1406 req-f3950b44-6782-47c8-a861-b5a40e1da186 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:44.451453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-187b3e74-81a7-401f-8285-e83e121c1406 req-f3950b44-6782-47c8-a861-b5a40e1da186 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:44.452070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-187b3e74-81a7-401f-8285-e83e121c1406 req-f3950b44-6782-47c8-a861-b5a40e1da186 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:44.465485 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-187b3e74-81a7-401f-8285-e83e121c1406 req-f3950b44-6782-47c8-a861-b5a40e1da186 service nova] Creating event network-vif-plugged:ad86b77a-7d3b-4d7e-b22b-f254fe439313 for instance 79b454c4-af92-48f9-859c-dc3e702e22e0 on n-h2-858383-16 Oct 27 09:02:44.471138 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-187b3e74-81a7-401f-8285-e83e121c1406 req-f3950b44-6782-47c8-a861-b5a40e1da186 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041517 Oct 27 09:02:44.472003 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 421/828] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:44.480139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:44.481380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:44.488043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:44.488900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:44.489560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:44.490534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:44.491218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:44.491889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:44.504737 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a0c52f4-838e-433b-9121-339943ac9206 tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c2154f00-419f-4d90-ad71-37d971f9b2b3" status: 202 len: 0 microversion: 2.1 time: 0.621458 Oct 27 09:02:44.506533 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 408/829] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:02:43 2022] DELETE /compute/v2.1/os-security-groups/c2154f00-419f-4d90-ad71-37d971f9b2b3 => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:02:44.513941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48200b27-2b22-4aa3-8c0f-652e230a08e0 tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] Calling method '.version_select at 0x7f31aa743ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:45.125361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:45.137713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:45.140107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:45.141695 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-50a2ecf8-ff56-46ce-8204-816466c1f816 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1362 microversion: 2.25 time: 0.668137 Oct 27 09:02:45.143310 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 422/830] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:44 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1362 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:45.152383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:45.153826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: 145ca530-0213-42f4-adf0-ce76a1e19915] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:45.162713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:45.164510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:45.165857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:45.166809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:45.167736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:45.168408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:45.189409 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] HTTP exception thrown: Instance 145ca530-0213-42f4-adf0-ce76a1e19915 could not be found. Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Request method failure captured: Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 HTTP/1.1 Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjvOGEFLiYhM6yvnYwMLswkLdL0zf7C9tB73_OsX8Y2iZmI9KBvWeMGsVwfAT_y9ufg-_Bu5d6zE3fpyMsQ4Uy7KnQDyZgi4GvSAtNSbZLLK0OiMttbTub-9Da6w9Kl901iauB5VVM_QHOFzpKpnFHFVo121W0IJTemHc_oD0FKciE Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: fdefc8ef9ac54c2295f8ed1c7e5c0af6 Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-LiveMigrationNegativeTest-696035319 Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdefc8ef9ac54c2295f8ed1c7e5c0af6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdefc8ef9ac54c2295f8ed1c7e5c0af6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdefc8ef9ac54c2295f8ed1c7e5c0af6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdefc8ef9ac54c2295f8ed1c7e5c0af6"}]}] Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-LiveMigrationNegativeTest-696035319 Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: fdefc8ef9ac54c2295f8ed1c7e5c0af6 Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-696035319 Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-LiveMigrationNegativeTest-696035319-project Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 1b81d8567c74491497aa9005c32412dd Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-LiveMigrationNegativeTest-696035319-project Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 145ca530-0213-42f4-adf0-ce76a1e19915 could not be found. Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '145ca530-0213-42f4-adf0-ce76a1e19915'} Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 145ca530-0213-42f4-adf0-ce76a1e19915 could not be found. Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 145ca530-0213-42f4-adf0-ce76a1e19915 could not be found. Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:45.191792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:45.197697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:45.197697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:45.197697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:45.197697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:45.197697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:45.197697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 145ca530-0213-42f4-adf0-ce76a1e19915 could not be found. Oct 27 09:02:45.197697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:45.201004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Returning 404 to user: Instance 145ca530-0213-42f4-adf0-ce76a1e19915 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:45.202100 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eef51c55-5e67-471c-ad99-d7964e78a702 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915" status: 404 len: 111 microversion: 2.1 time: 0.057603 Oct 27 09:02:45.203126 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 423/831] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:45 2022] GET /compute/v2.1/servers/145ca530-0213-42f4-adf0-ce76a1e19915 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:02:45.212343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:45.213036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:45.219561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:45.220486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:45.221188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:45.222460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:45.223902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:45.225394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:45.257014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:02:45.296294 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48200b27-2b22-4aa3-8c0f-652e230a08e0 tempest-SecurityGroupsTestAdminJSON-994339243 tempest-SecurityGroupsTestAdminJSON-994339243-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/66d8ec97-343b-4d53-96cf-9781fd28a4ca" status: 202 len: 0 microversion: 2.1 time: 0.785152 Oct 27 09:02:45.297603 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 409/832] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:02:44 2022] DELETE /compute/v2.1/os-security-groups/66d8ec97-343b-4d53-96cf-9781fd28a4ca => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:02:45.312815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca5b529c-496d-4447-8b75-02d2da8e59f2 tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] Calling method '.version_select at 0x7f31aaade820>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:45.562858 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4334c4e8-8bf7-4dbd-b95d-d7c0bea7cdb0 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 204 len: 0 microversion: 2.1 time: 0.355440 Oct 27 09:02:45.567121 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 424/833] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:02:45 2022] DELETE /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:02:45.574069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:45.575295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:45.581989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:45.584407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:45.585116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:45.585714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:45.586591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:45.587184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:45.587921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:45.927003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:45.938158 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86d5f8a6-f85d-4fd5-b658-2eb279a0c790 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1474 microversion: 2.1 time: 0.368565 Oct 27 09:02:45.946223 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 425/834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:45 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1474 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:46.000604 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca5b529c-496d-4447-8b75-02d2da8e59f2 tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/53738509-811b-4bb2-b494-0fa8a96db094" status: 202 len: 0 microversion: 2.1 time: 0.696714 Oct 27 09:02:46.001873 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 410/835] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:02:45 2022] DELETE /compute/v2.1/os-security-groups/53738509-811b-4bb2-b494-0fa8a96db094 => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:02:46.009734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc92ea49-e1d8-4751-a288-9dca94ec6ac4 tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] Calling method '.version_select at 0x7f31aa91dee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:46.170613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:46.171344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:46.180377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:46.181136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:46.181752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:46.182667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:46.183142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:46.183705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:46.635149 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc92ea49-e1d8-4751-a288-9dca94ec6ac4 tempest-SecurityGroupsTestAdminJSON-1913266336 tempest-SecurityGroupsTestAdminJSON-1913266336-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e4040deb-a358-42b1-ba2c-6e748e73aaff" status: 202 len: 0 microversion: 2.1 time: 0.629078 Oct 27 09:02:46.636013 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 426/836] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:02:46 2022] DELETE /compute/v2.1/os-security-groups/e4040deb-a358-42b1-ba2c-6e748e73aaff => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:02:46.648958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:46.660231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:46.663393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:46.665562 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7beeb813-cc8c-4b28-b3f0-8c7d1690fe40 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1362 microversion: 2.25 time: 0.500004 Oct 27 09:02:46.666487 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 411/837] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:46 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:46.966079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:46.966902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:46.975500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:46.976668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:46.977112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:46.977821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:46.978271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:46.978689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:47.087075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e4e13f1-0054-400b-b101-bf1def7b1a54 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '.version_select at 0x7f31aaa3ba60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:47.091613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e4e13f1-0054-400b-b101-bf1def7b1a54 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:47.092949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e4e13f1-0054-400b-b101-bf1def7b1a54 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:47.094008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e4e13f1-0054-400b-b101-bf1def7b1a54 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:47.132267 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e4e13f1-0054-400b-b101-bf1def7b1a54 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1974 microversion: 2.1 time: 0.023987 Oct 27 09:02:47.132988 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 412/838] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:02:47 2022] GET /compute/v2.1/os-migrations => generated 1974 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:02:47.155511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a539f72d-2702-4e00-b7d7-f916935b5d94 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:47.164242 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a539f72d-2702-4e00-b7d7-f916935b5d94 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012561 Oct 27 09:02:47.172614 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 413/839] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:02:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:47.179377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-787d0e4c-046b-4298-9acb-9c373a954148 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1233164530", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:47.190143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:47.204586 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-204929fe-5347-4d8e-833f-b35c9d0ed527 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1474 microversion: 2.1 time: 0.242279 Oct 27 09:02:47.206480 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 427/840] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:46 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1474 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:47.210661 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-787d0e4c-046b-4298-9acb-9c373a954148 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.036340 Oct 27 09:02:47.211478 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 414/841] 10.222.0.25 () {60 vars in 1146 bytes} [Thu Oct 27 09:02:47 2022] POST /compute/v2.1/flavors => generated 499 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:47.234969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4163f1fa-c35d-4de4-ae63-3b4bbdb20b1a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:47.243215 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4163f1fa-c35d-4de4-ae63-3b4bbdb20b1a tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014395 Oct 27 09:02:47.244149 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 428/842] 10.222.0.25 () {58 vars in 1182 bytes} [Thu Oct 27 09:02:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:02:47.416482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1573243105", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "12e94858-b912-4c84-a3ba-6ef5c5932f7f"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:47.477039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:02:47.696502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:47.697298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:47.707709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:47.709634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:47.711285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:47.712934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:47.716383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:47.717609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:48.229682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:02:48.232387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:02:48.234292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:02:48.234944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:02:48.236051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:02:48.256706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:48.258167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:48.258995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:48.261657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:48.262409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:48.263268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:48.295328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:02:48.301140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for user 0566a978e2924137973615346b1afaa3 and project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:02:48.318834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:02:48.321769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:02:48.412096 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efffb8d8-5cd6-49f3-a29b-b99ec2171586 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999431 Oct 27 09:02:48.413520 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 415/843] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:02:48.427518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:48.428379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:48.437854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:48.440764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:48.442204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:48.442866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:48.445104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:48.445586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:48.446206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:48.468038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:48.470194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:48.471596 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-821e480b-23a5-42fb-bf56-2abbfe524859 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1362 microversion: 2.25 time: 0.782310 Oct 27 09:02:48.476841 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 429/844] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:47 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1362 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:02:48.490581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a90c7d0-d917-4528-9b82-0d94c71c679a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:48.495148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4a90c7d0-d917-4528-9b82-0d94c71c679a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:48.611669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4a90c7d0-d917-4528-9b82-0d94c71c679a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:48.619004 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4a90c7d0-d917-4528-9b82-0d94c71c679a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1279 microversion: 2.1 time: 0.140788 Oct 27 09:02:48.619959 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 430/845] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:48 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1279 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:48.803960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:48.816804 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6187267-95bb-4ac3-8cbb-a30b8546b231 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1474 microversion: 2.1 time: 0.401422 Oct 27 09:02:48.819980 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 416/846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:48 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1474 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:49.255192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-06e9a55e-98a8-47e0-98fe-66e2775b54e3 req-2749c4c1-826b-4ee1-838a-2283ab48de45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930", "name": "network-vif-deleted", "tag": "9f3c4e6a-f571-473e-9df4-241d19271647"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:49.271727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06e9a55e-98a8-47e0-98fe-66e2775b54e3 req-2749c4c1-826b-4ee1-838a-2283ab48de45 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:49.272638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06e9a55e-98a8-47e0-98fe-66e2775b54e3 req-2749c4c1-826b-4ee1-838a-2283ab48de45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:49.272871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06e9a55e-98a8-47e0-98fe-66e2775b54e3 req-2749c4c1-826b-4ee1-838a-2283ab48de45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:49.314728 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-06e9a55e-98a8-47e0-98fe-66e2775b54e3 req-2749c4c1-826b-4ee1-838a-2283ab48de45 service nova] Creating event network-vif-deleted:9f3c4e6a-f571-473e-9df4-241d19271647 for instance b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 on n-h2-858383-16 Oct 27 09:02:49.329173 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-06e9a55e-98a8-47e0-98fe-66e2775b54e3 req-2749c4c1-826b-4ee1-838a-2283ab48de45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088653 Oct 27 09:02:49.332916 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 431/847] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:49.505996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:49.508264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:49.530633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:49.532055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:49.533597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:49.534775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:49.535625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:49.537442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:49.650267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:49.651145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:49.675059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:49.676559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:49.679532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:49.681120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:49.684768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:49.685908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:49.905128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:49.925846 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a95d0a26-befb-4631-85bc-31e80e4dd677 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1275 microversion: 2.1 time: 0.282670 Oct 27 09:02:49.940120 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 432/848] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:49 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:49.961666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:49.962639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:49.977337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:49.991434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:49.994649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:49.995699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:49.998335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:50.000387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:50.061145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:50.089865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:50.098049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:50.099899 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12373f83-4dd8-4d31-9deb-51bf7ea06a18 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1558 microversion: 2.25 time: 0.598673 Oct 27 09:02:50.126153 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 417/849] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:49 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1558 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:50.138798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:50.141350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:50.160283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:50.162960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:50.163849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:50.164144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:50.165220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:50.166388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:50.167164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:50.167809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:50.168329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lazy-loading 'fault' on Instance uuid b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:50.168845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:50.180855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:50.272712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b81d8567c74491497aa9005c32412dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdefc8ef9ac54c2295f8ed1c7e5c0af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:50.285155 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d3e44c18-d501-4f57-8e05-90680043957a tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 200 len: 1308 microversion: 2.1 time: 0.342016 Oct 27 09:02:50.302494 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 433/850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:49 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:50.706861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 79b454c4-af92-48f9-859c-dc3e702e22e0 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:50.732599 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60d7dd50-6fd1-4c96-be87-5985054e4404 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 2053 microversion: 2.25 time: 0.599546 Oct 27 09:02:50.733173 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 418/851] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:50 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 2053 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:02:50.759088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:50.760135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:50.768134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:50.768668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:50.769359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:50.770612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:50.771946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:50.772671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:50.958613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:50.959456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:50.968816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:50.969320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:50.969765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:50.973524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:50.974103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:50.974823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:51.376050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 79b454c4-af92-48f9-859c-dc3e702e22e0 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:51.410208 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86eba32e-6e7d-44b0-bc9b-5a45c02a5bc6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 2053 microversion: 2.25 time: 0.655683 Oct 27 09:02:51.420358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 434/852] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:50 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 2053 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:51.425466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:51.426394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] [instance: b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:51.437944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:51.443395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:51.444150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:51.445117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:51.445772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:51.446409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:51.448167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:51.462172 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-757551c8-eb0c-4710-9a5e-df647a666519 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1337 microversion: 2.1 time: 0.504229 Oct 27 09:02:51.462824 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 419/853] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:50 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1337 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:02:51.471288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] HTTP exception thrown: Instance b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 could not be found. Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Request method failure captured: Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 HTTP/1.1 Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjvOGEFLiYhM6yvnYwMLswkLdL0zf7C9tB73_OsX8Y2iZmI9KBvWeMGsVwfAT_y9ufg-_Bu5d6zE3fpyMsQ4Uy7KnQDyZgi4GvSAtNSbZLLK0OiMttbTub-9Da6w9Kl901iauB5VVM_QHOFzpKpnFHFVo121W0IJTemHc_oD0FKciE Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: fdefc8ef9ac54c2295f8ed1c7e5c0af6 Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-LiveMigrationNegativeTest-696035319 Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdefc8ef9ac54c2295f8ed1c7e5c0af6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fdefc8ef9ac54c2295f8ed1c7e5c0af6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fdefc8ef9ac54c2295f8ed1c7e5c0af6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fdefc8ef9ac54c2295f8ed1c7e5c0af6"}]}] Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-LiveMigrationNegativeTest-696035319 Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: fdefc8ef9ac54c2295f8ed1c7e5c0af6 Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-696035319 Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-LiveMigrationNegativeTest-696035319-project Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 1b81d8567c74491497aa9005c32412dd Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-LiveMigrationNegativeTest-696035319-project Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 could not be found. Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930'} Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 could not be found. Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 could not be found. Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:02:51.473362 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:51.477865 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:02:51.477865 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:02:51.477865 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:02:51.477865 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:02:51.477865 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:02:51.477865 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 could not be found. Oct 27 09:02:51.477865 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:02:51.480274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] Returning 404 to user: Instance b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:02:51.481368 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6bc0e6a-ad07-4cf9-a491-c62db0aa8ef7 tempest-LiveMigrationNegativeTest-696035319 tempest-LiveMigrationNegativeTest-696035319-project] 10.222.0.25 "GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930" status: 404 len: 111 microversion: 2.1 time: 0.059695 Oct 27 09:02:51.482170 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 435/854] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:51 2022] GET /compute/v2.1/servers/b23e0ac0-0e5e-4f3c-9e0d-0d435a0da930 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:02:51.489676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5593cc3-5fcb-4273-89f7-6413c3abe446 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:51.497889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5593cc3-5fcb-4273-89f7-6413c3abe446 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:51.498656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5593cc3-5fcb-4273-89f7-6413c3abe446 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:51.499613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5593cc3-5fcb-4273-89f7-6413c3abe446 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:51.501734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5593cc3-5fcb-4273-89f7-6413c3abe446 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:51.503064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5593cc3-5fcb-4273-89f7-6413c3abe446 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:51.504016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5593cc3-5fcb-4273-89f7-6413c3abe446 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:51.544132 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5593cc3-5fcb-4273-89f7-6413c3abe446 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.072053 Oct 27 09:02:51.546144 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 420/855] 10.222.0.25 () {60 vars in 1217 bytes} [Thu Oct 27 09:02:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:02:51.560671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a0e8306-e42c-458d-8f9f-d72b7622fd92 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:51.561213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a0e8306-e42c-458d-8f9f-d72b7622fd92 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:51.570771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e8306-e42c-458d-8f9f-d72b7622fd92 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:51.571593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e8306-e42c-458d-8f9f-d72b7622fd92 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:51.572450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e8306-e42c-458d-8f9f-d72b7622fd92 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:51.573406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e8306-e42c-458d-8f9f-d72b7622fd92 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:51.574281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e8306-e42c-458d-8f9f-d72b7622fd92 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:51.575697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e8306-e42c-458d-8f9f-d72b7622fd92 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:51.836121 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a0e8306-e42c-458d-8f9f-d72b7622fd92 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0/action" status: 202 len: 0 microversion: 2.25 time: 0.277977 Oct 27 09:02:51.845038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:51.845856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:51.854521 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 436/856] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:02:51 2022] POST /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:02:51.857517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:51.859191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:51.860400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:51.864362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:51.865247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:51.866613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:52.420656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 79b454c4-af92-48f9-859c-dc3e702e22e0 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:52.455356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fc229b3-7c6c-40ac-b1d6-061279e1b305 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 2058 microversion: 2.25 time: 0.614041 Oct 27 09:02:52.456557 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 421/857] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:51 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 2058 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:02:52.487912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:52.491152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:52.516183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:52.517527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:52.518226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:52.519272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:52.519986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:52.520653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:52.912528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:52.922327 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f5c6b49-70de-4a5c-a50c-ee160b0b68fa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1379 microversion: 2.1 time: 0.439456 Oct 27 09:02:52.941321 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 437/858] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:52 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1379 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:53.484508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:53.486151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:53.520595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:53.523007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:53.524273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:53.529772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:53.532739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:53.535013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:53.953034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:53.954365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:53.963561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:53.964419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:53.965892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:53.968445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:53.969186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:53.972160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:53.991073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 79b454c4-af92-48f9-859c-dc3e702e22e0 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:54.037987 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6dcdda4-e284-4978-9a62-57e0d5c42220 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 2038 microversion: 2.25 time: 0.551811 Oct 27 09:02:54.037987 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 422/859] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:53 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 2038 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:54.064322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-16", "block_migration": "auto"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:54.067158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:54.086182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:54.086695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:54.087145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:54.087914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:54.088537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:54.091252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:54.098562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:54.155387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'flavor' on Instance uuid 79b454c4-af92-48f9-859c-dc3e702e22e0 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:02:54.178572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Going to try to live migrate instance to n-h1-858383-16 {{(pid=120603) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:02:54.198152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:54.334479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:54.347266 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-352663a0-2eef-49a5-aab0-d76f69a1c1e7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1379 microversion: 2.1 time: 0.400296 Oct 27 09:02:54.351975 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 438/860] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:53 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1379 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:54.795064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3bfdc3ce-0ce8-405e-8256-b67afb2fc379 req-8b29e9b1-0b1c-42eb-aab5-92aaf2dede51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e4c64d-6f11-409d-befa-fbea1791a69b", "tag": "e8980257-9864-4b1e-940e-b586249dde6e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:54.814739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3bfdc3ce-0ce8-405e-8256-b67afb2fc379 req-8b29e9b1-0b1c-42eb-aab5-92aaf2dede51 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:54.815316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3bfdc3ce-0ce8-405e-8256-b67afb2fc379 req-8b29e9b1-0b1c-42eb-aab5-92aaf2dede51 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:54.816053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3bfdc3ce-0ce8-405e-8256-b67afb2fc379 req-8b29e9b1-0b1c-42eb-aab5-92aaf2dede51 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:54.840660 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3bfdc3ce-0ce8-405e-8256-b67afb2fc379 req-8b29e9b1-0b1c-42eb-aab5-92aaf2dede51 service nova] Creating event network-changed:e8980257-9864-4b1e-940e-b586249dde6e for instance a6e4c64d-6f11-409d-befa-fbea1791a69b on n-h1-858383-16 Oct 27 09:02:54.846127 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3bfdc3ce-0ce8-405e-8256-b67afb2fc379 req-8b29e9b1-0b1c-42eb-aab5-92aaf2dede51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054960 Oct 27 09:02:54.847310 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 439/861] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:02:55.377096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:55.377733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:55.389270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:55.390766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:55.391226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:55.391992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:55.392463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:55.397402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:55.928688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:55.944683 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-21eb4bef-fa99-4e55-94fd-f04dbfc65766 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1379 microversion: 2.1 time: 0.570749 Oct 27 09:02:55.948702 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 440/862] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:55 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1379 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:56.624869 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5cfe79c0-0772-424e-91cf-d7fd5949bc49 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0/action" status: 202 len: 0 microversion: 2.25 time: 2.565155 Oct 27 09:02:56.627013 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 423/863] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:02:54 2022] POST /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0/action => generated 0 bytes in 2568 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:02:56.649015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:56.654004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:56.683480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:56.714903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:56.715906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:56.716254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:56.716720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:56.717157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:56.979195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:56.980281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:56.991395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:56.992505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:56.993133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:56.994713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:56.995358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:56.996019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:57.079209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:57.094658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:57.096685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:57.100377 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fcfc7e95-f405-40f2-aed5-add7becb1529 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 0.468629 Oct 27 09:02:57.102071 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 441/864] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:56 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:57.416187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:57.425498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65c32bd9-77f4-43c9-9f36-918845dba3e9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1379 microversion: 2.1 time: 0.453698 Oct 27 09:02:57.434319 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 424/865] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:56 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1379 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:02:58.132840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:58.134887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:58.156956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:58.179198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:58.185887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:58.186908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:58.190684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:58.199225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:58.312654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:58.581593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd1598fd-6d7d-4673-a805-e46c09732a9e tempest-QuotaClassesAdminTestJSON-1946150700 tempest-QuotaClassesAdminTestJSON-1946150700-project-admin] Calling method '.version_select at 0x7f31aa4e0430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:58.606386 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd1598fd-6d7d-4673-a805-e46c09732a9e tempest-QuotaClassesAdminTestJSON-1946150700 tempest-QuotaClassesAdminTestJSON-1946150700-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.318822 Oct 27 09:02:58.606966 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 425/866] 10.222.0.25 () {58 vars in 1185 bytes} [Thu Oct 27 09:02:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:58.616279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:58.625838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:58.626830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:58.636696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:58.637196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:58.642664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:58.643609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:58.644097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:58.644699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:58.766418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:58.781883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:58.783477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:58.784579 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd1abb4b-989b-429a-a996-7ce19ca44fdd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 0.656657 Oct 27 09:02:58.785134 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 442/867] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:58 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:02:58.807807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ecfce13d-03fa-4542-a178-e425015a83bb tempest-QuotaClassesAdminTestJSON-1946150700 tempest-QuotaClassesAdminTestJSON-1946150700-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa6eb8b0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:59.510335 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ecfce13d-03fa-4542-a178-e425015a83bb tempest-QuotaClassesAdminTestJSON-1946150700 tempest-QuotaClassesAdminTestJSON-1946150700-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.707246 Oct 27 09:02:59.511280 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 443/868] 10.222.0.25 () {60 vars in 1206 bytes} [Thu Oct 27 09:02:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:59.523155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-226d375c-d6e5-438b-be0b-ef355621387d tempest-QuotaClassesAdminTestJSON-1946150700 tempest-QuotaClassesAdminTestJSON-1946150700-project-admin] Calling method '.version_select at 0x7f31aa8dadc0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:59.535755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=12,nova_api:INSERT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:02:59.554395 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-226d375c-d6e5-438b-be0b-ef355621387d tempest-QuotaClassesAdminTestJSON-1946150700 tempest-QuotaClassesAdminTestJSON-1946150700-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.035542 Oct 27 09:02:59.563999 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 444/869] 10.222.0.25 () {58 vars in 1185 bytes} [Thu Oct 27 09:02:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:02:59.580595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:02:59.590426 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a561c8a8-d354-400a-8f15-3a07433fc281 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1379 microversion: 2.1 time: 0.979263 Oct 27 09:02:59.590928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-75a6ce0d-8a8a-48a2-a1e3-fa8b1c6c9d9b tempest-QuotaClassesAdminTestJSON-1946150700 tempest-QuotaClassesAdminTestJSON-1946150700-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa6ccb80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:02:59.591067 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 426/870] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:02:58 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1379 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:02:59.810165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:02:59.810390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:02:59.825857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:59.827862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:59.834927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:02:59.836547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:02:59.837467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:02:59.839301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:00.026282 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-75a6ce0d-8a8a-48a2-a1e3-fa8b1c6c9d9b tempest-QuotaClassesAdminTestJSON-1946150700 tempest-QuotaClassesAdminTestJSON-1946150700-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.449105 Oct 27 09:03:00.046791 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 445/871] 10.222.0.25 () {60 vars in 1206 bytes} [Thu Oct 27 09:02:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:00.246833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:00.256342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:00.265613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:00.278501 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0655f408-4b95-48d2-8554-bd59eaa3b917 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 0.472717 Oct 27 09:03:00.283734 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 427/872] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:02:59 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:00.619144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:00.621209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:00.627507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:00.628051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:00.628485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:00.637398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:00.637398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:00.637767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:01.313249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:01.314488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:01.322266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:01.323091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:01.325694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:01.326719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:01.328208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:01.329692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:01.348297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:01.359421 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5d20b5e-baa0-438b-9fad-4a6145c4390b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1379 microversion: 2.1 time: 0.744947 Oct 27 09:03:01.388437 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 446/873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:00 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1379 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:01.517196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:01.622102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a1fd32c9-f105-4136-95d8-5c4127e2eaaf req-8f53a489-c21d-4092-b36c-c007dcca2b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b454c4-af92-48f9-859c-dc3e702e22e0", "name": "network-vif-unplugged", "status": "completed", "tag": "ad86b77a-7d3b-4d7e-b22b-f254fe439313"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:01.652216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a1fd32c9-f105-4136-95d8-5c4127e2eaaf req-8f53a489-c21d-4092-b36c-c007dcca2b2d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:01.653972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a1fd32c9-f105-4136-95d8-5c4127e2eaaf req-8f53a489-c21d-4092-b36c-c007dcca2b2d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:01.656027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a1fd32c9-f105-4136-95d8-5c4127e2eaaf req-8f53a489-c21d-4092-b36c-c007dcca2b2d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:01.685471 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a1fd32c9-f105-4136-95d8-5c4127e2eaaf req-8f53a489-c21d-4092-b36c-c007dcca2b2d service nova] Creating event network-vif-unplugged:ad86b77a-7d3b-4d7e-b22b-f254fe439313 for instance 79b454c4-af92-48f9-859c-dc3e702e22e0 on n-h2-858383-16 Oct 27 09:03:01.692108 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a1fd32c9-f105-4136-95d8-5c4127e2eaaf req-8f53a489-c21d-4092-b36c-c007dcca2b2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077060 Oct 27 09:03:01.694856 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 447/874] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:01.883001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:01.893748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:01.895915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:01.897526 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aedc52b4-bd92-4846-bb94-4a732313e71f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 0.596636 Oct 27 09:03:01.899595 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 428/875] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:01 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:03:02.388573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:02.389449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:02.403683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:02.404702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:02.405476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:02.406446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:02.407124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:02.407821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:02.928705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:02.929378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:02.939596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:02.948441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:02.948890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:02.949644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:02.950107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:02.950584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:03.565350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:03.577179 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7d7cf1b-e17a-42a8-a7d5-44d41bd0b9e2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1379 microversion: 2.1 time: 1.190394 Oct 27 09:03:03.585154 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 448/876] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:02 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1379 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:03.601743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:03.613881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:03.618896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:03.621332 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db891af0-4b2a-473f-923f-156c7bc6ea96 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 0.697472 Oct 27 09:03:03.625975 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 429/877] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:02 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:03:03.661292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b805cad7-8b9a-4ab2-82ad-229885d3864d req-accedb19-963d-4ed5-a92d-17d94490dd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e4c64d-6f11-409d-befa-fbea1791a69b", "name": "network-vif-plugged", "status": "completed", "tag": "e8980257-9864-4b1e-940e-b586249dde6e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:03.687643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b805cad7-8b9a-4ab2-82ad-229885d3864d req-accedb19-963d-4ed5-a92d-17d94490dd77 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:03.688100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b805cad7-8b9a-4ab2-82ad-229885d3864d req-accedb19-963d-4ed5-a92d-17d94490dd77 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:03.688532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b805cad7-8b9a-4ab2-82ad-229885d3864d req-accedb19-963d-4ed5-a92d-17d94490dd77 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:03.708562 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b805cad7-8b9a-4ab2-82ad-229885d3864d req-accedb19-963d-4ed5-a92d-17d94490dd77 service nova] Creating event network-vif-plugged:e8980257-9864-4b1e-940e-b586249dde6e for instance a6e4c64d-6f11-409d-befa-fbea1791a69b on n-h1-858383-16 Oct 27 09:03:03.722738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e7a487dd-da31-4d2e-a67c-c334e4672ace req-213690ff-a1bb-4ad7-9f76-dd0e89190880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b454c4-af92-48f9-859c-dc3e702e22e0", "tag": "ad86b77a-7d3b-4d7e-b22b-f254fe439313"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:03.729280 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b805cad7-8b9a-4ab2-82ad-229885d3864d req-accedb19-963d-4ed5-a92d-17d94490dd77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081732 Oct 27 09:03:03.733684 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 449/878] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:03.736190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e7a487dd-da31-4d2e-a67c-c334e4672ace req-213690ff-a1bb-4ad7-9f76-dd0e89190880 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:03.736893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e7a487dd-da31-4d2e-a67c-c334e4672ace req-213690ff-a1bb-4ad7-9f76-dd0e89190880 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:03.737504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e7a487dd-da31-4d2e-a67c-c334e4672ace req-213690ff-a1bb-4ad7-9f76-dd0e89190880 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:03.752950 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e7a487dd-da31-4d2e-a67c-c334e4672ace req-213690ff-a1bb-4ad7-9f76-dd0e89190880 service nova] Creating event network-changed:ad86b77a-7d3b-4d7e-b22b-f254fe439313 for instance 79b454c4-af92-48f9-859c-dc3e702e22e0 on n-h2-858383-16 Oct 27 09:03:03.760972 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e7a487dd-da31-4d2e-a67c-c334e4672ace req-213690ff-a1bb-4ad7-9f76-dd0e89190880 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041528 Oct 27 09:03:03.762431 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 430/879] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:04.603728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:04.604541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:04.613352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:04.613848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:04.614935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:04.615675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:04.616143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:04.616576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:04.654188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:04.655036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:04.677151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:04.677737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:04.678385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:04.679299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:04.685923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:04.686435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:05.613096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:05.627082 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d7235bbf-aa6e-42cd-bfa5-3672da5d0440 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1379 microversion: 2.1 time: 1.027890 Oct 27 09:03:05.628942 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 450/880] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:04 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1379 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:05.649748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:05.677096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:05.678587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:05.680586 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e9021dc-4db6-4d75-8670-535450540d22 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 1.032498 Oct 27 09:03:05.700313 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 431/881] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:04 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:03:06.654226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:06.655384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:06.675201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:06.675778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:06.676230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:06.684913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:06.685759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:06.685900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:06.840368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c3168af-07cb-4c37-9878-3c594b929c77 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Calling method '.version_select at 0x7f31aa7d2280>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:06.982870 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c3168af-07cb-4c37-9878-3c594b929c77 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 200 len: 371 microversion: 2.1 time: 0.406514 Oct 27 09:03:06.985684 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 451/882] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 09:03:06 2022] GET /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:07.009081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:07.012741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:07.030357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:07.031861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:07.037162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:07.037928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:07.038401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:07.045744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:07.058683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:07.079205 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0fdd510f-3ef9-47f2-b82f-b060d0356e9f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1529 microversion: 2.1 time: 0.428460 Oct 27 09:03:07.088820 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 432/883] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:06 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1529 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:07.115030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9463a2c7-943c-41f8-a0ca-b2a2f0d4155c tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa9f4280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:07.360999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463a2c7-943c-41f8-a0ca-b2a2f0d4155c tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:07.361586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463a2c7-943c-41f8-a0ca-b2a2f0d4155c tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:07.362252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463a2c7-943c-41f8-a0ca-b2a2f0d4155c tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:07.362893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463a2c7-943c-41f8-a0ca-b2a2f0d4155c tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:07.363419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463a2c7-943c-41f8-a0ca-b2a2f0d4155c tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:07.364326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9463a2c7-943c-41f8-a0ca-b2a2f0d4155c tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:07.460095 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9463a2c7-943c-41f8-a0ca-b2a2f0d4155c tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 200 len: 328 microversion: 2.1 time: 0.369783 Oct 27 09:03:07.461640 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 433/884] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:03:07 2022] PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 328 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:07.503744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:07.504641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:07.512672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:07.513490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:07.514153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:07.515088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:07.515813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:07.516589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:07.538046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:07.557065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:07.567120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:07.568751 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-65210e20-af1b-4fee-8f43-7e187254ccf1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 0.569480 Oct 27 09:03:07.571119 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 452/885] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:06 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:07.814270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1665772237", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:07.819860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:07.852074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5b08349-417b-4cab-9e8e-a943eeb4fc37 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1529 microversion: 2.1 time: 0.385754 Oct 27 09:03:07.853219 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 434/886] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:07 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1529 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:07.875463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8959b3f-b0cc-421d-a2a4-630568393e97 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:07.909320 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8959b3f-b0cc-421d-a2a4-630568393e97 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/12e94858-b912-4c84-a3ba-6ef5c5932f7f" status: 202 len: 0 microversion: 2.1 time: 0.035913 Oct 27 09:03:07.912282 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 435/887] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:03:07 2022] DELETE /compute/v2.1/flavors/12e94858-b912-4c84-a3ba-6ef5c5932f7f => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:03:07.933195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2da81d94-f387-4351-913c-696e0ba534fc tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:07.942190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:03:07.969691 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2da81d94-f387-4351-913c-696e0ba534fc tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.051642 Oct 27 09:03:07.970842 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 436/888] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:03:07 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:07.994816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:08.000222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:08.020352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:08.021584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:08.022045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:08.024802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:08.026792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:08.027670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:08.096158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:08.108306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Old instance type tempest-test_resize_flavor_-1233164530, new instance type m1.heat {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 09:03:08.124370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:03:08.135729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:03:08.136693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:03:08.137611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:03:08.138266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:03:08.324837 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1da49f7d-839b-4476-b655-42d3a72e90e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b/action" status: 202 len: 0 microversion: 2.1 time: 0.336705 Oct 27 09:03:08.327304 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 437/889] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:03:07 2022] POST /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:03:08.346781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:08.347033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:08.358833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:08.359545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:08.360451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:08.361327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:08.361943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:08.362747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:08.933161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:03:08.938116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:03:08.938776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:03:08.939245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:03:08.941737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:03:08.993109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:08.999798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:09.000373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:09.006117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:09.009540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:09.010152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:09.068699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Getting quotas for project a7883907bd5a4ccb86b21ed88e3bc34a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:09.083748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:09.086479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Getting quotas for user e2942adeba224da4a7e3db745f6ff31b and project a7883907bd5a4ccb86b21ed88e3bc34a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:09.106732 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-815a9323-4d46-4031-b952-d535e5b1c941 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1538 microversion: 2.1 time: 0.774413 Oct 27 09:03:09.109496 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 438/890] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:08 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1538 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:09.118391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.utils [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] cores quota exceeded for a7883907bd5a4ccb86b21ed88e3bc34a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120602) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 09:03:09.120821 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 09:03:09.124558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:09.127728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Request method failure captured: Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 145 Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWklJS7T1zyquraBuD-eBJ4uOsw1_E8VIVU2NuOohZkvXu6_dpcZlS6RnXrJatyC4KjrvpdhkfymKPjEvwLdL_qD-tSQNWuHqxH7y-_CDRIHXoYbzInmL-Um3cvbVfpfo72vVP2myW-ZdjZYkFIi1ipvvqAsuk2UNwJE620HB896PizM Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a7883907bd5a4ccb86b21ed88e3bc34a Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7883907bd5a4ccb86b21ed88e3bc34a"}]}] Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a7883907bd5a4ccb86b21ed88e3bc34a Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-QuotasAdminNegativeTest-1839307747-project Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e2942adeba224da4a7e3db745f6ff31b Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-QuotasAdminNegativeTest-1839307747-project Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1665772237", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1665772237', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452'}}} Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 09:03:09.132167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 27 09:03:09.137888 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:09.143489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:09.144554 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f861a29-e6fc-4361-8282-d51800e39375 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.425866 Oct 27 09:03:09.145754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 453/891] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:03:07 2022] POST /compute/v2.1/servers => generated 111 bytes in 1428 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:03:09.148444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:09.149115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:09.153797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:09.154791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:09.156131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:09.158416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:09.162742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-898a9d60-0943-41c5-a56e-8eb842a6f617 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Action: 'update', calling method: .version_select at 0x7f31aafd1160>, body: {"quota_set": {"cores": 20}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:09.355361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-898a9d60-0943-41c5-a56e-8eb842a6f617 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:09.356359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-898a9d60-0943-41c5-a56e-8eb842a6f617 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:09.357045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-898a9d60-0943-41c5-a56e-8eb842a6f617 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:09.358467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-898a9d60-0943-41c5-a56e-8eb842a6f617 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:09.360409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-898a9d60-0943-41c5-a56e-8eb842a6f617 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:09.361122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-898a9d60-0943-41c5-a56e-8eb842a6f617 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:09.508767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-898a9d60-0943-41c5-a56e-8eb842a6f617 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 200 len: 329 microversion: 2.1 time: 0.357410 Oct 27 09:03:09.509416 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 454/892] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:03:09 2022] PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 329 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:09.526791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-258110a8-7aa4-4023-a1ca-799850670c79 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Calling method '.version_select at 0x7f31ab07a8b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:09.589319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:09.598004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:09.605145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:09.606357 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c6276a3-4fd0-4922-b26c-f6873f7761ad tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 0.494925 Oct 27 09:03:09.624099 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 439/893] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:09 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:09.690603 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-258110a8-7aa4-4023-a1ca-799850670c79 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 200 len: 371 microversion: 2.1 time: 0.170301 Oct 27 09:03:09.691832 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 455/894] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 09:03:09 2022] GET /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:09.706553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce696778-4012-4eff-8cc7-c7378bb16124 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa4a3dc0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:09.843683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce696778-4012-4eff-8cc7-c7378bb16124 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:09.844319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce696778-4012-4eff-8cc7-c7378bb16124 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:09.844779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce696778-4012-4eff-8cc7-c7378bb16124 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:09.845601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce696778-4012-4eff-8cc7-c7378bb16124 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:09.849454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce696778-4012-4eff-8cc7-c7378bb16124 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:09.850173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce696778-4012-4eff-8cc7-c7378bb16124 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:09.961834 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce696778-4012-4eff-8cc7-c7378bb16124 tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 200 len: 328 microversion: 2.1 time: 0.260101 Oct 27 09:03:09.976313 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 440/895] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:03:09 2022] PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 328 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:10.122342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1348179318", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:10.134857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:10.135615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:10.168847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:10.179556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:10.180885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:10.190947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:10.193829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:10.194390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:10.259149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:10.311375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:03:10.957606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:10.969399 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d87c4641-c8f7-4eae-9a1a-38fe2ceaf44c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1538 microversion: 2.1 time: 0.838901 Oct 27 09:03:10.971890 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 441/896] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:10 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1538 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:10.993597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:10.994483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:11.007301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:03:11.008042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:03:11.008948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:03:11.009539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:03:11.010614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:03:11.020768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:11.021574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:11.022224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:11.023894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:11.024774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:11.025213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:11.032264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:11.032264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:11.032579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:11.034107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:11.046140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:11.046638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:11.139041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Getting quotas for project a7883907bd5a4ccb86b21ed88e3bc34a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:11.154732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Getting quotas for user e2942adeba224da4a7e3db745f6ff31b and project a7883907bd5a4ccb86b21ed88e3bc34a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:11.214343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.utils [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] instances quota exceeded for a7883907bd5a4ccb86b21ed88e3bc34a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120602) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 09:03:11.216150 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Request method failure captured: Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 145 Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWklJS7T1zyquraBuD-eBJ4uOsw1_E8VIVU2NuOohZkvXu6_dpcZlS6RnXrJatyC4KjrvpdhkfymKPjEvwLdL_qD-tSQNWuHqxH7y-_CDRIHXoYbzInmL-Um3cvbVfpfo72vVP2myW-ZdjZYkFIi1ipvvqAsuk2UNwJE620HB896PizM Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a7883907bd5a4ccb86b21ed88e3bc34a Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7883907bd5a4ccb86b21ed88e3bc34a"}]}] Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a7883907bd5a4ccb86b21ed88e3bc34a Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-QuotasAdminNegativeTest-1839307747-project Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e2942adeba224da4a7e3db745f6ff31b Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-QuotasAdminNegativeTest-1839307747-project Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1348179318", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1348179318', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452'}}} Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 09:03:11.223997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:11.228662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:11.235518 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e2167f01-7959-4994-ad35-3c19051d986a tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.108045 Oct 27 09:03:11.239524 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 456/897] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:03:10 2022] POST /compute/v2.1/servers => generated 119 bytes in 1123 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:03:11.252654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-505c8ba3-c3a0-4040-99f8-06387c42a6ba tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Action: 'update', calling method: .version_select at 0x7f31ab0163a0>, body: {"quota_set": {"instances": 10}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:11.386716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:11.403786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:11.409924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:11.419345 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b48fca34-9327-4851-bab9-627737d2545a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 0.438308 Oct 27 09:03:11.420311 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 442/898] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:10 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:11.422279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c8ba3-c3a0-4040-99f8-06387c42a6ba tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:11.422840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c8ba3-c3a0-4040-99f8-06387c42a6ba tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:11.425640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c8ba3-c3a0-4040-99f8-06387c42a6ba tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:11.427953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c8ba3-c3a0-4040-99f8-06387c42a6ba tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:11.431825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c8ba3-c3a0-4040-99f8-06387c42a6ba tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:11.433819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-505c8ba3-c3a0-4040-99f8-06387c42a6ba tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:11.610304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:11.675636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-505c8ba3-c3a0-4040-99f8-06387c42a6ba tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 200 len: 329 microversion: 2.1 time: 0.421055 Oct 27 09:03:11.676473 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 457/899] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:03:11 2022] PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 329 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:11.699490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68dc312f-e25c-4582-b98d-52dc811cc91f tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Calling method '.version_select at 0x7f31aaa05670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:11.863508 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68dc312f-e25c-4582-b98d-52dc811cc91f tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 200 len: 371 microversion: 2.1 time: 0.174364 Oct 27 09:03:11.872628 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 443/900] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 09:03:11 2022] GET /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:11.884908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-76a00f2e-16a4-4942-932c-b95508be2b4b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Action: 'update', calling method: .version_select at 0x7f31ab07ac10>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:11.995903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:11.996872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:12.011551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:12.015355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:12.015941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:12.030877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:12.031389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:12.031870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:12.078136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a00f2e-16a4-4942-932c-b95508be2b4b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:12.080529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a00f2e-16a4-4942-932c-b95508be2b4b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:12.081335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a00f2e-16a4-4942-932c-b95508be2b4b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:12.084028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a00f2e-16a4-4942-932c-b95508be2b4b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:12.084670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a00f2e-16a4-4942-932c-b95508be2b4b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:12.086243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a00f2e-16a4-4942-932c-b95508be2b4b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:12.269357 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-76a00f2e-16a4-4942-932c-b95508be2b4b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 200 len: 325 microversion: 2.1 time: 0.385758 Oct 27 09:03:12.271646 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 458/901] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:03:11 2022] PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 325 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:12.362125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1309379001", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:12.457100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:03:12.764640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:12.779049 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e1ff2ca4-4335-401a-a2c7-c175fc7c932f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1538 microversion: 2.1 time: 0.787130 Oct 27 09:03:12.784738 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 444/902] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:11 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1538 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:12.797728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:12.798880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:12.818034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:12.818790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:12.820444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:12.822152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:12.824338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:12.826113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:13.088314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:03:13.088737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:03:13.089334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:03:13.089747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:03:13.090198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:03:13.116076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:13.117227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:13.117227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:13.117918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:13.118373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:13.118872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:13.171927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Getting quotas for project a7883907bd5a4ccb86b21ed88e3bc34a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:13.182675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Getting quotas for user e2942adeba224da4a7e3db745f6ff31b and project a7883907bd5a4ccb86b21ed88e3bc34a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:13.198454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:13.224499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.utils [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] ram quota exceeded for a7883907bd5a4ccb86b21ed88e3bc34a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120602) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 27 09:03:13.225136 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Request method failure captured: Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 145 Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWklJS7T1zyquraBuD-eBJ4uOsw1_E8VIVU2NuOohZkvXu6_dpcZlS6RnXrJatyC4KjrvpdhkfymKPjEvwLdL_qD-tSQNWuHqxH7y-_CDRIHXoYbzInmL-Um3cvbVfpfo72vVP2myW-ZdjZYkFIi1ipvvqAsuk2UNwJE620HB896PizM Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a7883907bd5a4ccb86b21ed88e3bc34a Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7883907bd5a4ccb86b21ed88e3bc34a"}]}] Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a7883907bd5a4ccb86b21ed88e3bc34a Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-QuotasAdminNegativeTest-1839307747-project Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e2942adeba224da4a7e3db745f6ff31b Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-QuotasAdminNegativeTest-1839307747-project Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1309379001", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1309379001', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452'}}} Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 09:03:13.227242 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9041ec89-4008-43de-818a-1a19b24f4221 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.875202 Oct 27 09:03:13.231083 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 459/903] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:03:12 2022] POST /compute/v2.1/servers => generated 110 bytes in 878 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:03:13.253696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-237b48c6-9cc4-4093-9040-a1d19337836b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa8174c0>, body: {"quota_set": {"ram": 51200}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:13.379883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-237b48c6-9cc4-4093-9040-a1d19337836b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:13.382665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-237b48c6-9cc4-4093-9040-a1d19337836b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:13.383383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-237b48c6-9cc4-4093-9040-a1d19337836b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:13.384583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-237b48c6-9cc4-4093-9040-a1d19337836b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:13.385254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-237b48c6-9cc4-4093-9040-a1d19337836b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:13.387002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-237b48c6-9cc4-4093-9040-a1d19337836b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:13.417992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:13.433605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:13.435435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:13.442964 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e3eb2827-8c11-437b-85ac-b78a295c1b0c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1568 microversion: 2.25 time: 0.656281 Oct 27 09:03:13.444779 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 445/904] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:12 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1568 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:13.487387 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-237b48c6-9cc4-4093-9040-a1d19337836b tempest-QuotasAdminNegativeTest-420848857 tempest-QuotasAdminNegativeTest-420848857-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 200 len: 329 microversion: 2.1 time: 0.250816 Oct 27 09:03:13.488382 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 460/905] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:03:13 2022] PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 329 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:13.504854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fa83373-f93b-44d3-9209-a6766a2a15c2 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Action: 'update', calling method: .version_select at 0x7f31aaa054c0>, body: {"quota_set": {"ram": 0}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:13.510980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5fa83373-f93b-44d3-9209-a6766a2a15c2 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e2942adeba224da4a7e3db745f6ff31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7883907bd5a4ccb86b21ed88e3bc34a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fa83373-f93b-44d3-9209-a6766a2a15c2 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Request method failure captured: Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: request: PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a HTTP/1.1 Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 25 Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWklJS7T1zyquraBuD-eBJ4uOsw1_E8VIVU2NuOohZkvXu6_dpcZlS6RnXrJatyC4KjrvpdhkfymKPjEvwLdL_qD-tSQNWuHqxH7y-_CDRIHXoYbzInmL-Um3cvbVfpfo72vVP2myW-ZdjZYkFIi1ipvvqAsuk2UNwJE620HB896PizM Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a7883907bd5a4ccb86b21ed88e3bc34a Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7883907bd5a4ccb86b21ed88e3bc34a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7883907bd5a4ccb86b21ed88e3bc34a"}]}] Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a7883907bd5a4ccb86b21ed88e3bc34a Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1839307747 Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-QuotasAdminNegativeTest-1839307747-project Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: e2942adeba224da4a7e3db745f6ff31b Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-QuotasAdminNegativeTest-1839307747-project Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: {"quota_set": {"ram": 0}} Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'a7883907bd5a4ccb86b21ed88e3bc34a', 'body': {'quota_set': {'ram': 0}}} Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:03:13.531711 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 27 09:03:13.536851 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:13.539558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fa83373-f93b-44d3-9209-a6766a2a15c2 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:13.544692 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5fa83373-f93b-44d3-9209-a6766a2a15c2 tempest-QuotasAdminNegativeTest-1839307747 tempest-QuotasAdminNegativeTest-1839307747-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a" status: 403 len: 116 microversion: 2.1 time: 0.046162 Oct 27 09:03:13.547899 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 446/906] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:03:13 2022] PUT /compute/v2.1/os-quota-sets/a7883907bd5a4ccb86b21ed88e3bc34a => generated 116 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:03:13.825766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:13.826817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:13.845555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:13.846394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:13.847291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:13.868409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:13.874101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:13.875468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:13.882551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:14.193340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79d9fbf7-fc92-4cde-93a1-ef348434e52c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Action: 'create', calling method: .version_select at 0x7f31aa9f4a60>, body: {"keypair": {"name": "tempest-keypair-764824312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE2x6vTUXVhnGaGaIfDqpL+1uPtgxZqGmIdczraUJ/ratyyINCdl2BYeRv0HVh43w4f9MkHODwAo1uLRRNEPvUhqIRH/KRLY2baCcp2xN6579a+5ljvfhHC4PPWMm0wdA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:14.237633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-79d9fbf7-fc92-4cde-93a1-ef348434e52c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Getting quotas for project c3cdafcecdff4fe2bad2db76c806bcf3. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:14.251041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-79d9fbf7-fc92-4cde-93a1-ef348434e52c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Getting quotas for user 1415fa5593bd4614988fcc604442d0c0 and project c3cdafcecdff4fe2bad2db76c806bcf3. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:14.267441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:14.282202 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7374ac2f-51d9-478c-a5de-e50620297494 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1538 microversion: 2.1 time: 0.472650 Oct 27 09:03:14.284575 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 461/907] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:13 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1538 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:14.323511 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79d9fbf7-fc92-4cde-93a1-ef348434e52c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.474023 Oct 27 09:03:14.324526 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 447/908] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:03:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:14.473635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:14.474254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:14.495205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:14.495740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:14.496190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:14.496915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:14.497368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:14.499905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:14.814822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:14.827344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:14.841619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:14.843360 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7cb71ec1-0f37-4c7c-b196-914ed44855fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1543 microversion: 2.25 time: 0.376596 Oct 27 09:03:14.844581 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 462/909] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:14 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1543 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:14.872649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5edd5038-0247-42b6-87b8-2b6e2faefb96 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '.version_select at 0x7f31aa7870d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:14.880741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5edd5038-0247-42b6-87b8-2b6e2faefb96 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:14.881495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5edd5038-0247-42b6-87b8-2b6e2faefb96 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:14.883030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5edd5038-0247-42b6-87b8-2b6e2faefb96 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:14.899175 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5edd5038-0247-42b6-87b8-2b6e2faefb96 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3234 microversion: 2.25 time: 0.030416 Oct 27 09:03:14.899850 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 448/910] 10.222.0.25 () {60 vars in 1184 bytes} [Thu Oct 27 09:03:14 2022] GET /compute/v2.1/os-migrations => generated 3234 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:14.920246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:14.925160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:14.937879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:14.938974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:14.939921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:14.941010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:14.942757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:14.943375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:15.309720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:15.311552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:15.330418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:15.331170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:15.335406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:15.335406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:15.335406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:15.336318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:15.374690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 79b454c4-af92-48f9-859c-dc3e702e22e0 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:03:15.418128 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37a58ad9-b69f-471d-87a1-5bd5bd48ebea tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 2038 microversion: 2.25 time: 0.502350 Oct 27 09:03:15.421271 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 463/911] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:14 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 2038 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:15.456076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb9cd083-6810-42b6-9f29-b4b19bfb5200 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Action: 'create', calling method: .version_select at 0x7f31aa9cd0d0>, body: {"keypair": {"name": "tempest-keypair-1539815002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYAn6QMzqQIvs7MKXIgZal8dr9mHgGROHupuF1QBiYym0QydiCN4nE9mTC+q90hSGPVAkEV+278c+OswBYRScitceNmj894zAxNp2DzCnVjSIBhWQhm6+1EVXk8NBjy0g=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:15.476548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-cb9cd083-6810-42b6-9f29-b4b19bfb5200 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:15.487663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-cb9cd083-6810-42b6-9f29-b4b19bfb5200 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for user cf8bc1ce921e4f759cb9c0b5f4340324 and project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:15.538353 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb9cd083-6810-42b6-9f29-b4b19bfb5200 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.089139 Oct 27 09:03:15.540821 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 464/912] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Oct 27 09:03:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 27 09:03:15.743893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:15.767535 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4641746f-c929-46df-a22e-dd10c7e283f3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.463084 Oct 27 09:03:15.768147 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 449/913] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:15 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:16.807509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:16.808484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:16.828145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:16.829543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:16.830436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:16.831821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:16.837177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:16.838118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:17.173811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:17.193078 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1b0225a-c664-45a2-b3da-7d250b77de15 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.400297 Oct 27 09:03:17.193670 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 465/914] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:16 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:17.709004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-584949505", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "29aab344-ab67-47ba-a004-014083ac1f17"}], "security_groups": [{"name": "tempest-securitygroup--1774858464"}], "key_name": "tempest-keypair-764824312", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:17.888752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] validate_networks() for [('29aab344-ab67-47ba-a004-014083ac1f17', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:03:18.234133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:18.234765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:18.256319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:18.256829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:18.257276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:18.258004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:18.258461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:18.258893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:18.539116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:18.550845 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1cc4f43c-ad5d-4f1f-8132-3259502dbf7c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.327747 Oct 27 09:03:18.553765 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 466/915] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:18 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:18.560514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1293274682", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "1a8d8c4c-d7c6-4980-b309-ab63e829200b"}], "security_groups": [{"name": "tempest-securitygroup--1364045759"}], "key_name": "tempest-keypair-1539815002", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:18.696253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:03:18.697129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:03:18.697695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:03:18.698229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:03:18.698834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:03:18.703825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:18.728073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:18.728073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:18.728073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:18.730238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:18.730954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:18.732357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:18.764040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Getting quotas for project c3cdafcecdff4fe2bad2db76c806bcf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:18.770514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Getting quotas for user 1415fa5593bd4614988fcc604442d0c0 and project c3cdafcecdff4fe2bad2db76c806bcf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:18.785923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:03:18.789348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:03:18.800378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] validate_networks() for [('1a8d8c4c-d7c6-4980-b309-ab63e829200b', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:03:18.849063 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d742e3ad-b96d-4496-a180-2be613aa6256 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.144034 Oct 27 09:03:18.850511 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 450/916] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:03:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:03:19.126707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1518859381", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:19.194125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:03:19.667436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:03:19.668381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:03:19.669016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:03:19.669581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:03:19.670179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:03:19.684745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:19.690964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:19.691803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:19.693493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:19.694801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:19.695429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:19.735223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Getting quotas for project 9cf384590a90420a82a0df1a492f184c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:19.747492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Getting quotas for user bea683a1e9f94170b0c7049eedb41591 and project 9cf384590a90420a82a0df1a492f184c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:19.785597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:03:19.788318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:03:19.919400 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5f511cfa-2287-4955-bb76-eeda33ee35e3 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067604 Oct 27 09:03:19.936957 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 451/917] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:03:19.944188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:19.944799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:19.962954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:19.963995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:19.964829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:19.965852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:19.966478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:19.967070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:20.092748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:03:20.093362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:03:20.093837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:03:20.094619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:03:20.095014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:03:20.114523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:20.115333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:20.116847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:20.118306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:20.119112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:20.119927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:20.143858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:20.152202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for user cf8bc1ce921e4f759cb9c0b5f4340324 and project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:20.156108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:20.169046 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82595eaa-9e67-410a-b271-15c83c79759f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1292 microversion: 2.1 time: 0.230864 Oct 27 09:03:20.170775 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 452/918] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:19 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1292 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:20.182344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:20.184375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:20.196417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:03:20.200216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:20.200992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:20.201982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:20.204977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:20.207877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:20.208985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:20.210027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:03:20.275272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a3c09b5b-1f38-4efa-937e-01421e6b3e81 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.720423 Oct 27 09:03:20.276097 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 467/919] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:03:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:03:20.287433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eda8505d-eac7-42c5-9a6f-a41530f9dfd2 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:20.288486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eda8505d-eac7-42c5-9a6f-a41530f9dfd2 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:20.455846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eda8505d-eac7-42c5-9a6f-a41530f9dfd2 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:20.473097 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eda8505d-eac7-42c5-9a6f-a41530f9dfd2 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1223 microversion: 2.1 time: 0.190608 Oct 27 09:03:20.473821 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 468/920] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:20 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1223 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:20.485108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ebd02547-0f97-4b9e-a52e-e4b924b8dd69 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:20.486254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ebd02547-0f97-4b9e-a52e-e4b924b8dd69 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:20.541070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:20.554067 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f65b178-98c0-4937-b1a8-1b12c419b31e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.379950 Oct 27 09:03:20.556234 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 453/921] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:20 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:20.589851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebd02547-0f97-4b9e-a52e-e4b924b8dd69 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:20.604747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebd02547-0f97-4b9e-a52e-e4b924b8dd69 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:20.607203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebd02547-0f97-4b9e-a52e-e4b924b8dd69 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:20.609415 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ebd02547-0f97-4b9e-a52e-e4b924b8dd69 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1286 microversion: 2.25 time: 0.133259 Oct 27 09:03:20.611487 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 469/922] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:20 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1286 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:21.204893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:21.206494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:21.215706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.221807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.223767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.225023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.225787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.226622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.341346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:21.352825 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac441da3-749f-4116-9705-9507324c2dc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1298 microversion: 2.1 time: 0.153642 Oct 27 09:03:21.355543 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 454/923] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:21 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:21.500639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:21.502412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:21.510753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.511852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.512777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.513568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.514545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.515056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.581803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:21.584052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:21.599367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.600042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.600490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.601279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.601741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.602183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.717858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:21.736732 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c8cbc009-8abf-499f-821d-037ada5b2bb9 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1275 microversion: 2.1 time: 0.238858 Oct 27 09:03:21.738886 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 470/924] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:21 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:21.748363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:21.748989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:21.756439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.756936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.757443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.758434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.759133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.759911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.869562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:21.881235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:21.883011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:21.884687 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5fcaaa5d-318e-450e-9c15-0af70cb5f600 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1282 microversion: 2.25 time: 0.143164 Oct 27 09:03:21.898478 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 471/925] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:21 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:21.906181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:21.920750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:21.921607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Searching by: {'deleted': False, 'project_id': '00f19c40e6554a1f890cc7348bc30065'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:03:21.930542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.931408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.932061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.932972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:21.933623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:21.934220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:21.961359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:21.996217 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5adc0bdf-91a9-4059-98d5-6ae8f6298ba7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.419408 Oct 27 09:03:22.001675 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 455/926] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:21 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:22.085878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:03:22.215786 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fbe3eb4a-9517-4e50-b516-2250456c2a95 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.313919 Oct 27 09:03:22.219312 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 472/927] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:03:21 2022] GET /compute/v2.1/servers => generated 344 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:22.235257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:22.247769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:22.249999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Searching by: {'deleted': False, 'project_id': '00f19c40e6554a1f890cc7348bc30065'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:03:22.265894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:22.268154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:22.272697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:22.275482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:22.276169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:22.276764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:22.385270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:22.386701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:22.390948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:22.401632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:22.402403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:22.403205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:22.419145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:22.422339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:22.423041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:22.459599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:03:22.829689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:22.851600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:22.851600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:22.851600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:22.963839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:22.974994 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ef6932a1-2eb0-4e41-a5ea-48eb14b599b0 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.594472 Oct 27 09:03:22.976412 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 473/928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:22 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:22.982769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:22.983545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:22.992030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:22.992684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:22.993277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:22.994042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:22.994529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:22.994991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:23.101513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:23.110591 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7428bdbe-84b7-460e-a02d-c29ebe5adde7 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1281 microversion: 2.1 time: 0.132191 Oct 27 09:03:23.111717 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 474/929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:22 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:23.127085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:23.131254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:23.145476 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c25ccb16-e05b-44c2-a40b-ea29184c07f1 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.914671 Oct 27 09:03:23.146257 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 456/930] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:03:22 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:23.152198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:23.152901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:23.168451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:23.169373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:23.169373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:23.172137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:23.173607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:23.174303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:23.175425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:23.176425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:23.177404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:23.177404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:23.182379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:23.183353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:23.402558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:23.423643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:23.425385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:23.426838 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66327f39-5c05-4c15-ae17-08040e41da91 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1338 microversion: 2.25 time: 0.313872 Oct 27 09:03:23.427937 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 475/931] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:23 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1338 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:23.449593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d36ce3ab-0e95-4781-add1-7fba9b5ff9cd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:23.460078 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d36ce3ab-0e95-4781-add1-7fba9b5ff9cd tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023235 Oct 27 09:03:23.468277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 476/932] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:03:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:23.567141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:23.581000 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf58835f-b616-4f83-8cf6-0cdb91c84648 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.432698 Oct 27 09:03:23.582803 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 457/933] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:23 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:23.817385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fa7d6b46-ec27-465a-b34b-c6136342629c req-794e30f4-fc62-46a0-bdc6-f56d875c1c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84aa1ad4-354f-4ad7-b54c-4ee8e96950e6", "tag": "435314b9-661f-4dd8-937f-c626a97df68d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:23.872779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:23.873008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:23.875852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fa7d6b46-ec27-465a-b34b-c6136342629c req-794e30f4-fc62-46a0-bdc6-f56d875c1c84 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:23.878276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fa7d6b46-ec27-465a-b34b-c6136342629c req-794e30f4-fc62-46a0-bdc6-f56d875c1c84 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:23.881053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:23.884492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fa7d6b46-ec27-465a-b34b-c6136342629c req-794e30f4-fc62-46a0-bdc6-f56d875c1c84 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:23.887904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:23.888426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:23.891484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:23.892271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:23.900509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:23.909880 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fa7d6b46-ec27-465a-b34b-c6136342629c req-794e30f4-fc62-46a0-bdc6-f56d875c1c84 service nova] Creating event network-changed:435314b9-661f-4dd8-937f-c626a97df68d for instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 on n-h2-858383-16 Oct 27 09:03:23.926162 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fa7d6b46-ec27-465a-b34b-c6136342629c req-794e30f4-fc62-46a0-bdc6-f56d875c1c84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121750 Oct 27 09:03:23.928551 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 477/934] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:23.962249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:03:24.002749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:24.003640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:24.023544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.024114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.025395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.027561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.027561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.029693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.172027 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-541c4d3c-9132-4a73-ad46-9c2a2dcd15ce tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 204 len: 0 microversion: 2.1 time: 0.303773 Oct 27 09:03:24.173233 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 458/935] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:03:23 2022] DELETE /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:03:24.179866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:24.181125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:24.188518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.189296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.189984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.190949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.191745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.192532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.321282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:24.335846 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bef11bc5-91cd-410d-9a83-0e0e99d1bb17 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1281 microversion: 2.1 time: 0.161092 Oct 27 09:03:24.336724 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 459/936] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:24 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:24.344706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:24.348106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:24.368946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.369535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.371865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.372682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.373249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.374728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.407936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:24.422208 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b27d8f92-a596-48ea-8f4f-31f2d940a661 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.427003 Oct 27 09:03:24.425605 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 478/937] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:23 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:24.461764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:24.462476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:24.476318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.477342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.478023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.478905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.479472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.483034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.584067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:24.593923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:24.594877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:24.595406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:24.596545 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f1c10ec4-d693-48b1-a66d-c00f6ac2357f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1344 microversion: 2.25 time: 0.145468 Oct 27 09:03:24.611441 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 479/938] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:24 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:03:24.611441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:24.611441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:24.618680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:24.622290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.622864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.623323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.624269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:24.624816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:24.625251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:24.628910 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aac1f8a2-a5ed-4ca8-99fb-aa6464eada6d tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1607 microversion: 2.1 time: 0.289897 Oct 27 09:03:24.630098 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 460/939] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:24 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1607 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:24.788205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:24.798083 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f9396e8-15eb-4bf7-8ada-aa6bc8ac81df tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.192782 Oct 27 09:03:24.798696 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 480/940] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:24 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:25.361580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:25.362774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:25.370597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:25.371247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:25.371961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:25.372793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:25.373470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:25.374138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:25.447941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:25.449271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:25.461803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:25.462636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:25.463365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:25.464305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:25.464953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:25.473092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:25.646771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:25.661237 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8a6984ac-5c81-4129-b52f-450dd3ba1d0c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.301035 Oct 27 09:03:25.670201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 461/941] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:25 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:25.686862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:25.688443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:25.697025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:25.698827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:25.700722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:25.701844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:25.702903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:25.704415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:25.816948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:25.834460 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5be677b-5b5e-4a21-b260-91ce26755e14 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.390646 Oct 27 09:03:25.839640 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 481/942] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:25 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:25.845562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:25.847365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:25.862937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:25.863454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:25.864083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:25.864819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:25.865283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:25.865994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:25.893875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:26.021186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:26.031726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:26.033624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:26.035474 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa53f9f9-1347-4616-98a0-c2086cfbe828 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.363681 Oct 27 09:03:26.052632 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 462/943] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:25 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:26.057395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:26.058025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:26.069228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:26.069861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:26.070358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:26.072170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:26.072611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:26.074280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:26.091049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:26.103914 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa52ba37-642e-4c9c-9003-a506c1048548 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1607 microversion: 2.1 time: 0.265656 Oct 27 09:03:26.105629 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 482/944] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:25 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1607 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:26.272557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:26.282454 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7645709c-12c2-4cc3-8955-3fc6ddae347c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.231691 Oct 27 09:03:26.283539 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 463/945] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:26 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:26.696386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:26.697880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:26.704491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:26.704978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:26.705445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:26.706150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:26.706605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:26.707034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:26.858008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:26.859192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:26.865557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:26.866262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:26.866853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:26.867772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:26.868381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:26.868955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:26.875875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:26.887136 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84ca2485-3978-4eab-b165-22684722ed41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.193929 Oct 27 09:03:26.892156 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 483/946] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:26 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:26.953099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-10af11a7-d601-455f-b101-e68402c0bf01 req-60c53488-359a-44be-8250-59b01241af07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d", "tag": "5a1ddd07-b18b-4724-8a1f-952c95c591d9"}, {"name": "network-changed", "server_uuid": "71bb1b9d-cd11-4520-8a23-19fb66586870", "tag": "d01f9056-87e8-488b-b98b-d11e1b5ba9b5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:26.964817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-10af11a7-d601-455f-b101-e68402c0bf01 req-60c53488-359a-44be-8250-59b01241af07 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:26.965295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-10af11a7-d601-455f-b101-e68402c0bf01 req-60c53488-359a-44be-8250-59b01241af07 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:26.965723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-10af11a7-d601-455f-b101-e68402c0bf01 req-60c53488-359a-44be-8250-59b01241af07 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:26.984648 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-10af11a7-d601-455f-b101-e68402c0bf01 req-60c53488-359a-44be-8250-59b01241af07 service nova] Creating event network-changed:5a1ddd07-b18b-4724-8a1f-952c95c591d9 for instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d on n-h2-858383-16 Oct 27 09:03:26.986022 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-10af11a7-d601-455f-b101-e68402c0bf01 req-60c53488-359a-44be-8250-59b01241af07 service nova] Creating event network-changed:d01f9056-87e8-488b-b98b-d11e1b5ba9b5 for instance 71bb1b9d-cd11-4520-8a23-19fb66586870 on n-h2-858383-16 Oct 27 09:03:26.993818 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-10af11a7-d601-455f-b101-e68402c0bf01 req-60c53488-359a-44be-8250-59b01241af07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043986 Oct 27 09:03:26.995303 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 484/947] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:27.037140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:27.045299 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d53998c6-00a9-46c5-b29a-29abb493a0dd tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.191283 Oct 27 09:03:27.046102 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 464/948] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:26 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:27.063303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:27.064574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:27.073841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:27.074266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:27.074705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:27.075433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:27.075910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:27.076329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:27.129783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:27.130957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:27.138463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:27.138956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:27.139397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:27.140352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:27.140945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:27.141570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:27.332369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:27.341473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:27.343403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:27.344872 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-771ed0eb-5382-44df-b463-271f0b7813ef tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.286328 Oct 27 09:03:27.345903 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 485/949] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:27 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:03:27.351532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:27.352492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:27.359163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:27.359881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:27.360579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:27.361458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:27.362071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:27.362669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:27.411899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:27.426061 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23c96525-7926-48d2-95a3-4c2367a78a93 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1607 microversion: 2.1 time: 0.299139 Oct 27 09:03:27.427623 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 465/950] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:27 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1607 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:27.523106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:27.531006 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f130794-fa7c-4306-9377-a11b08b207b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.183707 Oct 27 09:03:27.531594 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 486/951] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:27 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:27.917282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:27.918588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:27.931955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:27.931955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:27.932918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:27.934371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:27.935372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:27.936316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:28.071485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:28.072480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:28.084059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:28.085254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:28.086029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:28.086846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:28.087529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:28.088227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:28.149731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:28.177985 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1ec7722-a1c4-408b-8621-74df894dfd02 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.266606 Oct 27 09:03:28.180469 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 466/952] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:27 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:28.318392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:28.328179 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0dd28bd0-3469-4814-b7b9-efd12ce40d4b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.260147 Oct 27 09:03:28.328769 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 487/953] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:28 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:28.389087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:28.389695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:28.397314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:28.397795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:28.398228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:28.398925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:28.399478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:28.399950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:28.453812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:28.454977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:28.467279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:28.467811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:28.468248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:28.469062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:28.469563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:28.469985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:28.929092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:28.938344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:28.941517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:28.943035 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b862d11-0a24-4964-a15f-55310f159be6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.558296 Oct 27 09:03:28.955675 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 467/954] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:28 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:28.955675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:28.955675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:28.957971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:28.958564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:28.963491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:28.963491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:28.963491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:28.963491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:29.168955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:29.185691 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-55bcddbc-63d7-4ea0-9716-b0d38b7b1fae tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1607 microversion: 2.1 time: 0.737189 Oct 27 09:03:29.205258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 488/955] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:28 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1607 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:29.220778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:29.222201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:29.231180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:29.231870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:29.233073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:29.233917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:29.236862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:29.237542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:29.872665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:29.892236 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8067b79-595b-46cf-bf8a-635e8d1602d2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.946517 Oct 27 09:03:29.893270 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 468/956] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:28 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:29.899270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:29.900532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:29.912916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:29.913768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:29.914521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:29.915724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:29.916520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:29.917254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:29.978923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:29.988243 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10f3afbf-29b0-4b6b-b3a9-da3f3ab57296 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.772368 Oct 27 09:03:29.989540 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 489/957] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:29 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:29.995303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:29.996141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:30.003660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:30.004714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:30.005326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:30.006314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:30.006935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:30.007545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:30.299895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:30.316835 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7753a29d-e477-4b9a-92e7-cf19285c9b92 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.421157 Oct 27 09:03:30.333094 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 469/958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:29 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:30.333094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:30.333094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:30.333094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:30.333534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:30.333800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:30.334516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:30.334975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:30.335402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:30.345188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:30.355614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:30.357277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:30.358926 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b29a72e3-03cc-443c-a767-bf5236250e72 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.368201 Oct 27 09:03:30.359950 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 490/959] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:29 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:30.367856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e2b06d5b-4510-4f50-8f41-642dad9a9ae5 req-e5330b04-60f3-4da0-a75c-17cbd5305de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f858a111-a0dd-4036-9871-3f76198b85c4", "name": "network-vif-unplugged", "status": "completed", "tag": "d2678d7a-fafd-4961-b47b-ada8b2073e9d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:30.378806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e2b06d5b-4510-4f50-8f41-642dad9a9ae5 req-e5330b04-60f3-4da0-a75c-17cbd5305de5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:30.379296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e2b06d5b-4510-4f50-8f41-642dad9a9ae5 req-e5330b04-60f3-4da0-a75c-17cbd5305de5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:30.379763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e2b06d5b-4510-4f50-8f41-642dad9a9ae5 req-e5330b04-60f3-4da0-a75c-17cbd5305de5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:30.397419 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e2b06d5b-4510-4f50-8f41-642dad9a9ae5 req-e5330b04-60f3-4da0-a75c-17cbd5305de5 service nova] Creating event network-vif-unplugged:d2678d7a-fafd-4961-b47b-ada8b2073e9d for instance f858a111-a0dd-4036-9871-3f76198b85c4 on n-h2-858383-16 Oct 27 09:03:30.405138 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e2b06d5b-4510-4f50-8f41-642dad9a9ae5 req-e5330b04-60f3-4da0-a75c-17cbd5305de5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042216 Oct 27 09:03:30.406143 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 491/960] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:30.722853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:30.736307 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8629c5c7-9d07-451e-a2e9-7ad5e7b0fd7a tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1607 microversion: 2.1 time: 0.417458 Oct 27 09:03:30.737304 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 470/961] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:30 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1607 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:30.913299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=22 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:30.918966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:30.919865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:30.931357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:30.932463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:30.933504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:30.934764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:30.935790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:30.936728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.066607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:31.070484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:31.098946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:31.100186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:31.102630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.111289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:31.112445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:31.114214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.246162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:31.256464 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61922414-cc87-4962-a2da-14fc8b2521ae tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.344513 Oct 27 09:03:31.258592 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 492/962] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:30 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:31.269418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f675905f-37aa-41cd-beb0-db8d02a7ee39 req-81aff2e3-f89c-4fa3-9a63-829ebba0044f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f858a111-a0dd-4036-9871-3f76198b85c4", "name": "network-vif-deleted", "tag": "d2678d7a-fafd-4961-b47b-ada8b2073e9d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:31.292964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f675905f-37aa-41cd-beb0-db8d02a7ee39 req-81aff2e3-f89c-4fa3-9a63-829ebba0044f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:31.293733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f675905f-37aa-41cd-beb0-db8d02a7ee39 req-81aff2e3-f89c-4fa3-9a63-829ebba0044f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:31.294356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f675905f-37aa-41cd-beb0-db8d02a7ee39 req-81aff2e3-f89c-4fa3-9a63-829ebba0044f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.307960 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f675905f-37aa-41cd-beb0-db8d02a7ee39 req-81aff2e3-f89c-4fa3-9a63-829ebba0044f service nova] Creating event network-vif-deleted:d2678d7a-fafd-4961-b47b-ada8b2073e9d for instance f858a111-a0dd-4036-9871-3f76198b85c4 on n-h2-858383-16 Oct 27 09:03:31.317232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f675905f-37aa-41cd-beb0-db8d02a7ee39 req-81aff2e3-f89c-4fa3-9a63-829ebba0044f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056953 Oct 27 09:03:31.318541 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 493/963] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:31.356168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:31.357937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:31.365430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:31.366451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:31.367106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.368063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:31.368737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:31.369374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.391015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:31.400741 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00632a00-a848-42c5-bb5a-0c66ed35ae3c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.375390 Oct 27 09:03:31.401334 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 471/964] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:31 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:31.413698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:31.416603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:31.423522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:31.425347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:31.426057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.427220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:31.428426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:31.429104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.653223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:31.663777 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c8c72a1-d325-4cf8-b22d-ea9d0f25160a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.322269 Oct 27 09:03:31.665209 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 494/965] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:31 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:31.687237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:31.696721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:31.710418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:31.711604 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08751826-691b-4a56-81cc-52f4302df2ea tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.308720 Oct 27 09:03:31.731935 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 472/966] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:31 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:31.763551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:31.764369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:31.772220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:31.772860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:31.773594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.774602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:31.775378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:31.775985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:31.901493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:31.913924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77a30172-3204-4230-ab75-03b251ba0752 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1539 microversion: 2.1 time: 0.156465 Oct 27 09:03:31.915076 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 495/967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:31 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:32.283128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:32.285791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:32.298485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:32.301287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:32.302202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:32.303717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:32.304428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:32.305226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:32.349488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:32.431754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:32.437711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:32.448404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=18 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:32.450510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:32.451429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:32.451916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:32.452916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:32.453622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:32.459437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:32.721719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:32.736200 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbdbfcb1-8bbf-462a-94b7-d37e0d142dd5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.456819 Oct 27 09:03:32.738537 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 473/968] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:32 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:32.749471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:32.753656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:32.769970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:32.771920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:32.772652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:32.777121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:32.777841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:32.778669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:32.854563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=38 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:33.175779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:33.204410 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5dd125a2-0302-4ded-b71f-927d1bc7877a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.777546 Oct 27 09:03:33.224227 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 496/969] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:32 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:33.247766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:33.249327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:33.260821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:33.262049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:33.263140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:33.264752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:33.266048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:33.267103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:33.527819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:33.555651 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-708208c3-6f16-4253-923b-1f5e19d6a991 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.816696 Oct 27 09:03:33.574161 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 474/970] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:32 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:33.600118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:33.602200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0f3e65b1-3167-4883-97ef-d926120ec272 req-c2639a7f-02f9-47c5-a634-8aa6572f058e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84aa1ad4-354f-4ad7-b54c-4ee8e96950e6", "name": "network-vif-plugged", "status": "completed", "tag": "435314b9-661f-4dd8-937f-c626a97df68d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:33.623516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0f3e65b1-3167-4883-97ef-d926120ec272 req-c2639a7f-02f9-47c5-a634-8aa6572f058e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:33.624357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0f3e65b1-3167-4883-97ef-d926120ec272 req-c2639a7f-02f9-47c5-a634-8aa6572f058e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:33.625114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0f3e65b1-3167-4883-97ef-d926120ec272 req-c2639a7f-02f9-47c5-a634-8aa6572f058e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:33.627661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:33.629184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:33.630350 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f6e0b8c-8fbf-48f8-af73-095821dac4b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.404412 Oct 27 09:03:33.635291 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 497/971] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:33 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:33.645898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:33.646801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:33.658397 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0f3e65b1-3167-4883-97ef-d926120ec272 req-c2639a7f-02f9-47c5-a634-8aa6572f058e service nova] Creating event network-vif-plugged:435314b9-661f-4dd8-937f-c626a97df68d for instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 on n-h2-858383-16 Oct 27 09:03:33.665376 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0f3e65b1-3167-4883-97ef-d926120ec272 req-c2639a7f-02f9-47c5-a634-8aa6572f058e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089073 Oct 27 09:03:33.672144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:33.675036 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 475/972] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:33.675786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:33.676124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:33.677008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:33.677478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:33.677820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:33.765527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:33.766703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:33.787435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:33.791143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:33.792373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:33.794197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:33.795507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:33.796578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:33.797375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:33.815807 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f49e8725-8efe-4ab0-a3c4-2da0c4ac63dc tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1252 microversion: 2.1 time: 0.178710 Oct 27 09:03:33.817255 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 498/973] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:33 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1252 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:34.019424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:34.027417 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee1bccd4-f380-4408-8158-7c24f4c65ed1 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.269158 Oct 27 09:03:34.028005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 476/974] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:33 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:34.247392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:34.247877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:34.254446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:34.254930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:34.255362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:34.256178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:34.256697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:34.257120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:34.404865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:34.413517 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-22b88bd8-b579-4e27-85dc-b1076f228317 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.170250 Oct 27 09:03:34.414430 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 499/975] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:34 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:34.608573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:34.609609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:34.618752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:34.619524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:34.620226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:34.621335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:34.622385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:34.622928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:34.664648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:34.665451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:34.671297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:34.671821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:34.672258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:34.672957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:34.673418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:34.673949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:34.879275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:34.886257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:34.893262 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88cb917d-9245-4a90-9210-c0e8928ee2ce tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.290296 Oct 27 09:03:34.895081 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 477/976] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:34 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:34.903785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:34.904904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:34.915310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:34.916349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:34.917223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:34.918560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:34.919505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:34.920393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:34.925610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:34.927453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:34.929195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:34.930693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-68f45598-4792-41ea-963f-41b653378786 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.269310 Oct 27 09:03:34.932209 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 500/977] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:34 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:03:34.997936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:35.006910 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7909fb80-45b5-4b55-b5d9-715731212f54 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1252 microversion: 2.1 time: 0.110164 Oct 27 09:03:35.007489 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 478/978] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:34 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1252 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:35.067644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:35.068583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:35.075114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:35.076058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:35.076931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:35.077994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:35.078601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:35.079179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:35.084210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:35.310305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:35.320235 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1ec9c55c-c6a2-4c0d-8662-9187f3f5ca2d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.258289 Oct 27 09:03:35.337852 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 501/979] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:35 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:35.447896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:35.449409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:35.459999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:35.462303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:35.463278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:35.464391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:35.464880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:35.465316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:35.633259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:35.649492 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc77acf0-6fbe-4b88-95d1-42095022d77f tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.206589 Oct 27 09:03:35.650992 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 479/980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:35 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:35.937734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:35.938923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:35.946407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:35.947168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:35.947837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:35.949092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:35.950015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:35.950607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:35.971823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:35.989083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:36.012029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:36.025069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:36.025739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:36.028211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:36.028905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:36.029554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:36.260171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:36.272319 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-697c4b7c-2849-4c7b-96ee-6ece589476cf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.339651 Oct 27 09:03:36.274635 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 502/981] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:35 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:36.281512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:36.282498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:36.290775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:36.291948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:36.292564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:36.294658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:36.295544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:36.296393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:36.302679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:36.311613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:36.314406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:36.316402 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2dc7596e-d7e6-4b94-9772-88b81d175c71 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.351523 Oct 27 09:03:36.318424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 480/982] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:35 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:36.349676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:36.352063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:36.374417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:36.374916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:36.375356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:36.376091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:36.376549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:36.376974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:36.454935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:36.476947 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bfc0c594-8ff4-4a3b-827f-b867feaba7cf tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1252 microversion: 2.1 time: 0.200658 Oct 27 09:03:36.478607 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 503/983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:36 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1252 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:36.635426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:36.647101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ba580a23-b6f4-459c-85b4-8a3e242f40b3 req-7e3bb8f5-0cc9-4372-a26b-674cba7d6542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bb1b9d-cd11-4520-8a23-19fb66586870", "name": "network-vif-plugged", "status": "completed", "tag": "d01f9056-87e8-488b-b98b-d11e1b5ba9b5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:36.665045 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9629fb90-6717-4ee5-b3d7-336417285bc3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.322690 Oct 27 09:03:36.672440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ba580a23-b6f4-459c-85b4-8a3e242f40b3 req-7e3bb8f5-0cc9-4372-a26b-674cba7d6542 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:36.673456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ba580a23-b6f4-459c-85b4-8a3e242f40b3 req-7e3bb8f5-0cc9-4372-a26b-674cba7d6542 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:36.674180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ba580a23-b6f4-459c-85b4-8a3e242f40b3 req-7e3bb8f5-0cc9-4372-a26b-674cba7d6542 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:36.678483 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 481/984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:36 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:36.689126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:36.690120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:36.699490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:36.702116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:36.703024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:36.704365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:36.704814 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ba580a23-b6f4-459c-85b4-8a3e242f40b3 req-7e3bb8f5-0cc9-4372-a26b-674cba7d6542 service nova] Creating event network-vif-plugged:d01f9056-87e8-488b-b98b-d11e1b5ba9b5 for instance 71bb1b9d-cd11-4520-8a23-19fb66586870 on n-h2-858383-16 Oct 27 09:03:36.705517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:36.706431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:36.717837 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ba580a23-b6f4-459c-85b4-8a3e242f40b3 req-7e3bb8f5-0cc9-4372-a26b-674cba7d6542 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077687 Oct 27 09:03:36.721780 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 504/985] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:36.906381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:36.915883 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5b075b0-fe96-4642-9758-651236ae9467 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.232962 Oct 27 09:03:36.916674 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 482/986] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:36 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:37.297268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:37.297969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:37.305384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.305852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.306294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.307134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.307630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.308063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.359551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:37.361159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:37.365203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:37.371482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.372297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.372876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.373831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.374536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.375087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.488997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:37.501105 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59c1cece-450a-4b92-983b-91f0606ca69c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.208224 Oct 27 09:03:37.501805 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 505/987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:37 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:37.508366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:37.509811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:37.516345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.517085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.517589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.518357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.519536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.520061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.597750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:37.605651 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ce365133-f2a9-4746-9719-d889a5fb7a90 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1252 microversion: 2.1 time: 0.102430 Oct 27 09:03:37.606716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 506/988] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:37 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1252 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:37.609626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:37.618807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:37.620277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:37.621460 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e33f7fd2-753b-49e9-814d-a3e958917c1c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.268278 Oct 27 09:03:37.622017 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 483/989] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:37 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:03:37.699059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:37.700182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:37.710037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.710562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.711033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.711817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.712310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.712773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.941092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:37.941092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:37.947541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.958133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.963660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.964624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:37.965274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:37.966036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:37.978984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:37.991838 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2f22bad6-6697-4a53-b282-ba212ff5c719 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.296545 Oct 27 09:03:37.997231 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 507/990] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:37 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:38.194625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:38.222235 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-430ce774-9ce0-45d1-bd8e-30cfcb2eab88 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.285680 Oct 27 09:03:38.223613 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 484/991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:37 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:38.524385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:38.525231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:38.532368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:38.533304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:38.533756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:38.535244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:38.535729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:38.536293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:38.638693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:38.642286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:38.658507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:38.660065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:38.669256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:38.670575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:38.671433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:38.672258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:38.739851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:38.740290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:38.740724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:38.741368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lazy-loading 'fault' on Instance uuid f858a111-a0dd-4036-9871-3f76198b85c4 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:03:38.821393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:38.827207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:38.835282 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8223ab0d-9fec-40ce-a56e-eeccada3999f tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1257 microversion: 2.1 time: 0.209641 Oct 27 09:03:38.835901 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7aceecef-13a7-415d-be04-da21655cd7d7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1366 microversion: 2.1 time: 0.316138 Oct 27 09:03:38.836062 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 485/992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:38 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1257 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:38.837138 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 508/993] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:38 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:38.841338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:38.842433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:38.849087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:38.849945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:38.850617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:38.851495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:38.852382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:38.852960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.026788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:39.027506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:39.034999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:39.035453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:39.036698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.037598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:39.038084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:39.038590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.055979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:39.071487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:39.074019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:39.075714 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b55acaa3-2f31-4a93-8511-13ae45519ad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.238599 Oct 27 09:03:39.076753 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 486/994] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:38 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:39.206982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:39.220615 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83ce701d-d4a7-4ee9-a24a-00bdd10553cd tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.198062 Oct 27 09:03:39.248322 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 509/995] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:39 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:39.254958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:39.256506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:39.263403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:39.264400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:39.265020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.265920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:39.266549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:39.267143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.438811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:39.448831 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53335e55-bcf2-4486-a390-efb986f9552a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1323 microversion: 2.1 time: 0.197793 Oct 27 09:03:39.449832 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 487/996] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:39 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:39.865009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:39.866866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:39.869701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:39.870991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:39.875677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:39.876797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:39.877667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:39.877847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.878552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:39.879092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:39.879455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.879944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:39.880632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:39.880746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.881444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:39.882081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.916463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:39.917402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:39.918106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:39.918771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lazy-loading 'fault' on Instance uuid f858a111-a0dd-4036-9871-3f76198b85c4 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:03:40.084872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:40.102100 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aabc5883-4b3c-4efa-b9f2-31eed411ccc7 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1257 microversion: 2.1 time: 0.235286 Oct 27 09:03:40.104058 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 488/997] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:39 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1257 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:40.115071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:40.117173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:40.149725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:40.150882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:40.151908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:40.153365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:40.154579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:40.155560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:40.396647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:40.421154 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed1638c5-8854-4123-b8e2-c5bcb9f49c67 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1557 microversion: 2.1 time: 0.561920 Oct 27 09:03:40.444457 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 510/998] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:39 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1557 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:40.466773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:40.467899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:40.486613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:40.488107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:40.489185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:40.490729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:40.492356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:40.493763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:40.604732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:40.618098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:40.619590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:40.620836 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac21ab7f-b26d-48a6-95fe-66861e53850e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 0.515044 Oct 27 09:03:40.621273 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 489/999] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:40 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:40.630979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6dad2b72-5e8e-44b8-9ca9-8c90765f6cbf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:40.631475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6dad2b72-5e8e-44b8-9ca9-8c90765f6cbf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:40.651636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dad2b72-5e8e-44b8-9ca9-8c90765f6cbf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:40.651636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dad2b72-5e8e-44b8-9ca9-8c90765f6cbf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:40.651636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dad2b72-5e8e-44b8-9ca9-8c90765f6cbf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:40.652248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dad2b72-5e8e-44b8-9ca9-8c90765f6cbf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:40.652707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dad2b72-5e8e-44b8-9ca9-8c90765f6cbf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:40.653134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dad2b72-5e8e-44b8-9ca9-8c90765f6cbf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:40.796646 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6dad2b72-5e8e-44b8-9ca9-8c90765f6cbf tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.170030 Oct 27 09:03:40.797470 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 490/1000] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:03:40 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:40.803081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:40.803753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:40.812288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:40.820556 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-67665e8e-628d-4241-9b4f-1d1a2de81d98 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1543 microversion: 2.1 time: 0.374437 Oct 27 09:03:40.821146 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 511/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:40 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1543 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:40.826956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:40.827449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:40.827921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:40.828636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:40.829095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:40.829522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:40.902438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7778249a-0ed1-4391-be30-3d2ea9c62578 req-71c8e868-c6df-4aef-9714-4c742e7c21a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d", "name": "network-vif-plugged", "status": "completed", "tag": "5a1ddd07-b18b-4724-8a1f-952c95c591d9"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:40.919495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7778249a-0ed1-4391-be30-3d2ea9c62578 req-71c8e868-c6df-4aef-9714-4c742e7c21a4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:40.920018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7778249a-0ed1-4391-be30-3d2ea9c62578 req-71c8e868-c6df-4aef-9714-4c742e7c21a4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:40.920460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7778249a-0ed1-4391-be30-3d2ea9c62578 req-71c8e868-c6df-4aef-9714-4c742e7c21a4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:40.947599 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7778249a-0ed1-4391-be30-3d2ea9c62578 req-71c8e868-c6df-4aef-9714-4c742e7c21a4 service nova] Creating event network-vif-plugged:5a1ddd07-b18b-4724-8a1f-952c95c591d9 for instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d on n-h2-858383-16 Oct 27 09:03:40.961385 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7778249a-0ed1-4391-be30-3d2ea9c62578 req-71c8e868-c6df-4aef-9714-4c742e7c21a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062469 Oct 27 09:03:40.962361 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 512/1002] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:41.126809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:41.127521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:41.137858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.138399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.138816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.140520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.141053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.141487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.271649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.272649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.273298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.273948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lazy-loading 'fault' on Instance uuid f858a111-a0dd-4036-9871-3f76198b85c4 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:03:41.435358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:41.454613 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ddf37184-cddd-4449-8d89-46efcecd3755 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1473 microversion: 2.1 time: 0.655647 Oct 27 09:03:41.455423 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 491/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:40 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1473 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:41.480595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabd7061a0d647d1bb5a9c3d296f6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f19c40e6554a1f890cc7348bc30065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:41.494255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:41.496055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:41.511403 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-922038e8-ddc2-4942-8bb8-89a9db5cd031 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 200 len: 1211 microversion: 2.1 time: 0.389068 Oct 27 09:03:41.512315 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 513/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:41 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 1211 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:41.515267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.516244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.516905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.517808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.519844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.520949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.554432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Request method failure captured: Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870/diagnostics HTTP/1.1 Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWklVvG29b83vhdFzkJm-hYp_GwGbAehKe9RMrG8Pb4VrkwA5eGm3m7H8iOsnfPbpo5LgG8YnJfZxNihJ_r8Nq69bS7ESwlUPsj7yuBmHH2U0uucjFUlS0e6-PqHmaioayO0-6JHsDo-O7dbUc7rezyAIrvs0niftDcigKDZYO05ZLEg Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 9cf384590a90420a82a0df1a492f184c Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1993805995 Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9cf384590a90420a82a0df1a492f184c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9cf384590a90420a82a0df1a492f184c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9cf384590a90420a82a0df1a492f184c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9cf384590a90420a82a0df1a492f184c"}]}] Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1993805995 Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 9cf384590a90420a82a0df1a492f184c Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1993805995 Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerDiagnosticsNegativeTest-1993805995-project Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: bea683a1e9f94170b0c7049eedb41591 Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1993805995-project Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': '71bb1b9d-cd11-4520-8a23-19fb66586870'} Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:41.559381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:41.566084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:41.566084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:41.566084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:03:41.566084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:03:41.566084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 27 09:03:41.566084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:41.584998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:41.589958 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a86b4117-d222-4695-869b-1fe28a14375c tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.109694 Oct 27 09:03:41.591223 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 492/1005] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:03:41 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870/diagnostics => generated 117 bytes in 115 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:03:41.610689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:41.611783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:41.620755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.621703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.622349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.623604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.624412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.625064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.654492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:41.656049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:41.666187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.670802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.673181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.675344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.676122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.677718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:03:41.678221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.808180 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0004d042-59c7-402a-999e-b4acd3fc8f41 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 204 len: 0 microversion: 2.1 time: 0.202810 Oct 27 09:03:41.809758 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 514/1006] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:03:41 2022] DELETE /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:03:41.820274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:41.821609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:41.835525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.836340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.838435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:41.843243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:41.844920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:41.846471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:42.810635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:42.824650 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62b22a61-180c-4c4c-8601-0cd1e68b882a tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1479 microversion: 2.1 time: 1.007004 Oct 27 09:03:42.841317 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 515/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:41 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1479 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:42.848756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:42.852451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:42.858178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:42.859349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:42.860314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:42.861659 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df21f687-ba83-497d-a6fc-69a83e44d92d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 1.213425 Oct 27 09:03:42.863382 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 493/1008] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:41 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:42.868279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:42.869200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] [instance: f858a111-a0dd-4036-9871-3f76198b85c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:42.875481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:42.876179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:42.876777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:42.877694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:42.878944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:42.879706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:42.885409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:42.891132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:42.891483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:42.892396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:42.892774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:42.893203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:42.911809 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] HTTP exception thrown: Instance f858a111-a0dd-4036-9871-3f76198b85c4 could not be found. Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Request method failure captured: Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 HTTP/1.1 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjl9wRzC35awfRFbBsFVJKpSYsp_j2E3WCfTlOF3dboD9uWNTGjPgpKZEPI4URYRnUbRDT0y7RDC24wDiP15ixMpSioyaneq1bT3dcNf4vIkCO-n9QBrMhoNhiydPpYYw5it9f9ODtdUlANFFhVYRHQVRy1x10SLN5ddEljy2m_mRc Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 00f19c40e6554a1f890cc7348bc30065 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestBootFromVolume-814401607 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f19c40e6554a1f890cc7348bc30065"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00f19c40e6554a1f890cc7348bc30065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00f19c40e6554a1f890cc7348bc30065"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00f19c40e6554a1f890cc7348bc30065"}]}] Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestBootFromVolume-814401607 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 00f19c40e6554a1f890cc7348bc30065 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestBootFromVolume-814401607 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestBootFromVolume-814401607-project Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: eabd7061a0d647d1bb5a9c3d296f6217 Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestBootFromVolume-814401607-project Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance f858a111-a0dd-4036-9871-3f76198b85c4 could not be found. Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f858a111-a0dd-4036-9871-3f76198b85c4'} Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f858a111-a0dd-4036-9871-3f76198b85c4 could not be found. Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f858a111-a0dd-4036-9871-3f76198b85c4 could not be found. Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:42.915294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:42.921371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:42.921371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:42.921371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:42.921371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:42.921371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:42.921371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f858a111-a0dd-4036-9871-3f76198b85c4 could not be found. Oct 27 09:03:42.921371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:42.923539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Returning 404 to user: Instance f858a111-a0dd-4036-9871-3f76198b85c4 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:42.927019 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7a24025-4907-4870-b5ca-371e12f1dc4b tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4" status: 404 len: 111 microversion: 2.1 time: 0.062306 Oct 27 09:03:42.931652 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 494/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:42 2022] GET /compute/v2.1/servers/f858a111-a0dd-4036-9871-3f76198b85c4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:03:42.947518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d5169ef-0661-4c1c-8de7-4455fd308643 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] Calling method '.version_select at 0x7f31aa36e550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:42.975287 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d5169ef-0661-4c1c-8de7-4455fd308643 tempest-ServersTestBootFromVolume-814401607 tempest-ServersTestBootFromVolume-814401607-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-971548891" status: 202 len: 0 microversion: 2.1 time: 0.041279 Oct 27 09:03:42.976215 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 495/1010] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:03:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-971548891 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:03:43.288721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:43.297277 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f57aa052-126f-4c77-a84c-34698b2ca1aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1542 microversion: 2.1 time: 0.454486 Oct 27 09:03:43.300393 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 516/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:42 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1542 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:43.851904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:43.852379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:43.861402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:43.862001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:43.862375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:43.863091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:43.863555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:43.864011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:43.891046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:43.891962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:43.898278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:43.903404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:43.905927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:43.907290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:43.908055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:43.908525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:43.909004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:43.942684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:44.741818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:44.750420 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a2ff1f48-7c3f-4792-bba1-7b9ab85be0b5 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1479 microversion: 2.1 time: 0.904835 Oct 27 09:03:44.769010 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 496/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:43 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1479 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:44.782202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:44.783175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:44.800586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:44.801484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:44.802163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:44.803119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:44.803829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:44.809348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:45.005709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:45.023721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:45.025451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:45.026675 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-931d7651-4f48-41f3-b191-43daf3208741 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1412 microversion: 2.25 time: 1.140300 Oct 27 09:03:45.040187 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 517/1013] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:43 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1412 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:45.061063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-669c01dc-a3b2-427c-98d7-6ad5bca6ef22 req-7badc250-ff57-4d65-a37c-57897211b45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84aa1ad4-354f-4ad7-b54c-4ee8e96950e6", "tag": "435314b9-661f-4dd8-937f-c626a97df68d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:45.090584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-669c01dc-a3b2-427c-98d7-6ad5bca6ef22 req-7badc250-ff57-4d65-a37c-57897211b45d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:45.092057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-669c01dc-a3b2-427c-98d7-6ad5bca6ef22 req-7badc250-ff57-4d65-a37c-57897211b45d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:45.092665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-669c01dc-a3b2-427c-98d7-6ad5bca6ef22 req-7badc250-ff57-4d65-a37c-57897211b45d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:45.122576 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-669c01dc-a3b2-427c-98d7-6ad5bca6ef22 req-7badc250-ff57-4d65-a37c-57897211b45d service nova] Creating event network-changed:435314b9-661f-4dd8-937f-c626a97df68d for instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 on n-h2-858383-16 Oct 27 09:03:45.134434 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-669c01dc-a3b2-427c-98d7-6ad5bca6ef22 req-7badc250-ff57-4d65-a37c-57897211b45d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091533 Oct 27 09:03:45.139347 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 518/1014] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:45.765028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:45.780471 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f095476f-f1c3-43bb-9d15-2698e916a8b6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1474 microversion: 2.1 time: 1.009346 Oct 27 09:03:45.795594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:45.795807 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 497/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:44 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1474 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:45.795926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:45.795926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:45.807777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:45.808288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:45.811035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:45.811847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:45.812325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:45.812758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:45.870348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-86e28a8b-4367-4100-97d2-a37d83420980 req-f905182a-ee15-492e-9550-e24e960de0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bb1b9d-cd11-4520-8a23-19fb66586870", "name": "network-vif-deleted", "tag": "d01f9056-87e8-488b-b98b-d11e1b5ba9b5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:45.896094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-86e28a8b-4367-4100-97d2-a37d83420980 req-f905182a-ee15-492e-9550-e24e960de0f4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:45.896849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-86e28a8b-4367-4100-97d2-a37d83420980 req-f905182a-ee15-492e-9550-e24e960de0f4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:45.898024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-86e28a8b-4367-4100-97d2-a37d83420980 req-f905182a-ee15-492e-9550-e24e960de0f4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:45.929319 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-86e28a8b-4367-4100-97d2-a37d83420980 req-f905182a-ee15-492e-9550-e24e960de0f4 service nova] Creating event network-vif-deleted:d01f9056-87e8-488b-b98b-d11e1b5ba9b5 for instance 71bb1b9d-cd11-4520-8a23-19fb66586870 on n-h2-858383-16 Oct 27 09:03:45.941792 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-86e28a8b-4367-4100-97d2-a37d83420980 req-f905182a-ee15-492e-9550-e24e960de0f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075551 Oct 27 09:03:45.947371 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 498/1016] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:46.057115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:46.057816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:46.070314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:46.073126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:46.073583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:46.074506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:46.078950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:46.080386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:46.450647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bea683a1e9f94170b0c7049eedb41591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf384590a90420a82a0df1a492f184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:46.461598 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9fd6bef3-687e-43fe-bcfb-449bedf85d04 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 200 len: 1437 microversion: 2.1 time: 0.683500 Oct 27 09:03:46.465367 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 519/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:45 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 1437 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:46.662158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:46.678812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:46.680622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:46.682226 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-daab7ce8-29fa-4cdc-99b5-0727bba3e2c3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1608 microversion: 2.25 time: 0.629800 Oct 27 09:03:46.685399 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 499/1018] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:46 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1608 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:46.709162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85e5344f-5b21-4107-a638-97d09e6581c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:46.709880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-85e5344f-5b21-4107-a638-97d09e6581c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:46.716410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85e5344f-5b21-4107-a638-97d09e6581c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:46.717846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85e5344f-5b21-4107-a638-97d09e6581c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:46.718470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85e5344f-5b21-4107-a638-97d09e6581c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:46.720084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85e5344f-5b21-4107-a638-97d09e6581c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:46.720938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85e5344f-5b21-4107-a638-97d09e6581c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:46.722911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85e5344f-5b21-4107-a638-97d09e6581c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:46.807512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:46.808132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:46.817341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:46.817850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:46.818253 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85e5344f-5b21-4107-a638-97d09e6581c6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.113082 Oct 27 09:03:46.818381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:46.820522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:46.821275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:46.821495 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 520/1019] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Oct 27 09:03:46 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:03:46.822026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.023105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-21ea16b3-bb47-4d6b-88ba-8939f065a32f req-e1719251-4ea0-48a1-9197-3c88360cf46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e4c64d-6f11-409d-befa-fbea1791a69b", "name": "network-vif-unplugged", "status": "completed", "tag": "e8980257-9864-4b1e-940e-b586249dde6e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:47.076475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-21ea16b3-bb47-4d6b-88ba-8939f065a32f req-e1719251-4ea0-48a1-9197-3c88360cf46d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:47.078410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-21ea16b3-bb47-4d6b-88ba-8939f065a32f req-e1719251-4ea0-48a1-9197-3c88360cf46d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:47.082149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-21ea16b3-bb47-4d6b-88ba-8939f065a32f req-e1719251-4ea0-48a1-9197-3c88360cf46d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.133110 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-21ea16b3-bb47-4d6b-88ba-8939f065a32f req-e1719251-4ea0-48a1-9197-3c88360cf46d service nova] Creating event network-vif-unplugged:e8980257-9864-4b1e-940e-b586249dde6e for instance a6e4c64d-6f11-409d-befa-fbea1791a69b on n-h1-858383-16 Oct 27 09:03:47.180993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-21ea16b3-bb47-4d6b-88ba-8939f065a32f req-e1719251-4ea0-48a1-9197-3c88360cf46d service nova] Instance a6e4c64d-6f11-409d-befa-fbea1791a69b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:03:47.193842 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-21ea16b3-bb47-4d6b-88ba-8939f065a32f req-e1719251-4ea0-48a1-9197-3c88360cf46d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173642 Oct 27 09:03:47.206749 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 521/1020] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:47.372786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:47.381043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df765282-9662-446c-b6cf-76700e74a8ce tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1471 microversion: 2.1 time: 0.578094 Oct 27 09:03:47.395635 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 500/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:46 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1471 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:47.405873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:47.406557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:47.414032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:47.414535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:47.414975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.415712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:47.416163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:47.416784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.462392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:47.463752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:47.464407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.465325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:47.465947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:47.466377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.489484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:47.491068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] [instance: 71bb1b9d-cd11-4520-8a23-19fb66586870] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:47.496503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:47.503474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for user 0566a978e2924137973615346b1afaa3 and project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:47.508839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:47.509596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:47.510143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.510961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:47.511527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:47.512083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.529315 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] HTTP exception thrown: Instance 71bb1b9d-cd11-4520-8a23-19fb66586870 could not be found. Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Request method failure captured: Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 HTTP/1.1 Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWklVvG29b83vhdFzkJm-hYp_GwGbAehKe9RMrG8Pb4VrkwA5eGm3m7H8iOsnfPbpo5LgG8YnJfZxNihJ_r8Nq69bS7ESwlUPsj7yuBmHH2U0uucjFUlS0e6-PqHmaioayO0-6JHsDo-O7dbUc7rezyAIrvs0niftDcigKDZYO05ZLEg Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 9cf384590a90420a82a0df1a492f184c Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1993805995 Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9cf384590a90420a82a0df1a492f184c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9cf384590a90420a82a0df1a492f184c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9cf384590a90420a82a0df1a492f184c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9cf384590a90420a82a0df1a492f184c"}]}] Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1993805995 Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 9cf384590a90420a82a0df1a492f184c Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1993805995 Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerDiagnosticsNegativeTest-1993805995-project Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: bea683a1e9f94170b0c7049eedb41591 Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1993805995-project Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 71bb1b9d-cd11-4520-8a23-19fb66586870 could not be found. Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '71bb1b9d-cd11-4520-8a23-19fb66586870'} Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bb1b9d-cd11-4520-8a23-19fb66586870 could not be found. Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bb1b9d-cd11-4520-8a23-19fb66586870 could not be found. Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:47.531350 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:47.535667 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:47.535667 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:47.535667 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:47.535667 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:47.535667 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:47.535667 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:47.535667 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bb1b9d-cd11-4520-8a23-19fb66586870 could not be found. Oct 27 09:03:47.535667 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:47.537806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] Returning 404 to user: Instance 71bb1b9d-cd11-4520-8a23-19fb66586870 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:47.539291 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b72e882b-6588-4496-84eb-5ebc17e33c75 tempest-ServerDiagnosticsNegativeTest-1993805995 tempest-ServerDiagnosticsNegativeTest-1993805995-project] 10.222.0.25 "GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870" status: 404 len: 111 microversion: 2.1 time: 0.056995 Oct 27 09:03:47.540204 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 501/1022] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:47 2022] GET /compute/v2.1/servers/71bb1b9d-cd11-4520-8a23-19fb66586870 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:03:47.631337 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5870d1e-83ce-4d94-ac5e-3c0a93161c2e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b/action" status: 202 len: 0 microversion: 2.1 time: 0.229614 Oct 27 09:03:47.635018 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 522/1023] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:03:47 2022] POST /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:03:47.640559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:47.641331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:47.648012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:47.648535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:47.648978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.649869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:47.650544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:47.651104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:47.843103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:47.853680 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-783156d5-4d45-49b1-89ad-ba4468543898 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1470 microversion: 2.1 time: 0.217198 Oct 27 09:03:47.854984 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 502/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:47 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:48.881773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:48.882531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:48.889234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:48.889720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:48.890213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:48.890921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:48.891557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:48.892004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:49.114718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:49.131138 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-601baade-913e-4225-b810-d1d2b5e2ca1e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1470 microversion: 2.1 time: 0.254111 Oct 27 09:03:49.134228 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 523/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:48 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:49.379460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0178d584-3045-47e6-b304-62db44e88c4e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Action: 'create', calling method: .version_select at 0x7f31aa4e48b0>, body: {"keypair": {"name": "tempest-keypair-1695940829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9ejzublNAk9W0en1772uZbBI3HaZEag74p9c6DFz9PWXeZjCd1wnrvZQIcuTRNRqyNT2YigptrkxQGkOghNgL2BmtbqXGo/gl3DgsPXmsVe0zyanot1l5HFfyZeRoDKA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:49.421433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0178d584-3045-47e6-b304-62db44e88c4e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Getting quotas for project 1df6a0e925ac430c8dced7c02d70b45a. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:49.439280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0178d584-3045-47e6-b304-62db44e88c4e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Getting quotas for user d7176e89e16e4b0788ebecec7a32a924 and project 1df6a0e925ac430c8dced7c02d70b45a. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:49.496283 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0178d584-3045-47e6-b304-62db44e88c4e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.122420 Oct 27 09:03:49.504524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 503/1026] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Oct 27 09:03:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:03:49.971954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b5a4d014-c8cb-4c5b-8f90-2a6dbf9bad3c req-f4048e66-bf44-48da-8c8f-a6efe4eca602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d", "tag": "5a1ddd07-b18b-4724-8a1f-952c95c591d9"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:49.988571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b5a4d014-c8cb-4c5b-8f90-2a6dbf9bad3c req-f4048e66-bf44-48da-8c8f-a6efe4eca602 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:49.991157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b5a4d014-c8cb-4c5b-8f90-2a6dbf9bad3c req-f4048e66-bf44-48da-8c8f-a6efe4eca602 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:50.004424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b5a4d014-c8cb-4c5b-8f90-2a6dbf9bad3c req-f4048e66-bf44-48da-8c8f-a6efe4eca602 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:50.030517 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b5a4d014-c8cb-4c5b-8f90-2a6dbf9bad3c req-f4048e66-bf44-48da-8c8f-a6efe4eca602 service nova] Creating event network-changed:5a1ddd07-b18b-4724-8a1f-952c95c591d9 for instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d on n-h2-858383-16 Oct 27 09:03:50.040634 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b5a4d014-c8cb-4c5b-8f90-2a6dbf9bad3c req-f4048e66-bf44-48da-8c8f-a6efe4eca602 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073154 Oct 27 09:03:50.041393 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 524/1027] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:50.156802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:50.157444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:50.166720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:50.168162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:50.168937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:50.172827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:50.173598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:50.174949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:50.636688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:50.644583 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3103e4be-6cbc-4f67-95b0-3e2877b1366b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1470 microversion: 2.1 time: 0.491630 Oct 27 09:03:50.653951 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 504/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:50 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1470 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:51.026789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b47ef56b-08ba-48f9-b284-3713e4819936 req-cbbe9478-149f-4ef1-a9b8-79467c031361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e4c64d-6f11-409d-befa-fbea1791a69b", "name": "network-vif-plugged", "status": "completed", "tag": "e8980257-9864-4b1e-940e-b586249dde6e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:51.050722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b47ef56b-08ba-48f9-b284-3713e4819936 req-cbbe9478-149f-4ef1-a9b8-79467c031361 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.052688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b47ef56b-08ba-48f9-b284-3713e4819936 req-cbbe9478-149f-4ef1-a9b8-79467c031361 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.056383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b47ef56b-08ba-48f9-b284-3713e4819936 req-cbbe9478-149f-4ef1-a9b8-79467c031361 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.100479 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b47ef56b-08ba-48f9-b284-3713e4819936 req-cbbe9478-149f-4ef1-a9b8-79467c031361 service nova] Creating event network-vif-plugged:e8980257-9864-4b1e-940e-b586249dde6e for instance a6e4c64d-6f11-409d-befa-fbea1791a69b on n-h1-858383-16 Oct 27 09:03:51.108276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-b47ef56b-08ba-48f9-b284-3713e4819936 req-cbbe9478-149f-4ef1-a9b8-79467c031361 service nova] Instance a6e4c64d-6f11-409d-befa-fbea1791a69b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:03:51.120370 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b47ef56b-08ba-48f9-b284-3713e4819936 req-cbbe9478-149f-4ef1-a9b8-79467c031361 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098147 Oct 27 09:03:51.121735 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 525/1029] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:51.554059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa3b0160>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:51.559307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.559856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.560294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.575849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.576668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.578654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.597966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] HTTP exception thrown: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Request method failure captured: Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: request: PUT /compute/v2.1/os-services/7872a5d2-df3a-4cf5-bd26-82b28e2787f5 HTTP/1.1 Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 56 Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkl3dQyWqt1HV8pTfIp6IaaRwEaAe-h8x0dSdAALng-2q89dCHguTgFRzH1tHeg2KhSLN3L_g9--qR9E4YEEIfb1Gj77oPdyNgdbRhRa_2aYoidjxODP9WrP-p-AUcnY19CRdSdx_r_CvERo64XyeE9TMaAXwCBlMDrR9-micsQF8-o Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 3b82096be2f244e9a7bf678094407e5c Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-897550258 Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b82096be2f244e9a7bf678094407e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3b82096be2f244e9a7bf678094407e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b82096be2f244e9a7bf678094407e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3b82096be2f244e9a7bf678094407e5c"}]}] Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-897550258 Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 3b82096be2f244e9a7bf678094407e5c Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-897550258 Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 40e0ffad4ed7426d9c9e31819f49e042 Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: exception: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7872a5d2-df3a-4cf5-bd26-82b28e2787f5', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:51.602040 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Returning 404 to user: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08e4c92f-b92d-42c3-af9c-dafdfecdcad3 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/7872a5d2-df3a-4cf5-bd26-82b28e2787f5" status: 404 len: 110 microversion: 2.53 time: 0.295296 Oct 27 09:03:51.607010 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 505/1030] 10.222.0.25 () {62 vars in 1309 bytes} [Thu Oct 27 09:03:51 2022] PUT /compute/v2.1/os-services/7872a5d2-df3a-4cf5-bd26-82b28e2787f5 => generated 110 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:03:51.616156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa57a5e0>, body: {"status": "disabled"} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:51.621626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.622439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.623116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.632580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.633422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.634114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.644137 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] HTTP exception thrown: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Request method failure captured: Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/os-services/7872a5d2-df3a-4cf5-bd26-82b28e2787f5 HTTP/1.1 Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 22 Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkl3dQyWqt1HV8pTfIp6IaaRwEaAe-h8x0dSdAALng-2q89dCHguTgFRzH1tHeg2KhSLN3L_g9--qR9E4YEEIfb1Gj77oPdyNgdbRhRa_2aYoidjxODP9WrP-p-AUcnY19CRdSdx_r_CvERo64XyeE9TMaAXwCBlMDrR9-micsQF8-o Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 3b82096be2f244e9a7bf678094407e5c Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-897550258 Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b82096be2f244e9a7bf678094407e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3b82096be2f244e9a7bf678094407e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b82096be2f244e9a7bf678094407e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3b82096be2f244e9a7bf678094407e5c"}]}] Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-897550258 Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 3b82096be2f244e9a7bf678094407e5c Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-897550258 Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 40e0ffad4ed7426d9c9e31819f49e042 Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: {"status": "disabled"} Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: exception: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7872a5d2-df3a-4cf5-bd26-82b28e2787f5', 'body': {'status': 'disabled'}} Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:51.646783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.651083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.655524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Returning 404 to user: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:51.657100 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cbd922d2-569a-49ee-bff4-36bd87d1134e tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/7872a5d2-df3a-4cf5-bd26-82b28e2787f5" status: 404 len: 110 microversion: 2.53 time: 0.046459 Oct 27 09:03:51.658236 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 526/1031] 10.222.0.25 () {62 vars in 1309 bytes} [Thu Oct 27 09:03:51 2022] PUT /compute/v2.1/os-services/7872a5d2-df3a-4cf5-bd26-82b28e2787f5 => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:03:51.668218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa4a3ee0>, body: {"status": "enabled"} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:51.676024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.679056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.680047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.687833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:51.689023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:51.695458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.698044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.698938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.706477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.709233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.709941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.712782 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] HTTP exception thrown: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.713825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.714530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.715188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Request method failure captured: Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: request: PUT /compute/v2.1/os-services/7872a5d2-df3a-4cf5-bd26-82b28e2787f5 HTTP/1.1 Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 21 Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkl3dQyWqt1HV8pTfIp6IaaRwEaAe-h8x0dSdAALng-2q89dCHguTgFRzH1tHeg2KhSLN3L_g9--qR9E4YEEIfb1Gj77oPdyNgdbRhRa_2aYoidjxODP9WrP-p-AUcnY19CRdSdx_r_CvERo64XyeE9TMaAXwCBlMDrR9-micsQF8-o Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 3b82096be2f244e9a7bf678094407e5c Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-897550258 Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b82096be2f244e9a7bf678094407e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3b82096be2f244e9a7bf678094407e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b82096be2f244e9a7bf678094407e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3b82096be2f244e9a7bf678094407e5c"}]}] Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-897550258 Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 3b82096be2f244e9a7bf678094407e5c Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-897550258 Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 40e0ffad4ed7426d9c9e31819f49e042 Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: {"status": "enabled"} Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: exception: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7872a5d2-df3a-4cf5-bd26-82b28e2787f5', 'body': {'status': 'enabled'}} Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:51.720649 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. Oct 27 09:03:51.725773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:51.728358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Returning 404 to user: Service 7872a5d2-df3a-4cf5-bd26-82b28e2787f5 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:51.733707 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44214268-1002-46dd-9ea3-21a44525fe43 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/7872a5d2-df3a-4cf5-bd26-82b28e2787f5" status: 404 len: 110 microversion: 2.53 time: 0.069761 Oct 27 09:03:51.735201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 506/1032] 10.222.0.25 () {62 vars in 1309 bytes} [Thu Oct 27 09:03:51 2022] PUT /compute/v2.1/os-services/7872a5d2-df3a-4cf5-bd26-82b28e2787f5 => generated 110 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:03:51.755519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14a45702-0df2-45a7-b37d-bbd75b294eae tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:51.768632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a45702-0df2-45a7-b37d-bbd75b294eae tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.769446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a45702-0df2-45a7-b37d-bbd75b294eae tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.771137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a45702-0df2-45a7-b37d-bbd75b294eae tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.772436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a45702-0df2-45a7-b37d-bbd75b294eae tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.774987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a45702-0df2-45a7-b37d-bbd75b294eae tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.775673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a45702-0df2-45a7-b37d-bbd75b294eae tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.838098 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14a45702-0df2-45a7-b37d-bbd75b294eae tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.093867 Oct 27 09:03:51.839768 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 507/1033] 10.222.0.25 () {60 vars in 1178 bytes} [Thu Oct 27 09:03:51 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:03:51.862658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b31c31b9-dc1c-4d8b-a01a-6bd4a164a120 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:51.878762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31c31b9-dc1c-4d8b-a01a-6bd4a164a120 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.879280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31c31b9-dc1c-4d8b-a01a-6bd4a164a120 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.879759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31c31b9-dc1c-4d8b-a01a-6bd4a164a120 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.880526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31c31b9-dc1c-4d8b-a01a-6bd4a164a120 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.880983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31c31b9-dc1c-4d8b-a01a-6bd4a164a120 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.885380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31c31b9-dc1c-4d8b-a01a-6bd4a164a120 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:51.962186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:51.970707 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-442e4617-7562-4fc6-a242-f0d751aa2260 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1470 microversion: 2.1 time: 0.293259 Oct 27 09:03:51.971751 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b31c31b9-dc1c-4d8b-a01a-6bd4a164a120 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.121344 Oct 27 09:03:51.972486 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 508/1034] 10.222.0.25 () {60 vars in 1211 bytes} [Thu Oct 27 09:03:51 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:51.986185 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 527/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:51 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:51.989440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1409680292", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9f308f64-5352-4673-8175-ce38df079ed9"}, {"port": "1909605a-f082-4fa7-8b71-e5b6588381b7", "tag": "port-1"}, {"port": "3b758947-9790-4cd2-9c9a-4f2d98912f3e", "tag": "port-2"}, {"uuid": "bd14e41d-f93f-4881-a483-3f860c0c751f", "tag": "net-1"}, {"uuid": "bd14e41d-f93f-4881-a483-3f860c0c751f"}, {"uuid": "dab5b204-fdb5-4a85-85d4-e18e7c932854", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "dab5b204-fdb5-4a85-85d4-e18e7c932854", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2dd78810-48ac-4cb9-b733-bfd97a26819c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "772d493f-bab8-49c6-a189-8643c936f9bc", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5ae29fa1-3a5f-49a3-a046-6700fd520b53", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1909669690"}], "key_name": "tempest-keypair-1695940829", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:51.991238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a6558fe-b2cb-4da3-8a70-afcc3c0f0781 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:51.998053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a6558fe-b2cb-4da3-8a70-afcc3c0f0781 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:51.998727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a6558fe-b2cb-4da3-8a70-afcc3c0f0781 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:51.999335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a6558fe-b2cb-4da3-8a70-afcc3c0f0781 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:52.000265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a6558fe-b2cb-4da3-8a70-afcc3c0f0781 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:52.000912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a6558fe-b2cb-4da3-8a70-afcc3c0f0781 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:52.001509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a6558fe-b2cb-4da3-8a70-afcc3c0f0781 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:52.040343 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a6558fe-b2cb-4da3-8a70-afcc3c0f0781 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.052511 Oct 27 09:03:52.041277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 528/1036] 10.222.0.25 () {60 vars in 1178 bytes} [Thu Oct 27 09:03:51 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:52.087475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59cbedb6-240f-4696-9350-2d07ab1e0ac4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:52.096135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59cbedb6-240f-4696-9350-2d07ab1e0ac4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:52.096611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59cbedb6-240f-4696-9350-2d07ab1e0ac4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:52.101436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59cbedb6-240f-4696-9350-2d07ab1e0ac4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:52.102706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59cbedb6-240f-4696-9350-2d07ab1e0ac4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:52.103198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59cbedb6-240f-4696-9350-2d07ab1e0ac4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:52.108870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59cbedb6-240f-4696-9350-2d07ab1e0ac4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:52.146571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] validate_networks() for [('9f308f64-5352-4673-8175-ce38df079ed9', None, None, None, None, None), (None, None, '1909605a-f082-4fa7-8b71-e5b6588381b7', None, None, None), (None, None, '3b758947-9790-4cd2-9c9a-4f2d98912f3e', None, None, None), ('bd14e41d-f93f-4881-a483-3f860c0c751f', None, None, None, None, None), ('bd14e41d-f93f-4881-a483-3f860c0c751f', None, None, None, None, None), ('dab5b204-fdb5-4a85-85d4-e18e7c932854', '10.2.2.100', None, None, None, None), ('dab5b204-fdb5-4a85-85d4-e18e7c932854', '10.2.2.200', None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:03:52.165856 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59cbedb6-240f-4696-9350-2d07ab1e0ac4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-858383-16&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.093326 Oct 27 09:03:52.167119 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 529/1037] 10.222.0.25 () {60 vars in 1237 bytes} [Thu Oct 27 09:03:52 2022] GET /compute/v2.1/os-services?host=n-d-858383-16&binary=xxx => generated 16 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:52.184493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d46818d0-9cda-4586-8bd3-197b21270861 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:52.188087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d46818d0-9cda-4586-8bd3-197b21270861 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:52.188755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d46818d0-9cda-4586-8bd3-197b21270861 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:52.189480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d46818d0-9cda-4586-8bd3-197b21270861 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:52.190877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d46818d0-9cda-4586-8bd3-197b21270861 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:52.191448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d46818d0-9cda-4586-8bd3-197b21270861 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:52.192682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d46818d0-9cda-4586-8bd3-197b21270861 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:52.263211 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d46818d0-9cda-4586-8bd3-197b21270861 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.082471 Oct 27 09:03:52.264784 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 530/1038] 10.222.0.25 () {60 vars in 1178 bytes} [Thu Oct 27 09:03:52 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:52.285710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-01117f37-6802-4415-8daf-a5ddf618fcf4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:52.289730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01117f37-6802-4415-8daf-a5ddf618fcf4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:52.290440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01117f37-6802-4415-8daf-a5ddf618fcf4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:52.291048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01117f37-6802-4415-8daf-a5ddf618fcf4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:52.291986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01117f37-6802-4415-8daf-a5ddf618fcf4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:52.292600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01117f37-6802-4415-8daf-a5ddf618fcf4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:52.293188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01117f37-6802-4415-8daf-a5ddf618fcf4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:52.331126 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-01117f37-6802-4415-8daf-a5ddf618fcf4 tempest-ServicesAdminNegativeV253TestJSON-897550258 tempest-ServicesAdminNegativeV253TestJSON-897550258-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.055966 Oct 27 09:03:52.332210 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 531/1039] 10.222.0.25 () {60 vars in 1239 bytes} [Thu Oct 27 09:03:52 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:52.546964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bca106c2-00ec-44ec-acea-e3816f94738a tempest-ServicesAdminNegativeV253TestJSON-2006647220 tempest-ServicesAdminNegativeV253TestJSON-2006647220-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:52.551863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bca106c2-00ec-44ec-acea-e3816f94738a tempest-ServicesAdminNegativeV253TestJSON-2006647220 tempest-ServicesAdminNegativeV253TestJSON-2006647220-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ad89605c9e6d4d50a1de814e00308894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ae67f56e324dc9b896cfca786de9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bca106c2-00ec-44ec-acea-e3816f94738a tempest-ServicesAdminNegativeV253TestJSON-2006647220 tempest-ServicesAdminNegativeV253TestJSON-2006647220-project] Request method failure captured: Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkl29xipjhNxaY2uxNeVmECx-KlSSUMf-JLU1QYFOgpKa-64U-vGzOPP5xwX7A62CvecqQFXoMuG2ycAToj6f6PAdQfMYm4RLFUuCv-ldDnJFmKHAFpNzdWxzIPg4N7WI1V8WstgVq5FHCDY4K3ftELpoS_v7jr9FFliQRcocHw8JfM Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.53 Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 63ae67f56e324dc9b896cfca786de9eb Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2006647220 Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63ae67f56e324dc9b896cfca786de9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63ae67f56e324dc9b896cfca786de9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63ae67f56e324dc9b896cfca786de9eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63ae67f56e324dc9b896cfca786de9eb"}]}] Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2006647220 Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 63ae67f56e324dc9b896cfca786de9eb Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2006647220 Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2006647220-project Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: ad89605c9e6d4d50a1de814e00308894 Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2006647220-project Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: action_args: {} Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:03:52.553502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bca106c2-00ec-44ec-acea-e3816f94738a tempest-ServicesAdminNegativeV253TestJSON-2006647220 tempest-ServicesAdminNegativeV253TestJSON-2006647220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bca106c2-00ec-44ec-acea-e3816f94738a tempest-ServicesAdminNegativeV253TestJSON-2006647220 tempest-ServicesAdminNegativeV253TestJSON-2006647220-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.211659 Oct 27 09:03:52.558486 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 532/1040] 10.222.0.25 () {60 vars in 1178 bytes} [Thu Oct 27 09:03:52 2022] GET /compute/v2.1/os-services => generated 112 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:03:53.002401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:53.003799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:53.014389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:53.015106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:53.015543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:53.016335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:53.017108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:53.017947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:53.241945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:53.250729 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57b01ffe-b699-411f-ba6e-0528ac061d97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1536 microversion: 2.1 time: 0.252319 Oct 27 09:03:53.251747 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 533/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:52 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1536 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:54.275133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:54.276960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:54.284902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:54.285960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:54.287549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:54.288539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:54.289194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:54.289938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:54.530184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:54.537706 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31f7ff5b-ffb3-4768-959f-d725721e9eb4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1536 microversion: 2.1 time: 0.267154 Oct 27 09:03:54.538566 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 534/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:54 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1536 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:55.192579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:03:55.193607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:03:55.194940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:03:55.196725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:03:55.198435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:03:55.210892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:55.212151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:55.213206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:55.214171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:55.214836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:55.215678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:55.238456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Getting quotas for project 1df6a0e925ac430c8dced7c02d70b45a. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:03:55.244245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Getting quotas for user d7176e89e16e4b0788ebecec7a32a924 and project 1df6a0e925ac430c8dced7c02d70b45a. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:03:55.457996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:03:55.463195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2dd78810-48ac-4cb9-b733-bfd97a26819c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='772d493f-bab8-49c6-a189-8643c936f9bc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ae29fa1-3a5f-49a3-a046-6700fd520b53',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:03:55.562751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:55.563402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:55.572110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:55.572925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:55.574200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:55.575776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:55.576449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:55.577119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:55.875522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:55.885396 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c2db290-a726-4899-bcc5-20f8d4e6afbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1536 microversion: 2.1 time: 0.327428 Oct 27 09:03:55.886839 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 535/1043] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:55 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1536 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:55.999818 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bb4a994-5182-4b33-a9ac-75ec7fa4b247 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 4.023027 Oct 27 09:03:56.001511 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 509/1044] 10.222.0.25 () {62 vars in 1189 bytes} [Thu Oct 27 09:03:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 4028 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:03:56.013050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89c90635-8544-47b3-80df-0c69e8e66884 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:56.013671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-89c90635-8544-47b3-80df-0c69e8e66884 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:56.148456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89c90635-8544-47b3-80df-0c69e8e66884 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:56.161213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89c90635-8544-47b3-80df-0c69e8e66884 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:56.163460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89c90635-8544-47b3-80df-0c69e8e66884 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:56.165152 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-89c90635-8544-47b3-80df-0c69e8e66884 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1286 microversion: 2.32 time: 0.156786 Oct 27 09:03:56.173359 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 536/1045] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:56 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:56.503283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8c1841a-a061-4abc-a60b-f1d9adbd5478 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:56.509500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b8c1841a-a061-4abc-a60b-f1d9adbd5478 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:56.513213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1397ad7b-dc34-42cf-add1-05e0d17f693b tempest-FlavorsV2NegativeTest-2079127975 tempest-FlavorsV2NegativeTest-2079127975-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:56.524554 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1397ad7b-dc34-42cf-add1-05e0d17f693b tempest-FlavorsV2NegativeTest-2079127975 tempest-FlavorsV2NegativeTest-2079127975-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.234981 Oct 27 09:03:56.525742 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 510/1046] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:03:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:56.541126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8c1841a-a061-4abc-a60b-f1d9adbd5478 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:56.541623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8c1841a-a061-4abc-a60b-f1d9adbd5478 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:56.542070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8c1841a-a061-4abc-a60b-f1d9adbd5478 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:56.542840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8c1841a-a061-4abc-a60b-f1d9adbd5478 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:56.543300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8c1841a-a061-4abc-a60b-f1d9adbd5478 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:56.543769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8c1841a-a061-4abc-a60b-f1d9adbd5478 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:56.833954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1bcd663f-d1c1-45e5-9703-57c189474ef0 req-ace46fc0-85d3-4851-8e8b-683ef8f0557e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e4c64d-6f11-409d-befa-fbea1791a69b", "name": "network-vif-unplugged", "status": "completed", "tag": "e8980257-9864-4b1e-940e-b586249dde6e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:56.861460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1bcd663f-d1c1-45e5-9703-57c189474ef0 req-ace46fc0-85d3-4851-8e8b-683ef8f0557e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:56.863444 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8c1841a-a061-4abc-a60b-f1d9adbd5478 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1815 microversion: 2.1 time: 0.364408 Oct 27 09:03:56.864306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1bcd663f-d1c1-45e5-9703-57c189474ef0 req-ace46fc0-85d3-4851-8e8b-683ef8f0557e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:56.864708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1bcd663f-d1c1-45e5-9703-57c189474ef0 req-ace46fc0-85d3-4851-8e8b-683ef8f0557e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:56.884231 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 537/1047] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:56 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1815 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:03:56.892389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95888a36-9c40-49d7-804a-ef4c9c408c3f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:56.898501 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1bcd663f-d1c1-45e5-9703-57c189474ef0 req-ace46fc0-85d3-4851-8e8b-683ef8f0557e service nova] Creating event network-vif-unplugged:e8980257-9864-4b1e-940e-b586249dde6e for instance a6e4c64d-6f11-409d-befa-fbea1791a69b on n-h1-858383-16 Oct 27 09:03:56.903496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95888a36-9c40-49d7-804a-ef4c9c408c3f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:56.904617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-1bcd663f-d1c1-45e5-9703-57c189474ef0 req-ace46fc0-85d3-4851-8e8b-683ef8f0557e service nova] Instance a6e4c64d-6f11-409d-befa-fbea1791a69b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:03:56.910786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95888a36-9c40-49d7-804a-ef4c9c408c3f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:56.911155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95888a36-9c40-49d7-804a-ef4c9c408c3f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:56.911962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95888a36-9c40-49d7-804a-ef4c9c408c3f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:56.912427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95888a36-9c40-49d7-804a-ef4c9c408c3f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:56.912887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95888a36-9c40-49d7-804a-ef4c9c408c3f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:56.913724 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1bcd663f-d1c1-45e5-9703-57c189474ef0 req-ace46fc0-85d3-4851-8e8b-683ef8f0557e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085212 Oct 27 09:03:56.914818 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 511/1048] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:03:56.921615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:56.922247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:56.931467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:56.932249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:56.932853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:56.934461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:56.935310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:56.936359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:56.950515 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-95888a36-9c40-49d7-804a-ef4c9c408c3f tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.064751 Oct 27 09:03:56.953323 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 538/1049] 10.222.0.25 () {58 vars in 1176 bytes} [Thu Oct 27 09:03:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:03:57.195430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:57.196373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:57.217018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:57.217916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:57.218363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:57.219082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:57.219532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:57.222117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:57.235209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:57.247263 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef622719-a24f-4916-8f8d-85e0c20557da tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1536 microversion: 2.1 time: 0.330904 Oct 27 09:03:57.248762 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 512/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:56 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1536 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:57.312543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:03:57.555655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:57.570260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:57.572391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:57.574288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-baab46d9-f688-4c39-889e-eff82521943a tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1520 microversion: 2.32 time: 0.385863 Oct 27 09:03:57.592191 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 539/1051] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:57 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:03:57.633096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a969c2f8-417b-47cd-aba1-97377cc6e2ba tempest-FlavorsV2NegativeTest-2079127975 tempest-FlavorsV2NegativeTest-2079127975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1577039731", "imageRef": "7dd0da5a-cafa-4747-a55a-e2f307b2edb8", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:57.749833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-a969c2f8-417b-47cd-aba1-97377cc6e2ba tempest-FlavorsV2NegativeTest-2079127975 tempest-FlavorsV2NegativeTest-2079127975-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:03:58.074502 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a969c2f8-417b-47cd-aba1-97377cc6e2ba tempest-FlavorsV2NegativeTest-2079127975 tempest-FlavorsV2NegativeTest-2079127975-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a969c2f8-417b-47cd-aba1-97377cc6e2ba tempest-FlavorsV2NegativeTest-2079127975 tempest-FlavorsV2NegativeTest-2079127975-project] Request method failure captured: Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 143 Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkl8cjT53-RmWXj4J_53xq0YF-lfy8X-cO-8zRPfGXlDLOgRE0AdgSwBU_z8Yq8DIAhSQ1U1jQOpUlW9u-Nj-EAi9spa6Q0RwZvePtvejB1VkydCyrzlpupTBHyIRppP6svHzoYahszb9QkSv6TNUXlNfV9UdOBhUFGLiiVhFKtcmyI Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 5595cf10fbe645f4a8d3cbf88f292d5a Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FlavorsV2NegativeTest-2079127975 Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5595cf10fbe645f4a8d3cbf88f292d5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5595cf10fbe645f4a8d3cbf88f292d5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5595cf10fbe645f4a8d3cbf88f292d5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5595cf10fbe645f4a8d3cbf88f292d5a"}]}] Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FlavorsV2NegativeTest-2079127975 Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 5595cf10fbe645f4a8d3cbf88f292d5a Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-2079127975 Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FlavorsV2NegativeTest-2079127975-project Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c21db621985c40f4b6c07b3d495e9bb8 Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FlavorsV2NegativeTest-2079127975-project Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1577039731", "imageRef": "7dd0da5a-cafa-4747-a55a-e2f307b2edb8", "flavorRef": "452"}} Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: exception: Flavor's memory is too small for requested image. Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1577039731', 'imageRef': '7dd0da5a-cafa-4747-a55a-e2f307b2edb8', 'flavorRef': '452'}}} Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:58.076329 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a969c2f8-417b-47cd-aba1-97377cc6e2ba tempest-FlavorsV2NegativeTest-2079127975 tempest-FlavorsV2NegativeTest-2079127975-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a969c2f8-417b-47cd-aba1-97377cc6e2ba tempest-FlavorsV2NegativeTest-2079127975 tempest-FlavorsV2NegativeTest-2079127975-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.448565 Oct 27 09:03:58.080510 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 513/1052] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:03:57 2022] POST /compute/v2.1/servers => generated 93 bytes in 450 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:03:58.275168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:58.275918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:58.294699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:58.297376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:58.298554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:58.300824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:58.302787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:58.303891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:58.603828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:58.604523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:58.615542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:58.616160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:58.618527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:58.619956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:58.621191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:58.624741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:58.754247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:58.771136 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-58a44a31-d64f-4ac2-a311-9b2fc1622466 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1529 microversion: 2.1 time: 0.500460 Oct 27 09:03:58.773492 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 540/1053] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:58 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1529 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:58.800013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:58.802477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:58.812825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:58.813693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:58.814990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:58.816213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:58.817870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:58.818862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:58.897698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:58.915735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:58.917855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:58.921854 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-869b4fb1-17cb-4f29-808c-0c70f04d1f57 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1594 microversion: 2.32 time: 0.324605 Oct 27 09:03:58.947210 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 514/1054] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:03:58 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1594 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:03:59.209918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:03:59.220997 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8756e013-4343-40a7-904a-8630c5fb1e4b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1529 microversion: 2.1 time: 0.428039 Oct 27 09:03:59.224567 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 541/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:03:58 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1529 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:03:59.251555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3aec9f2d-06ac-4815-9bdf-fed4e724b09b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:03:59.263835 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-3aec9f2d-06ac-4815-9bdf-fed4e724b09b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] HTTP exception thrown: Flavor 12e94858-b912-4c84-a3ba-6ef5c5932f7f could not be found. Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3aec9f2d-06ac-4815-9bdf-fed4e724b09b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Request method failure captured: Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/flavors/12e94858-b912-4c84-a3ba-6ef5c5932f7f HTTP/1.1 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkigUOF7qIupaYcpf05_OCrNhTIgHeIp9eqbcs0X8U8fng3OotLNzIP1GUAZ0fhbTQiUuak-X-s_EaaUjUyucH4H7iHyMo3q5o2s8k8o9yMeCKdNRA0VDZUPHgqZWK4mPy1MTZxZIO7d_NDK3kKxC0AaZjo3x_63fquhIfsh6jSLk28 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6a94c8f1728143db9c22f3995a036a73 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-MigrationsAdminTest-2075391032 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a94c8f1728143db9c22f3995a036a73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6a94c8f1728143db9c22f3995a036a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a94c8f1728143db9c22f3995a036a73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6a94c8f1728143db9c22f3995a036a73"}]}] Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-MigrationsAdminTest-2075391032 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6a94c8f1728143db9c22f3995a036a73 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-MigrationsAdminTest-2075391032 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-MigrationsAdminTest-2075391032-project-admin Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 53a12c42039245cb8f56db798254e016 Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-MigrationsAdminTest-2075391032-project-admin Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: exception: Flavor 12e94858-b912-4c84-a3ba-6ef5c5932f7f could not be found. Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '12e94858-b912-4c84-a3ba-6ef5c5932f7f'} Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 12e94858-b912-4c84-a3ba-6ef5c5932f7f could not be found. Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 12e94858-b912-4c84-a3ba-6ef5c5932f7f could not be found. Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:59.267218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:03:59.271340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:59.271340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:03:59.271340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:03:59.271340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:03:59.271340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:03:59.271340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:03:59.271340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 12e94858-b912-4c84-a3ba-6ef5c5932f7f could not be found. Oct 27 09:03:59.271340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:03:59.274734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3aec9f2d-06ac-4815-9bdf-fed4e724b09b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Returning 404 to user: Flavor 12e94858-b912-4c84-a3ba-6ef5c5932f7f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:03:59.277362 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3aec9f2d-06ac-4815-9bdf-fed4e724b09b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/12e94858-b912-4c84-a3ba-6ef5c5932f7f" status: 404 len: 109 microversion: 2.1 time: 0.029566 Oct 27 09:03:59.279977 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 515/1056] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:03:59 2022] DELETE /compute/v2.1/flavors/12e94858-b912-4c84-a3ba-6ef5c5932f7f => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:03:59.487130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1150400288", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:59.588523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:03:59.663818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac92ae76-b9c9-403d-b049-a27e8de3a91d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d7f79b4-fa41-482f-aa81-5356968ff6cd", "device": "/dev/xvdb"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:03:59.668306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac92ae76-b9c9-403d-b049-a27e8de3a91d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:03:59.689561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac92ae76-b9c9-403d-b049-a27e8de3a91d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:59.691276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac92ae76-b9c9-403d-b049-a27e8de3a91d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:59.691912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac92ae76-b9c9-403d-b049-a27e8de3a91d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:03:59.692639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac92ae76-b9c9-403d-b049-a27e8de3a91d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:03:59.695023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac92ae76-b9c9-403d-b049-a27e8de3a91d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:03:59.695497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac92ae76-b9c9-403d-b049-a27e8de3a91d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:00.063559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:04:00.064072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:04:00.064603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:04:00.065012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:04:00.065414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:04:00.107915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:00.108410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:00.108849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:00.109587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:00.110042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:00.134016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:00.216059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:04:00.233627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Getting quotas for user 0566a978e2924137973615346b1afaa3 and project 749cfbed2a9044b286f364ad8fb9dea9. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:04:00.303856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:04:00.309638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:04:00.366284 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac92ae76-b9c9-403d-b049-a27e8de3a91d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "POST /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708728 Oct 27 09:04:00.373569 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 516/1057] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:03:59 2022] POST /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments => generated 194 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:00.387288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:00.392302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:00.402581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:00.417243 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7802e5c0-6ec2-4235-ab31-148f4a6bca22 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935555 Oct 27 09:04:00.417514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:00.418524 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 542/1058] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:03:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:04:00.419558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:00.420198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:00.421083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:00.422720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:00.424764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:00.431880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8044310b-760f-48c3-bddc-1d4e1d48526c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:00.442707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8044310b-760f-48c3-bddc-1d4e1d48526c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:01.354708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8044310b-760f-48c3-bddc-1d4e1d48526c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:01.362768 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8044310b-760f-48c3-bddc-1d4e1d48526c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1213 microversion: 2.1 time: 0.936848 Oct 27 09:04:01.368565 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 543/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:00 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1213 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:01.384741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:01.385769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:01.394338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:01.404407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:01.405147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:01.406349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:01.406983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:01.407620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:01.476663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:04:01.782824 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b80a82ce-a13c-4fc1-8375-56493d1b7896 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 204 len: 0 microversion: 2.1 time: 0.411653 Oct 27 09:04:01.787826 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 544/1060] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:04:01 2022] DELETE /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:04:01.800171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:01.804021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:01.823750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:01.825064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:01.826051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:01.830618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:01.831206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:01.832288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:02.085598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:02.103130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:02.110298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:02.117094 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d12532b2-f4c9-43e1-9e15-235f58020bc2 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1662 microversion: 2.32 time: 1.741652 Oct 27 09:04:02.118080 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 517/1061] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:00 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1662 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:02.307613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:02.316095 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61fcdc2b-c3bf-48cf-8295-52c34ceb1e12 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1711 microversion: 2.1 time: 0.524514 Oct 27 09:04:02.320924 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 545/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:01 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1711 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:02.390873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:02.398531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:02.406569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:02.407063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:02.407509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:02.408871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:02.409338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:02.409773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:02.539766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:02.550773 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-84ecd3d3-032d-481e-bf36-c76e2306bf17 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1209 microversion: 2.1 time: 0.163797 Oct 27 09:04:02.552371 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 518/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:02 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1209 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:03.144415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:03.145469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:03.159279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:03.164341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:03.165779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:03.168233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:03.169117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:03.169885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:03.173213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:03.185852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b89cbb09-ace2-408e-8807-c237ea33ec0e req-d320fc16-211a-4dcd-9c74-40201ef0a51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e4c64d-6f11-409d-befa-fbea1791a69b", "name": "network-vif-plugged", "status": "completed", "tag": "e8980257-9864-4b1e-940e-b586249dde6e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:03.230025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b89cbb09-ace2-408e-8807-c237ea33ec0e req-d320fc16-211a-4dcd-9c74-40201ef0a51d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:03.230512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b89cbb09-ace2-408e-8807-c237ea33ec0e req-d320fc16-211a-4dcd-9c74-40201ef0a51d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:03.230961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b89cbb09-ace2-408e-8807-c237ea33ec0e req-d320fc16-211a-4dcd-9c74-40201ef0a51d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:03.274859 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b89cbb09-ace2-408e-8807-c237ea33ec0e req-d320fc16-211a-4dcd-9c74-40201ef0a51d service nova] Creating event network-vif-plugged:e8980257-9864-4b1e-940e-b586249dde6e for instance a6e4c64d-6f11-409d-befa-fbea1791a69b on n-h1-858383-16 Oct 27 09:04:03.288450 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b89cbb09-ace2-408e-8807-c237ea33ec0e req-d320fc16-211a-4dcd-9c74-40201ef0a51d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106996 Oct 27 09:04:03.292350 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 519/1064] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:03.343761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:03.353431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:03.365343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:03.370721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:03.371187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:03.371963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:03.372423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:03.375905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:03.641128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:03.660870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:03.665066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:03.670281 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae33663c-cdb4-47c8-97ac-3a4199904387 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1709 microversion: 2.32 time: 0.530926 Oct 27 09:04:03.671110 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 546/1065] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:03 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1709 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:03.681415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:03.693306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:03.704579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:03.708337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:03.711103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:03.712069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:03.712787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:03.713401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:03.820610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:03.826719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:03.830859 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a193e6d2-ff69-4aff-ba5b-73f0b1f8c069 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1265 microversion: 2.1 time: 0.157386 Oct 27 09:04:03.832059 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 547/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:03 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:03.841472 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e58d89b2-0863-4b05-8097-b257a433373f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1711 microversion: 2.1 time: 0.503034 Oct 27 09:04:03.844551 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 520/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:03 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1711 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:04.700673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:04.701982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:04.709637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:04.715599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:04.716398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:04.724466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:04.727941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:04.728739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:04.860066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:04.860682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:04.874317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:04.876747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:04.877269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:04.879718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:04.880737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:04.881196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:04.915778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:05.228366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:05.253215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:05.386508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:05.401462 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5bf759c9-b38b-4a2c-9e89-2762867e63f8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1271 microversion: 2.1 time: 0.545736 Oct 27 09:04:05.415608 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 521/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:04 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1271 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:05.423466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:05.424115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:05.438113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:05.438871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:05.439718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:05.440639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:05.441458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:05.442051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:06.282309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:06.299279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:06.301448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:06.302908 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9a07f81e-cd60-4b7b-a9ac-46d1bd1b004d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1756 microversion: 2.32 time: 1.606289 Oct 27 09:04:06.317142 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 548/1069] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:04 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1756 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:06.428179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:06.429356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:06.453728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:06.457541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:06.458877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:06.460030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:06.460719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:06.462798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:06.821700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:06.832090 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e177d3d5-70f0-4d50-9ff2-61cbcd06b3a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1711 microversion: 2.1 time: 1.428603 Oct 27 09:04:06.852287 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 522/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:05 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1711 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:07.005827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:07.023814 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1a8c3579-cfbf-4c9d-add2-13f62072a3b4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1271 microversion: 2.1 time: 0.597730 Oct 27 09:04:07.032237 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 549/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:06 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1271 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:07.332916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:07.333829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:07.349112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:07.349618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:07.350065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:07.350788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:07.351247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:07.351711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:07.866332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:07.866938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:07.876804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:07.878815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:07.881116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:07.882074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:07.884398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:07.885040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:08.211358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:08.222629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:08.232520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:08.234966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b7c906c-46d6-4994-9d8d-9b90ad0b13ea tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1850 microversion: 2.32 time: 0.906517 Oct 27 09:04:08.237677 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 523/1072] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:07 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1850 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:08.248032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:08.248632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:08.269836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:08.271283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:08.272884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:08.275591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:08.277702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:08.279313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:08.968717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:08.982382 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5aa3bdd-862b-4675-a95c-db76aea8e79f tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1711 microversion: 2.1 time: 1.117744 Oct 27 09:04:09.014867 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 550/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:07 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1711 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:09.021414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-13bce919-0b52-4f34-80a1-31818d12904c req-b0e48aa2-99ac-4b5f-8f33-fb04ddf0677e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "tag": "81294aa2-0c23-45a5-81ca-6872462ae6d3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:09.033101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13bce919-0b52-4f34-80a1-31818d12904c req-b0e48aa2-99ac-4b5f-8f33-fb04ddf0677e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:09.033825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13bce919-0b52-4f34-80a1-31818d12904c req-b0e48aa2-99ac-4b5f-8f33-fb04ddf0677e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:09.035002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13bce919-0b52-4f34-80a1-31818d12904c req-b0e48aa2-99ac-4b5f-8f33-fb04ddf0677e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:09.062933 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-13bce919-0b52-4f34-80a1-31818d12904c req-b0e48aa2-99ac-4b5f-8f33-fb04ddf0677e service nova] Creating event network-changed:81294aa2-0c23-45a5-81ca-6872462ae6d3 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:04:09.087033 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-13bce919-0b52-4f34-80a1-31818d12904c req-b0e48aa2-99ac-4b5f-8f33-fb04ddf0677e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070356 Oct 27 09:04:09.090410 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 551/1074] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:09.201442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:09.217338 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-063a2eab-eab0-44a1-ab42-d5a0b191f3c5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 0.977823 Oct 27 09:04:09.220531 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 524/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:08 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:09.266298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:09.267226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:09.284122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:09.284724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:09.285283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:09.286085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:09.286652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:09.287184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:10.012396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:10.013309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:10.024307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:10.031687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:10.032295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:10.033307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:10.033881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:10.034527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:10.154515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=17 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:10.211413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:10.225288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:10.226851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:10.231553 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46b33203-eec1-4c79-9bb2-33982ba46c6c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1871 microversion: 2.32 time: 0.969741 Oct 27 09:04:10.237109 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 552/1076] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:09 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1871 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:10.252143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:10.252918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:10.271123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:10.271816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:10.272362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:10.273176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:10.273738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:10.274426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:10.405315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:10.415064 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38dff17b-e694-4c32-8061-ba8d5703cfe4 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1644 microversion: 2.1 time: 0.406307 Oct 27 09:04:10.416214 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 525/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:10 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1644 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:10.516524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2ecc8168-b008-48bf-b995-ba7a8e2951c9 req-d11a17a4-405a-4a31-95bd-4e09293e70a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134f4014-5bbe-4a5a-a204-9044a7ce8134", "name": "network-vif-deleted", "tag": "01a80a77-f0f3-4513-baef-52423db0a2cd"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:10.533536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2ecc8168-b008-48bf-b995-ba7a8e2951c9 req-d11a17a4-405a-4a31-95bd-4e09293e70a3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:10.534447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2ecc8168-b008-48bf-b995-ba7a8e2951c9 req-d11a17a4-405a-4a31-95bd-4e09293e70a3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:10.535843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2ecc8168-b008-48bf-b995-ba7a8e2951c9 req-d11a17a4-405a-4a31-95bd-4e09293e70a3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:10.568920 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2ecc8168-b008-48bf-b995-ba7a8e2951c9 req-d11a17a4-405a-4a31-95bd-4e09293e70a3 service nova] Creating event network-vif-deleted:01a80a77-f0f3-4513-baef-52423db0a2cd for instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 on n-h1-858383-16 Oct 27 09:04:10.580895 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2ecc8168-b008-48bf-b995-ba7a8e2951c9 req-d11a17a4-405a-4a31-95bd-4e09293e70a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068129 Oct 27 09:04:10.581832 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 526/1078] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:11.194259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f6c3ee8f-0cb4-42f8-ab5b-a0a48ba9f722 req-5e156358-bf39-4b82-84cb-bca0c427b3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "tag": "1909605a-f082-4fa7-8b71-e5b6588381b7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:11.214039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f6c3ee8f-0cb4-42f8-ab5b-a0a48ba9f722 req-5e156358-bf39-4b82-84cb-bca0c427b3c7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:11.214895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f6c3ee8f-0cb4-42f8-ab5b-a0a48ba9f722 req-5e156358-bf39-4b82-84cb-bca0c427b3c7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:11.215600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f6c3ee8f-0cb4-42f8-ab5b-a0a48ba9f722 req-5e156358-bf39-4b82-84cb-bca0c427b3c7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:11.235117 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f6c3ee8f-0cb4-42f8-ab5b-a0a48ba9f722 req-5e156358-bf39-4b82-84cb-bca0c427b3c7 service nova] Creating event network-changed:1909605a-f082-4fa7-8b71-e5b6588381b7 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:04:11.241096 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f6c3ee8f-0cb4-42f8-ab5b-a0a48ba9f722 req-5e156358-bf39-4b82-84cb-bca0c427b3c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051394 Oct 27 09:04:11.242358 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 527/1079] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:11.281293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:11.284606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:11.305786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:11.307221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:11.307933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:11.309961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:11.310700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:11.313036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:11.362628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=10 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:11.388007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:11.421250 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3d107320-a66b-483d-84af-0d3b74cd03f5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 1.182427 Oct 27 09:04:11.422626 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 553/1080] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:10 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:11.486413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:11.490153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:11.499623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:11.501009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:11.502276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:11.506618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:11.507438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:11.508231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:11.576083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:11.576984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:11.577655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:11.578335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lazy-loading 'fault' on Instance uuid 134f4014-5bbe-4a5a-a204-9044a7ce8134 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:04:11.833982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57135e8924954c2da220af70744f9a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee4717f40ee493aa3aa1c7f37d5ffbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:11.856352 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d9095cc5-6526-477e-b22f-d259c601cb52 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 200 len: 1354 microversion: 2.1 time: 0.410067 Oct 27 09:04:11.858619 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 554/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:11 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 1354 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:12.451232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:12.451911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:12.468153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:12.469366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:12.470451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:12.472100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:12.472717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:12.473153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:12.491910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:12.531360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:12.537316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:12.551455 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb6dcd65-6b38-4f29-b906-f78fbaa62010 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1892 microversion: 2.32 time: 1.286258 Oct 27 09:04:12.552142 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 528/1082] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:11 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1892 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:12.885117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:12.885733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:12.901561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:12.902454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:12.905080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:12.908002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:12.910962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:12.912857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:12.963159 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] HTTP exception thrown: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Request method failure captured: Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 HTTP/1.1 Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkh6XcxeBc_pKDI5VW6scMsRFoPmm4iguIQRTzBMpMAhQ8jF5eJzzEfGgcW0zbkJ_lvFZniYzqm6Wwd4ZZvThiITt6jnEDa90cYuJRD_qHZ6zaCVgQ8OjeQdDc8IZzqOwiivPIVtS1NplexL_mLJeB_4MrGoEjuCRn8btag2YU1ll1s Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}] Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57135e8924954c2da220af70744f9a2b Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '134f4014-5bbe-4a5a-a204-9044a7ce8134'} Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:12.968467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:12.973199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:12.973199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:12.973199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:12.973199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:12.973199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:12.973199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:12.973199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:12.973199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:12.974726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Returning 404 to user: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:12.977885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a32062c1-39b9-43f5-a723-536d65fa5f7a tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 404 len: 111 microversion: 2.1 time: 0.095756 Oct 27 09:04:12.983799 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 529/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:12 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:04:12.997788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:12.999954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:13.018743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:13.027228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:13.028660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:13.031730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:13.032454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:13.033159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:13.066651 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] HTTP exception thrown: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Request method failure captured: Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c HTTP/1.1 Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkh6XcxeBc_pKDI5VW6scMsRFoPmm4iguIQRTzBMpMAhQ8jF5eJzzEfGgcW0zbkJ_lvFZniYzqm6Wwd4ZZvThiITt6jnEDa90cYuJRD_qHZ6zaCVgQ8OjeQdDc8IZzqOwiivPIVtS1NplexL_mLJeB_4MrGoEjuCRn8btag2YU1ll1s Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}] Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57135e8924954c2da220af70744f9a2b Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd008a476-b957-43e1-a895-4c894f28710c'} Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:04:13.068913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.073729 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.087206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Returning 404 to user: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:13.088573 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca4793ff-7ef8-438c-9438-eec380684361 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 404 len: 111 microversion: 2.1 time: 0.103348 Oct 27 09:04:13.096760 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 530/1084] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:04:12 2022] DELETE /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:13.105126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:13.109394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:13.128265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:13.129189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:13.129803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:13.130724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:13.132022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:13.133367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:13.176107 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] HTTP exception thrown: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Request method failure captured: Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c HTTP/1.1 Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkh6XcxeBc_pKDI5VW6scMsRFoPmm4iguIQRTzBMpMAhQ8jF5eJzzEfGgcW0zbkJ_lvFZniYzqm6Wwd4ZZvThiITt6jnEDa90cYuJRD_qHZ6zaCVgQ8OjeQdDc8IZzqOwiivPIVtS1NplexL_mLJeB_4MrGoEjuCRn8btag2YU1ll1s Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}] Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57135e8924954c2da220af70744f9a2b Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd008a476-b957-43e1-a895-4c894f28710c'} Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.177782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Returning 404 to user: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:13.183084 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a9105aa-c0ad-44c0-858b-4510386231d3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 404 len: 111 microversion: 2.1 time: 0.080020 Oct 27 09:04:13.192704 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 531/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:13 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:13.201853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-105037dd-6600-4d18-9de7-4725cd10b8b3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '.version_select at 0x7f31aa25d550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:13.240945 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-105037dd-6600-4d18-9de7-4725cd10b8b3 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745641971" status: 202 len: 0 microversion: 2.1 time: 0.042589 Oct 27 09:04:13.252629 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 532/1086] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 09:04:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745641971 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:13.284023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5975bcc2-388c-4e06-ac11-2354f2b54b81 req-02c5ead7-0307-4624-af01-947669bba3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "tag": "3b758947-9790-4cd2-9c9a-4f2d98912f3e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:13.311546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5975bcc2-388c-4e06-ac11-2354f2b54b81 req-02c5ead7-0307-4624-af01-947669bba3a8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:13.312517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5975bcc2-388c-4e06-ac11-2354f2b54b81 req-02c5ead7-0307-4624-af01-947669bba3a8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:13.314717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5975bcc2-388c-4e06-ac11-2354f2b54b81 req-02c5ead7-0307-4624-af01-947669bba3a8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:13.354907 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5975bcc2-388c-4e06-ac11-2354f2b54b81 req-02c5ead7-0307-4624-af01-947669bba3a8 service nova] Creating event network-changed:3b758947-9790-4cd2-9c9a-4f2d98912f3e for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:04:13.370592 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5975bcc2-388c-4e06-ac11-2354f2b54b81 req-02c5ead7-0307-4624-af01-947669bba3a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090521 Oct 27 09:04:13.375379 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 533/1087] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:13.582769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:13.583884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:13.595210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:13.596902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:13.600722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:13.602077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:13.602723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:13.603336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:13.694324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:13.705554 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3cad05ae-4d01-4530-b660-bc59f3601fed tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 1.262198 Oct 27 09:04:13.711298 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 555/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:12 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:14.738069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:14.738882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:14.745693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:14.746477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:14.747153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:14.748075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:14.750031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:14.750680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:14.783671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:14.894501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:14.922646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:14.925399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:14.928961 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ba164e95-1013-4dbd-8188-50a0b4763d63 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1892 microversion: 2.32 time: 1.348873 Oct 27 09:04:14.961808 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 534/1089] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:13 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1892 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:04:15.168585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-14b4ad51-5a58-4758-94b2-a5817c008d91 req-30f6c569-19e7-4a5c-9a1d-a03201fc6d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a988a0df-4f91-4497-a599-e7e19c636ac7", "tag": "b5279136-9006-4596-a97a-bc6367ac28b6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:15.184475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-14b4ad51-5a58-4758-94b2-a5817c008d91 req-30f6c569-19e7-4a5c-9a1d-a03201fc6d02 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:15.185312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-14b4ad51-5a58-4758-94b2-a5817c008d91 req-30f6c569-19e7-4a5c-9a1d-a03201fc6d02 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:15.185967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-14b4ad51-5a58-4758-94b2-a5817c008d91 req-30f6c569-19e7-4a5c-9a1d-a03201fc6d02 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:15.203950 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-14b4ad51-5a58-4758-94b2-a5817c008d91 req-30f6c569-19e7-4a5c-9a1d-a03201fc6d02 service nova] Creating event network-changed:b5279136-9006-4596-a97a-bc6367ac28b6 for instance a988a0df-4f91-4497-a599-e7e19c636ac7 on n-h1-858383-16 Oct 27 09:04:15.210325 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-14b4ad51-5a58-4758-94b2-a5817c008d91 req-30f6c569-19e7-4a5c-9a1d-a03201fc6d02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047357 Oct 27 09:04:15.211782 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 535/1090] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:15.395845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6a3a5b5a-3d58-4df9-91e9-a583602d222f req-cf55ac2a-26a9-4885-a58f-584cddb3a4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "tag": "91f51f6e-082b-4bd2-a440-28e5320e62d1"}, {"name": "network-changed", "server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "tag": "e2bf3f27-0dfb-4e04-ab67-6ed73dc59c65"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:15.412232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6a3a5b5a-3d58-4df9-91e9-a583602d222f req-cf55ac2a-26a9-4885-a58f-584cddb3a4fc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:15.413318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6a3a5b5a-3d58-4df9-91e9-a583602d222f req-cf55ac2a-26a9-4885-a58f-584cddb3a4fc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:15.413943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6a3a5b5a-3d58-4df9-91e9-a583602d222f req-cf55ac2a-26a9-4885-a58f-584cddb3a4fc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:15.427325 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6a3a5b5a-3d58-4df9-91e9-a583602d222f req-cf55ac2a-26a9-4885-a58f-584cddb3a4fc service nova] Creating event network-changed:91f51f6e-082b-4bd2-a440-28e5320e62d1 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:04:15.428181 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6a3a5b5a-3d58-4df9-91e9-a583602d222f req-cf55ac2a-26a9-4885-a58f-584cddb3a4fc service nova] Creating event network-changed:e2bf3f27-0dfb-4e04-ab67-6ed73dc59c65 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:04:15.437595 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6a3a5b5a-3d58-4df9-91e9-a583602d222f req-cf55ac2a-26a9-4885-a58f-584cddb3a4fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048312 Oct 27 09:04:15.439778 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 536/1091] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:15.528248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:15.545233 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-78db89ca-9e07-42d4-beea-9f79f4e06b70 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 0.811323 Oct 27 09:04:15.550483 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 556/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:14 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:15.974209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:15.975703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:15.987412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:15.992015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:15.992920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:15.993917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:15.994618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:15.997759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:16.576085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:16.577316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:16.589543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:16.593181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:16.593845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:16.594932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:16.596593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:16.598370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:16.772020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:16.790971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:16.796234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:16.800318 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-173cdd9b-acf7-4c88-87e8-4dd0359ee4f3 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1892 microversion: 2.32 time: 0.829720 Oct 27 09:04:16.815603 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 537/1093] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:15 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1892 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:17.368933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08bf9fd2-7a1c-440c-abd0-abfd8ba3e140 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:17.397903 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08bf9fd2-7a1c-440c-abd0-abfd8ba3e140 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1109119856" status: 202 len: 0 microversion: 2.1 time: 0.035388 Oct 27 09:04:17.402289 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 538/1094] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 09:04:17 2022] DELETE /compute/v2.1/flavors/1109119856 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:17.411875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52a147ce-7b10-4a9c-97c0-a8a0f0b3fad5 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:17.437413 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-52a147ce-7b10-4a9c-97c0-a8a0f0b3fad5 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.033564 Oct 27 09:04:17.454707 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 539/1095] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:17 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:17.461649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1d8af65d-92b7-4648-8327-f1083fdf59bf tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:17.488115 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1d8af65d-92b7-4648-8327-f1083fdf59bf tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1997814556" status: 202 len: 0 microversion: 2.1 time: 0.029886 Oct 27 09:04:17.489118 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 540/1096] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 09:04:17 2022] DELETE /compute/v2.1/flavors/1997814556 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:17.499663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc7d3923-0da7-4425-84a7-5838d260efc6 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:17.533790 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc7d3923-0da7-4425-84a7-5838d260efc6 tempest-ServersWithSpecificFlavorTestJSON-103501395 tempest-ServersWithSpecificFlavorTestJSON-103501395-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035385 Oct 27 09:04:17.535111 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 541/1097] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:17.548101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:17.553703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5d4e9698-43b1-46bc-b4ff-4d6798bc7f36 req-8f06a64f-b6b5-4739-8724-d1821ae96549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "tag": "32d1d17b-5769-4c16-9353-0660cc143a6a"}, {"name": "network-changed", "server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "tag": "2e9a642c-cdf6-4f11-b419-815f385318f3"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:17.559278 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-956979d9-5190-4b70-8f1a-c0881db287b7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 0.987840 Oct 27 09:04:17.573486 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 557/1098] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:16 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:17.586342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:17.587870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:17.589087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5d4e9698-43b1-46bc-b4ff-4d6798bc7f36 req-8f06a64f-b6b5-4739-8724-d1821ae96549 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.589662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5d4e9698-43b1-46bc-b4ff-4d6798bc7f36 req-8f06a64f-b6b5-4739-8724-d1821ae96549 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.590250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5d4e9698-43b1-46bc-b4ff-4d6798bc7f36 req-8f06a64f-b6b5-4739-8724-d1821ae96549 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.596636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.597472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.598156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.599098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.599782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.600405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.610849 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5d4e9698-43b1-46bc-b4ff-4d6798bc7f36 req-8f06a64f-b6b5-4739-8724-d1821ae96549 service nova] Creating event network-changed:32d1d17b-5769-4c16-9353-0660cc143a6a for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:04:17.615732 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5d4e9698-43b1-46bc-b4ff-4d6798bc7f36 req-8f06a64f-b6b5-4739-8724-d1821ae96549 service nova] Creating event network-changed:2e9a642c-cdf6-4f11-b419-815f385318f3 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:04:17.618220 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] HTTP exception thrown: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Request method failure captured: Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 HTTP/1.1 Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkh6XcxeBc_pKDI5VW6scMsRFoPmm4iguIQRTzBMpMAhQ8jF5eJzzEfGgcW0zbkJ_lvFZniYzqm6Wwd4ZZvThiITt6jnEDa90cYuJRD_qHZ6zaCVgQ8OjeQdDc8IZzqOwiivPIVtS1NplexL_mLJeB_4MrGoEjuCRn8btag2YU1ll1s Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}] Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57135e8924954c2da220af70744f9a2b Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '134f4014-5bbe-4a5a-a204-9044a7ce8134'} Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:04:17.620152 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.624699 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.628599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Returning 404 to user: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:17.630205 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98ba0664-d6c7-4698-b0fd-219c80edf5a9 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 404 len: 111 microversion: 2.1 time: 0.063527 Oct 27 09:04:17.630759 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 558/1099] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:04:17 2022] DELETE /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:17.635178 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5d4e9698-43b1-46bc-b4ff-4d6798bc7f36 req-8f06a64f-b6b5-4739-8724-d1821ae96549 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096105 Oct 27 09:04:17.635178 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 542/1100] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:17.643898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:17.644857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: 134f4014-5bbe-4a5a-a204-9044a7ce8134] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:17.652394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.653112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.653787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.654691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.655291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.655665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.675914 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] HTTP exception thrown: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Request method failure captured: Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 HTTP/1.1 Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkh6XcxeBc_pKDI5VW6scMsRFoPmm4iguIQRTzBMpMAhQ8jF5eJzzEfGgcW0zbkJ_lvFZniYzqm6Wwd4ZZvThiITt6jnEDa90cYuJRD_qHZ6zaCVgQ8OjeQdDc8IZzqOwiivPIVtS1NplexL_mLJeB_4MrGoEjuCRn8btag2YU1ll1s Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}] Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57135e8924954c2da220af70744f9a2b Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '134f4014-5bbe-4a5a-a204-9044a7ce8134'} Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.677457 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Returning 404 to user: Instance 134f4014-5bbe-4a5a-a204-9044a7ce8134 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:17.682624 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e6bc6c4-ccbd-4e31-85a5-c4f459b87f51 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134" status: 404 len: 111 microversion: 2.1 time: 0.040594 Oct 27 09:04:17.689436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:17.690038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:17.693127 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 559/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:17 2022] GET /compute/v2.1/servers/134f4014-5bbe-4a5a-a204-9044a7ce8134 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:17.696466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.697184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.697831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.698887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.699715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.701030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.720198 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] HTTP exception thrown: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Request method failure captured: Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c HTTP/1.1 Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkh6XcxeBc_pKDI5VW6scMsRFoPmm4iguIQRTzBMpMAhQ8jF5eJzzEfGgcW0zbkJ_lvFZniYzqm6Wwd4ZZvThiITt6jnEDa90cYuJRD_qHZ6zaCVgQ8OjeQdDc8IZzqOwiivPIVtS1NplexL_mLJeB_4MrGoEjuCRn8btag2YU1ll1s Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}] Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57135e8924954c2da220af70744f9a2b Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd008a476-b957-43e1-a895-4c894f28710c'} Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:04:17.722348 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Returning 404 to user: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:17.726380 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f088f685-525e-403d-9ddc-ae4954a69521 tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 404 len: 111 microversion: 2.1 time: 0.040057 Oct 27 09:04:17.734231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:17.735752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] [instance: d008a476-b957-43e1-a895-4c894f28710c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:17.741459 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 543/1102] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:04:17 2022] DELETE /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:17.743256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.743785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.744234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.744965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.745410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.745834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.783083 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] HTTP exception thrown: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Request method failure captured: Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c HTTP/1.1 Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkh6XcxeBc_pKDI5VW6scMsRFoPmm4iguIQRTzBMpMAhQ8jF5eJzzEfGgcW0zbkJ_lvFZniYzqm6Wwd4ZZvThiITt6jnEDa90cYuJRD_qHZ6zaCVgQ8OjeQdDc8IZzqOwiivPIVtS1NplexL_mLJeB_4MrGoEjuCRn8btag2YU1ll1s Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7ee4717f40ee493aa3aa1c7f37d5ffbe"}]}] Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7ee4717f40ee493aa3aa1c7f37d5ffbe Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695 Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57135e8924954c2da220af70744f9a2b Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599571695-project Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd008a476-b957-43e1-a895-4c894f28710c'} Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.784980 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:17.791120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.791120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:17.791120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:17.791120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:17.791120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:17.791120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:17.791120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. Oct 27 09:04:17.791120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:17.792857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] Returning 404 to user: Instance d008a476-b957-43e1-a895-4c894f28710c could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:17.794676 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-87df4426-e8e5-482f-bb9c-af2b1540bd0c tempest-ServersWithSpecificFlavorTestJSON-599571695 tempest-ServersWithSpecificFlavorTestJSON-599571695-project] 10.222.0.25 "GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c" status: 404 len: 111 microversion: 2.1 time: 0.064693 Oct 27 09:04:17.799235 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 560/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:17 2022] GET /compute/v2.1/servers/d008a476-b957-43e1-a895-4c894f28710c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:17.828860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:17.829540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:17.839179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.839637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.840089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:17.840807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:17.841271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:17.841702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:18.535852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:18.552253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:18.554608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:18.557559 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0ffaf51-5be9-4799-a818-ac1c2de73f7b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1892 microversion: 2.32 time: 0.732669 Oct 27 09:04:18.563807 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 544/1104] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:17 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1892 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:18.592957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:18.593565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:18.608745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:18.609480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:18.613681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:18.614681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:18.615325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:18.615940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:18.975989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:18.985963 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9284cc06-9b8f-48d2-b0ba-b64d697b1925 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 0.396124 Oct 27 09:04:18.998661 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 561/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:18 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:19.591981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:19.592794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:19.602292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:19.605173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:19.607417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:19.614763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:19.615510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:19.616242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:20.058490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:20.086336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1738017581", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "9eef8a1a-d727-4fc9-8d90-b364a5843ffd"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:20.093121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:20.101254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:20.103727 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0febde4c-2aca-4412-bb0d-5d514c9030e8 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1892 microversion: 2.32 time: 0.515486 Oct 27 09:04:20.104939 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 545/1106] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:19 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1892 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:20.124939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:20.126579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:20.139107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:20.140315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:20.141030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:20.142335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:20.143235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:20.144016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:20.195844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] validate_networks() for [('9eef8a1a-d727-4fc9-8d90-b364a5843ffd', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:04:21.784510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:21.799276 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff5afb07-5d79-4f86-b8d2-fd1acbb92954 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 1.692322 Oct 27 09:04:21.801033 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 546/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:20 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:21.807796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:21.808811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:21.817771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:21.818576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:21.819317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:21.821265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:21.822022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:21.822854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:22.699503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:22.749531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:04:22.754844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:04:22.755759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:04:22.756626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:04:22.757207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:04:22.798236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:22.798734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:22.799174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:22.802987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:22.803482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:22.804158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:22.805630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:22.811489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:22.818437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b55f23b-cc4c-46d7-b9f4-70c3a111331b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1892 microversion: 2.32 time: 1.014300 Oct 27 09:04:22.824661 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 547/1108] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:21 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1892 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:22.843049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-93502ba2-a8f4-415c-a44c-e757d9981545 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:22.845283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-93502ba2-a8f4-415c-a44c-e757d9981545 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:22.867942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Getting quotas for project 525959f0023641e6ade5c949a1d7a7b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:04:22.872807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93502ba2-a8f4-415c-a44c-e757d9981545 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:22.873716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93502ba2-a8f4-415c-a44c-e757d9981545 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:22.875683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93502ba2-a8f4-415c-a44c-e757d9981545 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:22.879365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93502ba2-a8f4-415c-a44c-e757d9981545 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:22.881685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93502ba2-a8f4-415c-a44c-e757d9981545 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:22.882418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93502ba2-a8f4-415c-a44c-e757d9981545 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:22.882776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Getting quotas for user f45f1abf2cfe4d65bba598a764d0ff24 and project 525959f0023641e6ade5c949a1d7a7b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:04:22.917635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:04:22.919977 n-d-858383-16 devstack@n-api.service[120602]: WARNING nova.utils [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1738017581 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-173801758 Oct 27 09:04:22.920903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:04:23.042526 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4536c2dc-1356-40d9-a156-e87bf717a8fe tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.137906 Oct 27 09:04:23.043850 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 562/1109] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:04:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:04:23.056282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:23.056968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:23.074993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:23.075497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:23.075974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:23.076692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:23.077150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:23.077574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:24.030898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:24.049024 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de56fd07-e984-4e0b-93ab-9ec033fd1a45 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 1.003886 Oct 27 09:04:24.050867 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-93502ba2-a8f4-415c-a44c-e757d9981545 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1861 microversion: 2.1 time: 1.224730 Oct 27 09:04:24.058221 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 563/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:23 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:24.074266 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 548/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:22 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1861 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:24.086657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:24.088562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:24.101405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:24.101911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:24.118171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:24.118583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:24.122306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:24.127119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:24.127638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:24.128300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:24.128429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:24.129023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:24.130150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:24.144136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:24.156418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:24.157163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:24.950274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:24.958120 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a2831f05-bf54-4f17-8fbd-1e293aa83296 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1228 microversion: 2.1 time: 0.884924 Oct 27 09:04:24.958701 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 564/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:24 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1228 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:24.975706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-16", "block_migration": true, "disk_over_commit": false}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:24.981125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:24.999666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:25.000418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:25.001049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:25.001956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:25.002576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:25.003175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:25.114040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lazy-loading 'flavor' on Instance uuid 45b64fc7-dd59-4a29-b395-8f8e8990cabb {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:04:25.127286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Going to try to live migrate instance to n-h1-858383-16 {{(pid=120602) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:04:25.467420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:25.486261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:25.490646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:25.492754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:25.494226 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-edec3887-51b9-4bf3-a986-d9ee885df6be tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1892 microversion: 2.32 time: 1.413805 Oct 27 09:04:25.494949 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 549/1113] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:24 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1892 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:25.503508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:25.516570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:25.535903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:25.536901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:25.537633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:25.538645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:25.539372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:25.540061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:26.006686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:26.015344 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0345e9b-23cc-4f9b-b381-52a08b5e02de tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 0.519063 Oct 27 09:04:26.017376 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 550/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:25 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:26.035495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-56e01938-f351-419b-bc3e-e4fab27fc5a2 req-f437435a-5775-4d22-bfac-e065039cbb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a988a0df-4f91-4497-a599-e7e19c636ac7", "name": "network-vif-plugged", "status": "completed", "tag": "b5279136-9006-4596-a97a-bc6367ac28b6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:26.057580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56e01938-f351-419b-bc3e-e4fab27fc5a2 req-f437435a-5775-4d22-bfac-e065039cbb45 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:26.058552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56e01938-f351-419b-bc3e-e4fab27fc5a2 req-f437435a-5775-4d22-bfac-e065039cbb45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:26.061081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56e01938-f351-419b-bc3e-e4fab27fc5a2 req-f437435a-5775-4d22-bfac-e065039cbb45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:26.092762 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-56e01938-f351-419b-bc3e-e4fab27fc5a2 req-f437435a-5775-4d22-bfac-e065039cbb45 service nova] Creating event network-vif-plugged:b5279136-9006-4596-a97a-bc6367ac28b6 for instance a988a0df-4f91-4497-a599-e7e19c636ac7 on n-h1-858383-16 Oct 27 09:04:26.103716 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-56e01938-f351-419b-bc3e-e4fab27fc5a2 req-f437435a-5775-4d22-bfac-e065039cbb45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083345 Oct 27 09:04:26.105671 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 551/1115] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:26.135151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:26.140221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:26.157926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:26.162474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:26.166778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:26.167756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:26.169194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:26.169803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:26.426105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:26.436026 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b56ae69-f772-426e-9f00-19d6dd991df9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1290 microversion: 2.1 time: 0.328813 Oct 27 09:04:26.448858 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 552/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:26 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1290 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:26.519781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:26.521119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:26.527715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:26.528221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:26.528647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:26.529352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:26.529809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:26.530237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:26.771916 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3208c81a-5681-4891-95fe-ba89fdffda1b tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/action" status: 202 len: 0 microversion: 2.1 time: 1.808264 Oct 27 09:04:26.773622 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 565/1117] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:04:24 2022] POST /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/action => generated 0 bytes in 1811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:26.786062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:26.787435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:26.799171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:26.800336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:26.801445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:26.802443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:26.803212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:26.805196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:27.152602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:27.165379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:27.176422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:27.178314 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-838ddcd9-83b2-4967-aabf-918efa782563 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1892 microversion: 2.32 time: 0.662542 Oct 27 09:04:27.182406 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 553/1118] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:26 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1892 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:04:27.193931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:27.194620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:27.211292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:27.211827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:27.212265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:27.213132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:27.213597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:27.218476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:27.932156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:27.943182 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dd42a5fd-fbab-45e4-ac81-718390491a71 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 1.164678 Oct 27 09:04:27.946716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 566/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:26 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:27.958487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:27.959904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:27.977562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:27.978064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:27.978496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:27.979213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:27.979696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:27.980112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:28.423929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:28.435108 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8adccbe4-eeee-415e-ab56-f77bd199df34 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1290 microversion: 2.1 time: 0.487608 Oct 27 09:04:28.447086 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 567/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:27 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1290 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:28.453325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:28.456078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:28.471711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:28.473166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:28.473631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:28.475134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:28.475944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:28.478831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:28.479838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:28.499342 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1583637c-c207-4611-85df-f1a7394fe84b tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1313 microversion: 2.1 time: 1.313447 Oct 27 09:04:28.501331 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 554/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:27 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1313 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:28.621841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-209655678", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7723893b-55e8-45c9-89a4-5a83f117f085"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:28.745319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] validate_networks() for [('7723893b-55e8-45c9-89a4-5a83f117f085', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:04:29.430477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:29.441734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:29.443727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:29.445167 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-17f491fb-ed01-4b22-a0d1-cda8938075b0 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1892 microversion: 2.32 time: 0.996037 Oct 27 09:04:29.446611 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 568/1122] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:28 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1892 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:29.469668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:29.470579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:29.481473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:29.484463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:29.488134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:29.489180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:29.489818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:29.490414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:30.113664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:30.134145 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8bbec9e8-bbd0-4166-9256-f792d990d695 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.681404 Oct 27 09:04:30.137234 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 569/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:29 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:30.161431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:30.162522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:30.173629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:30.174125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:30.174561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:30.175262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:30.175756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:30.176167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:30.435976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:04:30.437383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:04:30.438679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:04:30.439253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:04:30.439674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:04:30.470579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:30.472607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:30.476651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:30.479988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:30.480876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:30.481833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:30.527691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:30.536433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Getting quotas for project b56f0bc62eab4b3382c1e77fa2b1a90b. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:04:30.546253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Getting quotas for user b557eb3af44d47479a280ed67b80ffca and project b56f0bc62eab4b3382c1e77fa2b1a90b. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:04:30.570816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:04:30.573934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:04:30.589994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:30.599615 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9dd6b5a6-2fa8-4e4b-9bed-dcea24393aeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 0.460779 Oct 27 09:04:30.619064 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 570/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:30 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:30.637386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:30.641611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:30.662971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:30.663544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:30.665337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:30.666303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:30.668105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:30.669140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:30.710840 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe62f555-d9e6-420a-bb57-63674cb2e680 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.208221 Oct 27 09:04:30.712196 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 555/1125] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:04:30.737290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:30.738420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:30.745240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:30.746474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:30.747107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:30.747993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:30.748755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:30.776110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:32.068197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:32.084110 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5482168a-3985-4514-813d-eecbd623e16f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1463 microversion: 2.1 time: 1.461540 Oct 27 09:04:32.100478 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 571/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:30 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1463 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:32.123188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:32.126915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:32.151915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:32.152626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:32.153248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:32.156784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:32.157430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:32.158033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:32.345530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:32.366794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:32.373532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:32.375766 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f4d16e6a-bd72-455b-a1bb-7b676bcfb940 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 1.661445 Oct 27 09:04:32.383222 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 556/1127] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:30 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:32.403633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:32.406567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:32.429788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:32.430512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:32.431147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:32.432076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:32.432858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:32.443089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:32.553969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:32.572747 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4bc03388-d89a-41fb-8e27-4cfc35164874 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1279 microversion: 2.1 time: 0.469257 Oct 27 09:04:32.574538 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 572/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:32 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1279 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:32.599930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:32.606067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:32.628365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:32.643703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:32.647165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:32.649284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:32.651117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:32.652528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:32.720243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:32.835324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:32.901977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:33.459041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:33.472270 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0b1f2fb-5002-4825-aeb7-70803df12d78 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 1.087621 Oct 27 09:04:33.473118 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 557/1129] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:32 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:33.480783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36bbfe70-aa2f-4890-b105-eda6e53e891b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:33.481696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36bbfe70-aa2f-4890-b105-eda6e53e891b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:33.504342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36bbfe70-aa2f-4890-b105-eda6e53e891b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:33.505144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36bbfe70-aa2f-4890-b105-eda6e53e891b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:33.505758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36bbfe70-aa2f-4890-b105-eda6e53e891b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:33.506652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36bbfe70-aa2f-4890-b105-eda6e53e891b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:33.507273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36bbfe70-aa2f-4890-b105-eda6e53e891b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:33.507898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36bbfe70-aa2f-4890-b105-eda6e53e891b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:33.574949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:33.594601 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3abade1c-377c-4312-86cd-de5f723595fc tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 1.013392 Oct 27 09:04:33.595254 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 573/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:32 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:33.624507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:33.625162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:33.627077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:33.644405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:33.645181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:33.645795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:33.646684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:33.647302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:33.647929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:34.202344 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36bbfe70-aa2f-4890-b105-eda6e53e891b tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1616 microversion: 2.1 time: 0.727996 Oct 27 09:04:34.202938 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 558/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:33 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1616 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:34.208181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:34.208791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:34.232934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:34.233439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:34.233874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:34.237512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:34.237996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:34.238428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:34.471839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:34.488967 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c37240c2-28e9-4246-919c-e65b5af6ecaa tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1285 microversion: 2.1 time: 0.284361 Oct 27 09:04:34.498116 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 559/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:34 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1285 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:34.508622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:34.511001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:34.520718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:34.524279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:34.524785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:34.530526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:34.531673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:34.532174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:34.532622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:34.543280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:34.546176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:34.549342 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9623c19-7415-4388-aa90-d4031da51283 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.928697 Oct 27 09:04:34.560975 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 574/1133] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:33 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:34.577220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:34.579122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:34.587226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:34.588017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:34.588706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:34.589568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:34.590186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:34.590788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:34.606687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '53a12c42039245cb8f56db798254e016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a94c8f1728143db9c22f3995a036a73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:34.617136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] flavor_id is None. Assuming migration. {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 27 09:04:34.620233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 09:04:35.002168 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f29dc7f-aab4-4662-b0bd-7ceae776d388 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7/action" status: 202 len: 0 microversion: 2.1 time: 0.499336 Oct 27 09:04:35.007143 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 560/1134] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:04:34 2022] POST /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:35.013643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:35.014560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:35.023860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:35.024971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:35.025625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:35.026765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:35.027858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:35.028700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:35.191963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:35.213767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2398de76-06f0-4aef-a6d3-9b1735c8b6e1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.651232 Oct 27 09:04:35.227623 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 575/1135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:34 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:35.227623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:35.229087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:35.239881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:35.240908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:35.241515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:35.244225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:35.244797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:35.245205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:35.621502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:35.635721 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d476fb7c-2879-4aa7-a83d-30762c17abfb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 0.626036 Oct 27 09:04:35.639063 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 561/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:35 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:35.646106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5edf1e79-2491-446b-9c1a-1a6c0d4a9764 req-74305c71-19b0-4000-aa3a-00cee2cb6504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e35128-7782-4862-8089-4849310d455c", "tag": "8f227eb9-17d1-4c08-9f33-d566033baac2"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:35.659960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5edf1e79-2491-446b-9c1a-1a6c0d4a9764 req-74305c71-19b0-4000-aa3a-00cee2cb6504 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:35.660905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5edf1e79-2491-446b-9c1a-1a6c0d4a9764 req-74305c71-19b0-4000-aa3a-00cee2cb6504 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:35.661612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5edf1e79-2491-446b-9c1a-1a6c0d4a9764 req-74305c71-19b0-4000-aa3a-00cee2cb6504 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:35.683829 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5edf1e79-2491-446b-9c1a-1a6c0d4a9764 req-74305c71-19b0-4000-aa3a-00cee2cb6504 service nova] Creating event network-changed:8f227eb9-17d1-4c08-9f33-d566033baac2 for instance d4e35128-7782-4862-8089-4849310d455c on n-h2-858383-16 Oct 27 09:04:35.693860 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5edf1e79-2491-446b-9c1a-1a6c0d4a9764 req-74305c71-19b0-4000-aa3a-00cee2cb6504 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052734 Oct 27 09:04:35.694872 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 562/1137] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:35.701364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:35.702292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:35.710196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:35.710924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:35.711671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:35.712695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:35.713442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:35.714086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:35.895698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:35.919375 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a8867a2-89da-4882-89e8-d862b9c84ae5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1472 microversion: 2.1 time: 0.701357 Oct 27 09:04:35.920145 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 576/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:35 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1472 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:35.935292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:35.938135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:35.956674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:35.959008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:35.963021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:35.964011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:35.965520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:35.966253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:36.531770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:36.540154 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9cd5e287-5d64-45fb-aa28-7f1354991d89 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.843850 Oct 27 09:04:36.546270 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 563/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:35 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:36.556431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:36.558494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:36.570214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:36.574031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:36.574614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:36.576244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:36.579477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:36.580068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:37.277118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:37.286918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:37.288488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:37.289769 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e110319-a6a1-42b3-b62b-dcbedd6c3c14 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 1.368286 Oct 27 09:04:37.290394 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 577/1140] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:35 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:37.295506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:37.296388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:37.302518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:37.303337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:37.304388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:37.305282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:37.305732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:37.306152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:37.513420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:37.527628 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-09c0409d-bfce-4a1c-9f97-633097e43173 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.978923 Oct 27 09:04:37.528130 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 564/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:36 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:37.534119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:37.535148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:37.542486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:37.543222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:37.543857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:37.544716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:37.545449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:37.546033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:37.736127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:37.746384 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84ed1250-cbe4-45ce-a01a-edffc832805c tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 0.454631 Oct 27 09:04:37.763427 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 578/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:37 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:37.773978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:37.774597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:37.782256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:37.783063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:37.784170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:37.785132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:37.785829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:37.786534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:37.911733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:37.926411 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4489dd3a-b852-410d-ba89-9af5a5d9f64d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1472 microversion: 2.1 time: 0.396835 Oct 27 09:04:37.928098 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 565/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:37 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:38.057690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:38.066789 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e65212c5-a914-4a61-b5cf-0694c5893746 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.299617 Oct 27 09:04:38.068222 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 579/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:37 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:38.331839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:38.332484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:38.339392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:38.339911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:38.340729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:38.341434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:38.342085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:38.342507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:38.485185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-30acde0f-eb00-47cd-b905-161e8b25db38 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-60447528", "id": 685496959, "os-flavor-access:is_public": "False"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:38.508153 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-30acde0f-eb00-47cd-b905-161e8b25db38 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.196247 Oct 27 09:04:38.508841 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 566/1145] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:04:38 2022] POST /compute/v2.1/flavors => generated 426 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:38.529341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5a1dd90-9ca5-4ce3-adde-6409d3560b7a tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8914bdf5668a48a8aaf4d4997244829f"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:38.621163 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5a1dd90-9ca5-4ce3-adde-6409d3560b7a tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/685496959/action" status: 200 len: 96 microversion: 2.1 time: 0.101650 Oct 27 09:04:38.622118 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 567/1146] 10.222.0.25 () {60 vars in 1197 bytes} [Thu Oct 27 09:04:38 2022] POST /compute/v2.1/flavors/685496959/action => generated 96 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:04:38.626879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:38.627479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:38.633456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:38.633937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:38.634370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:38.636080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:38.636080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:38.636080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:38.670187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:38.691664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:38.694262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:38.696359 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-36362d96-51f8-4832-8ab4-24370e6655cf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.370971 Oct 27 09:04:38.697233 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 580/1147] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:38 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:04:38.704758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7d5f1f90-bf0a-4883-a763-3c6031b14bfe req-4d755750-2429-415c-a83c-68a5cfb37b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87f82e6-50b6-4479-a799-c880d5782c8f", "tag": "5d20c40b-f5b8-4d89-bad8-054558dcbcde"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:38.715661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7d5f1f90-bf0a-4883-a763-3c6031b14bfe req-4d755750-2429-415c-a83c-68a5cfb37b0c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:38.716150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7d5f1f90-bf0a-4883-a763-3c6031b14bfe req-4d755750-2429-415c-a83c-68a5cfb37b0c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:38.716631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7d5f1f90-bf0a-4883-a763-3c6031b14bfe req-4d755750-2429-415c-a83c-68a5cfb37b0c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:38.728806 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7d5f1f90-bf0a-4883-a763-3c6031b14bfe req-4d755750-2429-415c-a83c-68a5cfb37b0c service nova] Creating event network-changed:5d20c40b-f5b8-4d89-bad8-054558dcbcde for instance a87f82e6-50b6-4479-a799-c880d5782c8f on n-h1-858383-16 Oct 27 09:04:38.733660 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7d5f1f90-bf0a-4883-a763-3c6031b14bfe req-4d755750-2429-415c-a83c-68a5cfb37b0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034908 Oct 27 09:04:38.734821 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 581/1148] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:38.781578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:38.783907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:38.791196 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5be89371-4cfe-4c62-ae2f-62a86efb178d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.168102 Oct 27 09:04:38.792022 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 568/1149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:38 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:38.810088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:38.810991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:38.818868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:38.819590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:38.820033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:38.820730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:38.821180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:38.821598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:38.860500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-377f4345-5677-44bc-b21e-67e778d9d535 tempest-FlavorsAccessTestJSON-1353651780 tempest-FlavorsAccessTestJSON-1353651780-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:38.913421 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-377f4345-5677-44bc-b21e-67e778d9d535 tempest-FlavorsAccessTestJSON-1353651780 tempest-FlavorsAccessTestJSON-1353651780-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5407 microversion: 2.1 time: 0.177301 Oct 27 09:04:38.914468 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 582/1150] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:38 2022] GET /compute/v2.1/flavors/detail => generated 5407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:38.933031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3dd3ce8-dd51-444a-bff7-16300b1c2011 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8914bdf5668a48a8aaf4d4997244829f"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:39.011128 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e3dd3ce8-dd51-444a-bff7-16300b1c2011 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/685496959/action" status: 200 len: 21 microversion: 2.1 time: 0.082070 Oct 27 09:04:39.012580 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 583/1151] 10.222.0.25 () {60 vars in 1197 bytes} [Thu Oct 27 09:04:38 2022] POST /compute/v2.1/flavors/685496959/action => generated 21 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:04:39.018222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.019256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:39.026543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:39.027432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:39.028256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:39.029217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:39.029900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:39.030596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:39.288259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:39.296151 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bac4689a-e02f-449d-bd15-b276fd77f8e9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 0.502954 Oct 27 09:04:39.296886 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 569/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:38 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:39.301851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab5a4a59-7f39-4bf8-8eaa-3f3b72b48039 tempest-FlavorsAccessTestJSON-1353651780 tempest-FlavorsAccessTestJSON-1353651780-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.338750 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab5a4a59-7f39-4bf8-8eaa-3f3b72b48039 tempest-FlavorsAccessTestJSON-1353651780 tempest-FlavorsAccessTestJSON-1353651780-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040323 Oct 27 09:04:39.339620 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 570/1153] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:39.350433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.351327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:39.358841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:39.359773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:39.360622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:39.361543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:39.362160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:39.362589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:39.523937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:39.534231 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c5ef9bca-3e86-42a7-9ce8-02bb81ec8536 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1472 microversion: 2.1 time: 0.520326 Oct 27 09:04:39.548328 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 584/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:39 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:39.554828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82c3ba36-b274-4bb2-ad20-8e47eff7e8e1 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.572030 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82c3ba36-b274-4bb2-ad20-8e47eff7e8e1 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/685496959" status: 202 len: 0 microversion: 2.1 time: 0.022360 Oct 27 09:04:39.575797 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 585/1155] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 09:04:39 2022] DELETE /compute/v2.1/flavors/685496959 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:39.580925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e4c203d-7e57-496f-a008-4fc350a43091 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.601375 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9e4c203d-7e57-496f-a008-4fc350a43091 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024474 Oct 27 09:04:39.601961 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 586/1156] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:39.622141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1717749-089b-43e0-8dba-e4e7f8d3f3c3 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1432901494", "id": 888260855, "os-flavor-access:is_public": "False"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:39.641587 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1717749-089b-43e0-8dba-e4e7f8d3f3c3 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.023985 Oct 27 09:04:39.642160 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 587/1157] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:04:39 2022] POST /compute/v2.1/flavors => generated 428 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:39.654474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ad4b1551-1200-4037-973f-6449a0ed0bdc tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.666855 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ad4b1551-1200-4037-973f-6449a0ed0bdc tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/888260855/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.015978 Oct 27 09:04:39.667421 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 588/1158] 10.222.0.25 () {58 vars in 1206 bytes} [Thu Oct 27 09:04:39 2022] GET /compute/v2.1/flavors/888260855/os-flavor-access => generated 21 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:04:39.676661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27a92495-a46f-453f-81d2-cdbf661def59 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.695630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27a92495-a46f-453f-81d2-cdbf661def59 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/888260855" status: 202 len: 0 microversion: 2.1 time: 0.022174 Oct 27 09:04:39.696194 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 589/1159] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 09:04:39 2022] DELETE /compute/v2.1/flavors/888260855 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:04:39.704923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ec31c0a8-bdf3-4474-8d4c-f3a3466f05d0 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.714691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:39.725460 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc9a043c-6bf6-4a56-b73a-2553f9a4fbff tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.384297 Oct 27 09:04:39.727376 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ec31c0a8-bdf3-4474-8d4c-f3a3466f05d0 tempest-FlavorsAccessTestJSON-1881189801 tempest-FlavorsAccessTestJSON-1881189801-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025952 Oct 27 09:04:39.727993 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 590/1160] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:39.736260 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 571/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:39 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:39.741970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.744716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:39.751761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:39.752268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:39.752713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:39.753420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:39.753883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:39.754313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:39.816068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:39.817108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:39.823400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:39.823989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:39.824648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:39.825567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:39.827101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:39.827101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:40.299005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:40.309353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:40.311801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:40.314012 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c8b1140-7a33-416b-a0d5-d8d57bd80077 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.585017 Oct 27 09:04:40.314531 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 591/1162] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:39 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:40.318751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:40.332413 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f123c28-2182-4575-af08-f681b9d0acbf tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.520069 Oct 27 09:04:40.333272 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 572/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:39 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:40.346051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:40.350980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:40.357183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:40.357673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:40.358111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:40.358816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:40.359968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:40.360573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:40.564734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:40.565716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:40.571906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:40.572739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:40.577102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:40.578302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:40.578893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:40.579834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:40.580477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:40.581210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:41.082253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:41.090983 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ef7a187-217a-4a73-ada0-4b5a6f5433d1 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 0.772435 Oct 27 09:04:41.091743 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 592/1164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:40 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:41.097023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:41.097788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:41.104064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:41.113173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:41.114800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:41.117536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:41.117927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:41.118359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:41.536719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:41.542098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:41.547426 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-707508e6-53fb-43f4-8f85-9488d9f230e6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.992434 Oct 27 09:04:41.553739 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e6586fe3-c161-4c4d-bcac-2538e0b5797d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.460148 Oct 27 09:04:41.554819 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 593/1165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:41 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:41.556463 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 573/1166] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:40 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:41.560231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:41.561081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:41.562533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:41.563150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:41.570409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:41.570934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:41.571675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:41.574939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:41.575101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:41.575526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:41.576051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:41.576765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:41.577215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:41.577631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:41.581795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:41.582316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:41.916495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:41.928606 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ce56564-58f8-4f6b-921a-018109740106 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.368504 Oct 27 09:04:41.928606 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 574/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:41 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:41.937884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:41.948951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:41.950884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:41.953429 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6520e622-4755-49b1-af39-70c6cbcae41f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.396306 Oct 27 09:04:41.953429 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 594/1168] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:41 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:42.120073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:42.120807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:42.127280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.128015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.128246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:42.128938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.129376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.129795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:42.262895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:42.271124 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fca0a84b-6942-425d-bc4c-bdeeba1cb87e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 0.156604 Oct 27 09:04:42.271867 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 575/1169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:42 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:42.575725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:42.576367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:42.579999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:42.580688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:42.583909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.584402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.584829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:42.585520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.586029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.586377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:42.587304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.587884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.588390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:42.589096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.589554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.589980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:42.734432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:42.742470 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92b361aa-9f45-4ab8-a171-092cd0378db3 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.166993 Oct 27 09:04:42.743275 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 576/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:42 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:42.952074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:42.953586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:42.956614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:42.961103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.961595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.962060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:42.962956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.963600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.964032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:42.968169 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5075c23a-0aad-4c58-9adf-cdea28fc42ea tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.396101 Oct 27 09:04:42.969483 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 595/1171] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:42 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:42.978011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:42.978011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:42.984085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.984647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.985096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:42.985789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:42.986250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:42.986677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:43.228127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:43.238086 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-775408ed-8f3a-4dd4-830f-780c0ff7c007 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.291819 Oct 27 09:04:43.239011 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 577/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:42 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:43.252337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:43.262504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:43.264078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:43.267100 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a26e7cda-3b8a-4912-aa2d-6ffff10d5f4c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.292283 Oct 27 09:04:43.268340 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 596/1173] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:42 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:04:43.293756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:43.294389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:43.300380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:43.300862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:43.301287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:43.301971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:43.302419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:43.302841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:43.430031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df7d0231-b6e3-49ed-84f4-6a229a310748 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1696386288", "id": 321613488, "os-flavor-access:is_public": "False"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:43.445673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:43.449260 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df7d0231-b6e3-49ed-84f4-6a229a310748 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.208890 Oct 27 09:04:43.449887 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 578/1174] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:04:43 2022] POST /compute/v2.1/flavors => generated 436 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:43.453590 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3065de89-3e34-4e67-bd5b-a5da49ec02ce tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 0.163723 Oct 27 09:04:43.454152 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 597/1175] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:43 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:43.465280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab6df3b7-f7ed-4473-a9cd-70bd1dc17445 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:43.531623 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab6df3b7-f7ed-4473-a9cd-70bd1dc17445 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/321613488/action" status: 200 len: 96 microversion: 2.1 time: 0.069745 Oct 27 09:04:43.532307 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 579/1176] 10.222.0.25 () {60 vars in 1197 bytes} [Thu Oct 27 09:04:43 2022] POST /compute/v2.1/flavors/321613488/action => generated 96 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:04:43.542672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0e381c9-164e-4702-a012-c466734fa080 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:43.610730 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c0e381c9-164e-4702-a012-c466734fa080 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 585478e6e56f4b07a71bd4321524d95a combination. Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0e381c9-164e-4702-a012-c466734fa080 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Request method failure captured: Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/flavors/321613488/action HTTP/1.1 Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 67 Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkmqlCvRBgAu0WG7a8pNAY7SSJxNDcLp1_wHj-QfiEnwpJzSObJN3iCuoPCMEfNV6l6iJusMt13HxexWEwWhbQszLTS1fq3NRHLTpAQ32eirXvqn6PchwP507Mdnimuw3FL_OgwA2JnXtzVKR-FxdjB6iVNlgh2fs_5EHv6fxDmiCQ8 Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: ac41688cebe540c0b887ebb0cc00cb1f Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-908013203 Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac41688cebe540c0b887ebb0cc00cb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac41688cebe540c0b887ebb0cc00cb1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac41688cebe540c0b887ebb0cc00cb1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac41688cebe540c0b887ebb0cc00cb1f"}]}] Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-908013203 Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: ac41688cebe540c0b887ebb0cc00cb1f Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-908013203 Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c1610b96263440f3bfdbf9d6acd2323d Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: {"addTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: exception: Flavor access already exists for flavor 35 and project 585478e6e56f4b07a71bd4321524d95a combination. Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '321613488', 'body': {'addTenantAccess': {'tenant': '585478e6e56f4b07a71bd4321524d95a'}}} Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result.read() Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-585478e6e56f4b07a71bd4321524d95a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.615177 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi session.flush() Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result.read() Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:04:43.620629 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-585478e6e56f4b07a71bd4321524d95a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 27, 9, 4, 43, 606165), 'updated_at': None, 'flavor_id': 35, 'project_id': '585478e6e56f4b07a71bd4321524d95a'}] Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project 585478e6e56f4b07a71bd4321524d95a combination. Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project 585478e6e56f4b07a71bd4321524d95a combination. Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project 585478e6e56f4b07a71bd4321524d95a combination. Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0e381c9-164e-4702-a012-c466734fa080 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 585478e6e56f4b07a71bd4321524d95a combination. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:43.625639 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0e381c9-164e-4702-a012-c466734fa080 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/321613488/action" status: 409 len: 152 microversion: 2.1 time: 0.077723 Oct 27 09:04:43.629885 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 598/1177] 10.222.0.25 () {60 vars in 1197 bytes} [Thu Oct 27 09:04:43 2022] POST /compute/v2.1/flavors/321613488/action => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:04:43.629996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2acfdd46-cdc6-4612-9b79-ddfd458ed4fa tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:43.706068 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2acfdd46-cdc6-4612-9b79-ddfd458ed4fa tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/321613488/action" status: 200 len: 21 microversion: 2.1 time: 0.081604 Oct 27 09:04:43.706661 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 580/1178] 10.222.0.25 () {60 vars in 1197 bytes} [Thu Oct 27 09:04:43 2022] POST /compute/v2.1/flavors/321613488/action => generated 21 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:04:43.716741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3ae3b2d-df7a-492c-9336-da57e417682f tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:43.736154 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c3ae3b2d-df7a-492c-9336-da57e417682f tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/321613488" status: 202 len: 0 microversion: 2.1 time: 0.023135 Oct 27 09:04:43.736825 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 599/1179] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 09:04:43 2022] DELETE /compute/v2.1/flavors/321613488 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:04:43.745297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b850618c-61f2-4925-b2ba-8c8c5e1cddfd tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:43.764626 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b850618c-61f2-4925-b2ba-8c8c5e1cddfd tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023283 Oct 27 09:04:43.765438 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 581/1180] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:43.767292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:43.767930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:43.774007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:43.774489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:43.774928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:43.775647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:43.776103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:43.776523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:43.784538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f44124c5-0488-4d78-b11f-7fd70762b526 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1474213890", "id": 1537544616, "os-flavor-access:is_public": "True"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:43.802922 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f44124c5-0488-4d78-b11f-7fd70762b526 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022470 Oct 27 09:04:43.803515 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 582/1181] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:04:43 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:43.815272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73551593-c51b-4d52-b25b-5784c45a9515 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:43.821982 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-73551593-c51b-4d52-b25b-5784c45a9515 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73551593-c51b-4d52-b25b-5784c45a9515 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Request method failure captured: Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/flavors/1537544616/os-flavor-access HTTP/1.1 Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkmqlCvRBgAu0WG7a8pNAY7SSJxNDcLp1_wHj-QfiEnwpJzSObJN3iCuoPCMEfNV6l6iJusMt13HxexWEwWhbQszLTS1fq3NRHLTpAQ32eirXvqn6PchwP507Mdnimuw3FL_OgwA2JnXtzVKR-FxdjB6iVNlgh2fs_5EHv6fxDmiCQ8 Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: ac41688cebe540c0b887ebb0cc00cb1f Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-908013203 Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac41688cebe540c0b887ebb0cc00cb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac41688cebe540c0b887ebb0cc00cb1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac41688cebe540c0b887ebb0cc00cb1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac41688cebe540c0b887ebb0cc00cb1f"}]}] Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-908013203 Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: ac41688cebe540c0b887ebb0cc00cb1f Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-908013203 Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c1610b96263440f3bfdbf9d6acd2323d Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: exception: Access list not available for public flavors. Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'flavor_id': '1537544616'} Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 27 09:04:43.823597 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:43.829548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73551593-c51b-4d52-b25b-5784c45a9515 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:43.829548 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73551593-c51b-4d52-b25b-5784c45a9515 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1537544616/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.013277 Oct 27 09:04:43.829548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 583/1182] 10.222.0.25 () {58 vars in 1209 bytes} [Thu Oct 27 09:04:43 2022] GET /compute/v2.1/flavors/1537544616/os-flavor-access => generated 91 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:04:43.833386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efadda7c-9df0-4b40-8877-5c02ccf2bd13 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:43.852495 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efadda7c-9df0-4b40-8877-5c02ccf2bd13 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1537544616" status: 202 len: 0 microversion: 2.1 time: 0.022576 Oct 27 09:04:43.853250 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 584/1183] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 09:04:43 2022] DELETE /compute/v2.1/flavors/1537544616 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:04:43.861558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5086442f-7be1-4cc2-bb1b-9809f347b6d2 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:43.882018 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5086442f-7be1-4cc2-bb1b-9809f347b6d2 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024734 Oct 27 09:04:43.882590 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 585/1184] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:43.901133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ac687bd-afce-4594-ba83-c861a52518ed tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1677325237", "id": 1336699346, "os-flavor-access:is_public": "False"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:43.914624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:43.919092 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ac687bd-afce-4594-ba83-c861a52518ed tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.021562 Oct 27 09:04:43.919768 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 586/1185] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:04:43 2022] POST /compute/v2.1/flavors => generated 439 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:43.920646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:43.925138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:43.930770 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ec11df31-0afc-4e5b-ac1b-0104fc86e45e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.167371 Oct 27 09:04:43.931606 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 600/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:43 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:43.992509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:43.993351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:43.999606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.000287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.000465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.001121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.001571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.001989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.038547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b59c53d-e5f9-461f-bfc7-97cbbdc87b1f tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:44.044176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5b59c53d-e5f9-461f-bfc7-97cbbdc87b1f tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '4d26f4c3048b4e3a98ce84944d152d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585478e6e56f4b07a71bd4321524d95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b59c53d-e5f9-461f-bfc7-97cbbdc87b1f tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] Request method failure captured: Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/flavors/1336699346/action HTTP/1.1 Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 67 Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkmqstCvmaWhDPDA6-G1LfipctKl4qPqjU404q1MuX68td9-vgCnOyV8ML06h9aGfuYQ5hGf_v-0G1S-1U0AKDuazTsqum4mS-b0YBlkVupPr8Q7TwxoaYHwX9wNYJX4Wmx0xvbgkZ8i47sRMIMD9oPhu833bnflqoxFVgYfybOdYeo Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 585478e6e56f4b07a71bd4321524d95a Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-563419469 Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/585478e6e56f4b07a71bd4321524d95a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_585478e6e56f4b07a71bd4321524d95a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/585478e6e56f4b07a71bd4321524d95a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/585478e6e56f4b07a71bd4321524d95a"}]}] Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-563419469 Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 585478e6e56f4b07a71bd4321524d95a Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-563419469 Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FlavorsAccessNegativeTestJSON-563419469-project Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 4d26f4c3048b4e3a98ce84944d152d3c Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-563419469-project Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: {"addTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '1336699346', 'body': {'addTenantAccess': {'tenant': '585478e6e56f4b07a71bd4321524d95a'}}} Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:04:44.047873 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b59c53d-e5f9-461f-bfc7-97cbbdc87b1f tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b59c53d-e5f9-461f-bfc7-97cbbdc87b1f tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] 10.222.0.25 "POST /compute/v2.1/flavors/1336699346/action" status: 403 len: 130 microversion: 2.1 time: 0.121536 Oct 27 09:04:44.054695 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 587/1187] 10.222.0.25 () {60 vars in 1200 bytes} [Thu Oct 27 09:04:43 2022] POST /compute/v2.1/flavors/1336699346/action => generated 130 bytes in 123 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:04:44.062287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59c7648c-613e-43ff-a46c-595793fce65a tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:44.081259 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59c7648c-613e-43ff-a46c-595793fce65a tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1336699346" status: 202 len: 0 microversion: 2.1 time: 0.025199 Oct 27 09:04:44.082530 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 588/1188] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 09:04:44 2022] DELETE /compute/v2.1/flavors/1336699346 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:44.091399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b82c9a3-08ef-4e59-b3f9-b489339002e4 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:44.112955 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b82c9a3-08ef-4e59-b3f9-b489339002e4 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025080 Oct 27 09:04:44.113542 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 589/1189] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:44.132535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-632e23df-7e43-44c9-b36f-665bd055f4e1 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-130405081", "id": 1935493843, "os-flavor-access:is_public": "False"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:44.150982 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-632e23df-7e43-44c9-b36f-665bd055f4e1 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021997 Oct 27 09:04:44.151588 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 590/1190] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:04:44 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:44.164064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-695f7159-bf18-4667-8eb1-aefc1bf1646f tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:44.196974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:44.206142 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2da7507b-9eb7-4d48-9488-66be22d78e17 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.218278 Oct 27 09:04:44.207147 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 601/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:43 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:44.238223 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-695f7159-bf18-4667-8eb1-aefc1bf1646f tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1935493843/action" status: 200 len: 97 microversion: 2.1 time: 0.077735 Oct 27 09:04:44.239051 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 591/1192] 10.222.0.25 () {60 vars in 1200 bytes} [Thu Oct 27 09:04:44 2022] POST /compute/v2.1/flavors/1935493843/action => generated 97 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:04:44.249246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5baf0914-5203-4f07-952f-b22f2c78e72a tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:44.253086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5baf0914-5203-4f07-952f-b22f2c78e72a tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '4d26f4c3048b4e3a98ce84944d152d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585478e6e56f4b07a71bd4321524d95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5baf0914-5203-4f07-952f-b22f2c78e72a tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] Request method failure captured: Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/flavors/1935493843/action HTTP/1.1 Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 70 Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkmqstCvmaWhDPDA6-G1LfipctKl4qPqjU404q1MuX68td9-vgCnOyV8ML06h9aGfuYQ5hGf_v-0G1S-1U0AKDuazTsqum4mS-b0YBlkVupPr8Q7TwxoaYHwX9wNYJX4Wmx0xvbgkZ8i47sRMIMD9oPhu833bnflqoxFVgYfybOdYeo Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 585478e6e56f4b07a71bd4321524d95a Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-563419469 Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/585478e6e56f4b07a71bd4321524d95a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_585478e6e56f4b07a71bd4321524d95a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/585478e6e56f4b07a71bd4321524d95a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/585478e6e56f4b07a71bd4321524d95a"}]}] Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-563419469 Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 585478e6e56f4b07a71bd4321524d95a Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-563419469 Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FlavorsAccessNegativeTestJSON-563419469-project Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4d26f4c3048b4e3a98ce84944d152d3c Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-563419469-project Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: {"removeTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '1935493843', 'body': {'removeTenantAccess': {'tenant': '585478e6e56f4b07a71bd4321524d95a'}}} Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can( Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 09:04:44.254656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5baf0914-5203-4f07-952f-b22f2c78e72a tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5baf0914-5203-4f07-952f-b22f2c78e72a tempest-FlavorsAccessNegativeTestJSON-563419469 tempest-FlavorsAccessNegativeTestJSON-563419469-project] 10.222.0.25 "POST /compute/v2.1/flavors/1935493843/action" status: 403 len: 133 microversion: 2.1 time: 0.010637 Oct 27 09:04:44.262664 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 602/1193] 10.222.0.25 () {60 vars in 1200 bytes} [Thu Oct 27 09:04:44 2022] POST /compute/v2.1/flavors/1935493843/action => generated 133 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:44.269513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57b0628e-01c3-4604-ae64-75f61908e846 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "585478e6e56f4b07a71bd4321524d95a"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:44.270284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:44.271089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:44.279751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.280558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.281899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.283075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.283962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.284714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.385013 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57b0628e-01c3-4604-ae64-75f61908e846 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1935493843/action" status: 200 len: 21 microversion: 2.1 time: 0.119282 Oct 27 09:04:44.386106 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 603/1194] 10.222.0.25 () {60 vars in 1200 bytes} [Thu Oct 27 09:04:44 2022] POST /compute/v2.1/flavors/1935493843/action => generated 21 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:04:44.395208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:44.396381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:44.406673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.407544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.408367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.409599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.410584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.411352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.553169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:44.569272 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f95d563-f555-496a-a3ef-c09c6e847518 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.303424 Oct 27 09:04:44.570281 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 592/1195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:44 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:44.578905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82913e50-114c-4c7a-9e5c-2333bf97714e tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:44.607771 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82913e50-114c-4c7a-9e5c-2333bf97714e tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1935493843" status: 202 len: 0 microversion: 2.1 time: 0.035475 Oct 27 09:04:44.608783 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 593/1196] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 09:04:44 2022] DELETE /compute/v2.1/flavors/1935493843 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:44.618292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:44.619368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:44.629599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.630452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.631241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.632571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.633375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.634143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.763294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:44.778633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:44.781208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:44.782778 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-855abf33-aa60-4e05-b535-04ee9f8c931d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.395038 Oct 27 09:04:44.783955 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 604/1197] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:44 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:44.788660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4f394f3-b039-4857-abc8-2e9a9e5ab9a0 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:44.809612 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c4f394f3-b039-4857-abc8-2e9a9e5ab9a0 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024155 Oct 27 09:04:44.823036 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 605/1198] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:44.835709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa3dfe00-0943-44d7-acae-b0793677da9a tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1571867114", "id": 1576527636, "os-flavor-access:is_public": "False"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:44.837009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:44.846881 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d67e9ed-d5cd-492f-9db1-c9c492fc8ac5 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 0.235738 Oct 27 09:04:44.847700 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 594/1199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:44 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:44.866800 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aa3dfe00-0943-44d7-acae-b0793677da9a tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.037871 Oct 27 09:04:44.867531 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 606/1200] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:04:44 2022] POST /compute/v2.1/flavors => generated 439 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:44.881451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cbce33c4-7f42-4598-9503-17ed530ab076 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9e44890f915d4ef7aa23443b60ebbfa3"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:44.962037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:44.963439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:44.977759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.978837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.980150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.981771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:44.982790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:44.983768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:44.994484 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cbce33c4-7f42-4598-9503-17ed530ab076 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] HTTP exception thrown: Flavor access not found for 39 / 9e44890f915d4ef7aa23443b60ebbfa3 combination. Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cbce33c4-7f42-4598-9503-17ed530ab076 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Request method failure captured: Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/flavors/1576527636/action HTTP/1.1 Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 70 Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkmqlCvRBgAu0WG7a8pNAY7SSJxNDcLp1_wHj-QfiEnwpJzSObJN3iCuoPCMEfNV6l6iJusMt13HxexWEwWhbQszLTS1fq3NRHLTpAQ32eirXvqn6PchwP507Mdnimuw3FL_OgwA2JnXtzVKR-FxdjB6iVNlgh2fs_5EHv6fxDmiCQ8 Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: ac41688cebe540c0b887ebb0cc00cb1f Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-908013203 Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac41688cebe540c0b887ebb0cc00cb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac41688cebe540c0b887ebb0cc00cb1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac41688cebe540c0b887ebb0cc00cb1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac41688cebe540c0b887ebb0cc00cb1f"}]}] Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-908013203 Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: ac41688cebe540c0b887ebb0cc00cb1f Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-908013203 Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c1610b96263440f3bfdbf9d6acd2323d Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: {"removeTenantAccess": {"tenant": "9e44890f915d4ef7aa23443b60ebbfa3"}} Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: exception: Flavor access not found for 39 / 9e44890f915d4ef7aa23443b60ebbfa3 combination. Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '1576527636', 'body': {'removeTenantAccess': {'tenant': '9e44890f915d4ef7aa23443b60ebbfa3'}}} Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 9e44890f915d4ef7aa23443b60ebbfa3 combination. Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:44.996886 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 9e44890f915d4ef7aa23443b60ebbfa3 combination. Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 9e44890f915d4ef7aa23443b60ebbfa3 combination. Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cbce33c4-7f42-4598-9503-17ed530ab076 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Returning 404 to user: Flavor access not found for 39 / 9e44890f915d4ef7aa23443b60ebbfa3 combination. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cbce33c4-7f42-4598-9503-17ed530ab076 tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1576527636/action" status: 404 len: 124 microversion: 2.1 time: 0.122366 Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 595/1201] 10.222.0.25 () {60 vars in 1200 bytes} [Thu Oct 27 09:04:44 2022] POST /compute/v2.1/flavors/1576527636/action => generated 124 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:45.011913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5963f568-e81e-4568-865c-dcdf1b708b1b tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:45.034613 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5963f568-e81e-4568-865c-dcdf1b708b1b tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1576527636" status: 202 len: 0 microversion: 2.1 time: 0.029156 Oct 27 09:04:45.035504 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 596/1202] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 09:04:45 2022] DELETE /compute/v2.1/flavors/1576527636 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:45.046633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-56a3cc08-0222-4267-a083-f8f0094ba86e req-a1137b40-aed2-4504-8611-946513b5896a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e35128-7782-4862-8089-4849310d455c", "name": "network-vif-plugged", "status": "completed", "tag": "8f227eb9-17d1-4c08-9f33-d566033baac2"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:45.059118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56a3cc08-0222-4267-a083-f8f0094ba86e req-a1137b40-aed2-4504-8611-946513b5896a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:45.059843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56a3cc08-0222-4267-a083-f8f0094ba86e req-a1137b40-aed2-4504-8611-946513b5896a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:45.060267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56a3cc08-0222-4267-a083-f8f0094ba86e req-a1137b40-aed2-4504-8611-946513b5896a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:45.072108 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-56a3cc08-0222-4267-a083-f8f0094ba86e req-a1137b40-aed2-4504-8611-946513b5896a service nova] Creating event network-vif-plugged:8f227eb9-17d1-4c08-9f33-d566033baac2 for instance d4e35128-7782-4862-8089-4849310d455c on n-h2-858383-16 Oct 27 09:04:45.078363 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-56a3cc08-0222-4267-a083-f8f0094ba86e req-a1137b40-aed2-4504-8611-946513b5896a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038149 Oct 27 09:04:45.079188 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 597/1203] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:45.084131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9dad7c6c-ca6e-495a-9ba9-83b664bc64bc tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:45.111417 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9dad7c6c-ca6e-495a-9ba9-83b664bc64bc tempest-FlavorsAccessNegativeTestJSON-908013203 tempest-FlavorsAccessNegativeTestJSON-908013203-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030930 Oct 27 09:04:45.127742 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 598/1204] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:45.255811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:45.272035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:45.273654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:45.285051 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18760fad-5331-4cb9-b381-cb0a84239ac4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.331466 Oct 27 09:04:45.286782 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 607/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:44 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:45.298232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:45.299070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:45.299861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:45.303250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:45.304346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:45.305104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:45.597266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:45.598707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:45.613799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:45.614694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:45.615265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:45.615940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:45.616410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:45.616842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:45.624271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:45.633845 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85fe1426-0ac7-44af-8a16-d2212c4d5d95 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.392137 Oct 27 09:04:45.634494 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 599/1206] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:45 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:45.760634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:45.770350 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9135b132-a358-40ae-a05e-89a95fdd38d8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.180614 Oct 27 09:04:45.771404 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 608/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:45 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:45.823985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:45.824956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:45.830882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:45.831327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:45.831798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:45.832487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:45.832941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:45.833361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:45.869515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:45.870389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:45.873262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=11,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:45.881032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:45.881559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:45.881998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:45.882699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:45.883152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:45.883623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:46.196676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:46.201294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:46.207870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:46.210223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:46.210372 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d94d41c5-c736-44d5-84de-3450ff785983 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1332 microversion: 2.1 time: 0.344486 Oct 27 09:04:46.211181 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 609/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:45 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1332 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:04:46.212742 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82d9ed55-2792-463a-8e51-e39a2d044ef4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.392664 Oct 27 09:04:46.213666 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 600/1209] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:45 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:46.310327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:46.310968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:46.317347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:46.318034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:46.318474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:46.319166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:46.319648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:46.320074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:46.476726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:46.485891 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66b0a75a-14f5-4e74-9403-fec0699ee2ab tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.179358 Oct 27 09:04:46.486464 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 610/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:46 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:46.656011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:46.656573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:46.663921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:46.664481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:46.665067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:46.665789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:46.666266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:46.666669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:46.794741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:46.796182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:46.804443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:46.805369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:46.805931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:46.806635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:46.807089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:46.807505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:46.808820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:46.817363 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3fab3cf-64c6-4207-a3cc-2ff9d346e20b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.165416 Oct 27 09:04:46.817902 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 601/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:46 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:46.949415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:46.958305 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3ad77eeb-6dfb-4c65-9ed9-0d421401c7e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.167947 Oct 27 09:04:46.974420 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 611/1212] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:46 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:47.232141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:47.232743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:47.239827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:47.240443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:47.247248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:47.247796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:47.248453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:47.249190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:47.249836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:47.250453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:47.250881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:47.251399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:47.251919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:47.253719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:47.255074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:47.255689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:47.511919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:47.518183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:47.520230 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50971670-f0c4-4ffb-8a09-410a5d4c59bd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1537 microversion: 2.1 time: 0.291887 Oct 27 09:04:47.520987 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 602/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:47 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1537 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:47.528311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:47.532606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:47.534325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:47.535120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:47.539642 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bbdc9fa7-11bf-4b39-9457-7f22214e2380 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.303365 Oct 27 09:04:47.540429 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 612/1214] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:47 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:47.545997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:47.546558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:47.546999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:47.550384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4c822e8-3b57-4434-9eac-ac4a21e909ff tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Action: 'create', calling method: .version_select at 0x7f31aa5079d0>, body: {"pool": "7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83"} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:47.557331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:47.557815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:47.558247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:47.958626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:47.968702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b1574f7-659b-4274-bc11-9c8a807f1b23 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.446034 Oct 27 09:04:47.969403 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 603/1215] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:47 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:47.979211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-70df5686-2161-41ea-a546-2fbe894daa69 req-34ed6aab-9b83-4965-8d79-267a82fe0e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87f82e6-50b6-4479-a799-c880d5782c8f", "name": "network-vif-plugged", "status": "completed", "tag": "5d20c40b-f5b8-4d89-bad8-054558dcbcde"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:47.992512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-70df5686-2161-41ea-a546-2fbe894daa69 req-34ed6aab-9b83-4965-8d79-267a82fe0e35 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:47.993171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-70df5686-2161-41ea-a546-2fbe894daa69 req-34ed6aab-9b83-4965-8d79-267a82fe0e35 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:47.993982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-70df5686-2161-41ea-a546-2fbe894daa69 req-34ed6aab-9b83-4965-8d79-267a82fe0e35 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:48.007130 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-70df5686-2161-41ea-a546-2fbe894daa69 req-34ed6aab-9b83-4965-8d79-267a82fe0e35 service nova] Creating event network-vif-plugged:5d20c40b-f5b8-4d89-bad8-054558dcbcde for instance a87f82e6-50b6-4479-a799-c880d5782c8f on n-h1-858383-16 Oct 27 09:04:48.012268 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-70df5686-2161-41ea-a546-2fbe894daa69 req-34ed6aab-9b83-4965-8d79-267a82fe0e35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041167 Oct 27 09:04:48.013025 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 604/1216] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:48.018541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:48.019326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:48.025843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:48.026547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:48.027344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:48.028254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:48.028869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:48.029442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:48.676557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:48.680740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:48.693221 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-190d6312-317e-40f3-813d-f6300e8db399 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.678428 Oct 27 09:04:48.695457 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 605/1217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:48 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:48.701065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:48.701948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:48.710783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:48.711493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:48.712760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:48.714978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:48.715859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:48.716488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:49.149631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:49.158611 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8a950f7a-335f-4ed9-b475-5e974a9077e8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.461707 Oct 27 09:04:49.159184 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 606/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:48 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:49.163660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:49.164416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:49.170420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:49.170929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:49.171478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:49.172247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:49.172664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:49.173101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:49.540735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:49.550928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:49.552603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:49.554231 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-28196659-4e18-419a-ab2c-aa7a04082faf tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.393838 Oct 27 09:04:49.555091 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 607/1219] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:49 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:49.685714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c22942cf-df1d-4363-b97a-0a572625cbfb tempest-FlavorsV255TestJSON-633419683 tempest-FlavorsV255TestJSON-633419683-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-73338700", "id": 1776554029, "os-flavor-access:is_public": "True"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:49.713351 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c22942cf-df1d-4363-b97a-0a572625cbfb tempest-FlavorsV255TestJSON-633419683 tempest-FlavorsV255TestJSON-633419683-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 447 microversion: 2.55 time: 0.156510 Oct 27 09:04:49.719771 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 608/1220] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:04:49 2022] POST /compute/v2.1/flavors => generated 447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:04:49.726152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1e618873-1d9d-41d7-92f4-fd06611f918b req-b995630c-b1c0-4c6f-aac3-c883dba8571d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b64fc7-dd59-4a29-b395-8f8e8990cabb", "name": "network-vif-unplugged", "status": "completed", "tag": "bbc5a442-ff28-4a74-95b8-7e5a6187b536"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:49.739983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1e618873-1d9d-41d7-92f4-fd06611f918b req-b995630c-b1c0-4c6f-aac3-c883dba8571d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:49.740996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1e618873-1d9d-41d7-92f4-fd06611f918b req-b995630c-b1c0-4c6f-aac3-c883dba8571d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:49.741765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1e618873-1d9d-41d7-92f4-fd06611f918b req-b995630c-b1c0-4c6f-aac3-c883dba8571d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:49.756548 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1e618873-1d9d-41d7-92f4-fd06611f918b req-b995630c-b1c0-4c6f-aac3-c883dba8571d service nova] Creating event network-vif-unplugged:bbc5a442-ff28-4a74-95b8-7e5a6187b536 for instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb on n-h2-858383-16 Oct 27 09:04:49.761885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1e618873-1d9d-41d7-92f4-fd06611f918b req-b995630c-b1c0-4c6f-aac3-c883dba8571d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039904 Oct 27 09:04:49.762787 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 609/1221] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:49.770164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:49.772263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:49.778879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:49.779607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:49.780230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:49.781360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:49.782092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:49.782777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:50.034346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:50.045114 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-899ec2f0-3149-47d8-98b8-0c119b0bfb76 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.280362 Oct 27 09:04:50.058349 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 610/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:49 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:50.065340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:50.065958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:50.071915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:50.072617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:50.073227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:50.074113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:50.074734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:50.075326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:50.353940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:50.362192 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c8dc57c-f5cc-4c18-a34c-71cd009c2e24 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1327 microversion: 2.1 time: 0.301070 Oct 27 09:04:50.362762 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 611/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:50 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1327 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:50.424624 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d4c822e8-3b57-4434-9eac-ac4a21e909ff tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.882968 Oct 27 09:04:50.425310 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 613/1224] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:04:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:50.430825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:50.431514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:50.439408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:50.440068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:50.440440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:50.441148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:50.441783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:50.442367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:50.479786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44033e83-3e43-4442-92d8-72915465014e tempest-FlavorsV255TestJSON-1970440638 tempest-FlavorsV255TestJSON-1970440638-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:50.487899 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44033e83-3e43-4442-92d8-72915465014e tempest-FlavorsV255TestJSON-1970440638 tempest-FlavorsV255TestJSON-1970440638-project] 10.222.0.25 "GET /compute/v2.1/flavors/1776554029" status: 200 len: 447 microversion: 2.55 time: 0.124152 Oct 27 09:04:50.488458 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 612/1225] 10.222.0.25 () {60 vars in 1199 bytes} [Thu Oct 27 09:04:50 2022] GET /compute/v2.1/flavors/1776554029 => generated 447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:04:50.501320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Action: 'action', calling method: .version_select at 0x7f31ac9d8dc0>, body: {"addFloatingIp": {"address": "172.25.6.138"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:50.503777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:50.510872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:50.511352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:50.511831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:50.512519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:50.512969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:50.513391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:50.583898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:04:50.584365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquired lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:04:50.595718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:50.606145 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bfe3accb-1d11-496b-affa-b80217ff0b16 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.179317 Oct 27 09:04:50.606969 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 614/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:50 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:50.615462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-acdcd4b5-031f-4f5c-9e94-565b55c75c74 tempest-FlavorsV255TestJSON-633419683 tempest-FlavorsV255TestJSON-633419683-project-admin] Action: 'update', calling method: .version_select at 0x7f31ac16cb80>, body: {"flavor": {"description": "new"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:50.656094 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-acdcd4b5-031f-4f5c-9e94-565b55c75c74 tempest-FlavorsV255TestJSON-633419683 tempest-FlavorsV255TestJSON-633419683-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1776554029" status: 200 len: 448 microversion: 2.55 time: 0.047443 Oct 27 09:04:50.657103 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 615/1227] 10.222.0.25 () {62 vars in 1219 bytes} [Thu Oct 27 09:04:50 2022] PUT /compute/v2.1/flavors/1776554029 => generated 448 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:04:50.661987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:50.662849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:50.675220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:50.675854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:50.676367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:50.677152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:50.677687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:50.678185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:51.005458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:51.015844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:51.017273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:51.018425 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a7f16df1-4605-41b2-9493-1054f66d3ea5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.360194 Oct 27 09:04:51.018976 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 616/1228] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:50 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:51.023662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dbaf2c44-908b-4a80-9efc-f0abe59eeb89 tempest-FlavorsV255TestJSON-1970440638 tempest-FlavorsV255TestJSON-1970440638-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:51.044949 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dbaf2c44-908b-4a80-9efc-f0abe59eeb89 tempest-FlavorsV255TestJSON-1970440638 tempest-FlavorsV255TestJSON-1970440638-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5723 microversion: 2.55 time: 0.024957 Oct 27 09:04:51.045517 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 617/1229] 10.222.0.25 () {60 vars in 1187 bytes} [Thu Oct 27 09:04:51 2022] GET /compute/v2.1/flavors/detail => generated 5723 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:51.069171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46ca37d0-c129-4c57-930f-8f1093a738f2 tempest-FlavorsV255TestJSON-1970440638 tempest-FlavorsV255TestJSON-1970440638-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:51.096402 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46ca37d0-c129-4c57-930f-8f1093a738f2 tempest-FlavorsV255TestJSON-1970440638 tempest-FlavorsV255TestJSON-1970440638-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3155 microversion: 2.55 time: 0.032348 Oct 27 09:04:51.097297 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 618/1230] 10.222.0.25 () {60 vars in 1166 bytes} [Thu Oct 27 09:04:51 2022] GET /compute/v2.1/flavors => generated 3155 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:04:51.104080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:51.104948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:51.111111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:51.111810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:51.112236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:51.112859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:51.113315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:51.113871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:51.350353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:51.359858 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de77f356-e82a-431d-9052-6aeaf428d1c9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.260166 Oct 27 09:04:51.360631 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 619/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:51 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:51.366073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-580655cc-583d-4b37-8346-4cbd4df8d0c4 tempest-FlavorsV255TestJSON-633419683 tempest-FlavorsV255TestJSON-633419683-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:51.389645 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-580655cc-583d-4b37-8346-4cbd4df8d0c4 tempest-FlavorsV255TestJSON-633419683 tempest-FlavorsV255TestJSON-633419683-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1776554029" status: 202 len: 0 microversion: 2.55 time: 0.027714 Oct 27 09:04:51.390910 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 620/1232] 10.222.0.25 () {60 vars in 1202 bytes} [Thu Oct 27 09:04:51 2022] DELETE /compute/v2.1/flavors/1776554029 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:04:51.396066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:51.396677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:51.402412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:51.402903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:51.403344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:51.404080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:51.404536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:51.404962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:51.632366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:51.640445 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c5b1eb2d-75fb-4697-9fa2-a1c1278e725c tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1526 microversion: 2.1 time: 0.248176 Oct 27 09:04:51.641139 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 621/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:51 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1526 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:51.645733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eedddc62-7b9c-4026-ae9b-f753e6ad9dfe tempest-FlavorsV255TestJSON-633419683 tempest-FlavorsV255TestJSON-633419683-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:51.665307 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eedddc62-7b9c-4026-ae9b-f753e6ad9dfe tempest-FlavorsV255TestJSON-633419683 tempest-FlavorsV255TestJSON-633419683-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.023040 Oct 27 09:04:51.665891 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 622/1234] 10.222.0.25 () {60 vars in 1187 bytes} [Thu Oct 27 09:04:51 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:51.670536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:51.671667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:51.677538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:51.678029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:51.678471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:51.679429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:51.680424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:51.680424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:51.902527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:51.911317 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83bfa777-6214-4fab-8bf5-437ee382ccc2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.244381 Oct 27 09:04:51.912232 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 623/1235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:51 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:51.916884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:51.917448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:51.923836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:51.924307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:51.924739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:51.925543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:51.925939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:51.926360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:52.446426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:52.455092 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10fcb8bc-dec2-4f15-9de9-c85847c419ac tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1526 microversion: 2.1 time: 0.541918 Oct 27 09:04:52.456412 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 624/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:51 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1526 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:52.461026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2db03ffd-d310-4397-8c26-be77e889d11e req-cdc3647b-86b2-4675-99ed-c2eacd91a824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b64fc7-dd59-4a29-b395-8f8e8990cabb", "tag": "bbc5a442-ff28-4a74-95b8-7e5a6187b536"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:52.468685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Building network info cache for instance {{(pid=120603) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:04:52.471132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2db03ffd-d310-4397-8c26-be77e889d11e req-cdc3647b-86b2-4675-99ed-c2eacd91a824 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:52.471780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2db03ffd-d310-4397-8c26-be77e889d11e req-cdc3647b-86b2-4675-99ed-c2eacd91a824 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:52.472321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2db03ffd-d310-4397-8c26-be77e889d11e req-cdc3647b-86b2-4675-99ed-c2eacd91a824 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:52.485875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2db03ffd-d310-4397-8c26-be77e889d11e req-cdc3647b-86b2-4675-99ed-c2eacd91a824 service nova] Creating event network-changed:bbc5a442-ff28-4a74-95b8-7e5a6187b536 for instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb on n-h2-858383-16 Oct 27 09:04:52.491510 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2db03ffd-d310-4397-8c26-be77e889d11e req-cdc3647b-86b2-4675-99ed-c2eacd91a824 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033835 Oct 27 09:04:52.492596 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 625/1237] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:52.498188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:52.499117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:52.506269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:52.507093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:52.507760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:52.508617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:52.509223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:52.509864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:52.975064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:52.989028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:52.990989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:52.993018 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9a443ee-e58f-484b-b773-06b2d3a01eeb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.498402 Oct 27 09:04:53.007605 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 626/1238] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:52 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:53.011652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:53.011652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:53.021494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:53.022322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:53.022425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:53.023813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:53.023813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:53.024052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:53.572088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:53.582158 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-609cb0e4-2883-4d8f-a9bd-01db2700a939 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.577856 Oct 27 09:04:53.603439 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 627/1239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:52 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:53.688158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Updating instance_info_cache with network_info: [{"id": "8f227eb9-17d1-4c08-9f33-d566033baac2", "address": "fa:16:3e:08:32:80", "network": {"id": "9eef8a1a-d727-4fc9-8d90-b364a5843ffd", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1727078278-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "525959f0023641e6ade5c949a1d7a7b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8f227eb9-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120603) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:04:53.707597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Releasing lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:04:53.708708 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88b4159b-b149-42d7-8f6d-2046c0e08bd0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action" status: 202 len: 0 microversion: 2.1 time: 3.211254 Oct 27 09:04:53.709420 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 613/1240] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:04:50 2022] POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action => generated 0 bytes in 3220 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 09:04:53.718348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:53.721438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:53.729048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:53.730335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:53.730771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:53.731470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:53.731958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:53.732535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:53.982777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:54.001758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:54.002315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:54.002475 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d77ca69-cd1a-4ae1-a360-8e12a32566d7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.291721 Oct 27 09:04:54.012401 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 614/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:53 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:54.017319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:54.018104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:54.020099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:54.021213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:54.022772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:54.023410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:54.031851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2d6f56f5-bbf7-48e7-9c54-5114cbe36044 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Action: 'create', calling method: .version_select at 0x7f31aa1aee50>, body: {"pool": "7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83"} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:54.043132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:54.044481 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] HTTP exception thrown: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Request method failure captured: Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f HTTP/1.1 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkmbdCPNA4iRZh10K05rPAyJfHk5qAd87qrvlqNZsnMi1pasWSDB9J-Ip_HnB3U1_c1RvRnp9irv7ejTXD5uytJ3hcBaBfP0uABTP9a09CtCm7tlPQ1rgB0pDO5vboEW4fUrb88KC3xVp2OL5W63bWD14aUzyuwYIUIv_u1X7RQF4Qs Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 310b63b4f50d46bcbcd22e05ff395084 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1486401862 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/310b63b4f50d46bcbcd22e05ff395084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_310b63b4f50d46bcbcd22e05ff395084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/310b63b4f50d46bcbcd22e05ff395084"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/310b63b4f50d46bcbcd22e05ff395084"}]}] Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1486401862 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 310b63b4f50d46bcbcd22e05ff395084 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1486401862 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1486401862-project Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 17d5a6c5292746258afe0252dd44dc63 Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1486401862-project Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'a87f82e6-50b6-4479-a799-c880d5782c8f'} Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:04:54.047018 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Returning 404 to user: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-091aeafe-6eac-4281-90b5-034f3500f3cf tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 404 len: 111 microversion: 2.1 time: 0.444146 Oct 27 09:04:54.054436 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 628/1242] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:04:53 2022] DELETE /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 111 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:54.059956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:54.060803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:54.072937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:54.073738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:54.074886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:54.075887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:54.076565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:54.077421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:54.376652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:54.386379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:54.387837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:54.388985 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a67a6d5c-9361-4d34-a91c-e1b8b42768ac tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.338519 Oct 27 09:04:54.390100 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 629/1243] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:54 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:54.405142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:54.406720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:54.413190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:54.413749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:54.414351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:54.415332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:54.415786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:54.416209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:54.642126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:54.650049 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72dd66b2-6b01-4579-bfc0-fa055da399db tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1526 microversion: 2.1 time: 0.258687 Oct 27 09:04:54.650648 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 630/1244] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:54 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:54.656090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d99c9bb1-b0d1-4ecd-8006-363b1e5fd61f req-557f3abf-3f80-414f-85c6-5ee2eced96ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e35128-7782-4862-8089-4849310d455c", "tag": "8f227eb9-17d1-4c08-9f33-d566033baac2"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:54.665852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d99c9bb1-b0d1-4ecd-8006-363b1e5fd61f req-557f3abf-3f80-414f-85c6-5ee2eced96ab service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:54.666648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d99c9bb1-b0d1-4ecd-8006-363b1e5fd61f req-557f3abf-3f80-414f-85c6-5ee2eced96ab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:54.667247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d99c9bb1-b0d1-4ecd-8006-363b1e5fd61f req-557f3abf-3f80-414f-85c6-5ee2eced96ab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:54.680084 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d99c9bb1-b0d1-4ecd-8006-363b1e5fd61f req-557f3abf-3f80-414f-85c6-5ee2eced96ab service nova] Creating event network-changed:8f227eb9-17d1-4c08-9f33-d566033baac2 for instance d4e35128-7782-4862-8089-4849310d455c on n-h2-858383-16 Oct 27 09:04:54.685789 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d99c9bb1-b0d1-4ecd-8006-363b1e5fd61f req-557f3abf-3f80-414f-85c6-5ee2eced96ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033579 Oct 27 09:04:54.686839 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 631/1245] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:54.692819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:54.693766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:54.701307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:54.701943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:54.703090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:54.704583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:54.705450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:54.705882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:54.998140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:55.007023 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-521a574f-1140-4645-b4bd-f1f22308d17f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.318533 Oct 27 09:04:55.007852 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 632/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:54 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:55.012195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Action: 'update', calling method: >, body: {"server": {"name": "a87f82e6-50b6-4479-a799-c880d5782c8f_new"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:55.014571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:55.021170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.021836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.023968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.024857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.025312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.025739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.039329 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] HTTP exception thrown: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Request method failure captured: Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f HTTP/1.1 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 64 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkmbdCPNA4iRZh10K05rPAyJfHk5qAd87qrvlqNZsnMi1pasWSDB9J-Ip_HnB3U1_c1RvRnp9irv7ejTXD5uytJ3hcBaBfP0uABTP9a09CtCm7tlPQ1rgB0pDO5vboEW4fUrb88KC3xVp2OL5W63bWD14aUzyuwYIUIv_u1X7RQF4Qs Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 310b63b4f50d46bcbcd22e05ff395084 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1486401862 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/310b63b4f50d46bcbcd22e05ff395084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_310b63b4f50d46bcbcd22e05ff395084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/310b63b4f50d46bcbcd22e05ff395084"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/310b63b4f50d46bcbcd22e05ff395084"}]}] Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1486401862 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 310b63b4f50d46bcbcd22e05ff395084 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1486401862 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1486401862-project Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 17d5a6c5292746258afe0252dd44dc63 Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1486401862-project Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "a87f82e6-50b6-4479-a799-c880d5782c8f_new"}} Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'a87f82e6-50b6-4479-a799-c880d5782c8f', 'body': {'server': {'name': 'a87f82e6-50b6-4479-a799-c880d5782c8f_new'}}} Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:04:55.041165 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] Returning 404 to user: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:55.046014 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed54ac36-9f3a-483f-9820-8d536fd2a2fb tempest-ServersNegativeTestMultiTenantJSON-1486401862 tempest-ServersNegativeTestMultiTenantJSON-1486401862-project] 10.222.0.25 "PUT /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 404 len: 111 microversion: 2.1 time: 0.034007 Oct 27 09:04:55.047535 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 633/1247] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 09:04:55 2022] PUT /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:04:55.184657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Calling method '.version_select at 0x7f31aa3bee50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:55.186944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.187435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.187891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.204940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.205419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.205852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.216143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.216619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.217052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.222821 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ebe63fa8-5916-44f6-91bf-e60d781fb9e3 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.174143 Oct 27 09:04:55.223382 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 634/1248] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:55.227802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:55.229673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:55.235034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.235517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.235975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.236677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.237131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.237562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.528996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:55.537744 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e419639-25d3-4edc-9260-18941165e2c7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.313322 Oct 27 09:04:55.538320 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 635/1249] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:55 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:55.542809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:55.543528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:55.550546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.551035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.551460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.552449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.553108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.553531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.580005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:04:55.658021 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-714a2fb0-b90f-411b-a843-8559f87181c1 tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 204 len: 0 microversion: 2.1 time: 0.118462 Oct 27 09:04:55.658664 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 636/1250] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:04:55 2022] DELETE /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:04:55.663840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Calling method '.version_select at 0x7f31aa535f70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:55.665907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.666469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.667025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.681750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.682253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.682682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.693451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.693931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.694391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.700547 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2d1772b1-156f-4830-91d0-03d1f5aa908c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.040712 Oct 27 09:04:55.701387 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 637/1251] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Oct 27 09:04:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:55.717270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:55.718645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:55.724850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.725467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.725920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:55.726621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:55.727075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:55.727504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.016988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:56.026179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:56.027724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:56.028870 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85de2a9e-a41c-448d-a550-898af725f34d tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.326572 Oct 27 09:04:56.029429 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 638/1252] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:55 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:56.033872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.034478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:56.040199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.040682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.041117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.041806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.042265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.042809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.138561 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2d6f56f5-bbf7-48e7-9c54-5114cbe36044 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.123733 Oct 27 09:04:56.139331 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 615/1253] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:04:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:56.143781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Calling method '.version_select at 0x7f31aa25a3a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.145659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.146237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.146752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.160806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.161313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.161754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.171991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.172479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.172914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.178628 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a714c805-8f8f-4519-a427-3aefa0966cf9 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.038237 Oct 27 09:04:56.179487 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 616/1254] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:56.184101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.184710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:56.190767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.191255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.191728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.192424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.192886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.193314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.205342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:56.212874 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c22f925-2381-4a9b-b511-31e6f9bf15cc tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1532 microversion: 2.1 time: 0.182490 Oct 27 09:04:56.213440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 639/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1532 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:56.218008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Action: 'action', calling method: .version_select at 0x7f31abfee1f0>, body: {"addFloatingIp": {"address": "172.25.6.213"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:56.220443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:56.226443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.227111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.227735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.228610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.229239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.229850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.297112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:04:56.297511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquired lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:04:56.376626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:56.384361 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc3fc18d-8202-4d04-8733-02a4ea5f8b97 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.203889 Oct 27 09:04:56.384917 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 617/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:56.398681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5367856b-bb61-495a-b25c-ca2814d858fe tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Calling method '.version_select at 0x7f31aa25a550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.398681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5367856b-bb61-495a-b25c-ca2814d858fe tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.398681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5367856b-bb61-495a-b25c-ca2814d858fe tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.398681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5367856b-bb61-495a-b25c-ca2814d858fe tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.407812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5367856b-bb61-495a-b25c-ca2814d858fe tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.408304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5367856b-bb61-495a-b25c-ca2814d858fe tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.408748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5367856b-bb61-495a-b25c-ca2814d858fe tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.415436 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5367856b-bb61-495a-b25c-ca2814d858fe tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.029304 Oct 27 09:04:56.416043 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 618/1257] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:56.431791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1193df86-2f5d-4cc6-bee5-0ecdb69b9468 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Calling method '.version_select at 0x7f31aa13fb80>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.433506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1193df86-2f5d-4cc6-bee5-0ecdb69b9468 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.433993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1193df86-2f5d-4cc6-bee5-0ecdb69b9468 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.434569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1193df86-2f5d-4cc6-bee5-0ecdb69b9468 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.451492 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1193df86-2f5d-4cc6-bee5-0ecdb69b9468 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.023493 Oct 27 09:04:56.452141 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 619/1258] 10.222.0.25 () {58 vars in 1179 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:56.463959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Calling method '.version_select at 0x7f31aa2461f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.465727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.466214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.466654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.481164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.481641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.482074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.493451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.493925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.494358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.500142 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f884a79f-d060-4447-bab7-0b328c9989dd tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.039641 Oct 27 09:04:56.500740 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 620/1259] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:56.510856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9d4eb3b-0565-426e-8681-02871d2e9f6c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Calling method '.version_select at 0x7f31aa13f310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.512636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d4eb3b-0565-426e-8681-02871d2e9f6c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.513110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d4eb3b-0565-426e-8681-02871d2e9f6c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.513540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d4eb3b-0565-426e-8681-02871d2e9f6c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.525569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d4eb3b-0565-426e-8681-02871d2e9f6c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.526042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d4eb3b-0565-426e-8681-02871d2e9f6c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.526476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9d4eb3b-0565-426e-8681-02871d2e9f6c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.533371 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e9d4eb3b-0565-426e-8681-02871d2e9f6c tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.026024 Oct 27 09:04:56.533946 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 621/1260] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:56.548311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66c019de-971c-422e-a170-269b147b8ca5 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Calling method '.version_select at 0x7f31aa12de50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.550070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c019de-971c-422e-a170-269b147b8ca5 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.550547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c019de-971c-422e-a170-269b147b8ca5 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.550995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c019de-971c-422e-a170-269b147b8ca5 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.564407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c019de-971c-422e-a170-269b147b8ca5 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.564895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c019de-971c-422e-a170-269b147b8ca5 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.565337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c019de-971c-422e-a170-269b147b8ca5 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.571648 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66c019de-971c-422e-a170-269b147b8ca5 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.027288 Oct 27 09:04:56.572705 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 622/1261] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:04:56.576627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.577237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:56.583072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.583583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.584029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.584733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.585195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.585758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.748431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.213 (8601a5b4-cae7-4d21-82d9-5edfad7ff093) with port 8f227eb9-17d1-4c08-9f33-d566033baac2 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83.", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:04:56.749053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Releasing lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:04:56.749643 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.213 (8601a5b4-cae7-4d21-82d9-5edfad7ff093) with port 8f227eb9-17d1-4c08-9f33-d566033baac2 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83. Oct 27 09:04:56.749643 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-e7606071-fa58-45d6-8103-d90f8b7a4892'] Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Request method failure captured: Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action HTTP/1.1 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 46 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkmThAYr1_F6whjLzuT1PGxd2w8-ODini54pUAcsBgHwGAw6g-ubGPJBysMjTFUf-Zqere2umwS9yCUUGI2w7WaIXUa35LJPDM5XHkVPxQ79MvtS6-gjN2PxXDB1IuWytoH1T-198t22SxMUv-N4crl7aCyWSfmMHMFVEwfFbS6JVRA Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/525959f0023641e6ade5c949a1d7a7b6"}]}] Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: f45f1abf2cfe4d65bba598a764d0ff24 Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: {"addFloatingIp": {"address": "172.25.6.213"}} Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: exception: Cannot associate floating IP 172.25.6.213 (8601a5b4-cae7-4d21-82d9-5edfad7ff093) with port 8f227eb9-17d1-4c08-9f33-d566033baac2 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83. Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-e7606071-fa58-45d6-8103-d90f8b7a4892'] Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd4e35128-7782-4862-8089-4849310d455c', 'body': {'addFloatingIp': {'address': '172.25.6.213'}}} Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:04:56.752045 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.213 (8601a5b4-cae7-4d21-82d9-5edfad7ff093) with port 8f227eb9-17d1-4c08-9f33-d566033baac2 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83. Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7606071-fa58-45d6-8103-d90f8b7a4892'] Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.213 (8601a5b4-cae7-4d21-82d9-5edfad7ff093) with port 8f227eb9-17d1-4c08-9f33-d566033baac2 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83. Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7606071-fa58-45d6-8103-d90f8b7a4892'] Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.213 (8601a5b4-cae7-4d21-82d9-5edfad7ff093) with port 8f227eb9-17d1-4c08-9f33-d566033baac2 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83. Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7606071-fa58-45d6-8103-d90f8b7a4892'] Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.213 (8601a5b4-cae7-4d21-82d9-5edfad7ff093) with port 8f227eb9-17d1-4c08-9f33-d566033baac2 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83. Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7606071-fa58-45d6-8103-d90f8b7a4892'] Oct 27 09:04:56.757235 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:04:56.760875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Returning 400 to user: Cannot associate floating IP 172.25.6.213 (8601a5b4-cae7-4d21-82d9-5edfad7ff093) with port 8f227eb9-17d1-4c08-9f33-d566033baac2 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83. Oct 27 09:04:56.760875 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-e7606071-fa58-45d6-8103-d90f8b7a4892'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:04:56.760875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5cf3894-06c1-4471-8a33-bafa16aadcee tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action" status: 400 len: 382 microversion: 2.1 time: 0.539093 Oct 27 09:04:56.760875 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 640/1262] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:04:56 2022] POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action => generated 382 bytes in 540 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:04:56.761588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Calling method '.version_select at 0x7f31aa3de550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:56.763340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.763841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.764279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.776625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:56.780814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.781297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.781769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.785288 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c8695df-dc0b-4fb6-a559-6c89a303b8c8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.212124 Oct 27 09:04:56.786009 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 623/1263] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:56.791523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:56.792138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:56.792654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:56.797467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c86e2ffe-51f9-4548-ac6a-33f90b4c6b1f tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '.version_select at 0x7f31aa052700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:57.084955 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8aeb5ef0-b3a3-442c-8227-62c484786506 tempest-HypervisorAdminTestJSON-1007934859 tempest-HypervisorAdminTestJSON-1007934859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.326529 Oct 27 09:04:57.091909 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 641/1264] 10.222.0.25 () {58 vars in 1173 bytes} [Thu Oct 27 09:04:56 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:57.091909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:57.091909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:57.102102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:57.102600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:57.103044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:57.103880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:57.104344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:57.104774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:57.391659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:57.402784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:57.404449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:57.405714 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9128d446-e8ef-4a18-801b-830becc6947c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.318870 Oct 27 09:04:57.406250 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 642/1265] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:57 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:57.410980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:57.411595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:57.418015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:57.418763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:57.419364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:57.420244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:57.420893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:57.421468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:58.099541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:58.117008 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9f018e2-d23c-4dd2-9a8a-99ce7a29282d tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1532 microversion: 2.1 time: 0.709361 Oct 27 09:04:58.117753 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 643/1266] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:57 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1532 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:58.123480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:58.124147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:58.149269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:58.150043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:58.150544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:58.151282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:58.152171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:58.152855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:58.424470 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c86e2ffe-51f9-4548-ac6a-33f90b4c6b1f tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/8601a5b4-cae7-4d21-82d9-5edfad7ff093" status: 202 len: 0 microversion: 2.1 time: 1.630991 Oct 27 09:04:58.430801 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 624/1267] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:04:56 2022] DELETE /compute/v2.1/os-floating-ips/8601a5b4-cae7-4d21-82d9-5edfad7ff093 => generated 0 bytes in 1641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:04:58.434254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:58.435002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:58.443420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:58.444221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:58.444909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:58.445849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:58.446543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:58.447642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:58.528905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:58.542071 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8714f481-ba59-4ba1-a4af-5253d64a6277 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.422982 Oct 27 09:04:58.545184 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 644/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:58 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:58.564543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:58.565933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:58.585411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:58.588011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:58.588961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:58.589732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:58.590244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:58.590669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:58.632902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:58.700545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:58.721666 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ace9b5dc-776f-40bb-bafe-e2ea5077b972 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.292558 Oct 27 09:04:58.722264 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 625/1269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:58 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:58.744224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Action: 'action', calling method: .version_select at 0x7f31ac8d23a0>, body: {"removeFloatingIp": {"address": "172.25.6.138"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:59.179708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:59.181828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=10,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:59.192717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.194153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.194579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:59.196986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:59.198028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.199246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.199869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:59.222525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:59.227149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:59.230211 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae4cee48-e337-44c6-b206-0a8444ac7b26 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.681795 Oct 27 09:04:59.232443 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 645/1270] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:04:58 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:04:59.238044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2ae33cc0-9ac2-4eac-9cf9-f987c4ae0ea2 req-fce56abc-5487-43db-a725-81a83209f02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87f82e6-50b6-4479-a799-c880d5782c8f", "name": "network-vif-deleted", "tag": "5d20c40b-f5b8-4d89-bad8-054558dcbcde"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:04:59.257063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2ae33cc0-9ac2-4eac-9cf9-f987c4ae0ea2 req-fce56abc-5487-43db-a725-81a83209f02e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.258058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2ae33cc0-9ac2-4eac-9cf9-f987c4ae0ea2 req-fce56abc-5487-43db-a725-81a83209f02e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.258722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2ae33cc0-9ac2-4eac-9cf9-f987c4ae0ea2 req-fce56abc-5487-43db-a725-81a83209f02e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:59.284746 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2ae33cc0-9ac2-4eac-9cf9-f987c4ae0ea2 req-fce56abc-5487-43db-a725-81a83209f02e service nova] Creating event network-vif-deleted:5d20c40b-f5b8-4d89-bad8-054558dcbcde for instance a87f82e6-50b6-4479-a799-c880d5782c8f on n-h1-858383-16 Oct 27 09:04:59.311242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2ae33cc0-9ac2-4eac-9cf9-f987c4ae0ea2 req-fce56abc-5487-43db-a725-81a83209f02e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076272 Oct 27 09:04:59.316499 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 646/1271] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:04:59.345511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:59.346947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:59.362495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.365215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.365809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:59.368484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.369070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.369610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:59.435857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.437367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.438166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:59.438798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lazy-loading 'fault' on Instance uuid a87f82e6-50b6-4479-a799-c880d5782c8f {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:04:59.618272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b557eb3af44d47479a280ed67b80ffca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f0bc62eab4b3382c1e77fa2b1a90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:59.627022 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97033eaf-8de5-4bbb-9c01-39b15c3bba7b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 200 len: 1317 microversion: 2.1 time: 0.309154 Oct 27 09:04:59.641735 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 647/1272] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:59 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:59.652251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:59.652877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:59.659319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:04:59.660769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.661727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.662170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:59.663137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.663782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.664356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:59.758221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:04:59.759258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquired lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:04:59.936249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:04:59.948767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c57c044-f00c-430f-a8e2-719bc69715f7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.301373 Oct 27 09:04:59.950444 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 648/1273] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:59 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:04:59.969992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:04:59.970610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:04:59.982760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.984473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.987210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:04:59.988290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:04:59.988977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:04:59.989645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.304485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:00.319366 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62eb4ab8-fc3c-4e86-9853-8432aea35447 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.365126 Oct 27 09:05:00.320049 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 649/1274] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:04:59 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:00.324731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:00.325323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:00.331648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.332223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.332658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.333373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.333830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.334254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.629541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:00.643998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:00.645504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:00.646863 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5feb7ee5-3f40-47cc-94d3-b380940fc3ad tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.325658 Oct 27 09:05:00.647548 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 650/1275] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:00 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:00.776767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Calling method '.version_select at 0x7f31aa3e5700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:00.779484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.780624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.781243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.794232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Building network info cache for instance {{(pid=120603) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:05:00.798454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.799150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.799817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.811035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.811812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.812431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.822601 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-30af5d2f-8348-49bf-87d2-fd85416567dc tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.173736 Oct 27 09:05:00.823884 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 651/1276] 10.222.0.25 () {60 vars in 1187 bytes} [Thu Oct 27 09:05:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:05:00.831301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:00.835848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] [instance: a87f82e6-50b6-4479-a799-c880d5782c8f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:00.842176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.843414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.844074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.845245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.845864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.846453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.864969 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] HTTP exception thrown: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Request method failure captured: Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f HTTP/1.1 Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkmDtyMAfHM3Tv8dKuF81IEFmBhlGVcUk4aTprr1sVRBtOqpCzc4ZEn_FGEtKAeaxZ86ay0qos_SxaUKeQWpMIGeTfTzZzbK5diIcBaj8RYFjzrLvZnIZ-EiGP_e64rPpqfz8qBWGSzMxUi4dmtBxAFqBOMgHHd-_q2_pm8RyodaaRM Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b56f0bc62eab4b3382c1e77fa2b1a90b Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-163978851 Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b56f0bc62eab4b3382c1e77fa2b1a90b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b56f0bc62eab4b3382c1e77fa2b1a90b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b56f0bc62eab4b3382c1e77fa2b1a90b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b56f0bc62eab4b3382c1e77fa2b1a90b"}]}] Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-163978851 Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b56f0bc62eab4b3382c1e77fa2b1a90b Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-163978851 Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestMultiTenantJSON-163978851-project Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: b557eb3af44d47479a280ed67b80ffca Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-163978851-project Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'a87f82e6-50b6-4479-a799-c880d5782c8f'} Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:05:00.866873 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:00.871776 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:00.871776 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:00.871776 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:00.871776 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:00.871776 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:00.871776 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:05:00.871776 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:05:00.871776 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. Oct 27 09:05:00.871776 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:00.873323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] Returning 404 to user: Instance a87f82e6-50b6-4479-a799-c880d5782c8f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:05:00.874212 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9cbac375-ac92-4844-835f-490ecb14807b tempest-ServersNegativeTestMultiTenantJSON-163978851 tempest-ServersNegativeTestMultiTenantJSON-163978851-project] 10.222.0.25 "GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f" status: 404 len: 111 microversion: 2.1 time: 0.048027 Oct 27 09:05:00.875082 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 652/1277] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:00 2022] GET /compute/v2.1/servers/a87f82e6-50b6-4479-a799-c880d5782c8f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:05:00.894053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8718bb8-bdf2-4833-a2c9-4c9033b92459 tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Calling method '.version_select at 0x7f31aa3dfaf0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:00.895867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8718bb8-bdf2-4833-a2c9-4c9033b92459 tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.896397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8718bb8-bdf2-4833-a2c9-4c9033b92459 tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.905929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8718bb8-bdf2-4833-a2c9-4c9033b92459 tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.936203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8718bb8-bdf2-4833-a2c9-4c9033b92459 tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.938732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8718bb8-bdf2-4833-a2c9-4c9033b92459 tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.939362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8718bb8-bdf2-4833-a2c9-4c9033b92459 tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.954569 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8718bb8-bdf2-4833-a2c9-4c9033b92459 tempest-HypervisorAdminV228Test-953224669 tempest-HypervisorAdminV228Test-953224669-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.078402 Oct 27 09:05:00.955505 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 653/1278] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Oct 27 09:05:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:05:00.974561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:00.975457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:00.981849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.982827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.984834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:00.985892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:00.986516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:00.987072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:01.432394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:01.440404 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aaeb1e6a-4abb-4557-8b5e-1dce3c3b1ce9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.470692 Oct 27 09:05:01.440982 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 654/1279] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:00 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:01.448746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c285afe-66c4-4797-bb2c-780a8192116a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a572cef7-1104-4485-9370-9159b108c5f8"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:01.455688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8c285afe-66c4-4797-bb2c-780a8192116a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:01.471864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c285afe-66c4-4797-bb2c-780a8192116a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:01.472623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c285afe-66c4-4797-bb2c-780a8192116a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:01.473222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c285afe-66c4-4797-bb2c-780a8192116a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:01.474518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c285afe-66c4-4797-bb2c-780a8192116a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:01.484364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c285afe-66c4-4797-bb2c-780a8192116a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:01.485055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c285afe-66c4-4797-bb2c-780a8192116a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:01.720987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Updating instance_info_cache with network_info: [{"id": "8f227eb9-17d1-4c08-9f33-d566033baac2", "address": "fa:16:3e:08:32:80", "network": {"id": "9eef8a1a-d727-4fc9-8d90-b364a5843ffd", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1727078278-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "525959f0023641e6ade5c949a1d7a7b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8f227eb9-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120603) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:05:01.750528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Releasing lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:05:01.751882 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d41c761c-d3d3-40f5-92fa-20c44ca9e1cd tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action" status: 202 len: 0 microversion: 2.1 time: 3.018938 Oct 27 09:05:01.752659 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 626/1280] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:04:58 2022] POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action => generated 0 bytes in 3030 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 09:05:01.765738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:01.767811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:01.781831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:01.782667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:01.783114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:01.783857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:01.784312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:01.784733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:01.792167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:01.977966 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c285afe-66c4-4797-bb2c-780a8192116a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "POST /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535756 Oct 27 09:05:01.978660 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 655/1281] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:05:01 2022] POST /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:01.994815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2b375aec-e8cb-4391-b37c-2f1c2f90b0de req-904ca0f5-4648-4971-afc6-4d461cb6d12b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e35128-7782-4862-8089-4849310d455c", "tag": "8f227eb9-17d1-4c08-9f33-d566033baac2"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:02.009987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2b375aec-e8cb-4391-b37c-2f1c2f90b0de req-904ca0f5-4648-4971-afc6-4d461cb6d12b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:02.016230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2b375aec-e8cb-4391-b37c-2f1c2f90b0de req-904ca0f5-4648-4971-afc6-4d461cb6d12b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:02.016910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2b375aec-e8cb-4391-b37c-2f1c2f90b0de req-904ca0f5-4648-4971-afc6-4d461cb6d12b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:02.038926 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2b375aec-e8cb-4391-b37c-2f1c2f90b0de req-904ca0f5-4648-4971-afc6-4d461cb6d12b service nova] Creating event network-changed:8f227eb9-17d1-4c08-9f33-d566033baac2 for instance d4e35128-7782-4862-8089-4849310d455c on n-h2-858383-16 Oct 27 09:05:02.049170 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2b375aec-e8cb-4391-b37c-2f1c2f90b0de req-904ca0f5-4648-4971-afc6-4d461cb6d12b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068836 Oct 27 09:05:02.049993 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 656/1282] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:02.058427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:02.064306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:02.086704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:02.087282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:02.087773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:02.088493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:02.088947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:02.089378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:02.101266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:02.134233 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f00d6b62-d961-4db7-983e-1ce37163420d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.375274 Oct 27 09:05:02.152586 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 627/1283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:01 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:02.162244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b12849f0-11bf-43c4-b0bf-7603e5b01cf9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '.version_select at 0x7f31aa0ffaf0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:02.589945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:02.600163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:02.608836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:02.613599 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7a2d61e-1a99-4667-bc0e-38f9b8aa1a15 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.562010 Oct 27 09:05:02.628967 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 657/1284] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:02 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:02.638830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:02.639786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:02.646016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:02.648412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:02.649291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:02.650210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:02.650828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:02.651411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:02.946516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:02.955310 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-426c6a55-839e-4eb4-adf4-4a3c927d7ca2 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.324907 Oct 27 09:05:02.966334 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 658/1285] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:02 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:03.162281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:03.162895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:03.186099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:03.187355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:03.188048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:03.189059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:03.189800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:03.190595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:03.561002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:03.571292 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e2b6046a-9233-461f-980e-5c143bd2cd11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.412845 Oct 27 09:05:03.577125 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 659/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:03 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:03.644440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:03.645864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:03.667741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:03.668647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:03.669384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:03.670425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:03.672788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:03.673503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:04.829831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:04.848965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:04.852882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:04.861469 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-940917c4-0feb-4bf7-8f3b-4326a110af23 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 1.218781 Oct 27 09:05:04.862104 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 660/1287] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:03 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:04.876968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:04.877705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:04.893208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:04.898371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:04.898869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:04.899654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:04.902511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:04.902974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:05.739783 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b12849f0-11bf-43c4-b0bf-7603e5b01cf9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/aa73216c-6dd5-4f36-b5bd-d12746c65635" status: 202 len: 0 microversion: 2.1 time: 3.582681 Oct 27 09:05:05.740628 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 628/1288] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:05:02 2022] DELETE /compute/v2.1/os-floating-ips/aa73216c-6dd5-4f36-b5bd-d12746c65635 => generated 0 bytes in 3587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:05:05.752254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:05.752961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:05.753256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:05.762455 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c2d9a52-ffd6-48f4-bd04-6158b462f5aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 0.899275 Oct 27 09:05:05.765927 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 661/1289] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:04 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:05.766576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:05.767183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:05.768028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:05.770847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:05.771466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:05.772473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:05.779115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ae0698e-60c6-4ff8-b704-c324e8d57006 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ae0698e-60c6-4ff8-b704-c324e8d57006 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Request method failure captured: Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action HTTP/1.1 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 34 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkmThAYr1_F6whjLzuT1PGxd2w8-ODini54pUAcsBgHwGAw6g-ubGPJBysMjTFUf-Zqere2umwS9yCUUGI2w7WaIXUa35LJPDM5XHkVPxQ79MvtS6-gjN2PxXDB1IuWytoH1T-198t22SxMUv-N4crl7aCyWSfmMHMFVEwfFbS6JVRA Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/525959f0023641e6ade5c949a1d7a7b6"}]}] Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: f45f1abf2cfe4d65bba598a764d0ff24 Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: {"addFloatingIp": {"address": ""}} Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd4e35128-7782-4862-8089-4849310d455c', 'body': {'addFloatingIp': {'address': ''}}} Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '' Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:05:05.792557 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 27 09:05:05.799815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:05.802110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ae0698e-60c6-4ff8-b704-c324e8d57006 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:05:05.803154 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ae0698e-60c6-4ff8-b704-c324e8d57006 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action" status: 400 len: 142 microversion: 2.1 time: 0.035854 Oct 27 09:05:05.805007 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 662/1290] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:05:05 2022] POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action => generated 142 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:05:05.815986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:05.820621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:05.834195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:05.835904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:05.836547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:05.838232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:05.839373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:05.840000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:05.893808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:05:05.894414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquired lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:05:06.086498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Releasing lock "refresh_cache-d4e35128-7782-4862-8089-4849310d455c" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:05:06.089230 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] HTTP exception thrown: floating IP not found Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Request method failure captured: Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action HTTP/1.1 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 41 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkmThAYr1_F6whjLzuT1PGxd2w8-ODini54pUAcsBgHwGAw6g-ubGPJBysMjTFUf-Zqere2umwS9yCUUGI2w7WaIXUa35LJPDM5XHkVPxQ79MvtS6-gjN2PxXDB1IuWytoH1T-198t22SxMUv-N4crl7aCyWSfmMHMFVEwfFbS6JVRA Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/525959f0023641e6ade5c949a1d7a7b6"}]}] Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: f45f1abf2cfe4d65bba598a764d0ff24 Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: exception: floating IP not found Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd4e35128-7782-4862-8089-4849310d455c', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 27 09:05:06.094460 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.100437 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:06.100437 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.100437 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:06.100437 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:06.100437 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:06.100437 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:05:06.100437 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:05:06.100437 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 27 09:05:06.100437 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.108562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Returning 404 to user: floating IP not found {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:05:06.109737 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a0ba1c34-1f5a-46e6-b60a-ca611bfebdeb tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action" status: 404 len: 67 microversion: 2.1 time: 0.299858 Oct 27 09:05:06.111447 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 663/1291] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:05:05 2022] POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action => generated 67 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:05:06.118400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:06.124666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:06.128576 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb79d87a-ec01-4df5-85f1-ed259ea21b95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.380517 Oct 27 09:05:06.130321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:06.138306 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 629/1292] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:05 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:06.142604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.146254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.146719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.148923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-255684fe-38fe-453a-b45a-ee7773838af2 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:06.149831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.151611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.152192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.210014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:06.247964 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-255684fe-38fe-453a-b45a-ee7773838af2 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-255684fe-38fe-453a-b45a-ee7773838af2 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Request method failure captured: Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action HTTP/1.1 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 44 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkmThAYr1_F6whjLzuT1PGxd2w8-ODini54pUAcsBgHwGAw6g-ubGPJBysMjTFUf-Zqere2umwS9yCUUGI2w7WaIXUa35LJPDM5XHkVPxQ79MvtS6-gjN2PxXDB1IuWytoH1T-198t22SxMUv-N4crl7aCyWSfmMHMFVEwfFbS6JVRA Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/525959f0023641e6ade5c949a1d7a7b6"}]}] Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: f45f1abf2cfe4d65bba598a764d0ff24 Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: exception: Floating IP not found for address 0.0.0.0. Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd4e35128-7782-4862-8089-4849310d455c', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 27 09:05:06.251745 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 27 09:05:06.257589 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:06.260471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-255684fe-38fe-453a-b45a-ee7773838af2 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:05:06.261601 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-255684fe-38fe-453a-b45a-ee7773838af2 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action" status: 404 len: 88 microversion: 2.1 time: 0.119766 Oct 27 09:05:06.262362 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 630/1293] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:05:06 2022] POST /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c/action => generated 88 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:05:06.277421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:06.279086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:06.290570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.292447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.293325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.294438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.295196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.296151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.610062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:06.625368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:06.627109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:06.628358 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eee79c14-1c03-4019-a7f7-8bf641f03ca9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.515409 Oct 27 09:05:06.628919 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 664/1294] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:06 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:06.645322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:06.645829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:06.676881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.677389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.677832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.678586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.679271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.679741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.713795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:06.747863 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf8538d2-80db-4485-9cf6-c761c6f14272 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 2348 microversion: 2.25 time: 0.479407 Oct 27 09:05:06.766341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:05:06.766901 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 631/1295] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:06 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 2348 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:06.781774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5f938198-5f48-4669-8744-c4a946d5a779 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:06.802911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f938198-5f48-4669-8744-c4a946d5a779 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.804497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f938198-5f48-4669-8744-c4a946d5a779 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.805010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f938198-5f48-4669-8744-c4a946d5a779 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.811638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f938198-5f48-4669-8744-c4a946d5a779 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.812392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f938198-5f48-4669-8744-c4a946d5a779 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.814044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f938198-5f48-4669-8744-c4a946d5a779 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.859872 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5f938198-5f48-4669-8744-c4a946d5a779 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.085797 Oct 27 09:05:06.872224 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 632/1296] 10.222.0.25 () {60 vars in 1217 bytes} [Thu Oct 27 09:05:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:05:06.895778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:06.896522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:06.901138 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0df6e579-9919-4056-bdf8-fd28e547fa9e tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 204 len: 0 microversion: 2.1 time: 0.270218 Oct 27 09:05:06.903319 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 665/1297] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:05:06 2022] DELETE /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:05:06.912808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.913307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.917207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:06.918220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:06.919537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.920347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.921020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.922038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.928220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.929377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.930000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:06.930950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:06.932484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:06.933238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:07.602310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:07.611734 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-444f78b3-9111-41d1-84ce-b60a34391446 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1543 microversion: 2.1 time: 0.702583 Oct 27 09:05:07.616160 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 666/1298] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:06 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1543 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:07.651945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:07.652767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:07.666251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:07.669660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:07.670206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:07.682763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:07.683253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:07.683726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:07.853204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:07.883386 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c6ae5c79-d082-4486-af86-3cbef7477618 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1477 microversion: 2.1 time: 1.000573 Oct 27 09:05:07.901166 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 633/1299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:06 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1477 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:07.910051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:07.912300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:07.919902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:07.922301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:07.923296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:07.925856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:07.926551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:07.944980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:08.200759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:08.217584 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-745017a8-7426-4486-b88f-4c3ba58f0348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.585885 Oct 27 09:05:08.218440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 667/1300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:07 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:08.607137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:08.621380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:08.623462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:08.624873 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc96a6b8-a612-41fc-ab06-3eea645ebdc4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.722284 Oct 27 09:05:08.625615 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 634/1301] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:07 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:08.637889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:08.638920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:08.654190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:08.655328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:08.655836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:08.656555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:08.657016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:08.657447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:09.028366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1116468306", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": "none"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:09.103138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:05:09.103848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:05:09.107490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:05:09.108656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:05:09.110425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:05:09.132239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:09.135124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:09.135662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:09.136571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:09.137047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:09.137483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:09.174962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Getting quotas for project 0e582d9186724857aa62fa4058c89f64. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:05:09.182784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Getting quotas for user 1f32e1b7f7e24ca99ba9b97a45d5c8e3 and project 0e582d9186724857aa62fa4058c89f64. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:05:09.213802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:05:09.218673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:05:09.231124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:09.255554 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4781a72e-9853-4e06-a876-61b78f4e49d0 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1543 microversion: 2.1 time: 0.621270 Oct 27 09:05:09.256542 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 668/1302] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:08 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1543 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:09.261170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:09.268369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:09.299359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:09.300123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:09.300755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:09.302326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:09.302954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:09.303543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:09.308826 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-86e5973a-b351-47bc-ba7a-ca6bda69cac3 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.411959 Oct 27 09:05:09.310196 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 635/1303] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:05:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:05:09.320903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:09.321951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:09.360115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:09.361206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:09.361777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:09.362789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:09.364231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:09.364795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:09.712633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:09.721680 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd9aa579-8276-43ee-bd7c-167ead18870f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1476 microversion: 2.1 time: 0.464067 Oct 27 09:05:09.739985 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 669/1304] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:09 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1476 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:09.749620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-028e0f11-e200-473a-a486-9857135692b0 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:09.752039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-028e0f11-e200-473a-a486-9857135692b0 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:09.953951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:09.964993 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8cc86f4d-4daf-4cb5-b8b0-be2ed26582ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1718 microversion: 2.1 time: 0.652663 Oct 27 09:05:09.966075 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 636/1305] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:09 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1718 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:09.972722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:09.973782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:09.989789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:09.999735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:10.000200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:10.000958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:10.001418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:10.001980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:10.090130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-028e0f11-e200-473a-a486-9857135692b0 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:10.119796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-028e0f11-e200-473a-a486-9857135692b0 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:10.126591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-028e0f11-e200-473a-a486-9857135692b0 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:10.137646 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-028e0f11-e200-473a-a486-9857135692b0 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "PUT /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1359 microversion: 2.75 time: 0.392268 Oct 27 09:05:10.139909 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 670/1306] 10.222.0.25 () {62 vars in 1297 bytes} [Thu Oct 27 09:05:09 2022] PUT /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1359 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:10.146454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-760d6776-ee14-4271-972f-ba96b7d39cc7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4519c945-9ce4-48f0-bffe-4c01c00aaf1f", "device": "/dev/xvdb"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:10.150505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-760d6776-ee14-4271-972f-ba96b7d39cc7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:10.158202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-760d6776-ee14-4271-972f-ba96b7d39cc7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:10.159600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-760d6776-ee14-4271-972f-ba96b7d39cc7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:10.160381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-760d6776-ee14-4271-972f-ba96b7d39cc7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:10.161401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-760d6776-ee14-4271-972f-ba96b7d39cc7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:10.162178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-760d6776-ee14-4271-972f-ba96b7d39cc7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:10.162760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-760d6776-ee14-4271-972f-ba96b7d39cc7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:10.681290 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-760d6776-ee14-4271-972f-ba96b7d39cc7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "POST /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.539283 Oct 27 09:05:10.705744 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 671/1307] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Oct 27 09:05:10 2022] POST /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:05:10.862315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:10.873743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:10.893514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:10.894720 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10201f14-c254-4453-a460-1db93a2cb491 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.927540 Oct 27 09:05:10.895480 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 637/1308] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:09 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:10.905269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8a0cbd0d-7bbd-48a0-9a9c-6d6bee5b4ef7 req-0436b787-eae8-44dd-9227-ef91c31e9ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a988a0df-4f91-4497-a599-e7e19c636ac7", "name": "network-vif-unplugged", "status": "completed", "tag": "b5279136-9006-4596-a97a-bc6367ac28b6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:10.909926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-481c6656-3791-45bc-888c-da968fa322bc req-820b4bc7-232e-480e-99ea-6ab252fb0c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e35128-7782-4862-8089-4849310d455c", "name": "network-vif-deleted", "tag": "8f227eb9-17d1-4c08-9f33-d566033baac2"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:10.935046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8a0cbd0d-7bbd-48a0-9a9c-6d6bee5b4ef7 req-0436b787-eae8-44dd-9227-ef91c31e9ffc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:10.935544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8a0cbd0d-7bbd-48a0-9a9c-6d6bee5b4ef7 req-0436b787-eae8-44dd-9227-ef91c31e9ffc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:10.936336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8a0cbd0d-7bbd-48a0-9a9c-6d6bee5b4ef7 req-0436b787-eae8-44dd-9227-ef91c31e9ffc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:10.952576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-481c6656-3791-45bc-888c-da968fa322bc req-820b4bc7-232e-480e-99ea-6ab252fb0c76 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:10.953079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-481c6656-3791-45bc-888c-da968fa322bc req-820b4bc7-232e-480e-99ea-6ab252fb0c76 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:10.953513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-481c6656-3791-45bc-888c-da968fa322bc req-820b4bc7-232e-480e-99ea-6ab252fb0c76 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:10.963606 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8a0cbd0d-7bbd-48a0-9a9c-6d6bee5b4ef7 req-0436b787-eae8-44dd-9227-ef91c31e9ffc service nova] Creating event network-vif-unplugged:b5279136-9006-4596-a97a-bc6367ac28b6 for instance a988a0df-4f91-4497-a599-e7e19c636ac7 on n-h2-858383-16 Oct 27 09:05:10.992930 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-481c6656-3791-45bc-888c-da968fa322bc req-820b4bc7-232e-480e-99ea-6ab252fb0c76 service nova] Creating event network-vif-deleted:8f227eb9-17d1-4c08-9f33-d566033baac2 for instance d4e35128-7782-4862-8089-4849310d455c on n-h2-858383-16 Oct 27 09:05:10.995182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-8a0cbd0d-7bbd-48a0-9a9c-6d6bee5b4ef7 req-0436b787-eae8-44dd-9227-ef91c31e9ffc service nova] Instance a988a0df-4f91-4497-a599-e7e19c636ac7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:05:11.002330 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-481c6656-3791-45bc-888c-da968fa322bc req-820b4bc7-232e-480e-99ea-6ab252fb0c76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293098 Oct 27 09:05:11.006358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 672/1309] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:11.021877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:11.023832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:11.028312 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8a0cbd0d-7bbd-48a0-9a9c-6d6bee5b4ef7 req-0436b787-eae8-44dd-9227-ef91c31e9ffc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131279 Oct 27 09:05:11.029174 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 638/1310] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:11.034838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:11.035549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:11.038077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:11.038911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:11.039366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:11.040261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:11.041583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:11.042369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:11.063334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:11.063964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:11.064407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:11.065131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:11.065590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:11.066022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:11.148213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:11.150528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:11.151640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:11.152373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lazy-loading 'fault' on Instance uuid d4e35128-7782-4862-8089-4849310d455c {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:11.259313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45f1abf2cfe4d65bba598a764d0ff24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525959f0023641e6ade5c949a1d7a7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:11.270715 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8293b708-4393-4e40-9795-9dffbb6301d9 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 200 len: 1322 microversion: 2.1 time: 0.239298 Oct 27 09:05:11.293792 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 639/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:11 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:11.299883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:11.305145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:11.315385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:11.320237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:11.325171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:11.332354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:11.332845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:11.333338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:11.343621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:11.345085 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7fc34815-e801-4e14-ad8a-c7c5c2bcc68a tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1355 microversion: 2.75 time: 0.335607 Oct 27 09:05:11.345747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:11.346394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:11.347780 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 673/1312] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:11 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1355 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:11.364560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:11.365277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:11.430643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:11.431166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:11.441875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:11.445501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:11.446275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:11.448811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.118228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:12.152819 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c109d01-cd15-408c-8f08-bb4b61cd9123 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1476 microversion: 2.1 time: 0.853423 Oct 27 09:05:12.157355 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 640/1313] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:11 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1476 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:12.168671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:12.177040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:12.179764 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aceee1c2-7140-42d7-ace9-2a2a881070f8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1708 microversion: 2.1 time: 0.830071 Oct 27 09:05:12.180210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:12.191440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 674/1314] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:11 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1708 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:12.209256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.210517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.213358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.214283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.214929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.220411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.312137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a1fab8b8-36e0-418c-bddf-6178e23cdf88 req-b424aa7d-e1dd-400d-ba13-6cddf56c1f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-plugged", "status": "completed", "tag": "3b758947-9790-4cd2-9c9a-4f2d98912f3e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:12.351796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a1fab8b8-36e0-418c-bddf-6178e23cdf88 req-b424aa7d-e1dd-400d-ba13-6cddf56c1f6c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.354227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a1fab8b8-36e0-418c-bddf-6178e23cdf88 req-b424aa7d-e1dd-400d-ba13-6cddf56c1f6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.354897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a1fab8b8-36e0-418c-bddf-6178e23cdf88 req-b424aa7d-e1dd-400d-ba13-6cddf56c1f6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.388160 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a1fab8b8-36e0-418c-bddf-6178e23cdf88 req-b424aa7d-e1dd-400d-ba13-6cddf56c1f6c service nova] Creating event network-vif-plugged:3b758947-9790-4cd2-9c9a-4f2d98912f3e for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:05:12.401825 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a1fab8b8-36e0-418c-bddf-6178e23cdf88 req-b424aa7d-e1dd-400d-ba13-6cddf56c1f6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206728 Oct 27 09:05:12.406162 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 675/1315] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:12.419150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7796d0e-fd05-4aea-b8ba-1d1e86e71882 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '.version_select at 0x7f31aa29d160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:12.428076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7796d0e-fd05-4aea-b8ba-1d1e86e71882 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.428832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7796d0e-fd05-4aea-b8ba-1d1e86e71882 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.429283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7796d0e-fd05-4aea-b8ba-1d1e86e71882 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.460254 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7796d0e-fd05-4aea-b8ba-1d1e86e71882 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3546 microversion: 2.1 time: 0.052702 Oct 27 09:05:12.460898 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 676/1316] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:05:12 2022] GET /compute/v2.1/os-migrations => generated 3546 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:12.491911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:12.492660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] [instance: d4e35128-7782-4862-8089-4849310d455c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:12.508978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.509405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.509849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.510557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.521013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.522012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.563951 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] HTTP exception thrown: Instance d4e35128-7782-4862-8089-4849310d455c could not be found. Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Request method failure captured: Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c HTTP/1.1 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkmThAYr1_F6whjLzuT1PGxd2w8-ODini54pUAcsBgHwGAw6g-ubGPJBysMjTFUf-Zqere2umwS9yCUUGI2w7WaIXUa35LJPDM5XHkVPxQ79MvtS6-gjN2PxXDB1IuWytoH1T-198t22SxMUv-N4crl7aCyWSfmMHMFVEwfFbS6JVRA Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/525959f0023641e6ade5c949a1d7a7b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/525959f0023641e6ade5c949a1d7a7b6"}]}] Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 525959f0023641e6ade5c949a1d7a7b6 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: f45f1abf2cfe4d65bba598a764d0ff24 Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance d4e35128-7782-4862-8089-4849310d455c could not be found. Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd4e35128-7782-4862-8089-4849310d455c'} Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e35128-7782-4862-8089-4849310d455c could not be found. Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e35128-7782-4862-8089-4849310d455c could not be found. Oct 27 09:05:12.565660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e35128-7782-4862-8089-4849310d455c could not be found. Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] Returning 404 to user: Instance d4e35128-7782-4862-8089-4849310d455c could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:05:12.570607 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5dc90c7-10ce-489d-a31c-7819b2beb642 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963 tempest-FloatingIPsAssociationNegativeTestJSON-1219305963-project] 10.222.0.25 "GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c" status: 404 len: 111 microversion: 2.1 time: 0.105262 Oct 27 09:05:12.573392 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 677/1317] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:12 2022] GET /compute/v2.1/servers/d4e35128-7782-4862-8089-4849310d455c => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:05:12.583220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:12.583946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:12.591561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.592809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.593703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.594628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.595255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.595909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.755710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:12.772316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:12.775234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:12.782643 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37303933-3757-4255-a07a-574abff2ce71 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1419 microversion: 2.75 time: 0.208079 Oct 27 09:05:12.797452 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 678/1318] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:12 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1419 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:12.812301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-78f3341e-aa69-49c0-85a8-c18e39f81c86 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:12.813124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-78f3341e-aa69-49c0-85a8-c18e39f81c86 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:12.819797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f3341e-aa69-49c0-85a8-c18e39f81c86 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.820581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f3341e-aa69-49c0-85a8-c18e39f81c86 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.821311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f3341e-aa69-49c0-85a8-c18e39f81c86 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:12.822357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f3341e-aa69-49c0-85a8-c18e39f81c86 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:12.823048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f3341e-aa69-49c0-85a8-c18e39f81c86 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:12.823782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f3341e-aa69-49c0-85a8-c18e39f81c86 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:13.284865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:13.311545 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-78f3341e-aa69-49c0-85a8-c18e39f81c86 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1861 microversion: 2.1 time: 0.512881 Oct 27 09:05:13.313480 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 679/1319] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:12 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1861 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:13.329009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-52d36f7c-6d89-45ff-9619-0fd66904d0df req-440c5d54-5378-45a9-9971-84e667650b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a988a0df-4f91-4497-a599-e7e19c636ac7", "tag": "b5279136-9006-4596-a97a-bc6367ac28b6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:13.335145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:13.341178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-52d36f7c-6d89-45ff-9619-0fd66904d0df req-440c5d54-5378-45a9-9971-84e667650b80 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:13.341893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:13.342118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-52d36f7c-6d89-45ff-9619-0fd66904d0df req-440c5d54-5378-45a9-9971-84e667650b80 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:13.342720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-52d36f7c-6d89-45ff-9619-0fd66904d0df req-440c5d54-5378-45a9-9971-84e667650b80 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:13.343140 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79282a8c-d42c-47f1-8605-acd6020ad585 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 1.183045 Oct 27 09:05:13.343729 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 641/1320] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:12 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:13.358182 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-52d36f7c-6d89-45ff-9619-0fd66904d0df req-440c5d54-5378-45a9-9971-84e667650b80 service nova] Creating event network-changed:b5279136-9006-4596-a97a-bc6367ac28b6 for instance a988a0df-4f91-4497-a599-e7e19c636ac7 on n-h2-858383-16 Oct 27 09:05:13.368420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-52d36f7c-6d89-45ff-9619-0fd66904d0df req-440c5d54-5378-45a9-9971-84e667650b80 service nova] Instance a988a0df-4f91-4497-a599-e7e19c636ac7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:05:13.387888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:13.388598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:13.389697 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-52d36f7c-6d89-45ff-9619-0fd66904d0df req-440c5d54-5378-45a9-9971-84e667650b80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073595 Oct 27 09:05:13.390485 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 680/1321] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:13.413553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-116c8f6f-c515-4a26-a47f-eb7e0f756a05 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:13.414540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-116c8f6f-c515-4a26-a47f-eb7e0f756a05 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:13.421809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-116c8f6f-c515-4a26-a47f-eb7e0f756a05 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:13.422639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-116c8f6f-c515-4a26-a47f-eb7e0f756a05 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:13.423245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-116c8f6f-c515-4a26-a47f-eb7e0f756a05 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:13.424528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-116c8f6f-c515-4a26-a47f-eb7e0f756a05 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:13.425152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-116c8f6f-c515-4a26-a47f-eb7e0f756a05 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:13.425732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-116c8f6f-c515-4a26-a47f-eb7e0f756a05 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:13.448676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:13.449332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:13.453468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:13.459220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:13.471902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:13.472479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:14.453227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:14.457898 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-116c8f6f-c515-4a26-a47f-eb7e0f756a05 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1861 microversion: 2.1 time: 1.065996 Oct 27 09:05:14.468217 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 681/1322] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:13 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1861 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:14.475321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:14.476145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:14.486439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:14.488945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:14.489771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:14.490509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:14.491793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:14.493034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:14.494219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:14.500731 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8052e68-7d2a-445c-aaa9-d64fbfff03e8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1476 microversion: 2.1 time: 1.122848 Oct 27 09:05:14.515607 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 642/1323] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:13 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1476 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:14.515607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:14.515607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:14.528747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:14.530296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:14.546401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:14.547201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:14.547724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:14.548177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:14.667112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:14.677352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:14.679242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:14.689016 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77256e44-f26d-4ddf-9668-84529cdcc90b tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1417 microversion: 2.75 time: 0.219665 Oct 27 09:05:14.690177 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 682/1324] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:14 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1417 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:14.697530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f9ab0054-ffc9-407f-abe3-134d6510e9d0 req-24a41b50-4251-412e-a9f8-c9bec0923e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-plugged", "status": "completed", "tag": "1909605a-f082-4fa7-8b71-e5b6588381b7"}, {"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-plugged", "status": "completed", "tag": "2e9a642c-cdf6-4f11-b419-815f385318f3"}, {"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-plugged", "status": "completed", "tag": "e2bf3f27-0dfb-4e04-ab67-6ed73dc59c65"}, {"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-plugged", "status": "completed", "tag": "32d1d17b-5769-4c16-9353-0660cc143a6a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:14.711811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f9ab0054-ffc9-407f-abe3-134d6510e9d0 req-24a41b50-4251-412e-a9f8-c9bec0923e2a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:14.712628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f9ab0054-ffc9-407f-abe3-134d6510e9d0 req-24a41b50-4251-412e-a9f8-c9bec0923e2a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:14.715174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f9ab0054-ffc9-407f-abe3-134d6510e9d0 req-24a41b50-4251-412e-a9f8-c9bec0923e2a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:14.731511 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f9ab0054-ffc9-407f-abe3-134d6510e9d0 req-24a41b50-4251-412e-a9f8-c9bec0923e2a service nova] Creating event network-vif-plugged:1909605a-f082-4fa7-8b71-e5b6588381b7 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:05:14.732972 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f9ab0054-ffc9-407f-abe3-134d6510e9d0 req-24a41b50-4251-412e-a9f8-c9bec0923e2a service nova] Creating event network-vif-plugged:2e9a642c-cdf6-4f11-b419-815f385318f3 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:05:14.733691 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f9ab0054-ffc9-407f-abe3-134d6510e9d0 req-24a41b50-4251-412e-a9f8-c9bec0923e2a service nova] Creating event network-vif-plugged:e2bf3f27-0dfb-4e04-ab67-6ed73dc59c65 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:05:14.734895 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f9ab0054-ffc9-407f-abe3-134d6510e9d0 req-24a41b50-4251-412e-a9f8-c9bec0923e2a service nova] Creating event network-vif-plugged:32d1d17b-5769-4c16-9353-0660cc143a6a for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:05:14.742509 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f9ab0054-ffc9-407f-abe3-134d6510e9d0 req-24a41b50-4251-412e-a9f8-c9bec0923e2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.050802 Oct 27 09:05:14.744271 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 683/1325] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:14.753579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:14.754672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:14.762643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:14.763443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:14.765080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:14.766401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:14.768186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:14.768873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:14.907877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:14.917442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:14.918915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:14.920189 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d248e16-d0ef-4ce7-a818-b39ee0285864 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.417321 Oct 27 09:05:14.927363 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 643/1326] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:14 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:14.964686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lazy-loading 'services' on Instance uuid 45b64fc7-dd59-4a29-b395-8f8e8990cabb {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:15.196745 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82fd3d82-5183-45c7-89b6-72666f6dd8f2 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "DELETE /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments/4d7f79b4-fa41-482f-aa81-5356968ff6cd" status: 202 len: 0 microversion: 2.1 time: 0.450460 Oct 27 09:05:15.197547 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 684/1327] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:05:14 2022] DELETE /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments/4d7f79b4-fa41-482f-aa81-5356968ff6cd => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:05:15.206354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5ddabb5-09f4-4f3e-93cf-6c7b9603617c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:15.208703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5ddabb5-09f4-4f3e-93cf-6c7b9603617c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:15.221450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ddabb5-09f4-4f3e-93cf-6c7b9603617c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:15.221974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ddabb5-09f4-4f3e-93cf-6c7b9603617c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:15.222427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ddabb5-09f4-4f3e-93cf-6c7b9603617c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:15.223168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ddabb5-09f4-4f3e-93cf-6c7b9603617c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:15.223670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ddabb5-09f4-4f3e-93cf-6c7b9603617c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:15.224111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5ddabb5-09f4-4f3e-93cf-6c7b9603617c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:15.355457 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5ddabb5-09f4-4f3e-93cf-6c7b9603617c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152499 Oct 27 09:05:15.362365 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 644/1328] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:15 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:15.533558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:15.535718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:15.551664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:15.552546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:15.555534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:15.560510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:15.562501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:15.567377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:15.724905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:15.725525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:15.731893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:15.732935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:15.733382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:15.734100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:15.734629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:15.735243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:15.815498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:15.830942 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f9164df4-78f2-46c4-b586-fc4b1e76f549 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1476 microversion: 2.1 time: 0.298795 Oct 27 09:05:15.832056 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 685/1329] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:15 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1476 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:15.897112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:15.906543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:15.908049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:15.916538 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bea90b56-42a5-4aad-8c03-a820ece641ab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1417 microversion: 2.75 time: 0.195161 Oct 27 09:05:15.917849 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 645/1330] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:15 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1417 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:15.953191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:15.954127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:15.963405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:15.964532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:15.965180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:15.967356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:15.968160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:15.968830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:16.318792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:16.332864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:16.338309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:16.343905 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-efffac2e-391d-452d-9215-c80e345305a9 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.399085 Oct 27 09:05:16.344496 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 686/1331] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:15 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:16.374913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2696b80a-441f-40a4-9af7-0a2702f8d3e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:16.377240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2696b80a-441f-40a4-9af7-0a2702f8d3e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:16.387613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2696b80a-441f-40a4-9af7-0a2702f8d3e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:16.388125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2696b80a-441f-40a4-9af7-0a2702f8d3e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:16.388704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2696b80a-441f-40a4-9af7-0a2702f8d3e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:16.389431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2696b80a-441f-40a4-9af7-0a2702f8d3e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:16.389898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2696b80a-441f-40a4-9af7-0a2702f8d3e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:16.390515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2696b80a-441f-40a4-9af7-0a2702f8d3e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:16.429467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:16.432591 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2696b80a-441f-40a4-9af7-0a2702f8d3e6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063931 Oct 27 09:05:16.433996 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 646/1332] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:16 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:16.917462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f67a553c-2d61-4a39-8259-dae00b1e9f81 req-4b348487-9dcb-4aab-adca-72621648f3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-plugged", "status": "completed", "tag": "81294aa2-0c23-45a5-81ca-6872462ae6d3"}, {"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-plugged", "status": "completed", "tag": "91f51f6e-082b-4bd2-a440-28e5320e62d1"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:16.953552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f67a553c-2d61-4a39-8259-dae00b1e9f81 req-4b348487-9dcb-4aab-adca-72621648f3ff service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:16.954048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f67a553c-2d61-4a39-8259-dae00b1e9f81 req-4b348487-9dcb-4aab-adca-72621648f3ff service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:16.954490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f67a553c-2d61-4a39-8259-dae00b1e9f81 req-4b348487-9dcb-4aab-adca-72621648f3ff service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:16.985000 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f67a553c-2d61-4a39-8259-dae00b1e9f81 req-4b348487-9dcb-4aab-adca-72621648f3ff service nova] Creating event network-vif-plugged:81294aa2-0c23-45a5-81ca-6872462ae6d3 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:05:16.985621 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f67a553c-2d61-4a39-8259-dae00b1e9f81 req-4b348487-9dcb-4aab-adca-72621648f3ff service nova] Creating event network-vif-plugged:91f51f6e-082b-4bd2-a440-28e5320e62d1 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:05:16.995924 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f67a553c-2d61-4a39-8259-dae00b1e9f81 req-4b348487-9dcb-4aab-adca-72621648f3ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082735 Oct 27 09:05:16.997886 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 647/1333] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:17.009497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:17.010428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:17.027954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:17.028738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:17.045520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:17.048850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:17.051845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:17.052516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:17.309233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:17.324260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:17.325810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:17.337292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:17.338615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:17.343019 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5fc31923-e2ea-4cb2-bb83-b34fe9395615 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1417 microversion: 2.75 time: 0.341373 Oct 27 09:05:17.345916 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 648/1334] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:16 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1417 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:17.363472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:17.364438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:17.365913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:17.366662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:17.367136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:17.368364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:17.375590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:17.376557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:17.389749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:17.390517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:17.392036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:17.393000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:17.397293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:17.398019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:17.878662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:17.897609 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-48b0e8ef-99b5-43bd-9348-fab39dc068d8 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1476 microversion: 2.1 time: 1.044246 Oct 27 09:05:17.902175 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 687/1335] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:16 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1476 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:17.911131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:17.916551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b86dffc8-3c08-4ae8-b7a7-80a2cd89976f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:17.922629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:17.933773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b86dffc8-3c08-4ae8-b7a7-80a2cd89976f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:17.934278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:17.939247 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a58199f-1444-417e-a19e-611744ae0c48 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.564310 Oct 27 09:05:17.941792 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 649/1336] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:17 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:17.949448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b86dffc8-3c08-4ae8-b7a7-80a2cd89976f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:17.949899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b86dffc8-3c08-4ae8-b7a7-80a2cd89976f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:17.950346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b86dffc8-3c08-4ae8-b7a7-80a2cd89976f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:17.968635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b86dffc8-3c08-4ae8-b7a7-80a2cd89976f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:17.971763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b86dffc8-3c08-4ae8-b7a7-80a2cd89976f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:17.974774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b86dffc8-3c08-4ae8-b7a7-80a2cd89976f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:18.049797 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b86dffc8-3c08-4ae8-b7a7-80a2cd89976f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145405 Oct 27 09:05:18.056567 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 688/1337] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:17 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:18.391384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:18.392398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:18.407693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:18.408474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:18.409176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:18.410172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:18.411016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:18.412034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:18.546598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:18.568620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:18.570449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:18.576905 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d2b4bd3-b340-4ac2-bf81-9d828d37a8fc tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1438 microversion: 2.75 time: 0.202516 Oct 27 09:05:18.578059 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 650/1338] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:18 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1438 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:18.610711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:18.614837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:18.621809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:18.627121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:18.627846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:18.628295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:18.629178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:18.629636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:18.630242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:18.756883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:05:18.757500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:05:18.758126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:05:18.758760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:05:18.759614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:05:18.854926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:18.864412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:18.865126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:18.868630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:18.869879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:18.870752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:18.871387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:18.925656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:18.926538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:18.955068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:18.963034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:18.965724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:18.969247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:18.970767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:18.971932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:18.979448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:18.990735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:18.992360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:19.001235 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28a69190-c0c9-4109-8213-82ca265b4ae5 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "POST /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516/action" status: 202 len: 1495 microversion: 2.75 time: 0.395879 Oct 27 09:05:19.002412 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 689/1339] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:05:18 2022] POST /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516/action => generated 1495 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 27 09:05:19.009603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:19.010407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:19.017313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:19.017808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:19.018252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:19.019025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:19.020353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:19.020848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:19.162937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:19.199107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:19.437734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:19.447559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:19.448884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:19.450326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:19.452348 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e3e17eb7-d15f-49bf-914f-483776e3e270 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1880 microversion: 2.32 time: 0.448502 Oct 27 09:05:19.464089 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9d70df0c-7e2c-4fc8-b320-a6802143f006 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1474 microversion: 2.1 time: 0.534936 Oct 27 09:05:19.465875 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 690/1340] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:19 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1880 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:19.475924 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 651/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:18 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1474 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:19.480146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:19.481021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:19.487766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:19.488447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:19.489529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:19.489658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:19.490192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:19.490692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:19.608374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:19.621262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:19.623620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:19.639216 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.170809 Oct 27 09:05:19.640706 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 691/1342] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:19 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:19.641846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:19.642934 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001257 Oct 27 09:05:19.651287 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 692/1343] 10.222.0.25 () {56 vars in 886 bytes} [Thu Oct 27 09:05:19 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 09:05:19.653608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:19.655486 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003023 Oct 27 09:05:19.663236 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 693/1344] 10.222.0.25 () {54 vars in 1035 bytes} [Thu Oct 27 09:05:19 2022] GET /compute/v2/ => generated 379 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 27 09:05:19.664739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:19.665961 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001579 Oct 27 09:05:19.676281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 694/1345] 10.222.0.25 () {54 vars in 1041 bytes} [Thu Oct 27 09:05:19 2022] GET /compute/v2.1/ => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:19.677709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:19.679130 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2deef0ba-f7d9-4a60-a322-92363076bae7 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001722 Oct 27 09:05:19.688636 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 695/1346] 10.222.0.25 () {56 vars in 886 bytes} [Thu Oct 27 09:05:19 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 09:05:19.886592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-714c3877-8f92-4a40-b5ee-be33ee5ce7a8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:19.889156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-714c3877-8f92-4a40-b5ee-be33ee5ce7a8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:19.902456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-714c3877-8f92-4a40-b5ee-be33ee5ce7a8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:19.903219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-714c3877-8f92-4a40-b5ee-be33ee5ce7a8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:19.904362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-714c3877-8f92-4a40-b5ee-be33ee5ce7a8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:19.906798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-714c3877-8f92-4a40-b5ee-be33ee5ce7a8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:19.907494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-714c3877-8f92-4a40-b5ee-be33ee5ce7a8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:19.907954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-714c3877-8f92-4a40-b5ee-be33ee5ce7a8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:19.999742 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-714c3877-8f92-4a40-b5ee-be33ee5ce7a8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.522515 Oct 27 09:05:20.005945 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 652/1347] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:19 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments => generated 197 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:20.482646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:20.483291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:20.485403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:20.486062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:20.486462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:20.495471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:20.496781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:20.498166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:20.499337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:20.500076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:20.500753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:20.501948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:20.502455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:20.502911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:20.504364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:20.504837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:20.505276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:20.907436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:20.917303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:20.918734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:20.920539 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d16894a2-628e-463a-bb6b-2c67c4d3681b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2833 microversion: 2.32 time: 0.442164 Oct 27 09:05:20.921095 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 696/1348] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:20 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2833 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:20.938156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:20.941425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:20.951646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:20.953240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:20.957837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:20.958455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:20.959339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:20.959980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:20.960577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:20.964459 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e9c9858-139a-4b2e-94b5-1ddd28165102 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1474 microversion: 2.1 time: 0.482817 Oct 27 09:05:20.967353 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 653/1349] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:20 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1474 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:20.976882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ea74e95-b27e-4cb1-8e19-d5c5edc8f618 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:20.978039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ea74e95-b27e-4cb1-8e19-d5c5edc8f618 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:20.995304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea74e95-b27e-4cb1-8e19-d5c5edc8f618 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:20.995912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea74e95-b27e-4cb1-8e19-d5c5edc8f618 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:20.996577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea74e95-b27e-4cb1-8e19-d5c5edc8f618 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:20.997660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea74e95-b27e-4cb1-8e19-d5c5edc8f618 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:20.998969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea74e95-b27e-4cb1-8e19-d5c5edc8f618 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:20.999604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea74e95-b27e-4cb1-8e19-d5c5edc8f618 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:21.160264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:21.175504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:21.177154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:21.189213 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ef3101f9-9287-4f21-9c72-fced8c4f9286 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.256982 Oct 27 09:05:21.195260 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 697/1350] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:20 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:21.203540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98e0441d-cbdc-44c1-b858-7a2ea04ca724 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:21.208899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98e0441d-cbdc-44c1-b858-7a2ea04ca724 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:21.230936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e0441d-cbdc-44c1-b858-7a2ea04ca724 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:21.231592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e0441d-cbdc-44c1-b858-7a2ea04ca724 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:21.236706 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ea74e95-b27e-4cb1-8e19-d5c5edc8f618 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.267443 Oct 27 09:05:21.237946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e0441d-cbdc-44c1-b858-7a2ea04ca724 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:21.238446 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 654/1351] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Oct 27 09:05:20 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6/os-interface => generated 1833 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:21.240151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e0441d-cbdc-44c1-b858-7a2ea04ca724 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:21.240926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e0441d-cbdc-44c1-b858-7a2ea04ca724 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:21.247267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e0441d-cbdc-44c1-b858-7a2ea04ca724 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:21.313079 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98e0441d-cbdc-44c1-b858-7a2ea04ca724 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112998 Oct 27 09:05:21.315829 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 698/1352] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:21 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:21.994033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:21.994650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:22.009505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.011745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.012459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.015709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.017934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.018896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.223166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:22.224016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:22.239321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.240895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.241366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.242093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.243357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.245085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.399081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:22.410983 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3f7d466e-6c02-4482-91ed-fe4ffb4dd292 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1471 microversion: 2.1 time: 0.422393 Oct 27 09:05:22.411603 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 655/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:21 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:22.418637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbd3d409-8d0b-451b-a711-3ea64282e97c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:22.422126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dbd3d409-8d0b-451b-a711-3ea64282e97c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:22.431544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd3d409-8d0b-451b-a711-3ea64282e97c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.432292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd3d409-8d0b-451b-a711-3ea64282e97c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.432929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd3d409-8d0b-451b-a711-3ea64282e97c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.433807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd3d409-8d0b-451b-a711-3ea64282e97c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.434418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd3d409-8d0b-451b-a711-3ea64282e97c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.435074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd3d409-8d0b-451b-a711-3ea64282e97c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.439160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:22.449792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:22.452521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:22.458215 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5ed6d0e-d636-43b1-9af6-6e5f11bc6759 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.239595 Oct 27 09:05:22.476602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbd3d409-8d0b-451b-a711-3ea64282e97c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063819 Oct 27 09:05:22.477925 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 656/1354] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:22 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:22.479743 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 699/1355] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:22 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:22.486131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b1ad0ff-135e-4ef4-84d1-1abe9250bd09 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:22.488194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b1ad0ff-135e-4ef4-84d1-1abe9250bd09 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:22.497242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1ad0ff-135e-4ef4-84d1-1abe9250bd09 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.498510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1ad0ff-135e-4ef4-84d1-1abe9250bd09 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.499917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1ad0ff-135e-4ef4-84d1-1abe9250bd09 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.501324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1ad0ff-135e-4ef4-84d1-1abe9250bd09 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.502019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1ad0ff-135e-4ef4-84d1-1abe9250bd09 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.502650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b1ad0ff-135e-4ef4-84d1-1abe9250bd09 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.685827 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b1ad0ff-135e-4ef4-84d1-1abe9250bd09 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "POST /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7/action" status: 202 len: 0 microversion: 2.1 time: 0.205295 Oct 27 09:05:22.687178 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 657/1356] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:05:22 2022] POST /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:05:22.697565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:22.699715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:22.706874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.707364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.717284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.723434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:22.724019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:22.724466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:22.805837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:23.491932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:23.494108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:23.506028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:23.508006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:23.508672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:23.509688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:23.510399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:23.511088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:23.628821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:23.642515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:23.649356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:23.669772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:23.673380 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1a935ab-09b4-433d-9a12-467a5db61cff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.179592 Oct 27 09:05:23.681256 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-784fb739-d42c-4c47-a6aa-fe58b8af1c99 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1470 microversion: 2.1 time: 0.989939 Oct 27 09:05:23.682499 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 658/1357] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:23 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:23.684468 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 700/1358] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:22 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1470 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:23.690698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4398c2d-600e-41e5-9626-2a363ba1b8be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:23.692931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b4398c2d-600e-41e5-9626-2a363ba1b8be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:23.705401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c10fbe63-2a13-4d08-8aa8-f6bcb3c86ca3 req-28ca7467-9264-46cf-9650-481284bd4d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "tag": "81294aa2-0c23-45a5-81ca-6872462ae6d3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:23.725187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4398c2d-600e-41e5-9626-2a363ba1b8be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:23.726814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4398c2d-600e-41e5-9626-2a363ba1b8be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:23.728332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4398c2d-600e-41e5-9626-2a363ba1b8be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:23.735707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c10fbe63-2a13-4d08-8aa8-f6bcb3c86ca3 req-28ca7467-9264-46cf-9650-481284bd4d83 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:23.736425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4398c2d-600e-41e5-9626-2a363ba1b8be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:23.737088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4398c2d-600e-41e5-9626-2a363ba1b8be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:23.737769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c10fbe63-2a13-4d08-8aa8-f6bcb3c86ca3 req-28ca7467-9264-46cf-9650-481284bd4d83 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:23.739493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c10fbe63-2a13-4d08-8aa8-f6bcb3c86ca3 req-28ca7467-9264-46cf-9650-481284bd4d83 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:23.739782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4398c2d-600e-41e5-9626-2a363ba1b8be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:23.759080 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c10fbe63-2a13-4d08-8aa8-f6bcb3c86ca3 req-28ca7467-9264-46cf-9650-481284bd4d83 service nova] Creating event network-changed:81294aa2-0c23-45a5-81ca-6872462ae6d3 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:05:23.766097 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c10fbe63-2a13-4d08-8aa8-f6bcb3c86ca3 req-28ca7467-9264-46cf-9650-481284bd4d83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078860 Oct 27 09:05:23.767886 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 701/1359] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:23.773665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5edefaa6-b4e2-4d02-a5a8-16033128ce35 req-c8c95d46-8841-4c37-a9c9-46c293aa44db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a988a0df-4f91-4497-a599-e7e19c636ac7", "name": "network-vif-plugged", "status": "completed", "tag": "b5279136-9006-4596-a97a-bc6367ac28b6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:23.809279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5edefaa6-b4e2-4d02-a5a8-16033128ce35 req-c8c95d46-8841-4c37-a9c9-46c293aa44db service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:23.810818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5edefaa6-b4e2-4d02-a5a8-16033128ce35 req-c8c95d46-8841-4c37-a9c9-46c293aa44db service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:23.811454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5edefaa6-b4e2-4d02-a5a8-16033128ce35 req-c8c95d46-8841-4c37-a9c9-46c293aa44db service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:23.816461 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b4398c2d-600e-41e5-9626-2a363ba1b8be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132583 Oct 27 09:05:23.830573 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 659/1360] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:23 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:05:23.836482 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5edefaa6-b4e2-4d02-a5a8-16033128ce35 req-c8c95d46-8841-4c37-a9c9-46c293aa44db service nova] Creating event network-vif-plugged:b5279136-9006-4596-a97a-bc6367ac28b6 for instance a988a0df-4f91-4497-a599-e7e19c636ac7 on n-h2-858383-16 Oct 27 09:05:23.853291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-5edefaa6-b4e2-4d02-a5a8-16033128ce35 req-c8c95d46-8841-4c37-a9c9-46c293aa44db service nova] Instance a988a0df-4f91-4497-a599-e7e19c636ac7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:05:23.877720 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-5edefaa6-b4e2-4d02-a5a8-16033128ce35 req-c8c95d46-8841-4c37-a9c9-46c293aa44db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107794 Oct 27 09:05:23.878665 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 702/1361] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:24.724054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:24.725295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:24.734720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:24.736332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:24.740349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:24.740847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:24.742518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:24.742518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:24.742518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:24.742855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:24.752010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:24.752785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:24.753966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:24.755892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:24.757882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:24.758606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:25.163746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:25.173539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:25.192714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:25.209529 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3a6018a-1a83-4d04-b242-457c608c0f70 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.480837 Oct 27 09:05:25.210373 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 703/1362] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:24 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:25.234704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-924b063d-9f8f-428b-9bc2-4a26b17eac33 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa17f820>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:25.335524 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-924b063d-9f8f-428b-9bc2-4a26b17eac33 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/b1a069bd-936e-487d-b7d7-b7766dad2ebf" status: 200 len: 661 microversion: 2.1 time: 0.122151 Oct 27 09:05:25.348078 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 704/1363] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:05:25 2022] GET /compute/v2.1/images/b1a069bd-936e-487d-b7d7-b7766dad2ebf => generated 661 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:25.654198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:25.675980 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8c88a15-4c69-4253-960d-c093ca98fbf9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1470 microversion: 2.1 time: 0.955536 Oct 27 09:05:25.679376 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 660/1364] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:24 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1470 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:25.707473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f2bc4da3-867b-43db-963e-c91b47a430bb tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa019160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:25.801834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cbb0a83c-1b00-4fcf-8e65-f16eff3c0533"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:25.806007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:25.826907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:25.827758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:25.828565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:25.829458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:25.830083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:25.830674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:25.842435 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f2bc4da3-867b-43db-963e-c91b47a430bb tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/b1a069bd-936e-487d-b7d7-b7766dad2ebf" status: 200 len: 661 microversion: 2.1 time: 0.159206 Oct 27 09:05:25.843387 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 661/1365] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:05:25 2022] GET /compute/v2.1/images/b1a069bd-936e-487d-b7d7-b7766dad2ebf => generated 661 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:26.062700 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] HTTP exception thrown: Volume cbb0a83c-1b00-4fcf-8e65-f16eff3c0533 could not be found. Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Request method failure captured: Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments/a572cef7-1104-4485-9370-9159b108c5f8 HTTP/1.1 Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 74 Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWklRg2zJDtgq7l0sYI5S7nctW1l5KdKq3Es0jejvzdickkoOsMBTMcNaW4G-0rB6ehv8XxDg2n5Nc1DBKxRtffqPtjr5MXQaEmsxi4-OShM3tpS8UtPkUwCRHgtWqiAksKPnGSfAa_6vyCgId_FxfM9kpnupSv-xb53bSHT6-BgytlE Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bcb425f81b8a468b8b1abc58aa1ac750 Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesAdminNegativeTest-1338843527 Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bcb425f81b8a468b8b1abc58aa1ac750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bcb425f81b8a468b8b1abc58aa1ac750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bcb425f81b8a468b8b1abc58aa1ac750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bcb425f81b8a468b8b1abc58aa1ac750"}]}] Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesAdminNegativeTest-1338843527 Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bcb425f81b8a468b8b1abc58aa1ac750 Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1338843527 Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesAdminNegativeTest-1338843527-project-admin Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: bd7671dc2aa44d71be38011c8abcbf8c Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesAdminNegativeTest-1338843527-project-admin Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: {"volumeAttachment": {"volumeId": "cbb0a83c-1b00-4fcf-8e65-f16eff3c0533"}} Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: exception: Volume cbb0a83c-1b00-4fcf-8e65-f16eff3c0533 could not be found. Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'server_id': '84aa1ad4-354f-4ad7-b54c-4ee8e96950e6', 'id': 'a572cef7-1104-4485-9370-9159b108c5f8', 'body': {'volumeAttachment': {'volumeId': 'cbb0a83c-1b00-4fcf-8e65-f16eff3c0533'}}} Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cbb0a83c-1b00-4fcf-8e65-f16eff3c0533 could not be found. (HTTP 404) (Request-ID: req-8466b6e7-8374-4ce4-8dfb-31b8790b8d20) Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:05:26.069137 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cbb0a83c-1b00-4fcf-8e65-f16eff3c0533 could not be found. Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume cbb0a83c-1b00-4fcf-8e65-f16eff3c0533 could not be found. Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cbb0a83c-1b00-4fcf-8e65-f16eff3c0533 could not be found. Oct 27 09:05:26.073546 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:05:26.079514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Returning 400 to user: Volume cbb0a83c-1b00-4fcf-8e65-f16eff3c0533 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:05:26.080649 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-adf9b429-c30e-41f1-b919-80aa718deb71 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments/a572cef7-1104-4485-9370-9159b108c5f8" status: 400 len: 107 microversion: 2.1 time: 0.731153 Oct 27 09:05:26.082874 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 705/1366] 10.222.0.25 () {60 vars in 1433 bytes} [Thu Oct 27 09:05:25 2022] PUT /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments/a572cef7-1104-4485-9370-9159b108c5f8 => generated 107 bytes in 734 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:05:26.236610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:26.237622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:26.244231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:26.245276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:26.252499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:26.255738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:26.257858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:26.258587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:26.259550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:26.261539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:26.261999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:26.262614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:26.263545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:26.264036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:26.264645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:26.271346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:26.522064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:26.547164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:26.551261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:26.583006 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ef716955-19bb-4650-ba26-6c563caa3744 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.336462 Oct 27 09:05:26.583940 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 706/1367] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:26 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:26.684039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lazy-loading 'services' on Instance uuid 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:26.707366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:26.708422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:26.717267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:26.718139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:26.721943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:26.726786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:26.727482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:26.727953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:26.871234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:26.889095 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef6af4dc-bcd2-4be6-bf2c-c5b4183432f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments/a572cef7-1104-4485-9370-9159b108c5f8" status: 202 len: 0 microversion: 2.1 time: 0.657097 Oct 27 09:05:26.889695 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 662/1368] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:05:26 2022] DELETE /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments/a572cef7-1104-4485-9370-9159b108c5f8 => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:05:26.899053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-476c4d28-8b0d-4b1c-b990-e1f1f7a22f48 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:26.901423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-476c4d28-8b0d-4b1c-b990-e1f1f7a22f48 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:26.917090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-476c4d28-8b0d-4b1c-b990-e1f1f7a22f48 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:26.917879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-476c4d28-8b0d-4b1c-b990-e1f1f7a22f48 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:26.918767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-476c4d28-8b0d-4b1c-b990-e1f1f7a22f48 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:26.919726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-476c4d28-8b0d-4b1c-b990-e1f1f7a22f48 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:26.920358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-476c4d28-8b0d-4b1c-b990-e1f1f7a22f48 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:26.920976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-476c4d28-8b0d-4b1c-b990-e1f1f7a22f48 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:26.931493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:26.940638 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5408c851-f132-407c-ba86-594cb5e22964 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1470 microversion: 2.1 time: 0.241660 Oct 27 09:05:26.941841 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 707/1369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:26 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:26.978996 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-476c4d28-8b0d-4b1c-b990-e1f1f7a22f48 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084671 Oct 27 09:05:26.979638 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 663/1370] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:26 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:05:27.473298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cdb1c1d2-5882-4bdc-bf4f-7d2a6a74fd61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa2bcc10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:27.566278 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cdb1c1d2-5882-4bdc-bf4f-7d2a6a74fd61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/b5d7061f-63c9-48a1-8061-18c94e133702" status: 200 len: 662 microversion: 2.1 time: 0.096891 Oct 27 09:05:27.567266 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 708/1371] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:05:27 2022] GET /compute/v2.1/images/b5d7061f-63c9-48a1-8061-18c94e133702 => generated 662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:27.580909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9387720-2bf5-4e64-9b7a-a28d6fb80f7d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa07a1f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:27.614264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:27.615153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:27.625046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:27.632848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:27.636111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:27.638640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:27.639436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:27.640103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:27.650864 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9387720-2bf5-4e64-9b7a-a28d6fb80f7d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/b5d7061f-63c9-48a1-8061-18c94e133702" status: 200 len: 662 microversion: 2.1 time: 0.073726 Oct 27 09:05:27.660111 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 664/1372] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:05:27 2022] GET /compute/v2.1/images/b5d7061f-63c9-48a1-8061-18c94e133702 => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:27.809064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:27.829498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:27.834504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:27.850181 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-810954e3-eb30-4c2c-b680-d06c913f0c29 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.241132 Oct 27 09:05:27.864206 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 709/1373] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:27 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:27.973988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:27.975755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:27.984726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:27.994520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-426b0955-6e1d-4d76-923c-4509633ef926 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:27.999935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-426b0955-6e1d-4d76-923c-4509633ef926 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:28.003230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:28.008745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:28.028214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:28.029328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:28.033068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:28.033909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:28.048506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426b0955-6e1d-4d76-923c-4509633ef926 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:28.049185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426b0955-6e1d-4d76-923c-4509633ef926 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:28.054424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426b0955-6e1d-4d76-923c-4509633ef926 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:28.055200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426b0955-6e1d-4d76-923c-4509633ef926 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:28.062516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426b0955-6e1d-4d76-923c-4509633ef926 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:28.063059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426b0955-6e1d-4d76-923c-4509633ef926 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:28.174902 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-426b0955-6e1d-4d76-923c-4509633ef926 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185038 Oct 27 09:05:28.188998 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 710/1374] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:27 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:28.431091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:28.443013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9d41c7b-20c2-4fd1-9ab1-931b4387deea tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1470 microversion: 2.1 time: 0.477259 Oct 27 09:05:28.460280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 665/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:27 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1470 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:28.881307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:28.882283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:28.892854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:28.905313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:28.909285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:28.910300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:28.911180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:28.912034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:29.083191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:29.096384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:29.101137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:29.110839 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-758fa606-3fbf-49ed-9b23-a34f0a105590 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.235201 Oct 27 09:05:29.113433 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 711/1376] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:28 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:29.189198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb82494f-a5bb-4fe3-9526-2e29855bb781 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:29.192501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb82494f-a5bb-4fe3-9526-2e29855bb781 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:29.226341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb82494f-a5bb-4fe3-9526-2e29855bb781 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:29.227050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb82494f-a5bb-4fe3-9526-2e29855bb781 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:29.227696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb82494f-a5bb-4fe3-9526-2e29855bb781 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:29.228862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb82494f-a5bb-4fe3-9526-2e29855bb781 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:29.229742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb82494f-a5bb-4fe3-9526-2e29855bb781 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:29.230336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb82494f-a5bb-4fe3-9526-2e29855bb781 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:29.275242 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb82494f-a5bb-4fe3-9526-2e29855bb781 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090461 Oct 27 09:05:29.276547 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 666/1377] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:29 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:29.402616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-871737bf-78ee-470a-9b9b-3fa9c60dd456 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0d4550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:29.469656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:29.471108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:29.484960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:29.485470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:29.487647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:29.489577 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-871737bf-78ee-470a-9b9b-3fa9c60dd456 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/605e0a09-e169-4bfd-9724-8815495b253a" status: 200 len: 662 microversion: 2.1 time: 0.090550 Oct 27 09:05:29.490162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:29.490682 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 712/1378] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:05:29 2022] GET /compute/v2.1/images/605e0a09-e169-4bfd-9724-8815495b253a => generated 662 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:29.492522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:29.492973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:29.504398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59ffb9ab-93e4-4090-a128-bb46d2dbf84c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa175550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:29.580144 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59ffb9ab-93e4-4090-a128-bb46d2dbf84c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/605e0a09-e169-4bfd-9724-8815495b253a" status: 200 len: 662 microversion: 2.1 time: 0.079338 Oct 27 09:05:29.581952 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 713/1379] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:05:29 2022] GET /compute/v2.1/images/605e0a09-e169-4bfd-9724-8815495b253a => generated 662 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:29.721329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1064500301", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:29.748551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:29.773741 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9242b7f5-83d0-4ec0-b8b5-24222afe4d78 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1470 microversion: 2.1 time: 0.306877 Oct 27 09:05:29.788078 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 667/1380] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:29 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:29.822474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:05:30.141632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:30.142367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:30.158402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:30.158916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:30.159368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:30.160137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:30.160596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:30.161219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:30.394556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:30.410101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:30.418617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:30.439353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-69ba5f66-ef9a-49ce-8607-bbed9f8b8c31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.304296 Oct 27 09:05:30.443025 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 668/1381] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:30 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:30.454325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad6b575f-fc9e-4dd5-b8b5-e2efa01b5217 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:30.460004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad6b575f-fc9e-4dd5-b8b5-e2efa01b5217 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:30.478674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad6b575f-fc9e-4dd5-b8b5-e2efa01b5217 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:30.479792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad6b575f-fc9e-4dd5-b8b5-e2efa01b5217 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:30.480435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad6b575f-fc9e-4dd5-b8b5-e2efa01b5217 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:30.482285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad6b575f-fc9e-4dd5-b8b5-e2efa01b5217 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:30.485922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad6b575f-fc9e-4dd5-b8b5-e2efa01b5217 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:30.487967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad6b575f-fc9e-4dd5-b8b5-e2efa01b5217 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:30.576268 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad6b575f-fc9e-4dd5-b8b5-e2efa01b5217 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130032 Oct 27 09:05:30.578879 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 669/1382] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:30 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:30.802039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:30.802671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:30.815824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:30.823586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:30.824357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:30.825850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:30.827109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:30.827555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:31.308627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:05:31.311070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:05:31.311799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:05:31.312431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:05:31.316981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:05:31.322426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:31.339033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:31.347557 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8aa9675-8e2a-45e9-aaa8-951e564f3d1f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1470 microversion: 2.1 time: 0.549953 Oct 27 09:05:31.348391 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 670/1383] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:30 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1470 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:31.359811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:31.359811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:31.359811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:31.359811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:31.359811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:31.387403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Getting quotas for project ce2cb516397542a1b9ffa3d8d9dd0499. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:05:31.401915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Getting quotas for user d6c4e0fe197a41fdaab411474b35aff5 and project ce2cb516397542a1b9ffa3d8d9dd0499. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:05:31.427808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:05:31.432793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:05:31.455826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c09a301-e6ce-45cc-acb6-023a796fb8fe tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'create', calling method: .version_select at 0x7f31aa25d700>, body: {"keypair": {"name": "tempest-keypair-717960891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEO0f/oZVuDJTaCTAtgJEHa/guYLIe9NO/rb/WotY9ChnOVFe1l/kli/S8/eyLzLU2jQzZLOVBfIfmDiYoLz+0FjrrLPtKN7Q86aBV2cntKoaU75u751yxAayZu9MIK6yA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:31.491978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4c09a301-e6ce-45cc-acb6-023a796fb8fe tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Getting quotas for project 1babaa8dc02a4a04b18cbe0fe7ef5377. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:05:31.499232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4c09a301-e6ce-45cc-acb6-023a796fb8fe tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Getting quotas for user 0e5cea258c34423e82b53d552b21239f and project 1babaa8dc02a4a04b18cbe0fe7ef5377. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:05:31.540035 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4c09a301-e6ce-45cc-acb6-023a796fb8fe tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.178100 Oct 27 09:05:31.553879 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-36ff2616-9d1e-461f-81f6-59d51e58229c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.836214 Oct 27 09:05:31.555763 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 714/1384] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:05:31.560513 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 671/1385] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Oct 27 09:05:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:05:31.573245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:31.573971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:31.585607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:31.586825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:31.587788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:31.591923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f99cc1d-7a45-461d-90ea-804dc6fe2e3a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:31.594810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f99cc1d-7a45-461d-90ea-804dc6fe2e3a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:31.595839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:31.596530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:31.597432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:31.626923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f99cc1d-7a45-461d-90ea-804dc6fe2e3a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:31.634561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f99cc1d-7a45-461d-90ea-804dc6fe2e3a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:31.635700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f99cc1d-7a45-461d-90ea-804dc6fe2e3a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:31.636707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f99cc1d-7a45-461d-90ea-804dc6fe2e3a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:31.637403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f99cc1d-7a45-461d-90ea-804dc6fe2e3a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:31.638381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f99cc1d-7a45-461d-90ea-804dc6fe2e3a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:31.725356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f99cc1d-7a45-461d-90ea-804dc6fe2e3a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137941 Oct 27 09:05:31.730725 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 672/1386] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:31 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:31.745663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1492207404", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:31.762321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:31.785238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:31.794038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:31.807011 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cfaa01fc-e450-449d-a6f2-8792de9f7a47 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.249459 Oct 27 09:05:31.807931 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 715/1387] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:31 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:31.956551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:05:32.374468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:32.375202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:32.394221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:32.396801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:32.398059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:32.400074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:32.401674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:32.402416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:32.797128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:05:32.798157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:05:32.800721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:05:32.801716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:05:32.802584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:05:32.907050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:32.908172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:32.910916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:32.913071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:32.913977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:32.915954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:32.981211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Getting quotas for project ce2cb516397542a1b9ffa3d8d9dd0499. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:05:33.000425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Getting quotas for user d6c4e0fe197a41fdaab411474b35aff5 and project ce2cb516397542a1b9ffa3d8d9dd0499. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:05:33.024726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:05:33.028275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:05:33.201100 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49d0bd69-edd6-4641-a387-ac47ad8b4ef9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464511 Oct 27 09:05:33.237716 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 673/1388] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:05:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:05:33.244766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:33.266832 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-715d6c92-e6ed-4c24-8612-a4c0b4bfe86f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1470 microversion: 2.1 time: 0.897361 Oct 27 09:05:33.276520 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 716/1389] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:32 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1470 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:33.291309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc420163-2813-4a03-81d6-36d8bcf74409 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:33.312506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc420163-2813-4a03-81d6-36d8bcf74409 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:33.340028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc420163-2813-4a03-81d6-36d8bcf74409 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:33.348183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc420163-2813-4a03-81d6-36d8bcf74409 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:33.349128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc420163-2813-4a03-81d6-36d8bcf74409 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:33.357268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc420163-2813-4a03-81d6-36d8bcf74409 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:33.358168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc420163-2813-4a03-81d6-36d8bcf74409 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:33.359405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc420163-2813-4a03-81d6-36d8bcf74409 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:33.398089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-010ae849-218c-4af9-9ad2-7e86c4d99721 req-ea5918d3-2cf6-41b8-8cd7-b12bb515ff15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a988a0df-4f91-4497-a599-e7e19c636ac7", "name": "network-vif-unplugged", "status": "completed", "tag": "b5279136-9006-4596-a97a-bc6367ac28b6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:33.424171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-010ae849-218c-4af9-9ad2-7e86c4d99721 req-ea5918d3-2cf6-41b8-8cd7-b12bb515ff15 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:33.426116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-010ae849-218c-4af9-9ad2-7e86c4d99721 req-ea5918d3-2cf6-41b8-8cd7-b12bb515ff15 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:33.428882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-010ae849-218c-4af9-9ad2-7e86c4d99721 req-ea5918d3-2cf6-41b8-8cd7-b12bb515ff15 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:33.469232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-010ae849-218c-4af9-9ad2-7e86c4d99721 req-ea5918d3-2cf6-41b8-8cd7-b12bb515ff15 service nova] Creating event network-vif-unplugged:b5279136-9006-4596-a97a-bc6367ac28b6 for instance a988a0df-4f91-4497-a599-e7e19c636ac7 on n-h1-858383-16 Oct 27 09:05:33.481962 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc420163-2813-4a03-81d6-36d8bcf74409 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195959 Oct 27 09:05:33.487754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 717/1390] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:33 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:33.492126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-010ae849-218c-4af9-9ad2-7e86c4d99721 req-ea5918d3-2cf6-41b8-8cd7-b12bb515ff15 service nova] Instance a988a0df-4f91-4497-a599-e7e19c636ac7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:05:33.503932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:33.505473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:33.518006 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-010ae849-218c-4af9-9ad2-7e86c4d99721 req-ea5918d3-2cf6-41b8-8cd7-b12bb515ff15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.278104 Oct 27 09:05:33.524739 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 674/1391] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:33.530011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:33.532559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:33.536433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:33.538479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:33.542129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:33.545141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:33.545696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2cbd84d7-fec8-4b5f-a9b6-9cac53917428 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:33.546557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2cbd84d7-fec8-4b5f-a9b6-9cac53917428 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:33.767829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2cbd84d7-fec8-4b5f-a9b6-9cac53917428 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:33.779838 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2cbd84d7-fec8-4b5f-a9b6-9cac53917428 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1218 microversion: 2.1 time: 0.251114 Oct 27 09:05:33.784152 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 675/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:33 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:33.795643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:33.796578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:33.828261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:33.832801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:33.836321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:33.843725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:33.844229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:33.844787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:33.868029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:33.888605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:33.890348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:33.908844 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-914aa698-eac4-4bfe-a8ca-c2663d1e2dc6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.423080 Oct 27 09:05:33.912997 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 718/1393] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:33 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:34.173571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:34.246168 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6f87e19-8b72-49df-bd43-99c414ee8e82 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 2426 microversion: 2.25 time: 0.460053 Oct 27 09:05:34.251448 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 676/1394] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:33 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 2426 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:34.282705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-16", "block_migration": "auto"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:34.289400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:34.300066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:34.301501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:34.332699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:34.343101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:34.343870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:34.344621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:34.346178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:34.359171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:34.360345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:34.368925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:34.369902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:34.370635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:34.372775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:34.375705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:34.477106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'flavor' on Instance uuid f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:34.516516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Going to try to live migrate instance to n-h1-858383-16 {{(pid=120602) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:05:35.038159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:35.048786 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf7736f3-b2d5-4297-b616-4c8948abc305 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1470 microversion: 2.1 time: 0.753470 Oct 27 09:05:35.060629 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 677/1395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:34 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1470 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:35.066530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a7abc20-f641-4c54-bf02-105f16ed1990 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:35.069398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0a7abc20-f641-4c54-bf02-105f16ed1990 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:35.081761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a7abc20-f641-4c54-bf02-105f16ed1990 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:35.085185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a7abc20-f641-4c54-bf02-105f16ed1990 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:35.085888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a7abc20-f641-4c54-bf02-105f16ed1990 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:35.086857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a7abc20-f641-4c54-bf02-105f16ed1990 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:35.100290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a7abc20-f641-4c54-bf02-105f16ed1990 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:35.101236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a7abc20-f641-4c54-bf02-105f16ed1990 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:35.181087 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a7abc20-f641-4c54-bf02-105f16ed1990 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118610 Oct 27 09:05:35.191001 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 678/1396] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:35 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:35.198044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:35.204000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:35.211350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:35.218483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:35.219184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:35.220192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:35.220889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:35.221567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:35.386888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:35.396904 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51d17a97-a9a0-4110-b696-aa34c23c4071 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1270 microversion: 2.1 time: 0.204651 Oct 27 09:05:35.405658 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 679/1397] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:35 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:35.415632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:35.419916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:35.438938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:35.444833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:35.445477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:35.449342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:35.450929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:35.453380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:35.662448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:35.689851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:35.697231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:35.711123 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63cf1ee2-f11e-4233-a0bf-fced9fdb2056 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.302282 Oct 27 09:05:35.712378 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 680/1398] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:35 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:35.728720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1809838356", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f506d926-48c7-451d-8629-5f6d284c2bd3"}], "security_groups": [{"name": "tempest-securitygroup--118968425"}], "key_name": "tempest-keypair-717960891", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:36.041179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] validate_networks() for [('f506d926-48c7-451d-8629-5f6d284c2bd3', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:05:37.693047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:05:37.694276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:05:37.694859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:05:37.695337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:05:37.695853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:05:37.709175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:37.709746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:37.712008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:37.713456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:37.713939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:37.714864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:37.750928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Getting quotas for project 1babaa8dc02a4a04b18cbe0fe7ef5377. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:05:37.758229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Getting quotas for user 0e5cea258c34423e82b53d552b21239f and project 1babaa8dc02a4a04b18cbe0fe7ef5377. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:05:37.777023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:05:37.780691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:05:37.860211 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aefe0955-8700-4bd1-b6e8-b5773153e11b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.136643 Oct 27 09:05:37.872201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 681/1399] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:05:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:05:37.883305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-045e75fc-9d8e-4111-bc7f-89c8d65e10df req-f714b697-4cd9-4e9f-9a87-2159f28db52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a988a0df-4f91-4497-a599-e7e19c636ac7", "tag": "b5279136-9006-4596-a97a-bc6367ac28b6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:37.900511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-045e75fc-9d8e-4111-bc7f-89c8d65e10df req-f714b697-4cd9-4e9f-9a87-2159f28db52e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:37.901104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-045e75fc-9d8e-4111-bc7f-89c8d65e10df req-f714b697-4cd9-4e9f-9a87-2159f28db52e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:37.901636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-045e75fc-9d8e-4111-bc7f-89c8d65e10df req-f714b697-4cd9-4e9f-9a87-2159f28db52e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:37.922433 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-045e75fc-9d8e-4111-bc7f-89c8d65e10df req-f714b697-4cd9-4e9f-9a87-2159f28db52e service nova] Creating event network-changed:b5279136-9006-4596-a97a-bc6367ac28b6 for instance a988a0df-4f91-4497-a599-e7e19c636ac7 on n-h1-858383-16 Oct 27 09:05:37.936423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-045e75fc-9d8e-4111-bc7f-89c8d65e10df req-f714b697-4cd9-4e9f-9a87-2159f28db52e service nova] Instance a988a0df-4f91-4497-a599-e7e19c636ac7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:05:37.951117 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-045e75fc-9d8e-4111-bc7f-89c8d65e10df req-f714b697-4cd9-4e9f-9a87-2159f28db52e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077371 Oct 27 09:05:37.953907 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 682/1400] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:37.966476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:37.967696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:37.977408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:37.978254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:37.978899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:37.979838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:37.980487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:37.981430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:38.451814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:38.464516 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8a38bf52-bc20-40ef-945d-ad04fef0e4e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1470 microversion: 2.1 time: 0.508859 Oct 27 09:05:38.466881 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 683/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:37 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1470 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:38.474242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f0525c8-d2a5-407c-80f4-1d8e3e322f70 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:38.481067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f0525c8-d2a5-407c-80f4-1d8e3e322f70 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:38.509072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0525c8-d2a5-407c-80f4-1d8e3e322f70 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:38.509573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0525c8-d2a5-407c-80f4-1d8e3e322f70 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:38.510017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0525c8-d2a5-407c-80f4-1d8e3e322f70 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:38.510736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0525c8-d2a5-407c-80f4-1d8e3e322f70 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:38.511188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0525c8-d2a5-407c-80f4-1d8e3e322f70 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:38.517092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0525c8-d2a5-407c-80f4-1d8e3e322f70 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:38.533061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:38.603510 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f0525c8-d2a5-407c-80f4-1d8e3e322f70 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135566 Oct 27 09:05:38.604142 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 684/1402] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:05:38 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:05:38.616813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:38.619430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:38.626834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:38.627680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:38.628646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:38.629521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:38.630140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:38.631120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:39.004294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:39.015883 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5f9c624-45f2-4aa3-a6eb-be489323d804 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.409423 Oct 27 09:05:39.027604 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 685/1403] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:38 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:39.027604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:39.027604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:39.029434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:39.030263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:39.030885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:39.032145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:39.032778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:39.033208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:39.105506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:39.115409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:39.117607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:39.122986 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3b66a52-6d97-4dff-bc23-09e59a1d2902 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.105015 Oct 27 09:05:39.132513 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 686/1404] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:39 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:39.132513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:39.132513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:39.135165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:39.135673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:39.136561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:39.136935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:39.138025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:39.138477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:39.228197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:39.241619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:39.243446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:39.244899 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cadae7b9-053a-4bc5-ae79-af83f3fb141c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1285 microversion: 2.20 time: 0.120199 Oct 27 09:05:39.252477 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 687/1405] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:39 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:39.259263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1894593553", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "29aab344-ab67-47ba-a004-014083ac1f17"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:39.331387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] validate_networks() for [('29aab344-ab67-47ba-a004-014083ac1f17', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:05:40.645991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:05:40.646668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:05:40.646954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:05:40.647628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:05:40.648023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:05:40.671660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:40.673501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:40.674126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:40.675033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:40.675691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:40.676295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:40.697911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Getting quotas for project c3cdafcecdff4fe2bad2db76c806bcf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:05:40.703853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:40.705077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Getting quotas for user 1415fa5593bd4614988fcc604442d0c0 and project c3cdafcecdff4fe2bad2db76c806bcf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:05:40.729437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:05:40.731800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:05:40.791937 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5059bbdf-99a1-4151-8b09-fc0b14de405f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545002 Oct 27 09:05:40.793009 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 688/1406] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:05:40.798788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:40.799664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:40.807079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:40.807896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:40.808772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:40.810470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:40.811166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:40.821260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:41.370011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:41.412746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:41.728779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:41.744392 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f9fe5d7-2502-4f03-b30d-140410367477 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1463 microversion: 2.1 time: 0.949849 Oct 27 09:05:41.744981 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 689/1407] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:40 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1463 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:41.761765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:41.762652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:41.770659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:41.772003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:41.773294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:41.774331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:41.775094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:41.776538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:41.928669 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-290ad507-d683-4a4c-9701-a00de91c9fa5 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/action" status: 202 len: 0 microversion: 2.25 time: 7.650422 Oct 27 09:05:41.932427 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 719/1408] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:05:34 2022] POST /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/action => generated 0 bytes in 7657 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:05:41.953267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:41.954610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:41.992355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:41.993582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:41.995467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:41.999624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:42.002447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:42.004039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:42.304464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:42.315038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:42.319374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:42.332466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:42.354600 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2715ed4e-cb93-495b-a609-76b966f3fa12 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.419072 Oct 27 09:05:42.358331 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 720/1409] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:41 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:42.372709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:42.373953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:42.387975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:42.389756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:42.390230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:42.393751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:42.395389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:42.398632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:42.608693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:42.627654 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9223848f-6b26-413b-9abb-2fe9b19e38b5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.881068 Oct 27 09:05:42.639961 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 690/1410] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:41 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:42.645902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cd5062f3-2e2d-4851-abb6-7d01c0ae7d31 req-3c049b73-9a95-4666-969b-4b6638c7971b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d645fadc-59fa-44d8-aee6-1b98f0013de3", "tag": "bfbf5e11-af5f-410d-a0c1-a17a8f0be57c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:42.669880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cd5062f3-2e2d-4851-abb6-7d01c0ae7d31 req-3c049b73-9a95-4666-969b-4b6638c7971b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:42.671780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cd5062f3-2e2d-4851-abb6-7d01c0ae7d31 req-3c049b73-9a95-4666-969b-4b6638c7971b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:42.672686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cd5062f3-2e2d-4851-abb6-7d01c0ae7d31 req-3c049b73-9a95-4666-969b-4b6638c7971b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:42.700127 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cd5062f3-2e2d-4851-abb6-7d01c0ae7d31 req-3c049b73-9a95-4666-969b-4b6638c7971b service nova] Creating event network-changed:bfbf5e11-af5f-410d-a0c1-a17a8f0be57c for instance d645fadc-59fa-44d8-aee6-1b98f0013de3 on n-h2-858383-16 Oct 27 09:05:42.718628 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cd5062f3-2e2d-4851-abb6-7d01c0ae7d31 req-3c049b73-9a95-4666-969b-4b6638c7971b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075162 Oct 27 09:05:42.720173 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 691/1411] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:42.734559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:42.736381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:42.744077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:42.744901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:42.746253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:42.749499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:42.750237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:42.753347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:42.838667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:42.852267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:42.854830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:42.857907 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3210311d-5875-4aa0-ac49-a3637fb1e0a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.498477 Oct 27 09:05:42.860553 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 721/1412] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:42 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:42.898218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:42.907980 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1af3fe8-5ae6-408c-af6e-b34eacfb8088 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1270 microversion: 2.1 time: 0.186270 Oct 27 09:05:42.927655 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 692/1413] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:42 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:42.933113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:42.933734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:42.939914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:42.940404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:42.941028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:42.941749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:42.942214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:42.942642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.122840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-615fbb95-d0c5-4a80-8e24-652818506308 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:43.124450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-615fbb95-d0c5-4a80-8e24-652818506308 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:43.135477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615fbb95-d0c5-4a80-8e24-652818506308 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.136434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615fbb95-d0c5-4a80-8e24-652818506308 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.138110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615fbb95-d0c5-4a80-8e24-652818506308 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.139193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615fbb95-d0c5-4a80-8e24-652818506308 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.140750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615fbb95-d0c5-4a80-8e24-652818506308 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.141787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-615fbb95-d0c5-4a80-8e24-652818506308 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.440857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:43.455634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:43.460662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:43.462654 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d02c703e-665a-4f3c-a403-5b8be7bf3dab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.533473 Oct 27 09:05:43.463661 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 693/1414] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:42 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:43.488068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:43.489330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:43.499034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.499806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.500497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.501415 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-615fbb95-d0c5-4a80-8e24-652818506308 tempest-MigrationsAdminTest-2075391032 tempest-MigrationsAdminTest-2075391032-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1616 microversion: 2.1 time: 0.639517 Oct 27 09:05:43.511522 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 722/1415] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:42 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1616 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:43.511813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.511813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.511813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.536399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:43.536899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:43.544165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.544771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.545268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.546058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.546586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.547087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.594689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:05:43.643721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:43.655322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:43.661063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:43.674278 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e96ea65f-8e43-47cf-8eda-48ee8ed8d3af tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.209259 Oct 27 09:05:43.675409 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 694/1416] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:43 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:43.696065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:43.696989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:43.708789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.709565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.710231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.711402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.713900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.714675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.792306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:43.802192 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3da6de3d-b2c7-43e9-8f15-d84956e4b2aa tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 204 len: 0 microversion: 2.1 time: 0.269045 Oct 27 09:05:43.807021 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 723/1417] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:05:43 2022] DELETE /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:05:43.824743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:43.825727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:43.842071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.842071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.842071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.842391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:43.843156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:43.843805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:43.975618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:43.986424 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a25436bd-e3ec-4f8d-bc54-54a208256313 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.309568 Oct 27 09:05:43.987023 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 695/1418] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:43 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:44.005900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:44.006785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:44.017119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.017612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.018235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.019164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.019853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.020717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.086045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.096627 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c09b038-afb8-4f47-b694-df0cde38015c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1469 microversion: 2.1 time: 0.279919 Oct 27 09:05:44.097925 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 724/1419] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:43 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:44.103025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:44.103859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:44.112899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.113609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.114231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.115106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.115753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.116366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.222104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.238232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-12a02061-8510-4157-a4d7-6f667269431d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1288 microversion: 2.1 time: 0.139199 Oct 27 09:05:44.238820 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 725/1420] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:44 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1288 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:44.243199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-eaedb435-3bd5-455e-bbe8-36c5222f3324 req-6a81af5b-75ba-43e9-860f-c93bcb8b1732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d248926-b23e-472b-9a1e-4b10c924758a", "tag": "c24197dc-db5d-4363-91d8-125f1e441095"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:44.254214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.264273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.264937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eaedb435-3bd5-455e-bbe8-36c5222f3324 req-6a81af5b-75ba-43e9-860f-c93bcb8b1732 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.265375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eaedb435-3bd5-455e-bbe8-36c5222f3324 req-6a81af5b-75ba-43e9-860f-c93bcb8b1732 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.265806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eaedb435-3bd5-455e-bbe8-36c5222f3324 req-6a81af5b-75ba-43e9-860f-c93bcb8b1732 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.266434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.267780 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c7f9d90-f483-438f-a3cc-25215928688f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.277508 Oct 27 09:05:44.268616 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 696/1421] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:43 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:44.287965 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-eaedb435-3bd5-455e-bbe8-36c5222f3324 req-6a81af5b-75ba-43e9-860f-c93bcb8b1732 service nova] Creating event network-changed:c24197dc-db5d-4363-91d8-125f1e441095 for instance 3d248926-b23e-472b-9a1e-4b10c924758a on n-h1-858383-16 Oct 27 09:05:44.299020 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-eaedb435-3bd5-455e-bbe8-36c5222f3324 req-6a81af5b-75ba-43e9-860f-c93bcb8b1732 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057552 Oct 27 09:05:44.300131 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 726/1422] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:44.491317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:44.492224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:44.500226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.501585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.502313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.503406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.503972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.504595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.671974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.689746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.695762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.705178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:44.706118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:44.710370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ace9a97-f3f1-46ca-b04e-75b7633fadab tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.211614 Oct 27 09:05:44.731600 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 697/1423] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:44 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:44.732000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.732000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.732000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.732000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.732000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.733440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.745606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e40aa488-8667-4823-b93f-c8b07e5b79d1 req-0b9fd528-3221-4980-a73c-3ed46c465e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f46edbb-82a0-4749-a443-02e5ca52e341", "tag": "4f73cce5-2a06-488c-8855-f44a51f4779a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:44.776568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e40aa488-8667-4823-b93f-c8b07e5b79d1 req-0b9fd528-3221-4980-a73c-3ed46c465e0b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.777076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e40aa488-8667-4823-b93f-c8b07e5b79d1 req-0b9fd528-3221-4980-a73c-3ed46c465e0b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.777527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e40aa488-8667-4823-b93f-c8b07e5b79d1 req-0b9fd528-3221-4980-a73c-3ed46c465e0b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.806684 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e40aa488-8667-4823-b93f-c8b07e5b79d1 req-0b9fd528-3221-4980-a73c-3ed46c465e0b service nova] Creating event network-changed:4f73cce5-2a06-488c-8855-f44a51f4779a for instance 1f46edbb-82a0-4749-a443-02e5ca52e341 on n-h1-858383-16 Oct 27 09:05:44.815104 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e40aa488-8667-4823-b93f-c8b07e5b79d1 req-0b9fd528-3221-4980-a73c-3ed46c465e0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074771 Oct 27 09:05:44.819454 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 698/1424] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:44.874103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.884114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.885724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:44.893016 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f56cb5ae-a4cb-4458-a690-a85a22e12f66 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.193045 Oct 27 09:05:44.894017 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 727/1425] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:44 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:44.941126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3b823d72-8fa6-4c4a-b05e-7055c4b0cd43 req-4f26c1b7-158c-4276-9da5-f753b479a670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a988a0df-4f91-4497-a599-e7e19c636ac7", "name": "network-vif-plugged", "status": "completed", "tag": "b5279136-9006-4596-a97a-bc6367ac28b6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:44.959238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b823d72-8fa6-4c4a-b05e-7055c4b0cd43 req-4f26c1b7-158c-4276-9da5-f753b479a670 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:44.960062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b823d72-8fa6-4c4a-b05e-7055c4b0cd43 req-4f26c1b7-158c-4276-9da5-f753b479a670 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:44.960900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b823d72-8fa6-4c4a-b05e-7055c4b0cd43 req-4f26c1b7-158c-4276-9da5-f753b479a670 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:44.983267 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3b823d72-8fa6-4c4a-b05e-7055c4b0cd43 req-4f26c1b7-158c-4276-9da5-f753b479a670 service nova] Creating event network-vif-plugged:b5279136-9006-4596-a97a-bc6367ac28b6 for instance a988a0df-4f91-4497-a599-e7e19c636ac7 on n-h1-858383-16 Oct 27 09:05:44.994419 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3b823d72-8fa6-4c4a-b05e-7055c4b0cd43 req-4f26c1b7-158c-4276-9da5-f753b479a670 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059670 Oct 27 09:05:44.995493 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 699/1426] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:45.010734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:45.012797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:45.023221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.028148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.028867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:45.036715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.038254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.038877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:45.123759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:45.124631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:45.132014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.132683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.133309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:45.134148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.134806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.135470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:45.318604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:45.366265 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6ea8bb24-e9e9-434a-8882-5beaaf84bfd6 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1469 microversion: 2.1 time: 0.247303 Oct 27 09:05:45.367269 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 700/1427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:45 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1469 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:45.374524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:45.375531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:45.384667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.385520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.385981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:45.386719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.387310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.387831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:45.651189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:45.667416 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5cf68ac3-4b5a-4cbc-9955-7e3f78a56cc9 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1288 microversion: 2.1 time: 0.297653 Oct 27 09:05:45.669798 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 701/1428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:45 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1288 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:45.684043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:45.688266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:45.706184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.706993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.708719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:45.709878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.710879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.715826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:45.718252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:45.728768 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0907ec2c-5c6a-41fe-8c98-a4e6f3cd96d9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.722307 Oct 27 09:05:45.753754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 728/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:45 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:45.766553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:45.768677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:45.782503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.784188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.785949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:45.789906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:45.792666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:45.793830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:46.130132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.142367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.145521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.149075 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db5a992a-dcc1-4615-a800-1051f193cb54 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.394051 Oct 27 09:05:46.154691 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 729/1430] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:45 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:46.165167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:46.167727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:46.181546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:46.186650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:46.188693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:46.188693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:46.189248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:46.189917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:46.268380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.280154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.282941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.290080 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0579695c-8966-4cec-b4c3-d6477832ed04 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.617625 Oct 27 09:05:46.292185 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 702/1431] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:45 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:46.392235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:46.393018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:46.406700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:46.408502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:46.412431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:46.413348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:46.414074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:46.414636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:46.455888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:46.702256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.721499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.723411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.730221 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-611b1636-2121-44a7-8fdb-328ea5fd3dab tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.574167 Oct 27 09:05:46.740622 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 730/1432] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:46 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:46.746952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:46.747603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:46.762734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:46.763239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:46.763712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:46.764484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:46.768323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:46.769485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:46.974230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:46.999936 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e1bbe2c7-4546-41c6-8448-638211b42617 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1469 microversion: 2.1 time: 0.612823 Oct 27 09:05:47.000551 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 703/1433] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:46 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1469 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:47.005252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:47.005873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:47.021914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:47.024851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:47.025566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:47.026649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:47.029253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:47.029879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:47.180555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.188612 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8676dc6b-2afd-4990-a3f0-277176e2e1ec tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.446790 Oct 27 09:05:47.189193 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 731/1434] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:46 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:47.194444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:47.195478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:47.209792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:47.210259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:47.210698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:47.211488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:47.214986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:47.217105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:47.250307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.261515 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe51606b-598c-4aa5-9ef2-163f80f038e4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.259488 Oct 27 09:05:47.263003 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 704/1435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:47 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:47.327530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:47.329483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:47.344508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:47.345328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:47.346037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:47.346866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:47.348032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:47.350920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:47.417306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.432261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.433774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.435608 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2fc1cc8d-ea73-4012-a3a8-87c3ab302fd9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.245107 Oct 27 09:05:47.452100 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 732/1436] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:47 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:47.592505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.610540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.613090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.614356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a14b4ff-4aaf-4687-b811-082f173f1781 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.293727 Oct 27 09:05:47.615629 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 705/1437] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:47 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:47.644289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8d99ff89-65e6-41cd-bd2a-d86e55df61ec req-57c09f92-facb-48be-a5f9-047138e10afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680796e2-1a4e-46e0-9407-742f517c7e9d", "tag": "415ccb14-ad15-4768-af9a-14128574917b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:47.661795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d99ff89-65e6-41cd-bd2a-d86e55df61ec req-57c09f92-facb-48be-a5f9-047138e10afe service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:47.662374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d99ff89-65e6-41cd-bd2a-d86e55df61ec req-57c09f92-facb-48be-a5f9-047138e10afe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:47.662879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d99ff89-65e6-41cd-bd2a-d86e55df61ec req-57c09f92-facb-48be-a5f9-047138e10afe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:47.689212 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8d99ff89-65e6-41cd-bd2a-d86e55df61ec req-57c09f92-facb-48be-a5f9-047138e10afe service nova] Creating event network-changed:415ccb14-ad15-4768-af9a-14128574917b for instance 680796e2-1a4e-46e0-9407-742f517c7e9d on n-h2-858383-16 Oct 27 09:05:47.697474 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8d99ff89-65e6-41cd-bd2a-d86e55df61ec req-57c09f92-facb-48be-a5f9-047138e10afe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056758 Oct 27 09:05:47.698750 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 733/1438] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:47.760982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:47.761585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:47.768068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:47.768542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:47.768940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:47.769641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:47.770095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:47.770520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:47.842040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.850266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.851979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:47.858990 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd8d23fd-7e58-4398-8126-e4678cd82544 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1447 microversion: 2.75 time: 0.101815 Oct 27 09:05:47.860224 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 706/1439] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:47 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:48.026356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:48.027867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:48.040236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:48.041005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:48.041616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:48.042580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:48.044804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:48.045891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:48.214246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:48.214909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:48.229299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:48.229814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:48.230266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:48.231050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:48.231532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:48.231991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:48.543920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:48.552764 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62526114-4682-4dfa-9c8c-f8f11ec55dda tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1469 microversion: 2.1 time: 0.533838 Oct 27 09:05:48.553528 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 734/1440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:48 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1469 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:48.564392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:48.571812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:48.587093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:48.587746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:48.588258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:48.589039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:48.589677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:48.590298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.048126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.062290 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e84169e-06c2-494e-b29c-225a6e49306d tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.851042 Oct 27 09:05:49.064336 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 707/1441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:48 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:49.080717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:49.083550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:49.101248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.106975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.107713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.108727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.109394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.110135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.357985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.370255 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fbd308e1-4bc2-4469-9e25-8fd81d7b6cb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.812487 Oct 27 09:05:49.370850 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 735/1442] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:48 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:49.381684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:49.382287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:49.414576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.415076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.415514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.416267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.416725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.417150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.615288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.626223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.630874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.636886 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8bb30d61-3883-440d-a23a-493be87bf4d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.568487 Oct 27 09:05:49.637565 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 708/1443] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:49 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:49.662311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:49.662922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:49.681231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.681737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.682178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.682895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.683351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.688169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.709009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.721048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.722487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.723671 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fac81360-363d-4804-9e61-0b7203c4dc54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.345930 Oct 27 09:05:49.724237 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 736/1444] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:49 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:49.749792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6abea864-574a-4be1-89eb-dcd8c9bee1a5 req-1b1e7bba-451f-4e14-aaf4-4f9b3806af06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a988a0df-4f91-4497-a599-e7e19c636ac7", "name": "network-vif-deleted", "tag": "b5279136-9006-4596-a97a-bc6367ac28b6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:49.767672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6abea864-574a-4be1-89eb-dcd8c9bee1a5 req-1b1e7bba-451f-4e14-aaf4-4f9b3806af06 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.768447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6abea864-574a-4be1-89eb-dcd8c9bee1a5 req-1b1e7bba-451f-4e14-aaf4-4f9b3806af06 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.769044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6abea864-574a-4be1-89eb-dcd8c9bee1a5 req-1b1e7bba-451f-4e14-aaf4-4f9b3806af06 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.784443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:49.803324 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6abea864-574a-4be1-89eb-dcd8c9bee1a5 req-1b1e7bba-451f-4e14-aaf4-4f9b3806af06 service nova] Creating event network-vif-deleted:b5279136-9006-4596-a97a-bc6367ac28b6 for instance a988a0df-4f91-4497-a599-e7e19c636ac7 on n-h1-858383-16 Oct 27 09:05:49.837845 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6abea864-574a-4be1-89eb-dcd8c9bee1a5 req-1b1e7bba-451f-4e14-aaf4-4f9b3806af06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101507 Oct 27 09:05:49.868325 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 737/1445] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:49.868325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:49.868325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:49.897440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.919078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.924464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:49.928532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.930508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.930508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.931855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.933073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.934615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.956399 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fef1b2c7-799d-46b7-9fde-f2aea5787107 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1453 microversion: 2.75 time: 0.297676 Oct 27 09:05:49.957201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 709/1446] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:49 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1453 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:49.985786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:49.986721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:49.987734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:49.988489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lazy-loading 'fault' on Instance uuid a988a0df-4f91-4497-a599-e7e19c636ac7 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:50.075477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:50.087246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0eb13d23-cf83-4a72-891d-01223670f3ff tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 200 len: 1303 microversion: 2.1 time: 0.226575 Oct 27 09:05:50.102369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:50.102369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:50.103008 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 738/1447] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:49 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:50.109409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:50.113351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:50.125792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:50.126816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:50.129893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:50.130973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:50.296549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-4960ee8c-d55d-485e-b8a4-35a7605a68ed req-7698b691-10df-4539-a729-2b9ed6baf137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d645fadc-59fa-44d8-aee6-1b98f0013de3", "name": "network-vif-plugged", "status": "completed", "tag": "bfbf5e11-af5f-410d-a0c1-a17a8f0be57c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:50.326889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4960ee8c-d55d-485e-b8a4-35a7605a68ed req-7698b691-10df-4539-a729-2b9ed6baf137 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:50.327977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4960ee8c-d55d-485e-b8a4-35a7605a68ed req-7698b691-10df-4539-a729-2b9ed6baf137 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:50.327977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4960ee8c-d55d-485e-b8a4-35a7605a68ed req-7698b691-10df-4539-a729-2b9ed6baf137 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:50.387269 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-4960ee8c-d55d-485e-b8a4-35a7605a68ed req-7698b691-10df-4539-a729-2b9ed6baf137 service nova] Creating event network-vif-plugged:bfbf5e11-af5f-410d-a0c1-a17a8f0be57c for instance d645fadc-59fa-44d8-aee6-1b98f0013de3 on n-h2-858383-16 Oct 27 09:05:50.415534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:50.428604 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-4960ee8c-d55d-485e-b8a4-35a7605a68ed req-7698b691-10df-4539-a729-2b9ed6baf137 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115749 Oct 27 09:05:50.433602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29130e78-2e04-4e6b-a68f-8bf6dc092d06 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.347056 Oct 27 09:05:50.444813 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 739/1449] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:05:50.444813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:50.445209 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 710/1449] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:50 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:50.446787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:50.455677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:50.456333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:50.456776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:50.457479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:50.457932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:50.458355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:50.649344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:50.659969 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a0067561-660a-4737-b142-5787944975f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.222569 Oct 27 09:05:50.664214 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 740/1450] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:50 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:50.665052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:50.665711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:50.675059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:50.676046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:50.676708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:50.677428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:50.677962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:50.678660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:50.696843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:50.723145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=24 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:50.758245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:50.759713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:50.772919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:50.773447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:50.773906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:50.774630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:50.775091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:50.775521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:50.864806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:50.906870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:50.914582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:50.919854 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c3bee2a-95d1-4ec8-a149-cff86af9edde tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.254910 Oct 27 09:05:50.929183 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 711/1451] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:50 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:50.990477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:50.991230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:51.002847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.004760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.005908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.010251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.014216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.014998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.116160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:51.129501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:51.130965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:51.133679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:51.138424 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9cd1e3f-f300-4c2f-b27d-a6c58d3790d9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1453 microversion: 2.75 time: 0.152834 Oct 27 09:05:51.141064 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 712/1452] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:50 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:51.144613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:51.147050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:51.148484 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f66a9417-64bf-4a1b-8f65-6ce3c0079984 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.396421 Oct 27 09:05:51.165087 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 741/1453] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:50 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:51.166136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:51.166970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a988a0df-4f91-4497-a599-e7e19c636ac7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:51.176797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.177307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.177772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.178985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.179370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.179853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.198177 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] HTTP exception thrown: Instance a988a0df-4f91-4497-a599-e7e19c636ac7 could not be found. Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Request method failure captured: Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 HTTP/1.1 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiegmnl2n716Mq_wdO8SPk35wJqzkpYkHnYKbLTW8ntaB0FkFe7wAEuJpXNUfyDkvX3D_2usptgXfZgLq1KD5HtVcD_RNBG8Pp_8bFJOjp066C71FY9xteP_KTNoXcdwohnxtsNap6wyQwdNTziG2nHIeXsZK9nTiDGSOnycwIztBM Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 749cfbed2a9044b286f364ad8fb9dea9 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-MigrationsAdminTest-759885590 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/749cfbed2a9044b286f364ad8fb9dea9"}]}] Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-MigrationsAdminTest-759885590 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 749cfbed2a9044b286f364ad8fb9dea9 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-MigrationsAdminTest-759885590 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-MigrationsAdminTest-759885590-project Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0566a978e2924137973615346b1afaa3 Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-MigrationsAdminTest-759885590-project Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance a988a0df-4f91-4497-a599-e7e19c636ac7 could not be found. Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'a988a0df-4f91-4497-a599-e7e19c636ac7'} Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a988a0df-4f91-4497-a599-e7e19c636ac7 could not be found. Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a988a0df-4f91-4497-a599-e7e19c636ac7 could not be found. Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:05:51.200782 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a988a0df-4f91-4497-a599-e7e19c636ac7 could not be found. Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Returning 404 to user: Instance a988a0df-4f91-4497-a599-e7e19c636ac7 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-644b5745-f36c-40d1-b236-e0441a1838b9 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7" status: 404 len: 111 microversion: 2.1 time: 0.059867 Oct 27 09:05:51.206780 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 713/1454] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:51 2022] GET /compute/v2.1/servers/a988a0df-4f91-4497-a599-e7e19c636ac7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:05:51.211104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:51.211643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:51.219325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.220137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.220818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.221595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.222033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.222646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.256787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:05:51.389272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c4e6be6e-0080-45f9-823f-9bad2625853d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 204 len: 0 microversion: 2.1 time: 0.181226 Oct 27 09:05:51.390627 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 742/1455] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:05:51 2022] DELETE /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:05:51.408991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:51.409998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:51.420836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.421706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.422306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.423280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.424053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.424997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.463471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:51.464446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:51.482110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.483560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.484039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.484769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.485767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.486182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.789850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:51.800327 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8063e15-0cf2-482c-87c0-f37735a37cbc tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1535 microversion: 2.1 time: 0.403026 Oct 27 09:05:51.802806 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 714/1456] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:51 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1535 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:51.807879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:51.808556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:51.814448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.814939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.815381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.816101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.816932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.817361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.818846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:51.830307 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d9349f6-7570-4f2a-990b-1b063824b326 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.372696 Oct 27 09:05:51.831055 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 743/1457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:51 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:51.951200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:51.951768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:51.957663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.958150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.958589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.959287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:51.959807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:51.960231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:51.985578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:51.995842 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe195c0b-e619-4fed-a1c5-bdd0fb50e1dc tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.191420 Oct 27 09:05:52.001071 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 715/1458] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:51 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:52.134670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:52.146206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:52.147798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:52.149057 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-93de6ffa-2f88-46f7-9847-f21eb8ca7f3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.202600 Oct 27 09:05:52.149645 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 744/1459] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:51 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:52.169035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:52.169647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:52.176557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:52.177050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:52.177494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:52.178466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:52.178927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:52.179358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:52.188320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:52.188939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:52.204263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:52.204263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:52.204263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:52.204263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:52.204263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:52.204263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:52.267177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:52.276001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:52.278515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:52.283750 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-31c791f9-0d4b-4e8b-b95d-4673d1902087 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1453 microversion: 2.75 time: 0.118517 Oct 27 09:05:52.284331 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 716/1460] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:52 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:52.362628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:52.372132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:52.373669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:52.374802 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ce0469a-830e-4af5-9bfb-26ee6a43309a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.201153 Oct 27 09:05:52.375366 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 745/1461] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:52 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:52.826958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:52.827590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:52.834793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:52.835285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:52.835801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:52.836504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:52.837070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:52.837475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:52.856378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:52.856990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:52.865392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:52.866051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:52.866502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:52.867202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:52.867954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:52.868381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.045582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.054055 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-075a7c4e-7f9d-437a-ade4-f203c49ff2ec tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1535 microversion: 2.1 time: 0.231035 Oct 27 09:05:53.054638 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 717/1462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:52 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1535 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:53.059646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:53.060573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.060783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:53.066985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.067480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.068003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.068659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.069249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.069684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.078575 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-42018cac-61c8-4d6b-9813-e1468e1b42ee tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.227122 Oct 27 09:05:53.079536 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 746/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:52 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:53.126427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-358017539", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "ff9a447f-bbfd-4e05-944d-b9d8c867cecf"}], "block_device_mapping_v2": [{"uuid": "1c220f78-d35a-4b37-91d0-ea349053e71f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:53.202497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] validate_networks() for [('ff9a447f-bbfd-4e05-944d-b9d8c867cecf', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:05:53.232261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.242675 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ae86c5e-d3ea-4472-bd2b-05bcf808a873 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.186988 Oct 27 09:05:53.243327 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 718/1464] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:53 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:53.248668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:53.249300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:53.255107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.255862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.256306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.257071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.257773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.258210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.462722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.472590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.474046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.475227 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-958bad1a-d4f5-4d4c-8fc1-90c81057f3f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.230747 Oct 27 09:05:53.475821 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 719/1465] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:53 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:53.481109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:53.481751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:53.487758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.488498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.489048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.489756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.490222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.490651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.593035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.597037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:53.603075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.604640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.611095 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cddd1aa6-ed5d-4359-a260-61c6675e2b31 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1453 microversion: 2.75 time: 0.134272 Oct 27 09:05:53.612089 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 720/1466] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:53 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:53.616762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:53.617650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:53.624391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.624903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.625342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.626332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.627239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.627906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.848662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:05:53.849324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:05:53.849795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:05:53.850337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:05:53.850799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:05:53.855297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.866526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.867417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.868249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.869299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:53.870039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:53.870656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:53.875991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.877729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:53.879800 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe1efb21-8417-4e57-a39b-736bf04ee050 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.265978 Oct 27 09:05:53.881034 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 721/1467] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:53 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:53.898372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for project 37b756ad383a4cf18b7da7565a51572e. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:05:53.904849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Getting quotas for user aff1721693734cc8937a84d9b8a483dd and project 37b756ad383a4cf18b7da7565a51572e. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:05:53.970050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:05:53.972934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c220f78-d35a-4b37-91d0-ea349053e71f',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:05:54.023844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8f6969ad-caac-4a26-be11-fa562b18272a req-991eb51f-b088-48f5-a70e-fb71c00be70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f46edbb-82a0-4749-a443-02e5ca52e341", "name": "network-vif-plugged", "status": "completed", "tag": "4f73cce5-2a06-488c-8855-f44a51f4779a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:54.034054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8f6969ad-caac-4a26-be11-fa562b18272a req-991eb51f-b088-48f5-a70e-fb71c00be70b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.034514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8f6969ad-caac-4a26-be11-fa562b18272a req-991eb51f-b088-48f5-a70e-fb71c00be70b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.035038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8f6969ad-caac-4a26-be11-fa562b18272a req-991eb51f-b088-48f5-a70e-fb71c00be70b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.048797 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8f6969ad-caac-4a26-be11-fa562b18272a req-991eb51f-b088-48f5-a70e-fb71c00be70b service nova] Creating event network-vif-plugged:4f73cce5-2a06-488c-8855-f44a51f4779a for instance 1f46edbb-82a0-4749-a443-02e5ca52e341 on n-h1-858383-16 Oct 27 09:05:54.054237 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8f6969ad-caac-4a26-be11-fa562b18272a req-991eb51f-b088-48f5-a70e-fb71c00be70b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033990 Oct 27 09:05:54.055077 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 722/1468] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:05:54.079208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:54.080039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:54.088376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.088967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.089591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.090341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.093423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.094124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.139712 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10a0494d-53c4-4f68-9898-33811256b653 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.017114 Oct 27 09:05:54.141324 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 747/1469] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:05:54.146248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:54.147057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:54.153984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.154471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.154912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.155646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.156272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.156866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.281509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.296652 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ba8b8d3-3d4d-4c71-920c-8fa73ece7ad7 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1535 microversion: 2.1 time: 0.221666 Oct 27 09:05:54.298383 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 723/1470] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:54 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1535 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:54.303878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2619fe1-1fa5-481a-b7d9-583a42b3710a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:54.305016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2619fe1-1fa5-481a-b7d9-583a42b3710a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:54.357740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.376654 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b372131e-4f50-4a83-9852-add30814adfa tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.234040 Oct 27 09:05:54.380326 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 748/1471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:54 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:54.386996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:54.387733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:54.393924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.394630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.395151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.395981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.396718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.397391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.429257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2619fe1-1fa5-481a-b7d9-583a42b3710a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.440693 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2619fe1-1fa5-481a-b7d9-583a42b3710a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1052 microversion: 2.1 time: 0.140796 Oct 27 09:05:54.441504 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 724/1472] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:54 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1052 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:54.509337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:54.510167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:54.517871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.518455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.518904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.520258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.521048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.521511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.560347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.571982 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08b51189-95d6-41da-be63-edaceeffd4c9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.190716 Oct 27 09:05:54.572901 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 749/1473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:54 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:54.646500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:54.647761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:54.658582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.659472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.659960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.661116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.661320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.661870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.705488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.715334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.717171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.718370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-203291bc-b482-4223-a6de-2a50f2475ea5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.213864 Oct 27 09:05:54.718936 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 725/1474] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:54 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:54.746148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.754982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.756793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:54.762745 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2adfa7c9-9ef5-46fe-beb2-3446c3445f36 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1453 microversion: 2.75 time: 0.124444 Oct 27 09:05:54.763379 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 750/1475] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:54 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:54.908419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:54.909059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:54.915838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.916323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.916764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:54.917454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:54.918421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:54.918837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.053925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.064190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.065825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.067047 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d58380ff-3db1-4b8f-8147-40edd872b059 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.162497 Oct 27 09:05:55.067810 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 726/1476] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:54 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:55.322141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:55.322897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:55.331535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.332093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.332488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.333189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.333644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.334069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.404532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:55.405167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:55.407506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:55.413487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.414035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.414563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.415424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.415971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.416544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.548224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.557122 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ebc13b51-8bca-414a-bbb4-6797c845ff6c tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1535 microversion: 2.1 time: 0.238806 Oct 27 09:05:55.557989 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 751/1477] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:55 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1535 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:55.562607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:55.563213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:55.570314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.571139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.571481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.572489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.572962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.573395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.598575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.606558 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d095f0d9-cc42-4e62-9226-c585bc9cae93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.208134 Oct 27 09:05:55.607123 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 727/1478] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:55 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:55.612213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:55.612843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:55.618900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.619390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.619860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.620561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.621056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.621522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.643267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.651755 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3595dbdc-f357-4a40-975a-e2886cdaf76f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1150 microversion: 2.1 time: 0.092695 Oct 27 09:05:55.652564 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 752/1479] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:55 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:55.745814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:55.746640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:55.753191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.753722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.754255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.754915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.755368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.755869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.765380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.773976 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-89faf030-1cdc-4026-8bf8-f419f2fd080b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1318 microversion: 2.1 time: 0.165781 Oct 27 09:05:55.774592 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 728/1480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:55 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:55.793774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:55.794509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:55.802243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.802699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.803707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.804583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:55.805137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:55.805664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:55.901746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.911215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.912856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.919506 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3af5ad29-7298-4f4b-9491-b3c915d5f478 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1453 microversion: 2.75 time: 0.131091 Oct 27 09:05:55.920129 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 729/1481] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:55 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:55.927328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.932980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:55.940500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.942277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:55.943628 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3695f912-4747-4968-a6e0-9aa7e8c3ecdc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.202078 Oct 27 09:05:55.944297 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 753/1482] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:55 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:56.094334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:56.095017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:56.102282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.102878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.103598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.104280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.104811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.105344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.250159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:56.259401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:56.260985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:56.262234 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-677ca99f-cd75-441b-84d0-29cebf86923f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.172604 Oct 27 09:05:56.264982 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 730/1483] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:56 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:56.583557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:56.584201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:56.593631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.594257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.594703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.595413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.595902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.596334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.630306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:56.630977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:56.636955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.637446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.637892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.638599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.639056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.639481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.780503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:56.788889 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c593f3e4-3bf4-41ad-8fc7-d3230124e9be tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1535 microversion: 2.1 time: 0.209135 Oct 27 09:05:56.795041 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 754/1484] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:56 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1535 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:56.799953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:56.800825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:56.807970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.809073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.809510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.810236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.810688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.811655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.833751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:56.841559 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7021cf9-3718-419e-a8a6-bf3513ade997 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.215126 Oct 27 09:05:56.842358 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 731/1485] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:56 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:05:56.846640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:56.847254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:56.854205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.854706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.855867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.856584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.859316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.859813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.878560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:56.886842 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-50073986-2870-4233-a245-f86b758ec4e4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1150 microversion: 2.1 time: 0.090168 Oct 27 09:05:56.899595 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 755/1486] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:56 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:56.950445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:56.951376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:56.957420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.957910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.958352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.959054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:56.960137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:56.960568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:56.991242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:56.999770 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c684e0ba-f668-4df9-8388-0f96c691c84e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1467 microversion: 2.1 time: 0.156606 Oct 27 09:05:57.000343 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 732/1487] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:56 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1467 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:57.004916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:57.005450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:57.011256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.011811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.012256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.012963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.013419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.013851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.028260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.036327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.037840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.043314 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c3a9b23-3d3c-4d1b-b2e5-6dd648b032d8 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1438 microversion: 2.75 time: 0.096314 Oct 27 09:05:57.043988 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 756/1488] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:56 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:57.055511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:57.055511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:57.055511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.057511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.058347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.059115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.059743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.060180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.192483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.201188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.202652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.203842 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-846e139f-ea6c-4a0e-8f6b-8d7cc1a3716a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.202557 Oct 27 09:05:57.204419 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 733/1489] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:57 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:57.223477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.232058 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-53a3d207-9687-4aa0-8730-7ea104f1003f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1318 microversion: 2.1 time: 0.187016 Oct 27 09:05:57.232631 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 757/1490] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:57 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:57.287345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:57.287989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:57.290889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:57.295992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.296487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.296982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.298068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.298164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.298555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.318970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:57.321892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:57.328234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.328743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.329197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.329906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.330364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.330798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.410828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:05:57.411355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:05:57.411931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:05:57.412349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:05:57.412766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:05:57.443561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.452722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.454220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:57.455373 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8dfc360c-26bc-4c0b-9efb-4ef817a10505 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.171989 Oct 27 09:05:57.455986 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 758/1491] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:57 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:05:57.478081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:57.484542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.485171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.485665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.486621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.487232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.487685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.617326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:57.642966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-81849747-9c40-47c7-a63c-4fe5111b45a6 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516/action" status: 202 len: 1944 microversion: 2.75 time: 0.437327 Oct 27 09:05:57.644155 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 734/1492] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:05:57 2022] POST /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516/action => generated 1944 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 09:05:57.676095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:57.676748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:57.685946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.686585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.687076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.688124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.688650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.690022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.815929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:57.817687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:57.827407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.828576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.829405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.831085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.833074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.836054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.845368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:57.873231 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c28d118c-3a57-4a11-8321-9d7e68c7a6eb tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.200788 Oct 27 09:05:57.883644 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 759/1493] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:57 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:57.895988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:57.899911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:57.908747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.911482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.926848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:57.927701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:57.932887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:57.933991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.119991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:58.137234 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42dc7cd5-4c3a-4200-b641-38432e75a33f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1535 microversion: 2.1 time: 0.328554 Oct 27 09:05:58.151743 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 735/1494] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:57 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1535 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:58.151743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:58.151743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:58.151743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.151743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.152407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.152816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.153248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.155476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.174602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:05:58.215870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:58.225655 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f55229e8-79a1-4e55-9f3e-37fb37916bfe tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.347638 Oct 27 09:05:58.226571 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 760/1495] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:57 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:58.234518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:58.235522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:58.243127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.244001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.244666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.246378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.247057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.249748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.264992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:58.278318 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5232d6cf-ebf3-4abc-93c4-5eb2ec6fb30c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1150 microversion: 2.1 time: 0.138212 Oct 27 09:05:58.280080 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 736/1496] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:58 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:58.285900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0f5ef573-cda3-4865-b136-95d18e0365a2 req-94cbe1f0-c223-49d3-a068-805a2c31e3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d", "name": "network-vif-unplugged", "status": "completed", "tag": "5a1ddd07-b18b-4724-8a1f-952c95c591d9"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:58.297730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0f5ef573-cda3-4865-b136-95d18e0365a2 req-94cbe1f0-c223-49d3-a068-805a2c31e3d4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.298314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0f5ef573-cda3-4865-b136-95d18e0365a2 req-94cbe1f0-c223-49d3-a068-805a2c31e3d4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.298868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0f5ef573-cda3-4865-b136-95d18e0365a2 req-94cbe1f0-c223-49d3-a068-805a2c31e3d4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.313853 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0f5ef573-cda3-4865-b136-95d18e0365a2 req-94cbe1f0-c223-49d3-a068-805a2c31e3d4 service nova] Creating event network-vif-unplugged:5a1ddd07-b18b-4724-8a1f-952c95c591d9 for instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d on n-h2-858383-16 Oct 27 09:05:58.319053 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0f5ef573-cda3-4865-b136-95d18e0365a2 req-94cbe1f0-c223-49d3-a068-805a2c31e3d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037565 Oct 27 09:05:58.320242 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 737/1497] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:05:58.325132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:58.325822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:58.333648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.333648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.333908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.334627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.335086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.335515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.476715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:58.497238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:58.499287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:58.501430 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2de8045f-7d35-4b24-bff3-4cfba6c764a0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.273148 Oct 27 09:05:58.521034 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 761/1498] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:58 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:58.527025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:58.528283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:58.534963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.535716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.548242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.549961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.550974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.552086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.701275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:58.709902 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e61bec49-bf06-4410-b5a4-880f284d4495 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1468 microversion: 2.1 time: 0.388634 Oct 27 09:05:58.714921 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 738/1499] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:58 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1468 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:58.740178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4aeb3601-1562-44af-b3dd-1f689ac1949b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-831515906"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:05:58.742845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4aeb3601-1562-44af-b3dd-1f689ac1949b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:58.756528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aeb3601-1562-44af-b3dd-1f689ac1949b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.757021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aeb3601-1562-44af-b3dd-1f689ac1949b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.757465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aeb3601-1562-44af-b3dd-1f689ac1949b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:58.758168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aeb3601-1562-44af-b3dd-1f689ac1949b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:58.758620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aeb3601-1562-44af-b3dd-1f689ac1949b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:58.759040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aeb3601-1562-44af-b3dd-1f689ac1949b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.119097 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4aeb3601-1562-44af-b3dd-1f689ac1949b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "POST /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341/action" status: 202 len: 0 microversion: 2.1 time: 0.379023 Oct 27 09:05:59.121557 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 739/1500] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:05:58 2022] POST /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:05:59.137349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:59.138167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:59.157824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.159175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.162138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.163667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.164246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.166426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.416850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:59.437587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:59.452223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:59.454009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:59.455389 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dd5b99b8-7b5d-49f4-b36d-eb1141737eba tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.933143 Oct 27 09:05:59.456516 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b479c860-9e28-4d5e-9cd8-94baadd30f7a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.332500 Oct 27 09:05:59.477644 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 762/1501] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:58 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:59.479840 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 740/1502] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:59 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:05:59.489769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-209f259d-f55f-4c83-8ebe-ef6718ea3648 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0e1f70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:59.493369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:59.494304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:59.509969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.511462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.512794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.513958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.514482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.515007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.561665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.562209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.562842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.563502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lazy-loading 'fault' on Instance uuid a6e4c64d-6f11-409d-befa-fbea1791a69b {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:05:59.564926 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-209f259d-f55f-4c83-8ebe-ef6718ea3648 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.084194 Oct 27 09:05:59.565884 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 763/1503] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:05:59 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:59.579645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:59.580545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:59.591543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.591900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.592396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.593466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.594297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.594941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.690323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:59.702552 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7683263-856b-48b4-af96-a6fbea2ff2e5 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 200 len: 1369 microversion: 2.1 time: 0.220659 Oct 27 09:05:59.705448 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 741/1504] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:59 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:59.716570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:59.717293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:59.738113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.738619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.739060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.739798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.740245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.740852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.873371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:59.884214 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23350846-7874-4eee-aa3c-60630ffdbd9e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1168 microversion: 2.1 time: 0.175100 Oct 27 09:05:59.885860 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 742/1505] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:59 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1168 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:05:59.893543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:05:59.895596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:05:59.905434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.906286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.907085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.910126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:05:59.911068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:05:59.912089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:05:59.989359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:05:59.998306 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d2a05b12-5e06-4736-9735-7bd96166980b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.429889 Oct 27 09:06:00.010880 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 764/1506] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:05:59 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:00.015625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6b717dd5-4480-423c-ac8b-59489e9d0bdd req-3a065114-9922-4d72-915d-43a07e1675ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d248926-b23e-472b-9a1e-4b10c924758a", "name": "network-vif-plugged", "status": "completed", "tag": "c24197dc-db5d-4363-91d8-125f1e441095"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:00.031074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6b717dd5-4480-423c-ac8b-59489e9d0bdd req-3a065114-9922-4d72-915d-43a07e1675ea service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.031549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6b717dd5-4480-423c-ac8b-59489e9d0bdd req-3a065114-9922-4d72-915d-43a07e1675ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.033225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6b717dd5-4480-423c-ac8b-59489e9d0bdd req-3a065114-9922-4d72-915d-43a07e1675ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.049633 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6b717dd5-4480-423c-ac8b-59489e9d0bdd req-3a065114-9922-4d72-915d-43a07e1675ea service nova] Creating event network-vif-plugged:c24197dc-db5d-4363-91d8-125f1e441095 for instance 3d248926-b23e-472b-9a1e-4b10c924758a on n-h1-858383-16 Oct 27 09:06:00.055113 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6b717dd5-4480-423c-ac8b-59489e9d0bdd req-3a065114-9922-4d72-915d-43a07e1675ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055089 Oct 27 09:06:00.056093 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 765/1507] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:00.171880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:00.181629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:00.183297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:00.184603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0378384-223c-4445-bf3a-ff5fce592d74 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.297222 Oct 27 09:06:00.185511 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 743/1508] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:05:59 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:00.372741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c7f0019f-bf0d-4d27-8e0d-3c343ab3da83 req-ac3aef0f-c09c-4b1b-8448-b1e83e870a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e4c64d-6f11-409d-befa-fbea1791a69b", "name": "network-vif-deleted", "tag": "e8980257-9864-4b1e-940e-b586249dde6e"}, {"name": "network-changed", "server_uuid": "f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d", "tag": "5a1ddd07-b18b-4724-8a1f-952c95c591d9"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:00.408910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c7f0019f-bf0d-4d27-8e0d-3c343ab3da83 req-ac3aef0f-c09c-4b1b-8448-b1e83e870a45 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.415294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c7f0019f-bf0d-4d27-8e0d-3c343ab3da83 req-ac3aef0f-c09c-4b1b-8448-b1e83e870a45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.416209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c7f0019f-bf0d-4d27-8e0d-3c343ab3da83 req-ac3aef0f-c09c-4b1b-8448-b1e83e870a45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.457062 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c7f0019f-bf0d-4d27-8e0d-3c343ab3da83 req-ac3aef0f-c09c-4b1b-8448-b1e83e870a45 service nova] Creating event network-vif-deleted:e8980257-9864-4b1e-940e-b586249dde6e for instance a6e4c64d-6f11-409d-befa-fbea1791a69b on n-h1-858383-16 Oct 27 09:06:00.458863 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c7f0019f-bf0d-4d27-8e0d-3c343ab3da83 req-ac3aef0f-c09c-4b1b-8448-b1e83e870a45 service nova] Creating event network-changed:5a1ddd07-b18b-4724-8a1f-952c95c591d9 for instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d on n-h2-858383-16 Oct 27 09:06:00.477566 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c7f0019f-bf0d-4d27-8e0d-3c343ab3da83 req-ac3aef0f-c09c-4b1b-8448-b1e83e870a45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.109233 Oct 27 09:06:00.491058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:00.491835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:00.495226 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 766/1509] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:06:00.505583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:00.505779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.506333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.507312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.508403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.509135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.510262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:00.511315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.531778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.532463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.533016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.534268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.534828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.535353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.760899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:00.768982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:00.777975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:00.780472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:00.782526 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d7efe43-190c-42e1-9164-89d48fb0057e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.300916 Oct 27 09:06:00.783929 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 744/1510] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:00 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:00.789452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65ee2501-9561-4ab8-ad3b-1480ff95c86d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa1ae280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:00.813451 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84ae798e-6095-471e-87d8-9cd6c9f3bb25 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.315064 Oct 27 09:06:00.824141 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 767/1511] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:00 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:00.830643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:00.831922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: a6e4c64d-6f11-409d-befa-fbea1791a69b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:00.851180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.851748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.852429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.852897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.853343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.853769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.866409 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65ee2501-9561-4ab8-ad3b-1480ff95c86d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.081123 Oct 27 09:06:00.867660 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 745/1512] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:00 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:00.878929 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] HTTP exception thrown: Instance a6e4c64d-6f11-409d-befa-fbea1791a69b could not be found. Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Request method failure captured: Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b HTTP/1.1 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkiegmnl2n716Mq_wdO8SPk35wJqzkpYkHnYKbLTW8ntaB0FkFe7wAEuJpXNUfyDkvX3D_2usptgXfZgLq1KD5HtVcD_RNBG8Pp_8bFJOjp066C71FY9xteP_KTNoXcdwohnxtsNap6wyQwdNTziG2nHIeXsZK9nTiDGSOnycwIztBM Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 749cfbed2a9044b286f364ad8fb9dea9 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-MigrationsAdminTest-759885590 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/749cfbed2a9044b286f364ad8fb9dea9"}]}] Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-MigrationsAdminTest-759885590 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 749cfbed2a9044b286f364ad8fb9dea9 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-MigrationsAdminTest-759885590 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-MigrationsAdminTest-759885590-project Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0566a978e2924137973615346b1afaa3 Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-MigrationsAdminTest-759885590-project Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance a6e4c64d-6f11-409d-befa-fbea1791a69b could not be found. Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'a6e4c64d-6f11-409d-befa-fbea1791a69b'} Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e4c64d-6f11-409d-befa-fbea1791a69b could not be found. Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e4c64d-6f11-409d-befa-fbea1791a69b could not be found. Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:00.881368 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:00.885891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:00.885891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:00.885891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:00.885891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:06:00.885891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:06:00.885891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e4c64d-6f11-409d-befa-fbea1791a69b could not be found. Oct 27 09:06:00.885891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:00.885891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Returning 404 to user: Instance a6e4c64d-6f11-409d-befa-fbea1791a69b could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:06:00.885891 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c3e161a0-55a9-4530-bfa5-3940917f1b3d tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b" status: 404 len: 111 microversion: 2.1 time: 0.068766 Oct 27 09:06:00.888532 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 768/1513] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:00 2022] GET /compute/v2.1/servers/a6e4c64d-6f11-409d-befa-fbea1791a69b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:06:00.897747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f5572d3-f280-42b7-a06b-f164eb83d329 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '.version_select at 0x7f31aa86d4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:00.916533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:00.918338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:00.925204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.926226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.927684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.929028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:00.929787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:00.930442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:00.938186 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f5572d3-f280-42b7-a06b-f164eb83d329 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216726483" status: 202 len: 0 microversion: 2.1 time: 0.044657 Oct 27 09:06:00.938876 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 746/1514] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 09:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216726483 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:06:01.024117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:01.024930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:01.036764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:01.037258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:01.037703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:01.038406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:01.038872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:01.039310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:01.378714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:01.389162 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4bd1de3a-2786-4206-b763-febca0cd3a95 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1210 microversion: 2.1 time: 0.479967 Oct 27 09:06:01.389999 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 769/1515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:00 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1210 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:01.411132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:01.411780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:01.419016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:01.419515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:01.419989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:01.420697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:01.421156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:01.421585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:01.468465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:01.484630 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5437512c-a088-4df8-944a-3dcc2af3b21b tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.464243 Oct 27 09:06:01.492420 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 747/1516] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:01 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:01.676496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:01.690902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:01.693919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:01.695743 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb5e0745-f81a-4409-8da9-87a6df167203 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.288433 Oct 27 09:06:01.696787 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 770/1517] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:01 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:01.810096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:01.811665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:01.818257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:01.819105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:01.819815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:01.820635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:01.821787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:01.821950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:01.853181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:01.853885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:01.867802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:01.868614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:01.870285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:01.871552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:01.872210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:01.873861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.017799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:02.041923 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-015d564d-a662-452a-8b23-567705c6ac3f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.196172 Oct 27 09:06:02.042782 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 771/1518] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:01 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:02.047933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-043117d0-8454-4dee-b010-e081fc679014 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa16c790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:02.104283 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-043117d0-8454-4dee-b010-e081fc679014 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.060260 Oct 27 09:06:02.105316 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 772/1519] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:02 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:02.120436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:02.121337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:02.128666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.131865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:02.135698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.141185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:02.142637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:02.143806 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df6ac41d-d0e5-4c31-a9db-5cdc718fbf1f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.338438 Oct 27 09:06:02.144844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.145810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.146448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.147549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.153834 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 748/1520] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:01 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:02.171847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-799bf76f-98d8-4a82-a791-ed9d1fc57d83 req-6eb47366-3a8c-44ca-bf94-453e75650ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680796e2-1a4e-46e0-9407-742f517c7e9d", "name": "network-vif-plugged", "status": "completed", "tag": "415ccb14-ad15-4768-af9a-14128574917b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:02.182305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-799bf76f-98d8-4a82-a791-ed9d1fc57d83 req-6eb47366-3a8c-44ca-bf94-453e75650ba6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.183093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-799bf76f-98d8-4a82-a791-ed9d1fc57d83 req-6eb47366-3a8c-44ca-bf94-453e75650ba6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.183718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-799bf76f-98d8-4a82-a791-ed9d1fc57d83 req-6eb47366-3a8c-44ca-bf94-453e75650ba6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.191668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:02.196572 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-799bf76f-98d8-4a82-a791-ed9d1fc57d83 req-6eb47366-3a8c-44ca-bf94-453e75650ba6 service nova] Creating event network-vif-plugged:415ccb14-ad15-4768-af9a-14128574917b for instance 680796e2-1a4e-46e0-9407-742f517c7e9d on n-h2-858383-16 Oct 27 09:06:02.202979 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-799bf76f-98d8-4a82-a791-ed9d1fc57d83 req-6eb47366-3a8c-44ca-bf94-453e75650ba6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047122 Oct 27 09:06:02.203225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:06:02.208068 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 749/1521] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:02.296615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-28893f9c-95cd-44b1-a66c-dec53068b006 req-b48e115c-1b96-4738-b598-e17a1a88f8ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5c8ea0-8c53-4718-b62f-f35835ecb83e", "tag": "c30b0569-641d-48e2-a378-efe6a00a3231"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:02.297376 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d81a9917-4f4f-4e04-bb84-1a85a6e70b4e tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 204 len: 0 microversion: 2.1 time: 0.182417 Oct 27 09:06:02.298604 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 773/1522] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:06:02 2022] DELETE /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:02.309075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:02.310217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-28893f9c-95cd-44b1-a66c-dec53068b006 req-b48e115c-1b96-4738-b598-e17a1a88f8ed service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.310405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:02.311122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-28893f9c-95cd-44b1-a66c-dec53068b006 req-b48e115c-1b96-4738-b598-e17a1a88f8ed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.311792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-28893f9c-95cd-44b1-a66c-dec53068b006 req-b48e115c-1b96-4738-b598-e17a1a88f8ed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.317935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.318626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.319154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.320092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.320613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.321101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.328900 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-28893f9c-95cd-44b1-a66c-dec53068b006 req-b48e115c-1b96-4738-b598-e17a1a88f8ed service nova] Creating event network-changed:c30b0569-641d-48e2-a378-efe6a00a3231 for instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e on n-h1-858383-16 Oct 27 09:06:02.340037 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-28893f9c-95cd-44b1-a66c-dec53068b006 req-b48e115c-1b96-4738-b598-e17a1a88f8ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044224 Oct 27 09:06:02.342725 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 750/1523] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:02.413903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:02.414608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:02.421633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.422391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.423014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.423915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.424532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.425190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.511191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:02.520886 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2a8e2bc1-60d1-427e-bc23-058acbcc97cf tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1469 microversion: 2.1 time: 0.216909 Oct 27 09:06:02.521633 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 774/1524] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:02 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:02.532654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:02.533569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:02.540326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.540949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.542494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.543188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.543839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.544281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.591627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:02.599503 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-905df38e-e11b-485e-9dca-64d2236fef06 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1210 microversion: 2.1 time: 0.189920 Oct 27 09:06:02.600116 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 751/1525] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:02 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1210 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:02.685109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:02.693425 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ebcb300-73c0-462a-8c51-e6b34acb2a23 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.170802 Oct 27 09:06:02.694003 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 775/1526] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:02 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:02.721265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:02.721864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:02.727804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.728281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.728713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.729398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:02.729918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:02.730341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:02.868911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:02.878950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:02.880437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:02.881675 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c643a41-4db7-42ed-abe1-c543f8d610d5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.164218 Oct 27 09:06:02.882177 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 752/1527] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:02 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:03.070284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:03.070972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:03.077808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.078294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.078736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.079429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.079939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.080364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.120338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75a85f4f-d9db-48d9-93d0-0ba7c427450d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa1ae700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:03.164093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:03.178909 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-75a85f4f-d9db-48d9-93d0-0ba7c427450d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.062210 Oct 27 09:06:03.179646 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 753/1528] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:03 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:03.185378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:03.186247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:03.188691 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c3f42e4-e128-40dc-954c-730265b5bcdc tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.122167 Oct 27 09:06:03.189596 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 776/1529] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:03 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:03.193803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.194486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.194930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.195669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.196126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.196553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.345600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:03.354380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:03.355917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:03.357034 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e63c0aaa-f5ff-47a3-94b0-51e6d4d328da tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.176234 Oct 27 09:06:03.357592 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 754/1530] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:03 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:03.543747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:03.544394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:03.550488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.550980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.551423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.552181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.552642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.553335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.622637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:03.623533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:03.629906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.630398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.631030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.631771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.632239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.632921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.720513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:03.729050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6ee17d2-210f-4fc7-bdfc-19d0893b3ba4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1469 microversion: 2.1 time: 0.189118 Oct 27 09:06:03.730186 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 777/1531] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:03 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:03.734790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:03.735396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:03.742202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.742672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.743116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.743916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.744373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.744798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.836460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:03.845184 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d26eb920-0d3b-47ae-89eb-5ce6c92ac162 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1210 microversion: 2.1 time: 0.226997 Oct 27 09:06:03.846031 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 755/1532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:03 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1210 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:03.885082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:03.905359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:03.908443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:03.911144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:03.912176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:03.915808 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-611af126-a087-48e9-898b-3abc455b8673 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1318 microversion: 2.1 time: 0.184553 Oct 27 09:06:03.922230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.923024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.923761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.925326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:03.926348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:03.927012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:03.932289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:03.944086 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 778/1533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:03 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:04.086142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:04.095973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:04.097751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:04.098964 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0cc6c66-f169-402f-8074-5346813a7f14 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.196557 Oct 27 09:06:04.099717 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 756/1534] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:03 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:04.200294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7179b180-d8eb-4339-a5d0-4c480f582ac4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa1a3790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:04.223085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:04.224119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:04.232351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:04.232833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:04.233268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:04.233992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:04.234443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:04.234876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:04.251877 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7179b180-d8eb-4339-a5d0-4c480f582ac4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.056781 Oct 27 09:06:04.256512 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 779/1535] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:04 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:04.316441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:04.336966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b72cfb33-786f-43ef-a447-3db79d257769 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.120483 Oct 27 09:06:04.337863 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 757/1536] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:04 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:04.383705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:04.384372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:04.393299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:04.393788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:04.394216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:04.395143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:04.395852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:04.397370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:04.540332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:04.548949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:04.550383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:04.551481 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8cb7d2d9-e445-4b6b-9f65-473704a8c925 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1406 microversion: 2.20 time: 0.172615 Oct 27 09:06:04.552062 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 780/1537] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:04 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:04.752141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:04.752882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:04.754708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:04.761497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:04.761990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:04.762430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:04.763129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:04.763837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:04.764255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:04.869815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:04.870756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:04.876939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:04.877434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:04.877867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:04.878572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:04.879023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:04.879448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.102331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:05.126633 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d9ffca2-e362-4262-a628-d2b8767d231a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1469 microversion: 2.1 time: 0.373817 Oct 27 09:06:05.135835 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 758/1538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:04 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1469 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:05.141985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:05.143122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:05.150710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.151801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.152256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.153558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.154179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.154617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.162052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:05.171033 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3b9a31b-2b1c-4ecc-9ba8-2c703ef2671a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1210 microversion: 2.1 time: 0.305431 Oct 27 09:06:05.171767 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 781/1539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:04 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1210 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:05.191709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:05.192332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:05.199360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.200168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.200838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.201540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.202171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.202620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.460895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:05.474087 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7fa5225-e62b-4353-bee1-6e5e739bfdc2 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1508 microversion: 2.1 time: 0.336435 Oct 27 09:06:05.475445 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 759/1540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:05 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:05.477332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:05.486856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:05.488611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:05.490042 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-031e6e8d-e0b4-4f35-b0b2-495e8792fa4c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.305202 Oct 27 09:06:05.491085 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 782/1541] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:05 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:05.496457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:05.497228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:05.498104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5dfc22dc-2fe2-4b5c-aa17-d92004b4d936 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa8260d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:05.503797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.505552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.506312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.507207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.508023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.508642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.575664 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5dfc22dc-2fe2-4b5c-aa17-d92004b4d936 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.098833 Oct 27 09:06:05.583945 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 760/1542] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:05 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:05.583945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2fd36c16-2321-4962-a05e-008c148f95be req-d8fc4735-1745-4164-b893-4aecfac2bbea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb21e13f-718e-4afe-b3f3-97a05e9be9c6", "name": "network-vif-deleted", "tag": "a5a9685d-1d59-4fbb-a249-b32a53d0668d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:05.592263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:05.611724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2fd36c16-2321-4962-a05e-008c148f95be req-d8fc4735-1745-4164-b893-4aecfac2bbea service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.612386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2fd36c16-2321-4962-a05e-008c148f95be req-d8fc4735-1745-4164-b893-4aecfac2bbea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.612955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2fd36c16-2321-4962-a05e-008c148f95be req-d8fc4735-1745-4164-b893-4aecfac2bbea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.620944 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00b27574-a0ca-4a52-b925-fdc88e68947f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.128524 Oct 27 09:06:05.622706 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 783/1543] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:05 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:05.627487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:05.628131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:05.628959 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2fd36c16-2321-4962-a05e-008c148f95be req-d8fc4735-1745-4164-b893-4aecfac2bbea service nova] Creating event network-vif-deleted:a5a9685d-1d59-4fbb-a249-b32a53d0668d for instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 on n-h1-858383-16 Oct 27 09:06:05.633897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.634328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.634950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.635877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.636340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.636932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.645783 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2fd36c16-2321-4962-a05e-008c148f95be req-d8fc4735-1745-4164-b893-4aecfac2bbea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067831 Oct 27 09:06:05.646765 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 761/1544] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:05.820514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:05.830818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:05.832823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:05.834142 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4d2b4955-847f-4a37-b9c4-806dfa5a42d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1598 microversion: 2.20 time: 0.210317 Oct 27 09:06:05.835140 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 784/1545] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:05 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1598 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:05.860299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b77deae0-0f46-4379-9f9e-7b342ce5e8b8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:05.860879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b77deae0-0f46-4379-9f9e-7b342ce5e8b8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:05.867606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b77deae0-0f46-4379-9f9e-7b342ce5e8b8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.868322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b77deae0-0f46-4379-9f9e-7b342ce5e8b8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.868539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b77deae0-0f46-4379-9f9e-7b342ce5e8b8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.869449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b77deae0-0f46-4379-9f9e-7b342ce5e8b8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:05.869970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b77deae0-0f46-4379-9f9e-7b342ce5e8b8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:05.870576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b77deae0-0f46-4379-9f9e-7b342ce5e8b8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:05.987417 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b77deae0-0f46-4379-9f9e-7b342ce5e8b8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.131261 Oct 27 09:06:05.987943 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 762/1546] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Oct 27 09:06:05 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:06.148947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:06.150200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:06.157014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.157497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.157934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.158627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.159078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.159501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.192375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.193288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.194101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.194738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lazy-loading 'fault' on Instance uuid fb21e13f-718e-4afe-b3f3-97a05e9be9c6 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:06.201692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:06.202411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:06.212533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.231973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.233639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.235592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.242321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.243157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.243943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:06.252702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8036b0dc-1532-4e53-869e-e98c14bee483 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 200 len: 1303 microversion: 2.1 time: 0.107898 Oct 27 09:06:06.253285 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 785/1547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:06 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:06.431893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:06.441748 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff8c3bf8-69d9-4014-af55-2981183230f5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.247174 Oct 27 09:06:06.442591 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 763/1548] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:06 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:06.476856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2044be76-813c-4912-82a2-39c0152f9bb8 req-45a1d1de-1950-4a7f-ad5e-495e4d60e4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f46edbb-82a0-4749-a443-02e5ca52e341", "name": "network-vif-plugged", "status": "completed", "tag": "4f73cce5-2a06-488c-8855-f44a51f4779a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:06.499554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2044be76-813c-4912-82a2-39c0152f9bb8 req-45a1d1de-1950-4a7f-ad5e-495e4d60e4b0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.500151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2044be76-813c-4912-82a2-39c0152f9bb8 req-45a1d1de-1950-4a7f-ad5e-495e4d60e4b0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.500583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2044be76-813c-4912-82a2-39c0152f9bb8 req-45a1d1de-1950-4a7f-ad5e-495e4d60e4b0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.521838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:06.522743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:06.535936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.536998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.537632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.539237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.540562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.541335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.541953 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2044be76-813c-4912-82a2-39c0152f9bb8 req-45a1d1de-1950-4a7f-ad5e-495e4d60e4b0 service nova] Creating event network-vif-plugged:4f73cce5-2a06-488c-8855-f44a51f4779a for instance 1f46edbb-82a0-4749-a443-02e5ca52e341 on n-h1-858383-16 Oct 27 09:06:06.559925 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2044be76-813c-4912-82a2-39c0152f9bb8 req-45a1d1de-1950-4a7f-ad5e-495e4d60e4b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086648 Oct 27 09:06:06.563034 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 786/1549] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:06.592749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-473bd1a8-38c3-422d-8255-6d8b96980724 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa344700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:06.670752 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-473bd1a8-38c3-422d-8255-6d8b96980724 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.078953 Oct 27 09:06:06.673358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 787/1550] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:06 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:06.682508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:06.685891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:06.700528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.701364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.701782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.702587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.703117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.704082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.827792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:06.846362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:06.851950 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8fc09c05-c237-47ab-8334-a982365fdf61 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.177265 Oct 27 09:06:06.852692 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 788/1551] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:06 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:06.868330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:06.871475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:06.873015 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d31520f-b656-4689-96bd-5cdeac995853 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.356515 Oct 27 09:06:06.880121 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 764/1552] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:06 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:06.985657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cfa82b89-e679-4fcc-981e-f9b314d35057"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:06.988059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:06.994058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.994540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.994975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:06.996244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:06.996700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:06.997123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.047747 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] HTTP exception thrown: Volume e31ee7d0-203a-47ae-8068-b5d2e02427c7 could not be found. Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Request method failure captured: Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d/os-volume_attachments/e31ee7d0-203a-47ae-8068-b5d2e02427c7 HTTP/1.1 Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 74 Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWklRg2zJDtgq7l0sYI5S7nctW1l5KdKq3Es0jejvzdickkoOsMBTMcNaW4G-0rB6ehv8XxDg2n5Nc1DBKxRtffqPtjr5MXQaEmsxi4-OShM3tpS8UtPkUwCRHgtWqiAksKPnGSfAa_6vyCgId_FxfM9kpnupSv-xb53bSHT6-BgytlE Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bcb425f81b8a468b8b1abc58aa1ac750 Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesAdminNegativeTest-1338843527 Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bcb425f81b8a468b8b1abc58aa1ac750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bcb425f81b8a468b8b1abc58aa1ac750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bcb425f81b8a468b8b1abc58aa1ac750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bcb425f81b8a468b8b1abc58aa1ac750"}]}] Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesAdminNegativeTest-1338843527 Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bcb425f81b8a468b8b1abc58aa1ac750 Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1338843527 Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesAdminNegativeTest-1338843527-project-admin Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: bd7671dc2aa44d71be38011c8abcbf8c Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesAdminNegativeTest-1338843527-project-admin Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: {"volumeAttachment": {"volumeId": "cfa82b89-e679-4fcc-981e-f9b314d35057"}} Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: exception: Volume e31ee7d0-203a-47ae-8068-b5d2e02427c7 could not be found. Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'server_id': '680796e2-1a4e-46e0-9407-742f517c7e9d', 'id': 'e31ee7d0-203a-47ae-8068-b5d2e02427c7', 'body': {'volumeAttachment': {'volumeId': 'cfa82b89-e679-4fcc-981e-f9b314d35057'}}} Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e31ee7d0-203a-47ae-8068-b5d2e02427c7 could not be found. (HTTP 404) (Request-ID: req-1d095416-bc02-4f20-ba52-d1c614a1a4db) Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:06:07.050033 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e31ee7d0-203a-47ae-8068-b5d2e02427c7 could not be found. Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e31ee7d0-203a-47ae-8068-b5d2e02427c7 could not be found. Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e31ee7d0-203a-47ae-8068-b5d2e02427c7 could not be found. Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] Returning 404 to user: Volume e31ee7d0-203a-47ae-8068-b5d2e02427c7 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-602b7a12-6372-46c5-8550-96a876118bc1 tempest-VolumesAdminNegativeTest-1338843527 tempest-VolumesAdminNegativeTest-1338843527-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d/os-volume_attachments/e31ee7d0-203a-47ae-8068-b5d2e02427c7" status: 404 len: 109 microversion: 2.1 time: 0.069869 Oct 27 09:06:07.058843 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 789/1553] 10.222.0.25 () {60 vars in 1433 bytes} [Thu Oct 27 09:06:06 2022] PUT /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d/os-volume_attachments/e31ee7d0-203a-47ae-8068-b5d2e02427c7 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:06:07.281842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:07.282646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: fb21e13f-718e-4afe-b3f3-97a05e9be9c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:07.290019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.290505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.290941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.291683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.292137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.292770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.306989 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] HTTP exception thrown: Instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 could not be found. Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Request method failure captured: Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 HTTP/1.1 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiegmnl2n716Mq_wdO8SPk35wJqzkpYkHnYKbLTW8ntaB0FkFe7wAEuJpXNUfyDkvX3D_2usptgXfZgLq1KD5HtVcD_RNBG8Pp_8bFJOjp066C71FY9xteP_KTNoXcdwohnxtsNap6wyQwdNTziG2nHIeXsZK9nTiDGSOnycwIztBM Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 749cfbed2a9044b286f364ad8fb9dea9 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-MigrationsAdminTest-759885590 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/749cfbed2a9044b286f364ad8fb9dea9"}]}] Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-MigrationsAdminTest-759885590 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 749cfbed2a9044b286f364ad8fb9dea9 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-MigrationsAdminTest-759885590 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-MigrationsAdminTest-759885590-project Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0566a978e2924137973615346b1afaa3 Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-MigrationsAdminTest-759885590-project Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 could not be found. Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'fb21e13f-718e-4afe-b3f3-97a05e9be9c6'} Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 could not be found. Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 could not be found. Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:07.309613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 could not be found. Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Returning 404 to user: Instance fb21e13f-718e-4afe-b3f3-97a05e9be9c6 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2d899cea-6c47-483c-9461-815942f52ab0 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6" status: 404 len: 111 microversion: 2.1 time: 0.032660 Oct 27 09:06:07.318214 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 765/1554] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:07 2022] GET /compute/v2.1/servers/fb21e13f-718e-4afe-b3f3-97a05e9be9c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:06:07.320491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:07.321031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:07.329730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.330471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.331096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.331996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.332621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.333857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.338613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:07.365339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:06:07.447021 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b451f8fe-e585-479a-aca1-43ec660269a4 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 204 len: 0 microversion: 2.1 time: 0.130523 Oct 27 09:06:07.451485 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 790/1555] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:06:07 2022] DELETE /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:07.457540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:07.458145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:07.464837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.465569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.466286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:07.466514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.467173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:07.467579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.468245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.468827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.473765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.474369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.474914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.475785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.476357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.476882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.706623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:07.709930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:07.714729 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14540e0d-96a8-4327-a709-d3f85d4b9269 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1467 microversion: 2.1 time: 0.261193 Oct 27 09:06:07.715416 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 766/1556] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:07 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1467 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:07.720226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b4945153-3c11-4cf0-a9c6-6edfe5a3b547 req-c2eb6eca-8935-4343-9c6b-5f5978d97758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d248926-b23e-472b-9a1e-4b10c924758a", "tag": "c24197dc-db5d-4363-91d8-125f1e441095"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:07.731799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b4945153-3c11-4cf0-a9c6-6edfe5a3b547 req-c2eb6eca-8935-4343-9c6b-5f5978d97758 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.732748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b4945153-3c11-4cf0-a9c6-6edfe5a3b547 req-c2eb6eca-8935-4343-9c6b-5f5978d97758 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.732911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b4945153-3c11-4cf0-a9c6-6edfe5a3b547 req-c2eb6eca-8935-4343-9c6b-5f5978d97758 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.734344 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91260206-64a5-4e22-8c92-865dcba5ae65 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.271346 Oct 27 09:06:07.735144 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 791/1557] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:07 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:07.739694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ede0694-f0bf-46ce-bc89-a7cc04ccc36c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa35fd30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:07.745941 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b4945153-3c11-4cf0-a9c6-6edfe5a3b547 req-c2eb6eca-8935-4343-9c6b-5f5978d97758 service nova] Creating event network-changed:c24197dc-db5d-4363-91d8-125f1e441095 for instance 3d248926-b23e-472b-9a1e-4b10c924758a on n-h1-858383-16 Oct 27 09:06:07.752345 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b4945153-3c11-4cf0-a9c6-6edfe5a3b547 req-c2eb6eca-8935-4343-9c6b-5f5978d97758 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034601 Oct 27 09:06:07.753292 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 767/1558] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:07.788497 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ede0694-f0bf-46ce-bc89-a7cc04ccc36c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.052471 Oct 27 09:06:07.791623 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 792/1559] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:07 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:07.880972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:07.882338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:07.889373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.889982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.890487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.891286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.891844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.892275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.900905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:07.901796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:07.908653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.909285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.909894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.911047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:07.911612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:07.912049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:07.991234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:08.016185 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96bf5b35-6fb5-4576-8dc1-0592d26a1939 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.139386 Oct 27 09:06:08.017108 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 768/1560] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:07 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:08.080670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:08.089965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:08.091907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:08.092962 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9d05d61c-8526-4e2d-bdf7-6bf5599b618c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.198019 Oct 27 09:06:08.093880 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 793/1561] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:07 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:08.742012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:08.742596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:08.750040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:08.750538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:08.750978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:08.751729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:08.752201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:08.752634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:08.760415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:08.761850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:08.774217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:08.774720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:08.775159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:08.777423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:08.777893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:08.778324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:08.965997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:08.969316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:08.976148 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-41a18b9c-8457-4920-aea1-df3b8db30d28 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1467 microversion: 2.1 time: 0.238231 Oct 27 09:06:08.976732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 769/1562] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:08 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1467 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:08.978085 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cae1335a-01e4-4acf-b430-3ba9a614d241 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.221585 Oct 27 09:06:08.987725 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 794/1563] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:08 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:08.990359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad33adfd-e700-4aa0-9e80-f18268995bc2 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa5e0b80>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:09.037400 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad33adfd-e700-4aa0-9e80-f18268995bc2 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.052578 Oct 27 09:06:09.038070 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 770/1564] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:08 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:09.047042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:09.047671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:09.053778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:09.054257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:09.054688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:09.055372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:09.055849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:09.056271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:09.118774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:09.119441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:09.131608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:09.132131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:09.132573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:09.133282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:09.133730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:09.134153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:09.141525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:09.162188 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cdfbcff2-8141-4683-8908-e216c16e38e7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.118746 Oct 27 09:06:09.162806 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 795/1565] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:09 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:09.270708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:09.271631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:09.278189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:09.285364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:09.285850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:09.286295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:09.287065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:09.287516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:09.288194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:09.290409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:09.292036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:09.293365 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0131e73-9166-4075-a8aa-27256f3daa64 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.178864 Oct 27 09:06:09.294339 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 771/1566] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:09 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:09.316733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:06:09.397167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:09.405284 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cc76f117-daa4-46da-903a-dd88f66cad93 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "DELETE /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 204 len: 0 microversion: 2.1 time: 0.139130 Oct 27 09:06:09.406099 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 796/1567] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:06:09 2022] DELETE /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:09.414953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:09.415635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:09.417837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:09.423726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:09.424227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:09.424673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:09.425383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:09.425842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:09.426276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:09.567538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:09.576855 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-305d0dd2-ae4e-4e13-846d-8158d5bb4767 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1514 microversion: 2.1 time: 0.166251 Oct 27 09:06:09.577431 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 772/1568] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:09 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:10.001363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:10.002098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:10.003431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:10.004176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:10.009800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.010292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.011428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.012323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.012449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.012782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.012906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.013279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.013416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.014025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.014781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.015305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.237306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:10.245903 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb636733-57a0-4cab-a7f2-062b1b27c402 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.247013 Oct 27 09:06:10.247528 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 773/1569] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:09 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:10.257660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:10.257867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4bd284b0-3ea7-4a2c-8094-b20c5fb5256d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa13f940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:10.257993 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-81653d6a-e6d5-4320-a2ca-4d73d2e01a59 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1467 microversion: 2.1 time: 0.260481 Oct 27 09:06:10.257993 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 797/1570] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:09 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1467 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:10.263779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:10.264577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:10.274181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.274840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.275371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.276249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.277002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.277884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.303523 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4bd284b0-3ea7-4a2c-8094-b20c5fb5256d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.054353 Oct 27 09:06:10.304502 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 774/1571] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:10 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:10.323046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:10.324477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:10.336113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.336748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.337930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.338738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.339307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.339845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.376501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:10.396026 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-193a4b28-9e64-4e12-86ea-bf42e3a1335a tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.137042 Oct 27 09:06:10.396785 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 798/1572] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:10 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:10.600862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:10.601592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:10.609784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.610639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.611254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.612185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:10.612720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:10.613224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:10.763268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:10.772981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:10.774683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:10.777212 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af412103-10ab-4c22-a7f6-80e154608279 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.457888 Oct 27 09:06:10.777212 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 775/1573] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:10 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:10.855407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:10.863810 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a429dcaa-9de6-4dfe-b12e-4e054c605637 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1514 microversion: 2.1 time: 0.267678 Oct 27 09:06:10.864450 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 799/1574] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:10 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:11.272907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:11.273563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:11.281795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.282022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:11.282500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.282707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.282956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:11.283430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.283909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.284513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.293213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.293718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.294163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.294881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.295332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.295808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.502318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:11.512559 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2bb735e-93dc-4397-b12e-d0ec8a840838 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.243500 Oct 27 09:06:11.517026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:11.537835 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 776/1575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:11 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:11.543712 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d795f3c-471c-464c-bf27-7b166965c89f tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1467 microversion: 2.1 time: 0.263623 Oct 27 09:06:11.545168 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 800/1576] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:11 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1467 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:11.546348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f15d201-2108-4bde-b518-4ff205a75a0f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa71e160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:11.550737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:11.551724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:11.565082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.565650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.566105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.566890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.567356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.567876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.605957 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f15d201-2108-4bde-b518-4ff205a75a0f tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.066227 Oct 27 09:06:11.606552 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 777/1577] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:11 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:11.668106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:11.694056 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80034bb2-6bf4-495b-8cd3-c710b715939d tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.147557 Oct 27 09:06:11.694842 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 801/1578] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:11 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:11.804654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:11.805388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:11.815112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.815981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.816726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.817942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.818276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-4d4d8441-16f1-42af-94fc-75c961cb4b8a req-f1db469a-0d75-4b95-88e7-fdb8fc1d73aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680796e2-1a4e-46e0-9407-742f517c7e9d", "name": "network-vif-deleted", "tag": "415ccb14-ad15-4768-af9a-14128574917b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:11.818922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.821894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.833237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4d4d8441-16f1-42af-94fc-75c961cb4b8a req-f1db469a-0d75-4b95-88e7-fdb8fc1d73aa service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.833812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4d4d8441-16f1-42af-94fc-75c961cb4b8a req-f1db469a-0d75-4b95-88e7-fdb8fc1d73aa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.834533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4d4d8441-16f1-42af-94fc-75c961cb4b8a req-f1db469a-0d75-4b95-88e7-fdb8fc1d73aa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.848760 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-4d4d8441-16f1-42af-94fc-75c961cb4b8a req-f1db469a-0d75-4b95-88e7-fdb8fc1d73aa service nova] Creating event network-vif-deleted:415ccb14-ad15-4768-af9a-14128574917b for instance 680796e2-1a4e-46e0-9407-742f517c7e9d on n-h2-858383-16 Oct 27 09:06:11.849923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:11.855859 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-4d4d8441-16f1-42af-94fc-75c961cb4b8a req-f1db469a-0d75-4b95-88e7-fdb8fc1d73aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049410 Oct 27 09:06:11.857406 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 802/1579] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:11.899646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:11.900459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:11.916095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.916608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.920176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:11.921011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:11.922642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:11.923280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:12.034591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:12.044042 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-48af8ca8-9f45-4bd1-8084-68573a4c6658 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 200 len: 1303 microversion: 2.1 time: 0.158986 Oct 27 09:06:12.045009 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 803/1580] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:11 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 1303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:12.056801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:12.067695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:12.069345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:12.070761 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be0eab6b-b0ef-4248-9793-e23947a4887c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.272313 Oct 27 09:06:12.071721 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 778/1581] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:11 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:12.544441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:12.545057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:12.553150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:12.553639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:12.554079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:12.554849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:12.555954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:12.555954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:12.560503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:12.573700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:12.576486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:12.596564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:12.603931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:12.604590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:12.605577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:12.606062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:12.606659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:12.910853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:12.928543 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5bf8dfc9-0084-4153-9898-4e9839c7d7e5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.387727 Oct 27 09:06:12.929821 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 804/1582] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:12 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:12.938636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64fdbef4-8097-4f77-90a4-a1100f1a9b14 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa3444c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:12.990839 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64fdbef4-8097-4f77-90a4-a1100f1a9b14 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.059608 Oct 27 09:06:12.991430 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 805/1583] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:12 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:12.996388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:12.997193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:13.003901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:13.004622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:13.005251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:13.006121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:13.006819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:13.007455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:13.020933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:13.036203 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4c84956-d531-4194-8fc9-8e7a3588464a tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1467 microversion: 2.1 time: 0.465136 Oct 27 09:06:13.039244 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 779/1584] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:12 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1467 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:13.068198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:13.069101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 680796e2-1a4e-46e0-9407-742f517c7e9d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:13.080833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:13.081666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:13.082280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:13.083136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:13.083656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:13.084091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:13.100692 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] HTTP exception thrown: Instance 680796e2-1a4e-46e0-9407-742f517c7e9d could not be found. Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Request method failure captured: Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d HTTP/1.1 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWklDbx9azCLFd0BgK8TOBWwC3tCsZBiR3ug3oeoTLtFAbClsEI5C8zIDuZ41oOKtgIH6Wrx9VP9z092oWAyT0Rg6Fl3LmmIjXMoBVRwt-hjY77IzL3p7SrJV2ZMO8qJeIM01WY9JkUn8tFcDQxlEwQftiF3-GOOeyA0bSdEr6yGZo0A Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: c3cdafcecdff4fe2bad2db76c806bcf3 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesAdminNegativeTest-2016761418 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3cdafcecdff4fe2bad2db76c806bcf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3cdafcecdff4fe2bad2db76c806bcf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3cdafcecdff4fe2bad2db76c806bcf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3cdafcecdff4fe2bad2db76c806bcf3"}]}] Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-VolumesAdminNegativeTest-2016761418 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: c3cdafcecdff4fe2bad2db76c806bcf3 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2016761418 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-VolumesAdminNegativeTest-2016761418-project Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 1415fa5593bd4614988fcc604442d0c0 Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-VolumesAdminNegativeTest-2016761418-project Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 680796e2-1a4e-46e0-9407-742f517c7e9d could not be found. Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '680796e2-1a4e-46e0-9407-742f517c7e9d'} Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680796e2-1a4e-46e0-9407-742f517c7e9d could not be found. Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680796e2-1a4e-46e0-9407-742f517c7e9d could not be found. Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:13.102870 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680796e2-1a4e-46e0-9407-742f517c7e9d could not be found. Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Returning 404 to user: Instance 680796e2-1a4e-46e0-9407-742f517c7e9d could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7aff7407-9f9d-4afe-a446-48282a06abb3 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d" status: 404 len: 111 microversion: 2.1 time: 0.040236 Oct 27 09:06:13.115273 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 780/1585] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:13 2022] GET /compute/v2.1/servers/680796e2-1a4e-46e0-9407-742f517c7e9d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:06:13.130513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:13.137183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:13.153410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:13.157727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:13.161423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:13.161878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:13.162615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:13.163075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:13.167346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:13.185689 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f42dcaf-7234-41c6-be97-39de892a788c tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.192907 Oct 27 09:06:13.186956 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 806/1586] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:12 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:13.525099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:13.544147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:13.548710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:13.550334 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33e97c04-a9d3-43be-ac14-83d68fefe419 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.444427 Oct 27 09:06:13.551653 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 781/1587] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:13 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:13.682823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a27497fe-b230-412c-92b7-aea1af7a4b32 req-80e70830-72d9-45af-8a7b-cce821cac717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba26e0a-7168-465e-b2f2-3b763456fe6c", "name": "network-vif-deleted", "tag": "083ab409-0cbd-467f-85a9-e03ea9c7779b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:13.699227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a27497fe-b230-412c-92b7-aea1af7a4b32 req-80e70830-72d9-45af-8a7b-cce821cac717 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:13.701310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a27497fe-b230-412c-92b7-aea1af7a4b32 req-80e70830-72d9-45af-8a7b-cce821cac717 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:13.706979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a27497fe-b230-412c-92b7-aea1af7a4b32 req-80e70830-72d9-45af-8a7b-cce821cac717 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:13.729882 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a27497fe-b230-412c-92b7-aea1af7a4b32 req-80e70830-72d9-45af-8a7b-cce821cac717 service nova] Creating event network-vif-deleted:083ab409-0cbd-467f-85a9-e03ea9c7779b for instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c on n-h1-858383-16 Oct 27 09:06:13.742318 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a27497fe-b230-412c-92b7-aea1af7a4b32 req-80e70830-72d9-45af-8a7b-cce821cac717 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063588 Oct 27 09:06:13.743971 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 807/1588] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:13.954655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:13.956331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:13.976031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:13.977986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:13.978930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:13.980990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:13.982063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:13.982776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:14.007556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fdab8124-8a6d-4501-b7e0-01595733ff17 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa2a3160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:14.107038 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fdab8124-8a6d-4501-b7e0-01595733ff17 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.104164 Oct 27 09:06:14.113892 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 808/1589] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:14 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:14.130240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:14.135554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:14.154803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:14.155457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:14.156477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:14.157776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:14.160244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:14.160807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:14.270677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:14.271112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:14.271553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:14.272036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lazy-loading 'fault' on Instance uuid 3ba26e0a-7168-465e-b2f2-3b763456fe6c {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:14.481113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0566a978e2924137973615346b1afaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749cfbed2a9044b286f364ad8fb9dea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:14.491800 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1edf8f30-77fb-4c0e-bc23-c656f2d8c957 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 200 len: 1301 microversion: 2.1 time: 0.375004 Oct 27 09:06:14.510039 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 809/1590] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:14 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 1301 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:14.515881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:14.519258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:14.534937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:14.535761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:14.536364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:14.537284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:14.537886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:14.538905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:14.592939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:14.601863 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c24a412c-8346-4841-a4ad-aa2e2274b39f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.652687 Oct 27 09:06:14.610400 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 782/1591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:13 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:14.615496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:14.616293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:14.630891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:14.631843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:14.632470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:14.639278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:14.640518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:14.640640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:14.673647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:14.736304 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-06fd7ac6-e38d-4fc8-8911-5023b9a078a7 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.223765 Oct 27 09:06:14.752756 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 810/1592] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:14 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:14.907330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:14.919321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:14.921774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:14.924625 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e3396fd-1897-4efb-9683-90d8f09ff9da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.312857 Oct 27 09:06:14.928424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 783/1593] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:14 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:15.125579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-09b2e5cf-aa9f-42b2-97b7-2a2fd7aac437 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa344310>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:15.206038 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-09b2e5cf-aa9f-42b2-97b7-2a2fd7aac437 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.084415 Oct 27 09:06:15.218454 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 811/1594] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:15 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:15.514745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:15.515364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] [instance: 3ba26e0a-7168-465e-b2f2-3b763456fe6c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:15.526544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:15.529840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:15.530544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:15.531532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:15.532216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:15.532851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:15.560975 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] HTTP exception thrown: Instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c could not be found. Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Request method failure captured: Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c HTTP/1.1 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiegmnl2n716Mq_wdO8SPk35wJqzkpYkHnYKbLTW8ntaB0FkFe7wAEuJpXNUfyDkvX3D_2usptgXfZgLq1KD5HtVcD_RNBG8Pp_8bFJOjp066C71FY9xteP_KTNoXcdwohnxtsNap6wyQwdNTziG2nHIeXsZK9nTiDGSOnycwIztBM Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 749cfbed2a9044b286f364ad8fb9dea9 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-MigrationsAdminTest-759885590 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749cfbed2a9044b286f364ad8fb9dea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/749cfbed2a9044b286f364ad8fb9dea9"}]}] Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-MigrationsAdminTest-759885590 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 749cfbed2a9044b286f364ad8fb9dea9 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-MigrationsAdminTest-759885590 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-MigrationsAdminTest-759885590-project Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0566a978e2924137973615346b1afaa3 Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-MigrationsAdminTest-759885590-project Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c could not be found. Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '3ba26e0a-7168-465e-b2f2-3b763456fe6c'} Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c could not be found. Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c could not be found. Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:15.566962 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:15.572555 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:15.572555 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:15.572555 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:15.572555 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:06:15.572555 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:06:15.572555 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c could not be found. Oct 27 09:06:15.572555 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:15.574569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] Returning 404 to user: Instance 3ba26e0a-7168-465e-b2f2-3b763456fe6c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:06:15.575845 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7cef3ddd-6057-402b-b0a3-58aa9cc17525 tempest-MigrationsAdminTest-759885590 tempest-MigrationsAdminTest-759885590-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c" status: 404 len: 111 microversion: 2.1 time: 0.065193 Oct 27 09:06:15.583317 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 784/1595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:15 2022] GET /compute/v2.1/servers/3ba26e0a-7168-465e-b2f2-3b763456fe6c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:06:15.644257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:15.644966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:15.658152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:15.658783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:15.659332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:15.661016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:15.661997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:15.663066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:15.785360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:15.786236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:15.798129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:15.799353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:15.800397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:15.804455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:15.805192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:15.805887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:16.016642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:16.081540 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72ebc285-87bd-4e5c-b37a-cf9b1cc054ed tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.299837 Oct 27 09:06:16.082135 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 785/1596] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:15 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:16.097352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:16.099631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:16.101472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:16.112256 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d86615d5-ac2a-4aec-84df-63afa91dc77e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.473498 Oct 27 09:06:16.116034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:16.117003 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 812/1597] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:15 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:16.129611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:16.130906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:16.131980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:16.143259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:16.144427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:16.223423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6e173f02-2556-4cf2-b480-194247ea025c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa8e3d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:16.290797 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6e173f02-2556-4cf2-b480-194247ea025c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.072089 Oct 27 09:06:16.294679 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 813/1598] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:16 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:16.351486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:16.364463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:16.366032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:16.367373 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fffea576-5a3c-48f2-bba0-547a4b7bacb5 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1815 microversion: 2.25 time: 0.280969 Oct 27 09:06:16.379603 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 786/1599] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:16 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1815 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:17.111933 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:06:17.112749 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 09:06:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 (ip 10.222.0.25) !!! Oct 27 09:06:17.120732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:17.121530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:17.151918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:17.154638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:17.160289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:17.161570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:17.162383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:17.163363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:17.164648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:17.165298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:17.167759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:17.168436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:17.169050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:17.169765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:17.170224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:17.170655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:17.388606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:17.439700 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a61a6c83-b6a7-4d23-b8a4-54260c8bad09 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.329136 Oct 27 09:06:17.446271 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 814/1600] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:17 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:17.459894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86b4c4d8-73b1-4266-8af4-7736ee46ea65 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa78a9d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:17.553651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:17.563666 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df34f3e3-031c-46d1-a068-d057d71261ff tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.421717 Oct 27 09:06:17.575102 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86b4c4d8-73b1-4266-8af4-7736ee46ea65 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.127094 Oct 27 09:06:17.575846 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 787/1601] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:17 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:17.576752 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 815/1602] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:17 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:17.763002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d28366e5-8ff1-4e45-be4a-15143f3d18a3 req-7253f485-560b-4a6c-8d5a-c0582b6583a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5c8ea0-8c53-4718-b62f-f35835ecb83e", "name": "network-vif-plugged", "status": "completed", "tag": "c30b0569-641d-48e2-a378-efe6a00a3231"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:17.786321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d28366e5-8ff1-4e45-be4a-15143f3d18a3 req-7253f485-560b-4a6c-8d5a-c0582b6583a2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:17.786937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d28366e5-8ff1-4e45-be4a-15143f3d18a3 req-7253f485-560b-4a6c-8d5a-c0582b6583a2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:17.787389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d28366e5-8ff1-4e45-be4a-15143f3d18a3 req-7253f485-560b-4a6c-8d5a-c0582b6583a2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:17.821933 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d28366e5-8ff1-4e45-be4a-15143f3d18a3 req-7253f485-560b-4a6c-8d5a-c0582b6583a2 service nova] Creating event network-vif-plugged:c30b0569-641d-48e2-a378-efe6a00a3231 for instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e on n-h1-858383-16 Oct 27 09:06:17.841181 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d28366e5-8ff1-4e45-be4a-15143f3d18a3 req-7253f485-560b-4a6c-8d5a-c0582b6583a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083118 Oct 27 09:06:17.845744 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 816/1603] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 27 09:06:17.875467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:17.876884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:17.910217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:17.913066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:17.915826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:17.920930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:17.925532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:17.929707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:17.995292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:06:18.005631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:18.006452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:18.030247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.030882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.031340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.036416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.040238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.046019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.180044 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a133171c-009c-4ec3-9e77-4b2717dfe9f5 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 204 len: 0 microversion: 2.1 time: 0.332096 Oct 27 09:06:18.188787 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 817/1604] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:06:17 2022] DELETE /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:18.214524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:18.215603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:18.230636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.231661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.232417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.233390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.234068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.234894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.454112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:18.471002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:18.474336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:18.477726 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9be30035-1541-4622-adac-cda8ce2f9743 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1805 microversion: 2.25 time: 0.891724 Oct 27 09:06:18.478305 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 788/1605] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:17 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1805 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:18.487903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:18.488802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:18.497763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.499002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.499618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.505350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.505907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.506358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.507345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:18.518849 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e92ce937-4bf0-4378-b37f-eae98f988aa7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1682 microversion: 2.1 time: 0.328266 Oct 27 09:06:18.532370 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 818/1606] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:18 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1682 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:18.545386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aec0f22c-4548-40a8-96c1-a4ff2e40245b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '.version_select at 0x7f31aa8e3d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:18.549998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aec0f22c-4548-40a8-96c1-a4ff2e40245b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.550824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aec0f22c-4548-40a8-96c1-a4ff2e40245b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.551451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aec0f22c-4548-40a8-96c1-a4ff2e40245b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.563535 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aec0f22c-4548-40a8-96c1-a4ff2e40245b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2807 microversion: 2.25 time: 0.028554 Oct 27 09:06:18.564871 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 819/1607] 10.222.0.25 () {60 vars in 1184 bytes} [Thu Oct 27 09:06:18 2022] GET /compute/v2.1/os-migrations => generated 2807 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:18.584036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:18.586458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:18.604571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.605314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.605992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.606931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.607617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.608220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.640863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:18.686658 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34189eed-4fbf-4945-a07a-eaf9d50c3b42 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.204469 Oct 27 09:06:18.688494 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 789/1608] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:18 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:18.698838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-69482069-f5a2-4cd6-8e74-1e5c0e6fba7e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa13e160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:18.762992 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-69482069-f5a2-4cd6-8e74-1e5c0e6fba7e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.071341 Oct 27 09:06:18.764306 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 790/1609] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:18 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:18.786086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:18.787892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:18.803875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.805756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.807442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.808891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:18.811415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:18.814549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:18.919333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:18.981844 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b03ed0a-7646-4caf-81c6-2d79dc6d77ba tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 2426 microversion: 2.25 time: 0.401788 Oct 27 09:06:18.988731 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 820/1610] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:18 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 2426 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:19.022127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:19.023066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:19.050189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.052233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.053941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.055700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.057081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.059046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.106202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:19.115292 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73ca89f6-c0df-4215-a36f-edf9feb9426b tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.348243 Oct 27 09:06:19.116458 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 791/1611] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:18 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:19.261278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:19.286582 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08efa2fa-7388-4886-a910-238caf02b8a9 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 2426 microversion: 2.25 time: 0.268577 Oct 27 09:06:19.287435 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 821/1612] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:19 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 2426 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:19.425314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:19.426052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:19.435914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.436685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.437302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.438232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.438864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.439683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.553055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:19.553685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:19.564089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.568033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.569222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.572635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.573184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.581622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.598268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lazy-loading 'services' on Instance uuid f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:19.754232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbbd1e5a-a182-4104-80aa-c2bd3acd1aa7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments/4519c945-9ce4-48f0-bffe-4c01c00aaf1f" status: 202 len: 0 microversion: 2.25 time: 0.336288 Oct 27 09:06:19.755106 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 792/1613] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Oct 27 09:06:19 2022] DELETE /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments/4519c945-9ce4-48f0-bffe-4c01c00aaf1f => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:19.778787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:19.779790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:19.787886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.788857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.789536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.790552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.791181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.792388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.850660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:19.863734 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd324871-9108-4918-8a09-c0ee40e2710c tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1682 microversion: 2.1 time: 0.315675 Oct 27 09:06:19.880897 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 822/1614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:19 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1682 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:19.890013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4294f34f-cb66-4ed3-8a17-c51f9098b88c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:19.893353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4294f34f-cb66-4ed3-8a17-c51f9098b88c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:19.899852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4294f34f-cb66-4ed3-8a17-c51f9098b88c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.901866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4294f34f-cb66-4ed3-8a17-c51f9098b88c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.902557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4294f34f-cb66-4ed3-8a17-c51f9098b88c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.903537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4294f34f-cb66-4ed3-8a17-c51f9098b88c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:19.904351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4294f34f-cb66-4ed3-8a17-c51f9098b88c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:19.905005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4294f34f-cb66-4ed3-8a17-c51f9098b88c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:19.949860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:19.969636 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44391340-a5b7-4fa2-8091-e7b1a2b2fcea tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.212188 Oct 27 09:06:19.970228 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 793/1615] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:19 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:19.973378 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4294f34f-cb66-4ed3-8a17-c51f9098b88c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090396 Oct 27 09:06:19.974139 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 823/1616] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:06:19 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:19.974861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e50361b-86a8-40d7-ad27-d8c3378fd31e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0ef1f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:20.048895 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e50361b-86a8-40d7-ad27-d8c3378fd31e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.077615 Oct 27 09:06:20.049942 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 794/1617] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:19 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:20.141690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:20.142365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:20.152881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:20.153683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:20.154315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:20.157264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:20.157951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:20.158690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:20.164842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2d4d9070-b1ac-4e2c-83ca-7d25bce38506 tempest-QuotaClassesAdmin257Test-2104338023 tempest-QuotaClassesAdmin257Test-2104338023-project-admin] Calling method '.version_select at 0x7f31aa9cd5e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:20.182960 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2d4d9070-b1ac-4e2c-83ca-7d25bce38506 tempest-QuotaClassesAdmin257Test-2104338023 tempest-QuotaClassesAdmin257Test-2104338023-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.207419 Oct 27 09:06:20.191946 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 824/1618] 10.222.0.25 () {60 vars in 1226 bytes} [Thu Oct 27 09:06:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:20.202447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-103c3d11-03c3-4301-836a-f9a1e27e97ff tempest-QuotaClassesAdmin257Test-2104338023 tempest-QuotaClassesAdmin257Test-2104338023-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa57a820>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:20.358709 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-103c3d11-03c3-4301-836a-f9a1e27e97ff tempest-QuotaClassesAdmin257Test-2104338023 tempest-QuotaClassesAdmin257Test-2104338023-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.164575 Oct 27 09:06:20.361410 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 825/1619] 10.222.0.25 () {62 vars in 1247 bytes} [Thu Oct 27 09:06:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:20.373567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c6edfb7-c386-4007-923f-528415b2e6a6 tempest-QuotaClassesAdmin257Test-2104338023 tempest-QuotaClassesAdmin257Test-2104338023-project-admin] Calling method '.version_select at 0x7f31aa55d3a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:20.395725 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c6edfb7-c386-4007-923f-528415b2e6a6 tempest-QuotaClassesAdmin257Test-2104338023 tempest-QuotaClassesAdmin257Test-2104338023-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.026769 Oct 27 09:06:20.397009 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 826/1620] 10.222.0.25 () {60 vars in 1226 bytes} [Thu Oct 27 09:06:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:20.413763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-190e4b4a-b006-4119-9d1a-f4b3740ffb46 tempest-QuotaClassesAdmin257Test-2104338023 tempest-QuotaClassesAdmin257Test-2104338023-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa3beb80>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:20.421807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:20.445067 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b46271ab-4dec-4600-b910-8953a48a7f46 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1198 microversion: 2.1 time: 0.310464 Oct 27 09:06:20.459716 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 795/1621] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:20 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1198 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:20.502452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=15,nova_api:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:20.525412 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-190e4b4a-b006-4119-9d1a-f4b3740ffb46 tempest-QuotaClassesAdmin257Test-2104338023 tempest-QuotaClassesAdmin257Test-2104338023-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.117284 Oct 27 09:06:20.533012 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 827/1622] 10.222.0.25 () {62 vars in 1247 bytes} [Thu Oct 27 09:06:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:06:20.894633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:20.898384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:20.907314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:20.907852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:20.908704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:20.909790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:20.910523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:20.911138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:20.996397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5aabf56f-1bb4-43f2-b176-d39486f03789 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:20.997241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5aabf56f-1bb4-43f2-b176-d39486f03789 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:21.012671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aabf56f-1bb4-43f2-b176-d39486f03789 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:21.013585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aabf56f-1bb4-43f2-b176-d39486f03789 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:21.016236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aabf56f-1bb4-43f2-b176-d39486f03789 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:21.018703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aabf56f-1bb4-43f2-b176-d39486f03789 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:21.021921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aabf56f-1bb4-43f2-b176-d39486f03789 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:21.022125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aabf56f-1bb4-43f2-b176-d39486f03789 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:21.032093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:21.095106 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5aabf56f-1bb4-43f2-b176-d39486f03789 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105204 Oct 27 09:06:21.096125 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 828/1623] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:06:20 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:21.104731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:21.106463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:21.113588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:21.114266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:21.114786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:21.115632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:21.117976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:21.118468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:21.249870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:21.257231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:21.259591 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c6188388-7ceb-40c8-b782-9e341ded201f tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1682 microversion: 2.1 time: 0.369219 Oct 27 09:06:21.260739 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 796/1624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:20 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1682 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:21.276107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:21.296199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8b232a4-57d3-4fd4-bc16-ae29db36d291 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa826a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:21.308823 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4fb958d2-1386-4a4c-9fc4-418b1d27f342 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.211476 Oct 27 09:06:21.309873 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 829/1625] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:21 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:21.354231 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8b232a4-57d3-4fd4-bc16-ae29db36d291 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.081362 Oct 27 09:06:21.355150 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 797/1626] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:21 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:21.471152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:21.473281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:21.498925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:21.500031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:21.502555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:21.505217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:21.507735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:21.510836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:21.710774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2aa765be-7bd9-494d-9099-dbb6e323f1da req-71bd29fd-6dd3-4767-8416-ed461c45f1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84aa1ad4-354f-4ad7-b54c-4ee8e96950e6", "name": "network-vif-deleted", "tag": "435314b9-661f-4dd8-937f-c626a97df68d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:21.736968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2aa765be-7bd9-494d-9099-dbb6e323f1da req-71bd29fd-6dd3-4767-8416-ed461c45f1a6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:21.739991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2aa765be-7bd9-494d-9099-dbb6e323f1da req-71bd29fd-6dd3-4767-8416-ed461c45f1a6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:21.741080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2aa765be-7bd9-494d-9099-dbb6e323f1da req-71bd29fd-6dd3-4767-8416-ed461c45f1a6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:21.777660 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2aa765be-7bd9-494d-9099-dbb6e323f1da req-71bd29fd-6dd3-4767-8416-ed461c45f1a6 service nova] Creating event network-vif-deleted:435314b9-661f-4dd8-937f-c626a97df68d for instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 on n-h2-858383-16 Oct 27 09:06:21.785266 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2aa765be-7bd9-494d-9099-dbb6e323f1da req-71bd29fd-6dd3-4767-8416-ed461c45f1a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079498 Oct 27 09:06:21.796371 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 798/1627] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:06:21.972770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:21.982047 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6c59aee-eaa5-4d3a-92f9-5ac8ec52a31e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1382 microversion: 2.1 time: 0.515513 Oct 27 09:06:21.982650 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 830/1628] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:21 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1382 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:22.110680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f463aa47-fe72-48af-b92e-fa742b354b03 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:22.113261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f463aa47-fe72-48af-b92e-fa742b354b03 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:22.149997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f463aa47-fe72-48af-b92e-fa742b354b03 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:22.153242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f463aa47-fe72-48af-b92e-fa742b354b03 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:22.154461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f463aa47-fe72-48af-b92e-fa742b354b03 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:22.159331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f463aa47-fe72-48af-b92e-fa742b354b03 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:22.160455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f463aa47-fe72-48af-b92e-fa742b354b03 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:22.161898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f463aa47-fe72-48af-b92e-fa742b354b03 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:22.246906 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f463aa47-fe72-48af-b92e-fa742b354b03 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142832 Oct 27 09:06:22.253188 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 831/1629] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:06:22 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:06:22.286191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:22.287231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:22.295215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:22.299142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:22.306301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:22.308285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:22.312812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:22.313645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:22.408126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:22.410773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:22.411486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:22.414201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lazy-loading 'fault' on Instance uuid 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:22.523479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1415fa5593bd4614988fcc604442d0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdafcecdff4fe2bad2db76c806bcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:22.539205 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f06ce32-fd06-4764-b55e-8f1581d0fa0a tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 200 len: 1330 microversion: 2.1 time: 0.257059 Oct 27 09:06:22.540285 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 832/1630] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:22 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 1330 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:22.553745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:22.556219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:22.585238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c01379d-059d-4a76-9166-b0bfa6fcfaf5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:22.585936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c01379d-059d-4a76-9166-b0bfa6fcfaf5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:22.605969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:22.606494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:22.612064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:22.614138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:22.614757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:22.615390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:22.619412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c01379d-059d-4a76-9166-b0bfa6fcfaf5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:22.620032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c01379d-059d-4a76-9166-b0bfa6fcfaf5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:22.620488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c01379d-059d-4a76-9166-b0bfa6fcfaf5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:22.621231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c01379d-059d-4a76-9166-b0bfa6fcfaf5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:22.621688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c01379d-059d-4a76-9166-b0bfa6fcfaf5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:22.638293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c01379d-059d-4a76-9166-b0bfa6fcfaf5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:22.730777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:22.779508 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3a4cea99-4d5a-494c-b104-a3de7a422b68 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.237980 Oct 27 09:06:22.783495 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 833/1631] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:22 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:22.796303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-329f616e-a140-4d91-8f25-a655027d2335 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa6d7700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:22.891497 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-329f616e-a140-4d91-8f25-a655027d2335 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.106621 Oct 27 09:06:22.895665 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 834/1632] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:22 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:23.018399 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c01379d-059d-4a76-9166-b0bfa6fcfaf5 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1535 microversion: 2.1 time: 1.013456 Oct 27 09:06:23.023165 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 799/1633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:22 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1535 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:23.047986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1f39bc9a-7142-49f0-acb5-3c261c5f05e2 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:23.048889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1f39bc9a-7142-49f0-acb5-3c261c5f05e2 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:23.055932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f39bc9a-7142-49f0-acb5-3c261c5f05e2 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.056424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f39bc9a-7142-49f0-acb5-3c261c5f05e2 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.063726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f39bc9a-7142-49f0-acb5-3c261c5f05e2 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.064718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f39bc9a-7142-49f0-acb5-3c261c5f05e2 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.065699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f39bc9a-7142-49f0-acb5-3c261c5f05e2 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.066506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f39bc9a-7142-49f0-acb5-3c261c5f05e2 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.261069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7fec609f-8a57-4cf4-a59c-e19d7fce6aa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:23.263662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7fec609f-8a57-4cf4-a59c-e19d7fce6aa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:23.284395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fec609f-8a57-4cf4-a59c-e19d7fce6aa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.284889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fec609f-8a57-4cf4-a59c-e19d7fce6aa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.285325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fec609f-8a57-4cf4-a59c-e19d7fce6aa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.290462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fec609f-8a57-4cf4-a59c-e19d7fce6aa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.290962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fec609f-8a57-4cf4-a59c-e19d7fce6aa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.297197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fec609f-8a57-4cf4-a59c-e19d7fce6aa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.400721 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7fec609f-8a57-4cf4-a59c-e19d7fce6aa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.143827 Oct 27 09:06:23.401303 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 800/1634] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:06:23 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:06:23.438310 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1f39bc9a-7142-49f0-acb5-3c261c5f05e2 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1535 microversion: 2.1 time: 0.393165 Oct 27 09:06:23.439658 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 835/1635] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:23 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1535 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:23.461502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea0f89a1-eae5-4c4f-a215-a87301109f91 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:23.465933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea0f89a1-eae5-4c4f-a215-a87301109f91 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.467172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea0f89a1-eae5-4c4f-a215-a87301109f91 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.467675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea0f89a1-eae5-4c4f-a215-a87301109f91 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.468697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea0f89a1-eae5-4c4f-a215-a87301109f91 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.469174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea0f89a1-eae5-4c4f-a215-a87301109f91 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.469771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea0f89a1-eae5-4c4f-a215-a87301109f91 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.498332 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea0f89a1-eae5-4c4f-a215-a87301109f91 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040368 Oct 27 09:06:23.512105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-16", "block_migration": false, "disk_over_commit": false}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:23.514562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:23.516977 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 801/1636] 10.222.0.25 () {58 vars in 1176 bytes} [Thu Oct 27 09:06:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:23.521605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.522262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.522919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.523810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.524875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.525309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.564838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:23.565456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] [instance: 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:23.572767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.573897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.574527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.575482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.576194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.576905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.581776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lazy-loading 'flavor' on Instance uuid 8f5c8ea0-8c53-4718-b62f-f35835ecb83e {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:23.597544 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] HTTP exception thrown: Instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 could not be found. Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Request method failure captured: Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 HTTP/1.1 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWklDbx9azCLFd0BgK8TOBWwC3tCsZBiR3ug3oeoTLtFAbClsEI5C8zIDuZ41oOKtgIH6Wrx9VP9z092oWAyT0Rg6Fl3LmmIjXMoBVRwt-hjY77IzL3p7SrJV2ZMO8qJeIM01WY9JkUn8tFcDQxlEwQftiF3-GOOeyA0bSdEr6yGZo0A Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: c3cdafcecdff4fe2bad2db76c806bcf3 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesAdminNegativeTest-2016761418 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3cdafcecdff4fe2bad2db76c806bcf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3cdafcecdff4fe2bad2db76c806bcf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3cdafcecdff4fe2bad2db76c806bcf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3cdafcecdff4fe2bad2db76c806bcf3"}]}] Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-VolumesAdminNegativeTest-2016761418 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: c3cdafcecdff4fe2bad2db76c806bcf3 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2016761418 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-VolumesAdminNegativeTest-2016761418-project Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 1415fa5593bd4614988fcc604442d0c0 Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-VolumesAdminNegativeTest-2016761418-project Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 could not be found. Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '84aa1ad4-354f-4ad7-b54c-4ee8e96950e6'} Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 could not be found. Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 could not be found. Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:23.600341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:23.606544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:23.606544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:23.606544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:23.606544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:06:23.606544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:06:23.606544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 could not be found. Oct 27 09:06:23.606544 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:06:23.607702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Returning 404 to user: Instance 84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:06:23.608575 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cebf7eba-a7d9-4042-bf14-833663a157a7 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6" status: 404 len: 111 microversion: 2.1 time: 0.049899 Oct 27 09:06:23.609366 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 802/1637] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:23 2022] GET /compute/v2.1/servers/84aa1ad4-354f-4ad7-b54c-4ee8e96950e6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:06:23.616921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Going to try to live migrate instance to n-h2-858383-16 {{(pid=120602) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:06:23.618189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6ee6b5c-1c63-487a-9ddd-1a133420e999 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] Calling method '.version_select at 0x7f31aa209f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:23.651538 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6ee6b5c-1c63-487a-9ddd-1a133420e999 tempest-VolumesAdminNegativeTest-2016761418 tempest-VolumesAdminNegativeTest-2016761418-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-764824312" status: 202 len: 0 microversion: 2.1 time: 0.035983 Oct 27 09:06:23.653457 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 803/1638] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:06:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-764824312 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:06:23.828632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:23.828632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:23.853406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.856339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.859092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:23.860848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:23.863174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:23.864134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:24.154269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:24.232196 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8565b76f-47fa-4e08-84a1-37a8280c1bda tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1931 microversion: 2.75 time: 0.421377 Oct 27 09:06:24.235027 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 804/1639] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:23 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1931 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:24.255414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-827ea6cc-34f0-48e2-9ab5-20915ceb21d5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa027a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:24.347675 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-827ea6cc-34f0-48e2-9ab5-20915ceb21d5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.111199 Oct 27 09:06:24.351266 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 805/1640] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:24 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:24.417036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0cf1dc05-e902-4171-889d-509a5070a660 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:24.420383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0cf1dc05-e902-4171-889d-509a5070a660 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:24.437946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cf1dc05-e902-4171-889d-509a5070a660 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:24.440176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cf1dc05-e902-4171-889d-509a5070a660 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:24.443652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cf1dc05-e902-4171-889d-509a5070a660 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:24.449141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cf1dc05-e902-4171-889d-509a5070a660 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:24.451422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cf1dc05-e902-4171-889d-509a5070a660 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:24.453524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cf1dc05-e902-4171-889d-509a5070a660 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:24.586796 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0cf1dc05-e902-4171-889d-509a5070a660 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.175315 Oct 27 09:06:24.587727 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 806/1641] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:06:24 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:06:25.268724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:25.269518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:25.280760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:25.283736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:25.284474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:25.286785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:25.287589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:25.288201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:25.450986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:25.521455 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7104bb90-10e0-4c92-b23d-9735dc05645f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1937 microversion: 2.75 time: 0.256881 Oct 27 09:06:25.543984 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 807/1642] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:25 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1937 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:25.561059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2698d618-54de-40a3-a9d1-76c7a460893b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9fd35e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:25.670890 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2698d618-54de-40a3-a9d1-76c7a460893b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.125238 Oct 27 09:06:25.679661 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 808/1643] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:25 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:25.689775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e638c8b6-8f0b-4fc8-9ecf-56f2a5b0ef6f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:25.696772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e638c8b6-8f0b-4fc8-9ecf-56f2a5b0ef6f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:25.712823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e638c8b6-8f0b-4fc8-9ecf-56f2a5b0ef6f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:25.713803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e638c8b6-8f0b-4fc8-9ecf-56f2a5b0ef6f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:25.714259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e638c8b6-8f0b-4fc8-9ecf-56f2a5b0ef6f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:25.719106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e638c8b6-8f0b-4fc8-9ecf-56f2a5b0ef6f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:25.720089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e638c8b6-8f0b-4fc8-9ecf-56f2a5b0ef6f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:25.720202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e638c8b6-8f0b-4fc8-9ecf-56f2a5b0ef6f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:25.788475 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e638c8b6-8f0b-4fc8-9ecf-56f2a5b0ef6f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111560 Oct 27 09:06:25.789534 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 809/1644] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:06:25 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:26.559885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:26.560800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:26.575930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:26.576442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:26.576890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:26.577674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:26.578141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:26.578573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:26.674161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:26.696006 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9690f70a-1faf-4957-b906-f21785fd14a0 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1937 microversion: 2.75 time: 0.139863 Oct 27 09:06:26.715598 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 810/1645] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:26 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1937 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:26.907402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be79f7c4-b8e1-4fc8-9c39-3f2b737dc9b3 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Action: 'update', calling method: .version_select at 0x7f31a9fd3700>, body: {"quota_set": {"ram": "5120"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:27.011636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be79f7c4-b8e1-4fc8-9c39-3f2b737dc9b3 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.013120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be79f7c4-b8e1-4fc8-9c39-3f2b737dc9b3 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.015719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be79f7c4-b8e1-4fc8-9c39-3f2b737dc9b3 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.018942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be79f7c4-b8e1-4fc8-9c39-3f2b737dc9b3 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.019689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be79f7c4-b8e1-4fc8-9c39-3f2b737dc9b3 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.021307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be79f7c4-b8e1-4fc8-9c39-3f2b737dc9b3 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.085355 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de57cb8e-03f5-43fd-bd49-1438e4285e9c tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e/action" status: 202 len: 0 microversion: 2.1 time: 3.577510 Oct 27 09:06:27.086627 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 836/1646] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:06:23 2022] POST /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e/action => generated 0 bytes in 3580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:06:27.092758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0bcdd1d-ef77-48b1-a07b-186ed2136ab0 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0f9550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:27.188987 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0bcdd1d-ef77-48b1-a07b-186ed2136ab0 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.101102 Oct 27 09:06:27.191715 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 837/1647] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:27 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:27.202111 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be79f7c4-b8e1-4fc8-9c39-3f2b737dc9b3 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/9316732f37b545368b575f7aa9e1328d" status: 200 len: 148 microversion: 2.57 time: 0.503627 Oct 27 09:06:27.208596 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 811/1648] 10.222.0.25 () {62 vars in 1303 bytes} [Thu Oct 27 09:06:26 2022] PUT /compute/v2.1/os-quota-sets/9316732f37b545368b575f7aa9e1328d => generated 148 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:27.209265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2d3f4518-6297-4a7c-b74a-c6a13952a85e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:27.212095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2d3f4518-6297-4a7c-b74a-c6a13952a85e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:27.215379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:27.216578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:27.223762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.224263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.224700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.224824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d3f4518-6297-4a7c-b74a-c6a13952a85e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.225420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.225589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d3f4518-6297-4a7c-b74a-c6a13952a85e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.225876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.226531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.227171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d3f4518-6297-4a7c-b74a-c6a13952a85e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.232165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d3f4518-6297-4a7c-b74a-c6a13952a85e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.232718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d3f4518-6297-4a7c-b74a-c6a13952a85e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.233163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d3f4518-6297-4a7c-b74a-c6a13952a85e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.325267 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2d3f4518-6297-4a7c-b74a-c6a13952a85e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131334 Oct 27 09:06:27.336971 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 838/1649] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:06:27 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:27.342227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73821383-0f37-449d-9640-d1dcc40a0337 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Calling method '.version_select at 0x7f31aafd1160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:27.436183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:27.441502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73821383-0f37-449d-9640-d1dcc40a0337 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.442017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73821383-0f37-449d-9640-d1dcc40a0337 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.442611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73821383-0f37-449d-9640-d1dcc40a0337 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.443601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73821383-0f37-449d-9640-d1dcc40a0337 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.444330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73821383-0f37-449d-9640-d1dcc40a0337 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.445480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73821383-0f37-449d-9640-d1dcc40a0337 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.446680 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b35947d-b1aa-4a24-b6ed-ca1f9bcd19be tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.242318 Oct 27 09:06:27.448567 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 812/1650] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:27 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:27.485636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-73821383-0f37-449d-9640-d1dcc40a0337 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/9316732f37b545368b575f7aa9e1328d/detail" status: 200 len: 463 microversion: 2.57 time: 0.146444 Oct 27 09:06:27.487112 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 839/1651] 10.222.0.25 () {60 vars in 1304 bytes} [Thu Oct 27 09:06:27 2022] GET /compute/v2.1/os-quota-sets/9316732f37b545368b575f7aa9e1328d/detail => generated 463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:27.532730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:27.533752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:27.543979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.547697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.549095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.551637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.553554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.559720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.732098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:27.733180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:27.756936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.758345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.761459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.765194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:27.766426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:27.768600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:27.937587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:27.981691 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-68761f20-6b78-4b88-9232-5d72ea2b4d53 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1937 microversion: 2.75 time: 0.254894 Oct 27 09:06:27.983882 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 840/1652] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:27 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1937 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:27.998289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Action: 'update', calling method: .version_select at 0x7f31aa0f9790>, body: {"quota_set": {"ram": "2048"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:28.024645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:28.038726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:28.041928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:28.047017 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa6b2baa-f039-4062-82dc-7a7987c84e1b tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2952 microversion: 2.32 time: 0.519155 Oct 27 09:06:28.070492 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 813/1653] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:27 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2952 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:28.082123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e90ab256-d2b4-4bf3-8765-5bb9b26ca0cd tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:28.085926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e90ab256-d2b4-4bf3-8765-5bb9b26ca0cd tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:28.097572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e90ab256-d2b4-4bf3-8765-5bb9b26ca0cd tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.098061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e90ab256-d2b4-4bf3-8765-5bb9b26ca0cd tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.098513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e90ab256-d2b4-4bf3-8765-5bb9b26ca0cd tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.099241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e90ab256-d2b4-4bf3-8765-5bb9b26ca0cd tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.099763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e90ab256-d2b4-4bf3-8765-5bb9b26ca0cd tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.100201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e90ab256-d2b4-4bf3-8765-5bb9b26ca0cd tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.205467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.212106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.212106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.212106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.212106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.212529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.302719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.303600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.304271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.305531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.306276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.307470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.366161 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e90ab256-d2b4-4bf3-8765-5bb9b26ca0cd tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.288052 Oct 27 09:06:28.367523 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 814/1654] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Oct 27 09:06:28 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6/os-interface => generated 1833 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:28.372665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-841e4a2a-9c83-45cb-9c41-fd9ee019f55b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae6409d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:28.457544 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c4195e1-90ef-4f07-aba4-93159b330048 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/9316732f37b545368b575f7aa9e1328d?user_id=5b52be9eba29424c818aeeee7c3b7994" status: 200 len: 148 microversion: 2.57 time: 0.470965 Oct 27 09:06:28.459713 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 841/1655] 10.222.0.25 () {62 vars in 1384 bytes} [Thu Oct 27 09:06:27 2022] PUT /compute/v2.1/os-quota-sets/9316732f37b545368b575f7aa9e1328d?user_id=5b52be9eba29424c818aeeee7c3b7994 => generated 148 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:28.459842 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-841e4a2a-9c83-45cb-9c41-fd9ee019f55b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.086642 Oct 27 09:06:28.460622 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 815/1656] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:28 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:28.471523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f6d42d0a-da11-4045-bc9b-6d5cf6fb616e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:28.471993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b37cd826-238f-48d9-9801-b141c797bd10 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] Calling method '.version_select at 0x7f31aa1ae4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:28.481167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f6d42d0a-da11-4045-bc9b-6d5cf6fb616e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:28.490563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6d42d0a-da11-4045-bc9b-6d5cf6fb616e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.491413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6d42d0a-da11-4045-bc9b-6d5cf6fb616e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.493157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6d42d0a-da11-4045-bc9b-6d5cf6fb616e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.495485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6d42d0a-da11-4045-bc9b-6d5cf6fb616e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.496703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6d42d0a-da11-4045-bc9b-6d5cf6fb616e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.497369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6d42d0a-da11-4045-bc9b-6d5cf6fb616e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.536262 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f6d42d0a-da11-4045-bc9b-6d5cf6fb616e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074653 Oct 27 09:06:28.537729 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 842/1657] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:06:28 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:28.544596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:28.545537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:28.552388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.553460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.554138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.559874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:28.560802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:28.561758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:28.594452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:28.647496 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b37cd826-238f-48d9-9801-b141c797bd10 tempest-QuotasAdminTestV257-581068923 tempest-QuotasAdminTestV257-581068923-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/9316732f37b545368b575f7aa9e1328d?user_id=5b52be9eba29424c818aeeee7c3b7994" status: 200 len: 190 microversion: 2.57 time: 0.180621 Oct 27 09:06:28.648138 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 816/1658] 10.222.0.25 () {60 vars in 1364 bytes} [Thu Oct 27 09:06:28 2022] GET /compute/v2.1/os-quota-sets/9316732f37b545368b575f7aa9e1328d?user_id=5b52be9eba29424c818aeeee7c3b7994 => generated 190 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:28.840745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:28.855820 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25a3a8df-ca3c-4b10-b87d-7e781d9e47ac tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.316698 Oct 27 09:06:28.857662 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 843/1659] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:28 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:29.014473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:29.015170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:29.025189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:29.026380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:29.026734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:29.027446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:29.039224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:29.042616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:29.475821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f4eb3543-c9a6-4706-932b-5d97355bd280 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa18daf0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:29.555088 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f4eb3543-c9a6-4706-932b-5d97355bd280 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.083210 Oct 27 09:06:29.555796 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 844/1660] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:29 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:29.561203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1f0119e7-4858-4aa7-8c74-41741a896025 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:29.563508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1f0119e7-4858-4aa7-8c74-41741a896025 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:29.600959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0119e7-4858-4aa7-8c74-41741a896025 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:29.601453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0119e7-4858-4aa7-8c74-41741a896025 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:29.601888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0119e7-4858-4aa7-8c74-41741a896025 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:29.602612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0119e7-4858-4aa7-8c74-41741a896025 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:29.603069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0119e7-4858-4aa7-8c74-41741a896025 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:29.603607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0119e7-4858-4aa7-8c74-41741a896025 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:29.630948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:29.692012 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1f0119e7-4858-4aa7-8c74-41741a896025 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.135059 Oct 27 09:06:29.693150 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 845/1661] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:06:29 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:29.772639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:29.812298 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92c95781-26dd-4c50-b5fd-505e43eea317 tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1937 microversion: 2.75 time: 0.800637 Oct 27 09:06:29.814707 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 817/1662] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:29 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1937 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:29.888587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:29.889643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:29.907033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:29.909596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:29.910103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:29.910866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:29.911333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:29.917128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:30.573279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1348aa89-4e9e-4993-ad75-3031c2b159a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa13f820>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:30.680158 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1348aa89-4e9e-4993-ad75-3031c2b159a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.111988 Oct 27 09:06:30.680993 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 818/1663] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:30 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:30.865554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:30.866231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:30.876152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:30.876656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:30.877095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:30.877972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:30.878510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:30.878947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:31.030093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:31.052291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5abd37d2-372b-4005-a6a5-585d01d09e05 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 1.159003 Oct 27 09:06:31.053578 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 846/1664] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:29 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:31.123394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] Lazy-loading 'services' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:31.168346 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7727c736-0c9a-42f1-a485-a2cf6e7ab49f tempest-ServersAdmin275Test-475346294 tempest-ServersAdmin275Test-475346294-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1922 microversion: 2.75 time: 0.306754 Oct 27 09:06:31.174509 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 819/1665] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:30 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1922 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:31.225077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:31.228576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:31.243308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:31.243758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:31.249099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:31.249912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:31.250406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:31.252604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:31.340693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:06:31.492041 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82174ba2-060c-4457-9d41-0d65d2135878 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 204 len: 0 microversion: 2.75 time: 0.278399 Oct 27 09:06:31.498372 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 847/1666] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:06:31 2022] DELETE /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:06:31.506649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:31.507461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:31.519558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:31.522640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:31.524258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:31.525745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:31.534157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:31.534753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:31.701526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0320ee04-7d1c-4ff4-8792-2645d9967cf4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa3953a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:31.806392 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0320ee04-7d1c-4ff4-8792-2645d9967cf4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1454 microversion: 2.1 time: 0.110112 Oct 27 09:06:31.808691 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 848/1667] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:31 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:32.115062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:32.116604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:32.121668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:32.139086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:32.151364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:32.173847 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6897b31-454f-4376-809d-f4ef1c9327f6 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1444 microversion: 2.75 time: 0.673574 Oct 27 09:06:32.174450 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 820/1668] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:31 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1444 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:32.208109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:32.209054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:32.217498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:32.220886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:32.225338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:32.226914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:32.679012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:32.690682 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-362a8d65-5b5d-475c-a86b-70642a6471f4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.610316 Oct 27 09:06:32.692081 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 849/1669] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:32 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:32.826987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5dddacc4-d802-4b85-a5e9-1e3761ac9e78 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae640040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:33.218660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:33.224217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:33.239241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:33.240023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:33.240683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:33.243314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:33.244502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:33.245237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:33.368264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:33.384264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:33.392526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:33.409162 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49d908ce-19a5-4f1e-bac6-5dfb37834e86 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1444 microversion: 2.75 time: 0.199199 Oct 27 09:06:33.412236 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 850/1670] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:33 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1444 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:33.726449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:33.733901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:33.766908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:33.770561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:33.771136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:33.772035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:33.772637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:33.785017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:34.467902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:34.487175 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8165dcbf-4eab-4e46-90b1-1f15520261a7 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.761636 Oct 27 09:06:34.495009 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 851/1671] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:33 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:34.521730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:34.522234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:34.561166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:34.566342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:34.570319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:34.578069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:34.579399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:34.580082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:34.702251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:34.704906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:34.705392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:34.706649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lazy-loading 'fault' on Instance uuid f68610df-aba8-4a74-aab8-83fb732ac516 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:34.860962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:34.875139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:34.878167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f32e1b7f7e24ca99ba9b97a45d5c8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e582d9186724857aa62fa4058c89f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:34.892643 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-872222b5-d870-4902-91b2-08cbc41366ff tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 200 len: 1449 microversion: 2.75 time: 0.396096 Oct 27 09:06:34.911243 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 852/1672] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:34 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 1449 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:35.483785 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5dddacc4-d802-4b85-a5e9-1e3761ac9e78 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1463 microversion: 2.1 time: 2.661344 Oct 27 09:06:35.485172 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 821/1673] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:32 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1463 bytes in 2664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:35.502209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-78141b41-68b8-4167-852d-4882c6fa190b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa3dfe50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:35.524019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:35.525657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:35.548063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:35.548508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:35.548953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:35.557547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:35.558264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:35.559544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:35.562540 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-78141b41-68b8-4167-852d-4882c6fa190b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 200 len: 1463 microversion: 2.1 time: 0.066457 Oct 27 09:06:35.563129 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 853/1674] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:35 2022] GET /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 1463 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:35.578694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:35.582728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:35.598904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:35.599636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:35.600522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:35.602212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:35.604910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:35.605542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:35.974819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:35.998408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:36.003756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:36.012151 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77d38b31-d029-4100-a71b-2598a9807b46 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1481 microversion: 2.1 time: 0.419960 Oct 27 09:06:36.017608 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 854/1675] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:35 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1481 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:36.022244 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b519256-e518-402b-99a8-84d76e9ac586 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.501307 Oct 27 09:06:36.023347 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 822/1676] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:35 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:36.027750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:36.029016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] [instance: f68610df-aba8-4a74-aab8-83fb732ac516] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:36.054187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:36.062085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:36.062932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:36.065107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:36.066382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:36.067618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:36.085502 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] HTTP exception thrown: Instance f68610df-aba8-4a74-aab8-83fb732ac516 could not be found. Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Request method failure captured: Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 HTTP/1.1 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWknDRgvIOkuTtwMm6Cy9cLBI-Fc7-K65RkDcmgURgj24h6zRmycqXzl-E7IKMu0YGuIyu7CjX1kVIV5sakePStWtgchQdJiwHieBxErXA3ytUBpCaDNXzCjPrFfJ3f-Z6V2rOGnVWDye3TjU1RByGD3MnPfSqleMF6_k79hj8H8QrB4 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.75 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0e582d9186724857aa62fa4058c89f64 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdmin275Test-139142420 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e582d9186724857aa62fa4058c89f64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e582d9186724857aa62fa4058c89f64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e582d9186724857aa62fa4058c89f64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e582d9186724857aa62fa4058c89f64"}]}] Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdmin275Test-139142420 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0e582d9186724857aa62fa4058c89f64 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdmin275Test-139142420 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdmin275Test-139142420-project Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 1f32e1b7f7e24ca99ba9b97a45d5c8e3 Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdmin275Test-139142420-project Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f68610df-aba8-4a74-aab8-83fb732ac516 could not be found. Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f68610df-aba8-4a74-aab8-83fb732ac516'} Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68610df-aba8-4a74-aab8-83fb732ac516 could not be found. Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68610df-aba8-4a74-aab8-83fb732ac516 could not be found. Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:06:36.088380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:36.095657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:06:36.095657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:06:36.095657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:06:36.095657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:06:36.095657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:06:36.095657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68610df-aba8-4a74-aab8-83fb732ac516 could not be found. Oct 27 09:06:36.095657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:06:36.096994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] Returning 404 to user: Instance f68610df-aba8-4a74-aab8-83fb732ac516 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:06:36.098050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c4ab91c2-2abc-4bc9-b8c4-30cd6fed2ef9 tempest-ServersAdmin275Test-139142420 tempest-ServersAdmin275Test-139142420-project] 10.222.0.25 "GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516" status: 404 len: 111 microversion: 2.75 time: 0.076726 Oct 27 09:06:36.098809 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 855/1677] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:36 2022] GET /compute/v2.1/servers/f68610df-aba8-4a74-aab8-83fb732ac516 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:06:36.975760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1743693999", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:37.043225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:37.044090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:37.054354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:37.055940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:37.056465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:37.058045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:37.058775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:37.059239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:37.059699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:37.105121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:06:37.892056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:37.905061 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27d20993-eb5c-4ee5-b601-4a22d04bd405 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1468 microversion: 2.1 time: 0.867465 Oct 27 09:06:37.905949 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 856/1678] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:37 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1468 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:37.916833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:37.918141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:37.933822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:37.936474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:37.938590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:37.940886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:37.942557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:37.942963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:38.085713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:06:38.086240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:06:38.086763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:06:38.088142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:06:38.088824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:06:38.111861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:38.112647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:38.113269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:38.114503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:38.115617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:38.116604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:38.185139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Getting quotas for project 4d54fc3cc5ef488c9409163954878ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:38.209134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Getting quotas for user 86bf6e736b6a44bfa47de6549573ddd4 and project 4d54fc3cc5ef488c9409163954878ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:38.233660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:06:38.239205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:06:38.328583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=7 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:38.354437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9230cfc4-1203-4936-ab68-945faebcbc0e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906455 Oct 27 09:06:38.355823 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 823/1679] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:06:38.361500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-20193e75-ed76-4488-a786-a79d9aad459a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1812245924"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:38.364209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-20193e75-ed76-4488-a786-a79d9aad459a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:38.402655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20193e75-ed76-4488-a786-a79d9aad459a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:38.404136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20193e75-ed76-4488-a786-a79d9aad459a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:38.405742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20193e75-ed76-4488-a786-a79d9aad459a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:38.407058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20193e75-ed76-4488-a786-a79d9aad459a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:38.407966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20193e75-ed76-4488-a786-a79d9aad459a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:38.408724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20193e75-ed76-4488-a786-a79d9aad459a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:38.448050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=28,nova_cell0:UPDATE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:38.703797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:38.712939 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-deafe181-eb27-4458-a98b-824f81030e54 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.804638 Oct 27 09:06:38.717127 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 857/1680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:37 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:38.722606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-178521119", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:38.770618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:38.943885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:06:39.026997 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-20193e75-ed76-4488-a786-a79d9aad459a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "POST /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3/action" status: 202 len: 0 microversion: 2.1 time: 0.668996 Oct 27 09:06:39.027856 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 824/1681] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:06:38 2022] POST /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:06:39.077117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b697539-40ca-4704-a265-d851dae54ef0 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0ff8b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:39.206173 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b697539-40ca-4704-a265-d851dae54ef0 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.141218 Oct 27 09:06:39.206846 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 825/1682] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:39 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:39.743306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:39.745140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:39.762849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:39.764643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:39.767027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:39.770336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:39.771396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:39.773839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:39.845311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:06:39.846812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:06:39.847444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:06:39.848005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:06:39.849229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:06:39.879279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:39.881235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:39.882954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:39.885769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:39.886554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:39.888675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:39.966832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Getting quotas for project 4d54fc3cc5ef488c9409163954878ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:40.006811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Getting quotas for user 86bf6e736b6a44bfa47de6549573ddd4 and project 4d54fc3cc5ef488c9409163954878ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:40.041458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:06:40.046865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:06:40.174013 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16eff1c6-f510-4553-b63c-5610118da5a8 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454808 Oct 27 09:06:40.174681 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 858/1683] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:06:40.194059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-238812c4-4bd1-4ff8-a6c6-a5c153df0086 req-e4de0758-47c8-4bec-bfd7-513eb144ab5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f46edbb-82a0-4749-a443-02e5ca52e341", "name": "network-vif-unplugged", "status": "completed", "tag": "4f73cce5-2a06-488c-8855-f44a51f4779a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:40.206632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-238812c4-4bd1-4ff8-a6c6-a5c153df0086 req-e4de0758-47c8-4bec-bfd7-513eb144ab5f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:40.208643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-238812c4-4bd1-4ff8-a6c6-a5c153df0086 req-e4de0758-47c8-4bec-bfd7-513eb144ab5f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:40.211860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-238812c4-4bd1-4ff8-a6c6-a5c153df0086 req-e4de0758-47c8-4bec-bfd7-513eb144ab5f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:40.246433 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-238812c4-4bd1-4ff8-a6c6-a5c153df0086 req-e4de0758-47c8-4bec-bfd7-513eb144ab5f service nova] Creating event network-vif-unplugged:4f73cce5-2a06-488c-8855-f44a51f4779a for instance 1f46edbb-82a0-4749-a443-02e5ca52e341 on n-h1-858383-16 Oct 27 09:06:40.267093 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-238812c4-4bd1-4ff8-a6c6-a5c153df0086 req-e4de0758-47c8-4bec-bfd7-513eb144ab5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080889 Oct 27 09:06:40.276932 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 859/1684] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:40.292137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f66cbbb-ff8d-4d33-863e-179bdfaf99c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:40.308886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6f66cbbb-ff8d-4d33-863e-179bdfaf99c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:40.416473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:40.418443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6f66cbbb-ff8d-4d33-863e-179bdfaf99c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:40.426662 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f66cbbb-ff8d-4d33-863e-179bdfaf99c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1213 microversion: 2.1 time: 0.147190 Oct 27 09:06:40.428451 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 860/1685] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:40 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1213 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:40.430132 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-69d2c28f-92c7-423f-9a95-4462f2dd1bec tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.691646 Oct 27 09:06:40.450283 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 826/1686] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:39 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:40.452375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b95304ae-07ce-4ae3-928b-f4a1ea1d0464 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ab016280>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:40.558204 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b95304ae-07ce-4ae3-928b-f4a1ea1d0464 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.125466 Oct 27 09:06:40.560634 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 861/1687] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:40 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:41.453660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:41.455022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:41.458115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:41.459379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:41.466511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:41.467242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:41.468524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:41.470340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:41.474905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:41.475633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:41.482146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:41.482813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:41.484964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:41.492024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:41.500656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:41.502221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:41.600328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:41.610807 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c85aef5e-ff5f-471c-8c60-ec688b97d2eb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1265 microversion: 2.1 time: 0.161123 Oct 27 09:06:41.633167 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 827/1688] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:41 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:41.646811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f3ae785-70f6-4be9-bc0f-743b0c4a7d25 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa052f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:41.708230 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f3ae785-70f6-4be9-bc0f-743b0c4a7d25 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.073165 Oct 27 09:06:41.709204 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 828/1689] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:41 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:41.918691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:41.932699 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a979b30-ee48-4f75-ad93-9934477eedc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.472879 Oct 27 09:06:41.943916 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 862/1690] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:41 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:42.049841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1210001139", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": "none"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:42.122632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:06:42.123296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:06:42.124017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:06:42.124656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:06:42.125251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:06:42.143771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:42.144268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:42.144712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:42.145449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:42.145909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:42.146337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:42.206534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Getting quotas for project 6fd690af97f14fef9572fd231d12ddc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:42.218824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Getting quotas for user 984d5cab5251412692c743df3b464407 and project 6fd690af97f14fef9572fd231d12ddc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:42.260269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:06:42.263188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:06:42.376158 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21c60e28-03a3-4625-96ca-d8e7e9a1b25e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.545827 Oct 27 09:06:42.376836 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 829/1691] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:06:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:06:42.389375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4282bfad-8e86-45e7-9c0b-60dd9748e453 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:42.390786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4282bfad-8e86-45e7-9c0b-60dd9748e453 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:42.585048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4282bfad-8e86-45e7-9c0b-60dd9748e453 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:42.597164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4282bfad-8e86-45e7-9c0b-60dd9748e453 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:42.598607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4282bfad-8e86-45e7-9c0b-60dd9748e453 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:42.611673 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4282bfad-8e86-45e7-9c0b-60dd9748e453 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1454 microversion: 2.91 time: 0.227153 Oct 27 09:06:42.612319 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 863/1692] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:42 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1454 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:42.646482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:42.660843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:42.680531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:42.680851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:42.682359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:42.683253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:42.687841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:42.688553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:42.725996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-926f6b31-e04d-43e0-b4f1-009f6a296629 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa395700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:42.786456 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-926f6b31-e04d-43e0-b4f1-009f6a296629 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.065907 Oct 27 09:06:42.787216 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 864/1693] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:42 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:42.855724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:42.871796 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1e3f7b23-d81c-4ff9-9e0e-5856d7a991c0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1283 microversion: 2.1 time: 0.229217 Oct 27 09:06:42.873676 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 830/1694] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:42 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1283 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:42.959075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:42.960068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:42.972215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:42.974154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:42.975890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:42.977335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:42.979769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:42.980490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:43.312112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:43.323288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-150c18dd-5890-43e2-84e8-c7515626fb76 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.366864 Oct 27 09:06:43.324285 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 865/1695] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:42 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:43.642104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:43.644340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:43.659179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:43.660231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:43.668832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:43.670472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:43.671912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:43.673092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:43.802639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b296b33e-f88d-4432-8920-c780d8823ce4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa18d310>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:43.824729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:43.837586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:43.841837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:43.848727 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-de50a29c-0e15-43f2-92bc-33505d524454 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1506 microversion: 2.91 time: 0.210953 Oct 27 09:06:43.851149 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 831/1696] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:43 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:43.876681 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b296b33e-f88d-4432-8920-c780d8823ce4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.078052 Oct 27 09:06:43.877457 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 866/1697] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:43 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:43.899311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:43.900357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:43.916234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:43.919866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:43.921636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:43.926315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:43.926831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:43.927542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:44.257541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:44.276504 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f80bce39-3a85-466f-bd01-83ca622a5a91 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.375995 Oct 27 09:06:44.287808 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 832/1698] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:43 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:44.348281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:44.349169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:44.372500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:44.373460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:44.374335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:44.376351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:44.380116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:44.381193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:44.882306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:44.882946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:44.900562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:44.901300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:44.902324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:44.906853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:44.909192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:44.909852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:45.152434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:45.164345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:45.166815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:45.172614 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-662d761d-eaba-4878-b276-a396cac3c9e4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1512 microversion: 2.91 time: 0.295947 Oct 27 09:06:45.190164 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 833/1699] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:44 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1512 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:45.195308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5762ff27-2802-4c88-be53-8dd1985a464e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa1ae4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:45.267269 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5762ff27-2802-4c88-be53-8dd1985a464e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.075590 Oct 27 09:06:45.272936 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 834/1700] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:45 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:45.287453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5e88be3c-c4fe-4db7-9755-e873b746f5d5 req-d888a6d7-e45f-446d-8a28-84e126c17b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4349576-ae59-481f-92ec-599ddae530d7", "tag": "e74cd9c8-3c59-4b33-a7c7-5358d3b644c0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:45.299126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5e88be3c-c4fe-4db7-9755-e873b746f5d5 req-d888a6d7-e45f-446d-8a28-84e126c17b6c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:45.301152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5e88be3c-c4fe-4db7-9755-e873b746f5d5 req-d888a6d7-e45f-446d-8a28-84e126c17b6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:45.301773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5e88be3c-c4fe-4db7-9755-e873b746f5d5 req-d888a6d7-e45f-446d-8a28-84e126c17b6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:45.314039 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5e88be3c-c4fe-4db7-9755-e873b746f5d5 req-d888a6d7-e45f-446d-8a28-84e126c17b6c service nova] Creating event network-changed:e74cd9c8-3c59-4b33-a7c7-5358d3b644c0 for instance d4349576-ae59-481f-92ec-599ddae530d7 on n-h2-858383-16 Oct 27 09:06:45.319784 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5e88be3c-c4fe-4db7-9755-e873b746f5d5 req-d888a6d7-e45f-446d-8a28-84e126c17b6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045348 Oct 27 09:06:45.320996 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 835/1701] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:45.326381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:45.327422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:45.336034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:45.336827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:45.338167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:45.339149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:45.339882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:45.340542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:45.464985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:45.476544 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6fcef1aa-b9da-4284-891a-3fb13a00c0b8 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 1.132915 Oct 27 09:06:45.496126 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 867/1702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:44 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:45.766750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:45.777361 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d99ed3b7-fb08-402d-9bd0-62ea66b40932 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.454916 Oct 27 09:06:45.780925 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 836/1703] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:45 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:46.221140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:46.221861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:46.234705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:46.235236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:46.235704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:46.236423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:46.236880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:46.237314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:46.289542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99324cc0-ae01-4f51-bb17-83ffee5cae5b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5f6670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:46.343238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:46.354212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:46.357290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:46.363050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a2a5f74e-54f2-4aac-9d04-1a0f64ce3229 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1512 microversion: 2.91 time: 0.145954 Oct 27 09:06:46.364228 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 868/1704] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:46 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:46.366136 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99324cc0-ae01-4f51-bb17-83ffee5cae5b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.081666 Oct 27 09:06:46.366710 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 837/1705] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:46 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:46.384929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-596f1632-a041-4c56-91a7-951011b13652 req-2e8921e5-0d5e-46e9-b9ca-0cc15d2a5048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b7f7ba-bef4-4bb8-857a-a10e5c63ff47", "tag": "4eb61217-6569-44d5-8e30-41051be48cad"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:46.396536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-596f1632-a041-4c56-91a7-951011b13652 req-2e8921e5-0d5e-46e9-b9ca-0cc15d2a5048 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:46.397131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-596f1632-a041-4c56-91a7-951011b13652 req-2e8921e5-0d5e-46e9-b9ca-0cc15d2a5048 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:46.397640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-596f1632-a041-4c56-91a7-951011b13652 req-2e8921e5-0d5e-46e9-b9ca-0cc15d2a5048 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:46.403092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:46.423562 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-596f1632-a041-4c56-91a7-951011b13652 req-2e8921e5-0d5e-46e9-b9ca-0cc15d2a5048 service nova] Creating event network-changed:4eb61217-6569-44d5-8e30-41051be48cad for instance 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 on n-h1-858383-16 Oct 27 09:06:46.435580 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-596f1632-a041-4c56-91a7-951011b13652 req-2e8921e5-0d5e-46e9-b9ca-0cc15d2a5048 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059545 Oct 27 09:06:46.437149 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 869/1706] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:46.502576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:46.503189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:46.511345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:46.511866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:46.512531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:46.513413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:46.514034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:46.514685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:46.735941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:46.749322 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9702fc93-8bef-4c39-a710-b33d37a4fe1a tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.250023 Oct 27 09:06:46.763592 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 838/1707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:46 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:46.808130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:46.808845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:46.816210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:46.816676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:46.817117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:46.817855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:46.830356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:46.830826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:46.979405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-043b89d0-2bb4-48c8-8dcd-ec0117906779 req-c53b9948-1313-4854-a1e1-b5f7cb2e255a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d645fadc-59fa-44d8-aee6-1b98f0013de3", "name": "network-vif-plugged", "status": "completed", "tag": "bfbf5e11-af5f-410d-a0c1-a17a8f0be57c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:46.995270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-043b89d0-2bb4-48c8-8dcd-ec0117906779 req-c53b9948-1313-4854-a1e1-b5f7cb2e255a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:46.995773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-043b89d0-2bb4-48c8-8dcd-ec0117906779 req-c53b9948-1313-4854-a1e1-b5f7cb2e255a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:46.997040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-043b89d0-2bb4-48c8-8dcd-ec0117906779 req-c53b9948-1313-4854-a1e1-b5f7cb2e255a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:47.014709 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-043b89d0-2bb4-48c8-8dcd-ec0117906779 req-c53b9948-1313-4854-a1e1-b5f7cb2e255a service nova] Creating event network-vif-plugged:bfbf5e11-af5f-410d-a0c1-a17a8f0be57c for instance d645fadc-59fa-44d8-aee6-1b98f0013de3 on n-h2-858383-16 Oct 27 09:06:47.027271 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-043b89d0-2bb4-48c8-8dcd-ec0117906779 req-c53b9948-1313-4854-a1e1-b5f7cb2e255a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054604 Oct 27 09:06:47.028552 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 839/1708] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:47.138510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:47.147358 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c2f0ba74-7789-4880-b24e-e108382b5241 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.344682 Oct 27 09:06:47.148648 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 870/1709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:46 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:47.382305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed43b2ee-8a33-457d-986a-3678b7b3f87a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0b1af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:47.393823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3461e97-1220-4899-ab0e-c4eb878a1eaa tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Action: 'create', calling method: .version_select at 0x7f31aa1f5940>, body: {"keypair": {"name": "tempest-keypair-1218908060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+hNIeq48bbecrZt08PxsGqdYWQ+brgmrmSPFM89zz+I4PI7jVqoVU96btsz5gW6nJqqDxWac6YgsczYmeLk43cFQkP54eRQG+VxH4bQvp+o/LOHhr3DoGxpzuOfdVoNg=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:47.415900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d3461e97-1220-4899-ab0e-c4eb878a1eaa tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:47.422942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d3461e97-1220-4899-ab0e-c4eb878a1eaa tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for user 7ecd9ecf3b9a48f8b22b78cb60b7098f and project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:47.436820 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed43b2ee-8a33-457d-986a-3678b7b3f87a tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.058257 Oct 27 09:06:47.437959 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 871/1710] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:47 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:47.443741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:47.445068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:47.452807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:47.453602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:47.454074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:47.454744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:47.455200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:47.456009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:47.462450 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3461e97-1220-4899-ab0e-c4eb878a1eaa tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.205734 Oct 27 09:06:47.463632 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 840/1711] 10.222.0.25 () {62 vars in 1199 bytes} [Thu Oct 27 09:06:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 09:06:47.475176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b7148f5-b83e-4f08-81d8-6ead4e2c4155 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31ae640af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:47.484534 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b7148f5-b83e-4f08-81d8-6ead4e2c4155 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1218908060" status: 200 len: 513 microversion: 2.2 time: 0.013597 Oct 27 09:06:47.485312 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 841/1712] 10.222.0.25 () {60 vars in 1258 bytes} [Thu Oct 27 09:06:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1218908060 => generated 513 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:06:47.497744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-269636fb-1613-4933-893f-e5e875de64ba tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31aa0ffaf0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:47.519703 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-269636fb-1613-4933-893f-e5e875de64ba tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218908060" status: 204 len: 0 microversion: 2.2 time: 0.026353 Oct 27 09:06:47.520566 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 842/1713] 10.222.0.25 () {60 vars in 1261 bytes} [Thu Oct 27 09:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218908060 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:06:47.533471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5418f0be-9fe8-4164-8795-26c930a9b4c3 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Action: 'create', calling method: .version_select at 0x7f31ae5eed30>, body: {"keypair": {"name": "tempest-keypair-2051791535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW2WRxaBW1zIgS/ax74FKzBCbKoIsrGllmMda637muJc94QUKXI88IMIJeQvOgY5k+XVVkQFAosDt4jvkmaHV6NpaT+Vk5LAHO4iqNb4gK3xn7aXGgkhHxlFSCTsRKi2A=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:47.535076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:47.548195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:47.549661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:47.552052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5418f0be-9fe8-4164-8795-26c930a9b4c3 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:47.555337 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d255a52a-8b6e-4a8b-a350-111bea584b04 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1512 microversion: 2.91 time: 0.115995 Oct 27 09:06:47.556609 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 872/1714] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:47 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1512 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:47.558696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:47.560123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5418f0be-9fe8-4164-8795-26c930a9b4c3 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for user 7ecd9ecf3b9a48f8b22b78cb60b7098f and project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:47.589733 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5418f0be-9fe8-4164-8795-26c930a9b4c3 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.061266 Oct 27 09:06:47.590346 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 843/1715] 10.222.0.25 () {62 vars in 1199 bytes} [Thu Oct 27 09:06:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 27 09:06:47.601447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-220e02d8-5552-40eb-93cd-2f41480d123a tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31aa0b0c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:47.624765 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-220e02d8-5552-40eb-93cd-2f41480d123a tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051791535" status: 204 len: 0 microversion: 2.2 time: 0.027177 Oct 27 09:06:47.626200 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 873/1716] 10.222.0.25 () {60 vars in 1261 bytes} [Thu Oct 27 09:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051791535 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:47.637600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b03114f2-e8c9-43da-a729-0600f5676371 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Action: 'create', calling method: .version_select at 0x7f31ae5fc670>, body: {"keypair": {"name": "tempest-keypair-809818108", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:47.655325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b03114f2-e8c9-43da-a729-0600f5676371 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:47.660702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b03114f2-e8c9-43da-a729-0600f5676371 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for user 7ecd9ecf3b9a48f8b22b78cb60b7098f and project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:47.688552 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b03114f2-e8c9-43da-a729-0600f5676371 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.056387 Oct 27 09:06:47.689385 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 844/1717] 10.222.0.25 () {62 vars in 1199 bytes} [Thu Oct 27 09:06:47 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 27 09:06:47.702594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2cce2422-ce51-4312-90d0-a4ee2ac4bd13 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31aa0b1e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:47.725508 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2cce2422-ce51-4312-90d0-a4ee2ac4bd13 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-809818108" status: 204 len: 0 microversion: 2.2 time: 0.027047 Oct 27 09:06:47.726151 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 874/1718] 10.222.0.25 () {60 vars in 1258 bytes} [Thu Oct 27 09:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-809818108 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:47.742338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1d07a680-2903-45d1-aac6-cbc871afec13 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Action: 'create', calling method: .version_select at 0x7f31aa027dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-826518841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+n0nHsf5loLoQDhAgppmajzE4/i9iKszswP0HhG3R0btpuYctF+SODjYbtLz2Px65esd7WMjCQUlRR4WLAJ6bO9u+KrDnhna2hQCqMJu4NIGFp/rZ1roBxssXqkAZSnw=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:47.758183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1d07a680-2903-45d1-aac6-cbc871afec13 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:47.764843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1d07a680-2903-45d1-aac6-cbc871afec13 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for user 7ecd9ecf3b9a48f8b22b78cb60b7098f and project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:47.775327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:47.775953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:47.784734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:47.785098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:47.785710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:47.786599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:47.787060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:47.787871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:47.796864 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1d07a680-2903-45d1-aac6-cbc871afec13 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.059523 Oct 27 09:06:47.796864 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 845/1719] 10.222.0.25 () {62 vars in 1199 bytes} [Thu Oct 27 09:06:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 27 09:06:47.814697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b7fc85c-34db-4540-8e9d-c7dd899e9e99 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Action: 'create', calling method: .version_select at 0x7f31aa0ffa60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-398663224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJ+4fdqrrBZCykE6aOGbCKRlQqJ/qZwlPmNKG9xS1XIGK/GosrXGzxv81VA8N1H90Kpp1Nk+dbEIhSvcbvHDFGJ+elB5Jtshir6xposn+o/l/wihRY4f3Lp06Ywez2X9g=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:47.840679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0b7fc85c-34db-4540-8e9d-c7dd899e9e99 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:47.846174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0b7fc85c-34db-4540-8e9d-c7dd899e9e99 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for user 7ecd9ecf3b9a48f8b22b78cb60b7098f and project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:47.880144 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b7fc85c-34db-4540-8e9d-c7dd899e9e99 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.071701 Oct 27 09:06:47.890589 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 846/1720] 10.222.0.25 () {62 vars in 1199 bytes} [Thu Oct 27 09:06:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 27 09:06:47.896821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8bc8b3ba-c11d-4055-9dd7-6a8651ed03f4 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Action: 'create', calling method: .version_select at 0x7f31ae5ee670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1233963568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtNj4C7Oxc1Ddmpi3GQpKM522PaLKLZTIuPuYTHRO5FKmGQrNgJFnh6RjhOwZWiGJFKJh2+iv0fvDVgLozCXUptBdm+H1zOyrKIeoBkQ+tbgVPmgblXm6hg2bY728vrVw=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:47.919509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8bc8b3ba-c11d-4055-9dd7-6a8651ed03f4 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:47.926524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8bc8b3ba-c11d-4055-9dd7-6a8651ed03f4 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for user 7ecd9ecf3b9a48f8b22b78cb60b7098f and project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:47.959081 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8bc8b3ba-c11d-4055-9dd7-6a8651ed03f4 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.065772 Oct 27 09:06:47.965907 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 847/1721] 10.222.0.25 () {62 vars in 1199 bytes} [Thu Oct 27 09:06:47 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 27 09:06:47.975845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-171584e2-6d5c-40ea-8dd7-16a3aa765efd tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31ae5fc4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:47.980363 n-d-858383-16 devstack@n-api.service[120603]: WARNING oslo_db.sqlalchemy.utils [None req-171584e2-6d5c-40ea-8dd7-16a3aa765efd tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 09:06:47.986223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:47.989193 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-171584e2-6d5c-40ea-8dd7-16a3aa765efd tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.021109 Oct 27 09:06:47.990313 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 848/1722] 10.222.0.25 () {60 vars in 1177 bytes} [Thu Oct 27 09:06:47 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:47.996784 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62913d43-9bd4-4447-a755-f83efe9ac186 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.227187 Oct 27 09:06:47.997573 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 875/1723] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:47 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:48.012159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f94212f8-00ef-4766-a7f3-ce359cd9139b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31aa0279d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.034856 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f94212f8-00ef-4766-a7f3-ce359cd9139b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1233963568" status: 204 len: 0 microversion: 2.2 time: 0.033030 Oct 27 09:06:48.035453 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 849/1724] 10.222.0.25 () {60 vars in 1321 bytes} [Thu Oct 27 09:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1233963568 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:48.043974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27a24a0f-3592-4716-8ece-38a2eb8bc2cc tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31aa3955e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.062446 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27a24a0f-3592-4716-8ece-38a2eb8bc2cc tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-398663224" status: 204 len: 0 microversion: 2.2 time: 0.022466 Oct 27 09:06:48.063023 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 876/1725] 10.222.0.25 () {60 vars in 1318 bytes} [Thu Oct 27 09:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-398663224 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:06:48.071997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33379100-ed65-4e46-8349-7e5309cab10c tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31aa0ffe50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.092167 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33379100-ed65-4e46-8349-7e5309cab10c tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-826518841" status: 204 len: 0 microversion: 2.2 time: 0.024593 Oct 27 09:06:48.092903 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 850/1726] 10.222.0.25 () {60 vars in 1318 bytes} [Thu Oct 27 09:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-826518841 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:48.104907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dadff953-fbc0-4d1c-b904-2e8ac95a0159 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Action: 'create', calling method: .version_select at 0x7f31aa0b1d30>, body: {"keypair": {"name": "tempest-keypair-2030197428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwtgp23TWjtKoanyB1aPpsjDouN4U7mbExVu1MsQmwji5t4As/qlua/0Mw5y1fkn+GFITEje38wl+WOQdv5JMLhft/rE54CXrNUND9BCqPZghO6yRFY4ZPPAEzrdiIxfQ=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:48.120848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-dadff953-fbc0-4d1c-b904-2e8ac95a0159 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:48.127174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-dadff953-fbc0-4d1c-b904-2e8ac95a0159 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for user 7ecd9ecf3b9a48f8b22b78cb60b7098f and project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:48.153934 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dadff953-fbc0-4d1c-b904-2e8ac95a0159 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.052921 Oct 27 09:06:48.155655 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 877/1727] 10.222.0.25 () {62 vars in 1199 bytes} [Thu Oct 27 09:06:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 27 09:06:48.166013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-450cdca1-7f83-4a96-bc08-215bf6c5d98e tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31aa027d30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.171183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.171891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:48.174618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-450cdca1-7f83-4a96-bc08-215bf6c5d98e tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-2030197428" status: 200 len: 513 microversion: 2.2 time: 0.012598 Oct 27 09:06:48.175183 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 851/1728] 10.222.0.25 () {60 vars in 1258 bytes} [Thu Oct 27 09:06:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2030197428 => generated 513 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:48.179087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:48.179654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:48.180054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:48.180808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:48.181273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:48.181704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:48.187059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7db0f7d-6690-4d25-88a6-35482b834993 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31aa1f5670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.190898 n-d-858383-16 devstack@n-api.service[120603]: WARNING oslo_db.sqlalchemy.utils [None req-d7db0f7d-6690-4d25-88a6-35482b834993 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 09:06:48.195981 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7db0f7d-6690-4d25-88a6-35482b834993 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.012715 Oct 27 09:06:48.202840 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 852/1729] 10.222.0.25 () {60 vars in 1177 bytes} [Thu Oct 27 09:06:48 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:48.209124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1de34dee-8ef8-417f-b468-bff1dacdafe6 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31ae6151f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.233468 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1de34dee-8ef8-417f-b468-bff1dacdafe6 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030197428" status: 204 len: 0 microversion: 2.2 time: 0.029419 Oct 27 09:06:48.234170 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 853/1730] 10.222.0.25 () {60 vars in 1261 bytes} [Thu Oct 27 09:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030197428 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:48.245521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Action: 'create', calling method: .version_select at 0x7f31ae615af0>, body: {"keypair": {"name": "tempest-keypair-399594609", "type": "x509"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:48.265742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:48.271360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for user 7ecd9ecf3b9a48f8b22b78cb60b7098f and project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:48.290240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.processutils [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp17stwnh7/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp17stwnh7/temp.key -subj /CN=7ecd9ecf3b9a48f8b22b78cb60b7098f -extensions v3_req_client {{(pid=120603) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 27 09:06:48.342884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:48.351887 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e01db099-29cc-4a01-8456-2fdc320bc136 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.184462 Oct 27 09:06:48.352493 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 878/1731] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:48 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:48.453014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c44ecbc-f6e2-490c-b6aa-639df8273464 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa6d7ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.503298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.processutils [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp17stwnh7/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp17stwnh7/temp.key -subj /CN=7ecd9ecf3b9a48f8b22b78cb60b7098f -extensions v3_req_client" returned: 0 in 0.213s {{(pid=120603) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 27 09:06:48.505615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.processutils [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp17stwnh7/temp.key -password pass: {{(pid=120603) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 27 09:06:48.517450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c44ecbc-f6e2-490c-b6aa-639df8273464 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.068485 Oct 27 09:06:48.518040 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 879/1732] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:48 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:48.533054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.processutils [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp17stwnh7/temp.key -password pass:" returned: 0 in 0.026s {{(pid=120603) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 27 09:06:48.574551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:06:48.580408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Getting quotas for user 7ecd9ecf3b9a48f8b22b78cb60b7098f and project 5a4827d340374cd3bbfd9691c3c8037f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:06:48.585324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.586174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:48.593338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:48.594127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:48.594569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:48.595528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:48.596022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:48.596446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:48.600968 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ed7dd9df-ce48-432a-a923-c1b1f457d31b tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.360286 Oct 27 09:06:48.602266 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 854/1733] 10.222.0.25 () {62 vars in 1198 bytes} [Thu Oct 27 09:06:48 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 363 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:06:48.614559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-676ffb73-0772-4818-829d-ac982a4ebd74 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31ae6403a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.628352 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-676ffb73-0772-4818-829d-ac982a4ebd74 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-399594609" status: 200 len: 1533 microversion: 2.2 time: 0.018560 Oct 27 09:06:48.628943 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 855/1734] 10.222.0.25 () {60 vars in 1255 bytes} [Thu Oct 27 09:06:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-399594609 => generated 1533 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:48.640419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a55510a5-4779-4358-86c1-0cf34c608931 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31ae615e50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.644720 n-d-858383-16 devstack@n-api.service[120603]: WARNING oslo_db.sqlalchemy.utils [None req-a55510a5-4779-4358-86c1-0cf34c608931 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 09:06:48.650273 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a55510a5-4779-4358-86c1-0cf34c608931 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.013677 Oct 27 09:06:48.651053 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 856/1735] 10.222.0.25 () {60 vars in 1177 bytes} [Thu Oct 27 09:06:48 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:48.661438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c354c138-d5a6-4e7a-91b6-6be59b407641 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] Calling method '.version_select at 0x7f31aa0271f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:48.671863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:48.675541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:48.682245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:48.684050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:48.690649 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c354c138-d5a6-4e7a-91b6-6be59b407641 tempest-KeyPairsV22TestJSON-34020307 tempest-KeyPairsV22TestJSON-34020307-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-399594609" status: 204 len: 0 microversion: 2.2 time: 0.032501 Oct 27 09:06:48.691745 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 857/1736] 10.222.0.25 () {60 vars in 1258 bytes} [Thu Oct 27 09:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-399594609 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:06:48.692204 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2fbed619-ee4c-4cfd-9bf1-26aab15229c3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1512 microversion: 2.91 time: 0.110586 Oct 27 09:06:48.692795 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 880/1737] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:48 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1512 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:49.026999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:49.029350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:49.040679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:49.041870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:49.042810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:49.043921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:49.044508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:49.045059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:49.283889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:49.294068 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-579c6343-9e10-4c9a-8c71-649618b7773f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.274644 Oct 27 09:06:49.299615 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 858/1738] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:49 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:49.375972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:49.377665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:49.384627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:49.385087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:49.385528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:49.386411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:49.386870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:49.387650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:49.532700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f460426-3d39-4243-8afc-ca08e38b3f7e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5f61f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:49.568514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:49.578747 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c437e954-0841-4e26-ae90-c518766c9e88 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.208549 Oct 27 09:06:49.579899 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 881/1739] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:49 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:49.601571 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f460426-3d39-4243-8afc-ca08e38b3f7e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.072452 Oct 27 09:06:49.602166 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 859/1740] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:49 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:49.719503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:49.720153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:49.727292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:49.728394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:49.728826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:49.730021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:49.730858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:49.731541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:49.835188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:49.851174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:49.853773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:49.863912 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1cd91614-fa70-4edf-b7f9-89762ddfdbdc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1512 microversion: 2.91 time: 0.144764 Oct 27 09:06:49.866478 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 882/1741] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:49 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:50.325142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:50.327165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:50.348505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:50.350887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:50.351629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:50.353777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:50.354809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:50.356631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:50.519986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:50.528453 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10925c09-ce22-4ba3-8bed-8d5f3ca006bd tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.211471 Oct 27 09:06:50.528975 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 860/1742] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:50 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:50.606875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:50.608465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:50.619294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7b1658f-f52e-4b5c-b8df-ebb92361e584 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5fcc10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:50.631167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:50.637806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:50.638418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:50.638977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:50.640260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:50.641006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:50.641714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:50.723320 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7b1658f-f52e-4b5c-b8df-ebb92361e584 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.108924 Oct 27 09:06:50.723320 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 861/1743] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:50 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:50.832758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:50.845390 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea9c3701-ddaa-43e5-b611-8539d22226fe tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.245244 Oct 27 09:06:50.855138 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 883/1744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:50 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:50.894487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:50.895098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:50.903189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:50.904053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:50.904679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:50.905672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:50.906379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:50.907190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:51.020699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:51.030749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:51.032688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:51.038853 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d696dcd-da41-47f6-a686-cef44ef3f69f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1512 microversion: 2.91 time: 0.148386 Oct 27 09:06:51.040668 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 862/1745] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:50 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:51.552572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:51.553656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:51.561035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:51.561922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:51.562603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:51.563588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:51.564312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:51.564989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:51.744453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c95467a-8b04-4d69-a899-83708cd92cd8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae615b80>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:51.812090 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c95467a-8b04-4d69-a899-83708cd92cd8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.073313 Oct 27 09:06:51.813697 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 863/1746] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:51 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:51.852030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:51.863880 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e9b7655-bd91-4e23-af92-d7107b7c1daa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.315498 Oct 27 09:06:51.870828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:51.871881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:51.894736 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 884/1747] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:51 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:51.898536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:51.899383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:51.900186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:51.901116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:51.901763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:51.902514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:52.070845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:52.071829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:52.079054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:52.079596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:52.084257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:52.085320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:52.085964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:52.086398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:52.174101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:52.217328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:52.228424 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7950d572-d95e-4285-a397-4a9de511b68e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.362734 Oct 27 09:06:52.235925 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 864/1748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:51 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:52.290589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:52.303932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:52.306665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:52.346015 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-78eb08d3-4022-40c2-a291-8f6f7b93494d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1512 microversion: 2.91 time: 0.272087 Oct 27 09:06:52.346893 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 885/1749] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:52 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:52.828301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d9c6880b-7b3c-40fa-be08-4111632b1e54 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae615280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:52.894792 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d9c6880b-7b3c-40fa-be08-4111632b1e54 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.070015 Oct 27 09:06:52.904356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:52.905515 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 865/1750] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:52 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:52.905698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:52.921328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:52.921824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:52.922257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:52.923184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:52.924073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:52.924698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:53.258059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:53.258719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:53.278317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:53.278786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:53.279235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:53.280031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:53.288651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:53.296064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:53.300015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:53.311435 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c21959b6-b4e6-4206-85fb-11201add2e3e tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.412834 Oct 27 09:06:53.313707 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 886/1751] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:52 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:53.381057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:53.381674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:53.391032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:53.391865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:53.392481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:53.393781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:53.394408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:53.395005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:53.568958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:53.584604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:53.587521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:53.599976 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57327d14-9714-4c2b-847a-989318f385d9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1512 microversion: 2.91 time: 0.223334 Oct 27 09:06:53.614008 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 887/1752] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:53 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:06:53.912252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-58507a5a-328a-4005-9e55-df093dd4878d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0d44c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:53.987474 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-58507a5a-328a-4005-9e55-df093dd4878d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.080075 Oct 27 09:06:53.988354 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 888/1753] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:53 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:54.053564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:54.057691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:54.064309 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d75acc54-0e4d-44df-b2a7-adfcd747d180 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.810989 Oct 27 09:06:54.068679 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 866/1754] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:53 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:06:54.338661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:54.339783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:54.357812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:54.358488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:54.373303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:54.375377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:54.376316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:54.377017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:54.593585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-322e289d-386a-464d-a981-40165964b1cd req-02258c8d-1c02-455b-a7a7-92ae44cecb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5c8ea0-8c53-4718-b62f-f35835ecb83e", "name": "network-vif-unplugged", "status": "completed", "tag": "c30b0569-641d-48e2-a378-efe6a00a3231"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:54.613896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-322e289d-386a-464d-a981-40165964b1cd req-02258c8d-1c02-455b-a7a7-92ae44cecb06 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:54.616050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-322e289d-386a-464d-a981-40165964b1cd req-02258c8d-1c02-455b-a7a7-92ae44cecb06 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:54.616750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-322e289d-386a-464d-a981-40165964b1cd req-02258c8d-1c02-455b-a7a7-92ae44cecb06 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:54.650183 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-322e289d-386a-464d-a981-40165964b1cd req-02258c8d-1c02-455b-a7a7-92ae44cecb06 service nova] Creating event network-vif-unplugged:c30b0569-641d-48e2-a378-efe6a00a3231 for instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e on n-h1-858383-16 Oct 27 09:06:54.664000 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-322e289d-386a-464d-a981-40165964b1cd req-02258c8d-1c02-455b-a7a7-92ae44cecb06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074990 Oct 27 09:06:54.671516 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 867/1755] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:06:54.678464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:54.679450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:54.694073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:54.694991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:54.695828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:54.696866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:54.699410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:54.702128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:54.986192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:55.000877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:55.013996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:55.038607 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71dd1e5b-1d2b-4797-aa9b-76c9efe4f791 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1533 microversion: 2.91 time: 0.365217 Oct 27 09:06:55.084275 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 868/1756] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:54 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1533 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:55.109019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b03f7d40-1e92-45b1-aea0-f6e40490c4ca tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5f6820>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:55.165545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:55.178923 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18ed4657-13db-400d-b65a-5b28bb37a340 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.844332 Oct 27 09:06:55.202654 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 889/1757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:54 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:55.279333 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b03f7d40-1e92-45b1-aea0-f6e40490c4ca tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.180290 Oct 27 09:06:55.290390 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 869/1758] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:55 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:55.295820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:55.297019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:55.304867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:55.306392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:55.307086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:55.308128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:55.309467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:55.310335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:55.637502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:55.638647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:55.643369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:55.652603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:55.653393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:55.654239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:55.655274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:55.656139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:55.656959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:55.766481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lazy-loading 'services' on Instance uuid 734f18c8-6747-4af1-a701-95a8698c877d {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:55.776428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:55.795842 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c163918b-029b-47ed-b97a-d288b4abf85c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.495942 Oct 27 09:06:55.800172 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 870/1759] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:55 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:55.839654 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f39edee-2d3b-4da1-83e7-85cf1a1be113 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1940 microversion: 2.91 time: 0.634529 Oct 27 09:06:55.855820 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 890/1760] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:55 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1940 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:55.883491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:55.885529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:55.902076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:55.905859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:55.906486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:55.907670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:55.909581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:55.912719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:56.061580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lazy-loading 'services' on Instance uuid 734f18c8-6747-4af1-a701-95a8698c877d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:56.108506 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d57de4cd-96d8-4e49-9d79-6a994ded5cb0 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1940 microversion: 2.91 time: 0.229134 Oct 27 09:06:56.141720 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 871/1761] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:55 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1940 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:56.153269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b226db43-9356-4a66-8a40-cfcea63c2248 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:56.162190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b226db43-9356-4a66-8a40-cfcea63c2248 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:56.169595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ec199092-7f3a-479b-8a56-5d4bce78b172 req-86862976-d8df-44ae-b76b-71272d3a03b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b7f7ba-bef4-4bb8-857a-a10e5c63ff47", "name": "network-vif-plugged", "status": "completed", "tag": "4eb61217-6569-44d5-8e30-41051be48cad"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:56.172662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b226db43-9356-4a66-8a40-cfcea63c2248 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:56.174644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b226db43-9356-4a66-8a40-cfcea63c2248 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:56.181623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b226db43-9356-4a66-8a40-cfcea63c2248 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:56.184179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b226db43-9356-4a66-8a40-cfcea63c2248 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:56.189783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b226db43-9356-4a66-8a40-cfcea63c2248 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:56.220667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ec199092-7f3a-479b-8a56-5d4bce78b172 req-86862976-d8df-44ae-b76b-71272d3a03b9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:56.224947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ec199092-7f3a-479b-8a56-5d4bce78b172 req-86862976-d8df-44ae-b76b-71272d3a03b9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:56.225846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ec199092-7f3a-479b-8a56-5d4bce78b172 req-86862976-d8df-44ae-b76b-71272d3a03b9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:56.268718 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ec199092-7f3a-479b-8a56-5d4bce78b172 req-86862976-d8df-44ae-b76b-71272d3a03b9 service nova] Creating event network-vif-plugged:4eb61217-6569-44d5-8e30-41051be48cad for instance 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 on n-h1-858383-16 Oct 27 09:06:56.287007 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ec199092-7f3a-479b-8a56-5d4bce78b172 req-86862976-d8df-44ae-b76b-71272d3a03b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122967 Oct 27 09:06:56.293857 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b226db43-9356-4a66-8a40-cfcea63c2248 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.144983 Oct 27 09:06:56.297895 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 872/1762] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:06:56.311429 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 891/1763] 10.222.0.25 () {60 vars in 1217 bytes} [Thu Oct 27 09:06:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:06:56.316420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:56.324657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d655d180-6834-4a44-9f55-0e8fd409dc96 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa60ef70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:56.325543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:56.354346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:56.356408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:56.361010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:56.362067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:56.362768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:56.364249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:56.429845 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d655d180-6834-4a44-9f55-0e8fd409dc96 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.112218 Oct 27 09:06:56.431160 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 892/1764] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:56 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:56.447804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:56.448926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:56.470333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:56.474074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:56.474729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:56.475478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:56.475989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:56.478687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:56.556995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lazy-loading 'flavor' on Instance uuid 734f18c8-6747-4af1-a701-95a8698c877d {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:06:56.833298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:57.066091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:57.078596 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3198eede-fbc8-4185-bd9e-643e1f28d053 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.779105 Oct 27 09:06:57.079749 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 873/1765] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:56 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:57.108865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:57.112449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:57.127276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:57.132472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:57.133545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:57.134645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:57.135333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:57.135955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:57.249693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de081064-92f2-45d9-ac63-4cbd03d8e59c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "POST /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d/action" status: 202 len: 0 microversion: 2.91 time: 0.813700 Oct 27 09:06:57.256572 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 893/1766] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:06:56 2022] POST /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d/action => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:06:57.298367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:57.322900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:57.377487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:57.378075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:57.378465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:57.388444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:57.389095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:57.398017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:57.691938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:57.729217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:57.729654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:57.734119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:57.741404 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a554f9e0-696c-4252-872c-2283689e425a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 0.641063 Oct 27 09:06:57.742972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 874/1767] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:57 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:57.760634 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f068a812-da2b-49c3-98e0-b3c53c610ad2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.500662 Oct 27 09:06:57.761287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-645cee1a-9f8d-4b66-9a2b-51c14cba5298 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5a1820>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:57.761882 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 894/1768] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:57 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:57.835893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-00396ffb-aec0-4c3c-a41e-5400bc937f85 req-45e1efac-5324-4ed2-9ee9-1bcde0078068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5c8ea0-8c53-4718-b62f-f35835ecb83e", "tag": "c30b0569-641d-48e2-a378-efe6a00a3231"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:57.866969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-00396ffb-aec0-4c3c-a41e-5400bc937f85 req-45e1efac-5324-4ed2-9ee9-1bcde0078068 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:57.867779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-00396ffb-aec0-4c3c-a41e-5400bc937f85 req-45e1efac-5324-4ed2-9ee9-1bcde0078068 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:57.872132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-00396ffb-aec0-4c3c-a41e-5400bc937f85 req-45e1efac-5324-4ed2-9ee9-1bcde0078068 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:57.884737 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-645cee1a-9f8d-4b66-9a2b-51c14cba5298 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.137588 Oct 27 09:06:57.887323 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 875/1769] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:57 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:57.917533 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-00396ffb-aec0-4c3c-a41e-5400bc937f85 req-45e1efac-5324-4ed2-9ee9-1bcde0078068 service nova] Creating event network-changed:c30b0569-641d-48e2-a378-efe6a00a3231 for instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e on n-h1-858383-16 Oct 27 09:06:57.929855 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-00396ffb-aec0-4c3c-a41e-5400bc937f85 req-45e1efac-5324-4ed2-9ee9-1bcde0078068 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095686 Oct 27 09:06:57.932325 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 895/1770] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:06:58.122936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:58.125530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:58.152863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:58.156180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:58.159505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:58.160538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:58.162200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:58.169362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:58.554017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:58.564293 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65e40fa2-cb65-41dd-bfd9-ed108c72ec5f tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.462104 Oct 27 09:06:58.573580 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 876/1771] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:58 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:58.622776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=14 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:58.647386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-13bdd029-2acf-4df9-942d-d5497616f2fb req-427ee908-fdfa-4021-aa3f-db9ffed84264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4349576-ae59-481f-92ec-599ddae530d7", "name": "network-vif-plugged", "status": "completed", "tag": "e74cd9c8-3c59-4b33-a7c7-5358d3b644c0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:06:58.695237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13bdd029-2acf-4df9-942d-d5497616f2fb req-427ee908-fdfa-4021-aa3f-db9ffed84264 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:58.698223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13bdd029-2acf-4df9-942d-d5497616f2fb req-427ee908-fdfa-4021-aa3f-db9ffed84264 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:58.699067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13bdd029-2acf-4df9-942d-d5497616f2fb req-427ee908-fdfa-4021-aa3f-db9ffed84264 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:58.769485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:58.770119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:58.772125 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-13bdd029-2acf-4df9-942d-d5497616f2fb req-427ee908-fdfa-4021-aa3f-db9ffed84264 service nova] Creating event network-vif-plugged:e74cd9c8-3c59-4b33-a7c7-5358d3b644c0 for instance d4349576-ae59-481f-92ec-599ddae530d7 on n-h2-858383-16 Oct 27 09:06:58.784379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=56 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:06:58.786035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:58.786563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:58.794142 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-13bdd029-2acf-4df9-942d-d5497616f2fb req-427ee908-fdfa-4021-aa3f-db9ffed84264 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167821 Oct 27 09:06:58.794363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:58.797939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:58.798819 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 896/1772] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:06:58.801828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:58.802859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:58.848382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:58.849469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:58.896322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:58.898443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:58.904465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:58.908945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:58.930971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:58.937359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:59.295537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:59.310928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:59.312855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:06:59.326331 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-464cf29b-e1e9-4f3c-8702-b88810f88a4d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.525787 Oct 27 09:06:59.327125 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 897/1773] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:06:58 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:06:59.363973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed06d1e3-8146-417f-8faf-f3611943ff36 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0be700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:59.454909 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed06d1e3-8146-417f-8faf-f3611943ff36 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.100899 Oct 27 09:06:59.455910 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 898/1774] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:06:59 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:06:59.612705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:06:59.613337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:06:59.626570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:59.627822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:59.629971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:06:59.632393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:06:59.636008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:06:59.637059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:00.117642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:00.137438 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af5cce3b-da18-470c-a00e-182a6492c8e2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1313 microversion: 2.1 time: 1.372043 Oct 27 09:07:00.159032 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 877/1775] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:58 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1313 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:00.255442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:00.271894 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6df5e57a-5581-4b59-a92b-9ab29540aae3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.660902 Oct 27 09:07:00.272631 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 899/1776] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:06:59 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:00.299705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-331190149", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1a8d8c4c-d7c6-4980-b309-ab63e829200b"}], "block_device_mapping_v2": [{"uuid": "d9c01044-9695-4672-9189-cfdec00892bf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:00.358798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:00.359497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:00.370027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:00.370534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:00.370989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:00.379875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:00.384629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:00.388379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:00.450602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] validate_networks() for [('1a8d8c4c-d7c6-4980-b309-ab63e829200b', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:07:00.547696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:00.573188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:00.574965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:00.592943 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c4067c03-9fc9-464e-af8c-2c13180ba925 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.238217 Oct 27 09:07:00.596739 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 900/1777] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:00 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:00.708114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f590620a-1d13-4809-bb2e-709be4035b73 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Action: 'create', calling method: .version_select at 0x7f31aa3e59d0>, body: {"keypair": {"name": "tempest-keypair-531436625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCYGjxyJ0XxthS/mYYkVjlLO79Z/w46uwfyk3UuuEN2n8f7960s+UZuo6BsNvwVjFDuGIAC6xa120xt+cM9NOJis2VuTNi24Hj/uKzqDUrwYwWd4m7Qc4G3aDOpT/GYjA=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:00.745112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f590620a-1d13-4809-bb2e-709be4035b73 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Getting quotas for project b7de08c501014c3f871b145030dc97cb. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:07:00.752824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f590620a-1d13-4809-bb2e-709be4035b73 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Getting quotas for user c880db7ee81e4b9886f6414fd9359ade and project b7de08c501014c3f871b145030dc97cb. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:07:00.784461 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f590620a-1d13-4809-bb2e-709be4035b73 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.186789 Oct 27 09:07:00.785784 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 901/1778] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:07:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:00.790774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-63621482-6221-46b8-8686-f8a550490ac1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0e1040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:00.856863 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-63621482-6221-46b8-8686-f8a550490ac1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.069790 Oct 27 09:07:00.865271 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 902/1779] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:00 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:01.157254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:07:01.157878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:07:01.158112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:07:01.158561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:07:01.159675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:07:01.167914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:01.169238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:01.174767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:01.175258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:01.175775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:01.176491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:01.177211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:01.177547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:01.177674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:01.178160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:01.178648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:01.179337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:01.179831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:01.180894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:01.206023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:07:01.212305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Getting quotas for user cf8bc1ce921e4f759cb9c0b5f4340324 and project ed77ec98569b4d25bbf481afb32c3fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:07:01.294489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:07:01.297321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9c01044-9695-4672-9189-cfdec00892bf',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:07:01.464303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:01.473743 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47ad6865-132d-4d50-aa8d-d21ed9eb2cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1463 microversion: 2.1 time: 0.311373 Oct 27 09:07:01.474826 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 903/1780] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:01 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:01.480582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:01.481520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:01.488080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:01.488887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:01.489611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:01.490533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:01.491192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:01.491873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:01.538281 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2dc29d44-d01c-4eb1-ba35-ab4de61aaf38 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.243221 Oct 27 09:07:01.539107 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 878/1781] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:07:01.544636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:01.545500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:01.555844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:01.557173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:01.557795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:01.559016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:01.559686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:01.560286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:01.847072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:01.855335 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97325bb3-b9c0-4222-b6fc-d0c6ba481faa tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.379076 Oct 27 09:07:01.875415 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 904/1782] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:01 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:01.884773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1160491e-d56a-4177-937e-46b502859ebf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:01.885764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1160491e-d56a-4177-937e-46b502859ebf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:01.977401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1160491e-d56a-4177-937e-46b502859ebf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:01.986821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1160491e-d56a-4177-937e-46b502859ebf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:01.996836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1160491e-d56a-4177-937e-46b502859ebf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:01.997904 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1160491e-d56a-4177-937e-46b502859ebf tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1103 microversion: 2.25 time: 0.121050 Oct 27 09:07:01.998473 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 905/1783] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:01 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1103 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:02.012748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:02.027347 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8c24058-74a4-4893-a5a5-bcf799d926c4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1314 microversion: 2.1 time: 0.486314 Oct 27 09:07:02.030282 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 879/1784] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:01 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:02.047701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:02.051193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cdaf2476-eec9-4332-a9d5-c46eef3fcbf2 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5f7280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:02.053981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:02.075716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:02.076280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:02.077972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:02.078726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:02.081431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:02.082129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:02.147853 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cdaf2476-eec9-4332-a9d5-c46eef3fcbf2 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.112279 Oct 27 09:07:02.149148 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 880/1785] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:02 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:02.350998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:02.375008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:02.379995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:02.394757 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64a1a915-4dd3-49d1-b91b-457e3f2a4947 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.360310 Oct 27 09:07:02.395443 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 906/1786] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:02 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:02.885174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:02.885818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:02.900732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:02.901579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:02.902226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:02.903254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:02.904049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:02.908306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:03.026788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:03.028019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:03.053116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:03.057081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:03.057786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:03.058864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:03.061823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:03.062639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:03.193637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:03.203535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:03.206003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:03.207470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:03.208715 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0bd75ab-1da5-4088-afe0-372757dfc0d9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1232 microversion: 2.25 time: 0.187329 Oct 27 09:07:03.209293 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 907/1787] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:03 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1232 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:03.226270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:03.232020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:03.232303 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4531beea-634f-4220-9a9a-1d72f4883cb6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.352790 Oct 27 09:07:03.232930 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 881/1788] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:02 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:03.249885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:03.251704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:03.253577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b4e23b2-4f6b-43db-8efc-8641637d6ee4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae6159d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:03.254269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:03.256195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:03.259226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:03.259720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:03.344991 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b4e23b2-4f6b-43db-8efc-8641637d6ee4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.096692 Oct 27 09:07:03.352450 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 882/1789] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:03 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:03.429310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:03.430908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:03.447621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:03.450678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:03.451426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:03.452668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:03.455190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:03.456438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:03.718533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:03.735640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:03.751666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:03.765624 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1396cd0a-49de-4293-be6f-bbec29ab36fc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.342856 Oct 27 09:07:03.766515 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 883/1790] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:03 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:03.785354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1010686070", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d670a3a2-57f0-405c-9bc1-b6afe4142460"}], "security_groups": [{"name": "tempest-securitygroup--1811800304"}], "key_name": "tempest-keypair-531436625", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:04.266765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] validate_networks() for [('d670a3a2-57f0-405c-9bc1-b6afe4142460', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:07:04.338651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:04.350531 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-96e68972-45dd-401f-b8db-20afdfb7ae1b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1464 microversion: 2.1 time: 1.140075 Oct 27 09:07:04.389283 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 908/1791] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:03 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1464 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:04.416023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:04.425691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:04.440883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:04.453421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:04.453900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:04.460551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:04.461369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:04.462020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:04.653881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:04.674489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:04.677545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:04.678924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-afd7add1-7831-4a49-ac27-175437cdc5e7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1250 microversion: 2.25 time: 0.288277 Oct 27 09:07:04.704285 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 909/1792] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:04 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1250 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:04.716019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:04.719995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:04.742776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:04.743365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:04.743904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:04.744960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:04.745822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:04.749687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:05.116294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:05.131141 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-abe10a15-f6d9-451f-a52f-3a01a2382e20 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.425413 Oct 27 09:07:05.137693 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 910/1793] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:04 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:05.153151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5af98d3-64f6-4b90-adef-5e011f8585ed tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa020b80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:05.231909 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5af98d3-64f6-4b90-adef-5e011f8585ed tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.092743 Oct 27 09:07:05.233357 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 911/1794] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:05 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:05.246304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1935289993", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d4349576-ae59-481f-92ec-599ddae530d7"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:05.371922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Getting quotas for project b7de08c501014c3f871b145030dc97cb. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:07:05.381662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:07:05.391171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Getting quotas for user c880db7ee81e4b9886f6414fd9359ade and project b7de08c501014c3f871b145030dc97cb. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:07:05.426578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:07:05.427422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:07:05.428036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:07:05.428557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:07:05.429085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:07:05.457794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:05.458750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:05.459435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:05.460465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:05.461856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:05.462526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:05.511995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Getting quotas for project b7de08c501014c3f871b145030dc97cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:07:05.524992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Getting quotas for user c880db7ee81e4b9886f6414fd9359ade and project b7de08c501014c3f871b145030dc97cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:07:05.545656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:07:05.549067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:07:05.657916 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5163d2ad-e49c-435d-9785-22d72d74aacc tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.889668 Oct 27 09:07:05.659245 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 884/1795] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:07:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:07:05.667148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:05.668684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:05.683687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:05.684605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:05.685516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:05.686736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:05.687893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:05.688524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:05.879161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:05.898387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:05.901208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:05.932903 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6c9c253-41fb-403e-835e-8bf7e9cab75b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.271847 Oct 27 09:07:05.943762 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 885/1796] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:05 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:05.956179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-81d4c018-cba7-4edd-a90e-3a02353bb370 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:05.957392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-81d4c018-cba7-4edd-a90e-3a02353bb370 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:06.066852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-81d4c018-cba7-4edd-a90e-3a02353bb370 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:06.081593 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-81d4c018-cba7-4edd-a90e-3a02353bb370 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1277 microversion: 2.1 time: 0.142521 Oct 27 09:07:06.095662 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 886/1797] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:05 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:06.095662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:06.096138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:06.107130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:06.107657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:06.108107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:06.108825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:06.114690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:06.115255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:06.230549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:06.586152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:06.608722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:06.630795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:06.631384 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8eb7620d-92b6-439c-93e5-e68ef0ae72f7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1292 microversion: 2.25 time: 0.546654 Oct 27 09:07:06.647610 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 887/1798] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:06 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1292 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:06.650006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:06.651462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:06.671502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:06.672107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:06.672557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:06.673292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:06.673758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:06.674186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:06.875023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:07:06.875773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:07:06.875938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:07:06.876714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:07:06.877394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:07:06.899366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:06.900259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:06.901005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:06.902098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:06.903408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:06.904224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:06.972096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Getting quotas for project 4d54fc3cc5ef488c9409163954878ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:07:06.986964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Getting quotas for user 86bf6e736b6a44bfa47de6549573ddd4 and project 4d54fc3cc5ef488c9409163954878ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:07:07.021848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:07:07.034617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:07:07.152216 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fcc3584d-b7a1-435e-a09f-32c241543220 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917431 Oct 27 09:07:07.154390 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 912/1799] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:07:07.167491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e0c4f87-3ef5-4aa8-8c9f-c42b65315ff9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0515e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:07.278088 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e0c4f87-3ef5-4aa8-8c9f-c42b65315ff9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.122504 Oct 27 09:07:07.281967 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 913/1800] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:07 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:07.288730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:07.290891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:07.300030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:07.300921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:07.301718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:07.303267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:07.304210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:07.305520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:07.584531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:07.608562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:07.612481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:07.642714 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28fcfe0f-238c-4c6c-ad9a-f6089c499280 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.355917 Oct 27 09:07:07.648472 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 914/1801] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:07 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:07.674186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:07.677448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:07.698593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:07.702210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:07.705091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:07.709705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:07.711955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:07.712963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:07.719143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:07.737051 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8b5b0cc6-227f-4bb4-9ea0-ea85b982af34 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 1.097722 Oct 27 09:07:07.738888 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 888/1802] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:06 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:07.755487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-26ff9d94-551d-453b-8406-2f47561fd5ed tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:07.756533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-26ff9d94-551d-453b-8406-2f47561fd5ed tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:07.761872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:07.909751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:07.922338 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae94cf83-de4b-4482-9022-15d1753610af tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1329 microversion: 2.1 time: 0.272337 Oct 27 09:07:07.944847 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 915/1803] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:07 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1329 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:07.953426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:07.954039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:07.975996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:07.977940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:07.978419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:07.982658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:07.985610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:07.986292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:08.134452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-26ff9d94-551d-453b-8406-2f47561fd5ed tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:08.147473 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-26ff9d94-551d-453b-8406-2f47561fd5ed tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1214 microversion: 2.1 time: 0.403628 Oct 27 09:07:08.148568 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 889/1804] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:07 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:08.297935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d391a186-fba7-4cce-979a-ce9f6b49832e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae615c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:08.411164 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d391a186-fba7-4cce-979a-ce9f6b49832e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.117586 Oct 27 09:07:08.411867 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 890/1805] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:08 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:08.682763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:08.683765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:08.692661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:08.693604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:08.695138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:08.696385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:08.699014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:08.699831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:08.931352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:08.943138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:08.947990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:08.955012 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eaca8da2-6892-4fdf-b45c-915257736024 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.279382 Oct 27 09:07:08.968069 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 891/1806] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:08 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:08.983756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:08.984782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:08.992526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:08.993398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:08.994073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:08.995234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:08.996067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:08.996753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:09.111094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:09.128472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:09.129954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:09.130955 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5fe6ff42-615b-44e7-b96e-8b9744a6a226 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1292 microversion: 2.25 time: 1.184854 Oct 27 09:07:09.152250 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 916/1807] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:07 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1292 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:09.167465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:09.168277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:09.178046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:09.178467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:09.179321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:09.180486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:09.181019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:09.181658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:09.213542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:09.694710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:09.711797 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3cd9de57-758f-4cbc-888e-abfd3e2a2de0 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1335 microversion: 2.1 time: 0.550737 Oct 27 09:07:09.713027 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 917/1808] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:09 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1335 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:09.733790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:09.737629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:09.771945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:09.772617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:09.777210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:09.779449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:09.781830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:09.782355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:09.916831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:09.929418 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d3fd02a-abd5-4b53-94ca-4247654015fd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1266 microversion: 2.1 time: 0.210497 Oct 27 09:07:09.932356 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 918/1809] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:09 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:09.944213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea4366c7-c06e-4cb1-820a-d51e166f0c40 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0b1e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:10.043111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:10.053194 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea4366c7-c06e-4cb1-820a-d51e166f0c40 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.117189 Oct 27 09:07:10.053797 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 919/1810] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:09 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:10.054375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:10.060732 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63bfa1df-cf8f-4506-a152-06d5997438c5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 1.090250 Oct 27 09:07:10.063530 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 892/1811] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:08 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:10.068474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:10.069305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:10.079144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b8cc3b07-ae36-4f7e-aa99-a67c01391a36 req-9ca54b54-0ec8-4fbc-8aec-1a30c080dff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4098cc-19c7-4dc0-b5af-55f92720b32f", "tag": "f5de6da6-f70a-45de-9d70-2166b991303b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:10.086580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:10.087386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:10.087882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:10.088950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:10.089433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:10.089871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:10.104195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b8cc3b07-ae36-4f7e-aa99-a67c01391a36 req-9ca54b54-0ec8-4fbc-8aec-1a30c080dff2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:10.105739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b8cc3b07-ae36-4f7e-aa99-a67c01391a36 req-9ca54b54-0ec8-4fbc-8aec-1a30c080dff2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:10.110402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b8cc3b07-ae36-4f7e-aa99-a67c01391a36 req-9ca54b54-0ec8-4fbc-8aec-1a30c080dff2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:10.133411 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b8cc3b07-ae36-4f7e-aa99-a67c01391a36 req-9ca54b54-0ec8-4fbc-8aec-1a30c080dff2 service nova] Creating event network-changed:f5de6da6-f70a-45de-9d70-2166b991303b for instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f on n-h1-858383-16 Oct 27 09:07:10.144146 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b8cc3b07-ae36-4f7e-aa99-a67c01391a36 req-9ca54b54-0ec8-4fbc-8aec-1a30c080dff2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078884 Oct 27 09:07:10.146722 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 893/1812] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:10.172681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:10.174590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:10.191334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:10.196052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:10.196552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:10.197564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:10.199235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:10.200335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:10.647584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:10.661199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:10.666695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:10.680118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-053f527d-b354-4808-ab36-67878ed8e92d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.622808 Oct 27 09:07:10.681928 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 920/1813] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:10 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:10.739969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:10.740760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:10.757036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:10.758286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:10.758838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:10.759706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:10.760277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:10.760815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:10.963429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:10.979132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:10.980989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:10.982174 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f0f86af-dba7-4a04-bec4-1382bee2f1a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1292 microversion: 2.25 time: 0.816026 Oct 27 09:07:10.999595 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 894/1814] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:10 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1292 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:10.999595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:10.999595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:11.017928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:11.018479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:11.018929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:11.019687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:11.020155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:11.020587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:11.189503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:11.202036 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ae959f7-e461-45cc-8d04-cad24e5443dc tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1272 microversion: 2.1 time: 0.214061 Oct 27 09:07:11.202663 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 895/1815] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:10 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:11.214092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-199383aa-9641-48e5-9087-fbd1ecd60d8d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5f6940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:11.286813 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-199383aa-9641-48e5-9087-fbd1ecd60d8d tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.081809 Oct 27 09:07:11.287420 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 896/1816] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:11 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:11.305087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:11.305710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:11.330350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:11.330872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:11.331330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:11.332109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:11.332577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:11.333488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:11.432101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:11.444333 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f96313c3-eff0-4e76-b236-33a71b2c6e11 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1403 microversion: 2.1 time: 0.706392 Oct 27 09:07:11.446971 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 921/1817] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:10 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1403 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:11.459195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0c0dffc6-29af-468c-9298-b2a478bffd76 req-87eb9f3d-a9b7-421e-8871-62c73c394ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1d2ad1-7f91-47f3-b030-de36287cd241", "tag": "b23a8df2-1eac-45b9-a02f-702b2776b1cf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:11.482859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0c0dffc6-29af-468c-9298-b2a478bffd76 req-87eb9f3d-a9b7-421e-8871-62c73c394ee8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:11.486694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0c0dffc6-29af-468c-9298-b2a478bffd76 req-87eb9f3d-a9b7-421e-8871-62c73c394ee8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:11.487144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0c0dffc6-29af-468c-9298-b2a478bffd76 req-87eb9f3d-a9b7-421e-8871-62c73c394ee8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:11.505269 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0c0dffc6-29af-468c-9298-b2a478bffd76 req-87eb9f3d-a9b7-421e-8871-62c73c394ee8 service nova] Creating event network-changed:b23a8df2-1eac-45b9-a02f-702b2776b1cf for instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 on n-h2-858383-16 Oct 27 09:07:11.511621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0c0dffc6-29af-468c-9298-b2a478bffd76 req-87eb9f3d-a9b7-421e-8871-62c73c394ee8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061990 Oct 27 09:07:11.513210 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 922/1818] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:11.722913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:11.724464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:11.732861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:11.738992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:11.741111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:11.750286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:11.753653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:11.755821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:11.869760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:11.885902 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62abb14d-65fa-4d36-b78d-73573436a332 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1392 microversion: 2.1 time: 0.597093 Oct 27 09:07:11.886819 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 897/1819] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:11 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1392 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:12.000738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:12.009206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:12.010483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:12.017517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:12.019323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:12.026433 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a0c53eb-0974-4393-827b-cd6121db6409 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.307689 Oct 27 09:07:12.043788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:12.044196 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 923/1820] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:11 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:12.052229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:12.064387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:12.073984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:12.075139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:12.079489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:12.229309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:12.229923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:12.246135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:12.249249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:12.251671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:12.252063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:12.252843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:12.253304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:12.253736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:12.581081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:12.590684 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4b4bb7a4-6856-421a-810d-67bc5c2b0e16 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1272 microversion: 2.1 time: 0.365835 Oct 27 09:07:12.591277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 924/1821] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:12 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1272 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:12.605148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e7894de-12c4-4da4-8ecc-598513e0ffb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa2a31f0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:12.659332 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e7894de-12c4-4da4-8ecc-598513e0ffb7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.060297 Oct 27 09:07:12.660225 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 925/1822] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:12 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:12.664997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:12.665896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:12.687472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:12.688275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:12.688914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:12.689803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:12.690437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:12.691054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:12.704508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:12.717529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:12.727626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:12.728966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9ab81d3-1e7a-4565-9d09-f67bb969c560 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1292 microversion: 2.25 time: 0.723883 Oct 27 09:07:12.742495 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 898/1823] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:12 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1292 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:12.910706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:12.911939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:12.930845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:12.932194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:12.933404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:12.935149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:12.936521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:12.937143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:13.053097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:13.071430 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2f3fcfa2-4e87-4a3e-8280-5b46ef88fb13 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1403 microversion: 2.1 time: 0.404745 Oct 27 09:07:13.073950 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 926/1824] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:12 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1403 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:13.088425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:13.089348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:13.101001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:13.101777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:13.102547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:13.105513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:13.106564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:13.107291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:13.267260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:13.277792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:13.279615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:13.286432 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f2ff7c3c-020a-4514-ba68-10e7bcba119b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.209755 Oct 27 09:07:13.287770 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 927/1825] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:13 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:13.352903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:13.361672 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36b358c5-03ca-494c-af66-75c56393c1d4 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1382 microversion: 2.1 time: 0.456271 Oct 27 09:07:13.368844 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 899/1826] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:12 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1382 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:13.390590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cbf537ca-e049-48bb-9e46-31c12d996c74 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '.version_select at 0x7f31aa29d4c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:13.395021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf537ca-e049-48bb-9e46-31c12d996c74 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:13.397405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf537ca-e049-48bb-9e46-31c12d996c74 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:13.397882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf537ca-e049-48bb-9e46-31c12d996c74 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:13.418803 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cbf537ca-e049-48bb-9e46-31c12d996c74 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2732 microversion: 2.1 time: 0.031854 Oct 27 09:07:13.430227 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 928/1827] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:07:13 2022] GET /compute/v2.1/os-migrations => generated 2732 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:13.439808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-06f6454f-1353-4cba-9c58-a0396ad7bd92 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:13.440285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-06f6454f-1353-4cba-9c58-a0396ad7bd92 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:13.447222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06f6454f-1353-4cba-9c58-a0396ad7bd92 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:13.447887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06f6454f-1353-4cba-9c58-a0396ad7bd92 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:13.448523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06f6454f-1353-4cba-9c58-a0396ad7bd92 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:13.449383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06f6454f-1353-4cba-9c58-a0396ad7bd92 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:13.449905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06f6454f-1353-4cba-9c58-a0396ad7bd92 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:13.450333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06f6454f-1353-4cba-9c58-a0396ad7bd92 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:13.614753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:13.615728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:13.631844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:13.632490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:13.632960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:13.633688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:13.634146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:13.634583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:13.963603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-06f6454f-1353-4cba-9c58-a0396ad7bd92 tempest-LiveMigrationTest-1066909863 tempest-LiveMigrationTest-1066909863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1535 microversion: 2.1 time: 0.531896 Oct 27 09:07:13.966432 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 900/1828] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:13 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1535 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:14.010472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2221e9b3-2513-4fdc-9bda-ffc4df58f462 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5a1af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:14.094748 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2221e9b3-2513-4fdc-9bda-ffc4df58f462 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.098424 Oct 27 09:07:14.095805 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 901/1829] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:13 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:14.110904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:14.112097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:14.122938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.124001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.125592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.126785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.127496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.128244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.131147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:14.148990 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d6cb729c-a997-4dba-a27a-51a8207215d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.539042 Oct 27 09:07:14.159755 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 929/1830] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:13 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:14.159755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:14.159755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:14.176601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.179288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.179855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.181764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.183956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.184633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.266350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:07:14.444003 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed696cc4-6390-4e2f-b4be-8792e25f1ec6 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 204 len: 0 microversion: 2.1 time: 0.292321 Oct 27 09:07:14.446951 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 930/1831] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:07:14 2022] DELETE /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:07:14.454173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:14.456492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:14.466149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.467785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.468479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.469697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.470407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.471091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.784411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:14.792842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:14.794367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:14.795500 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1538c7ae-4cdf-4d78-a113-a4d90b375850 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1292 microversion: 2.25 time: 0.688933 Oct 27 09:07:14.796461 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 902/1832] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:14 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1292 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:14.798041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:14.801556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:14.802628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:14.809113 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e70cf74-c37a-46d0-9488-86edfb23bd52 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1403 microversion: 2.1 time: 0.360253 Oct 27 09:07:14.809587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.810357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.810980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.811903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.812519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.813108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.828752 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 931/1833] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:14 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1403 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:14.833790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:14.835640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:14.843129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.844990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.845229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.846240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:14.846809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:14.847337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:14.893890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:14.903796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:14.906656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:14.913137 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2dca7742-4cca-4a51-827d-40ee9beeada0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.115420 Oct 27 09:07:14.930019 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 903/1834] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:14 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:15.024847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:15.033538 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a3d1cf3d-4989-4bd6-b733-57e3c699f2a5 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1388 microversion: 2.1 time: 0.203433 Oct 27 09:07:15.034329 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 932/1835] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:14 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1388 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:15.111467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-426e3199-5376-4cf9-903d-fde53598515b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa052f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:15.175341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:15.176018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:15.184582 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-426e3199-5376-4cf9-903d-fde53598515b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.062544 Oct 27 09:07:15.188333 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 904/1836] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:15 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:15.197074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:15.200348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:15.200348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:15.200348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:15.200348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:15.200348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:15.490327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:15.500054 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b36a2f7b-9f2c-4ea7-9341-9d73239ff06e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.329362 Oct 27 09:07:15.516809 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 933/1837] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:15 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:15.822386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:15.828023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:15.829905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:15.842834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:15.844012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:15.848660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:15.849100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:15.849679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:15.851970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:15.852403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:15.852850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:15.863672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:15.864606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:15.865293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:15.866291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:15.867042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:15.867928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:16.257841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:16.272928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:16.279835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:16.281379 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1bf7891-1b31-48cc-bf1b-b5bad232acd4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.461390 Oct 27 09:07:16.285310 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 905/1838] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:15 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:16.297102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:16.298036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:16.306120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:16.306985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:16.307674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:16.308607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:16.309293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:16.309924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:16.318726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:16.330064 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3956c33a-8c40-4c84-9c57-25820190609f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1403 microversion: 2.1 time: 0.491031 Oct 27 09:07:16.331928 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 934/1839] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:15 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1403 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:16.350774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:16.352142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:16.366210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:16.371799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:16.372356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:16.373122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:16.373594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:16.374023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:16.505243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:16.514924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:16.521134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:16.532678 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-854461a5-db88-41ab-bc83-e89cdb3fd499 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.244907 Oct 27 09:07:16.549742 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 906/1840] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:16 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:16.563026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-695fc2fd-040e-4cf9-a91a-906633747056 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5c31f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:16.619121 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-695fc2fd-040e-4cf9-a91a-906633747056 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1455 microversion: 2.1 time: 0.067907 Oct 27 09:07:16.620534 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 907/1841] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:16 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:16.636688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:16.637721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:16.645905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:16.646800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:16.647466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:16.649477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:16.650172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:16.650822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:16.924742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:16.927297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:16.937940 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a0f154c2-3c99-46fe-8a44-e2f0ea691063 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1388 microversion: 2.1 time: 0.604389 Oct 27 09:07:16.939012 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 935/1842] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:16 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1388 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:17.026408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-635bc7fb-b392-4ddd-8f39-47ef69249cac req-8ccedcc4-addb-4d50-baff-5f77d8b6efa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed9f097-736e-467b-805c-1813e5c70ea3", "tag": "4f4178c9-6e2b-461c-891f-79017ab0aabc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:17.035150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:17.036248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:17.041991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-635bc7fb-b392-4ddd-8f39-47ef69249cac req-8ccedcc4-addb-4d50-baff-5f77d8b6efa8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.043211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-635bc7fb-b392-4ddd-8f39-47ef69249cac req-8ccedcc4-addb-4d50-baff-5f77d8b6efa8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.043943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-635bc7fb-b392-4ddd-8f39-47ef69249cac req-8ccedcc4-addb-4d50-baff-5f77d8b6efa8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.057928 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-635bc7fb-b392-4ddd-8f39-47ef69249cac req-8ccedcc4-addb-4d50-baff-5f77d8b6efa8 service nova] Creating event network-changed:4f4178c9-6e2b-461c-891f-79017ab0aabc for instance bed9f097-736e-467b-805c-1813e5c70ea3 on n-h2-858383-16 Oct 27 09:07:17.063701 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-635bc7fb-b392-4ddd-8f39-47ef69249cac req-8ccedcc4-addb-4d50-baff-5f77d8b6efa8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041831 Oct 27 09:07:17.065063 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 936/1843] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:17.084904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:17.095337 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a48448a1-dd1e-42dd-b532-dcb87c190610 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.472403 Oct 27 09:07:17.096656 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 908/1844] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:16 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:17.312508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:17.313326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:17.319791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.320529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.320718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.321555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.322067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.322522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.362617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:17.363236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:17.371623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.372205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.372734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.373554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.374074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.374569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.694159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:17.703970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:17.705427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:17.706669 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd57d8b3-bfc7-434e-a447-76bbe1a38e34 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.399287 Oct 27 09:07:17.707099 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 937/1845] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:17 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:17.712409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:17.713189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:17.714964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:17.719900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.720389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.720824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.721522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.721967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.722591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.741538 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7eb27c79-a3ce-44ce-a691-74613f81977f tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1403 microversion: 2.1 time: 0.373773 Oct 27 09:07:17.742429 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 909/1846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:17 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1403 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:17.747285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2cbf530b-9461-4e57-a7a2-87622e8ebd21 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa13e8b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:17.805401 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2cbf530b-9461-4e57-a7a2-87622e8ebd21 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1464 microversion: 2.1 time: 0.061687 Oct 27 09:07:17.805982 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 910/1847] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:17 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1464 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:17.822814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-239b54b7-1594-48f8-aa1a-596a277830d4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa1f5940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:17.832079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:17.842914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:17.844651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:17.850857 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d2405caa-1a11-48a4-911e-9fc53a2ecf0d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.142438 Oct 27 09:07:17.852253 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 938/1848] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:17 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:17.895138 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-239b54b7-1594-48f8-aa1a-596a277830d4 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 200 len: 1464 microversion: 2.1 time: 0.078943 Oct 27 09:07:17.896174 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 911/1849] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:17 2022] GET /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 1464 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:17.911654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:17.912281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:17.919102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.921066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.921699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.922780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.923489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.924185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.962838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:17.963463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:17.979181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.979714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.980706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:17.981825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:17.982535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:17.983202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.102464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:18.113074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dabdd9bb-63c6-4039-bea8-7902f643d1ea tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1183 microversion: 2.1 time: 0.153034 Oct 27 09:07:18.114303 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 912/1850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:17 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:18.120113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:18.121115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:18.129402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.130243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.130899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.131841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.132571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.133204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.140698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=20 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:18.160416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:18.169625 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e89b30a3-4c02-4f51-a28b-6e81aed71f61 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1467 microversion: 2.1 time: 0.262632 Oct 27 09:07:18.183697 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 939/1851] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:17 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1467 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:18.193256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e916d123-275f-49d8-8f8c-62a669551ffe tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-459509628"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:18.196137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e916d123-275f-49d8-8f8c-62a669551ffe tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:18.202950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e916d123-275f-49d8-8f8c-62a669551ffe tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.203446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e916d123-275f-49d8-8f8c-62a669551ffe tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.203926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e916d123-275f-49d8-8f8c-62a669551ffe tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.204641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e916d123-275f-49d8-8f8c-62a669551ffe tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.205101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e916d123-275f-49d8-8f8c-62a669551ffe tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.205528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e916d123-275f-49d8-8f8c-62a669551ffe tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.291016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:18.298969 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70e4ce98-ed6f-4af0-b165-eebaafb39f6d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.183382 Oct 27 09:07:18.303621 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 913/1852] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:18 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:18.429299 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e916d123-275f-49d8-8f8c-62a669551ffe tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "POST /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341/action" status: 202 len: 0 microversion: 2.1 time: 0.239799 Oct 27 09:07:18.430017 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 940/1853] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:07:18 2022] POST /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:07:18.440946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb7ffe06-1f90-4e7d-acc3-42df534ed097 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5c8790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:18.493343 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb7ffe06-1f90-4e7d-acc3-42df534ed097 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.056181 Oct 27 09:07:18.494418 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 914/1854] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:18 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:18.733453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:18.734213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:18.740554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.741043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.741599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.742290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.742738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.743160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.766429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:18.767455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:18.775325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.775869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.785871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.786692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.787192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.787666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.950676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:18.959329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:18.961525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:18.962940 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46dad7d7-0edc-4dc6-85c2-9c6bfa24b131 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.233789 Oct 27 09:07:18.963704 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 941/1855] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:18 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:18.968829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:18.969432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:18.974580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:18.975838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.976520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.977141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.978089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:18.978752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:18.979414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:18.983906 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-097fbd66-f0d5-4968-a6a4-904142411f5e tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1403 microversion: 2.1 time: 0.221450 Oct 27 09:07:18.984494 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 915/1856] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:18 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1403 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:19.046589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:19.055810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:19.057266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:19.062281 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7fa2d140-ab10-4ad9-88f5-e349f26848c7 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.097226 Oct 27 09:07:19.062849 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 942/1857] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:18 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:19.082592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c695a035-a7ee-4eeb-848f-3df283498dc1 req-8ad6b790-ea02-41bb-8ff4-38567b5dc79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5c8ea0-8c53-4718-b62f-f35835ecb83e", "name": "network-vif-deleted", "tag": "c30b0569-641d-48e2-a378-efe6a00a3231"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:19.091892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c695a035-a7ee-4eeb-848f-3df283498dc1 req-8ad6b790-ea02-41bb-8ff4-38567b5dc79b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:19.092376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c695a035-a7ee-4eeb-848f-3df283498dc1 req-8ad6b790-ea02-41bb-8ff4-38567b5dc79b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:19.092810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c695a035-a7ee-4eeb-848f-3df283498dc1 req-8ad6b790-ea02-41bb-8ff4-38567b5dc79b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:19.104065 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c695a035-a7ee-4eeb-848f-3df283498dc1 req-8ad6b790-ea02-41bb-8ff4-38567b5dc79b service nova] Creating event network-vif-deleted:c30b0569-641d-48e2-a378-efe6a00a3231 for instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e on n-h2-858383-16 Oct 27 09:07:19.108966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c695a035-a7ee-4eeb-848f-3df283498dc1 req-8ad6b790-ea02-41bb-8ff4-38567b5dc79b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030014 Oct 27 09:07:19.109575 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 916/1858] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:19.137625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:19.138337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:19.144544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:19.145122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:19.145621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:19.146372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:19.146905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:19.147422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:19.212914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:19.220734 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-445ee6c0-d3c9-4054-a601-3601bbb97fc3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1183 microversion: 2.1 time: 0.086976 Oct 27 09:07:19.221305 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 943/1859] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:19 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:19.322820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:19.323833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:19.330202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:19.331188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:19.331188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:19.331857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:19.332315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:19.332742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:19.469689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:19.474679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:19.480814 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8dc4a5c-23ad-4b4f-ba8a-89c8a3139027 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.162705 Oct 27 09:07:19.481686 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 917/1860] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:19 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:19.510748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-88580eae-0061-4c3e-8ddc-c06379342df1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa0b1d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:19.549395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-bf62353e-cb3f-442c-abde-eefec7ad9b46 req-11a76c84-620c-46a7-a29e-b04e5f779ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d2ad1-7f91-47f3-b030-de36287cd241", "name": "network-vif-plugged", "status": "completed", "tag": "b23a8df2-1eac-45b9-a02f-702b2776b1cf"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:19.561423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bf62353e-cb3f-442c-abde-eefec7ad9b46 req-11a76c84-620c-46a7-a29e-b04e5f779ea9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:19.561917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bf62353e-cb3f-442c-abde-eefec7ad9b46 req-11a76c84-620c-46a7-a29e-b04e5f779ea9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:19.562546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bf62353e-cb3f-442c-abde-eefec7ad9b46 req-11a76c84-620c-46a7-a29e-b04e5f779ea9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:19.571393 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-88580eae-0061-4c3e-8ddc-c06379342df1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.065236 Oct 27 09:07:19.576262 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-bf62353e-cb3f-442c-abde-eefec7ad9b46 req-11a76c84-620c-46a7-a29e-b04e5f779ea9 service nova] Creating event network-vif-plugged:b23a8df2-1eac-45b9-a02f-702b2776b1cf for instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 on n-h2-858383-16 Oct 27 09:07:19.580062 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 944/1861] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:19 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:19.581253 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-bf62353e-cb3f-442c-abde-eefec7ad9b46 req-11a76c84-620c-46a7-a29e-b04e5f779ea9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035500 Oct 27 09:07:19.581869 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 918/1862] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:07:19.988925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:19.989480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:19.995756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:19.996241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:19.996676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:19.997368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:19.997827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:19.998252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:20.006733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:20.007515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:20.013754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:20.014321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:20.014763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:20.015460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:20.015941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:20.016365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:20.196330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:20.204872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:20.208722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:20.213146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:20.214333 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b80b3337-547f-4c76-a47f-bcff5e093004 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.229634 Oct 27 09:07:20.214908 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 945/1863] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:19 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:20.219454 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-330bc3d2-63b2-4ef0-b92c-4e628b60f77c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1403 microversion: 2.1 time: 0.216895 Oct 27 09:07:20.220060 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 919/1864] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:20 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1403 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:20.224612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:20.225408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:20.232044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:20.232528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:20.232963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:20.233660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:20.234234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:20.234661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:20.244005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:20.244883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:20.250793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:20.251280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:20.251751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:20.252626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:20.253076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:20.253500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:20.317863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:20.327720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:20.329907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:20.337860 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e614bedc-c231-48ea-b798-eccbd2a18e68 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.116746 Oct 27 09:07:20.339097 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 920/1865] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:20 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:20.343336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:20.351923 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a3b6f64-c004-4f28-9199-7caff3154959 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1183 microversion: 2.1 time: 0.112207 Oct 27 09:07:20.352734 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 946/1866] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:20 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:20.504165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:20.504696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:20.512254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:20.512752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:20.513196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:20.513914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:20.514375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:20.514806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:20.586769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ce87869-efb6-4623-b801-af99f9b3f06c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa3e5a60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:20.637227 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9ce87869-efb6-4623-b801-af99f9b3f06c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.054698 Oct 27 09:07:20.638159 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 947/1867] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:20 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:20.657834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:20.665706 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4da85ce5-994d-42fa-930e-77c9c3ec1608 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.165474 Oct 27 09:07:20.666317 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 921/1868] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:20 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:21.239936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:21.240557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:21.245473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:21.246672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:21.247875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.248436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.249088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.249815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.250284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.250715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.253306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.253889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.254398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.255236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.255970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.256740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.464486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:21.468122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:21.477013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5cc5fa6-ee48-4ba2-a2f3-51fcc5799380 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1403 microversion: 2.1 time: 0.235448 Oct 27 09:07:21.477809 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 922/1869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:21 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1403 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:21.483787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:21.485507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:21.488826 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4183b51a-be8b-4f80-a8f9-2263a3d455b8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.252532 Oct 27 09:07:21.489751 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 948/1870] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:21 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:21.495794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:21.496413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:21.501516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:21.502267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:21.513692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.514197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.514641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.515362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.515846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.516282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.520688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.521237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.521665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.522422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.523425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.523886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.616373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:21.624716 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6e8e0727-8253-4b65-b7a0-a7896725dcc9 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 200 len: 1183 microversion: 2.1 time: 0.133859 Oct 27 09:07:21.625512 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 949/1871] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:21 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 1183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:21.630432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-336573c3-554d-4a81-8811-853f5ca10c2e req-22646076-167f-470a-990c-fb28b5ba58ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d645fadc-59fa-44d8-aee6-1b98f0013de3", "name": "network-vif-unplugged", "status": "completed", "tag": "bfbf5e11-af5f-410d-a0c1-a17a8f0be57c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:21.642312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:21.644126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-336573c3-554d-4a81-8811-853f5ca10c2e req-22646076-167f-470a-990c-fb28b5ba58ce service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.644610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-336573c3-554d-4a81-8811-853f5ca10c2e req-22646076-167f-470a-990c-fb28b5ba58ce service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.645045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-336573c3-554d-4a81-8811-853f5ca10c2e req-22646076-167f-470a-990c-fb28b5ba58ce service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.654620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:21.656405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:21.657667 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-336573c3-554d-4a81-8811-853f5ca10c2e req-22646076-167f-470a-990c-fb28b5ba58ce service nova] Creating event network-vif-unplugged:bfbf5e11-af5f-410d-a0c1-a17a8f0be57c for instance d645fadc-59fa-44d8-aee6-1b98f0013de3 on n-h2-858383-16 Oct 27 09:07:21.662279 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7daf2c9-6175-469e-836a-0ddbed0ba515 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.174911 Oct 27 09:07:21.662662 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-336573c3-554d-4a81-8811-853f5ca10c2e req-22646076-167f-470a-990c-fb28b5ba58ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036076 Oct 27 09:07:21.667831 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 923/1872] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:21 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:21.671920 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 950/1873] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:21.673194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-30ecb4df-4d23-4e7e-bfdf-6091c91098d5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5bd940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:21.689836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:21.690537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:21.698187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.698679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.699112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.700231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:21.700899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:21.701193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:21.721708 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-30ecb4df-4d23-4e7e-bfdf-6091c91098d5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.052575 Oct 27 09:07:21.722542 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 924/1874] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:21 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:21.837487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:21.845373 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6cf5ac66-7c97-4ab9-95dc-ded44b0cbb96 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.159775 Oct 27 09:07:21.845953 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 951/1875] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:21 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:22.501699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:22.502453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:22.516063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:22.517034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:22.522511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:22.524353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:22.524804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:22.525615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:22.525989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:22.526741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:22.529154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:22.529921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:22.530847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:22.532066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:22.532832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:22.533759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:23.107961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:23.110225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:23.118149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:23.119590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:23.120772 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a7391c11-9a85-4eb4-b000-1638232552ae tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.609965 Oct 27 09:07:23.121694 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 952/1876] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:22 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:23.126298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:23.126914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8f5c8ea0-8c53-4718-b62f-f35835ecb83e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:23.133584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:23.134070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:23.134512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:23.135212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:23.135696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:23.136121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:23.136911 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a6a493a-a8a2-443a-977a-c7a08fb9a5ac tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1403 microversion: 2.1 time: 0.640203 Oct 27 09:07:23.138309 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 925/1877] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:22 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1403 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:23.143739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:23.144776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:23.152746 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] HTTP exception thrown: Instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e could not be found. Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Request method failure captured: Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e HTTP/1.1 Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkiXHgnCW7xEFGzOObCYmUhBdgutb_PhZcirjZJdbNnC8JehRNikg18BPHyLD1qosxTUIJy_g642v3Wy5bSjkoXvOXPH-6eujK5wS13yI0LBACttzomfm_dctJ3Qp07T7IgD1a_Z19w666WNh11OnZjSP_hmnudqm9R7DeY_xA9PtFU Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 37b756ad383a4cf18b7da7565a51572e Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37b756ad383a4cf18b7da7565a51572e"}]}] Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 37b756ad383a4cf18b7da7565a51572e Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-LiveMigrationTest-1873683874-project Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: aff1721693734cc8937a84d9b8a483dd Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-LiveMigrationTest-1873683874-project Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e could not be found. Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '8f5c8ea0-8c53-4718-b62f-f35835ecb83e'} Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e could not be found. Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e could not be found. Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:07:23.154489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:07:23.160961 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:23.160961 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:07:23.160961 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:07:23.160961 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:07:23.160961 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:07:23.160961 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e could not be found. Oct 27 09:07:23.160961 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:07:23.160961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Returning 404 to user: Instance 8f5c8ea0-8c53-4718-b62f-f35835ecb83e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:07:23.161796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:23.161917 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bbc9c1c3-5012-4bdb-9d9f-b1fef6a24b94 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e" status: 404 len: 111 microversion: 2.1 time: 0.033161 Oct 27 09:07:23.162035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:23.162179 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 953/1878] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:23 2022] GET /compute/v2.1/servers/8f5c8ea0-8c53-4718-b62f-f35835ecb83e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:07:23.162270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:23.162270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:23.162270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:23.162270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:23.163085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-abae0252-40a9-46b4-8818-37d105617380 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa2a31f0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:23.217705 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-abae0252-40a9-46b4-8818-37d105617380 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.055972 Oct 27 09:07:23.227263 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 954/1879] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:23 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:23.227263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:23.227263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:23.241659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:23.242520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:23.243192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:23.244166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:23.244815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:23.245603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:23.247800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:23.258772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:23.260284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:23.266210 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd482a94-7140-420b-b1ed-3705a6835379 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.126557 Oct 27 09:07:23.267162 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 926/1880] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:23 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:23.436880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:23.447158 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3760be7-0858-4236-beae-499bad6c3534 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.226647 Oct 27 09:07:23.459602 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 955/1881] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:23 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:24.151739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:24.153105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:24.161607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:24.162325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:24.165773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.167179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.167939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.169441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.171105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.172496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.181321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.181321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.182243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.183355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.183944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.184454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.187792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:24.427864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:24.439921 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a638518-c562-4fc2-915c-33a2da068479 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1590 microversion: 2.1 time: 0.282055 Oct 27 09:07:24.441091 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 956/1882] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:24 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1590 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:24.448786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc9b977e-dbb5-4a40-a8f5-b759ca252bac tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa3445e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:24.455862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:24.468254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:24.469461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:24.470602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d9ec3e3b-8b4b-4cb1-b7db-ed32f93d63a2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.327425 Oct 27 09:07:24.472584 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 927/1883] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:24 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:24.477837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:24.478946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:24.486866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.487774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.488419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.489322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.490121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.490819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.533023 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc9b977e-dbb5-4a40-a8f5-b759ca252bac tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.088835 Oct 27 09:07:24.540766 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 957/1884] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:24 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:24.545975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-202e3bdb-3a83-42f9-9911-008a02f9e0a7 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:24.546601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-202e3bdb-3a83-42f9-9911-008a02f9e0a7 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:24.553755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-202e3bdb-3a83-42f9-9911-008a02f9e0a7 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.554377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-202e3bdb-3a83-42f9-9911-008a02f9e0a7 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.554921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-202e3bdb-3a83-42f9-9911-008a02f9e0a7 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.555925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-202e3bdb-3a83-42f9-9911-008a02f9e0a7 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.556548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-202e3bdb-3a83-42f9-9911-008a02f9e0a7 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.557082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-202e3bdb-3a83-42f9-9911-008a02f9e0a7 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.566826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:24.576614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:24.578083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:24.584104 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8efe5bfe-6bf0-4986-bc20-3918cd889bc8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.110215 Oct 27 09:07:24.584990 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 928/1885] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:24 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:24.589688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:24.590300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:24.596837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.597574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.598186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.599104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:24.599759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:24.600354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:24.753190 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-202e3bdb-3a83-42f9-9911-008a02f9e0a7 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211083 Oct 27 09:07:24.753811 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 958/1886] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:07:24 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:24.824930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:24.836393 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b252f5a3-85d4-42cd-a33a-956759763a93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.250163 Oct 27 09:07:24.837003 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 929/1887] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:24 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:25.503983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:25.505118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:25.513364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:25.514613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:25.515407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:25.516403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:25.517121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:25.517939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:25.551284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-711c16db-2658-4c28-b683-12d24977d837 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae587280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:25.639180 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-711c16db-2658-4c28-b683-12d24977d837 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.092535 Oct 27 09:07:25.639733 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 930/1888] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:25 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:25.652770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:25.653297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:25.673256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:25.673759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:25.674199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:25.674928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:25.675385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:25.675836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:25.915182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:25.929648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:25.931199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:25.948023 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc0b0635-dd69-49b3-b2fc-ad8ab59f1a0e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.307230 Oct 27 09:07:25.952364 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 931/1889] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:25 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:25.961206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:25.962890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:25.970185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:25.978468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:25.981853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:25.982757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:25.985055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:25.985964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:25.992895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:25.994561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:26.011072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:26.012347 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f68c3064-5e7e-4901-8e40-23c732fd744a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.512853 Oct 27 09:07:26.012951 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 959/1890] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:25 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:26.033601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-98013565-5eae-45b6-932b-147b3e192001 req-f5f4fa4a-f3b6-4836-814a-aada41417c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed9f097-736e-467b-805c-1813e5c70ea3", "name": "network-vif-plugged", "status": "completed", "tag": "4f4178c9-6e2b-461c-891f-79017ab0aabc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:26.067611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-98013565-5eae-45b6-932b-147b3e192001 req-f5f4fa4a-f3b6-4836-814a-aada41417c69 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:26.068033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-98013565-5eae-45b6-932b-147b3e192001 req-f5f4fa4a-f3b6-4836-814a-aada41417c69 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:26.073725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-98013565-5eae-45b6-932b-147b3e192001 req-f5f4fa4a-f3b6-4836-814a-aada41417c69 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:26.109790 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-98013565-5eae-45b6-932b-147b3e192001 req-f5f4fa4a-f3b6-4836-814a-aada41417c69 service nova] Creating event network-vif-plugged:4f4178c9-6e2b-461c-891f-79017ab0aabc for instance bed9f097-736e-467b-805c-1813e5c70ea3 on n-h2-858383-16 Oct 27 09:07:26.118133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-98013565-5eae-45b6-932b-147b3e192001 req-f5f4fa4a-f3b6-4836-814a-aada41417c69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091875 Oct 27 09:07:26.118791 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 960/1891] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:26.137168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:26.138256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:26.155152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:26.156424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:26.156944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:26.158016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:26.158615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:26.158744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:26.530168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:26.539185 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b96eff1-fb6e-4465-94d0-67b7485aa056 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.585434 Oct 27 09:07:26.540278 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 932/1892] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:25 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:26.545342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6df1b954-c655-4b86-b649-ce20a247df3a req-fdb0c45d-5899-4bfe-970d-f60f91851f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1d2ad1-7f91-47f3-b030-de36287cd241", "tag": "b23a8df2-1eac-45b9-a02f-702b2776b1cf"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:26.563998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6df1b954-c655-4b86-b649-ce20a247df3a req-fdb0c45d-5899-4bfe-970d-f60f91851f6c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:26.564700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6df1b954-c655-4b86-b649-ce20a247df3a req-fdb0c45d-5899-4bfe-970d-f60f91851f6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:26.564945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6df1b954-c655-4b86-b649-ce20a247df3a req-fdb0c45d-5899-4bfe-970d-f60f91851f6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:26.613046 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6df1b954-c655-4b86-b649-ce20a247df3a req-fdb0c45d-5899-4bfe-970d-f60f91851f6c service nova] Creating event network-changed:b23a8df2-1eac-45b9-a02f-702b2776b1cf for instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 on n-h2-858383-16 Oct 27 09:07:26.622430 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6df1b954-c655-4b86-b649-ce20a247df3a req-fdb0c45d-5899-4bfe-970d-f60f91851f6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080874 Oct 27 09:07:26.623134 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 933/1893] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:26.655220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c7439af-9adf-485c-9099-ff9ade5ba5fa tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5c8a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:26.671345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:26.681389 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31b3508d-c198-4720-8bd2-e69290f56a90 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1590 microversion: 2.1 time: 0.558008 Oct 27 09:07:26.689298 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 961/1894] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:26 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1590 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:26.737206 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c7439af-9adf-485c-9099-ff9ade5ba5fa tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.086103 Oct 27 09:07:26.743539 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 934/1895] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:26 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:26.977912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:26.978918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:26.987223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:26.988075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:26.988880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:26.989829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:26.990487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:26.991737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:27.040697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:27.041442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:27.050201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:27.064423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:27.065211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:27.066173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:27.066813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:27.067437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:27.171135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:27.190449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:27.192912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:27.201642 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1a09c9b-44db-4855-9992-6369bb28a588 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.227919 Oct 27 09:07:27.203660 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 962/1896] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:26 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:27.310083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:27.318682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:27.320899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:27.322008 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83c4e364-7193-4b92-be94-1b0d8adbee5a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.285929 Oct 27 09:07:27.327815 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 935/1897] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:27 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:27.565749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:27.566459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:27.574424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:27.575011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:27.575524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:27.576256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:27.576710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:27.577159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:27.620920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:27.621511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:27.631944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:27.632450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:27.632898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:27.633616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:27.634076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:27.634506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:27.662000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:07:27.740215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:27.767525 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-12669fef-afcd-4fb3-bec3-09492456f755 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1314 microversion: 2.1 time: 0.207138 Oct 27 09:07:27.773223 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 963/1898] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:27 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:27.785508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7b6095d9-66f0-4334-a197-b5991dc6ea4b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa054ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:27.809956 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5b4176c-32cc-43f5-8feb-c3c378d7fe02 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "DELETE /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 204 len: 0 microversion: 2.1 time: 0.192456 Oct 27 09:07:27.814111 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 936/1899] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:07:27 2022] DELETE /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:07:27.820818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:27.821770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:27.829168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:27.829931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:27.830578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:27.831510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:27.832251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:27.832881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:27.862110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:27.881666 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7b6095d9-66f0-4334-a197-b5991dc6ea4b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.105260 Oct 27 09:07:27.883318 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 964/1900] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:27 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:28.071937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:28.080770 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95ca9f05-928e-47dd-a6b2-c4c4aabca852 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1668 microversion: 2.1 time: 0.264746 Oct 27 09:07:28.081626 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 937/1901] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:27 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1668 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:28.143461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b76f52ff-ec46-4b08-ba6b-97dc18f5196a req-69416ba5-9083-458d-8a37-ba1db58c54ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4098cc-19c7-4dc0-b5af-55f92720b32f", "name": "network-vif-plugged", "status": "completed", "tag": "f5de6da6-f70a-45de-9d70-2166b991303b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:28.186820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b76f52ff-ec46-4b08-ba6b-97dc18f5196a req-69416ba5-9083-458d-8a37-ba1db58c54ed service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:28.187429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b76f52ff-ec46-4b08-ba6b-97dc18f5196a req-69416ba5-9083-458d-8a37-ba1db58c54ed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:28.187996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b76f52ff-ec46-4b08-ba6b-97dc18f5196a req-69416ba5-9083-458d-8a37-ba1db58c54ed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:28.201801 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b76f52ff-ec46-4b08-ba6b-97dc18f5196a req-69416ba5-9083-458d-8a37-ba1db58c54ed service nova] Creating event network-vif-plugged:f5de6da6-f70a-45de-9d70-2166b991303b for instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f on n-h1-858383-16 Oct 27 09:07:28.213493 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b76f52ff-ec46-4b08-ba6b-97dc18f5196a req-69416ba5-9083-458d-8a37-ba1db58c54ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074249 Oct 27 09:07:28.214496 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 965/1902] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:28.235830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:28.236602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:28.243546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:28.246029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:28.246948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:28.248356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:28.250049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:28.250806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:28.251430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:28.347002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:28.348280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:28.349107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:28.372015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:28.373375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:28.373778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:28.374484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:28.376684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:28.377624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:28.378342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:28.379073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:28.388596 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6317ee29-0ec0-4d41-a00f-9a61e537ccf1 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.156706 Oct 27 09:07:28.389279 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 938/1903] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:28 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:28.587135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:28.596051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:28.597505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:28.598627 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1d6bc7a6-c69b-4ed4-8684-341deb129f45 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.254935 Oct 27 09:07:28.599188 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 966/1904] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:28 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:28.795763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:28.796419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:28.804078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:28.804593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:28.805029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:28.805734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:28.806188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:28.806630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:28.898054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-939db37b-b4da-41c1-ae59-a976704e518c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9fff160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:28.942748 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-939db37b-b4da-41c1-ae59-a976704e518c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.048636 Oct 27 09:07:28.943324 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 967/1905] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:28 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:28.948866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:28.957737 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d96bb38-6cd3-43f8-ae1f-b48532a12309 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1464 microversion: 2.1 time: 0.165991 Oct 27 09:07:28.958342 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 939/1906] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:28 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:29.105588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:29.106599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:29.112713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.113200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.113631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.114510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.114968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.115388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.140971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-078efe2d-691c-4aae-9cd4-f45cadca5471 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:29.146453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-078efe2d-691c-4aae-9cd4-f45cadca5471 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Searching by: {'deleted': False, 'project_id': 'ffd2b27140134cc7a76286a192e3167d'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:07:29.153751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-078efe2d-691c-4aae-9cd4-f45cadca5471 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.154319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-078efe2d-691c-4aae-9cd4-f45cadca5471 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.154961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-078efe2d-691c-4aae-9cd4-f45cadca5471 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.155786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-078efe2d-691c-4aae-9cd4-f45cadca5471 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.156304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-078efe2d-691c-4aae-9cd4-f45cadca5471 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.159318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-078efe2d-691c-4aae-9cd4-f45cadca5471 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.253755 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-078efe2d-691c-4aae-9cd4-f45cadca5471 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.276445 Oct 27 09:07:29.263602 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 968/1907] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:07:28 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:07:29.283131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:29.283900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:29.292089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Searching by: {'deleted': False} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:07:29.294011 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77eb9fc4-d58f-41be-afeb-463d41e11c57 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1668 microversion: 2.1 time: 0.192190 Oct 27 09:07:29.295072 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 940/1908] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:29 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1668 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:29.297319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.298131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.298588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.299344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.299843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.300285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.417292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:29.418303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:29.424735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.425230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.425678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.426517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.426906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Listed batch of 16 results from cell out of 1000 limit. Returned 16 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:07:29.427248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.427695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.500466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:29.509599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:29.513473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:29.515376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.516084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.516714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.521822 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3756d61c-05e1-46c8-8797-82764c076db5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1560 microversion: 2.91 time: 0.109274 Oct 27 09:07:29.532955 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 941/1909] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:29 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1560 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:29.556594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c0fde82c-2d89-45e5-b53c-9d57951ddec8 req-d3ab9cc1-cfce-4a61-8dd9-78e626f04af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b64fc7-dd59-4a29-b395-8f8e8990cabb", "name": "network-vif-deleted", "tag": "bbc5a442-ff28-4a74-95b8-7e5a6187b536"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:29.566940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c0fde82c-2d89-45e5-b53c-9d57951ddec8 req-d3ab9cc1-cfce-4a61-8dd9-78e626f04af4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.567453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c0fde82c-2d89-45e5-b53c-9d57951ddec8 req-d3ab9cc1-cfce-4a61-8dd9-78e626f04af4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.567926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c0fde82c-2d89-45e5-b53c-9d57951ddec8 req-d3ab9cc1-cfce-4a61-8dd9-78e626f04af4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.582936 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c0fde82c-2d89-45e5-b53c-9d57951ddec8 req-d3ab9cc1-cfce-4a61-8dd9-78e626f04af4 service nova] Creating event network-vif-deleted:bbc5a442-ff28-4a74-95b8-7e5a6187b536 for instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb on n-h1-858383-16 Oct 27 09:07:29.590110 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c0fde82c-2d89-45e5-b53c-9d57951ddec8 req-d3ab9cc1-cfce-4a61-8dd9-78e626f04af4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037032 Oct 27 09:07:29.591511 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 942/1910] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:07:29.626705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:29.627582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:29.634908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.635092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.635403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.636148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:29.636610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:29.637497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:29.829108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:29.841879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:29.848762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:29.852317 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8aa34962-8aac-4710-a352-985291d58c4f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1280 microversion: 2.25 time: 0.229449 Oct 27 09:07:29.867625 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 943/1911] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:29 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1280 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:29.958878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8234d74f-2155-45c4-86dc-fdfcff5a0ab6 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5c3af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:30.006335 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-63cdfe80-6bf1-4028-b563-33de920bd44e tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 27662 microversion: 2.1 time: 0.727305 Oct 27 09:07:30.017360 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8234d74f-2155-45c4-86dc-fdfcff5a0ab6 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.062671 Oct 27 09:07:30.026242 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 944/1912] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:29 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:30.026453 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 969/1913] 10.222.0.25 () {58 vars in 1171 bytes} [Thu Oct 27 09:07:29 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 27662 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:07:30.058295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42bda7bd-decb-4fc4-96a6-cb4c34c43d15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:30.063726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42bda7bd-decb-4fc4-96a6-cb4c34c43d15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Searching by: {'deleted': False, 'project_id': 'ffd2b27140134cc7a76286a192e3167d'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:07:30.071764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bda7bd-decb-4fc4-96a6-cb4c34c43d15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.072260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bda7bd-decb-4fc4-96a6-cb4c34c43d15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.072698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bda7bd-decb-4fc4-96a6-cb4c34c43d15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.073669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bda7bd-decb-4fc4-96a6-cb4c34c43d15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.074160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bda7bd-decb-4fc4-96a6-cb4c34c43d15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.074592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bda7bd-decb-4fc4-96a6-cb4c34c43d15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.110673 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42bda7bd-decb-4fc4-96a6-cb4c34c43d15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=4d54fc3cc5ef488c9409163954878ca7" status: 200 len: 15 microversion: 2.1 time: 0.056345 Oct 27 09:07:30.127470 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 945/1914] 10.222.0.25 () {58 vars in 1231 bytes} [Thu Oct 27 09:07:30 2022] GET /compute/v2.1/servers/detail?tenant_id=4d54fc3cc5ef488c9409163954878ca7 => generated 15 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:07:30.134919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:30.141757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Searching by: {'tenant_id': '4d54fc3cc5ef488c9409163954878ca7', 'deleted': False} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:07:30.147703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.148169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.148596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.149346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.149788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.150209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.182749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:07:30.234356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f5406ecb-255e-42bc-a666-9c3a1905d213 req-7482dbd6-d6d1-49ed-af95-1cc8d14b53f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f46edbb-82a0-4749-a443-02e5ca52e341", "name": "network-vif-plugged", "status": "completed", "tag": "4f73cce5-2a06-488c-8855-f44a51f4779a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:30.244857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f5406ecb-255e-42bc-a666-9c3a1905d213 req-7482dbd6-d6d1-49ed-af95-1cc8d14b53f1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.245337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f5406ecb-255e-42bc-a666-9c3a1905d213 req-7482dbd6-d6d1-49ed-af95-1cc8d14b53f1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.246239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f5406ecb-255e-42bc-a666-9c3a1905d213 req-7482dbd6-d6d1-49ed-af95-1cc8d14b53f1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.264579 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f5406ecb-255e-42bc-a666-9c3a1905d213 req-7482dbd6-d6d1-49ed-af95-1cc8d14b53f1 service nova] Creating event network-vif-plugged:4f73cce5-2a06-488c-8855-f44a51f4779a for instance 1f46edbb-82a0-4749-a443-02e5ca52e341 on n-h1-858383-16 Oct 27 09:07:30.270219 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f5406ecb-255e-42bc-a666-9c3a1905d213 req-7482dbd6-d6d1-49ed-af95-1cc8d14b53f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041044 Oct 27 09:07:30.271673 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 946/1915] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:30.288514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.288992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.289420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.332304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:30.333208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:30.349806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.351065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.351732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.352606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.353284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.353875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.401746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.402388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.402951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.403495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lazy-loading 'fault' on Instance uuid 45b64fc7-dd59-4a29-b395-8f8e8990cabb {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:07:30.466433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:30.476539 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c266f6d8-1f51-4b3d-9dd9-166c130bbf4d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 200 len: 1324 microversion: 2.1 time: 0.154441 Oct 27 09:07:30.476779 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d8d8d4a1-f854-4745-9209-b16284a91238 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4d54fc3cc5ef488c9409163954878ca7" status: 200 len: 4833 microversion: 2.1 time: 0.345635 Oct 27 09:07:30.491971 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 970/1916] 10.222.0.25 () {58 vars in 1257 bytes} [Thu Oct 27 09:07:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4d54fc3cc5ef488c9409163954878ca7 => generated 4833 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:30.500671 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 947/1917] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:30 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 1324 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:30.503900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-889e48e3-851b-4909-8b0c-5af59a2136d4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:30.510509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-889e48e3-851b-4909-8b0c-5af59a2136d4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Searching by: {'tenant_id': 'ffd2b27140134cc7a76286a192e3167d', 'deleted': False} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:07:30.515366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889e48e3-851b-4909-8b0c-5af59a2136d4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.516111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889e48e3-851b-4909-8b0c-5af59a2136d4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.516539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889e48e3-851b-4909-8b0c-5af59a2136d4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.517252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889e48e3-851b-4909-8b0c-5af59a2136d4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.517702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889e48e3-851b-4909-8b0c-5af59a2136d4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.518172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889e48e3-851b-4909-8b0c-5af59a2136d4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.549973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:30.554336 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-889e48e3-851b-4909-8b0c-5af59a2136d4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ffd2b27140134cc7a76286a192e3167d" status: 200 len: 15 microversion: 2.1 time: 0.054194 Oct 27 09:07:30.557099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:30.560325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:30.569042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.571774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.572619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.573851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.574690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.576101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.581360 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 971/1918] 10.222.0.25 () {58 vars in 1257 bytes} [Thu Oct 27 09:07:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ffd2b27140134cc7a76286a192e3167d => generated 15 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:07:30.597774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-388255ec-0be0-429e-adfa-3e1e6c652f15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:30.603696 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-388255ec-0be0-429e-adfa-3e1e6c652f15 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.020818 Oct 27 09:07:30.616724 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 972/1919] 10.222.0.25 () {58 vars in 1189 bytes} [Thu Oct 27 09:07:30 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:07:30.630112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-889c96af-f21b-4211-ac86-68f5246d0c13 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:30.632635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-889c96af-f21b-4211-ac86-68f5246d0c13 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:30.640378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889c96af-f21b-4211-ac86-68f5246d0c13 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.641227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889c96af-f21b-4211-ac86-68f5246d0c13 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.641680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889c96af-f21b-4211-ac86-68f5246d0c13 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.642364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889c96af-f21b-4211-ac86-68f5246d0c13 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.643092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889c96af-f21b-4211-ac86-68f5246d0c13 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.643524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-889c96af-f21b-4211-ac86-68f5246d0c13 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.698653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:30.717925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:30.719254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:30.726363 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ee1338b-a8d7-4504-b173-1969014fc42c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1560 microversion: 2.91 time: 0.177748 Oct 27 09:07:30.740857 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 948/1920] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:30 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:30.767025 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-889c96af-f21b-4211-ac86-68f5246d0c13 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action" status: 202 len: 0 microversion: 2.1 time: 0.141051 Oct 27 09:07:30.767882 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 973/1921] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:07:30 2022] POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:07:30.779684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:30.785148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:30.796196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '4d54fc3cc5ef488c9409163954878ca7'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:07:30.805150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.806106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.806757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.808468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.809127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.809730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.888957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:30.894405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:30.903846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:07:30.905778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.906294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.907365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.908091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:30.910005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:30.910454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:30.971164 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e883db3b-65be-4b32-a4f3-97791c8df61b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.198694 Oct 27 09:07:30.973890 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 949/1922] 10.222.0.25 () {58 vars in 1150 bytes} [Thu Oct 27 09:07:30 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:07:30.987736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4b25fce-2b7a-4bf6-a0ee-280b27dd25c4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:30.990938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a4b25fce-2b7a-4bf6-a0ee-280b27dd25c4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:30.999773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4b25fce-2b7a-4bf6-a0ee-280b27dd25c4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.000336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4b25fce-2b7a-4bf6-a0ee-280b27dd25c4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.001703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4b25fce-2b7a-4bf6-a0ee-280b27dd25c4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.002231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4b25fce-2b7a-4bf6-a0ee-280b27dd25c4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.002769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4b25fce-2b7a-4bf6-a0ee-280b27dd25c4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.003273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4b25fce-2b7a-4bf6-a0ee-280b27dd25c4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.139899 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4b25fce-2b7a-4bf6-a0ee-280b27dd25c4 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action" status: 202 len: 0 microversion: 2.1 time: 0.157492 Oct 27 09:07:31.140608 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 950/1923] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:07:30 2022] POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:07:31.146631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f90adc69-17ed-49d4-a422-a53d34fb0762 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5f6ee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:31.178792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:31.193683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:31.195470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:31.201058 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28f321ba-427f-4d04-b9b1-6b406fda0c36 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1476 microversion: 2.25 time: 0.323722 Oct 27 09:07:31.204145 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f90adc69-17ed-49d4-a422-a53d34fb0762 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.062058 Oct 27 09:07:31.212956 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 951/1924] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:31 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:31.217949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab494298-c9c7-429a-ae19-4ef76b623170 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:31.218566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab494298-c9c7-429a-ae19-4ef76b623170 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:31.224116 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 974/1925] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:30 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:31.225054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab494298-c9c7-429a-ae19-4ef76b623170 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.226970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab494298-c9c7-429a-ae19-4ef76b623170 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.227625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab494298-c9c7-429a-ae19-4ef76b623170 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.228569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab494298-c9c7-429a-ae19-4ef76b623170 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.229207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab494298-c9c7-429a-ae19-4ef76b623170 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.229973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab494298-c9c7-429a-ae19-4ef76b623170 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.406124 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab494298-c9c7-429a-ae19-4ef76b623170 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1617 microversion: 2.1 time: 0.191795 Oct 27 09:07:31.407023 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 952/1926] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:31 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1617 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:31.417923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:31.419412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:31.428762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.429553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.430170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.430562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2221f463-50f2-49d9-82b4-ab1a5bc2e23f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:31.431347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2221f463-50f2-49d9-82b4-ab1a5bc2e23f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:31.431756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.432429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.433097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.440682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2221f463-50f2-49d9-82b4-ab1a5bc2e23f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.441970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2221f463-50f2-49d9-82b4-ab1a5bc2e23f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.442509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2221f463-50f2-49d9-82b4-ab1a5bc2e23f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.443405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2221f463-50f2-49d9-82b4-ab1a5bc2e23f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.444417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2221f463-50f2-49d9-82b4-ab1a5bc2e23f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.445035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2221f463-50f2-49d9-82b4-ab1a5bc2e23f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.717879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 8a4098cc-19c7-4dc0-b5af-55f92720b32f {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:07:31.720716 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2221f463-50f2-49d9-82b4-ab1a5bc2e23f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1617 microversion: 2.1 time: 0.294156 Oct 27 09:07:31.721331 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 953/1927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:31 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1617 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:31.727467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:31.728106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 45b64fc7-dd59-4a29-b395-8f8e8990cabb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:31.738392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.738891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.739327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.741807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.742292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.742934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.758366 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a203dc61-4c76-499a-99e0-f496baaf67a7 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1970 microversion: 2.25 time: 0.526487 Oct 27 09:07:31.759597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 975/1928] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:31 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1970 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:31.771277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] HTTP exception thrown: Instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb could not be found. Oct 27 09:07:31.779292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Request method failure captured: Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb HTTP/1.1 Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiXHgnCW7xEFGzOObCYmUhBdgutb_PhZcirjZJdbNnC8JehRNikg18BPHyLD1qosxTUIJy_g642v3Wy5bSjkoXvOXPH-6eujK5wS13yI0LBACttzomfm_dctJ3Qp07T7IgD1a_Z19w666WNh11OnZjSP_hmnudqm9R7DeY_xA9PtFU Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 37b756ad383a4cf18b7da7565a51572e Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37b756ad383a4cf18b7da7565a51572e"}]}] Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 37b756ad383a4cf18b7da7565a51572e Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-LiveMigrationTest-1873683874-project Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: aff1721693734cc8937a84d9b8a483dd Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-LiveMigrationTest-1873683874-project Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb could not be found. Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '45b64fc7-dd59-4a29-b395-8f8e8990cabb'} Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb could not be found. Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb could not be found. Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:07:31.781377 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:31.787426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:31.787426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:07:31.787426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:07:31.787426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:07:31.787426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:07:31.787426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb could not be found. Oct 27 09:07:31.787426 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:31.787426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Returning 404 to user: Instance 45b64fc7-dd59-4a29-b395-8f8e8990cabb could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:07:31.787426 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b2bf639-3c77-404d-9cef-7996c65c14c1 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb" status: 404 len: 111 microversion: 2.1 time: 0.063570 Oct 27 09:07:31.789101 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 954/1929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:31 2022] GET /compute/v2.1/servers/45b64fc7-dd59-4a29-b395-8f8e8990cabb => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:07:31.791825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Searching by: {'host': 'n-h2-858383-16', 'deleted': False} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:07:31.793265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:31.793905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:31.798166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.798745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.799411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.800054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.801006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.801191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.801769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.802624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.803874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.804107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.805110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.820263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.937086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:31.950583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:31.952736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:31.954043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:07:31.958547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:31.958877 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5818f23-46f0-456f-b95e-e3da07dcefc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1560 microversion: 2.91 time: 0.169423 Oct 27 09:07:31.959501 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 955/1930] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:31 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:31.964691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:31.965326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:31.972516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.973000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.973435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.974125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:31.974824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:31.975605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:31.994975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:32.030233 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2719510b-4b58-42a2-bbbf-a7a644a7e7e8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h2-858383-16&all_tenants=1" status: 200 len: 2637 microversion: 2.1 time: 0.265903 Oct 27 09:07:32.031778 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 976/1931] 10.222.0.25 () {58 vars in 1192 bytes} [Thu Oct 27 09:07:31 2022] GET /compute/v2.1/servers?host=n-h2-858383-16&all_tenants=1 => generated 2637 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:32.037709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27e70cae-8749-4cbf-9520-e606e07dc27d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '.version_select at 0x7f31a9fff040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:32.066421 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27e70cae-8749-4cbf-9520-e606e07dc27d tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-372968228" status: 202 len: 0 microversion: 2.1 time: 0.031796 Oct 27 09:07:32.067209 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 977/1932] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:07:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-372968228 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:07:32.079391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d060f1fb-a663-4351-9483-d7de7a56f34d tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:32.095135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d060f1fb-a663-4351-9483-d7de7a56f34d tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:07:32.103404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d060f1fb-a663-4351-9483-d7de7a56f34d tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.104960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d060f1fb-a663-4351-9483-d7de7a56f34d tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.105610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d060f1fb-a663-4351-9483-d7de7a56f34d tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.106930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d060f1fb-a663-4351-9483-d7de7a56f34d tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.107681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d060f1fb-a663-4351-9483-d7de7a56f34d tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.108869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d060f1fb-a663-4351-9483-d7de7a56f34d tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.173346 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d060f1fb-a663-4351-9483-d7de7a56f34d tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.104016 Oct 27 09:07:32.175993 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 978/1933] 10.222.0.25 () {58 vars in 1196 bytes} [Thu Oct 27 09:07:32 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:07:32.190631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc1379d5-4495-433f-a3da-d9a07ee455a8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:32.194982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc1379d5-4495-433f-a3da-d9a07ee455a8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:32.203727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1379d5-4495-433f-a3da-d9a07ee455a8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.204741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1379d5-4495-433f-a3da-d9a07ee455a8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.205599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1379d5-4495-433f-a3da-d9a07ee455a8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.206924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1379d5-4495-433f-a3da-d9a07ee455a8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.207549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1379d5-4495-433f-a3da-d9a07ee455a8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.208187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc1379d5-4495-433f-a3da-d9a07ee455a8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.243646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 8a4098cc-19c7-4dc0-b5af-55f92720b32f {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:07:32.275352 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c8a78db-39ed-4c0d-b1bc-4aeb180b996b tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1970 microversion: 2.25 time: 0.313203 Oct 27 09:07:32.277041 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 956/1934] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:31 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1970 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:32.289135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-877cd8a7-0a00-4428-af4d-5910e39c93f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31aa71e3a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:32.373205 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-877cd8a7-0a00-4428-af4d-5910e39c93f8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.094779 Oct 27 09:07:32.373815 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 957/1935] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:32 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:32.392640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d464ff0-1223-4c0f-bb0b-b68ec66465d6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:32.404157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d464ff0-1223-4c0f-bb0b-b68ec66465d6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.404649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d464ff0-1223-4c0f-bb0b-b68ec66465d6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.407947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d464ff0-1223-4c0f-bb0b-b68ec66465d6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.409037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d464ff0-1223-4c0f-bb0b-b68ec66465d6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.409807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d464ff0-1223-4c0f-bb0b-b68ec66465d6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.410449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d464ff0-1223-4c0f-bb0b-b68ec66465d6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.413147 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc1379d5-4495-433f-a3da-d9a07ee455a8 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action" status: 202 len: 0 microversion: 2.1 time: 0.226861 Oct 27 09:07:32.417965 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 979/1936] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:07:32 2022] POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:07:32.443160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:32.451249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:32.468442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.468936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.469371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.470087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.470525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.470942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.498498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d464ff0-1223-4c0f-bb0b-b68ec66465d6 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.109706 Oct 27 09:07:32.500271 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 958/1937] 10.222.0.25 () {60 vars in 1217 bytes} [Thu Oct 27 09:07:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:07:32.518429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-16", "block_migration": "auto"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:32.524533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:32.531839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.532578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.533191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.534063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.534719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.535332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.573300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:07:32.573989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:07:32.574646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:07:32.575229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:07:32.575829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:07:32.589736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'flavor' on Instance uuid 8a4098cc-19c7-4dc0-b5af-55f92720b32f {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:07:32.608513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Going to try to live migrate instance to n-h2-858383-16 {{(pid=120603) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:07:32.678481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:32.688327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.696319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.696875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.698797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.699279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.700498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.803300 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5dc49f6-fd6b-4a62-8dc6-df6b83fac0e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action" status: 202 len: 1068 microversion: 2.1 time: 0.382420 Oct 27 09:07:32.808185 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 980/1938] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:07:32 2022] POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action => generated 1068 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 09:07:32.825062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:32.825907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:32.841886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.842485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.846009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:32.848636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:32.849910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:32.850400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:33.211734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:33.224118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7bff8a2e-d3d7-48de-8a5a-931edc919c9b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1472 microversion: 2.1 time: 0.402906 Oct 27 09:07:33.225835 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 981/1939] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:32 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:33.258039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:33.269724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:33.286022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:33.287723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:33.291094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:33.292423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:33.293382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:33.295498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:33.440959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:33.453359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:33.454944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:33.464011 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4b580a70-b260-4602-bcf6-41ff6a7d682b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1560 microversion: 2.91 time: 0.236373 Oct 27 09:07:33.476428 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 982/1940] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:33 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1560 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:33.495993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ec0f4be-2703-4311-89c1-ca45624f69ef tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9dc0af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:33.555262 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ec0f4be-2703-4311-89c1-ca45624f69ef tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1454 microversion: 2.1 time: 0.077120 Oct 27 09:07:33.556540 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 983/1941] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:33 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:33.569666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:33.570173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:33.580104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:33.580926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:33.581536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:33.582446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:33.583096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:33.583523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:33.617962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:07:33.726910 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a4aa628-efdb-45aa-80a4-483f77549348 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "DELETE /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 204 len: 0 microversion: 2.1 time: 0.168410 Oct 27 09:07:33.731056 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 984/1942] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:07:33 2022] DELETE /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:07:33.749254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:33.750257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:33.756754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:33.757326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:33.757838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:33.758611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:33.759143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:33.759666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:33.909077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:33.929171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6179b8ee-c03b-446d-971d-1d67200cb916 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1485 microversion: 2.1 time: 0.184309 Oct 27 09:07:33.929972 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 985/1943] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:33 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1485 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:34.249383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:34.250782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:34.261371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:34.261859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:34.262292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:34.262991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:34.263504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:34.264660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:34.613238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:34.629495 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fedb78ef-ab57-48ce-a969-966bdb6cf9dd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1472 microversion: 2.1 time: 0.383425 Oct 27 09:07:34.635792 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 986/1944] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:34 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:34.643536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:34.645043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:34.674222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:34.674558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:34.675013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:34.679018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:34.679541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:34.680020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:34.846093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:34.859429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:34.868234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:34.874274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ebe0ef0d-fac7-4e9d-b719-cf570dfac40c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.241510 Oct 27 09:07:34.874856 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 987/1945] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:34 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:34.887542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e0a5ef05-864c-4a89-b656-e7fe9ab33b8c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9dc00d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:35.241360 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46263645-9c5c-483b-8417-00dca5aeb109 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f/action" status: 202 len: 0 microversion: 2.25 time: 2.729527 Oct 27 09:07:35.242396 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 959/1946] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:07:32 2022] POST /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f/action => generated 0 bytes in 2732 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:07:35.251623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:35.254305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:35.279454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:35.280126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:35.280964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:35.282723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:35.284706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:35.285800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:35.834696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:35.846792 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-768fe3fc-6dd6-46e6-b02d-12a409dcd238 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1485 microversion: 2.1 time: 0.601225 Oct 27 09:07:35.849697 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 960/1947] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:35 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1485 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:35.859927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:35.863033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:35.879207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:35.884843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:35.886312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:35.887285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:35.890415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:35.895431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:36.494475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:36.512422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:36.521383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:36.526714 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a677b2e-c09b-4cfb-b670-d4372e79bea2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.674899 Oct 27 09:07:36.530986 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 961/1948] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:35 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:36.543181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:36.554325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:36.590605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:36.591241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:36.594057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:36.595078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:36.598670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:36.601824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:37.398782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:37.411013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bf47476-86c2-4235-b8a7-b57878d8ba02 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1472 microversion: 2.1 time: 0.878556 Oct 27 09:07:37.418583 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 962/1949] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:36 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1472 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:37.430007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:37.433212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:37.492834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:37.493331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:37.493765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:37.497704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:37.500201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:37.503325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:37.642843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:37.663940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:37.670652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:37.682280 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0f46da2-ddb1-49a6-8957-5e9152238fbc tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.261606 Oct 27 09:07:37.716996 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 963/1950] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:37 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:37.735549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fe46b667-b18d-4b9c-9102-c2f42328a9f0 req-527c115e-ece2-40b4-b0f3-0f791e777eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224cd91a-b045-40e1-a226-451983e44fa5", "name": "network-vif-deleted", "tag": "c5ae8671-fffc-4a9f-9053-5c79098b2c67"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:37.756868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fe46b667-b18d-4b9c-9102-c2f42328a9f0 req-527c115e-ece2-40b4-b0f3-0f791e777eb5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:37.757539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fe46b667-b18d-4b9c-9102-c2f42328a9f0 req-527c115e-ece2-40b4-b0f3-0f791e777eb5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:37.758401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fe46b667-b18d-4b9c-9102-c2f42328a9f0 req-527c115e-ece2-40b4-b0f3-0f791e777eb5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:37.773521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fe46b667-b18d-4b9c-9102-c2f42328a9f0 req-527c115e-ece2-40b4-b0f3-0f791e777eb5 service nova] Creating event network-vif-deleted:c5ae8671-fffc-4a9f-9053-5c79098b2c67 for instance 224cd91a-b045-40e1-a226-451983e44fa5 on n-h2-858383-16 Oct 27 09:07:37.807519 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fe46b667-b18d-4b9c-9102-c2f42328a9f0 req-527c115e-ece2-40b4-b0f3-0f791e777eb5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086416 Oct 27 09:07:37.809214 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 964/1951] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:37.818294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:37.819502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:37.833143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:37.836251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:37.837040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:37.851745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:37.852511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:37.855384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:37.918579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:37.919245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:37.920074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:37.920692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lazy-loading 'fault' on Instance uuid 224cd91a-b045-40e1-a226-451983e44fa5 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:07:37.986195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:37.995982 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cff9b9e3-5c25-4e45-9f28-2ce62204e8ba tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1301 microversion: 2.1 time: 0.184265 Oct 27 09:07:38.024479 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 965/1952] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:37 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1301 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:38.029777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:38.030508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:38.040183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:38.041016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:38.041890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:38.042790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:38.043907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:38.044911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:38.404010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:38.417806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:38.420434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:38.422554 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a35eafa6-2bb5-4182-b721-6cbbcd726d65 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.396780 Oct 27 09:07:38.428597 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 966/1953] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:38 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:38.458606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:38.460553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:38.478651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:38.479452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:38.482001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:38.482001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:38.482001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:38.482001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:38.935052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:38.959177 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d133f5c4-2d20-47f5-817f-42f8eac8c830 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1472 microversion: 2.1 time: 0.506712 Oct 27 09:07:38.962930 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 967/1954] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:38 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1472 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:38.974659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:38.977980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:38.994968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:39.000124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:39.000609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:39.005180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:39.007173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:39.007686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:39.144806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:39.165547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:39.167762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:39.175645 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d31a793-d207-4a06-a75c-3b22b9996f82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.210566 Oct 27 09:07:39.177217 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 968/1955] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:38 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:39.183624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:39.184775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:39.198793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:39.199803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:39.200684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:39.224849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:39.226482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:39.238104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:39.310643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:39.311602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:39.312384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:39.313100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lazy-loading 'fault' on Instance uuid 224cd91a-b045-40e1-a226-451983e44fa5 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:07:39.425715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:39.438087 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8f29b2c-2d8e-43da-ab82-e6f3dbda2022 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 200 len: 1301 microversion: 2.1 time: 0.259182 Oct 27 09:07:39.438927 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 969/1956] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:39 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 1301 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:39.474013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:39.474013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:39.474013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:39.474013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:39.474013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:39.474013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:39.474013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:39.474013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:39.822364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:39.834747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:39.837509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:39.839066 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3dc62049-d6ea-4418-9f81-11085d3e37cc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.383970 Oct 27 09:07:39.839793 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 970/1957] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:39 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:39.987842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:39.988724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:40.008090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.010239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.013423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:40.019500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.022874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.023460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:40.277813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:40.294929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:40.308674 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35ffb6ce-8303-45c8-8454-907ed4f505c9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1472 microversion: 2.1 time: 0.325671 Oct 27 09:07:40.311233 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 971/1958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:39 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:40.316857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:40.317589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:40.345709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.346613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.347316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:40.348945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.355851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.356778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:40.379374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:40.473831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:40.488527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:40.490371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:40.498996 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b257106d-fd7c-42e9-9f40-52cb6bc72067 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.186475 Oct 27 09:07:40.517965 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 972/1959] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:40 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:40.536281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:40.537874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 224cd91a-b045-40e1-a226-451983e44fa5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:40.554333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.554851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.555289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:40.556068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.556602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.557039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:40.596610 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] HTTP exception thrown: Instance 224cd91a-b045-40e1-a226-451983e44fa5 could not be found. Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Request method failure captured: Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 HTTP/1.1 Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiXHgnCW7xEFGzOObCYmUhBdgutb_PhZcirjZJdbNnC8JehRNikg18BPHyLD1qosxTUIJy_g642v3Wy5bSjkoXvOXPH-6eujK5wS13yI0LBACttzomfm_dctJ3Qp07T7IgD1a_Z19w666WNh11OnZjSP_hmnudqm9R7DeY_xA9PtFU Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 37b756ad383a4cf18b7da7565a51572e Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37b756ad383a4cf18b7da7565a51572e"}]}] Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 37b756ad383a4cf18b7da7565a51572e Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-LiveMigrationTest-1873683874-project Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: aff1721693734cc8937a84d9b8a483dd Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-LiveMigrationTest-1873683874-project Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 224cd91a-b045-40e1-a226-451983e44fa5 could not be found. Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '224cd91a-b045-40e1-a226-451983e44fa5'} Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 224cd91a-b045-40e1-a226-451983e44fa5 could not be found. Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 224cd91a-b045-40e1-a226-451983e44fa5 could not be found. Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:07:40.598317 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:40.605980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:40.605980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:07:40.605980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:07:40.605980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:07:40.605980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:07:40.605980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 224cd91a-b045-40e1-a226-451983e44fa5 could not be found. Oct 27 09:07:40.605980 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:40.605980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Returning 404 to user: Instance 224cd91a-b045-40e1-a226-451983e44fa5 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:07:40.605980 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cfaf515e-0742-424e-97aa-9e421417876c tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5" status: 404 len: 111 microversion: 2.1 time: 0.080346 Oct 27 09:07:40.616125 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 973/1960] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:40 2022] GET /compute/v2.1/servers/224cd91a-b045-40e1-a226-451983e44fa5 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:07:40.621846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:40.622345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:40.634270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.635173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.641743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:40.644272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.645965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.646894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:40.707915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:07:40.903861 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e046757-01de-4168-b11e-53e1908e51e3 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 204 len: 0 microversion: 2.1 time: 0.286266 Oct 27 09:07:40.904812 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 974/1961] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:07:40 2022] DELETE /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:07:40.910535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:40.911252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:40.928424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:40.929846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.930354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.930801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:40.931537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:40.932024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:40.932454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:41.228550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:41.246285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:41.248184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:41.249557 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d10f0cd0-2345-4690-ad46-e2b0aa0a46cd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.343494 Oct 27 09:07:41.250627 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 975/1962] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:40 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:41.260731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:41.266597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:41.285070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:41.289256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:41.289924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:41.290864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:41.293198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:41.293976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:41.543209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:41.569085 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ba8a2acb-d788-4ff1-9a15-8ca7d643ea99 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1500 microversion: 2.1 time: 0.317064 Oct 27 09:07:41.570290 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 976/1963] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:41 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1500 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:41.596721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:41.597866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:41.607254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:41.608126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:41.608797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:41.609711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:41.610460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:41.611734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:42.136853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:42.299625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:42.311109 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0a88ba4-be81-4fd9-be70-44e8f21507a4 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1472 microversion: 2.1 time: 0.727151 Oct 27 09:07:42.311716 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 977/1964] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:41 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1472 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:42.330320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:42.330939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:42.361193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:42.361193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:42.361193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:42.361193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:42.361193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:42.361193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:42.465341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:42.608933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:42.617980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:42.619179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:42.638937 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-16426bbd-e1a4-4b6f-b03d-f6d087d185fd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.325897 Oct 27 09:07:42.639286 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 978/1965] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:42 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:42.654689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:42.655350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:42.674257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:42.674257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:42.674257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:42.674257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:42.674257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:42.674257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:42.903004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:42.911853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:42.913891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:42.915098 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c9e0a35-50f4-4259-bc15-ad579588467c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.274754 Oct 27 09:07:42.928572 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 979/1966] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:42 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:42.933564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:42.934166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:42.955496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:42.956275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:42.956726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:42.957459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:42.957917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:42.958342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:43.105272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:43.129445 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3f295d98-8130-4615-8d50-6ced4e96cd31 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1458 microversion: 2.1 time: 0.199544 Oct 27 09:07:43.138167 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 980/1967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:42 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1458 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:43.154315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c66d39a0-ac8e-469d-85ef-f67bc5eae39a req-72e9214b-063a-41a8-8915-5cce4aa0b137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5ae277-3562-4d0b-8169-2820971f9aa7", "name": "network-vif-deleted", "tag": "b09e8afc-87cf-4ace-af3f-18ab1dfab2b9"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:43.186617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c66d39a0-ac8e-469d-85ef-f67bc5eae39a req-72e9214b-063a-41a8-8915-5cce4aa0b137 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:43.188466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c66d39a0-ac8e-469d-85ef-f67bc5eae39a req-72e9214b-063a-41a8-8915-5cce4aa0b137 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:43.190017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c66d39a0-ac8e-469d-85ef-f67bc5eae39a req-72e9214b-063a-41a8-8915-5cce4aa0b137 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:43.228166 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c66d39a0-ac8e-469d-85ef-f67bc5eae39a req-72e9214b-063a-41a8-8915-5cce4aa0b137 service nova] Creating event network-vif-deleted:b09e8afc-87cf-4ace-af3f-18ab1dfab2b9 for instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 on n-h2-858383-16 Oct 27 09:07:43.238230 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c66d39a0-ac8e-469d-85ef-f67bc5eae39a req-72e9214b-063a-41a8-8915-5cce4aa0b137 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098190 Oct 27 09:07:43.239507 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 981/1968] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:43.361626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:43.363369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:43.414208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:43.415787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:43.418484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:43.421174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:43.424614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:43.425596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:43.828737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:43.845388 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-526bb562-ef71-420b-9c1b-eb735d38cdf7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1472 microversion: 2.1 time: 0.490327 Oct 27 09:07:43.846471 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 982/1969] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:43 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:43.872971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:43.875980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:43.886928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:43.887490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:43.889085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:43.889882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:43.890371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:43.890815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:44.011509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:44.023038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:44.024851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:44.032816 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b95546cb-4f57-49ae-80be-cdc4296846a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.171573 Oct 27 09:07:44.045475 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 983/1970] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:43 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:44.066810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:44.067434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:44.086729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:44.087462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:44.087985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:44.088719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:44.089193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:44.089810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:44.320748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:44.339082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:44.342979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:44.343701 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1564d713-f3b0-47c6-871f-7f3753089bb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.289904 Oct 27 09:07:44.359700 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 984/1971] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:44 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:44.364673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:44.365942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:44.376726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:44.377196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:44.377642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:44.378345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:44.378807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:44.379239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:44.416814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:44.417312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:44.417757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:44.418217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lazy-loading 'fault' on Instance uuid 8b5ae277-3562-4d0b-8169-2820971f9aa7 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:07:44.469311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff1721693734cc8937a84d9b8a483dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b756ad383a4cf18b7da7565a51572e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:44.479081 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2dfa218c-74e4-43e7-b5e4-06070d050a11 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 200 len: 1301 microversion: 2.1 time: 0.118083 Oct 27 09:07:44.484319 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 985/1972] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:44 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 1301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:44.856573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:44.872193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:44.872920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:44.873573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:44.888253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:44.888757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:44.892142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:44.892896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:44.893374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:44.893813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:45.429828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:45.446747 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c62e9204-9c70-4260-9e3c-3444e720f446 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1472 microversion: 2.1 time: 0.576578 Oct 27 09:07:45.447326 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 986/1973] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:44 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1472 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:45.462043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:45.462043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:45.472129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:45.472631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:45.473118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:45.474037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:45.474625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:45.475110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:46.143020 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e0a5ef05-864c-4a89-b656-e7fe9ab33b8c tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1463 microversion: 2.1 time: 11.267084 Oct 27 09:07:46.146151 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 988/1974] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:34 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1463 bytes in 11270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:46.165065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:46.167014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:46.182235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:46.185167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:46.185887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:46.187916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:46.192182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:46.196225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:46.253145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:46.264831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:46.268159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:46.288973 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2654c3e-759d-4365-a8e3-07fefaacf30f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.840482 Oct 27 09:07:46.303605 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 987/1975] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:45 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:46.306610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:46.311644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] [instance: 8b5ae277-3562-4d0b-8169-2820971f9aa7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:46.314910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:46.315532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:46.316416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:46.319857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:46.320402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:46.320858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:46.346177 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] HTTP exception thrown: Instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 could not be found. Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Request method failure captured: Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 HTTP/1.1 Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkiXHgnCW7xEFGzOObCYmUhBdgutb_PhZcirjZJdbNnC8JehRNikg18BPHyLD1qosxTUIJy_g642v3Wy5bSjkoXvOXPH-6eujK5wS13yI0LBACttzomfm_dctJ3Qp07T7IgD1a_Z19w666WNh11OnZjSP_hmnudqm9R7DeY_xA9PtFU Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 37b756ad383a4cf18b7da7565a51572e Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b756ad383a4cf18b7da7565a51572e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37b756ad383a4cf18b7da7565a51572e"}]}] Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 37b756ad383a4cf18b7da7565a51572e Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-LiveMigrationTest-1873683874 Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-LiveMigrationTest-1873683874-project Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: aff1721693734cc8937a84d9b8a483dd Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-LiveMigrationTest-1873683874-project Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 could not be found. Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '8b5ae277-3562-4d0b-8169-2820971f9aa7'} Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 could not be found. Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 could not be found. Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:07:46.348381 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:46.354515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:07:46.354515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:07:46.354515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:07:46.354515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:07:46.354515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:07:46.354515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 could not be found. Oct 27 09:07:46.354515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:07:46.354515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] Returning 404 to user: Instance 8b5ae277-3562-4d0b-8169-2820971f9aa7 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:07:46.354515 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df85bde3-5cab-4a24-b4bf-f68aa70ed743 tempest-LiveMigrationTest-1873683874 tempest-LiveMigrationTest-1873683874-project] 10.222.0.25 "GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7" status: 404 len: 111 microversion: 2.1 time: 0.058990 Oct 27 09:07:46.360630 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 988/1976] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:46 2022] GET /compute/v2.1/servers/8b5ae277-3562-4d0b-8169-2820971f9aa7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:07:46.366368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36af8f1d-82dc-4fe7-9df7-b1d922bc2b98 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae4b5af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:46.470585 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36af8f1d-82dc-4fe7-9df7-b1d922bc2b98 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 200 len: 1463 microversion: 2.1 time: 0.102457 Oct 27 09:07:46.481373 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 989/1977] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:46 2022] GET /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 1463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:46.505890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:46.510684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:46.535466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:46.547359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:46.549206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:46.550544 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2c6a4007-f94e-4bea-a739-33f709247079 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.402629 Oct 27 09:07:46.557056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:46.557560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:46.562033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:46.564327 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 989/1978] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:46 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:46.572376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:46.572376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:46.572376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:46.577252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:46.578250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:46.586659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:46.587616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:46.589551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:46.590366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:46.591527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:46.592276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:46.592996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:46.946807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:46.953392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:46.975364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8a8c2e7-23f1-4391-be42-74109049d645 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1478 microversion: 2.1 time: 0.496642 Oct 27 09:07:46.976409 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4992821a-bead-4342-a0da-08f1afc062c5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1481 microversion: 2.1 time: 0.408281 Oct 27 09:07:46.978204 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 990/1979] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:46 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1481 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:46.993032 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 990/1980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:46 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1478 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:47.327043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:47.328819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:47.339419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:47.340406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:47.341196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:47.348130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:47.349984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:47.351318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:47.443800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:47.464343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:47.468986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:47.476650 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1cd3284-d46f-4fba-a21a-792aaa54890d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.154272 Oct 27 09:07:47.478051 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 991/1981] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:47 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:47.579893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:47.580485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:47.588138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:47.588446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:47.589032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:47.589708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:47.590056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:47.590484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:47.786637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:47.800151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:47.801890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:47.803645 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb8b0e3c-3521-45f8-90a8-820b5ad8eff3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.228135 Oct 27 09:07:47.804516 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 991/1982] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:47 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:48.003377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:48.004409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:48.004570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:48.005001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:48.016788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:48.017279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:48.017521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:48.017710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:48.018417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:48.018567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:48.018870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:48.019295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:48.019673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:48.020590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:48.021447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:48.022067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:48.287878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:48.301805 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29b5e00a-dcd5-4afa-93b7-fa2886d7003f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1478 microversion: 2.1 time: 0.300729 Oct 27 09:07:48.302729 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 992/1983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:47 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1478 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:48.354825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:48.362881 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-68f4588f-5939-438a-a6e3-c18e13b508b7 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1468 microversion: 2.1 time: 0.364284 Oct 27 09:07:48.387127 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 992/1984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:47 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1468 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:48.391275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d7e6aa6-ba56-4696-ba94-eed0f26bcaf6 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae570d30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:48.506135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:48.507148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:48.519687 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d7e6aa6-ba56-4696-ba94-eed0f26bcaf6 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-10-27T09%3A05%3A28Z" status: 200 len: 1902 microversion: 2.1 time: 0.132297 Oct 27 09:07:48.530760 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 993/1985] 10.222.0.25 () {58 vars in 1199 bytes} [Thu Oct 27 09:07:48 2022] GET /compute/v2.1/images?changes-since=2022-10-27T09%3A05%3A28Z => generated 1902 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:48.531006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:48.537383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:48.537905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d2c3034-a624-4291-bed4-a210601c5659 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae4b5820>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:48.538046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:48.538624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:48.539095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:48.540042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:48.624744 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d2c3034-a624-4291-bed4-a210601c5659 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-535175276" status: 200 len: 484 microversion: 2.1 time: 0.092298 Oct 27 09:07:48.625920 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 994/1986] 10.222.0.25 () {58 vars in 1229 bytes} [Thu Oct 27 09:07:48 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-535175276 => generated 484 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:48.636955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:48.646298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbdc63fb-58c9-411d-ab70-647c5887f434 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae5878b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:48.646497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:48.647924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:48.653612 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d17b0ea7-88d8-48a9-b34e-c5f3ecdc859a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.151762 Oct 27 09:07:48.668371 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 993/1987] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:48 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:48.797375 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbdc63fb-58c9-411d-ab70-647c5887f434 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images?server=1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 956 microversion: 2.1 time: 0.158550 Oct 27 09:07:48.800483 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 995/1988] 10.222.0.25 () {58 vars in 1209 bytes} [Thu Oct 27 09:07:48 2022] GET /compute/v2.1/images?server=1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 956 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:48.816748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f974e8a2-daac-4ffc-902e-8460ad0a1b1b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d400d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:48.860820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:48.866837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:48.890021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:48.890496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:48.890941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:48.891704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:48.892169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:48.896950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:48.936057 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f974e8a2-daac-4ffc-902e-8460ad0a1b1b tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fd645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 485 microversion: 2.1 time: 0.123931 Oct 27 09:07:48.937164 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 994/1989] 10.222.0.25 () {58 vars in 1317 bytes} [Thu Oct 27 09:07:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fd645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 485 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:48.952072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-372f495c-992e-4929-8d00-a9a3464d2648 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d0e160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:49.043822 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-372f495c-992e-4929-8d00-a9a3464d2648 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fd645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 485 microversion: 2.1 time: 0.095056 Oct 27 09:07:49.043822 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 995/1990] 10.222.0.25 () {58 vars in 1303 bytes} [Thu Oct 27 09:07:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fd645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 485 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:49.075736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a2e77c9-527f-4b7b-9dba-ee04f66ba5cd tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d0e310>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:49.161766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:49.175150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:49.178470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:49.180022 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2b66cec-5b77-4a06-882b-d6973aa90461 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.352721 Oct 27 09:07:49.181415 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 996/1991] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:48 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:49.313468 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a2e77c9-527f-4b7b-9dba-ee04f66ba5cd tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.258445 Oct 27 09:07:49.327910 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 996/1992] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:07:49 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:49.336871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:49.337406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:49.340735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91428d3e-1b83-43df-baf7-cd8d871315c0 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d40820>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:49.356753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:49.357269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:49.357785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:49.358503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:49.358962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:49.359386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:49.468428 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91428d3e-1b83-43df-baf7-cd8d871315c0 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.138696 Oct 27 09:07:49.469183 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 997/1993] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:07:49 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:49.485521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c0b2dfe-4114-44be-bc46-facb15aaebfb tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d40670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:49.624540 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c0b2dfe-4114-44be-bc46-facb15aaebfb tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.143056 Oct 27 09:07:49.635357 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 998/1994] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:07:49 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:49.651601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8456bfe6-a661-4dcd-96ce-c8bef412206e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d408b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:49.948362 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8456bfe6-a661-4dcd-96ce-c8bef412206e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-10-27T09%3A05%3A23Z" status: 200 len: 6333 microversion: 2.1 time: 0.309920 Oct 27 09:07:49.949245 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 999/1995] 10.222.0.25 () {58 vars in 1220 bytes} [Thu Oct 27 09:07:49 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-27T09%3A05%3A23Z => generated 6333 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:49.966090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:49.968527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:49.969485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:49.984579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:49.985433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:49.985870 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-169475d1-de1b-4b4b-958d-818f0340a3cd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1478 microversion: 2.1 time: 0.663222 Oct 27 09:07:49.987679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:49.987955 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 997/1996] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:49 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1478 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:49.988924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:49.994415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:49.995191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:49.997137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b591642b-3b13-4476-9387-29e043b42b12 req-46a20223-4668-41fc-98ce-caf6895c6afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4349576-ae59-481f-92ec-599ddae530d7", "name": "network-vif-unplugged", "status": "completed", "tag": "e74cd9c8-3c59-4b33-a7c7-5358d3b644c0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:50.024276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b591642b-3b13-4476-9387-29e043b42b12 req-46a20223-4668-41fc-98ce-caf6895c6afe service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:50.024784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b591642b-3b13-4476-9387-29e043b42b12 req-46a20223-4668-41fc-98ce-caf6895c6afe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:50.025233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b591642b-3b13-4476-9387-29e043b42b12 req-46a20223-4668-41fc-98ce-caf6895c6afe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:50.043470 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b591642b-3b13-4476-9387-29e043b42b12 req-46a20223-4668-41fc-98ce-caf6895c6afe service nova] Creating event network-vif-unplugged:e74cd9c8-3c59-4b33-a7c7-5358d3b644c0 for instance d4349576-ae59-481f-92ec-599ddae530d7 on n-h2-858383-16 Oct 27 09:07:50.076912 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b591642b-3b13-4476-9387-29e043b42b12 req-46a20223-4668-41fc-98ce-caf6895c6afe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087682 Oct 27 09:07:50.077526 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 998/1997] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:50.106055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a7c5116-d57c-45ac-98d5-d3015d7f2c24 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae587820>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:50.147414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:50.171406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:50.173671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:50.185378 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-249934f1-6e6a-4255-a7ac-4bc758664734 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.233841 Oct 27 09:07:50.197724 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1000/1998] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:49 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:50.210919 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a7c5116-d57c-45ac-98d5-d3015d7f2c24 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-535175276" status: 200 len: 664 microversion: 2.1 time: 0.131992 Oct 27 09:07:50.211503 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 999/1999] 10.222.0.25 () {58 vars in 1250 bytes} [Thu Oct 27 09:07:50 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-535175276 => generated 664 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:50.224629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:50.226028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:50.241034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:50.244808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99a3acb8-1e4b-4a36-9fe6-96bea9f6e034 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae556670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:50.245590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:50.246153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:50.247036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:50.258605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:50.259221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:50.363594 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99a3acb8-1e4b-4a36-9fe6-96bea9f6e034 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fd645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1467 microversion: 2.1 time: 0.130530 Oct 27 09:07:50.364949 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1000/2000] 10.222.0.25 () {58 vars in 1338 bytes} [Thu Oct 27 09:07:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fd645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1467 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:50.388195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f59bc0a9-a5b6-483e-a090-ad7505ff90e5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae570160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:50.479868 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f59bc0a9-a5b6-483e-a090-ad7505ff90e5 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fd645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1467 microversion: 2.1 time: 0.104254 Oct 27 09:07:50.481191 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1001/2001] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Oct 27 09:07:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fd645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1467 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:50.500390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a703d01f-15e7-40cd-8f24-d21ab31c0c13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae556700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:50.628989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:50.642285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:50.648681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:50.650382 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00839ca3-af98-4a02-8055-753f06b36bb7 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.430323 Oct 27 09:07:50.651459 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1001/2002] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:50 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:50.695292 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a703d01f-15e7-40cd-8f24-d21ab31c0c13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.199212 Oct 27 09:07:50.704190 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1002/2003] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Oct 27 09:07:50 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:50.730235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-463b1780-c837-4e24-b7b4-ebd7caf569ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d0e8b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:50.834754 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-463b1780-c837-4e24-b7b4-ebd7caf569ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.108345 Oct 27 09:07:50.836416 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1002/2004] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Oct 27 09:07:50 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:50.854119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-412def78-430d-45ab-98f9-0f8b59d8bcb3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae556940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:50.919762 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-412def78-430d-45ab-98f9-0f8b59d8bcb3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/a5a38eaa-9305-45a5-98b3-c9ecee92f0b1" status: 200 len: 784 microversion: 2.1 time: 0.069298 Oct 27 09:07:50.922703 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1003/2005] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:07:50 2022] GET /compute/v2.1/images/a5a38eaa-9305-45a5-98b3-c9ecee92f0b1 => generated 784 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:50.944196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e80ecc57-bc35-4a9b-900d-09662c5679b0 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d44c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:51.014559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:51.015310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:51.022163 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e80ecc57-bc35-4a9b-900d-09662c5679b0 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.086884 Oct 27 09:07:51.023428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:51.024142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:51.024908 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1003/2006] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 09:07:50 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:51.042353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:51.044720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:51.044913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:51.045295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:51.046073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e00818b7-4686-410f-9217-4ea8c7d32162 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9dc05e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:51.348940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:51.364077 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d293908-0b07-472f-89de-0b74bc28fe26 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1478 microversion: 2.1 time: 0.354964 Oct 27 09:07:51.365385 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1004/2007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:51 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1478 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:51.370874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:51.371696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:51.379733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:51.380582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:51.381198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:51.382138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:51.383041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:51.383694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:51.505450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:51.529388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:51.531295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:51.547358 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9322a9a2-7cc7-49ce-af24-5fda32dfb6b4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.180377 Oct 27 09:07:51.549023 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1005/2008] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:51 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:51.556232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-31ca069c-ece2-4ee4-8854-61946513d303 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:51.556898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-31ca069c-ece2-4ee4-8854-61946513d303 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:51.570881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31ca069c-ece2-4ee4-8854-61946513d303 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:51.571779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31ca069c-ece2-4ee4-8854-61946513d303 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:51.571779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31ca069c-ece2-4ee4-8854-61946513d303 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:51.572532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31ca069c-ece2-4ee4-8854-61946513d303 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:51.573054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31ca069c-ece2-4ee4-8854-61946513d303 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:51.574139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31ca069c-ece2-4ee4-8854-61946513d303 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:51.630978 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-31ca069c-ece2-4ee4-8854-61946513d303 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/ips" status: 200 len: 151 microversion: 2.20 time: 0.079576 Oct 27 09:07:51.631759 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1006/2009] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Oct 27 09:07:51 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/ips => generated 151 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:07:51.682904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:51.683701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:51.696563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:51.697085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:51.698487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:51.702097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:51.703876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:51.705084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:51.813582 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e00818b7-4686-410f-9217-4ea8c7d32162 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "DELETE /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403" status: 204 len: 0 microversion: 2.1 time: 0.771847 Oct 27 09:07:51.815353 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1004/2010] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:51 2022] DELETE /compute/v2.1/images/00f5afb3-d2c6-4065-bd90-7db518ecd403 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:07:51.828334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ab2b205-bcf5-455a-89bb-b6daf0859f52 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d0e8b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:52.125129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:52.139775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:52.143735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:52.146770 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f6986b87-06a9-4eec-9816-b30902370eb9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.469506 Oct 27 09:07:52.164625 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1007/2011] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:51 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:52.171869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-247e6d48-1051-42c0-ac02-d6e760d76d2a req-7bc1ad08-e0db-4f07-a93e-382833c1cbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f46edbb-82a0-4749-a443-02e5ca52e341", "name": "network-vif-unplugged", "status": "completed", "tag": "4f73cce5-2a06-488c-8855-f44a51f4779a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:52.197641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-247e6d48-1051-42c0-ac02-d6e760d76d2a req-7bc1ad08-e0db-4f07-a93e-382833c1cbc9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:52.198193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-247e6d48-1051-42c0-ac02-d6e760d76d2a req-7bc1ad08-e0db-4f07-a93e-382833c1cbc9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:52.198631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-247e6d48-1051-42c0-ac02-d6e760d76d2a req-7bc1ad08-e0db-4f07-a93e-382833c1cbc9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:52.233659 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-247e6d48-1051-42c0-ac02-d6e760d76d2a req-7bc1ad08-e0db-4f07-a93e-382833c1cbc9 service nova] Creating event network-vif-unplugged:4f73cce5-2a06-488c-8855-f44a51f4779a for instance 1f46edbb-82a0-4749-a443-02e5ca52e341 on n-h1-858383-16 Oct 27 09:07:52.239272 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-247e6d48-1051-42c0-ac02-d6e760d76d2a req-7bc1ad08-e0db-4f07-a93e-382833c1cbc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081788 Oct 27 09:07:52.241018 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1008/2012] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:52.397557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:52.398482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:52.408917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:52.409415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:52.409949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:52.417388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:52.417987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:52.418437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:52.604841 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3ab2b205-bcf5-455a-89bb-b6daf0859f52 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "DELETE /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea" status: 204 len: 0 microversion: 2.1 time: 0.784889 Oct 27 09:07:52.606849 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1005/2013] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:51 2022] DELETE /compute/v2.1/images/d542a99b-2c2c-4850-b223-e28bdaa0eeea => generated 0 bytes in 787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:07:52.612857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:52.613468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:52.621295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:52.622092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:52.622732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:52.623719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:52.624383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:52.624977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:52.721456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:52.730148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:52.736647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:52.740903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:52.743544 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9678803a-5908-4df4-96e8-8b5f3619846d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1478 microversion: 2.1 time: 0.352522 Oct 27 09:07:52.745529 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1009/2014] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:52 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1478 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:52.754248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a03280a8-265c-4e74-a19a-b6ba94e4fda1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae532f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:52.758593 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4472072a-36c8-4f1c-bfad-9c19749638ac tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1537 microversion: 2.91 time: 0.150442 Oct 27 09:07:52.759864 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1006/2015] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:52 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:53.188572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:53.189267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:53.202394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.202619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.203715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:53.204151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.204696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.205245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:53.295880 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a03280a8-265c-4e74-a19a-b6ba94e4fda1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "DELETE /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254" status: 204 len: 0 microversion: 2.1 time: 0.548737 Oct 27 09:07:53.297393 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1010/2016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:52 2022] DELETE /compute/v2.1/images/bf207ac6-74d8-47b4-985c-1e0fa87ad254 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:07:53.306038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:53.307126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:53.314447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.315253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.315896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:53.316970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.317780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.318929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:53.381066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:07:53.507336 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0583a9f0-4ed9-4cbd-a9b3-040f6f5fc5a9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 204 len: 0 microversion: 2.1 time: 0.205050 Oct 27 09:07:53.512860 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1011/2017] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:07:53 2022] DELETE /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:07:53.519717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:53.521163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:53.528832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.529519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.530225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:53.531060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.531633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.532141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:53.800021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:53.814019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:53.821074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f7e53717-2dea-4191-baf6-f6f42a90ebb1 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1473 microversion: 2.1 time: 0.306020 Oct 27 09:07:53.823987 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1012/2018] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:53 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1473 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:53.829697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:53.830603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:53.840999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:53.844012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:53.845902 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94b4f8fa-abdf-48ad-b73d-ddb35d436066 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.664246 Oct 27 09:07:53.847484 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1007/2019] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:53 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:53.854829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.855362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.855822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:53.861393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:53.862279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:53.863477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.864184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.865418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:53.872345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.873132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.874214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:53.875155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:53.876118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:53.876739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:54.039442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:54.049390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:54.050901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:54.058709 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb431e30-a6b4-4308-8ed4-91e8d0bf5e98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1537 microversion: 2.91 time: 0.209156 Oct 27 09:07:54.059628 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1008/2020] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:53 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:54.107295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:54.117538 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d127110-3135-41d3-a836-2348d37eacc0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1478 microversion: 2.1 time: 0.291861 Oct 27 09:07:54.118687 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1013/2021] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:53 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1478 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:54.266505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0423e902-2041-4726-b939-17e9a9a5cb30 req-7d33f9e5-9d77-45f4-9623-9a3a2c456eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4349576-ae59-481f-92ec-599ddae530d7", "name": "network-vif-plugged", "status": "completed", "tag": "e74cd9c8-3c59-4b33-a7c7-5358d3b644c0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:54.281635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0423e902-2041-4726-b939-17e9a9a5cb30 req-7d33f9e5-9d77-45f4-9623-9a3a2c456eef service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:54.282483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0423e902-2041-4726-b939-17e9a9a5cb30 req-7d33f9e5-9d77-45f4-9623-9a3a2c456eef service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:54.283265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0423e902-2041-4726-b939-17e9a9a5cb30 req-7d33f9e5-9d77-45f4-9623-9a3a2c456eef service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:54.303127 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0423e902-2041-4726-b939-17e9a9a5cb30 req-7d33f9e5-9d77-45f4-9623-9a3a2c456eef service nova] Creating event network-vif-plugged:e74cd9c8-3c59-4b33-a7c7-5358d3b644c0 for instance d4349576-ae59-481f-92ec-599ddae530d7 on n-h2-858383-16 Oct 27 09:07:54.318994 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0423e902-2041-4726-b939-17e9a9a5cb30 req-7d33f9e5-9d77-45f4-9623-9a3a2c456eef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065741 Oct 27 09:07:54.320416 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1009/2022] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:07:54.830865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:54.831752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:54.847034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:54.848334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:54.855931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:54.858449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:54.859080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:54.862696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:54.863361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:54.864179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:54.865383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:54.866047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:54.866678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:54.868490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:54.870489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:54.874609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:54.918734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lazy-loading 'flavor' on Instance uuid 3d248926-b23e-472b-9a1e-4b10c924758a {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:07:55.025014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:55.146472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:55.157299 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9ad80ca-0909-45a4-b6ed-fe670baab8f9 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1473 microversion: 2.1 time: 0.316836 Oct 27 09:07:55.174807 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1010/2023] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:54 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1473 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:55.181466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:55.182764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:55.189580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:55.190373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:55.191014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:55.191945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:55.192583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:55.193449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:55.218694 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-52b0b744-3d96-4bb2-8943-ff915c31afc9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/action" status: 202 len: 0 microversion: 2.20 time: 0.392909 Oct 27 09:07:55.219811 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1014/2024] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:07:54 2022] POST /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:07:55.263890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:55.265341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:55.282714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:55.283739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:55.284435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:55.285703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:55.286406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:55.288245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:55.412079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:55.422546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:55.424853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:55.443850 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce56dabe-44a1-4faf-8d79-062bc045e722 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1537 microversion: 2.91 time: 0.221689 Oct 27 09:07:55.457630 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1015/2025] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:55 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:55.457630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:55.457630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:55.463605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:55.464224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:55.466893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:55.466893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:55.469628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:55.471255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:55.524474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:55.560853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:55.589292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:55.601626 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db169358-0aec-4d81-8d58-5c248d7ea34b tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.424747 Oct 27 09:07:55.603644 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1011/2026] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:55 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:55.640943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:55.642675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:55.651896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:55.651896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:55.652257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:55.654752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:55.654752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:55.654752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:55.995912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.003761 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-329cbfb5-2a80-49f2-aa40-102e0a90b75c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1478 microversion: 2.1 time: 0.557712 Oct 27 09:07:56.004340 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1016/2027] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:55 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1478 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:56.039101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.048263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.049975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.051157 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1617f0de-095f-42aa-b098-f17df4b0655e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.416256 Oct 27 09:07:56.052005 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1012/2028] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:55 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:56.186189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:56.186762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:56.193699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.194433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.194884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.195775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.196444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.197070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.416955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.425592 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c96fd4c-7644-40ed-99e0-84c405139e13 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1473 microversion: 2.1 time: 0.244100 Oct 27 09:07:56.426182 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1017/2029] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:56 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1473 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:56.492358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:56.493160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:56.500583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.501769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.502403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.503303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.503784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.504207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.619001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.637227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.638634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.643442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:56.644201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:56.644394 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-02cca7cc-db30-481d-9f6e-0347b9b06faa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1540 microversion: 2.91 time: 0.157737 Oct 27 09:07:56.659597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1013/2030] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:56 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1540 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:56.663338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.665445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.666599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.667360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.673080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:56.675781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:56.678398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.679204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.684555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.685280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.685836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.686567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.687029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.687466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.812922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858383-16". {{(pid=120602) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 27 09:07:56.910898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:07:56.934370 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8a28fcb-230f-49d2-bd74-8410e28f8f97 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d/action" status: 202 len: 0 microversion: 2.91 time: 0.264308 Oct 27 09:07:56.936857 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1014/2031] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:07:56 2022] POST /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:07:56.947950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:56.948747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:56.948884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.956014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.956968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.957738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.958662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:56.959286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:56.959906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:56.960587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.977834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:56.979079 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb684475-6c88-499c-b558-3fe7ac193651 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.340606 Oct 27 09:07:56.981158 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1018/2032] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:56 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:57.031705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:57.034009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:57.046161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:57.047039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:57.047842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:57.048817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:57.050111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:57.050836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:57.188886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:57.201720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:57.210329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:57.231604 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ade0f21f-32e9-4afd-92cd-e1424071034b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1548 microversion: 2.91 time: 0.284692 Oct 27 09:07:57.249252 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1015/2033] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:56 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1548 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:57.254657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:57.255621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:57.263053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:57.264279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:57.265061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:57.265934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:57.266558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:57.267139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:57.619478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:57.640785 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-082c3267-e6e6-4a06-b592-29c4d251ee3d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1478 microversion: 2.1 time: 0.611541 Oct 27 09:07:57.642503 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1019/2034] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:57 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1478 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:57.652321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:57.653781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:57.669810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:57.670553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:57.671186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:57.672657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:57.673286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:57.673875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:57.756748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:57.775128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:57.780027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:57.783100 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ddd6dd4-fefa-494e-91f9-9cd51be96db8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.531718 Oct 27 09:07:57.805631 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1016/2035] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:57 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:58.010377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:58.015439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:58.016558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:58.024569 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62e8e8b2-2770-40c1-bfa7-bb579a0d153e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1473 microversion: 2.1 time: 0.380218 Oct 27 09:07:58.025955 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1020/2036] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:57 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:58.038222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:58.039008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:58.039753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:58.040953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:58.041642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:58.042390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:58.147842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fb74f29c-3a59-4990-ad5a-05bcbb8b89a4 req-5b80d2c1-6bca-4f0c-87d3-cfe70603726e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d645fadc-59fa-44d8-aee6-1b98f0013de3", "name": "network-vif-deleted", "tag": "bfbf5e11-af5f-410d-a0c1-a17a8f0be57c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:07:58.160683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fb74f29c-3a59-4990-ad5a-05bcbb8b89a4 req-5b80d2c1-6bca-4f0c-87d3-cfe70603726e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:58.162260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fb74f29c-3a59-4990-ad5a-05bcbb8b89a4 req-5b80d2c1-6bca-4f0c-87d3-cfe70603726e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:58.162862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fb74f29c-3a59-4990-ad5a-05bcbb8b89a4 req-5b80d2c1-6bca-4f0c-87d3-cfe70603726e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:58.178923 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fb74f29c-3a59-4990-ad5a-05bcbb8b89a4 req-5b80d2c1-6bca-4f0c-87d3-cfe70603726e service nova] Creating event network-vif-deleted:bfbf5e11-af5f-410d-a0c1-a17a8f0be57c for instance d645fadc-59fa-44d8-aee6-1b98f0013de3 on n-h2-858383-16 Oct 27 09:07:58.186358 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fb74f29c-3a59-4990-ad5a-05bcbb8b89a4 req-5b80d2c1-6bca-4f0c-87d3-cfe70603726e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043119 Oct 27 09:07:58.187405 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1021/2037] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:07:58.261637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:58.262623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:58.272147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:58.273006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:58.273775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:58.274658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:58.275270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:58.276083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:58.339944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:58.348891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:58.350550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:58.352348 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9ca3a04-c471-4b52-9ac7-8939421d3458 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.343902 Oct 27 09:07:58.353101 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1017/2038] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:58 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:07:58.427919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:58.456237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:58.459299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:58.466099 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c455134-cf52-48bc-96eb-60eacd5f5f2b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1548 microversion: 2.91 time: 0.213488 Oct 27 09:07:58.467454 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1022/2039] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:58 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1548 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:58.690971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:58.691894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:58.700446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:58.700942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:58.701413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:58.702127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:58.702589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:58.703018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:58.820229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:58.821124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:58.827992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:58.828494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:58.828931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:58.829657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:58.830110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:58.830637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:59.024946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.039280 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1f611e0-d67a-4bd6-8647-ec609cbd10e6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1478 microversion: 2.1 time: 0.352853 Oct 27 09:07:59.040085 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1018/2040] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:58 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1478 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:07:59.058652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:59.061078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:59.078537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:59.079415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:59.084921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:59.086781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:59.087398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:59.089295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:59.108979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.129212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.133553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.136071 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7254bdc3-0318-4378-ab6b-f145e6275228 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.320086 Oct 27 09:07:59.148988 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1023/2041] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:58 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:59.169703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:59.170266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:59.170808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:59.171296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lazy-loading 'fault' on Instance uuid d645fadc-59fa-44d8-aee6-1b98f0013de3 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:07:59.282713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.305933 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fe836aa8-85bc-458a-9176-603e0760d799 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 200 len: 1308 microversion: 2.1 time: 0.251082 Oct 27 09:07:59.307450 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1019/2042] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:07:59 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:07:59.383165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:59.384009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:59.394344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:59.396721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:59.398712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:59.400175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:59.402507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:59.403918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:59.498605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:07:59.499231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:07:59.506258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:59.506835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:59.507358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:59.508536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:07:59.508951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:07:59.509437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:07:59.598299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.609227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.610333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.616138 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae5cf751-5d72-4e2a-995b-f39031a85c7f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1490 microversion: 2.91 time: 0.121508 Oct 27 09:07:59.616959 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1020/2043] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:59 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1490 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:07:59.635993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.645397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.647382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:07:59.648609 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5b2e9f0-8845-4cb6-ad23-f27898ed11b6 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.273774 Oct 27 09:07:59.649167 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1024/2044] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:07:59 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:00.064790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:00.065379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.073181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.074113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.074829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.075544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.076030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.076608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.165760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:00.166379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.168974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:00.180233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.180736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.183935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.184944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.185435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.185875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.283173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:00.293216 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-440a6cd9-f2b5-4fa4-b6e6-7dc7651e3b81 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1464 microversion: 2.1 time: 0.231643 Oct 27 09:08:00.337439 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1021/2045] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:00 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1464 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:00.346819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-090ab6c4-1b3b-4363-8b5d-348a1d580ed6 req-fc9c3547-d04e-4d3a-9e1a-bac01e3d2a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4098cc-19c7-4dc0-b5af-55f92720b32f", "name": "network-vif-unplugged", "status": "completed", "tag": "f5de6da6-f70a-45de-9d70-2166b991303b"}, {"name": "network-changed", "server_uuid": "8a4098cc-19c7-4dc0-b5af-55f92720b32f", "tag": "f5de6da6-f70a-45de-9d70-2166b991303b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:00.360457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-090ab6c4-1b3b-4363-8b5d-348a1d580ed6 req-fc9c3547-d04e-4d3a-9e1a-bac01e3d2a49 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.361940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-090ab6c4-1b3b-4363-8b5d-348a1d580ed6 req-fc9c3547-d04e-4d3a-9e1a-bac01e3d2a49 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.362885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-090ab6c4-1b3b-4363-8b5d-348a1d580ed6 req-fc9c3547-d04e-4d3a-9e1a-bac01e3d2a49 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.380105 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-090ab6c4-1b3b-4363-8b5d-348a1d580ed6 req-fc9c3547-d04e-4d3a-9e1a-bac01e3d2a49 service nova] Creating event network-vif-unplugged:f5de6da6-f70a-45de-9d70-2166b991303b for instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f on n-h1-858383-16 Oct 27 09:08:00.381459 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-090ab6c4-1b3b-4363-8b5d-348a1d580ed6 req-fc9c3547-d04e-4d3a-9e1a-bac01e3d2a49 service nova] Creating event network-changed:f5de6da6-f70a-45de-9d70-2166b991303b for instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f on n-h1-858383-16 Oct 27 09:08:00.393247 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-090ab6c4-1b3b-4363-8b5d-348a1d580ed6 req-fc9c3547-d04e-4d3a-9e1a-bac01e3d2a49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.050061 Oct 27 09:08:00.394453 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1022/2046] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:00.400196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:00.401898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:00.402877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.409233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.409725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.410250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.410388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:00.411045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.411498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.411948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.412475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:00.413906 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ec8a7a1-e9a4-466c-9fe3-4092a79957ac tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.252066 Oct 27 09:08:00.414462 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1025/2047] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:00 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:08:00.418985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:00.419946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: d645fadc-59fa-44d8-aee6-1b98f0013de3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.426103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.427112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.428447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.429711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.430418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.431011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.466684 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] HTTP exception thrown: Instance d645fadc-59fa-44d8-aee6-1b98f0013de3 could not be found. Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Request method failure captured: Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 HTTP/1.1 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWknSg2aiku_2WMyFEFlh4RXIKGnRRU-jV-Ni3aSh4uVwI3zoN-hCSEejEvzwf8gSeaNNlMyWnC8nmv8wetV7ZhfzQUuu4MBn-tH6JlGR1VgBQa_E3YL69fT5hst2nm9QVJNPlqEbvZ4IwP_eP-q0Qx9NyFkuB34hy45oeqTT0iJraaM Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: ce2cb516397542a1b9ffa3d8d9dd0499 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ListImageFiltersTestJSON-1730008489 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2cb516397542a1b9ffa3d8d9dd0499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce2cb516397542a1b9ffa3d8d9dd0499"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2cb516397542a1b9ffa3d8d9dd0499"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce2cb516397542a1b9ffa3d8d9dd0499"}]}] Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ListImageFiltersTestJSON-1730008489 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: ce2cb516397542a1b9ffa3d8d9dd0499 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1730008489 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ListImageFiltersTestJSON-1730008489-project Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d6c4e0fe197a41fdaab411474b35aff5 Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ListImageFiltersTestJSON-1730008489-project Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d645fadc-59fa-44d8-aee6-1b98f0013de3 could not be found. Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd645fadc-59fa-44d8-aee6-1b98f0013de3'} Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d645fadc-59fa-44d8-aee6-1b98f0013de3 could not be found. Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d645fadc-59fa-44d8-aee6-1b98f0013de3 could not be found. Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:00.471827 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:00.477521 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:00.477521 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:00.477521 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:00.477521 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:00.477521 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:00.477521 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d645fadc-59fa-44d8-aee6-1b98f0013de3 could not be found. Oct 27 09:08:00.477521 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:00.477521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Returning 404 to user: Instance d645fadc-59fa-44d8-aee6-1b98f0013de3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:00.477521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73b3300f-6ea0-4088-9489-b7aafbc4b64e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3" status: 404 len: 111 microversion: 2.1 time: 0.060624 Oct 27 09:08:00.478284 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1026/2048] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:00 2022] GET /compute/v2.1/servers/d645fadc-59fa-44d8-aee6-1b98f0013de3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:08:00.487780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:00.488370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.496077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.497284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.498081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.500155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.500996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.501623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.544715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:08:00.585960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:00.594868 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9c5a5f3-59d8-4fa8-8a1a-858c9d9456ab tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1464 microversion: 2.1 time: 0.198960 Oct 27 09:08:00.595798 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1023/2049] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:00 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1464 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:00.634509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:00.637494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.646232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.646718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.647466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.649086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.650456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.650996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.655347 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b019818c-f704-4670-bed3-05e81d732797 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 204 len: 0 microversion: 2.1 time: 0.172746 Oct 27 09:08:00.660050 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1027/2050] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:08:00 2022] DELETE /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:08:00.668103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:00.668994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.675838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.676844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.678116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.679007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.679762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.680664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.789349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:00.796398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:08:00.796831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:08:00.797308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:08:00.797734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:08:00.798148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:08:00.803201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:00.804791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:00.812259 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49f46a48-013b-442e-9162-a9512a6f1d9a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.150624 Oct 27 09:08:00.812955 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1028/2051] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:00 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:00.817445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:00.818086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.824131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.824841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.825446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.827051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.831335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.831937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.880989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.887360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.887887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.888333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.889046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.889494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.889918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.918128 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1483fc53-7ab7-4bd9-af07-32dd2a6cfb57 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action" status: 202 len: 1068 microversion: 2.1 time: 0.304204 Oct 27 09:08:00.931973 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1024/2052] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:08:00 2022] POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action => generated 1068 bytes in 306 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 27 09:08:00.937530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:00.938289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:00.945433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.945991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.946474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:00.947445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:00.947931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:00.948498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:01.391304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.394868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.400439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.401894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.403062 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a5ea22b2-826f-456f-b129-f143a07950dc tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.483311 Oct 27 09:08:01.403385 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a74b4be-c0f1-4886-8026-6850f49bc0ec tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1474 microversion: 2.1 time: 0.589558 Oct 27 09:08:01.403680 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1025/2053] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:00 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:01.407891 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1029/2054] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:00 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1474 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:01.412822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:01.413436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:01.419497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:01.420027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:01.420686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:01.421601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:01.422069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:01.422502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:01.428242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:01.539948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8bf4330a-e078-441c-8547-29314abb7336 tempest-NetworksTest-1698159078 tempest-NetworksTest-1698159078-project-admin] Calling method '.version_select at 0x7f31aa0f9160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:01.588591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.596613 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f07d6900-0229-4357-b431-67b28398e487 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.187349 Oct 27 09:08:01.597198 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1030/2055] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:01 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:01.601774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:01.602407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:01.608449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:01.608904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:01.609383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:01.610075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:01.610525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:01.610947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:01.822386 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8bf4330a-e078-441c-8547-29314abb7336 tempest-NetworksTest-1698159078 tempest-NetworksTest-1698159078-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 7400 microversion: 2.1 time: 0.417645 Oct 27 09:08:01.823413 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1026/2056] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:08:01 2022] GET /compute/v2.1/os-networks => generated 7400 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:01.830937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4a809bc-f69c-40fe-a2a5-95f9d4adac8c tempest-NetworksTest-1698159078 tempest-NetworksTest-1698159078-project-admin] Calling method '.version_select at 0x7f31a9d0e280>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:01.841527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.850382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.851868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.853046 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8831aeb-deaa-4dd5-a48c-0340ffbd7287 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.254923 Oct 27 09:08:01.868096 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1031/2057] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:01 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:01.872944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:01.873546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:01.884469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:01.885088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:01.885698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:01.886477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:01.887074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:01.887598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:01.963274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c4a809bc-f69c-40fe-a2a5-95f9d4adac8c tempest-NetworksTest-1698159078 tempest-NetworksTest-1698159078-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83" status: 200 len: 652 microversion: 2.1 time: 0.135702 Oct 27 09:08:01.964177 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1027/2058] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:08:01 2022] GET /compute/v2.1/os-networks/7c4ad0b1-a411-4a27-9581-ffdaa7b4aa83 => generated 652 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:08:01.973319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3fa46815-f9a4-4205-9a4c-60b4329a9d4b tempest-NetworksTest-1698159078 tempest-NetworksTest-1698159078-project-admin] Calling method '.version_select at 0x7f31a9d0e940>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:01.981807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.994234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:01.998362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:02.006975 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-987a7004-e6ac-4ae7-8d9f-992795dffc0f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.137430 Oct 27 09:08:02.007960 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1032/2059] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:01 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:02.188954 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3fa46815-f9a4-4205-9a4c-60b4329a9d4b tempest-NetworksTest-1698159078 tempest-NetworksTest-1698159078-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 7400 microversion: 2.1 time: 0.219232 Oct 27 09:08:02.189943 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1028/2060] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:08:01 2022] GET /compute/v2.1/os-networks => generated 7400 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:08:02.431723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:02.432264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:02.432697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:02.433499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:02.441465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:02.442051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:02.442560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:02.443204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:02.443427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:02.444126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:02.444381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:02.444691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:02.446312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:02.447314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:02.448542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:02.449659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:02.677721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:02.691334 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd21b9e9-05b6-4eee-94b6-fce308c7e027 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1474 microversion: 2.1 time: 0.264507 Oct 27 09:08:02.711400 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1029/2061] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:02 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:02.718109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:02.718735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:02.723151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:02.731329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:02.732268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:02.732822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:02.733747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:02.734315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:02.735004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:02.741055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:02.742515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:02.744452 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d921a45-2670-4f9e-b7d7-c7326480daa0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.317921 Oct 27 09:08:02.745022 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1033/2062] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:02 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:02.889521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:02.890256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:02.907526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:02.908082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:02.908796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:02.910352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:02.911294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:02.912479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:02.945634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:02.955607 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-75daa5c2-5762-4c55-a066-2d67446792e7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.247305 Oct 27 09:08:02.956409 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1030/2063] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:02 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:03.044363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:03.045357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:03.057460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:03.059096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:03.061125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:03.062291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:03.072189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:03.072649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:03.162074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:03.174739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:03.178281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:03.180118 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6cc22a8a-0b9b-4148-b98b-c527ef9c8186 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.296041 Oct 27 09:08:03.192745 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1034/2064] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:02 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:03.226752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:03.235033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:03.236620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:03.242082 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6791a54e-bbdf-4771-a282-6e15d19530c5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.202182 Oct 27 09:08:03.242656 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1031/2065] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:03 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:03.719488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:03.720483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:03.734421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:03.739430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:03.740584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:03.741383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:03.742144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:03.742658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:03.777528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:03.779164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:03.796639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:03.797586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:03.798438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:03.801134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:03.802911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:03.805688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:04.147135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:04.163009 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ddabe2d-35fa-44ed-a89c-95ad48d1d9c3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1474 microversion: 2.1 time: 0.447393 Oct 27 09:08:04.181198 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1035/2066] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:03 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1474 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:04.188326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:04.188955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:04.195216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:04.196571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:04.197227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:04.198128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:04.198771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:04.199491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:04.214608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:04.219160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:04.288752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:04.293423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:04.304391 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e740c940-47dd-487b-8cd5-b2b4b76856a4 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.532233 Oct 27 09:08:04.310825 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1032/2067] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:03 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:04.332377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:04.333223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:04.359285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:04.360129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:04.360864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:04.361909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:04.362537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:04.363254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:04.813551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:04.826893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:04.834717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:04.836315 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-debb0887-b640-44c8-9185-48655fb60789 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.524047 Oct 27 09:08:04.837167 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1033/2068] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:04 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:04.861406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:04.868728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:04.888622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:04.890763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:04.892348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:04.893351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:04.895591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:04.897721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:04.910753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:04.954202 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b9c4989-47d5-4a31-be89-134d2a5be27b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.770354 Oct 27 09:08:04.955177 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1036/2069] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:04 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:05.077079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:05.093748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:05.097413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:05.112246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d0eead0a-b96f-4649-9b50-e0c8e6e1875b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.258073 Oct 27 09:08:05.115813 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1034/2070] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:04 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:05.188929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:05.189536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:05.202672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:05.203189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:05.203764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:05.204711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:05.211245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:05.212243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:05.252560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a735454e-22c8-47f1-a66b-dca5f8d3caa0 req-fcae0406-4720-49a6-99cc-14cc294a5c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f46edbb-82a0-4749-a443-02e5ca52e341", "name": "network-vif-deleted", "tag": "4f73cce5-2a06-488c-8855-f44a51f4779a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:05.272140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a735454e-22c8-47f1-a66b-dca5f8d3caa0 req-fcae0406-4720-49a6-99cc-14cc294a5c2d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:05.274670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a735454e-22c8-47f1-a66b-dca5f8d3caa0 req-fcae0406-4720-49a6-99cc-14cc294a5c2d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:05.276082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a735454e-22c8-47f1-a66b-dca5f8d3caa0 req-fcae0406-4720-49a6-99cc-14cc294a5c2d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:05.313246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a735454e-22c8-47f1-a66b-dca5f8d3caa0 req-fcae0406-4720-49a6-99cc-14cc294a5c2d service nova] Creating event network-vif-deleted:4f73cce5-2a06-488c-8855-f44a51f4779a for instance 1f46edbb-82a0-4749-a443-02e5ca52e341 on n-h1-858383-16 Oct 27 09:08:05.319742 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a735454e-22c8-47f1-a66b-dca5f8d3caa0 req-fcae0406-4720-49a6-99cc-14cc294a5c2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070601 Oct 27 09:08:05.321406 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1035/2071] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:08:05.339751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:05.340723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:05.350197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:05.358252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:05.359296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:05.360331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:05.361514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:05.362363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:05.362973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:05.410089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c4e0fe197a41fdaab411474b35aff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2cb516397542a1b9ffa3d8d9dd0499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:05.426701 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ce56d06-68ab-4447-b39b-0113cdf516ad tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 200 len: 1432 microversion: 2.1 time: 0.241718 Oct 27 09:08:05.443803 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1037/2072] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:05 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 1432 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:05.591179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:05.611403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:05.613431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:05.614799 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-29efd20a-c08f-4425-8cfd-c9312f695fd1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.279372 Oct 27 09:08:05.615459 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1036/2073] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:05 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:05.867849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:05.869151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:05.924959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:05.925792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:05.928842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:05.932464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:05.932959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:05.934027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:05.978784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:05.980124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:05.989855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:05.992247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:05.992898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:05.996476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:05.997177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:05.997803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:06.317308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.335852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.335852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.341518 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a2b07c37-cdfd-4304-ad57-260ddc29429c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.477960 Oct 27 09:08:06.360027 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1038/2074] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:05 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:08:06.368275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.376333 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d7567a4-6aee-4c99-917f-340286e5d530 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.401792 Oct 27 09:08:06.379826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:06.381218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:06.400322 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1037/2075] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:05 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:06.400957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:06.402594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:06.404160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:06.406583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:06.409423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:06.410508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:06.453592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:06.454224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] [instance: 1f46edbb-82a0-4749-a443-02e5ca52e341] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:06.477239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:06.477681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:06.478138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:06.478856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:06.479309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:06.479881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:06.495183 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] HTTP exception thrown: Instance 1f46edbb-82a0-4749-a443-02e5ca52e341 could not be found. Oct 27 09:08:06.506095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Request method failure captured: Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 HTTP/1.1 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWknSg2aiku_2WMyFEFlh4RXIKGnRRU-jV-Ni3aSh4uVwI3zoN-hCSEejEvzwf8gSeaNNlMyWnC8nmv8wetV7ZhfzQUuu4MBn-tH6JlGR1VgBQa_E3YL69fT5hst2nm9QVJNPlqEbvZ4IwP_eP-q0Qx9NyFkuB34hy45oeqTT0iJraaM Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: ce2cb516397542a1b9ffa3d8d9dd0499 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ListImageFiltersTestJSON-1730008489 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2cb516397542a1b9ffa3d8d9dd0499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce2cb516397542a1b9ffa3d8d9dd0499"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce2cb516397542a1b9ffa3d8d9dd0499"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce2cb516397542a1b9ffa3d8d9dd0499"}]}] Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ListImageFiltersTestJSON-1730008489 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: ce2cb516397542a1b9ffa3d8d9dd0499 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1730008489 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ListImageFiltersTestJSON-1730008489-project Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: d6c4e0fe197a41fdaab411474b35aff5 Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ListImageFiltersTestJSON-1730008489-project Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 1f46edbb-82a0-4749-a443-02e5ca52e341 could not be found. Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '1f46edbb-82a0-4749-a443-02e5ca52e341'} Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f46edbb-82a0-4749-a443-02e5ca52e341 could not be found. Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f46edbb-82a0-4749-a443-02e5ca52e341 could not be found. Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:06.506625 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:06.512749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:06.512749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:06.512749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:06.512749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:06.512749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:06.512749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f46edbb-82a0-4749-a443-02e5ca52e341 could not be found. Oct 27 09:08:06.512749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:06.514356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Returning 404 to user: Instance 1f46edbb-82a0-4749-a443-02e5ca52e341 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:06.518332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.519179 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bcd950b8-c8c1-48cb-ab42-f0f9f643d06e tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341" status: 404 len: 111 microversion: 2.1 time: 0.066387 Oct 27 09:08:06.520012 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1038/2076] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:06 2022] GET /compute/v2.1/servers/1f46edbb-82a0-4749-a443-02e5ca52e341 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:08:06.523757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.527714 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa5064c8-4cd0-48cf-9a72-2c6a1ce536dd tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.162930 Oct 27 09:08:06.528711 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1039/2077] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:06 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:06.535427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82fc824c-d860-4eb6-8f5a-420c95a8c1a8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d0ee50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:06.643792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:06.644717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:06.654789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:06.658069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:06.658757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:06.663211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:06.664129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:06.664786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:06.941719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.954993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.969671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:06.971002 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abb3dda0-6321-47f0-80c8-bdc014db7b94 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.331371 Oct 27 09:08:06.971685 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1040/2078] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:06 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:07.437664 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e375d06-b511-42d8-972f-5ff071497170 tempest-TenantUsagesNegativeTestJSON-2026604504 tempest-TenantUsagesNegativeTestJSON-2026604504-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-26T09%3A08%3A07.140174&end=2022-10-28T09%3A08%3A07.140174" status: 404 len: 112 microversion: - time: 0.293261 Oct 27 09:08:07.438195 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1041/2079] 10.222.0.25 () {58 vars in 1316 bytes} [Thu Oct 27 09:08:07 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-26T09%3A08%3A07.140174&end=2022-10-28T09%3A08%3A07.140174 => generated 112 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 27 09:08:07.444804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:07.444804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:07.471174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:07.472025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:07.472666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:07.473573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:07.474770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:07.475398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:07.518183 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82fc824c-d860-4eb6-8f5a-420c95a8c1a8 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "DELETE /compute/v2.1/images/605e0a09-e169-4bfd-9724-8815495b253a" status: 204 len: 0 microversion: 2.1 time: 0.993032 Oct 27 09:08:07.518844 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1039/2080] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:06 2022] DELETE /compute/v2.1/images/605e0a09-e169-4bfd-9724-8815495b253a => generated 0 bytes in 994 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:08:07.524789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:07.528369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:07.545265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:07.546182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:07.546629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:07.547706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:07.548469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:07.549198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:07.789138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:07.807913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:07.810704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:07.819599 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a487726-24f1-4e10-af93-79fbcf6e472b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.380337 Oct 27 09:08:07.835614 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1042/2081] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:07 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:07.843609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79daa354-9c6f-46c1-baad-ccf6f2fd2cd3 tempest-TenantUsagesNegativeTestJSON-2026604504 tempest-TenantUsagesNegativeTestJSON-2026604504-project-admin] Calling method '.version_select at 0x7f31ae532a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:07.844211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:07.850008 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-79daa354-9c6f-46c1-baad-ccf6f2fd2cd3 tempest-TenantUsagesNegativeTestJSON-2026604504 tempest-TenantUsagesNegativeTestJSON-2026604504-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79daa354-9c6f-46c1-baad-ccf6f2fd2cd3 tempest-TenantUsagesNegativeTestJSON-2026604504 tempest-TenantUsagesNegativeTestJSON-2026604504-project-admin] Request method failure captured: Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-simple-tenant-usage/01a552a63368464c9ec6a760803eb500?start=2022-10-28T09%3A08%3A07.140174&end=2022-10-26T09%3A08%3A07.140174 HTTP/1.1 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkp2Ru0sNnD5nAtiHK-EG-iXNyOIKB8UcGHtzoUFZdpNJ_YvyYwyQaJwX9Bt_P4BZ90PgLk9_wSamomATzCITcH9LHABYMVpEfdE8FzpDj__n5hoQTa3xt1VE9kWxIvn9FDKcpWFEtaGV48H7ziqhrDqUuE84dwK8WVVjHW41tW2ny4 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: ef02fd9261124f3dadcd51ec91cbef17 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2026604504 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef02fd9261124f3dadcd51ec91cbef17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ef02fd9261124f3dadcd51ec91cbef17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ef02fd9261124f3dadcd51ec91cbef17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ef02fd9261124f3dadcd51ec91cbef17"}]}] Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2026604504 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: ef02fd9261124f3dadcd51ec91cbef17 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2026604504 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TenantUsagesNegativeTestJSON-2026604504-project-admin Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 2e4c39af756c42ffbd00065c58da4693 Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2026604504-project-admin Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid start time. The start time cannot occur after the end time. Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '01a552a63368464c9ec6a760803eb500'} Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 27 09:08:07.854425 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:07.866343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79daa354-9c6f-46c1-baad-ccf6f2fd2cd3 tempest-TenantUsagesNegativeTestJSON-2026604504 tempest-TenantUsagesNegativeTestJSON-2026604504-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:07.866343 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79daa354-9c6f-46c1-baad-ccf6f2fd2cd3 tempest-TenantUsagesNegativeTestJSON-2026604504 tempest-TenantUsagesNegativeTestJSON-2026604504-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/01a552a63368464c9ec6a760803eb500?start=2022-10-28T09%3A08%3A07.140174&end=2022-10-26T09%3A08%3A07.140174" status: 400 len: 111 microversion: 2.1 time: 0.032406 Oct 27 09:08:07.866343 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1043/2082] 10.222.0.25 () {58 vars in 1412 bytes} [Thu Oct 27 09:08:07 2022] GET /compute/v2.1/os-simple-tenant-usage/01a552a63368464c9ec6a760803eb500?start=2022-10-28T09%3A08%3A07.140174&end=2022-10-26T09%3A08%3A07.140174 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:08:07.866343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10ba4eff-abae-4492-bf45-cbc630b865be tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31ae4b5940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:07.893710 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-70bda205-ce4d-4db8-9604-ad86faadd875 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.366820 Oct 27 09:08:07.898579 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1040/2083] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:07 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:07.911051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:07.915204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:07.935287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:07.935804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:07.936396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:07.937242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:07.937790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:07.938269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:08.121428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:08.133562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:08.135853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:08.144401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86dd91e5-863e-4b75-bfc2-b6c4575f9be0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.244063 Oct 27 09:08:08.145498 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1041/2084] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:07 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:08.296167 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10ba4eff-abae-4492-bf45-cbc630b865be tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "DELETE /compute/v2.1/images/b5d7061f-63c9-48a1-8061-18c94e133702" status: 204 len: 0 microversion: 2.1 time: 0.436510 Oct 27 09:08:08.301257 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1044/2085] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:07 2022] DELETE /compute/v2.1/images/b5d7061f-63c9-48a1-8061-18c94e133702 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:08:08.306942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:08.307837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:08.316442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:08.317464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:08.319541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:08.320496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:08.321196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:08.322441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:08.369211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7530801-3eeb-488d-807e-a0eca2649be9 tempest-TenantUsagesNegativeTestJSON-1790259413 tempest-TenantUsagesNegativeTestJSON-1790259413-project] Calling method '.version_select at 0x7f31a9ca5430>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:08.376868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7530801-3eeb-488d-807e-a0eca2649be9 tempest-TenantUsagesNegativeTestJSON-1790259413 tempest-TenantUsagesNegativeTestJSON-1790259413-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '1b788257f7194926ae1d11a36e2774f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a552a63368464c9ec6a760803eb500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7530801-3eeb-488d-807e-a0eca2649be9 tempest-TenantUsagesNegativeTestJSON-1790259413 tempest-TenantUsagesNegativeTestJSON-1790259413-project] Request method failure captured: Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T09%3A08%3A07.140174&end=2022-10-28T09%3A08%3A07.140174&detailed=1 HTTP/1.1 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkp1AtoylEQw3NScB6YQesj47tUSmoK8X8BMryDa2a8gFow8DLTENQN79QpHSVR2SzTWD5Y3ZQuAsIn8pcywt9czw6dmKuESErDfxZFty_ouOMA66WRddiXuIraotsKgVQ4n6Et9QqMACzRBIssntsV7bvBrxY8NAVzgly7PWFE63Pk Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 01a552a63368464c9ec6a760803eb500 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1790259413 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01a552a63368464c9ec6a760803eb500"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01a552a63368464c9ec6a760803eb500"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01a552a63368464c9ec6a760803eb500"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01a552a63368464c9ec6a760803eb500"}]}] Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1790259413 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 01a552a63368464c9ec6a760803eb500 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1790259413 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TenantUsagesNegativeTestJSON-1790259413-project Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 1b788257f7194926ae1d11a36e2774f3 Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1790259413-project Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: action_args: {} Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:08:08.379317 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 27 09:08:08.394737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:08.397776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7530801-3eeb-488d-807e-a0eca2649be9 tempest-TenantUsagesNegativeTestJSON-1790259413 tempest-TenantUsagesNegativeTestJSON-1790259413-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:08.402620 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a7530801-3eeb-488d-807e-a0eca2649be9 tempest-TenantUsagesNegativeTestJSON-1790259413 tempest-TenantUsagesNegativeTestJSON-1790259413-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T09%3A08%3A07.140174&end=2022-10-28T09%3A08%3A07.140174&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.253291 Oct 27 09:08:08.404590 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1042/2086] 10.222.0.25 () {58 vars in 1335 bytes} [Thu Oct 27 09:08:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-26T09%3A08%3A07.140174&end=2022-10-28T09%3A08%3A07.140174&detailed=1 => generated 123 bytes in 258 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:08:08.416004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-341be229-3b3b-46f3-a355-ad0695508fb3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] Calling method '.version_select at 0x7f31a9d0e670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:08.513233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:08.528174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:08.531605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:08.534041 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f023c5c6-87a5-414c-8914-b2766c81ede1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.231159 Oct 27 09:08:08.534992 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1045/2087] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:08 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:08.824372 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-341be229-3b3b-46f3-a355-ad0695508fb3 tempest-ListImageFiltersTestJSON-1730008489 tempest-ListImageFiltersTestJSON-1730008489-project] 10.222.0.25 "DELETE /compute/v2.1/images/b1a069bd-936e-487d-b7d7-b7766dad2ebf" status: 204 len: 0 microversion: 2.1 time: 0.418637 Oct 27 09:08:08.825021 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1043/2088] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:08 2022] DELETE /compute/v2.1/images/b1a069bd-936e-487d-b7d7-b7766dad2ebf => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:08:08.852300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:08.853170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:08.862739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:08.862739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:08.862739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:08.862739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:08.862739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:08.862739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:08.929470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:08.931863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:08.942589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:08.943072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:08.943905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:08.944348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:08.945091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:08.945091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:09.083828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.103828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.109592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.111311 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b38e8d91-3ad9-4912-bbb2-ff9d0dbb652e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.264542 Oct 27 09:08:09.137482 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1046/2089] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:08 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:09.151132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.159805 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da6be4b1-d610-421f-b4e4-19849c458063 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.238524 Oct 27 09:08:09.160508 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1044/2090] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:08 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:08:09.181145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:09.184559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:09.197958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:09.198378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:09.207528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:09.209046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:09.209512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:09.210353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:09.341540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.357188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.361570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.376799 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53ccccc8-4ccf-4353-9188-b980c51fa46a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.200508 Oct 27 09:08:09.378925 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1047/2091] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:09 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:09.561777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:09.562565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:09.570784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:09.571591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:09.572365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:09.573394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:09.574169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:09.574716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:09.766193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.780807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.784960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:09.787693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ab82ed9-76d3-45e5-a790-d3257a764fa1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.230631 Oct 27 09:08:09.789569 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1045/2092] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:09 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:10.144724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:10.145571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:10.155054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:10.156581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:10.157416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:10.158361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:10.159038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:10.159731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:10.190140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:10.190812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:10.205221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:10.205929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:10.209141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:10.209932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:10.210375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:10.210813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:10.520142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:10.529630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e27c0f4a-0da7-459f-bde5-66709dd6b0db tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.344419 Oct 27 09:08:10.530220 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1046/2093] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:10 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:08:10.542291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:10.550204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:10.558499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:10.563433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:10.564284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:10.564955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:10.567442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:10.568981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:10.569788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:10.579149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:10.585841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:10.587140 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46a8d6f4-ab5f-4f26-ad29-61a6fbb87a3e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.446341 Oct 27 09:08:10.589462 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1048/2094] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:10 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:10.689163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:10.700156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:10.702116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:10.722229 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ec953f25-f12e-49be-ab92-c330d6aab787 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.185030 Oct 27 09:08:10.735195 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1047/2095] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:10 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:10.822301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:10.822943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:10.830108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:10.832111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:10.833532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:10.836057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:10.837690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:10.840801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:11.137992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.145186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:11.150732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.153964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.156644 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e73c629-ab97-4c21-b988-376a2144a05f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.339811 Oct 27 09:08:11.157788 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1049/2096] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:10 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:11.224697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43f14091-1a9a-4d82-9cf4-da6b517bf682 tempest-ListImageFiltersNegativeTestJSON-138748340 tempest-ListImageFiltersNegativeTestJSON-138748340-project] Calling method '.version_select at 0x7f31a9dc0d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:11.248097 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-43f14091-1a9a-4d82-9cf4-da6b517bf682 tempest-ListImageFiltersNegativeTestJSON-138748340 tempest-ListImageFiltersNegativeTestJSON-138748340-project] HTTP exception thrown: Image not found. Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43f14091-1a9a-4d82-9cf4-da6b517bf682 tempest-ListImageFiltersNegativeTestJSON-138748340 tempest-ListImageFiltersNegativeTestJSON-138748340-project] Request method failure captured: Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/images/f9a55cc3-c218-40b3-8034-168c2a8dddd5 HTTP/1.1 Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkp6JlE3viDUtMIUl-Ojlc18GDmNl1d6t9Tf0S4MF05AU4y0mHKPvM73pWDIOFkB_AsAqZq0k2KYuowz17F8rQ849KQmHKvXWJR2QV7uBtqPAgMn2hE5ip1jFVhkOfFkftmRkW6MNlYdgi8eoKxeUK92KqQ7-Ti9bMwxjpK9tTVM9Qs Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7d453b5dc3684530ad63c9952d36140b Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-138748340 Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d453b5dc3684530ad63c9952d36140b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d453b5dc3684530ad63c9952d36140b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d453b5dc3684530ad63c9952d36140b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d453b5dc3684530ad63c9952d36140b"}]}] Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-138748340 Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7d453b5dc3684530ad63c9952d36140b Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-138748340 Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ListImageFiltersNegativeTestJSON-138748340-project Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8602b80ae408463dae6d02b01dc3ca32 Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-138748340-project Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f9a55cc3-c218-40b3-8034-168c2a8dddd5'} Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f9a55cc3-c218-40b3-8034-168c2a8dddd5 Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:08:11.258581 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f9a55cc3-c218-40b3-8034-168c2a8dddd5 could not be found. Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:11.264037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43f14091-1a9a-4d82-9cf4-da6b517bf682 tempest-ListImageFiltersNegativeTestJSON-138748340 tempest-ListImageFiltersNegativeTestJSON-138748340-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:11.270953 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43f14091-1a9a-4d82-9cf4-da6b517bf682 tempest-ListImageFiltersNegativeTestJSON-138748340 tempest-ListImageFiltersNegativeTestJSON-138748340-project] 10.222.0.25 "GET /compute/v2.1/images/f9a55cc3-c218-40b3-8034-168c2a8dddd5" status: 404 len: 62 microversion: 2.1 time: 0.256496 Oct 27 09:08:11.274711 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1048/2097] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:08:11 2022] GET /compute/v2.1/images/f9a55cc3-c218-40b3-8034-168c2a8dddd5 => generated 62 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:08:11.557049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:11.558199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:11.567543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:11.569280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:11.569887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:11.571434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:11.572280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:11.572924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:11.614524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:11.616393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:11.625321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:11.626263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:11.627404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:11.628522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:11.632498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:11.633051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:11.780428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.790185 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa466558-1d67-406f-aca0-bab76f750a28 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.237128 Oct 27 09:08:11.803941 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1050/2098] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:11 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:11.803941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:11.809556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:11.815849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:11.816375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:11.816825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:11.818648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:11.818933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:11.819719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:11.830077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.841668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.843945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.845621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f40ab87-7519-4392-ab52-842f2a42665e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1743 microversion: 2.20 time: 0.235188 Oct 27 09:08:11.846364 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1049/2099] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:11 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1743 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:11.897671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.905994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.907864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:11.912926 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f4aeebf-a5df-4510-8f38-f578c47639d4 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.113858 Oct 27 09:08:11.913604 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1051/2100] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:11 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:12.188541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:12.189182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:12.195717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:12.196403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:12.196844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:12.197540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:12.198177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:12.198819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:12.712272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:12.722387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:12.723923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:12.725308 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16c5c0f9-4035-4815-b75b-a335baa9fb42 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.541344 Oct 27 09:08:12.725806 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1050/2101] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:12 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:12.818256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:12.820179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:12.831706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:12.832698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:12.833508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:12.834456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:12.836510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:12.837311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:12.883287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:12.884304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:12.892171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:12.893087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:12.893767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:12.894718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:12.895312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:12.896057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:13.075835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:13.086009 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac5e958d-bc58-4439-94fa-c6e73f3fe48d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.272538 Oct 27 09:08:13.086616 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1052/2102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:12 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:13.093346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:13.094345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:13.114455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:13.116743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:13.118953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:13.119893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:13.120211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:13.120841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:13.157560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:13.178147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:13.179836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:13.183794 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98fd4976-acea-4a2b-b8cc-9c684254df98 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1743 microversion: 2.20 time: 0.312619 Oct 27 09:08:13.185098 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1051/2103] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:12 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1743 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:08:13.222887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:13.237752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:13.242853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:13.255892 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44edc7e2-f9eb-47d5-808a-e37c7c432a23 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.166593 Oct 27 09:08:13.259407 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1053/2104] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:13 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:13.393160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34671d6d-c298-4397-aaca-93d4a47de3b3 tempest-ListImagesTestJSON-1243210756 tempest-ListImagesTestJSON-1243210756-project] Calling method '.version_select at 0x7f31a9caed30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:13.458967 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34671d6d-c298-4397-aaca-93d4a47de3b3 tempest-ListImagesTestJSON-1243210756 tempest-ListImagesTestJSON-1243210756-project] 10.222.0.25 "GET /compute/v2.1/images/a5a38eaa-9305-45a5-98b3-c9ecee92f0b1" status: 200 len: 784 microversion: 2.1 time: 0.270187 Oct 27 09:08:13.459606 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1052/2105] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:08:13 2022] GET /compute/v2.1/images/a5a38eaa-9305-45a5-98b3-c9ecee92f0b1 => generated 784 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:13.475688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb66b0d2-6917-4fbc-a009-6d59f117a40b tempest-ListImagesTestJSON-1243210756 tempest-ListImagesTestJSON-1243210756-project] Calling method '.version_select at 0x7f31ae608a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:13.529099 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb66b0d2-6917-4fbc-a009-6d59f117a40b tempest-ListImagesTestJSON-1243210756 tempest-ListImagesTestJSON-1243210756-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.057684 Oct 27 09:08:13.530241 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1054/2106] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 27 09:08:13 2022] GET /compute/v2.1/images => generated 445 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:13.542889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8eb040f0-aeec-448e-857f-e4c4d9fa5236 tempest-ListImagesTestJSON-1243210756 tempest-ListImagesTestJSON-1243210756-project] Calling method '.version_select at 0x7f31a9d28820>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:13.602665 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8eb040f0-aeec-448e-857f-e4c4d9fa5236 tempest-ListImagesTestJSON-1243210756 tempest-ListImagesTestJSON-1243210756-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.063261 Oct 27 09:08:13.618527 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1053/2107] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:08:13 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:13.753822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:13.754749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:13.761533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:13.762316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:13.762986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:13.763860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:13.764448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:13.764892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:13.985668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:13.996072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:14.001416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:14.002689 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-634a9055-469e-455f-bab7-b5a97d1d90bb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.252805 Oct 27 09:08:14.005721 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1055/2108] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:13 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:14.129253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:14.130127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:14.145575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:14.146728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:14.147658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:14.148329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:14.149056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:14.149818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:14.219866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:14.220686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:14.232251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:14.233730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:14.234368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:14.235509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:14.236411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:14.237380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:14.491049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:14.503270 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a0e48d7-b9b3-4fdd-83d7-44a1da340986 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.391756 Oct 27 09:08:14.506080 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1054/2109] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:14 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:14.522409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:14.524094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:14.531823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:14.532675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:14.533851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:14.534891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:14.536035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:14.537281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:14.567274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:14.587644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:14.590149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:14.595206 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59a4aa98-90a8-42cf-aa2a-7a52d635e687 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1743 microversion: 2.20 time: 0.381281 Oct 27 09:08:14.596209 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1056/2110] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:14 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1743 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:14.675028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:14.690277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:14.693897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:14.700582 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-12dced6c-de62-4d90-968e-eca85d0e952d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.192540 Oct 27 09:08:14.710373 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1055/2111] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:14 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:15.030669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:15.031675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:15.045436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:15.045954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:15.046911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:15.049212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:15.050238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:15.050908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:15.289877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:15.306350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:15.308024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:15.309281 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8b100339-b580-4977-a46a-d625f2e6a1c8 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.283022 Oct 27 09:08:15.309854 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1057/2112] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:15 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:15.538252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:15.538947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:15.593861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:15.595240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:15.597248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:15.598914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:15.603065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:15.603937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:15.631064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:15.631739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:15.641959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:15.642451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:15.644151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:15.645733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:15.646762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:15.649399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:15.901078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:15.905675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:15.916123 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b1834e0-c291-4309-b5aa-66959d74eb51 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.382611 Oct 27 09:08:15.916996 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1056/2113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:15 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:08:15.926968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:15.928237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:15.947915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:15.953610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:15.954437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:15.956413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:15.957390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:15.959862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:15.978238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:15.993073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:15.997603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:16.001691 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-edc11bce-ad78-4a34-acee-d7804d78a964 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1743 microversion: 2.20 time: 0.375494 Oct 27 09:08:16.005008 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1058/2114] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:15 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1743 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:08:16.077014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:16.093680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:16.099844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:16.114278 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-89de3233-bc55-4bff-a2fa-6bac4476db62 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.194344 Oct 27 09:08:16.115275 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1057/2115] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:15 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:16.339932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:16.341178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:16.363466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:16.367428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:16.369639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:16.370631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:16.371926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:16.373996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:16.551832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-06701d3c-e068-44db-a8e6-e85afd1470a6 req-31c8ab28-e152-4a9f-b2d5-50b60ee50575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d248926-b23e-472b-9a1e-4b10c924758a", "name": "network-vif-plugged", "status": "completed", "tag": "c24197dc-db5d-4363-91d8-125f1e441095"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:16.578206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06701d3c-e068-44db-a8e6-e85afd1470a6 req-31c8ab28-e152-4a9f-b2d5-50b60ee50575 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:16.580770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06701d3c-e068-44db-a8e6-e85afd1470a6 req-31c8ab28-e152-4a9f-b2d5-50b60ee50575 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:16.581837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06701d3c-e068-44db-a8e6-e85afd1470a6 req-31c8ab28-e152-4a9f-b2d5-50b60ee50575 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:16.610507 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-06701d3c-e068-44db-a8e6-e85afd1470a6 req-31c8ab28-e152-4a9f-b2d5-50b60ee50575 service nova] Creating event network-vif-plugged:c24197dc-db5d-4363-91d8-125f1e441095 for instance 3d248926-b23e-472b-9a1e-4b10c924758a on n-h1-858383-16 Oct 27 09:08:16.627818 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-06701d3c-e068-44db-a8e6-e85afd1470a6 req-31c8ab28-e152-4a9f-b2d5-50b60ee50575 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080813 Oct 27 09:08:16.634258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1058/2116] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:16.773653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:16.784884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:16.787294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:16.789461 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c16f68d-e852-42c6-9695-2eade338b1da tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.458124 Oct 27 09:08:16.790708 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1059/2117] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:16 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:16.950826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:16.951798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:16.970672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:16.971748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:16.972511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:16.973654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:16.974454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:16.975146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:17.037982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:17.040895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:17.055926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:17.058348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:17.061955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:17.064304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:17.068827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:17.070030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:17.335075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:17.347847 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f6fa5ec-4167-4fa5-9df9-69231ad3777c tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.401217 Oct 27 09:08:17.348746 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1059/2118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:16 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:17.376968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:17.379475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:17.396281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:17.396852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:17.397197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:17.397633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:17.398335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:17.398985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:17.399411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:17.409712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:17.411406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:17.413230 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e43fa911-98ec-494b-90bc-e71bbd535227 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1743 microversion: 2.20 time: 0.381480 Oct 27 09:08:17.414620 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1060/2119] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:17 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1743 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:08:17.479625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:17.490310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:17.492300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:17.498482 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-411a3034-e598-41df-aa52-2510556ce125 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.147898 Oct 27 09:08:17.499443 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1060/2120] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:17 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:17.818436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:17.819133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:17.835170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:17.835811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:17.836509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:17.837493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:17.838176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:17.838817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:18.201213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:18.219802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:18.221611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:18.226371 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78397015-a509-4736-aea6-339f90aaa0fb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.412598 Oct 27 09:08:18.228501 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1061/2121] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:17 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:18.375795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:18.376712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:18.389901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:18.391782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:18.393694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:18.395558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:18.399047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:18.400264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:18.495175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d4937b1-4ae4-4dd3-a031-5c1e7ef75886 tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] Calling method '.version_select at 0x7f31a9cb0790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:18.622336 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d4937b1-4ae4-4dd3-a031-5c1e7ef75886 tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.371396 Oct 27 09:08:18.625574 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1061/2122] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:08:18 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:08:18.645227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:18.648930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:18.664022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:18.664597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:18.665185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:18.667822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:18.668775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:18.669356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:18.830412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:18.848530 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-03988be7-1317-4e82-9623-ca75fec424c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.477936 Oct 27 09:08:18.849978 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1062/2123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:18 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:18.862833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:18.864344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:18.873588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:18.874664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:18.875508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:18.876675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:18.877374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:18.878039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:19.027837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:19.037206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:19.041845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:19.044143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:19.045577 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3c33baa0-1a4b-42da-b6b0-fea304297323 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.417775 Oct 27 09:08:19.048689 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1062/2124] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:18 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:19.067495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:19.069028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57051a9e-eba3-4d80-ad92-a54382c3f76c tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] Action: 'create', calling method: .version_select at 0x7f31a9cbaca0>, body: {"pool": "non_exist_pool"} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:19.072329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:19.087419 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc0c4098-0a38-4bc0-80cb-001157216ad9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.235652 Oct 27 09:08:19.097978 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1063/2125] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:18 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:19.186238 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-57051a9e-eba3-4d80-ad92-a54382c3f76c tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] HTTP exception thrown: Floating IP pool not found. Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57051a9e-eba3-4d80-ad92-a54382c3f76c tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] Request method failure captured: Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 26 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqC8N3xkAOZMyy1KWJMWa2uLpJwOuWajsjSW_gtOr_KT5mxn7c349IWCan3omd0jRcSAmcUWbNv6NifgqJvpsYQumJa06n9uwnS1F7X6qDBbupvHnzu6_ignl94W7MHCY-YVGb3mYs1JMeuucCJF3bhr7I7spkxUqM9FyWmUG5I2kQ Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: fb936a1829a04fe382c2a1e91e73b557 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-596668020 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb936a1829a04fe382c2a1e91e73b557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb936a1829a04fe382c2a1e91e73b557"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb936a1829a04fe382c2a1e91e73b557"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb936a1829a04fe382c2a1e91e73b557"}]}] Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-596668020 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: fb936a1829a04fe382c2a1e91e73b557 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-596668020 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FloatingIPsNegativeTestJSON-596668020-project Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5c67af83c8e7424fac187822afcab395 Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-596668020-project Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: {"pool": "non_exist_pool"} Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: exception: Floating IP pool not found. Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:19.188707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:19.197258 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 27 09:08:19.197258 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.200198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57051a9e-eba3-4d80-ad92-a54382c3f76c tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] Returning 404 to user: Floating IP pool not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:19.200198 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57051a9e-eba3-4d80-ad92-a54382c3f76c tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.148567 Oct 27 09:08:19.200948 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1063/2126] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:08:19 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:08:19.211950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a73c04c-8a7f-452e-ab5b-920f2e91b96e tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] Calling method '.version_select at 0x7f31ae608c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:19.260568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:19.260568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:19.303028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:19.305644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:19.306343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:19.307472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:19.308177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:19.308773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:19.352621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-5a73c04c-8a7f-452e-ab5b-920f2e91b96e tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a69c055b-0afc-483d-9ba6-ceaf42af96a2 could not be found", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:08:19.353370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5a73c04c-8a7f-452e-ab5b-920f2e91b96e tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] HTTP exception thrown: Floating IP not found for ID a69c055b-0afc-483d-9ba6-ceaf42af96a2 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a73c04c-8a7f-452e-ab5b-920f2e91b96e tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] Request method failure captured: Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-floating-ips/a69c055b-0afc-483d-9ba6-ceaf42af96a2 HTTP/1.1 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkqC8N3xkAOZMyy1KWJMWa2uLpJwOuWajsjSW_gtOr_KT5mxn7c349IWCan3omd0jRcSAmcUWbNv6NifgqJvpsYQumJa06n9uwnS1F7X6qDBbupvHnzu6_ignl94W7MHCY-YVGb3mYs1JMeuucCJF3bhr7I7spkxUqM9FyWmUG5I2kQ Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: fb936a1829a04fe382c2a1e91e73b557 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-596668020 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb936a1829a04fe382c2a1e91e73b557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb936a1829a04fe382c2a1e91e73b557"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb936a1829a04fe382c2a1e91e73b557"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb936a1829a04fe382c2a1e91e73b557"}]}] Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-596668020 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: fb936a1829a04fe382c2a1e91e73b557 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-596668020 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FloatingIPsNegativeTestJSON-596668020-project Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5c67af83c8e7424fac187822afcab395 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-596668020-project Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: exception: Floating IP not found for ID a69c055b-0afc-483d-9ba6-ceaf42af96a2 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'a69c055b-0afc-483d-9ba6-ceaf42af96a2'} Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a69c055b-0afc-483d-9ba6-ceaf42af96a2 could not be found Oct 27 09:08:19.355218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d03eeb48-1f31-48b1-8729-ecc210f7b005'] Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a69c055b-0afc-483d-9ba6-ceaf42af96a2. Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a69c055b-0afc-483d-9ba6-ceaf42af96a2 Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a69c055b-0afc-483d-9ba6-ceaf42af96a2 Oct 27 09:08:19.359907 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:19.364076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a73c04c-8a7f-452e-ab5b-920f2e91b96e tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] Returning 404 to user: Floating IP not found for ID a69c055b-0afc-483d-9ba6-ceaf42af96a2 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:19.365699 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a73c04c-8a7f-452e-ab5b-920f2e91b96e tempest-FloatingIPsNegativeTestJSON-596668020 tempest-FloatingIPsNegativeTestJSON-596668020-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/a69c055b-0afc-483d-9ba6-ceaf42af96a2" status: 404 len: 111 microversion: 2.1 time: 0.158535 Oct 27 09:08:19.366760 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1064/2127] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:08:19 2022] DELETE /compute/v2.1/os-floating-ips/a69c055b-0afc-483d-9ba6-ceaf42af96a2 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:08:19.709313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:19.718618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:19.730487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:19.734957 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-705c22ee-31ca-41e1-bf79-5abb08edaa47 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 0.486202 Oct 27 09:08:19.744625 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1064/2128] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:19 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:19.878541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:19.879190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:19.897589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:19.902101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:19.903218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:19.906094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:19.906607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:19.908496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:20.082182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:20.083088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:20.107457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:20.108669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:20.109784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:20.110757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:20.111450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:20.112074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:20.345884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:20.382641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:20.389296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:20.395751 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f6dabc9-26d8-479b-8c05-207cea2521f8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.318426 Oct 27 09:08:20.401481 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1065/2129] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:20 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:20.417417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:20.418412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:20.426953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:20.428132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:20.428814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:20.429795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:20.430483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:20.431169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:20.867483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:20.905276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:20.909460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:20.925203 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-73197d0f-4205-4785-a206-02bc145cfa71 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.520746 Oct 27 09:08:20.926269 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1066/2130] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:20 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:20.932788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:20.934072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:20.946390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:20.947314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:20.947816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:20.948558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:20.949255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:20.950567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:21.117588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:21.130132 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d90fef78-6a97-4eef-a009-67f39357d331 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 1.258222 Oct 27 09:08:21.130749 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1065/2131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:19 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:21.422427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:21.426490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:21.447445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:21.454787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:21.455272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:21.456147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:21.456747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:21.457038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:22.040885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:22.051072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:22.053326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:22.054983 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e27f9ff-1994-49b9-9bff-ce606d06945d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1486 microversion: 2.25 time: 1.126122 Oct 27 09:08:22.056072 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1067/2132] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:20 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1486 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:22.061077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:22.061867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:22.069354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:22.070078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:22.070913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:22.071870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:22.072634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:22.073568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:22.608843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:22.622460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:22.624351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:22.632330 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e68409e3-a839-4e12-9ead-dc239ef75e82 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.574898 Oct 27 09:08:22.633635 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1068/2133] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:22 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:22.638973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:22.639894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:22.646847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:22.647842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:22.649402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:22.650398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:22.651103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:22.651943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:22.771719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:22.786942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:22.788560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:22.790043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6cc0eee8-3c71-479c-b494-86154ac675f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 1.371568 Oct 27 09:08:22.791193 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1066/2134] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:21 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:23.081660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:23.082287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:23.090133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:23.090553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:23.090999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:23.091752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:23.097296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:23.098024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:23.137891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:23.154617 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a38a7617-ff8c-4820-9dab-0bb1e025c5bd tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.516801 Oct 27 09:08:23.178343 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1069/2135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:22 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:23.636561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:23.656331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:23.657934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:23.663117 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9e25202d-7131-4760-b4fe-8dd932116847 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1476 microversion: 2.25 time: 0.586257 Oct 27 09:08:23.667709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:23.668722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:23.669522 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1067/2136] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:23 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:08:23.691679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71fa50ce-3d72-4012-b1e1-3bef3f866f21 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '.version_select at 0x7f31aa800e50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:23.706921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:23.709607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71fa50ce-3d72-4012-b1e1-3bef3f866f21 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:23.711852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:23.712374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71fa50ce-3d72-4012-b1e1-3bef3f866f21 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:23.712866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71fa50ce-3d72-4012-b1e1-3bef3f866f21 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:23.717732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:23.720877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:23.723843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:23.725601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:23.760179 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71fa50ce-3d72-4012-b1e1-3bef3f866f21 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.072459 Oct 27 09:08:23.769367 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1068/2137] 10.222.0.25 () {60 vars in 1184 bytes} [Thu Oct 27 09:08:23 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:23.785366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:23.787621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:23.797270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:23.798373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:23.799084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:23.800792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:23.801527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:23.802280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:23.810514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:24.234731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:24.268091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:24.273376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:24.294295 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf64b0cf-a1ed-4cee-8794-7c40b1747477 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1533 microversion: 2.91 time: 0.630479 Oct 27 09:08:24.298703 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1070/2138] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:23 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1533 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:08:24.315285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:24.316210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:24.353189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] Lazy-loading 'services' on Instance uuid 8a4098cc-19c7-4dc0-b5af-55f92720b32f {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:08:24.355409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:24.356398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:24.357598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:24.361798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:24.362649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:24.363981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:24.382677 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-270b56d6-2946-42f0-9f9a-029443270738 tempest-LiveAutoBlockMigrationV225Test-1486745176 tempest-LiveAutoBlockMigrationV225Test-1486745176-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1970 microversion: 2.25 time: 0.602418 Oct 27 09:08:24.384511 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1069/2139] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:23 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1970 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:24.416353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:24.420210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:24.432707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:24.434040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:24.434826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:24.436197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:24.436930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:24.437479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:24.781378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:24.796031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:24.797842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:24.803454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b0da54a1-ad04-429c-9291-4bc8b38bf065 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.500382 Oct 27 09:08:24.806726 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1071/2140] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:24 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:24.836312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:24.837258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:24.845957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:24.846762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:24.847404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:24.849537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:24.850230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:24.850910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:25.007719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lazy-loading 'services' on Instance uuid 734f18c8-6747-4af1-a701-95a8698c877d {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:08:25.066588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:25.069535 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f3ff5fe-f039-4e01-9ce9-fe41d6173747 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1940 microversion: 2.91 time: 0.243985 Oct 27 09:08:25.072642 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1072/2141] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:24 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1940 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:25.078140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:25.078871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:25.090297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:25.091167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:25.092110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:25.094227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:25.095853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:25.113647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:25.122872 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77e7c049-66b7-4f86-9ae0-b04970e119d2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.721441 Oct 27 09:08:25.123539 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1070/2142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:24 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:25.171664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:25.173804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:25.179171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:25.202120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:25.202647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:25.203132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:25.203908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:25.210604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:25.211372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:25.214669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:08:25.290902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lazy-loading 'flavor' on Instance uuid 734f18c8-6747-4af1-a701-95a8698c877d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:08:25.444935 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d10ba70-ce25-4212-8b16-b0ffd7220c35 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 204 len: 0 microversion: 2.25 time: 0.368742 Oct 27 09:08:25.448343 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1073/2143] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:08:25 2022] DELETE /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:08:25.465002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:25.467415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:25.486732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:25.488002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:25.491819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:25.494381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:25.494899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:25.496672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:25.542743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:25.826062 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bcbf394-c015-4aa6-9349-451fb110c73d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "POST /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d/action" status: 202 len: 0 microversion: 2.91 time: 0.667870 Oct 27 09:08:25.838716 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1071/2144] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:08:25 2022] POST /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:08:25.855404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:25.860635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:25.890216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:25.893264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:25.897624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:25.900393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:25.906110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:25.909054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:25.961969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:25.979492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:25.981943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:25.983413 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5dfb4e07-d45b-402c-b802-fd915cdf8b9e tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1482 microversion: 2.25 time: 0.530758 Oct 27 09:08:25.984028 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1074/2145] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:25 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1482 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:25.997212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:25.997814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:26.045429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:26.045940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:26.046379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:26.047106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:26.047559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:26.048009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:26.114039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:26.133902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:26.137986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:26.171835 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-02efa7de-2798-4d3d-8b9d-095a4bb90026 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.331177 Oct 27 09:08:26.172717 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1072/2146] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:25 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:26.185141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:26.186762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:26.209131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:26.210475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:26.212483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:26.213636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:26.216170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:26.216988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:26.623789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:26.642188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:26.644928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:26.647095 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f8a032b-223c-488f-8800-bf33cd76f0d1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.657850 Oct 27 09:08:26.650961 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1075/2147] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:25 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:26.909368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:26.925896 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48ce8ab9-6547-47ea-aa14-0e3840efcba3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.749925 Oct 27 09:08:26.949356 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1073/2148] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:26 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:27.018530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:27.019750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:27.039987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:27.040791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:27.040950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:27.041664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:27.045295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:27.046901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:27.209826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:27.210614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:27.227185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:27.228166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:27.228891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:27.229934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:27.230655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:27.231354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:27.549636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:27.566723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:27.573518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:27.584528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:27.595024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:27.601720 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-922ce1d9-e156-499e-b550-0260443ab83a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.398566 Oct 27 09:08:27.609181 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1074/2149] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:27 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:27.610647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:27.612437 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9d8d057d-03a4-42b5-b49e-da84d69eb13d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1482 microversion: 2.25 time: 0.601608 Oct 27 09:08:27.632128 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1076/2150] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:27 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1482 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:27.682437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:27.683380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:27.697069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:27.700233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:27.700934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:27.701910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:27.702542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:27.707412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:27.953450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:27.953861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:27.970122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:27.971132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:27.971380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:27.972193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:27.973811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:27.973811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:28.531093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:28.548211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:28.550381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:28.560254 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1e3e496e-34c3-48f5-a628-38f47eade81b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.883606 Oct 27 09:08:28.561723 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1075/2151] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:27 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:28.576940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6ab33959-c929-4e15-8c37-ed166994f464 req-58325949-8dc1-4d50-a9f1-5cb2dda5fcfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4098cc-19c7-4dc0-b5af-55f92720b32f", "name": "network-vif-deleted", "tag": "f5de6da6-f70a-45de-9d70-2166b991303b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:28.614104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6ab33959-c929-4e15-8c37-ed166994f464 req-58325949-8dc1-4d50-a9f1-5cb2dda5fcfa service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:28.614501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6ab33959-c929-4e15-8c37-ed166994f464 req-58325949-8dc1-4d50-a9f1-5cb2dda5fcfa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:28.615166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6ab33959-c929-4e15-8c37-ed166994f464 req-58325949-8dc1-4d50-a9f1-5cb2dda5fcfa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:28.666840 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6ab33959-c929-4e15-8c37-ed166994f464 req-58325949-8dc1-4d50-a9f1-5cb2dda5fcfa service nova] Creating event network-vif-deleted:f5de6da6-f70a-45de-9d70-2166b991303b for instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f on n-h2-858383-16 Oct 27 09:08:28.683814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:28.702324 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6ab33959-c929-4e15-8c37-ed166994f464 req-58325949-8dc1-4d50-a9f1-5cb2dda5fcfa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137582 Oct 27 09:08:28.704852 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-432b8724-16ef-41d5-a457-61e9917c86a0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.755502 Oct 27 09:08:28.713654 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1077/2153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:27 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:28.713897 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1076/2153] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:28.730719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:28.733022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:28.738353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:28.739192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:28.759254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:28.762243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:28.764667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:28.765522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:28.767193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:28.769179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:28.771427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:28.772481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:28.775842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:28.778964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:28.779779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:28.780492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:29.230695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:29.252653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:29.254961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:29.260885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77aa7015-54aa-4685-b4f9-e90a73a2bad9 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1265 microversion: 2.25 time: 0.545135 Oct 27 09:08:29.269658 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1077/2154] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:28 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1265 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:29.295965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:29.308622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:29.310753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:29.319357 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f958299c-ef50-4c5a-9f5a-1e3ee63c9218 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.598404 Oct 27 09:08:29.320162 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1078/2155] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:28 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:29.395619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc432d86-c5a0-4f9f-be6d-dc8ac47bf3b9 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31aa13f310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-287251958", "description": "tempest-description-1634063793"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:29.593471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:29.594739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:29.606801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:29.608299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:29.609533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:29.610556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:29.611873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:29.612804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:29.862263 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc432d86-c5a0-4f9f-be6d-dc8ac47bf3b9 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.595715 Oct 27 09:08:29.863894 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1078/2156] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:08:29 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:29.870814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:29.885893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:29.914185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:29.919129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:29.920085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:29.925391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:29.926168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:29.927949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:29.935005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:29.946194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:29.954603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:29.956279 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ad4eec46-2453-4393-bf8e-ac37b5352403 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.368100 Oct 27 09:08:29.957308 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1079/2157] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:29 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:29.979318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d87ab01-3479-4161-9564-c0c105cebcf2 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31a9d0e430>, body: {"security_group_rule": {"parent_group_id": "ef8bfd27-9a71-43e1-bf59-42b9e786dedb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:30.321229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:30.330735 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b6bfe4a-f6c3-4e42-aab5-a22071802ce7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.465396 Oct 27 09:08:30.331324 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1079/2158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:29 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:30.355825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:30.356448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:30.369614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:30.370199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:30.370675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:30.371737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:30.372021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:30.372454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:31.374649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:31.387791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:31.389264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:31.390427 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b79b544-c535-42dd-b60b-d338a5921e79 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1265 microversion: 2.25 time: 1.052136 Oct 27 09:08:31.390991 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1080/2159] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:30 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1265 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:31.431954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:31.432769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:31.442235 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d87ab01-3479-4161-9564-c0c105cebcf2 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.478935 Oct 27 09:08:31.443023 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1080/2160] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:08:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:31.448770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:31.451334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:31.451742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:31.454115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:31.464458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:31.465536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:31.466337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:31.466640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:31.467879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:31.468662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:31.469540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:31.471757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:31.472286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:31.472851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:31.672985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:31.690812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:31.693385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:31.701100 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c6a6047-b31b-4108-8050-e9483fd9793c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.283417 Oct 27 09:08:31.717172 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1081/2161] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:31 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:31.734046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:31.735195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:31.744255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:31.745114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:31.745842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:31.746899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:31.747785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:31.748715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:31.854473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:31.870216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:31.872365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:31.884150 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ba0c977-5bd7-4386-bade-d6b256b9de3d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.439220 Oct 27 09:08:31.885725 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1081/2162] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:31 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:31.904645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-af54bc85-95e9-427d-ace3-dba78160b3d8 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31a9cae3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1573898572", "description": "tempest-description-220665086"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:32.094382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:32.115141 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33ee0363-4b6f-4272-9d8f-d9c6fbcf1a8e tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1473 microversion: 2.1 time: 0.393399 Oct 27 09:08:32.119778 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1082/2163] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:31 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:32.322818 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-af54bc85-95e9-427d-ace3-dba78160b3d8 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.435199 Oct 27 09:08:32.335148 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1082/2164] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:08:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:32.341573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6adfa791-38a4-43dc-8cf4-851c85194068 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31aa8269d0>, body: {"security_group_rule": {"parent_group_id": "2c321bcf-b94f-4154-8079-037e6a8e7b6a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:32.423210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:32.424136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:32.439053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:32.441044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:32.442470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:32.442470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:32.443178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:32.443178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:32.443602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:32.925097 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6adfa791-38a4-43dc-8cf4-851c85194068 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.589727 Oct 27 09:08:32.936049 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1083/2165] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:08:32 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:32.936049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:32.936049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:32.958286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:32.959525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:32.960225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:32.961068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:32.961729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:32.962274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:33.062230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.082446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.087017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.089069 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-14a0fb18-80d1-4b0a-ab8b-451da629330c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1265 microversion: 2.25 time: 0.670594 Oct 27 09:08:33.107607 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1083/2166] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:32 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1265 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:33.107607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:33.107607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:33.120703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:33.124861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:33.125384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:33.126137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:33.126607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:33.127028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:33.162261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.178718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.181227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.203643 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3aa5ee7-74f5-45e3-b472-b002fb7ee776 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.275662 Oct 27 09:08:33.221021 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1084/2167] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:32 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:33.240695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5749a49-629e-4747-bbd8-e8389a0bfa27 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31ae5565e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1146764714", "description": "tempest-description-246499059"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:33.368441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.383096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.384827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.386232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-afb5ccd4-5f36-434b-b98c-30a8aef1dd1a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.291822 Oct 27 09:08:33.403748 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1084/2168] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:33 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:33.403748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:33.403748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:33.421226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:33.421780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:33.422162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:33.422891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:33.425376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:33.425839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:33.817027 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5749a49-629e-4747-bbd8-e8389a0bfa27 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.594669 Oct 27 09:08:33.820206 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1085/2169] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:08:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:33.832739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-919b9875-c75b-418f-b7d8-7af7eedcdbd6 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31aa8260d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1885184783", "description": "tempest-description-1181005605"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:33.928573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:33.937444 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-baedcfd0-23e1-42fb-8382-da89ada05795 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1479 microversion: 2.1 time: 0.542432 Oct 27 09:08:33.938025 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1085/2170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:33 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1479 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:34.118675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:34.119474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:34.131049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:34.133762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:34.141779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:34.144260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:34.148325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:34.149137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:34.340506 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-919b9875-c75b-418f-b7d8-7af7eedcdbd6 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.511496 Oct 27 09:08:34.341443 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1086/2171] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:08:33 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:34.346520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:34.347080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:34.361532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:34.371548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:34.375606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:34.377651 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7abd958e-e448-4ae6-9f48-99701bfbffd0 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1265 microversion: 2.25 time: 0.262947 Oct 27 09:08:34.378871 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1086/2172] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:34 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:08:34.390031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcdcf0a6-0d37-4420-b38d-087713f6c315 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31a9c90dc0>, body: {"security_group_rule": {"parent_group_id": "5d70c1dd-c557-475f-8fd3-02a2e9faf9ec", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "fd033c8b-35a4-49d1-ac1c-27d22988494d"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:34.394016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:34.394545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:34.394986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:34.404318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:34.404945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:34.405384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:34.689964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:34.723206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:34.728806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:34.744735 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d8cb84a-e83e-4787-b595-98855fdd4c1e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.400790 Oct 27 09:08:34.747972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1087/2173] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:34 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:34.784561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:34.795415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:34.810465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:34.810974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:34.811662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:34.812602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:34.813255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:34.813867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:34.853025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:35.259446 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bcdcf0a6-0d37-4420-b38d-087713f6c315 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.879140 Oct 27 09:08:35.264167 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1087/2174] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:08:34 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:35.269650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:35.270485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:35.280104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:35.295738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:35.297581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:35.298054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:35.299211 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94d4b9eb-86ca-47ef-9f7e-f69de9fb8a67 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.549579 Oct 27 09:08:35.300829 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1088/2175] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:34 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:35.307679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f42f0c4-9504-4497-9c2c-4fe6db14cc2c tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31ae4b5ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-784192000", "description": "tempest-description-195894355"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:35.316801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:35.317270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:35.318103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:35.318568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:35.318995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:35.648024 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f42f0c4-9504-4497-9c2c-4fe6db14cc2c tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.345454 Oct 27 09:08:35.648738 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1089/2176] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:08:35 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:35.654496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:35.655107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:35.684168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:35.684990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:35.687071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:35.688235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:35.690734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:35.694714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:35.923519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:35.939006 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2748b7db-f28f-42ff-bd38-7f02549c2e60 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1479 microversion: 2.1 time: 0.673450 Oct 27 09:08:35.943747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:35.957075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:35.957343 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1088/2177] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:35 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1479 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:35.968467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:35.970290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9c2e31e-f88f-4a79-a3ab-27a8d7a69064 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31a9c909d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-87743475", "description": "tempest-description-174150676"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:35.972013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5d4b954-fa7c-45cf-918a-7635c9c09908 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1265 microversion: 2.25 time: 0.321924 Oct 27 09:08:35.973700 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1090/2178] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:35 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1265 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:35.983272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:35.984322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:35.993541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:35.994390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:35.995063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:35.996077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:35.996756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:35.997581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:36.122255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:36.144178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:36.150554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:36.166645 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab2e4ca7-d2c2-4ee8-a37c-757616ce6f98 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.190351 Oct 27 09:08:36.167687 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1091/2179] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:35 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:36.297523 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9c2e31e-f88f-4a79-a3ab-27a8d7a69064 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.338979 Oct 27 09:08:36.298582 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1089/2180] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:08:35 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:36.313062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3854ce3-df45-4ed3-93b2-422ddf7a2c76 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31ae4b5670>, body: {"security_group_rule": {"parent_group_id": "3265a85e-7dab-422e-8c8e-f4cc9c696b9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e3294150-024d-479a-b5b3-456d8737fbb0"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:36.347488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:36.348145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:36.365628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:36.369695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:36.370190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:36.370961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:36.371425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:36.371903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:36.860784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:36.872216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:36.875348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:36.878285 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db9a20ce-e97b-40b7-9df3-a9466e0e6d43 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.546178 Oct 27 09:08:36.894580 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1090/2181] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:36 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:36.967607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:36.969254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:36.984136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:36.987040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:36.990738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:36.995844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:36.997292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:37.000340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:37.229666 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3854ce3-df45-4ed3-93b2-422ddf7a2c76 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.920369 Oct 27 09:08:37.230594 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1092/2182] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:08:36 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:37.236344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:37.237424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:37.267402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:37.268421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:37.269093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:37.270009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:37.270647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:37.272222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:37.392728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:37.404080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:37.413745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:37.420080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:37.426344 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a4afcecd-a7c6-4469-a3b2-e170c6bd4523 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1479 microversion: 2.1 time: 0.464809 Oct 27 09:08:37.429632 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50421baa-5b66-4215-86fd-4916b1185a9d tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1265 microversion: 2.25 time: 0.197907 Oct 27 09:08:37.430961 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1091/2183] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:36 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1479 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:08:37.451782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:37.452399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:37.453732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1093/2184] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:37 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:37.462479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf644e45-d66f-4645-bd8e-bb9390d203e6 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31aa8001f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:37.484089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:37.484588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:37.485031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:37.485751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:37.490594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:37.491050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:37.642673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:37.656999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:37.661141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:37.680119 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-552ba23a-c1d3-4720-9d0c-4d9d755fb34f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.243675 Oct 27 09:08:37.681306 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1092/2185] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:37 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:38.023150 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf644e45-d66f-4645-bd8e-bb9390d203e6 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e3294150-024d-479a-b5b3-456d8737fbb0" status: 202 len: 0 microversion: 2.1 time: 0.567570 Oct 27 09:08:38.023898 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1094/2186] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:08:37 2022] DELETE /compute/v2.1/os-security-groups/e3294150-024d-479a-b5b3-456d8737fbb0 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:08:38.029555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:38.030312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:38.043635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.046096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.046754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.048143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.050542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.051089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.176688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:38.177249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:38.191663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.192421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.193464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.194227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.194687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.195217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.283857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:08:38.385057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:38.520400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:38.529860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:38.532905 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79a1a240-1a6b-4dec-a8f6-e432b8068f7c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 204 len: 0 microversion: 2.32 time: 0.723057 Oct 27 09:08:38.538612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:38.539012 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1093/2187] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:08:37 2022] DELETE /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 09:08:38.540003 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f412f190-f887-4a47-8e97-091ee5c14234 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.514907 Oct 27 09:08:38.540913 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1095/2188] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:38 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:38.548722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-88f4b159-f690-44d0-aa52-e6deac05e41d tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31a9e84550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:38.550747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:38.551371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:38.583948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.584454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.584905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.591171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.591701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.592150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.644399 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-88f4b159-f690-44d0-aa52-e6deac05e41d tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/3265a85e-7dab-422e-8c8e-f4cc9c696b9d" status: 200 len: 246 microversion: 2.1 time: 0.099622 Oct 27 09:08:38.645347 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1094/2189] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:08:38 2022] GET /compute/v2.1/os-security-groups/3265a85e-7dab-422e-8c8e-f4cc9c696b9d => generated 246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:38.650978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:38.652126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:38.670002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.672450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.675307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.676460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.679044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.681730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.813808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.820085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.823430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.825309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lazy-loading 'fault' on Instance uuid 8a4098cc-19c7-4dc0-b5af-55f92720b32f {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:08:38.846763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:38.861983 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33e93981-b870-424e-a91d-33a8e5408cf0 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1479 microversion: 2.1 time: 0.319462 Oct 27 09:08:38.864280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1096/2190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:38 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1479 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:38.871770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:38.877631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:38.898056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.900690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.901355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.902283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:38.905007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:38.907184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:38.942001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:38.954866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:38.956906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:38.958425 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00ae6f27-fdb4-4bd9-90f3-2aa947bd0ee3 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 200 len: 1270 microversion: 2.25 time: 0.311242 Oct 27 09:08:38.959720 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1095/2191] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:38 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 1270 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:38.979430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ad0ce73-10d4-494c-bed6-911f27050bd9 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31a9d728b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1911898982", "description": "tempest-description-1262872316"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:39.463624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:39.485220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:39.487462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:39.490792 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-794d2826-61b5-41de-ae72-8729fcfd405f tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2958 microversion: 2.32 time: 0.623950 Oct 27 09:08:39.497050 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1097/2192] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:38 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2958 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:39.508930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:39.513802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:39.529405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:39.536303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:39.537757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:39.549198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:39.553918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:39.556357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:39.674245 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ad0ce73-10d4-494c-bed6-911f27050bd9 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.713217 Oct 27 09:08:39.686305 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1096/2193] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:08:38 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:39.702901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:39.707703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:39.724976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:39.742093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:39.750417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:39.750813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:39.753187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:39.756905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:39.761533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:39.761877 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a34fdf6-0635-4960-8e7a-d8011dab01b9 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.263266 Oct 27 09:08:39.765254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:39.766576 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1098/2194] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:39 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:39.768060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:39.771870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b082ee69-5e59-4616-bbe1-341b4a8b4296 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31ae5bd550>, body: {"security_group_rule": {"parent_group_id": "3fb89231-9762-406f-9919-cb74c36f4df4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:40.283907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:40.298733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:40.300714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:40.306288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5255da62-e079-4d95-9654-f61a944e03eb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.623404 Oct 27 09:08:40.324346 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1097/2195] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:39 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:40.341778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5958d2dc-675e-4661-88dd-0d2741195636 req-92075366-c2c1-45a9-8109-e74246c4573b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4349576-ae59-481f-92ec-599ddae530d7", "name": "network-vif-unplugged", "status": "completed", "tag": "e74cd9c8-3c59-4b33-a7c7-5358d3b644c0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:40.392801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5958d2dc-675e-4661-88dd-0d2741195636 req-92075366-c2c1-45a9-8109-e74246c4573b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:40.392801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5958d2dc-675e-4661-88dd-0d2741195636 req-92075366-c2c1-45a9-8109-e74246c4573b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:40.392801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5958d2dc-675e-4661-88dd-0d2741195636 req-92075366-c2c1-45a9-8109-e74246c4573b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:40.397315 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b082ee69-5e59-4616-bbe1-341b4a8b4296 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.626601 Oct 27 09:08:40.397315 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1099/2196] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:08:39 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:40.415029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:40.416852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:40.420905 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5958d2dc-675e-4661-88dd-0d2741195636 req-92075366-c2c1-45a9-8109-e74246c4573b service nova] Creating event network-vif-unplugged:e74cd9c8-3c59-4b33-a7c7-5358d3b644c0 for instance d4349576-ae59-481f-92ec-599ddae530d7 on n-h2-858383-16 Oct 27 09:08:40.423637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:40.424786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:40.425810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:40.429537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:40.430237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:40.430926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:40.435298 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-5958d2dc-675e-4661-88dd-0d2741195636 req-92075366-c2c1-45a9-8109-e74246c4573b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109023 Oct 27 09:08:40.436827 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1098/2197] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:40.452984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:40.457451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 8a4098cc-19c7-4dc0-b5af-55f92720b32f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:40.476607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:40.477318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:40.477942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:40.478804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:40.480537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:40.482977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:40.525830 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] HTTP exception thrown: Instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f could not be found. Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Request method failure captured: Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f HTTP/1.1 Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjOu_UDes_X40MI_97cqctdDXONXN64NqD9pCNDGuncPU9EKK7GW3IrvWbXMbypOyFsPYTDKBDXrSC36BCzxHDOZH2tcWvitXbGPDimr1kB8ZkASIPaGFmwZ_VNYmjqpCR7XbDAuE6rrGJmMhLGPp82r63nV-l0AzPSm_3FLZkWGog Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: ed77ec98569b4d25bbf481afb32c3fbc Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed77ec98569b4d25bbf481afb32c3fbc"}]}] Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: ed77ec98569b4d25bbf481afb32c3fbc Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-LiveAutoBlockMigrationV225Test-1525272738-project Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: cf8bc1ce921e4f759cb9c0b5f4340324 Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738-project Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f could not be found. Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '8a4098cc-19c7-4dc0-b5af-55f92720b32f'} Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f could not be found. Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f could not be found. Oct 27 09:08:40.530572 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:40.533847 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:40.533847 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:40.533847 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:40.533847 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:40.533847 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:40.533847 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:40.533847 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:40.533847 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f could not be found. Oct 27 09:08:40.533847 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:40.535595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Returning 404 to user: Instance 8a4098cc-19c7-4dc0-b5af-55f92720b32f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:40.538258 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-29983d43-5038-4197-9aec-ff42b8497e92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f" status: 404 len: 111 microversion: 2.25 time: 0.098539 Oct 27 09:08:40.541528 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1099/2198] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:40 2022] GET /compute/v2.1/servers/8a4098cc-19c7-4dc0-b5af-55f92720b32f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:08:40.552785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7974641a-5bdc-4a98-a342-9723154bef19 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Action: 'create', calling method: .version_select at 0x7f31a9c90af0>, body: {"security_group_rule": {"parent_group_id": "3fb89231-9762-406f-9919-cb74c36f4df4", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:40.723988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:40.741421 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9f2d2d6-01a9-46c9-97be-b9c99967c3c2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1479 microversion: 2.1 time: 0.338807 Oct 27 09:08:40.757912 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1100/2199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:40 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1479 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:40.766459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:40.767083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:40.797111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:40.797616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:40.798066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:40.798777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:40.812514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:40.813396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:41.361546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:41.382016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:41.387670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:41.392752 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c7606046-8056-4e59-a812-8fd4fdaed660 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2958 microversion: 2.32 time: 0.633501 Oct 27 09:08:41.393539 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1101/2200] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:40 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2958 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:41.414245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:41.418403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:41.447423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:41.448685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:41.451092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:41.455770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:41.459160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:41.460959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:41.506017 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7974641a-5bdc-4a98-a342-9723154bef19 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.961619 Oct 27 09:08:41.507615 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1100/2201] 10.222.0.25 () {60 vars in 1195 bytes} [Thu Oct 27 09:08:40 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:41.526225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:41.546871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:41.574823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:41.577881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:41.579906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:41.581772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:41.583954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:41.587877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:41.664160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:41.681741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:41.694979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:41.706324 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-354b7242-9ae7-4f49-9c72-66803e6aa8d3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.310126 Oct 27 09:08:41.707486 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1102/2202] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:41 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:41.714186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ea4aea7-af82-4de4-af04-92644b27f2ef tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31aa0efee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:42.008703 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ea4aea7-af82-4de4-af04-92644b27f2ef tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/3fb89231-9762-406f-9919-cb74c36f4df4" status: 200 len: 665 microversion: 2.1 time: 0.299829 Oct 27 09:08:42.009285 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1103/2203] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:08:41 2022] GET /compute/v2.1/os-security-groups/3fb89231-9762-406f-9919-cb74c36f4df4 => generated 665 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:42.032673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:42.040115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:42.061610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:42.062264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:42.062728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:42.063658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:42.064085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:42.064520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:42.527669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:42.540902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:42.545605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:42.552969 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ecb7384d-bf6a-4bde-bd2d-a693cab0b43a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 1.027818 Oct 27 09:08:42.578718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:42.595499 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1101/2204] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:41 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:42.600922 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c3bd994b-3eda-4502-bbd0-75ead86726c3 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1479 microversion: 2.1 time: 0.577587 Oct 27 09:08:42.601573 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1104/2205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:42 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1479 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:42.613847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fb361742-5e05-4f24-9b23-e01770d25e79 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31a9d72af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:42.617771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:42.625276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:42.642821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:42.644859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:42.645542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:42.646332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:42.646806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:42.649468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:43.236147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:43.264704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:43.275603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:43.281480 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8b485705-3e82-473e-8cb5-59d43aa34761 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2958 microversion: 2.32 time: 0.671101 Oct 27 09:08:43.287536 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1105/2206] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:42 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2958 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:43.359971 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fb361742-5e05-4f24-9b23-e01770d25e79 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/8e4a9d3a-eaeb-47fe-9577-107a81a736b4" status: 202 len: 0 microversion: 2.1 time: 0.762613 Oct 27 09:08:43.360883 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1102/2207] 10.222.0.25 () {58 vars in 1287 bytes} [Thu Oct 27 09:08:42 2022] DELETE /compute/v2.1/os-security-group-rules/8e4a9d3a-eaeb-47fe-9577-107a81a736b4 => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:08:43.373575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:43.374192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:43.390211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:43.390928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:43.391559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:43.393197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:43.394651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:43.398481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:43.466358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1444391243", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "8aa86863-8c60-413b-9747-3e375f601520"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:43.634212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] validate_networks() for [('8aa86863-8c60-413b-9747-3e375f601520', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:08:43.649574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:43.664745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:43.676701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:43.689754 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a83bb9a1-81f2-4702-a492-ea8b38991200 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.320050 Oct 27 09:08:43.699663 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1103/2208] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:43 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:43.707440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-482f7dbe-7964-42a1-a04d-f3fe3ce9a714 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31a9c908b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:45.100246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-482f7dbe-7964-42a1-a04d-f3fe3ce9a714 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3fb89231-9762-406f-9919-cb74c36f4df4" status: 202 len: 0 microversion: 2.1 time: 1.399067 Oct 27 09:08:45.100820 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1104/2209] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:08:43 2022] DELETE /compute/v2.1/os-security-groups/3fb89231-9762-406f-9919-cb74c36f4df4 => generated 0 bytes in 1400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:08:45.106034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:45.106659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:45.134449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:45.135396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:45.135995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:45.136829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:45.137293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:45.138926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:45.579757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:08:45.580856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:08:45.581660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:08:45.582228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:08:45.582794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:08:45.603762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:45.613760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:45.615547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:45.621162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:45.622096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:45.623094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:45.624981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:45.626070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:45.626718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:45.636076 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9dd5acc6-457b-4ca9-b6a3-a6ac831d4489 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1738 microversion: 2.20 time: 0.534024 Oct 27 09:08:45.640134 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1105/2210] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:45 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1738 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:45.659491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:45.662255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:45.680787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:45.681295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:45.688705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:45.689579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:45.690080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:45.690640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:45.700018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:08:45.724404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for user e63dd72032ef4fe098382555888e3ae3 and project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:08:45.750221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:08:45.758370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:08:45.873666 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b708f7a-d0d1-4420-937c-c7c998e76a44 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.584287 Oct 27 09:08:45.881306 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1106/2211] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:08:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:08:45.886399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-51a9c35e-24ce-4b6d-8fd9-06103d63a707 req-d19ee7ae-6942-47b5-b8dc-21a591689fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4349576-ae59-481f-92ec-599ddae530d7", "name": "network-vif-plugged", "status": "completed", "tag": "e74cd9c8-3c59-4b33-a7c7-5358d3b644c0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:45.899319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51a9c35e-24ce-4b6d-8fd9-06103d63a707 req-d19ee7ae-6942-47b5-b8dc-21a591689fb2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:45.900283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51a9c35e-24ce-4b6d-8fd9-06103d63a707 req-d19ee7ae-6942-47b5-b8dc-21a591689fb2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:45.900935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51a9c35e-24ce-4b6d-8fd9-06103d63a707 req-d19ee7ae-6942-47b5-b8dc-21a591689fb2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:45.930355 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-51a9c35e-24ce-4b6d-8fd9-06103d63a707 req-d19ee7ae-6942-47b5-b8dc-21a591689fb2 service nova] Creating event network-vif-plugged:e74cd9c8-3c59-4b33-a7c7-5358d3b644c0 for instance d4349576-ae59-481f-92ec-599ddae530d7 on n-h2-858383-16 Oct 27 09:08:45.982625 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-51a9c35e-24ce-4b6d-8fd9-06103d63a707 req-d19ee7ae-6942-47b5-b8dc-21a591689fb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099663 Oct 27 09:08:45.983486 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1107/2212] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:45.989225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:45.990580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:46.017820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:46.022875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:46.023472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:46.027327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:46.027974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:46.028535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:46.447170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:46.472708 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-508f379e-8a30-445e-ac1c-40c74d97d3e1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1479 microversion: 2.1 time: 0.825980 Oct 27 09:08:46.473568 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1106/2213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:45 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1479 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:46.498442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:46.505759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:46.557467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:46.558632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:46.559663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:46.561356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:46.562032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:46.562704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:47.578290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:47.590222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:47.609336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:47.617293 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c43633d-1cbe-48c7-a74c-67218e050d7b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 1.141414 Oct 27 09:08:47.628782 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1107/2214] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:46 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:47.649827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a0805f8-86a4-47cf-bba4-2620e7e135fe tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31a9e24310>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:47.733438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-8a0805f8-86a4-47cf-bba4-2620e7e135fe tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e3294150-024d-479a-b5b3-456d8737fbb0 does not exist", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:08:47.734402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.security_group_api [None req-8a0805f8-86a4-47cf-bba4-2620e7e135fe tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Neutron security group e3294150-024d-479a-b5b3-456d8737fbb0 not found {{(pid=120602) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:08:47.735264 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8a0805f8-86a4-47cf-bba4-2620e7e135fe tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] HTTP exception thrown: Security group e3294150-024d-479a-b5b3-456d8737fbb0 does not exist Oct 27 09:08:47.735264 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-ae1c6608-925b-4f04-bf56-3c8ad89d8594'] Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a0805f8-86a4-47cf-bba4-2620e7e135fe tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Request method failure captured: Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-security-groups/e3294150-024d-479a-b5b3-456d8737fbb0 HTTP/1.1 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqMWXKbEjzJb88TsD_YcN-gVpQ3XIt5ryptqaJ4D774knUk4hofmf476ntAPaqkvVFefWoe11JDd5RoWdZhFkr0m1T-9NMhT7FGpyxZhIEdwiJeren_asKEq8oX8xJz0mTTBDzSsRAzUkTvHbzNji1qzjrHA0O6P7lSSy9KK4ksNMU Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 920f6d0bcf4f4548b4fb28c82802d6f0 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1504909157 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/920f6d0bcf4f4548b4fb28c82802d6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_920f6d0bcf4f4548b4fb28c82802d6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/920f6d0bcf4f4548b4fb28c82802d6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/920f6d0bcf4f4548b4fb28c82802d6f0"}]}] Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1504909157 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 920f6d0bcf4f4548b4fb28c82802d6f0 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1504909157 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupRulesTestJSON-1504909157-project Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0791cbed3b7a4a5f8ceeb3d41869110f Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1504909157-project Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: exception: Security group e3294150-024d-479a-b5b3-456d8737fbb0 does not exist Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-ae1c6608-925b-4f04-bf56-3c8ad89d8594'] Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'e3294150-024d-479a-b5b3-456d8737fbb0'} Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:08:47.737747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e3294150-024d-479a-b5b3-456d8737fbb0 does not exist Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae1c6608-925b-4f04-bf56-3c8ad89d8594'] Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e3294150-024d-479a-b5b3-456d8737fbb0 does not exist Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae1c6608-925b-4f04-bf56-3c8ad89d8594'] Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e3294150-024d-479a-b5b3-456d8737fbb0 does not exist Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae1c6608-925b-4f04-bf56-3c8ad89d8594'] Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e3294150-024d-479a-b5b3-456d8737fbb0 does not exist Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae1c6608-925b-4f04-bf56-3c8ad89d8594'] Oct 27 09:08:47.741775 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:47.746215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a0805f8-86a4-47cf-bba4-2620e7e135fe tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Returning 404 to user: Security group e3294150-024d-479a-b5b3-456d8737fbb0 does not exist Oct 27 09:08:47.746215 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-ae1c6608-925b-4f04-bf56-3c8ad89d8594'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:47.747659 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a0805f8-86a4-47cf-bba4-2620e7e135fe tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e3294150-024d-479a-b5b3-456d8737fbb0" status: 404 len: 194 microversion: 2.1 time: 0.117420 Oct 27 09:08:47.752474 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1108/2215] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:08:47 2022] DELETE /compute/v2.1/os-security-groups/e3294150-024d-479a-b5b3-456d8737fbb0 => generated 194 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:08:47.759520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:47.770818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:47.786107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:47.786826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:47.795115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:47.796200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:47.796834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:47.797434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:47.830922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:47.841444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:47.842920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:47.844273 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-130cff08-15d3-49fe-8aad-e9f6b66c9beb tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2937 microversion: 2.32 time: 1.859223 Oct 27 09:08:47.844824 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1108/2216] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:45 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2937 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:47.876016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:47.876724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:47.894552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:47.895065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:47.895521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:47.896316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:47.896783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:47.897213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:48.045635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:48.055528 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d359c30-26d9-41f7-a207-6f4e7781061e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1260 microversion: 2.1 time: 0.301589 Oct 27 09:08:48.056932 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1109/2217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:47 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1260 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:48.063390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:48.064314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:48.072856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:48.073662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:48.074321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:48.075556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:48.076496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:48.077113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:48.435825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:48.462397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:48.472669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:48.477027 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a26a668-a40d-43fd-8ffd-70ef60b5fdf1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1720 microversion: 2.20 time: 0.613993 Oct 27 09:08:48.477653 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1109/2218] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:47 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1720 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:48.505076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7449558-0f33-47fc-983e-fc0be80e8b4c tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31ae4b51f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:48.515329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:48.528752 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97617fed-798e-4c11-a210-2fe7714531cb tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1479 microversion: 2.1 time: 0.470107 Oct 27 09:08:48.529942 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1110/2219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:48 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1479 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:48.547553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-unplugged", "status": "completed", "tag": "1909605a-f082-4fa7-8b71-e5b6588381b7"}, {"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-unplugged", "status": "completed", "tag": "2e9a642c-cdf6-4f11-b419-815f385318f3"}, {"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-unplugged", "status": "completed", "tag": "e2bf3f27-0dfb-4e04-ab67-6ed73dc59c65"}, {"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-unplugged", "status": "completed", "tag": "32d1d17b-5769-4c16-9353-0660cc143a6a"}, {"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-unplugged", "status": "completed", "tag": "81294aa2-0c23-45a5-81ca-6872462ae6d3"}, {"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-unplugged", "status": "completed", "tag": "91f51f6e-082b-4bd2-a440-28e5320e62d1"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:48.593765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:48.598169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:48.601912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:48.655728 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Creating event network-vif-unplugged:1909605a-f082-4fa7-8b71-e5b6588381b7 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:48.656349 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Creating event network-vif-unplugged:2e9a642c-cdf6-4f11-b419-815f385318f3 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:48.656863 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Creating event network-vif-unplugged:e2bf3f27-0dfb-4e04-ab67-6ed73dc59c65 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:48.657372 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Creating event network-vif-unplugged:32d1d17b-5769-4c16-9353-0660cc143a6a for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:48.657868 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Creating event network-vif-unplugged:81294aa2-0c23-45a5-81ca-6872462ae6d3 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:48.658535 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] Creating event network-vif-unplugged:91f51f6e-082b-4bd2-a440-28e5320e62d1 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:48.676183 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f214b643-39cc-4ae8-b862-0093bdb2d2bf req-8d257b65-3125-4cb7-b59e-6c01f9320741 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.139207 Oct 27 09:08:48.678042 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1111/2220] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:48.685299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:48.686077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:48.695537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:48.696839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:48.697347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:48.698110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:48.698615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:48.699201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:48.786170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:08:48.959954 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-974e4d6b-22ca-41f3-8f6c-9507daecaa3f tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 204 len: 0 microversion: 2.25 time: 0.279746 Oct 27 09:08:48.960455 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1112/2221] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:08:48 2022] DELETE /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:08:48.977288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:48.979308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:48.999590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:49.000325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:49.002036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:49.004962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:49.006339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:49.006799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:49.141277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:49.151262 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7449558-0f33-47fc-983e-fc0be80e8b4c tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3265a85e-7dab-422e-8c8e-f4cc9c696b9d" status: 202 len: 0 microversion: 2.1 time: 0.672348 Oct 27 09:08:49.152447 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1110/2222] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:08:48 2022] DELETE /compute/v2.1/os-security-groups/3265a85e-7dab-422e-8c8e-f4cc9c696b9d => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:08:49.156164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:49.157880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:49.158626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:49.159849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:49.175819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:49.176594 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38da0aa7-3051-42b1-8fbc-328845e1256b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.209680 Oct 27 09:08:49.180254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:49.180752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:49.183013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:49.183831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:49.184412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:49.196799 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1113/2223] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:48 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:49.217549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:49.218200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:49.243291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:49.243901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:49.246191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:49.248403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:49.248891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:49.254621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:49.776763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:49.783936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:49.798381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:49.800740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:49.803031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:49.805306 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae628b39-b74d-4ca3-80e2-4fb205e10eee tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1733 microversion: 2.25 time: 0.598875 Oct 27 09:08:49.808675 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1114/2224] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:49 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1733 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:49.813799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:49.814630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:49.820585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:49.822078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:49.822751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:49.823338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:49.824239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:49.824847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:49.825468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:49.832350 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59afbef3-86b5-48e8-b23f-46d254a5f386 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2869 microversion: 2.32 time: 0.668313 Oct 27 09:08:49.838615 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1111/2225] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:49 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2869 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:49.858985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b593f90-86d5-425e-8045-0d5ae68d9872 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31ae4b5940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:50.095105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:50.100582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:50.111840 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-696422d6-ef95-40d2-90a9-a223e2103900 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1308 microversion: 2.1 time: 0.301610 Oct 27 09:08:50.112531 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1115/2226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:49 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:50.118733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:50.119461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:50.131111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.132051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.132671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.133545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.134003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.134433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.327932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:50.334725 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b593f90-86d5-425e-8045-0d5ae68d9872 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/fd033c8b-35a4-49d1-ac1c-27d22988494d" status: 202 len: 0 microversion: 2.1 time: 0.487703 Oct 27 09:08:50.336712 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1112/2227] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:08:49 2022] DELETE /compute/v2.1/os-security-groups/fd033c8b-35a4-49d1-ac1c-27d22988494d => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:08:50.350539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:50.352255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:50.363877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:50.365616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:50.366995 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2d7a2695-a463-4ec8-bcd8-3d5ef538c603 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1720 microversion: 2.20 time: 0.253057 Oct 27 09:08:50.367772 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1116/2228] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:50 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:50.371503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.372137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.372606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.373021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6d854552-e61f-41b0-a97c-e21ad6ed6ee2 req-3a71a2ef-4e7b-48dc-abe6-4ab760d20dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-deleted", "tag": "32d1d17b-5769-4c16-9353-0660cc143a6a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:50.373357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.373823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.374249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.377542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:50.394942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d854552-e61f-41b0-a97c-e21ad6ed6ee2 req-3a71a2ef-4e7b-48dc-abe6-4ab760d20dec service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.395429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d854552-e61f-41b0-a97c-e21ad6ed6ee2 req-3a71a2ef-4e7b-48dc-abe6-4ab760d20dec service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.397571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d854552-e61f-41b0-a97c-e21ad6ed6ee2 req-3a71a2ef-4e7b-48dc-abe6-4ab760d20dec service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.417786 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6d854552-e61f-41b0-a97c-e21ad6ed6ee2 req-3a71a2ef-4e7b-48dc-abe6-4ab760d20dec service nova] Creating event network-vif-deleted:32d1d17b-5769-4c16-9353-0660cc143a6a for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:50.423163 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6d854552-e61f-41b0-a97c-e21ad6ed6ee2 req-3a71a2ef-4e7b-48dc-abe6-4ab760d20dec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054078 Oct 27 09:08:50.424544 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1117/2229] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:50.431229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:50.432321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:50.442019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.442533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.443625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.444355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.445109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.445534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.544426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:50.553765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:50.555246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:50.561214 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c4c009b-de18-4e0c-b2f0-fbc8906c066f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.135212 Oct 27 09:08:50.562025 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1118/2230] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:50 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:50.567161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9bb75173-4b92-4709-9efd-27d7cf6c7c44 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31a9f90940>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:50.595643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:50.605058 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d57cc64-5b3f-4b1a-bc34-ba1317bcc5a2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1464 microversion: 2.1 time: 0.263622 Oct 27 09:08:50.618486 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1113/2231] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:50 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1464 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:50.636038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6fe4f061-a9ad-4ac8-805c-4adf5a821603 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:50.638434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6fe4f061-a9ad-4ac8-805c-4adf5a821603 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:50.645218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fe4f061-a9ad-4ac8-805c-4adf5a821603 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.645735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fe4f061-a9ad-4ac8-805c-4adf5a821603 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.646158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fe4f061-a9ad-4ac8-805c-4adf5a821603 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.646896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fe4f061-a9ad-4ac8-805c-4adf5a821603 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.647329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fe4f061-a9ad-4ac8-805c-4adf5a821603 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.647791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fe4f061-a9ad-4ac8-805c-4adf5a821603 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.735238 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6fe4f061-a9ad-4ac8-805c-4adf5a821603 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action" status: 202 len: 0 microversion: 2.1 time: 0.103027 Oct 27 09:08:50.736337 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1114/2232] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:08:50 2022] POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:08:50.748353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:50.749191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:50.766578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.767642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.768312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.772452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.773723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.774344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.819493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:50.820236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:50.820815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:50.821408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lazy-loading 'fault' on Instance uuid d4349576-ae59-481f-92ec-599ddae530d7 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:08:50.986399 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9bb75173-4b92-4709-9efd-27d7cf6c7c44 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5d70c1dd-c557-475f-8fd3-02a2e9faf9ec" status: 202 len: 0 microversion: 2.1 time: 0.423141 Oct 27 09:08:50.987306 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1119/2233] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:08:50 2022] DELETE /compute/v2.1/os-security-groups/5d70c1dd-c557-475f-8fd3-02a2e9faf9ec => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:08:50.991667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:50.992276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:51.004955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:51.006119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:51.006635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:51.007467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:51.008012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:51.008600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:51.228568 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2aa89c11-b5e4-42cc-8e9c-058393600863 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1600 microversion: 2.1 time: 0.486829 Oct 27 09:08:51.230413 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1115/2234] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:50 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1600 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:51.240487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:51.243865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:51.246855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:51.256298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:51.257171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:51.257683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:51.258567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:51.259024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:51.259525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:51.294922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:51.307105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:51.308592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:51.310044 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6aad47c-3064-4015-a995-0e0a2615bdb2 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1733 microversion: 2.25 time: 0.322111 Oct 27 09:08:51.310597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1120/2235] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:50 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1733 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:51.315559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7cfd9415-2746-48c1-a2c3-e7f854b54b30 req-7696d4a8-3079-49bb-ab23-23859cc12128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d248926-b23e-472b-9a1e-4b10c924758a", "name": "network-vif-unplugged", "status": "completed", "tag": "c24197dc-db5d-4363-91d8-125f1e441095"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:51.336052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7cfd9415-2746-48c1-a2c3-e7f854b54b30 req-7696d4a8-3079-49bb-ab23-23859cc12128 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:51.336843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7cfd9415-2746-48c1-a2c3-e7f854b54b30 req-7696d4a8-3079-49bb-ab23-23859cc12128 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:51.337434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7cfd9415-2746-48c1-a2c3-e7f854b54b30 req-7696d4a8-3079-49bb-ab23-23859cc12128 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:51.351803 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7cfd9415-2746-48c1-a2c3-e7f854b54b30 req-7696d4a8-3079-49bb-ab23-23859cc12128 service nova] Creating event network-vif-unplugged:c24197dc-db5d-4363-91d8-125f1e441095 for instance 3d248926-b23e-472b-9a1e-4b10c924758a on n-h1-858383-16 Oct 27 09:08:51.366855 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7cfd9415-2746-48c1-a2c3-e7f854b54b30 req-7696d4a8-3079-49bb-ab23-23859cc12128 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054867 Oct 27 09:08:51.367801 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1121/2236] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:51.373630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0dab559-3d81-4ce5-a962-53db11968868 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31a9d72550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:51.611344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:51.628171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:51.629649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:51.631718 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db42c9d8-793f-4161-906a-7e371d7c98ec tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2755 microversion: 2.32 time: 0.398585 Oct 27 09:08:51.632698 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1116/2237] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:51 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2755 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:51.638351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:51.638971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:51.646937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:51.647879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:51.648645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:51.650000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:51.650773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:51.651832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:51.919044 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a0dab559-3d81-4ce5-a962-53db11968868 tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2c321bcf-b94f-4154-8079-037e6a8e7b6a" status: 202 len: 0 microversion: 2.1 time: 0.549657 Oct 27 09:08:51.919749 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1122/2238] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:08:51 2022] DELETE /compute/v2.1/os-security-groups/2c321bcf-b94f-4154-8079-037e6a8e7b6a => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:08:51.929575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e5b028c-0f8c-4293-8123-60f39cc5eee7 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:51.932909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e5b028c-0f8c-4293-8123-60f39cc5eee7 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:51.939892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e5b028c-0f8c-4293-8123-60f39cc5eee7 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:51.940489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e5b028c-0f8c-4293-8123-60f39cc5eee7 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:51.941100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e5b028c-0f8c-4293-8123-60f39cc5eee7 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:51.942245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e5b028c-0f8c-4293-8123-60f39cc5eee7 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:51.942851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e5b028c-0f8c-4293-8123-60f39cc5eee7 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:51.943375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e5b028c-0f8c-4293-8123-60f39cc5eee7 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:51.968799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:51.980391 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-adddd98c-eca6-471e-ac90-25d6ed19924e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1308 microversion: 2.1 time: 0.344952 Oct 27 09:08:51.983133 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1117/2239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:51 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:52.015117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:52.016128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:52.035381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.035924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.036438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.040955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.041802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.043212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.046081 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e5b028c-0f8c-4293-8123-60f39cc5eee7 tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action" status: 202 len: 0 microversion: 2.1 time: 0.120885 Oct 27 09:08:52.052425 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1123/2240] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:08:51 2022] POST /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:08:52.064727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:52.068403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:52.084056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.084722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.089197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.090124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.090703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.091242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.220003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:52.231966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:52.234040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:52.241299 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-89fe1a97-9f67-4f60-8ca3-1b9a3077506c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.181659 Oct 27 09:08:52.242849 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1124/2241] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:52 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:52.248437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-394f1c72-6976-4ff6-9f0f-e42c11c874df tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] Calling method '.version_select at 0x7f31a9d72b80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:52.386191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:52.402980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:52.404866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:52.406332 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-accd4399-f150-44dc-8428-d7324801da4b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1663 microversion: 2.20 time: 0.421876 Oct 27 09:08:52.407111 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1118/2242] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:51 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1663 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:52.414880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49b64e0b-f2be-4fdf-a995-df021eaa846f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:52.415845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49b64e0b-f2be-4fdf-a995-df021eaa846f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:52.422560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b64e0b-f2be-4fdf-a995-df021eaa846f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.423352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b64e0b-f2be-4fdf-a995-df021eaa846f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.424075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b64e0b-f2be-4fdf-a995-df021eaa846f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.425053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b64e0b-f2be-4fdf-a995-df021eaa846f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.425958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b64e0b-f2be-4fdf-a995-df021eaa846f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.426822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49b64e0b-f2be-4fdf-a995-df021eaa846f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.828384 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49b64e0b-f2be-4fdf-a995-df021eaa846f tempest-ServersAdminTestJSON-1872450348 tempest-ServersAdminTestJSON-1872450348-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1617 microversion: 2.1 time: 0.417939 Oct 27 09:08:52.828384 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1119/2243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:52 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1617 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:52.832071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:52.832714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:52.838892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.839661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.840264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.841186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.841673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.842136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.945296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:52.955752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:52.957753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:52.959298 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c116058b-9a28-4c10-a547-321f937b88fd tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 200 len: 1665 microversion: 2.25 time: 0.130931 Oct 27 09:08:52.960485 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1120/2244] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:52 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 1665 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:52.965912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a5f8363-8a7b-405c-80bd-10fb23226133 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6afe5ede-e465-47b2-908c-54e89ca5b11a"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:52.969524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a5f8363-8a7b-405c-80bd-10fb23226133 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:52.976820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a5f8363-8a7b-405c-80bd-10fb23226133 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.977804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a5f8363-8a7b-405c-80bd-10fb23226133 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.978396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a5f8363-8a7b-405c-80bd-10fb23226133 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.979261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a5f8363-8a7b-405c-80bd-10fb23226133 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:52.979899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a5f8363-8a7b-405c-80bd-10fb23226133 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:52.980500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a5f8363-8a7b-405c-80bd-10fb23226133 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:52.996492 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-394f1c72-6976-4ff6-9f0f-e42c11c874df tempest-SecurityGroupRulesTestJSON-1504909157 tempest-SecurityGroupRulesTestJSON-1504909157-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ef8bfd27-9a71-43e1-bf59-42b9e786dedb" status: 202 len: 0 microversion: 2.1 time: 0.752001 Oct 27 09:08:52.997365 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1125/2245] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:08:52 2022] DELETE /compute/v2.1/os-security-groups/ef8bfd27-9a71-43e1-bf59-42b9e786dedb => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:08:53.002775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6942ebb1-f6b9-40fa-beaa-81304e5e6725 req-29d79372-dcc9-4f7d-a001-59d9e94cd47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-deleted", "tag": "e2bf3f27-0dfb-4e04-ab67-6ed73dc59c65"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:53.017973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6942ebb1-f6b9-40fa-beaa-81304e5e6725 req-29d79372-dcc9-4f7d-a001-59d9e94cd47c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:53.018718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6942ebb1-f6b9-40fa-beaa-81304e5e6725 req-29d79372-dcc9-4f7d-a001-59d9e94cd47c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:53.019305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6942ebb1-f6b9-40fa-beaa-81304e5e6725 req-29d79372-dcc9-4f7d-a001-59d9e94cd47c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:53.068533 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6942ebb1-f6b9-40fa-beaa-81304e5e6725 req-29d79372-dcc9-4f7d-a001-59d9e94cd47c service nova] Creating event network-vif-deleted:e2bf3f27-0dfb-4e04-ab67-6ed73dc59c65 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:53.078768 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6942ebb1-f6b9-40fa-beaa-81304e5e6725 req-29d79372-dcc9-4f7d-a001-59d9e94cd47c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078958 Oct 27 09:08:53.079719 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1126/2246] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:53.088569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:53.090894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:53.101238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:53.102082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:53.102082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:53.102779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:53.103309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:53.103848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:53.518170 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a5f8363-8a7b-405c-80bd-10fb23226133 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.555787 Oct 27 09:08:53.520457 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1121/2247] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Oct 27 09:08:52 2022] POST /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 188 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:08:53.551522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7cc40444-85bc-4389-b06c-6ef9d62c330c req-65a579a1-278b-48cd-aff5-0087a8b86827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b3e594-7d26-4197-b977-8f60fc81a4ff", "tag": "a9a9bbd6-f204-4116-b4c5-9036d94e2eab"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:53.598762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7cc40444-85bc-4389-b06c-6ef9d62c330c req-65a579a1-278b-48cd-aff5-0087a8b86827 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:53.600550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7cc40444-85bc-4389-b06c-6ef9d62c330c req-65a579a1-278b-48cd-aff5-0087a8b86827 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:53.603397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7cc40444-85bc-4389-b06c-6ef9d62c330c req-65a579a1-278b-48cd-aff5-0087a8b86827 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:53.636511 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7cc40444-85bc-4389-b06c-6ef9d62c330c req-65a579a1-278b-48cd-aff5-0087a8b86827 service nova] Creating event network-changed:a9a9bbd6-f204-4116-b4c5-9036d94e2eab for instance e5b3e594-7d26-4197-b977-8f60fc81a4ff on n-h1-858383-16 Oct 27 09:08:53.656452 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7cc40444-85bc-4389-b06c-6ef9d62c330c req-65a579a1-278b-48cd-aff5-0087a8b86827 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133505 Oct 27 09:08:53.663939 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1122/2248] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:53.681458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:53.682468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:53.693930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:53.694743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:53.695490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:53.698394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:53.707760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:53.710472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:53.712146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:53.714383 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-df1d7e81-6e46-4a5c-9193-99055783b994 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2661 microversion: 2.32 time: 0.633437 Oct 27 09:08:53.715083 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1127/2249] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:53 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2661 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:53.720244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:53.721024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:53.736121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:53.736938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:53.738505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:53.740160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:53.740836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:53.742033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:53.751049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:53.752886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:53.840814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:08:54.042803 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7d61703-63a4-4465-96f1-f118ac3c3b7a tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 204 len: 0 microversion: 2.1 time: 0.374132 Oct 27 09:08:54.044140 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1123/2250] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:08:53 2022] DELETE /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:08:54.060482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:54.064126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:54.076370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.076879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.077324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:54.078571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.079035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.079468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:54.101291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:54.103359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:54.115484 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ff79799c-0b2b-4fe6-81d4-2e3a7f5d17ca tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1308 microversion: 2.1 time: 0.399116 Oct 27 09:08:54.120028 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1128/2251] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:53 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:54.131941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:54.132544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:54.146640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.147042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.147481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:54.148956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.149949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.150613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:54.190081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120602) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 27 09:08:54.209095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:54.242428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:54.257458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:54.259252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:54.275855 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f753eb8b-08c6-4165-869c-21bc26f96e79 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.226527 Oct 27 09:08:54.276707 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1124/2252] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:54 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:54.288220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:54.288880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:54.291593 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1f1d3ee-5fdc-4fe3-a7b1-87946fcb70a6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/action" status: 202 len: 0 microversion: 2.20 time: 0.169904 Oct 27 09:08:54.293134 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1129/2253] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:08:54 2022] POST /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:08:54.298665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:54.299443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:54.300061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.300594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.301074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:54.301929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.308610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.309255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.309798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:54.310231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.310695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.310799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:54.311395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.311966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:54.343441 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] HTTP exception thrown: Instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d could not be found. Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Request method failure captured: Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d HTTP/1.1 Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjOu_UDes_X40MI_97cqctdDXONXN64NqD9pCNDGuncPU9EKK7GW3IrvWbXMbypOyFsPYTDKBDXrSC36BCzxHDOZH2tcWvitXbGPDimr1kB8ZkASIPaGFmwZ_VNYmjqpCR7XbDAuE6rrGJmMhLGPp82r63nV-l0AzPSm_3FLZkWGog Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: ed77ec98569b4d25bbf481afb32c3fbc Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed77ec98569b4d25bbf481afb32c3fbc"}]}] Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: ed77ec98569b4d25bbf481afb32c3fbc Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-LiveAutoBlockMigrationV225Test-1525272738-project Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: cf8bc1ce921e4f759cb9c0b5f4340324 Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738-project Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d could not be found. Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d'} Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d could not be found. Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d could not be found. Oct 27 09:08:54.355323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d could not be found. Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:08:54.359927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Returning 404 to user: Instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:54.361210 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b7b4503-5e69-4b9b-b2c9-c7561d57a678 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d" status: 404 len: 111 microversion: 2.25 time: 0.083340 Oct 27 09:08:54.361991 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1125/2254] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:54 2022] GET /compute/v2.1/servers/f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:08:54.368002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:54.368448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:54.376455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.377361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.378065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:54.379098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:54.379707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:54.380994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:55.088110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:55.097490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:55.112860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:55.117712 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef6d2282-9500-4488-9290-d5d7029c76cc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1749 microversion: 2.20 time: 0.754435 Oct 27 09:08:55.118466 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1126/2255] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:54 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1749 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:55.164986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-feb0228a-1058-4858-91f1-df70d3ff8feb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '.version_select at 0x7f31aa5e0790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:55.176770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:55.190124 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91d9517b-2317-483b-bff9-919248f6aec6 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1470 microversion: 2.1 time: 0.895591 Oct 27 09:08:55.190940 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1130/2256] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:54 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1470 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:55.212658 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-feb0228a-1058-4858-91f1-df70d3ff8feb tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539815002" status: 204 len: 0 microversion: 2.25 time: 0.090914 Oct 27 09:08:55.217177 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1127/2257] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:08:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539815002 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:08:55.221399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:55.223433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:55.224899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:55.228297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:55.233097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:55.234000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:55.234715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:55.236462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:55.237215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:55.238411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:55.249605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:55.250562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:55.252915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:55.256204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:55.256914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:55.258512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:55.659180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:55.674050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:55.679772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:55.702923 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5ab2996-97ff-4700-8ca3-3e8c24efab22 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1308 microversion: 2.1 time: 0.484292 Oct 27 09:08:55.710974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:55.712777 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1128/2258] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:55 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1308 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:55.715304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:55.722133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb282312-be10-4c7c-88cf-c4f68929e4d5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2500 microversion: 2.32 time: 0.515867 Oct 27 09:08:55.732415 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1131/2259] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:55 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2500 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:55.740061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7432b7c5-3b5a-42d0-ba11-cfd293c9d19d req-4f88668d-dd8b-4c19-96e7-b5434b3edaac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-deleted", "tag": "2e9a642c-cdf6-4f11-b419-815f385318f3"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:55.746435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:55.752698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:55.753715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:55.758880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7432b7c5-3b5a-42d0-ba11-cfd293c9d19d req-4f88668d-dd8b-4c19-96e7-b5434b3edaac service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:55.759719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7432b7c5-3b5a-42d0-ba11-cfd293c9d19d req-4f88668d-dd8b-4c19-96e7-b5434b3edaac service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:55.760272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7432b7c5-3b5a-42d0-ba11-cfd293c9d19d req-4f88668d-dd8b-4c19-96e7-b5434b3edaac service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:55.774086 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7432b7c5-3b5a-42d0-ba11-cfd293c9d19d req-4f88668d-dd8b-4c19-96e7-b5434b3edaac service nova] Creating event network-vif-deleted:2e9a642c-cdf6-4f11-b419-815f385318f3 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:55.780874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:55.781338 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7432b7c5-3b5a-42d0-ba11-cfd293c9d19d req-4f88668d-dd8b-4c19-96e7-b5434b3edaac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049540 Oct 27 09:08:55.782411 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1129/2260] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:55.784136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:55.785559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:55.789906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1e7e84bb-8610-4c3e-9890-5d5758e556e0 req-ea436afc-8426-47fd-8510-cacdf28a9529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d", "name": "network-vif-deleted", "tag": "5a1ddd07-b18b-4724-8a1f-952c95c591d9"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:55.792487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:55.794675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:55.800137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:55.803078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1e7e84bb-8610-4c3e-9890-5d5758e556e0 req-ea436afc-8426-47fd-8510-cacdf28a9529 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:55.803952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1e7e84bb-8610-4c3e-9890-5d5758e556e0 req-ea436afc-8426-47fd-8510-cacdf28a9529 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:55.804387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1e7e84bb-8610-4c3e-9890-5d5758e556e0 req-ea436afc-8426-47fd-8510-cacdf28a9529 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:55.817191 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1e7e84bb-8610-4c3e-9890-5d5758e556e0 req-ea436afc-8426-47fd-8510-cacdf28a9529 service nova] Creating event network-vif-deleted:5a1ddd07-b18b-4724-8a1f-952c95c591d9 for instance f11cc43c-8b5a-4d37-bbb6-d3d2e9be104d on n-h1-858383-16 Oct 27 09:08:55.824480 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1e7e84bb-8610-4c3e-9890-5d5758e556e0 req-ea436afc-8426-47fd-8510-cacdf28a9529 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039680 Oct 27 09:08:55.824480 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1130/2261] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:56.054101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:56.067208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:56.069476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:56.079345 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fcc0d7c9-2a99-43a1-a3f3-d24430cc7714 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.344388 Oct 27 09:08:56.080190 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1132/2262] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:55 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:56.153853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:56.155378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:56.171395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:56.173866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:56.175973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:56.180451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:56.181416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:56.182096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:56.216683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:56.217400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:56.236404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:56.236933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:56.237363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:56.243089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:56.244513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:56.244513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:56.691497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:56.703420 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fb923c7b-7817-400e-ad46-8a04b8994b79 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1470 microversion: 2.1 time: 0.490129 Oct 27 09:08:56.723401 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1133/2263] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:56 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1470 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:56.734155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:56.734769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:56.745291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:56.747692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:56.751977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:56.752900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:56.753515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:56.755463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:57.343412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:57.353573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:57.355079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:57.364116 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff5d710e-5a0b-4d19-8868-84076383fe62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 1.212385 Oct 27 09:08:57.367074 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1131/2264] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:56 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:57.384938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:57.386206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:57.417034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:57.418116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:57.419194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:57.421068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:57.421927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:57.423050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:57.459558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:57.471166 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-90864580-178a-42a3-bc3f-dbb511046d97 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1308 microversion: 2.1 time: 0.740686 Oct 27 09:08:57.476989 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1134/2265] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:56 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1308 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:08:57.489363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:57.496764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:57.503798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Searching by: {'deleted': False, 'project_id': 'b7de08c501014c3f871b145030dc97cb'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:08:57.523676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:57.528707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:57.529428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:57.530389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:57.530999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:57.531595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:57.588342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:08:57.595535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:08:57.659177 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-01205ec2-5f0b-4701-973b-13456c11055b tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.180689 Oct 27 09:08:57.665276 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1135/2266] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:08:57 2022] GET /compute/v2.1/servers => generated 340 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:57.672867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:57.678057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:57.697926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:57.699289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:57.699986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:57.700858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:57.701459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:57.702031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:57.926907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:57.941429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:57.946676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:57.957839 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f3fa7ef-5afe-48c8-9fd3-7901b5a014a5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.291117 Oct 27 09:08:57.959293 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1136/2267] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:57 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:57.972059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:57.982312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:57.990112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Searching by: {'deleted': False, 'project_id': 'b7de08c501014c3f871b145030dc97cb'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:08:57.998858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.000160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.008154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.009232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.009859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.010434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.064325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:08:58.124713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:58.135807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.136295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.136732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.168822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:58.183981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:58.187713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:58.191347 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-28f21d3e-730d-4324-be89-93806741c998 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 2343 microversion: 2.32 time: 0.821108 Oct 27 09:08:58.194110 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1132/2268] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:57 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 2343 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:58.212518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:58.215022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:58.233039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.236621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.237305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.239206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.249835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.250599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.327098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.327098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.327098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.327098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lazy-loading 'fault' on Instance uuid bed9f097-736e-467b-805c-1813e5c70ea3 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:08:58.467249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:58.479353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-31df5e92-c60e-4280-b591-35d883015bc7 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 200 len: 1304 microversion: 2.1 time: 0.282775 Oct 27 09:08:58.497274 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1133/2269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:58 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 1304 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:58.511833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1e048069-0155-45a1-935c-ea26ff32779d req-58721ad3-aa6f-4e9e-9391-c3aea99f3364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-deleted", "tag": "81294aa2-0c23-45a5-81ca-6872462ae6d3"}, {"server_uuid": "bed9f097-736e-467b-805c-1813e5c70ea3", "name": "network-vif-deleted", "tag": "4f4178c9-6e2b-461c-891f-79017ab0aabc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:08:58.543970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1e048069-0155-45a1-935c-ea26ff32779d req-58721ad3-aa6f-4e9e-9391-c3aea99f3364 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.551036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1e048069-0155-45a1-935c-ea26ff32779d req-58721ad3-aa6f-4e9e-9391-c3aea99f3364 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.551671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1e048069-0155-45a1-935c-ea26ff32779d req-58721ad3-aa6f-4e9e-9391-c3aea99f3364 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.578790 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1e048069-0155-45a1-935c-ea26ff32779d req-58721ad3-aa6f-4e9e-9391-c3aea99f3364 service nova] Creating event network-vif-deleted:81294aa2-0c23-45a5-81ca-6872462ae6d3 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:08:58.579552 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1e048069-0155-45a1-935c-ea26ff32779d req-58721ad3-aa6f-4e9e-9391-c3aea99f3364 service nova] Creating event network-vif-deleted:4f4178c9-6e2b-461c-891f-79017ab0aabc for instance bed9f097-736e-467b-805c-1813e5c70ea3 on n-h2-858383-16 Oct 27 09:08:58.591737 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-594452d2-ca87-4c1f-88c8-d399d4b022d2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.623414 Oct 27 09:08:58.593038 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1137/2270] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:08:57 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:58.598039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:58.599526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:58.615797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.616531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.617403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.618595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.619248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.619960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.630015 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1e048069-0155-45a1-935c-ea26ff32779d req-58721ad3-aa6f-4e9e-9391-c3aea99f3364 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.131176 Oct 27 09:08:58.656976 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1134/2271] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:58.686847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:58.687771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:58.709083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.720745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.721084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.721887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:58.722304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:58.722734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:58.930239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:58.945533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:58.947596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:58.960766 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d66948ff-19c2-440b-9edf-02778c40399c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 0.363191 Oct 27 09:08:58.976150 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1138/2272] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:58 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:58.990461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fae45d3d-37ca-4fe1-b3c2-250d2270fb0a tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.000613 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fae45d3d-37ca-4fe1-b3c2-250d2270fb0a tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022562 Oct 27 09:08:59.001924 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1139/2273] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:08:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:08:59.007659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.008598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:59.015518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.016481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.017277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.018980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.019703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.020419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.030793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.042823 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4c60ee3-f892-4b7e-9184-ea75933a2907 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1308 microversion: 2.1 time: 0.380041 Oct 27 09:08:59.044103 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1135/2274] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:58 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:59.048957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.049738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:59.056771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:08:59.069744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.070736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.072172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.074264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.080702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.081674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.195674 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7bbb9ff6-2fe0-4ba9-b608-d47e39f052f1 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 204 len: 0 microversion: 2.25 time: 0.192024 Oct 27 09:08:59.196490 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1140/2275] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:08:59 2022] DELETE /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:08:59.213410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.214133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:59.222453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.222959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.223585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.224706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.225426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.225579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.242983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.257499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.262807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.271447 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c7bd54c-abd8-4f32-878b-da410949c48a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1560 microversion: 2.91 time: 0.225962 Oct 27 09:08:59.276700 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1136/2276] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:59 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:59.287605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.288239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:59.304657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.305168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.305617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.306507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.306778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.307209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.422900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.435165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.436692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.439726 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb380a72-207e-413c-8ccd-2c6b8a35941e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.160173 Oct 27 09:08:59.442188 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1137/2277] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:59 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:59.447533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.448976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:59.456479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.457219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.457814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.459247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.459903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.460520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.490679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:08:59.513877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.525337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.531372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.532865 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-93ff1ec3-d8fe-4838-babd-14e789a04f33 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1549 microversion: 2.25 time: 0.323872 Oct 27 09:08:59.533521 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1141/2278] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:59 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1549 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:08:59.540452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.541292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: bed9f097-736e-467b-805c-1813e5c70ea3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:59.547787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.548478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.549075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.549963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.550639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.551276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.576368 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] HTTP exception thrown: Instance bed9f097-736e-467b-805c-1813e5c70ea3 could not be found. Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Request method failure captured: Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 HTTP/1.1 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkob3r0hWvCLVgSx3aIiDsT5mXQBH9o8hZJBLlRREPY82DRfvTRrjbDKAIVS3IAH5teQQXim8ZflYmuwmzbRDUDaHKRpieaEFWf3-lxSZFQweQs4fHC1SYLBBcKWqX83km1j3ejOKTktv5d0jxtRlm16ExKHYwbe37mmX5TFu5e35j8 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 4d54fc3cc5ef488c9409163954878ca7 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdminTestJSON-777497297 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d54fc3cc5ef488c9409163954878ca7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d54fc3cc5ef488c9409163954878ca7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d54fc3cc5ef488c9409163954878ca7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d54fc3cc5ef488c9409163954878ca7"}]}] Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdminTestJSON-777497297 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 4d54fc3cc5ef488c9409163954878ca7 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdminTestJSON-777497297 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdminTestJSON-777497297-project Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 86bf6e736b6a44bfa47de6549573ddd4 Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdminTestJSON-777497297-project Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance bed9f097-736e-467b-805c-1813e5c70ea3 could not be found. Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'bed9f097-736e-467b-805c-1813e5c70ea3'} Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed9f097-736e-467b-805c-1813e5c70ea3 could not be found. Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed9f097-736e-467b-805c-1813e5c70ea3 could not be found. Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:08:59.578221 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed9f097-736e-467b-805c-1813e5c70ea3 could not be found. Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Returning 404 to user: Instance bed9f097-736e-467b-805c-1813e5c70ea3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-71c7258a-cb9a-4bea-b0e3-c2e892e1977b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3" status: 404 len: 111 microversion: 2.1 time: 0.045244 Oct 27 09:08:59.582692 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1142/2279] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:59 2022] GET /compute/v2.1/servers/bed9f097-736e-467b-805c-1813e5c70ea3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:08:59.589639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.590452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:59.605107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.610107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.610973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.613411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.614652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.616011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.629602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04edf363-fc6d-4c36-a235-00630f3f35eb tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 204 len: 0 microversion: 2.1 time: 0.185746 Oct 27 09:08:59.635880 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1138/2280] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:08:59 2022] DELETE /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:08:59.652090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.653463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:59.664031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.664583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.665130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.665927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.666587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.666955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.687843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:08:59.782869 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f0a7ea2-fc57-409d-93f5-2d87446abf7f tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "DELETE /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 204 len: 0 microversion: 2.1 time: 0.196880 Oct 27 09:08:59.790002 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1143/2281] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:08:59 2022] DELETE /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:08:59.795753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.796786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:08:59.803536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.804623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.805300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.808024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:08:59.808937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:08:59.809746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:08:59.945994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:08:59.953962 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96a8dade-4719-4d93-aafd-b912cac31d74 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1714 microversion: 2.1 time: 0.312899 Oct 27 09:08:59.954656 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1139/2282] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:59 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1714 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:08:59.993537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:08:59.995377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:00.001732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.002293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.002736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.003767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.004412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.005691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.073186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.081404 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa349685-0126-4a34-806e-c93f5ace5766 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1469 microversion: 2.1 time: 0.289817 Oct 27 09:09:00.081972 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1144/2283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:08:59 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:00.088410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:00.089473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:00.097303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.098270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.099676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.100619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.101124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.101568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.358425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.373074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.395680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.400042 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0abbf2ff-fc21-4b07-bade-ec8527f65fae tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 0.408543 Oct 27 09:09:00.408253 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1140/2284] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:08:59 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:09:00.417030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:00.417780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:00.439874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.441068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.444741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.446501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.455364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.455817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.473935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.496478 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c8f575bc-f7ea-427d-b72f-35de3f684d75 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1308 microversion: 2.1 time: 0.413194 Oct 27 09:09:00.497274 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1145/2285] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:00 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:00.501889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:00.502506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:00.520359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.523018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.523958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.531146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.531684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.532139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.572926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.586909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.590735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.606100 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1280055-6746-488f-b203-7f46593aa222 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1560 microversion: 2.91 time: 0.199731 Oct 27 09:09:00.622738 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1141/2286] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:00 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:00.623992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.634924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:00.635824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:00.643276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.643872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.644773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.645636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.647289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.647410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.647846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.648496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.651376 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e35380e4-c4a9-4d46-8f0f-e2b631a6c13c tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.153318 Oct 27 09:09:00.652759 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1146/2287] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:00 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:00.664438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e39425f9-5018-4c34-b4a1-67cee483aafb req-e1b844ad-70c8-4edc-9bf3-3e97123abc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b3e594-7d26-4197-b977-8f60fc81a4ff", "name": "network-vif-plugged", "status": "completed", "tag": "a9a9bbd6-f204-4116-b4c5-9036d94e2eab"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:00.674003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:00.684833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e39425f9-5018-4c34-b4a1-67cee483aafb req-e1b844ad-70c8-4edc-9bf3-3e97123abc4b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.686476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e39425f9-5018-4c34-b4a1-67cee483aafb req-e1b844ad-70c8-4edc-9bf3-3e97123abc4b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.687075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e39425f9-5018-4c34-b4a1-67cee483aafb req-e1b844ad-70c8-4edc-9bf3-3e97123abc4b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.701366 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e39425f9-5018-4c34-b4a1-67cee483aafb req-e1b844ad-70c8-4edc-9bf3-3e97123abc4b service nova] Creating event network-vif-plugged:a9a9bbd6-f204-4116-b4c5-9036d94e2eab for instance e5b3e594-7d26-4197-b977-8f60fc81a4ff on n-h1-858383-16 Oct 27 09:09:00.709505 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e39425f9-5018-4c34-b4a1-67cee483aafb req-e1b844ad-70c8-4edc-9bf3-3e97123abc4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053965 Oct 27 09:09:00.710900 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1147/2288] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:00.721500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f76bd91f-6e19-4f98-8b51-61239219504b req-b5b10073-6aaa-4d84-886d-524771c6d5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79563e06-eccd-4e97-88ce-f036e2d086e6", "name": "network-vif-deleted", "tag": "91f51f6e-082b-4bd2-a440-28e5320e62d1"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:00.735741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f76bd91f-6e19-4f98-8b51-61239219504b req-b5b10073-6aaa-4d84-886d-524771c6d5bd service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.737426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f76bd91f-6e19-4f98-8b51-61239219504b req-b5b10073-6aaa-4d84-886d-524771c6d5bd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.738017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f76bd91f-6e19-4f98-8b51-61239219504b req-b5b10073-6aaa-4d84-886d-524771c6d5bd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.755071 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f76bd91f-6e19-4f98-8b51-61239219504b req-b5b10073-6aaa-4d84-886d-524771c6d5bd service nova] Creating event network-vif-deleted:91f51f6e-082b-4bd2-a440-28e5320e62d1 for instance 79563e06-eccd-4e97-88ce-f036e2d086e6 on n-h1-858383-16 Oct 27 09:09:00.765896 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f76bd91f-6e19-4f98-8b51-61239219504b req-b5b10073-6aaa-4d84-886d-524771c6d5bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052798 Oct 27 09:09:00.766511 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1148/2289] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:00.875752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.895588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.903491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:00.905088 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34b3afcd-2a15-4134-8543-7c68fac672ec tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1549 microversion: 2.25 time: 0.281020 Oct 27 09:09:00.906233 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1142/2290] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:00 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1549 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:00.979446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:00.981093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:00.989210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.990625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.991236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:00.992315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:00.992919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:00.993496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.108827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:01.109913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:01.120579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.121821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.122775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.127182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.127851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.128398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.256934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:01.265350 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-03b18e3f-b6f1-4b37-8051-6ea137f00036 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1714 microversion: 2.1 time: 0.291164 Oct 27 09:09:01.280250 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1149/2291] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:00 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1714 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:01.356299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:01.368587 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12df9e7d-a66c-49a7-98e7-05fd79b5e85d tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1469 microversion: 2.1 time: 0.264847 Oct 27 09:09:01.369928 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1143/2292] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:01 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:09:01.428252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:01.429169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:01.439627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.440352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.441933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.443431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.445348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.447246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.487344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:01.522909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:01.528912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:01.542220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.543070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.543984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.545122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.545772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.546379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.743245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:01.759304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:01.761248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:01.762719 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-53477022-8408-4e66-a06a-b3592a9a0e28 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 0.338676 Oct 27 09:09:01.777117 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1150/2293] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:01 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:09:01.789063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:01.789909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:01.796936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.797730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.798181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.798458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:01.798925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.799344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.799823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.817283 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c86be758-254c-4f93-b46a-9888961b1802 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1308 microversion: 2.1 time: 0.298619 Oct 27 09:09:01.826432 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1144/2294] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:01 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:01.826432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:01.826432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:01.839448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.840178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.840619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.841338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.841795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.842223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.903002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:01.915067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:01.916543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:01.925859 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e294d659-b890-4da3-8b87-ad374b4fa61b tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1560 microversion: 2.91 time: 0.147201 Oct 27 09:09:01.928066 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1151/2295] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:01 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:01.933872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fa2e2ad8-f0bc-4ef0-bfca-cbf92eae04e9 req-6a5f59ce-1de9-4de6-be32-11ad064ec348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b454c4-af92-48f9-859c-dc3e702e22e0", "name": "network-vif-deleted", "tag": "ad86b77a-7d3b-4d7e-b22b-f254fe439313"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:01.947427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fa2e2ad8-f0bc-4ef0-bfca-cbf92eae04e9 req-6a5f59ce-1de9-4de6-be32-11ad064ec348 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:01.948266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fa2e2ad8-f0bc-4ef0-bfca-cbf92eae04e9 req-6a5f59ce-1de9-4de6-be32-11ad064ec348 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:01.948902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fa2e2ad8-f0bc-4ef0-bfca-cbf92eae04e9 req-6a5f59ce-1de9-4de6-be32-11ad064ec348 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:01.981406 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fa2e2ad8-f0bc-4ef0-bfca-cbf92eae04e9 req-6a5f59ce-1de9-4de6-be32-11ad064ec348 service nova] Creating event network-vif-deleted:ad86b77a-7d3b-4d7e-b22b-f254fe439313 for instance 79b454c4-af92-48f9-859c-dc3e702e22e0 on n-h1-858383-16 Oct 27 09:09:01.993293 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fa2e2ad8-f0bc-4ef0-bfca-cbf92eae04e9 req-6a5f59ce-1de9-4de6-be32-11ad064ec348 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061087 Oct 27 09:09:01.995692 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1152/2296] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:02.009677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:02.011991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:02.023532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.024409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.026111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:02.027271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.028036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.028698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:02.049224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:02.070689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:02.072444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:02.073846 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbcc8df4-da82-443f-b9ac-283381375429 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.253343 Oct 27 09:09:02.074566 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1145/2297] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:01 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:02.153560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:02.167454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:02.172696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:02.175675 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b305df58-b099-475a-a1f7-e5acfc913b92 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 200 len: 1332 microversion: 2.25 time: 0.178556 Oct 27 09:09:02.193894 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1153/2298] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:01 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 1332 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:02.291708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:02.292495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:02.320102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.322217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.323283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:02.331431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.341051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.341549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:02.394224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:02.394958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:02.419624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.419624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.419624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:02.419624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.419624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.419624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:02.925010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:02.937739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:02.939560 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2282844-7ece-4564-91e1-8a1f363faa33 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1714 microversion: 2.1 time: 0.651027 Oct 27 09:09:02.943040 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1146/2299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:02 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1714 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:02.949259 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-133e0841-f653-474c-a2af-7dad6439d7e5 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 200 len: 1469 microversion: 2.1 time: 0.559337 Oct 27 09:09:02.950827 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1154/2300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:02 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 1469 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:02.955914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:02.957148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:02.957396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:02.959075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:02.969336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.970176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.971041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:02.972316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.973133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.974020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:02.980901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.981576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.981969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:02.982809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:02.983701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:02.984379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.431801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.438207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.444398 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a8b1913-59ca-418a-bdfc-66334fe57a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1488 microversion: 2.1 time: 0.490166 Oct 27 09:09:03.448054 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1155/2301] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:02 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1488 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:03.463376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.468386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:03.471137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.473277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8008894-4cdd-407e-b8f1-8bb3046b6ea7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 0.528352 Oct 27 09:09:03.473583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:03.474767 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1147/2302] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:02 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:03.479981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:03.481321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:03.487940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.488693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.490026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.491498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.492221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.492869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.517117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.519852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.521413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.522325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.523687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.526813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.625476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.634683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.641000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.648654 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0aca9e30-b02d-4b3c-9e56-e8f6996c197d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1560 microversion: 2.91 time: 0.199342 Oct 27 09:09:03.656231 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1156/2303] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:03 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:03.665416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:03.672256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 79b454c4-af92-48f9-859c-dc3e702e22e0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:03.692525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.694330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.694915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.695281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.696035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.696493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.701190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.709934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.715769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:03.718319 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ff79c42-98f4-4c3d-af5c-086f77c64d28 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.242181 Oct 27 09:09:03.732848 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1148/2304] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:03 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:03.751864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-df11b866-3fa8-4168-b442-6fba0331b46c req-fe740e52-b4fc-4978-835c-7adc26b58850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b7f7ba-bef4-4bb8-857a-a10e5c63ff47", "name": "network-vif-deleted", "tag": "4eb61217-6569-44d5-8e30-41051be48cad"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:03.775875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] HTTP exception thrown: Instance 79b454c4-af92-48f9-859c-dc3e702e22e0 could not be found. Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Request method failure captured: Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 HTTP/1.1 Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkjOu_UDes_X40MI_97cqctdDXONXN64NqD9pCNDGuncPU9EKK7GW3IrvWbXMbypOyFsPYTDKBDXrSC36BCzxHDOZH2tcWvitXbGPDimr1kB8ZkASIPaGFmwZ_VNYmjqpCR7XbDAuE6rrGJmMhLGPp82r63nV-l0AzPSm_3FLZkWGog Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: ed77ec98569b4d25bbf481afb32c3fbc Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed77ec98569b4d25bbf481afb32c3fbc"}]}] Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: ed77ec98569b4d25bbf481afb32c3fbc Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-LiveAutoBlockMigrationV225Test-1525272738-project Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: cf8bc1ce921e4f759cb9c0b5f4340324 Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738-project Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 79b454c4-af92-48f9-859c-dc3e702e22e0 could not be found. Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '79b454c4-af92-48f9-859c-dc3e702e22e0'} Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b454c4-af92-48f9-859c-dc3e702e22e0 could not be found. Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b454c4-af92-48f9-859c-dc3e702e22e0 could not be found. Oct 27 09:09:03.777733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b454c4-af92-48f9-859c-dc3e702e22e0 could not be found. Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Returning 404 to user: Instance 79b454c4-af92-48f9-859c-dc3e702e22e0 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e4b0aa24-7e6b-4292-ab42-044bd79a6139 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0" status: 404 len: 111 microversion: 2.25 time: 0.121891 Oct 27 09:09:03.780862 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1157/2305] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:03 2022] GET /compute/v2.1/servers/79b454c4-af92-48f9-859c-dc3e702e22e0 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:09:03.799097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df11b866-3fa8-4168-b442-6fba0331b46c req-fe740e52-b4fc-4978-835c-7adc26b58850 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.799597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df11b866-3fa8-4168-b442-6fba0331b46c req-fe740e52-b4fc-4978-835c-7adc26b58850 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.808999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40372d2b-2e2c-4d3e-8a96-99b6eee836d4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:03.809709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40372d2b-2e2c-4d3e-8a96-99b6eee836d4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:03.814517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df11b866-3fa8-4168-b442-6fba0331b46c req-fe740e52-b4fc-4978-835c-7adc26b58850 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.816113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40372d2b-2e2c-4d3e-8a96-99b6eee836d4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.816783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40372d2b-2e2c-4d3e-8a96-99b6eee836d4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.817401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40372d2b-2e2c-4d3e-8a96-99b6eee836d4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.818596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40372d2b-2e2c-4d3e-8a96-99b6eee836d4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.819300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40372d2b-2e2c-4d3e-8a96-99b6eee836d4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.820387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40372d2b-2e2c-4d3e-8a96-99b6eee836d4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.852823 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-df11b866-3fa8-4168-b442-6fba0331b46c req-fe740e52-b4fc-4978-835c-7adc26b58850 service nova] Creating event network-vif-deleted:4eb61217-6569-44d5-8e30-41051be48cad for instance 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 on n-h1-858383-16 Oct 27 09:09:03.876639 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-df11b866-3fa8-4168-b442-6fba0331b46c req-fe740e52-b4fc-4978-835c-7adc26b58850 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138015 Oct 27 09:09:03.877282 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1149/2306] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:03.891033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:03.891702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:03.906839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.907352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.913176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.915117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.920648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.921225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.933233 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40372d2b-2e2c-4d3e-8a96-99b6eee836d4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff/action" status: 202 len: 0 microversion: 2.1 time: 0.152021 Oct 27 09:09:03.933886 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1158/2307] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:09:03 2022] POST /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:09:03.948578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:03.949384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:03.961788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.962873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.963364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:03.964167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:03.964685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:03.965247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:04.003870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:09:04.267008 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29332729-693a-4f46-aeba-e4b1e0993a8c tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "DELETE /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 204 len: 0 microversion: 2.25 time: 0.385740 Oct 27 09:09:04.270521 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1150/2308] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:09:03 2022] DELETE /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:09:04.281388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:04.285308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:04.298932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:04.301016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:04.301830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:04.306315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:04.307009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:04.308834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:04.753782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:04.770399 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c993b063-0d2c-4ffa-a29f-83f22f5b7329 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1493 microversion: 2.1 time: 0.830816 Oct 27 09:09:04.775427 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1159/2309] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:03 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1493 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:04.791416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:04.794962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:04.805151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:04.815479 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b16f487-83fa-4113-957c-b935f77d879c tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1646 microversion: 2.1 time: 0.542962 Oct 27 09:09:04.819795 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1151/2310] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:04 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1646 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:04.831759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:04.833697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:04.847445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:04.847658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:04.848698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:04.850301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:04.851211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:04.852003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:04.852586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:04.854258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:04.858454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:04.859511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:04.860879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:04.861789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:04.862681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:04.890026 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] HTTP exception thrown: Instance 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 could not be found. Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Request method failure captured: Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 HTTP/1.1 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkob3r0hWvCLVgSx3aIiDsT5mXQBH9o8hZJBLlRREPY82DRfvTRrjbDKAIVS3IAH5teQQXim8ZflYmuwmzbRDUDaHKRpieaEFWf3-lxSZFQweQs4fHC1SYLBBcKWqX83km1j3ejOKTktv5d0jxtRlm16ExKHYwbe37mmX5TFu5e35j8 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 4d54fc3cc5ef488c9409163954878ca7 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdminTestJSON-777497297 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d54fc3cc5ef488c9409163954878ca7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d54fc3cc5ef488c9409163954878ca7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d54fc3cc5ef488c9409163954878ca7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d54fc3cc5ef488c9409163954878ca7"}]}] Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdminTestJSON-777497297 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 4d54fc3cc5ef488c9409163954878ca7 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdminTestJSON-777497297 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdminTestJSON-777497297-project Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 86bf6e736b6a44bfa47de6549573ddd4 Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdminTestJSON-777497297-project Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 could not be found. Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '47b7f7ba-bef4-4bb8-857a-a10e5c63ff47'} Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 could not be found. Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 could not be found. Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:04.892552 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 could not be found. Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Returning 404 to user: Instance 47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e4427d96-b2a6-489f-b0f5-b2103ca10def tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47" status: 404 len: 111 microversion: 2.1 time: 0.117312 Oct 27 09:09:04.897725 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1160/2311] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:04 2022] GET /compute/v2.1/servers/47b7f7ba-bef4-4bb8-857a-a10e5c63ff47 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:09:04.904800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:04.905134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:04.921882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:04.922382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:04.922830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:04.923826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:04.924034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:04.924438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:05.534784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:05.555475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:05.564094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:05.571138 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e95478e-2fd1-4020-ab7e-2371525f4b35 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 0.669463 Oct 27 09:09:05.587798 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1161/2312] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:04 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:05.608734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:05.609613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:05.654310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:05.657475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:05.657984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:05.658752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:05.663730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:05.664152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:05.684753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:05.695797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:05.708509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:05.716213 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0b263ee-2dce-44ce-a6ab-9ef13bcfcfed tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1563 microversion: 2.25 time: 0.891683 Oct 27 09:09:05.717053 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1152/2313] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:04 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1563 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:05.733042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:05.734092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:05.753760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:05.754691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:05.755959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:05.760592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:05.761420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:05.762081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.052732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:06.072232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:06.073896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:06.105351 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-311005f3-ed3a-458b-919f-3ec2838e0555 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.521342 Oct 27 09:09:06.108827 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1162/2314] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:05 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:06.138064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:06.138823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:06.156323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.157096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.157687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.158674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.159388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.162788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.220849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:06.232394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:09:06.287778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:06.302541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:06.309649 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ffe1c4c6-8f43-4ac2-9b0b-ca8fe85e2aee tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.587561 Oct 27 09:09:06.310685 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1153/2315] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:05 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:06.328279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:06.331064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:06.355606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.358811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.359275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.362242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.362716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.368080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.473353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:06.479290 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c48f4942-25e4-4e75-88ec-95cd38aa1dc2 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 204 len: 0 microversion: 2.1 time: 0.349555 Oct 27 09:09:06.479923 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1163/2316] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:09:06 2022] DELETE /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:09:06.489595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:06.490332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:06.497965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.498513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.498955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.499760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.500260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.500692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.548670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.549874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.550562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.551221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lazy-loading 'fault' on Instance uuid 3e1d2ad1-7f91-47f3-b030-de36287cd241 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:09:06.764214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c880db7ee81e4b9886f6414fd9359ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7de08c501014c3f871b145030dc97cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:06.787673 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3cea7194-4cdf-44ba-afe2-672005143ae4 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 200 len: 1367 microversion: 2.1 time: 0.304880 Oct 27 09:09:06.804037 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1164/2317] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:06 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:06.820178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-639b849f-d2df-403f-9bfc-0b360d5cc3b1 req-c803f8bc-c305-4612-a5cb-18668425660f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d2ad1-7f91-47f3-b030-de36287cd241", "name": "network-vif-deleted", "tag": "b23a8df2-1eac-45b9-a02f-702b2776b1cf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:06.856757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-639b849f-d2df-403f-9bfc-0b360d5cc3b1 req-c803f8bc-c305-4612-a5cb-18668425660f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.857236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-639b849f-d2df-403f-9bfc-0b360d5cc3b1 req-c803f8bc-c305-4612-a5cb-18668425660f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.857671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-639b849f-d2df-403f-9bfc-0b360d5cc3b1 req-c803f8bc-c305-4612-a5cb-18668425660f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.905112 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-639b849f-d2df-403f-9bfc-0b360d5cc3b1 req-c803f8bc-c305-4612-a5cb-18668425660f service nova] Creating event network-vif-deleted:b23a8df2-1eac-45b9-a02f-702b2776b1cf for instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 on n-h2-858383-16 Oct 27 09:09:06.927533 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-639b849f-d2df-403f-9bfc-0b360d5cc3b1 req-c803f8bc-c305-4612-a5cb-18668425660f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124905 Oct 27 09:09:06.930407 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1165/2318] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:06.945285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:06.946010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:06.961362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.961927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.962574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:06.968229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:06.968741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:06.969199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:07.379160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:07.381488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:07.390276 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f6b36e05-d604-42ba-b633-0f636aa9eb93 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1470 microversion: 2.1 time: 0.458597 Oct 27 09:09:07.408379 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1166/2319] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:06 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1470 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:07.414468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:07.415102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:07.419852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:07.422588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:07.423098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:07.423553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:07.424363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:07.424891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:07.425309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:07.434789 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6954e10-e9b5-4047-8325-045f3392b05a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 200 len: 1473 microversion: 2.1 time: 1.118289 Oct 27 09:09:07.435391 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1154/2320] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:06 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 1473 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:07.464746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:07.465675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:07.485758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:07.486266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:07.486712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:07.487445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:07.487927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:07.495548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:07.784349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:07.806382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:07.807160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf8bc1ce921e4f759cb9c0b5f4340324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed77ec98569b4d25bbf481afb32c3fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:07.808417 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-27d2fcf7-b2e4-40d2-ba7b-fc1f8903199a tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 200 len: 1521 microversion: 2.25 time: 0.352479 Oct 27 09:09:07.809190 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1155/2321] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:07 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:07.840248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:07.840880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:07.858161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:07.864336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:07.865639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:07.867890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:07.868686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:07.872148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:07.883372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:07.901431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:07.905688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:07.914402 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1461142e-8e86-437b-9849-44f1aa4d3639 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 0.500024 Oct 27 09:09:07.915071 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1167/2322] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:07 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:07.923109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:07.925131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:07.999021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:08.003169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:08.003669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:08.004604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:08.004913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:08.012946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:08.034425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:08.066611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:08.081140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:08.088818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:08.116936 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92084153-44d7-491d-92ad-b819cb929e22 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.296480 Oct 27 09:09:08.120366 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1156/2323] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:07 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:08.123996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:08.128879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fdfe1bfa-6a99-4050-ae63-219cd4e4ca1c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-137782436"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:08.137735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fdfe1bfa-6a99-4050-ae63-219cd4e4ca1c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:08.155997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfe1bfa-6a99-4050-ae63-219cd4e4ca1c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:08.156536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfe1bfa-6a99-4050-ae63-219cd4e4ca1c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:08.156982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfe1bfa-6a99-4050-ae63-219cd4e4ca1c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:08.157801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfe1bfa-6a99-4050-ae63-219cd4e4ca1c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:08.158319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfe1bfa-6a99-4050-ae63-219cd4e4ca1c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:08.169429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfe1bfa-6a99-4050-ae63-219cd4e4ca1c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:08.283289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:08.311919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:08.313814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:08.318743 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1ec497be-2c71-411c-bd64-45b70b7648b7 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.402564 Oct 27 09:09:08.321291 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1168/2324] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:07 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:08.337103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:08.337991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] [instance: 3e1d2ad1-7f91-47f3-b030-de36287cd241] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:08.351723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:08.360179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:08.362865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:08.363834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:08.366485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:08.371910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:08.426625 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] HTTP exception thrown: Instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 could not be found. Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Request method failure captured: Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 HTTP/1.1 Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWko0oNiE8QXDQvVn82Ce84pP7tWX0B0liD3cODuAQdfNGgiJ2fDjX7L3QXZRTOmsR_yIoAjfzZ6mqHupalyC-D1pp1DrUZS_Dqys_7ZvIPKWUb5-OyxMQAcyQB0O8WVhoC5JMTnu4Ih5IzsK0ySgmMsU7memNjBZpFN9E_CQfeUfRK8 Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b7de08c501014c3f871b145030dc97cb Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestManualDisk-605204881 Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b7de08c501014c3f871b145030dc97cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b7de08c501014c3f871b145030dc97cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b7de08c501014c3f871b145030dc97cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b7de08c501014c3f871b145030dc97cb"}]}] Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestManualDisk-605204881 Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b7de08c501014c3f871b145030dc97cb Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestManualDisk-605204881 Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestManualDisk-605204881-project Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c880db7ee81e4b9886f6414fd9359ade Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestManualDisk-605204881-project Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 could not be found. Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '3e1d2ad1-7f91-47f3-b030-de36287cd241'} Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 could not be found. Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 could not be found. Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:08.430947 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:08.435088 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:08.435088 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:08.435088 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:08.435088 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:09:08.435088 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:09:08.435088 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 could not be found. Oct 27 09:09:08.435088 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:08.440716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Returning 404 to user: Instance 3e1d2ad1-7f91-47f3-b030-de36287cd241 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:09:08.441771 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7bedaef-cf10-49c7-b96a-c43ac49931e2 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241" status: 404 len: 111 microversion: 2.1 time: 0.118418 Oct 27 09:09:08.444586 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1169/2325] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:08 2022] GET /compute/v2.1/servers/3e1d2ad1-7f91-47f3-b030-de36287cd241 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:09:08.452525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:08.454587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:08.506599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:08.508099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:08.512230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:08.513146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:08.515123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:08.519654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:08.855084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:08.914800 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fdfe1bfa-6a99-4050-ae63-219cd4e4ca1c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff/action" status: 202 len: 0 microversion: 2.1 time: 0.779265 Oct 27 09:09:08.916219 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1157/2326] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:09:08 2022] POST /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:09:08.938403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e22fd4f9-7a00-48d2-867b-84d413ff6364 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] Calling method '.version_select at 0x7f31aaabe040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:08.989273 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e22fd4f9-7a00-48d2-867b-84d413ff6364 tempest-ServersTestManualDisk-605204881 tempest-ServersTestManualDisk-605204881-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-531436625" status: 202 len: 0 microversion: 2.1 time: 0.063892 Oct 27 09:09:08.995903 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1158/2327] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:09:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-531436625 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:09:09.006546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:09.009794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] [instance: 825baa14-c4b5-47d3-ade1-af3f779cd623] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:09.025925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:09.026748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:09.027593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:09.028626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:09.029423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:09.030042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:09.054667 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] HTTP exception thrown: Instance 825baa14-c4b5-47d3-ade1-af3f779cd623 could not be found. Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Request method failure captured: Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 HTTP/1.1 Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkjOu_UDes_X40MI_97cqctdDXONXN64NqD9pCNDGuncPU9EKK7GW3IrvWbXMbypOyFsPYTDKBDXrSC36BCzxHDOZH2tcWvitXbGPDimr1kB8ZkASIPaGFmwZ_VNYmjqpCR7XbDAuE6rrGJmMhLGPp82r63nV-l0AzPSm_3FLZkWGog Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.25 Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: ed77ec98569b4d25bbf481afb32c3fbc Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed77ec98569b4d25bbf481afb32c3fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed77ec98569b4d25bbf481afb32c3fbc"}]}] Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: ed77ec98569b4d25bbf481afb32c3fbc Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738 Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-LiveAutoBlockMigrationV225Test-1525272738-project Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: cf8bc1ce921e4f759cb9c0b5f4340324 Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1525272738-project Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 825baa14-c4b5-47d3-ade1-af3f779cd623 could not be found. Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '825baa14-c4b5-47d3-ade1-af3f779cd623'} Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825baa14-c4b5-47d3-ade1-af3f779cd623 could not be found. Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825baa14-c4b5-47d3-ade1-af3f779cd623 could not be found. Oct 27 09:09:09.056850 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:09.060119 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:09.060119 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:09.060119 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:09.060119 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:09.060119 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:09.060119 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:09:09.060119 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:09:09.060119 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825baa14-c4b5-47d3-ade1-af3f779cd623 could not be found. Oct 27 09:09:09.060119 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:09.061549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] Returning 404 to user: Instance 825baa14-c4b5-47d3-ade1-af3f779cd623 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:09:09.062588 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee7151ab-6dd3-469d-aa88-816ea05fb245 tempest-LiveAutoBlockMigrationV225Test-1525272738 tempest-LiveAutoBlockMigrationV225Test-1525272738-project] 10.222.0.25 "GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623" status: 404 len: 111 microversion: 2.25 time: 0.064864 Oct 27 09:09:09.067040 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1159/2328] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:08 2022] GET /compute/v2.1/servers/825baa14-c4b5-47d3-ade1-af3f779cd623 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:09:09.072607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c7adace-3352-47cb-9d54-aa04ee8b6b88 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa5023a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:09.159785 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c7adace-3352-47cb-9d54-aa04ee8b6b88 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 200 len: 1413 microversion: 2.1 time: 0.083881 Oct 27 09:09:09.163958 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1160/2329] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:09:09 2022] GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:09.192831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:09.193500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:09.237770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:09.238285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:09.238745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:09.239619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:09.240103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:09.240540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:09.387692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.405982 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da8ce613-c235-463c-b3d1-5626156cfa0b tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1470 microversion: 2.1 time: 0.957684 Oct 27 09:09:09.409847 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1170/2330] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:08 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1470 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:09.415992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a267a98b-c891-46bd-afee-52bd1842195b req-73165501-96dc-4926-b8ba-b9a3e48bc525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825baa14-c4b5-47d3-ade1-af3f779cd623", "name": "network-vif-deleted", "tag": "b9670495-9893-4b00-a8fa-658c87304fa1"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:09.450841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a267a98b-c891-46bd-afee-52bd1842195b req-73165501-96dc-4926-b8ba-b9a3e48bc525 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:09.453652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a267a98b-c891-46bd-afee-52bd1842195b req-73165501-96dc-4926-b8ba-b9a3e48bc525 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:09.454290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a267a98b-c891-46bd-afee-52bd1842195b req-73165501-96dc-4926-b8ba-b9a3e48bc525 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:09.487843 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a267a98b-c891-46bd-afee-52bd1842195b req-73165501-96dc-4926-b8ba-b9a3e48bc525 service nova] Creating event network-vif-deleted:b9670495-9893-4b00-a8fa-658c87304fa1 for instance 825baa14-c4b5-47d3-ade1-af3f779cd623 on n-h2-858383-16 Oct 27 09:09:09.510017 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a267a98b-c891-46bd-afee-52bd1842195b req-73165501-96dc-4926-b8ba-b9a3e48bc525 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089010 Oct 27 09:09:09.511793 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1171/2331] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:09.527045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:09.528558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:09.546432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:09.552568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:09.553355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:09.555043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:09.555817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:09.556420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:09.745786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.761602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.763372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.774853 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aa1589b7-4186-4665-af87-5599044999df tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.261642 Oct 27 09:09:09.775754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1172/2332] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:09 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:09.783515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:09.788681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:09.812393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:09.813138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:09.813760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:09.814647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:09.815270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:09.816162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:09.860858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.874411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.878900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.880732 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e8886a4-505c-4290-8113-c9fa13ba4250 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 0.715182 Oct 27 09:09:09.886072 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1161/2333] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:09 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:09.949698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.969262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.973401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:09.980640 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a5d1d3f4-e80c-4457-bea8-c6f5a386ee65 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.197865 Oct 27 09:09:09.981643 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1173/2334] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:09 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:10.178301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ff35be3-b7f2-4f64-8fc4-9d88333dcad3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa25d040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:10.280144 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ff35be3-b7f2-4f64-8fc4-9d88333dcad3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 200 len: 1413 microversion: 2.1 time: 0.106809 Oct 27 09:09:10.280655 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1162/2335] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:09:10 2022] GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:09:10.440294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:10.440294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:10.464171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:10.464611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:10.465085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:10.465805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:10.471558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:10.472129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:10.712894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:10.726317 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cec3225b-2b43-4029-84be-9cff8b7f3af9 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1428 microversion: 2.1 time: 0.287652 Oct 27 09:09:10.728692 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1174/2336] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:10 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1428 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:10.812091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:10.812741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:10.840675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:10.845424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:10.847602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:10.855963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:10.858104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:10.860441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:10.911106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:10.912524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:10.942111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:10.942999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:10.943714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:10.944649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:10.950132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:10.950920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:11.095361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.112534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.118009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.132621 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5dfb8895-66cc-40be-970e-da76c5a25c9d tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.322865 Oct 27 09:09:11.149854 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1163/2337] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:10 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:11.171341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:11.172133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:11.179785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:11.180501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:11.181102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:11.183467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:11.184149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:11.184721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:11.421280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.440914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.446398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.449475 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c80b3f15-209d-4fdd-8816-ded0104edb69 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.298501 Oct 27 09:09:11.452765 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1164/2338] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:11 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:11.463987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1d92763d-2412-4f62-a632-7305f0180dee tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa0ef5e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:11.516918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.536829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.546684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.548287 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b6100e4-4023-484e-bfc7-4390bfe583cb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 0.641456 Oct 27 09:09:11.563605 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1d92763d-2412-4f62-a632-7305f0180dee tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 200 len: 1413 microversion: 2.1 time: 0.097127 Oct 27 09:09:11.563605 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1165/2339] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:09:11 2022] GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:11.572534 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1175/2340] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:10 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:09:11.582273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0696347a-5186-4421-8c88-4079c1267fc7 req-add376e5-9358-4661-a563-c6322cafbb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4349576-ae59-481f-92ec-599ddae530d7", "name": "network-vif-deleted", "tag": "e74cd9c8-3c59-4b33-a7c7-5358d3b644c0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:11.605896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0696347a-5186-4421-8c88-4079c1267fc7 req-add376e5-9358-4661-a563-c6322cafbb49 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:11.606757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0696347a-5186-4421-8c88-4079c1267fc7 req-add376e5-9358-4661-a563-c6322cafbb49 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:11.607399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0696347a-5186-4421-8c88-4079c1267fc7 req-add376e5-9358-4661-a563-c6322cafbb49 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:11.634245 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0696347a-5186-4421-8c88-4079c1267fc7 req-add376e5-9358-4661-a563-c6322cafbb49 service nova] Creating event network-vif-deleted:e74cd9c8-3c59-4b33-a7c7-5358d3b644c0 for instance d4349576-ae59-481f-92ec-599ddae530d7 on n-h2-858383-16 Oct 27 09:09:11.645300 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0696347a-5186-4421-8c88-4079c1267fc7 req-add376e5-9358-4661-a563-c6322cafbb49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067874 Oct 27 09:09:11.647874 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1166/2341] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:11.751953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:11.752942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:11.769126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:11.770043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:11.771912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:11.773235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:11.775941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:11.776746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:11.832605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:11.834073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:11.835383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:11.836236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lazy-loading 'fault' on Instance uuid d4349576-ae59-481f-92ec-599ddae530d7 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:09:11.948083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf6e736b6a44bfa47de6549573ddd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d54fc3cc5ef488c9409163954878ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:11.956599 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40ea42c2-e166-4c2f-973d-55e0bfed1d11 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 200 len: 1304 microversion: 2.1 time: 0.209863 Oct 27 09:09:11.960935 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1176/2342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:11 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:12.172111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:12.173227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:12.225903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:12.229583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:12.234513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:12.237135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:12.242968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:12.243883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:12.500609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:12.504973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:12.545238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:12.566012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:12.568713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:12.570465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:12.572539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:12.578391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:12.628905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:12.640892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:12.641578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:12.668668 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab9e3aa3-877a-4a6f-8d2e-14e5b6aea375 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.503322 Oct 27 09:09:12.669937 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1167/2343] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:12 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:12.675849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-285bb1a3-48ad-4253-9424-6b78c3a7dcaa tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa826670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:12.767214 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-285bb1a3-48ad-4253-9424-6b78c3a7dcaa tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 200 len: 1413 microversion: 2.1 time: 0.095957 Oct 27 09:09:12.774225 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1168/2344] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:09:12 2022] GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:12.779380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:12.788689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:12.789356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:12.808648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:12.813449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:12.814124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:12.814653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:12.817325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:12.818441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:12.818937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:12.821733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:12.843644 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea767898-44f7-4dbb-b4ae-5d4d65217694 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.350878 Oct 27 09:09:12.847255 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1177/2345] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:12 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:12.983141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:12.983830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] [instance: d4349576-ae59-481f-92ec-599ddae530d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:12.996969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:13.004377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:13.005665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:13.009412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:13.011069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:13.017440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:13.056130 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] HTTP exception thrown: Instance d4349576-ae59-481f-92ec-599ddae530d7 could not be found. Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Request method failure captured: Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 HTTP/1.1 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkob3r0hWvCLVgSx3aIiDsT5mXQBH9o8hZJBLlRREPY82DRfvTRrjbDKAIVS3IAH5teQQXim8ZflYmuwmzbRDUDaHKRpieaEFWf3-lxSZFQweQs4fHC1SYLBBcKWqX83km1j3ejOKTktv5d0jxtRlm16ExKHYwbe37mmX5TFu5e35j8 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 4d54fc3cc5ef488c9409163954878ca7 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdminTestJSON-777497297 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d54fc3cc5ef488c9409163954878ca7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d54fc3cc5ef488c9409163954878ca7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d54fc3cc5ef488c9409163954878ca7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d54fc3cc5ef488c9409163954878ca7"}]}] Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdminTestJSON-777497297 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 4d54fc3cc5ef488c9409163954878ca7 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdminTestJSON-777497297 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdminTestJSON-777497297-project Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 86bf6e736b6a44bfa47de6549573ddd4 Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdminTestJSON-777497297-project Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance d4349576-ae59-481f-92ec-599ddae530d7 could not be found. Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd4349576-ae59-481f-92ec-599ddae530d7'} Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4349576-ae59-481f-92ec-599ddae530d7 could not be found. Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4349576-ae59-481f-92ec-599ddae530d7 could not be found. Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:13.073374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:13.077491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:13.077491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:13.077491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:13.077491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:09:13.077491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:09:13.077491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4349576-ae59-481f-92ec-599ddae530d7 could not be found. Oct 27 09:09:13.077491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:13.084893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] Returning 404 to user: Instance d4349576-ae59-481f-92ec-599ddae530d7 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:09:13.086171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2b538a01-80b7-40de-a85e-57a3e93ec5b1 tempest-ServersAdminTestJSON-777497297 tempest-ServersAdminTestJSON-777497297-project] 10.222.0.25 "GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7" status: 404 len: 111 microversion: 2.1 time: 0.107488 Oct 27 09:09:13.086905 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1178/2346] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:12 2022] GET /compute/v2.1/servers/d4349576-ae59-481f-92ec-599ddae530d7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:09:13.694933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:13.703185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:13.703830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:13.706380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:13.710354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:13.711621 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21a6dfb4-a7a8-4264-8c46-86ec70d6c45e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1751 microversion: 2.20 time: 0.936369 Oct 27 09:09:13.712210 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1169/2347] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:12 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1751 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:13.720316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:13.723728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:13.724572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:13.725520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:13.727768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:13.729228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:13.790517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6073857d-c3e3-4351-8435-c4b20378c2eb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31abbf58b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:13.906928 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6073857d-c3e3-4351-8435-c4b20378c2eb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 200 len: 1413 microversion: 2.1 time: 0.121350 Oct 27 09:09:13.907653 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1170/2348] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:09:13 2022] GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:09:13.929710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:13.932788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:13.948314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:13.948314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:13.948314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:13.951847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:13.952468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:13.952930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:13.970786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:13.988430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:13.992877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:14.012342 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb658670-6ef5-48de-a2d4-fdd88e3b0247 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.314379 Oct 27 09:09:14.012950 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1179/2349] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:13 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:09:14.348593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:14.379523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:14.386847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:14.388232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-03a5568a-47a0-4609-b4d2-1e288b80c1f5 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.467369 Oct 27 09:09:14.396924 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1171/2350] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:13 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:14.743524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:14.744910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:14.756407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:14.763222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:14.764221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:14.765475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:14.766145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:14.766802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:14.923987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e1a25e6-ff21-4199-a109-afae2e2642e0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa452dc0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:15.039980 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e1a25e6-ff21-4199-a109-afae2e2642e0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 200 len: 1413 microversion: 2.1 time: 0.120023 Oct 27 09:09:15.050288 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1172/2351] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:09:14 2022] GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:15.060484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:15.061103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:15.084190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:15.092969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:15.094178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:15.095132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:15.095974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:15.096848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:15.651658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:15.671244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:15.683182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:15.716634 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f901a54d-bfbe-492f-9885-55a1e2410646 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.652706 Oct 27 09:09:15.763512 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1173/2352] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:15 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:15.770708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d33c3916-8a90-431e-8199-f44345b341a7 req-8dae57d8-d0fb-4044-b871-203273d58f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b3e594-7d26-4197-b977-8f60fc81a4ff", "name": "network-vif-plugged", "status": "completed", "tag": "a9a9bbd6-f204-4116-b4c5-9036d94e2eab"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:15.798597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d33c3916-8a90-431e-8199-f44345b341a7 req-8dae57d8-d0fb-4044-b871-203273d58f43 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:15.800492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d33c3916-8a90-431e-8199-f44345b341a7 req-8dae57d8-d0fb-4044-b871-203273d58f43 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:15.800621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d33c3916-8a90-431e-8199-f44345b341a7 req-8dae57d8-d0fb-4044-b871-203273d58f43 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:15.836663 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d33c3916-8a90-431e-8199-f44345b341a7 req-8dae57d8-d0fb-4044-b871-203273d58f43 service nova] Creating event network-vif-plugged:a9a9bbd6-f204-4116-b4c5-9036d94e2eab for instance e5b3e594-7d26-4197-b977-8f60fc81a4ff on n-h1-858383-16 Oct 27 09:09:15.849377 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d33c3916-8a90-431e-8199-f44345b341a7 req-8dae57d8-d0fb-4044-b871-203273d58f43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082486 Oct 27 09:09:15.850341 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1174/2353] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:15.857510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:15.858280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:15.869659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:15.870181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:15.870741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:15.871508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:15.872086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:15.872576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:16.321392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:16.348230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:16.354272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:16.354847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:16.359869 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8521d03a-7cee-4593-a75b-5f9a2a6a9a88 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.508131 Oct 27 09:09:16.363753 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1175/2354] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:15 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:16.376178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:16.384725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:16.392672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b94a506-f55b-4184-8e2c-51632ff71b49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa452f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:16.394167 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b6a00b0-a81f-4f8f-b8b0-50a6bb4ef8e4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 1.654740 Oct 27 09:09:16.400786 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1180/2355] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:14 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:16.762226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:16.765020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:16.788886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:16.789652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:16.790495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:16.792443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:16.797105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:16.798750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:18.018316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:18.056675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:18.068077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:18.091220 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e63df801-9055-4f6b-a063-20b51c217d06 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 1.334473 Oct 27 09:09:18.091816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1181/2356] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:16 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:18.145185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:18.145791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:18.170117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:18.170631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:18.171084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:18.171859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:18.172324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:18.172760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:18.858009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:18.886392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:18.888210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:18.896951 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2303221d-1a57-40a1-a347-50bc4af7ce95 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.769069 Oct 27 09:09:18.897926 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1182/2357] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:18 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:18.918720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:18.918720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:18.952530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:18.953054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:18.953494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:18.954276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:18.954744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:18.955145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:19.954416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:19.971037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:19.990639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:19.992470 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-07fd747d-01b0-44f8-b067-9cf0b219e30a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 1.092787 Oct 27 09:09:20.008990 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1183/2358] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:18 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:20.674617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-324193678", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "afa42004-6ac7-485a-b396-803a3056664e"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:25.866236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:26.333361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:29.963510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=93 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:30.728064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=52 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:34.253492 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b94a506-f55b-4184-8e2c-51632ff71b49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 200 len: 1413 microversion: 2.1 time: 17.887945 Oct 27 09:09:34.260517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] validate_networks() for [('afa42004-6ac7-485a-b396-803a3056664e', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:09:34.261214 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1176/2359] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:09:16 2022] GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 1413 bytes in 17897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:34.269087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:34.271428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:34.281801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:34.282552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:34.283222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:34.284187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:34.285091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:34.285761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:34.562305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:34.578111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:34.580492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:34.599460 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-89c04bcb-02b0-477b-bb82-92c3f5805f5f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.334303 Oct 27 09:09:34.602871 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1177/2360] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:34 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:34.612849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:34.617388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:34.627049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:34.645453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:34.646060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:34.646847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:34.647333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:34.653124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:34.867092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:34.877255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:34.885327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:34.888939 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1990a6b7-66c1-43b6-a9ba-50e96440118e tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1605 microversion: 2.32 time: 0.284114 Oct 27 09:09:34.896950 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1178/2361] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:34 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1605 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:34.912374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:34.913145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:34.921947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:34.926043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:34.927885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:34.933006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:34.936014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:34.936755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:36.451708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:09:36.452242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:09:36.452633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:09:36.453049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:09:36.453464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:09:36.457262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:36.475146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:36.475690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:36.476896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:36.477641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:36.479299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:36.480978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:36.489748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:36.495401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:36.502725 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f82897f-23dd-4223-a3b2-2d37b4441ca3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 1.604101 Oct 27 09:09:36.507134 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1179/2362] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:34 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:36.535457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-03621644-0081-418c-b66c-be0c72232b04 req-7531188a-abb6-4323-a35b-c28e98377722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d248926-b23e-472b-9a1e-4b10c924758a", "tag": "c24197dc-db5d-4363-91d8-125f1e441095"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:36.557131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Getting quotas for project 953ae7d1663a42caa17536474bc7f792. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:09:36.573761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Getting quotas for user 35c49dc808e1466b9202582583e5cc93 and project 953ae7d1663a42caa17536474bc7f792. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:09:36.577288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-03621644-0081-418c-b66c-be0c72232b04 req-7531188a-abb6-4323-a35b-c28e98377722 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:36.578728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-03621644-0081-418c-b66c-be0c72232b04 req-7531188a-abb6-4323-a35b-c28e98377722 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:36.582762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-03621644-0081-418c-b66c-be0c72232b04 req-7531188a-abb6-4323-a35b-c28e98377722 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:36.604133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:09:36.611012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:09:36.659005 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-03621644-0081-418c-b66c-be0c72232b04 req-7531188a-abb6-4323-a35b-c28e98377722 service nova] Creating event network-changed:c24197dc-db5d-4363-91d8-125f1e441095 for instance 3d248926-b23e-472b-9a1e-4b10c924758a on n-h2-858383-16 Oct 27 09:09:36.675653 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-03621644-0081-418c-b66c-be0c72232b04 req-7531188a-abb6-4323-a35b-c28e98377722 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162053 Oct 27 09:09:36.679132 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1180/2363] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:36.705088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59d2690d-b45e-48bb-a4df-e2efabcd557b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa2d7ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:36.747321 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25b65a00-845d-4b0c-8c6d-334352bff390 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 16.730521 Oct 27 09:09:36.755356 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1184/2364] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 16745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:09:36.775853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:36.780137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:36.814113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:36.818782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:36.819296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:36.823715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:36.827007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:36.827473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:37.782760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:37.813003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:37.816108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:37.853825 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-df9072d9-f64a-4a03-93b2-61dfaf663b2a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 1.094665 Oct 27 09:09:37.856774 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1185/2365] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:36 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:37.881388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:37.883314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:37.912384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:37.920197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:37.923185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:37.924131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:37.924553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:37.928022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:38.039117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:38.039890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:38.040730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:38.041746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lazy-loading 'fault' on Instance uuid 79563e06-eccd-4e97-88ce-f036e2d086e6 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:09:38.410335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:38.446566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:38.459209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7176e89e16e4b0788ebecec7a32a924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6a0e925ac430c8dced7c02d70b45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:38.461651 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae24732f-827a-4b55-8c45-a3737b0f5ce4 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 200 len: 1610 microversion: 2.32 time: 0.599178 Oct 27 09:09:38.490547 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1186/2366] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:37 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 1610 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:38.504490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:38.509529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:38.529140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:38.530832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:38.532222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:38.536410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:38.537200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:38.538386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:38.825659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:38.860102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:38.872415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:38.880249 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a8b4494-b87a-4895-b05f-aae378ef02c3 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1262 microversion: 2.21 time: 0.381005 Oct 27 09:09:38.884816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1187/2367] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:38 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1262 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:38.893956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:38.894819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:38.923558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:38.928851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:38.931234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:38.932785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:38.935861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:38.942343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:40.162712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:40.186528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:40.194224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:40.200335 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bb01b279-54a6-41e9-b8c7-e4aaa11ac475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 1.311603 Oct 27 09:09:40.201881 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1188/2368] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:38 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:40.228750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:40.230231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:40.250060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:40.253248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:40.253755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:40.254507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:40.255035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:40.263313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:40.582768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:40.592864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:40.606151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:40.621667 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ea4545f-0a5c-43c5-90c1-b770cbf07d88 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.414875 Oct 27 09:09:40.622299 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1189/2369] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:40 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:40.672987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:40.673613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:40.711127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:40.712280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:40.716403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:40.720408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:40.724014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:40.726261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:40.818642 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] HTTP exception thrown: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Request method failure captured: Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 HTTP/1.1 Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkk_vOftQL1Rc19io01ZqjNc0Hmfha5KAQsnS9BYQOvhU4ke6TgxMG8NVzgkD1SIvKBCyf8KZ_rfPMMFt3YRxbMVA07hhir3A_GEAmmp6qCMX_8sWZN1ZN-LY-kMcCpc7YOKSMjwseUd_rafP-EdY6wY80pAxmF2Hj89jGqwiVDi07w Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1df6a0e925ac430c8dced7c02d70b45a Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TaggedBootDevicesTest-189902524 Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1df6a0e925ac430c8dced7c02d70b45a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1df6a0e925ac430c8dced7c02d70b45a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1df6a0e925ac430c8dced7c02d70b45a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1df6a0e925ac430c8dced7c02d70b45a"}]}] Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TaggedBootDevicesTest-189902524 Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1df6a0e925ac430c8dced7c02d70b45a Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TaggedBootDevicesTest-189902524 Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TaggedBootDevicesTest-189902524-project Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: d7176e89e16e4b0788ebecec7a32a924 Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TaggedBootDevicesTest-189902524-project Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '79563e06-eccd-4e97-88ce-f036e2d086e6'} Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:40.821094 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:40.825598 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:40.825598 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:40.825598 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:40.825598 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:09:40.825598 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:09:40.825598 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:40.825598 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:09:40.832798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Returning 404 to user: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:09:40.840232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e973ccb-fddf-4168-bdc3-860c38804599 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 404 len: 111 microversion: 2.32 time: 0.178234 Oct 27 09:09:40.842136 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1190/2370] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:40 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:09:40.884753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:40.886443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:40.919114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:40.923525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:40.929127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:40.935835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:40.937820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:40.939349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:41.380337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:41.393039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:41.394832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:41.396733 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c644fb0d-49d8-4914-a628-64b98a180e17 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1316 microversion: 2.21 time: 0.549966 Oct 27 09:09:41.401946 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1191/2371] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:40 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:41.415754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f9ba6eea-092f-49ab-a207-8925968f4146 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '.version_select at 0x7f31aa35faf0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:41.463873 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f9ba6eea-092f-49ab-a207-8925968f4146 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695940829" status: 204 len: 0 microversion: 2.32 time: 0.059051 Oct 27 09:09:41.464874 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1192/2372] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Oct 27 09:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695940829 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:09:41.474911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:41.476126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:41.501640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:41.508996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:41.509770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:41.512331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:41.514344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:41.515992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:43.079602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59d2690d-b45e-48bb-a4df-e2efabcd557b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 200 len: 1422 microversion: 2.1 time: 6.396001 Oct 27 09:09:43.092422 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1181/2373] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:09:36 2022] GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 1422 bytes in 6409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:43.113932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:43.121520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:43.137533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:43.140606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:43.141107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:43.141946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:43.148006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:43.155224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:43.184873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:43.216791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:43.225771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:43.235347 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-451ebe25-b407-42ed-911a-e799656aacbf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 1.764395 Oct 27 09:09:43.239815 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1193/2374] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:41 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:43.271420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:43.272833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:43.292658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:43.296248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:43.296709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:43.302918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:43.303490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:43.303994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:43.570330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:43.589438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:43.590924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:43.608293 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5813075e-b481-4ea8-b3d0-433d039b78a2 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1316 microversion: 2.21 time: 0.366704 Oct 27 09:09:43.608903 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1194/2375] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:43 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:43.638489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-400f85e5-7cc8-45f7-adf5-99313a93bb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa0d2b80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:43.651768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:43.664520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:43.666141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:43.722822 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-39f3601f-9ce3-470b-883b-a88d65cc8c18 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1555 microversion: 2.91 time: 0.624148 Oct 27 09:09:43.724850 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1182/2376] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:43 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1555 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:43.783891 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-400f85e5-7cc8-45f7-adf5-99313a93bb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 200 len: 1422 microversion: 2.1 time: 0.151988 Oct 27 09:09:43.796555 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1195/2377] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:09:43 2022] GET /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 1422 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:43.800275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-251e5afd-a432-4c29-83f5-346efc6173b2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa13f9d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:44.270841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-321037413", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:45.556697 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-251e5afd-a432-4c29-83f5-346efc6173b2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 204 len: 0 microversion: 2.1 time: 1.760668 Oct 27 09:09:45.557799 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1183/2378] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:43 2022] DELETE /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 0 bytes in 1762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:09:45.562626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:45.563248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:45.609406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:45.609936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:45.610367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:45.611090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:45.611550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:45.625849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:45.659129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:09:46.526195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:46.594690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:47.049511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:47.066048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:47.073721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:47.076597 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc1838df-99dc-4a70-aceb-2984bd32d57f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 1.517761 Oct 27 09:09:47.079771 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1184/2379] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:45 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:47.102959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:47.104741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:47.126932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:47.131259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:47.132860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:47.134613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:47.139896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:47.146715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:47.984671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:09:47.985296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:09:47.985558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:09:47.986333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:09:47.986939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:09:48.007741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:48.010886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:48.013809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:48.021126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:48.023512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:48.027949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:48.090798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:09:48.104909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:09:48.160285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:09:48.173306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:09:48.311821 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ad027d56-4a2e-489c-9d50-d0db0c49941a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.445967 Oct 27 09:09:48.315270 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1196/2380] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:09:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:09:48.330233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:48.335210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:48.354839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:48.355708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:48.357219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:48.374417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:48.376801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:48.381250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:48.429895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:48.448366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:48.450525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:48.453013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0af228da-4f54-42be-a4fc-f345580beca6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1358 microversion: 2.21 time: 1.368714 Oct 27 09:09:48.454433 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1185/2381] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:47 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1358 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:48.464662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:48.465744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:48.472811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:48.473732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:48.474402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:48.475602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:48.476311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:48.476974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:48.523275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:09:48.723279 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ef43930-8811-46a7-a8f6-ced4652ca665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 204 len: 0 microversion: 2.1 time: 0.265222 Oct 27 09:09:48.724547 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1186/2382] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:09:48 2022] DELETE /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:09:48.896799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:48.906478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:48.908104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:48.933432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-64db4f3d-5a40-4668-a059-f979865a6e1d tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Action: 'create', calling method: .version_select at 0x7f31aa0ef310>, body: {"pool": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:48.945792 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38547e3a-ac6d-4f7a-9f66-57dd4c3b141f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1480 microversion: 2.91 time: 0.628685 Oct 27 09:09:48.946665 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1197/2383] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:48 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1480 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:48.955848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-615c628e-b599-4a97-99de-a1527da30fb9 req-3974ab95-f25e-4c4c-9426-7f0fc3b40ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b3e594-7d26-4197-b977-8f60fc81a4ff", "name": "network-vif-unplugged", "status": "completed", "tag": "a9a9bbd6-f204-4116-b4c5-9036d94e2eab"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:49.000761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-615c628e-b599-4a97-99de-a1527da30fb9 req-3974ab95-f25e-4c4c-9426-7f0fc3b40ccb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:49.002080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-615c628e-b599-4a97-99de-a1527da30fb9 req-3974ab95-f25e-4c4c-9426-7f0fc3b40ccb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:49.002946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-615c628e-b599-4a97-99de-a1527da30fb9 req-3974ab95-f25e-4c4c-9426-7f0fc3b40ccb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:49.022897 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-615c628e-b599-4a97-99de-a1527da30fb9 req-3974ab95-f25e-4c4c-9426-7f0fc3b40ccb service nova] Creating event network-vif-unplugged:a9a9bbd6-f204-4116-b4c5-9036d94e2eab for instance e5b3e594-7d26-4197-b977-8f60fc81a4ff on n-h1-858383-16 Oct 27 09:09:49.032558 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-615c628e-b599-4a97-99de-a1527da30fb9 req-3974ab95-f25e-4c4c-9426-7f0fc3b40ccb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083872 Oct 27 09:09:49.033838 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1198/2384] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:49.041436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:49.042640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:49.054127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:49.055497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:49.056222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:49.057185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:49.057864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:49.058516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:49.779681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:49.800208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:49.806114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:49.807762 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ab397bcf-c345-415d-8ecd-6a90058b7666 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 0.772496 Oct 27 09:09:49.813795 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1199/2385] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:49 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:49.826952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:49.832488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:49.868393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:49.872365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:49.873039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:49.873975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:49.881131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:49.881589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:50.047992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:50.057124 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d77bb3f5-995c-4f78-a453-95b79c986462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1212 microversion: 2.1 time: 0.241889 Oct 27 09:09:50.072036 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1200/2386] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:49 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1212 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:50.083434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1784684777", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "8aa86863-8c60-413b-9747-3e375f601520"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:50.238788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] validate_networks() for [('8aa86863-8c60-413b-9747-3e375f601520', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:09:54.679610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:09:54.681113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:09:54.684067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:09:54.684757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:09:54.685387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:09:54.703886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:54.704776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:54.705445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:54.708395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:54.709206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:54.709867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:54.744395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:09:54.751182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for user e63dd72032ef4fe098382555888e3ae3 and project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:09:54.776544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:09:54.787007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:09:54.885245 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-690d2c37-da06-46ac-ab51-d27e0025597d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.811945 Oct 27 09:09:54.888450 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1201/2387] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:09:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:09:54.914633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:54.918872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:54.928876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:54.929478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:54.930105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:54.931739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:54.932350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:54.950460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:55.054529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858383-16". {{(pid=120602) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 27 09:09:55.314751 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e0db723-5f80-4df3-83b7-5d42f3ad720c tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d/action" status: 202 len: 0 microversion: 2.91 time: 0.420933 Oct 27 09:09:55.318756 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1202/2388] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:09:54 2022] POST /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:09:55.357032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:55.359840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:55.387653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:55.389583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:55.390218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:55.393933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:55.395673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:55.397584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:56.964303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:56.984457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:56.986503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:56.987975 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-54c3b2e1-fc22-4421-9af8-43449b27c30b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1358 microversion: 2.21 time: 1.667564 Oct 27 09:09:57.004255 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1203/2389] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:55 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1358 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:57.018533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:57.024747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:57.031490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:57.032264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:57.032886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:57.033778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:57.034469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:57.035088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:57.041361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:57.571396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:57.580746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:57.582237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:57.584169 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5a42ffd-9f5e-4576-9630-e1882cba1c5f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 0.577990 Oct 27 09:09:57.592258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1204/2390] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:57 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:57.592258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:57.592258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:57.598835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:57.599538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:57.600154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:57.601055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:57.601650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:57.602467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.031165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:58.040059 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-136a07cf-04bd-48c3-a3fd-82f5241f6d8f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1316 microversion: 2.1 time: 0.453981 Oct 27 09:09:58.061446 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1205/2391] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:57 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:58.067783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fa1a2c07-13f9-4e82-9c26-7c7dcc19406a req-60b34fcc-51b6-49f2-a1a8-514514af0220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc", "tag": "5cfcef56-5b4d-4a92-a0bb-acbd1ddc4b56"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:58.087558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fa1a2c07-13f9-4e82-9c26-7c7dcc19406a req-60b34fcc-51b6-49f2-a1a8-514514af0220 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.088083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fa1a2c07-13f9-4e82-9c26-7c7dcc19406a req-60b34fcc-51b6-49f2-a1a8-514514af0220 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.088530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fa1a2c07-13f9-4e82-9c26-7c7dcc19406a req-60b34fcc-51b6-49f2-a1a8-514514af0220 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.110051 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fa1a2c07-13f9-4e82-9c26-7c7dcc19406a req-60b34fcc-51b6-49f2-a1a8-514514af0220 service nova] Creating event network-changed:5cfcef56-5b4d-4a92-a0bb-acbd1ddc4b56 for instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc on n-h1-858383-16 Oct 27 09:09:58.117872 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fa1a2c07-13f9-4e82-9c26-7c7dcc19406a req-60b34fcc-51b6-49f2-a1a8-514514af0220 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055020 Oct 27 09:09:58.118834 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1206/2392] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:58.125085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e8770c57-8b12-43a9-8c8e-0e6a06d1fe1c req-f7a227dc-f79d-4e17-bee9-dd86a760ac85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b3e594-7d26-4197-b977-8f60fc81a4ff", "name": "network-vif-deleted", "tag": "a9a9bbd6-f204-4116-b4c5-9036d94e2eab"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:58.131627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:58.135192 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-64db4f3d-5a40-4668-a059-f979865a6e1d tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.409213 Oct 27 09:09:58.136993 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1187/2393] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:09:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:58.140989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e8770c57-8b12-43a9-8c8e-0e6a06d1fe1c req-f7a227dc-f79d-4e17-bee9-dd86a760ac85 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.141725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e8770c57-8b12-43a9-8c8e-0e6a06d1fe1c req-f7a227dc-f79d-4e17-bee9-dd86a760ac85 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.142365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e8770c57-8b12-43a9-8c8e-0e6a06d1fe1c req-f7a227dc-f79d-4e17-bee9-dd86a760ac85 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.148316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:58.149048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:58.158355 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e8770c57-8b12-43a9-8c8e-0e6a06d1fe1c req-f7a227dc-f79d-4e17-bee9-dd86a760ac85 service nova] Creating event network-vif-deleted:a9a9bbd6-f204-4116-b4c5-9036d94e2eab for instance e5b3e594-7d26-4197-b977-8f60fc81a4ff on n-h1-858383-16 Oct 27 09:09:58.162937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:58.163771 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e8770c57-8b12-43a9-8c8e-0e6a06d1fe1c req-f7a227dc-f79d-4e17-bee9-dd86a760ac85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043308 Oct 27 09:09:58.164384 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1207/2394] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:58.166296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.167087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.167334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.177370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:58.178315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:58.180642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.181431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.182864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.187208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.187770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.188472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.189423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.190089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.190731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.214686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:09:58.286680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:58.304917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:58.311784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:58.313817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:58.314650 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08b0f81a-a75e-4e4f-8137-e68a53915e84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1260 microversion: 2.1 time: 0.176436 Oct 27 09:09:58.315696 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1188/2395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:09:58 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:09:58.321319 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a90bfc32-40ba-410e-a6eb-c6c49957ada5 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.148792 Oct 27 09:09:58.322233 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1208/2396] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:58 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:58.327892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-498550472", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ae941fcf-a08b-4e78-a643-31943d6c6ac9"}, {"uuid": "d3b4ecbd-ee42-4007-9994-04e612900e6b"}, {"uuid": "ae941fcf-a08b-4e78-a643-31943d6c6ac9"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:09:58.359001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:58.359679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:58.367142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.367803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.368548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.369533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.370222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.370727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.385767 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] HTTP exception thrown: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Request method failure captured: Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 HTTP/1.1 Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkk_vOftQL1Rc19io01ZqjNc0Hmfha5KAQsnS9BYQOvhU4ke6TgxMG8NVzgkD1SIvKBCyf8KZ_rfPMMFt3YRxbMVA07hhir3A_GEAmmp6qCMX_8sWZN1ZN-LY-kMcCpc7YOKSMjwseUd_rafP-EdY6wY80pAxmF2Hj89jGqwiVDi07w Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1df6a0e925ac430c8dced7c02d70b45a Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TaggedBootDevicesTest-189902524 Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1df6a0e925ac430c8dced7c02d70b45a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1df6a0e925ac430c8dced7c02d70b45a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1df6a0e925ac430c8dced7c02d70b45a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1df6a0e925ac430c8dced7c02d70b45a"}]}] Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TaggedBootDevicesTest-189902524 Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1df6a0e925ac430c8dced7c02d70b45a Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TaggedBootDevicesTest-189902524 Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TaggedBootDevicesTest-189902524-project Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d7176e89e16e4b0788ebecec7a32a924 Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TaggedBootDevicesTest-189902524-project Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '79563e06-eccd-4e97-88ce-f036e2d086e6'} Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:09:58.387815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Returning 404 to user: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb9eba0b-1e4c-4f05-9b46-29ffe076d832 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 404 len: 111 microversion: 2.32 time: 0.072380 Oct 27 09:09:58.392341 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1189/2397] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:09:58 2022] DELETE /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:09:58.398317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:58.399051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:58.405577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.406206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.406774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.407386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:58.407888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:58.408328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:58.413213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] validate_networks() for [('ae941fcf-a08b-4e78-a643-31943d6c6ac9', None, None, None, None, None), ('d3b4ecbd-ee42-4007-9994-04e612900e6b', None, None, None, None, None), ('ae941fcf-a08b-4e78-a643-31943d6c6ac9', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:09:58.652609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:58.665961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:58.667900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:09:58.669370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5923ada-db11-42b7-ac4a-4a9f88d0d237 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1358 microversion: 2.21 time: 0.276237 Oct 27 09:09:58.685032 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1190/2398] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:58 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:09:58.696926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04492936-ff71-44ab-b910-030c43a3b2fc tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Calling method '.version_select at 0x7f31aaabee50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:59.653320 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04492936-ff71-44ab-b910-030c43a3b2fc tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/e0b9ec5f-543a-4318-8cad-445d50abf290" status: 200 len: 142 microversion: 2.1 time: 0.966321 Oct 27 09:09:59.655060 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1191/2399] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:09:58 2022] GET /compute/v2.1/os-floating-ips/e0b9ec5f-543a-4318-8cad-445d50abf290 => generated 142 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:09:59.664316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:59.664954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] [instance: 79563e06-eccd-4e97-88ce-f036e2d086e6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:59.672423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:59.672934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:59.673634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:59.674361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:59.674815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:59.675426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:59.694231 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] HTTP exception thrown: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Request method failure captured: Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 HTTP/1.1 Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkk_vOftQL1Rc19io01ZqjNc0Hmfha5KAQsnS9BYQOvhU4ke6TgxMG8NVzgkD1SIvKBCyf8KZ_rfPMMFt3YRxbMVA07hhir3A_GEAmmp6qCMX_8sWZN1ZN-LY-kMcCpc7YOKSMjwseUd_rafP-EdY6wY80pAxmF2Hj89jGqwiVDi07w Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.32 Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1df6a0e925ac430c8dced7c02d70b45a Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TaggedBootDevicesTest-189902524 Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1df6a0e925ac430c8dced7c02d70b45a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1df6a0e925ac430c8dced7c02d70b45a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1df6a0e925ac430c8dced7c02d70b45a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1df6a0e925ac430c8dced7c02d70b45a"}]}] Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TaggedBootDevicesTest-189902524 Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1df6a0e925ac430c8dced7c02d70b45a Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TaggedBootDevicesTest-189902524 Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TaggedBootDevicesTest-189902524-project Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d7176e89e16e4b0788ebecec7a32a924 Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TaggedBootDevicesTest-189902524-project Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '79563e06-eccd-4e97-88ce-f036e2d086e6'} Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:09:59.696042 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:59.701096 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:09:59.701096 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:09:59.701096 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:09:59.701096 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:09:59.701096 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:09:59.701096 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. Oct 27 09:09:59.701096 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:09:59.702712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] Returning 404 to user: Instance 79563e06-eccd-4e97-88ce-f036e2d086e6 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:09:59.704277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd79e136-f06f-4d69-af1b-ccb1ef860530 tempest-TaggedBootDevicesTest-189902524 tempest-TaggedBootDevicesTest-189902524-project] 10.222.0.25 "GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6" status: 404 len: 111 microversion: 2.32 time: 0.047652 Oct 27 09:09:59.705276 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1192/2400] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:59 2022] GET /compute/v2.1/servers/79563e06-eccd-4e97-88ce-f036e2d086e6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:09:59.711846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:09:59.712762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:09:59.721843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:59.722355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:59.722807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:09:59.723707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:09:59.724181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:09:59.724627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:01.042186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:01.063299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:01.069587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:01.078074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9de22b8e-883b-4f7d-8822-cd5e5fe7220e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 1.371382 Oct 27 09:10:01.082030 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1193/2401] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:09:59 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:01.099294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:01.103018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:01.131253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:01.132085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:01.133629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:01.135337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:01.139181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:01.143477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:02.761957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:10:02.762730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:10:02.762831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:10:02.763253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:10:02.764556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:10:02.790641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:02.793290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:02.793801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:02.794264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:02.795032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:02.795515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:02.796023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:02.807274 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3f198b3e-7685-4697-a653-dae90f42e46a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1316 microversion: 2.1 time: 1.719454 Oct 27 09:10:02.810395 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1194/2402] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:01 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1316 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:02.815451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:02.828516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:02.835885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:02.836729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:02.837390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:02.838339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:02.839012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:02.839683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:02.865050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Getting quotas for project 58dde0075cf74c558c4b6462803c15e2. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:02.897522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Getting quotas for user a3b198587da845bf9237a28f784ae448 and project 58dde0075cf74c558c4b6462803c15e2. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:02.933586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:10:02.936482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:10:02.999978 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-424cc202-622d-4015-a22a-c99f8a3ac9c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.676079 Oct 27 09:10:03.001895 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1209/2403] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:10:03.013255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:03.013892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:03.042493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:03.043050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:03.043444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:03.044218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:03.044685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:03.045124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:03.458763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:03.469443 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7cc6f03a-7407-44d2-98a2-eb1cf873c6d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1266 microversion: 2.1 time: 0.657674 Oct 27 09:10:03.473856 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1195/2404] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:02 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1266 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:03.479487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f85ce24f-b33f-42df-a457-e9010fd86b5b tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Calling method '.version_select at 0x7f31aa25ddc0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:03.691007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:03.700301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:03.716656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:03.740417 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-02358a4f-8219-4703-a446-2cf108c74baa tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.737188 Oct 27 09:10:03.772701 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1210/2405] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:03 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:03.779849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:03.792653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:03.813114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:03.813628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:03.814085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:03.824343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:03.829571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:03.830113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:04.304938 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f85ce24f-b33f-42df-a457-e9010fd86b5b tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.827507 Oct 27 09:10:04.307025 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1196/2406] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:10:03 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:04.321181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:04.322121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:04.337304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:04.337808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:04.340338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:04.341143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:04.341630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:04.342309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:04.824262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:04.843059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:04.860154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:04.861751 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5031c22b-b4ea-4556-a133-eb62bbcd9121 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1358 microversion: 2.21 time: 1.087818 Oct 27 09:10:04.870809 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1211/2407] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:03 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1358 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:04.876294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:04.878336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:04.897998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:04.898733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:04.899345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:04.900244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:04.900845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:04.901441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:04.964459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:04.980969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:04.982574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:05.000448 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d3cbe3b-c3e7-463d-8783-cb52e1343d6d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 0.675702 Oct 27 09:10:05.002750 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1197/2408] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:04 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:05.028078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:05.032063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:05.057451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:05.058076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:05.058618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:05.066443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:05.067746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:05.068295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:05.396179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:05.406300 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d59088d1-824c-4723-adf6-632ca049a8e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1264 microversion: 2.1 time: 0.533886 Oct 27 09:10:05.425027 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1212/2409] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:04 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1264 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:05.440373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a9ea69a-cb95-4f6b-bb6b-2467082a9e41 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Calling method '.version_select at 0x7f31a9d7a040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:06.149925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:06.164681 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45230eba-0b23-4ce6-b565-9e5e4be031a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1316 microversion: 2.1 time: 1.160685 Oct 27 09:10:06.168435 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1198/2410] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:05 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1316 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:06.179557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:06.182442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:06.202245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:06.203181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:06.203914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:06.205153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:06.208861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:06.209642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:07.398917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:07.415145 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-103833db-8a7c-4e13-bae6-3341f35c06a9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1308 microversion: 2.1 time: 1.245248 Oct 27 09:10:07.418232 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1199/2411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:06 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1308 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:07.432918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:07.433803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:07.452562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:07.455852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:07.457786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:07.459683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:07.460437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:07.461130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:07.769622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:07.789547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:07.791492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:07.799115 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c7b6bbe2-5757-49ad-af14-d5ffa1faf164 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.379585 Oct 27 09:10:07.825167 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1200/2412] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:07 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:07.833966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8776f98e-da46-4634-8adf-f66ec5e273d2 req-a245ef15-3e6f-4a43-a27e-e94fa3699485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc", "name": "network-vif-plugged", "status": "completed", "tag": "5cfcef56-5b4d-4a92-a0bb-acbd1ddc4b56"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:07.857235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8776f98e-da46-4634-8adf-f66ec5e273d2 req-a245ef15-3e6f-4a43-a27e-e94fa3699485 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:07.858106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8776f98e-da46-4634-8adf-f66ec5e273d2 req-a245ef15-3e6f-4a43-a27e-e94fa3699485 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:07.858774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8776f98e-da46-4634-8adf-f66ec5e273d2 req-a245ef15-3e6f-4a43-a27e-e94fa3699485 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:07.894645 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8776f98e-da46-4634-8adf-f66ec5e273d2 req-a245ef15-3e6f-4a43-a27e-e94fa3699485 service nova] Creating event network-vif-plugged:5cfcef56-5b4d-4a92-a0bb-acbd1ddc4b56 for instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc on n-h1-858383-16 Oct 27 09:10:07.942517 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8776f98e-da46-4634-8adf-f66ec5e273d2 req-a245ef15-3e6f-4a43-a27e-e94fa3699485 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095229 Oct 27 09:10:07.958374 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1201/2413] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:07.969594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-93ecd2ce-9449-4702-a6bc-4a60a8a2a42b req-80a9816f-d3de-4be2-b456-3161ea198ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27033c1-2e3e-441a-99b0-4038d19ec1ee", "tag": "c0234ad9-452a-427c-adc9-6a1769a3da75"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:08.009766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-93ecd2ce-9449-4702-a6bc-4a60a8a2a42b req-80a9816f-d3de-4be2-b456-3161ea198ff3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:08.013292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-93ecd2ce-9449-4702-a6bc-4a60a8a2a42b req-80a9816f-d3de-4be2-b456-3161ea198ff3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:08.013875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-93ecd2ce-9449-4702-a6bc-4a60a8a2a42b req-80a9816f-d3de-4be2-b456-3161ea198ff3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:08.038913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-93ecd2ce-9449-4702-a6bc-4a60a8a2a42b req-80a9816f-d3de-4be2-b456-3161ea198ff3 service nova] Creating event network-changed:c0234ad9-452a-427c-adc9-6a1769a3da75 for instance b27033c1-2e3e-441a-99b0-4038d19ec1ee on n-h2-858383-16 Oct 27 09:10:08.059210 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-93ecd2ce-9449-4702-a6bc-4a60a8a2a42b req-80a9816f-d3de-4be2-b456-3161ea198ff3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098931 Oct 27 09:10:08.061106 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1202/2414] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:08.077768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:08.082035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:08.093403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:08.098751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:08.099480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:08.101701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:08.102294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:08.102953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:08.996937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:09.009868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:09.016260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:09.017520 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf1f198c-4a5c-433a-80e9-2e30523e0d31 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1358 microversion: 2.21 time: 0.948445 Oct 27 09:10:09.018217 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1203/2415] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:08 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1358 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:09.023845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:09.024709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:09.062566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:09.063354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:09.064012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:09.064932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:09.069308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:09.071105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:09.425719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:09.443599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:09.461238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:09.462492 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e5e2502-366b-4fd5-96aa-8f78b4d5f3cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 0.443201 Oct 27 09:10:09.463107 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1204/2416] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:09 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:09.480559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:09.484738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:09.502131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:09.503866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:09.508217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:09.510772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:09.513897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:09.514844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:09.671020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:09.685884 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f700b80-e240-46a4-b7d4-479e69945c83 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1270 microversion: 2.1 time: 0.220108 Oct 27 09:10:09.704961 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1205/2417] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:09 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1270 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:09.722684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:09.723913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:09.734686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:09.735192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:09.735666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:09.736425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:09.736876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:09.737308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.403699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:10.413394 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5322b8f-41db-46bf-91b6-cc2fef1c59a1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1316 microversion: 2.1 time: 0.703284 Oct 27 09:10:10.421352 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1206/2418] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:09 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:10.428907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:10.429675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:10.437025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.438099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.438099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.438798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.439723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.439723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.482067 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a9ea69a-cb95-4f6b-bb6b-2467082a9e41 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e0b9ec5f-543a-4318-8cad-445d50abf290" status: 202 len: 0 microversion: 2.1 time: 5.051430 Oct 27 09:10:10.486040 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1213/2419] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:10:05 2022] DELETE /compute/v2.1/os-floating-ips/e0b9ec5f-543a-4318-8cad-445d50abf290 => generated 0 bytes in 5057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:10:10.491807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:10.493488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:10.500643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.501131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.501585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.502274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.502897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.503888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.610370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:10.623248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:10.625572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:10.632627 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-659b35ec-4d09-4b30-be52-335e17de13f3 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.144782 Oct 27 09:10:10.633565 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1214/2420] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:10 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:10.668262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:10.676180 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-695c66f5-1794-46a5-baba-4941410a1d62 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1308 microversion: 2.1 time: 0.253350 Oct 27 09:10:10.677664 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1207/2421] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:10 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:10.683508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:10.684561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:10.691800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.693200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.693800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.694667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.695261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.696067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.756668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-bf75b318-3e0d-41ee-911f-cd160d6f90c2 req-489f2d86-bee8-4e74-bf48-fa1a584d1fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d248926-b23e-472b-9a1e-4b10c924758a", "name": "network-vif-plugged", "status": "completed", "tag": "c24197dc-db5d-4363-91d8-125f1e441095"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:10.774185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bf75b318-3e0d-41ee-911f-cd160d6f90c2 req-489f2d86-bee8-4e74-bf48-fa1a584d1fab service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.775258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bf75b318-3e0d-41ee-911f-cd160d6f90c2 req-489f2d86-bee8-4e74-bf48-fa1a584d1fab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.776732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bf75b318-3e0d-41ee-911f-cd160d6f90c2 req-489f2d86-bee8-4e74-bf48-fa1a584d1fab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.794491 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-bf75b318-3e0d-41ee-911f-cd160d6f90c2 req-489f2d86-bee8-4e74-bf48-fa1a584d1fab service nova] Creating event network-vif-plugged:c24197dc-db5d-4363-91d8-125f1e441095 for instance 3d248926-b23e-472b-9a1e-4b10c924758a on n-h2-858383-16 Oct 27 09:10:10.801070 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-bf75b318-3e0d-41ee-911f-cd160d6f90c2 req-489f2d86-bee8-4e74-bf48-fa1a584d1fab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165540 Oct 27 09:10:10.802750 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1215/2422] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:10.809685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0a9b3567-f23c-4ddd-ad86-59336b1af6bc req-7c5ec77f-eab2-441d-b9b7-c6d890ea6e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc682645-328d-418c-aeda-55b06824b085", "tag": "f7f4087c-e3d8-446a-8011-57745cdec512"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:10.841116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0a9b3567-f23c-4ddd-ad86-59336b1af6bc req-7c5ec77f-eab2-441d-b9b7-c6d890ea6e8c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.842476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0a9b3567-f23c-4ddd-ad86-59336b1af6bc req-7c5ec77f-eab2-441d-b9b7-c6d890ea6e8c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.843111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0a9b3567-f23c-4ddd-ad86-59336b1af6bc req-7c5ec77f-eab2-441d-b9b7-c6d890ea6e8c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.863313 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0a9b3567-f23c-4ddd-ad86-59336b1af6bc req-7c5ec77f-eab2-441d-b9b7-c6d890ea6e8c service nova] Creating event network-changed:f7f4087c-e3d8-446a-8011-57745cdec512 for instance dc682645-328d-418c-aeda-55b06824b085 on n-h2-858383-16 Oct 27 09:10:10.871980 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0a9b3567-f23c-4ddd-ad86-59336b1af6bc req-7c5ec77f-eab2-441d-b9b7-c6d890ea6e8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066368 Oct 27 09:10:10.873339 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1216/2423] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:10.883426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:10.884652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:10.894619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.895919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.896635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.897566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:10.897907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:10.898590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:10.900029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:10.907229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:10.908717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:10.910262 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-712816c8-bab1-4eb4-90f2-d1d712ca66eb tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1358 microversion: 2.21 time: 0.231081 Oct 27 09:10:10.924737 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1208/2424] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:10 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:10.936213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f33b9b63-b9a1-4438-84cc-e837407abff9 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Action: 'create', calling method: .version_select at 0x7f31aa07aa60>, body: {"pool": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:11.144132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:11.155930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:11.159177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:11.162114 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d24bb37-f869-4a22-94f0-bd0ea046f6a1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 0.286117 Oct 27 09:10:11.163311 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1217/2425] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:10 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:11.168422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:11.169459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:11.182624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:11.183186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:11.183717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:11.187887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:11.189308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:11.189761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:11.507701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:11.517850 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84145e9f-1402-4423-922e-17ad4e959192 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1312 microversion: 2.1 time: 0.352948 Oct 27 09:10:11.524142 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1218/2426] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:11 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:11.533453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:11.534469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:11.544091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:11.544923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:11.545573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:11.547072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:11.547680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:11.548220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:12.016947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:12.026938 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e6c5145d-f5bf-4adb-9806-4f69f4c5d5ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1316 microversion: 2.1 time: 0.499344 Oct 27 09:10:12.040057 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1219/2427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:11 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:12.047677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:12.048306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:12.054776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:12.055284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:12.056063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:12.056803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:12.057271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:12.057716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:12.151937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:12.164345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:12.165930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:12.172525 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ea366ea-34b3-4ca5-9670-23239bd45f42 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.131184 Oct 27 09:10:12.181014 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1220/2428] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:12 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:12.193708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:12.194330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:12.209220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:12.209737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:12.210188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:12.210944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:12.212024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:12.212024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:12.588898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:12.597320 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-962a7cef-5c9d-48ca-b206-50d63d4a0e7a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1308 microversion: 2.1 time: 0.414976 Oct 27 09:10:12.609436 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1221/2429] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:12 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:12.615360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:12.616245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:12.622624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:12.623124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:12.623584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:12.624318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:12.624937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:12.625428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:12.845420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:12.916871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=18 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:12.921823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:12.933456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:12.935035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:12.936479 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e3eedd91-5881-4b73-b1e6-87a8f3e99b06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1358 microversion: 2.21 time: 0.325524 Oct 27 09:10:12.937053 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1222/2430] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:12 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:12.959947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:12.960621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:12.966912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:12.967424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:12.967880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:12.969886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:12.969886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:12.969886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:13.383412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:13.394526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:13.396641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:13.397890 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1969e8e-4265-4ea7-8882-31fb9957d645 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1807 microversion: 2.20 time: 0.442801 Oct 27 09:10:13.398478 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1223/2431] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:12 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1807 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:13.407225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:13.408029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:13.419761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:13.420495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:13.421095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:13.421818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:13.422280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:13.422697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:13.605657 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f33b9b63-b9a1-4438-84cc-e837407abff9 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.679558 Oct 27 09:10:13.615080 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1209/2432] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:10:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:13.621099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:13.621953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:13.636320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:13.637024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:13.637476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:13.638204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:13.638672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:13.639235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:13.666064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:13.904679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:13.919726 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e2c43308-5a99-4603-a768-b85f03b1bca3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1312 microversion: 2.1 time: 0.516206 Oct 27 09:10:13.935295 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1224/2433] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:13 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1312 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:13.943845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:13.953108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:13.965805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:13.966818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:13.967281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:13.968057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:13.968981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:13.969733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:13.990492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:14.380321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:14.389257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:14.390841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:14.396297 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-340e79da-cd62-42ce-aa6b-e9dcc6fd62d0 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.459577 Oct 27 09:10:14.397203 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1225/2434] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:13 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:14.401981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1a8aa5d-19bc-448e-a4f3-16726d4325c6 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Calling method '.version_select at 0x7f31aa0f9430>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:14.582087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:14.615364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00858989-340e-4568-a753-208572a81dbb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1316 microversion: 2.1 time: 0.988273 Oct 27 09:10:14.618013 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1210/2435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:13 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1316 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:14.638611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:14.639608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:14.657664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:14.658945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:14.659492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:14.664847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:14.665499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:14.666090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:15.159849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:15.171284 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f75ddc6-2a2c-4111-8871-519cbdac117e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1308 microversion: 2.1 time: 0.551668 Oct 27 09:10:15.187740 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1211/2436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:14 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1308 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:15.197851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:15.198673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:15.221263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:15.222083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:15.222635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:15.224105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:15.225168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:15.225722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:15.683230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:15.698390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:15.700385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:15.701955 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d104ef56-06cf-4bf1-83f8-b1c5551c8815 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1551 microversion: 2.21 time: 0.512303 Oct 27 09:10:15.702664 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1212/2437] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:15 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1551 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:15.724108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:15.725246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:15.739854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:15.740482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:15.742239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:15.743008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:15.743476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:15.745371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:15.963730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:15.979214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:15.981705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:15.983357 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37f8b229-9af0-4953-906e-47209a7ddf63 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1794 microversion: 2.20 time: 0.279554 Oct 27 09:10:15.984524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1213/2438] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:15 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1794 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:15.991104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:15.991827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:15.999756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.000594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.001496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.002859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.003679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.004263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.232190 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1a8aa5d-19bc-448e-a4f3-16726d4325c6 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/7287f2d8-b29b-44e4-9b98-0421c9dcb858" status: 202 len: 0 microversion: 2.1 time: 1.833670 Oct 27 09:10:16.232893 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1226/2439] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:10:14 2022] DELETE /compute/v2.1/os-floating-ips/7287f2d8-b29b-44e4-9b98-0421c9dcb858 => generated 0 bytes in 1835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:10:16.242580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:16.252497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:16.268384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.268882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.272084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.275808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:16.277836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.278331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.278772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.287538 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a2b2a893-8424-42c5-a039-08a2ca3b0898 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1333 microversion: 2.1 time: 0.299783 Oct 27 09:10:16.290760 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1214/2440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:15 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1333 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:16.303281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:16.304468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:16.311616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.312087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.312524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.313231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.313686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.314110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.421583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:16.431759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:16.433573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:16.441055 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-567597e6-797b-4bdd-b71a-3a86a23b694f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.202496 Oct 27 09:10:16.442398 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1227/2441] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:16 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:16.449829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:16.450559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:16.463967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.464971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.465453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.466478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.466950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.467383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.497453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:10:16.534236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:16.546188 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6aa0c9d4-f175-494b-ab7d-6159c55caacb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1316 microversion: 2.1 time: 0.253848 Oct 27 09:10:16.552814 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1215/2442] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:16 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:16.560717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:16.561466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:16.569215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.570100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.570765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.572092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.572671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.573504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.589845 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e71206e6-1109-40f5-89e1-25750e726c06 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 204 len: 0 microversion: 2.21 time: 0.144578 Oct 27 09:10:16.590492 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1228/2443] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:10:16 2022] DELETE /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:10:16.597783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-350722fd-df55-4e86-bfcb-1a1328f1d2f9 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Calling method '.version_select at 0x7f31aa3be040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:16.672075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-350722fd-df55-4e86-bfcb-1a1328f1d2f9 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7287f2d8-b29b-44e4-9b98-0421c9dcb858 could not be found", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:10:16.673131 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-350722fd-df55-4e86-bfcb-1a1328f1d2f9 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] HTTP exception thrown: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-350722fd-df55-4e86-bfcb-1a1328f1d2f9 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Request method failure captured: Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-floating-ips/7287f2d8-b29b-44e4-9b98-0421c9dcb858 HTTP/1.1 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrZEQvmnyf3dKw6EUHzBrUsQY8f-FfRhevEs4WVzrXPqZfyMtXrIQVlm3Eiwi9I1IjZ2NZLM2egic8auoIirq4-Vb4mmuuM-QT4kXpUjvEkyZ2nY1mrXvxtoacqKFguwxkpDWUGJdmAG35VarhJlrVeZIs4Q6Tv4R1ZW7LhB2iKQgI Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0c94d312a7f34740871b72ce58b7653c Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-FloatingIPsTestJSON-1701589311 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c94d312a7f34740871b72ce58b7653c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c94d312a7f34740871b72ce58b7653c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c94d312a7f34740871b72ce58b7653c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c94d312a7f34740871b72ce58b7653c"}]}] Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-FloatingIPsTestJSON-1701589311 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0c94d312a7f34740871b72ce58b7653c Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1701589311 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-FloatingIPsTestJSON-1701589311-project Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c1d673c6b3af4bd793b9deae74d2a6a9 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-FloatingIPsTestJSON-1701589311-project Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: exception: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7287f2d8-b29b-44e4-9b98-0421c9dcb858'} Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7287f2d8-b29b-44e4-9b98-0421c9dcb858 could not be found Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9857cc8-82da-4ad1-9f73-5025517ba56e'] Oct 27 09:10:16.677284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858. Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 Oct 27 09:10:16.681491 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:16.687053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-350722fd-df55-4e86-bfcb-1a1328f1d2f9 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Returning 404 to user: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:10:16.688556 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-350722fd-df55-4e86-bfcb-1a1328f1d2f9 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/7287f2d8-b29b-44e4-9b98-0421c9dcb858" status: 404 len: 111 microversion: 2.1 time: 0.096757 Oct 27 09:10:16.690693 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1229/2444] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:10:16 2022] GET /compute/v2.1/os-floating-ips/7287f2d8-b29b-44e4-9b98-0421c9dcb858 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:10:16.695587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-aa968ca7-af7d-4a22-929a-460927924bb5 req-a07f5898-f686-4902-81cd-3dd938b74c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27033c1-2e3e-441a-99b0-4038d19ec1ee", "name": "network-vif-plugged", "status": "completed", "tag": "c0234ad9-452a-427c-adc9-6a1769a3da75"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:16.718008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-aa968ca7-af7d-4a22-929a-460927924bb5 req-a07f5898-f686-4902-81cd-3dd938b74c71 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.718744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-aa968ca7-af7d-4a22-929a-460927924bb5 req-a07f5898-f686-4902-81cd-3dd938b74c71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.719458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-aa968ca7-af7d-4a22-929a-460927924bb5 req-a07f5898-f686-4902-81cd-3dd938b74c71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.734848 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-aa968ca7-af7d-4a22-929a-460927924bb5 req-a07f5898-f686-4902-81cd-3dd938b74c71 service nova] Creating event network-vif-plugged:c0234ad9-452a-427c-adc9-6a1769a3da75 for instance b27033c1-2e3e-441a-99b0-4038d19ec1ee on n-h2-858383-16 Oct 27 09:10:16.743651 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-aa968ca7-af7d-4a22-929a-460927924bb5 req-a07f5898-f686-4902-81cd-3dd938b74c71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051569 Oct 27 09:10:16.744625 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1230/2445] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:16.753822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:16.755774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:16.769041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.769275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.769633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.770958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:16.771459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:16.771941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:16.986798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:16.996262 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-203cb8cd-23da-4b07-9746-b8ffabbec665 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1308 microversion: 2.1 time: 0.440930 Oct 27 09:10:17.014447 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1216/2446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:16 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:17.019729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-09f23730-393c-4b0d-b8e9-0e760ae896a0 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Calling method '.version_select at 0x7f31aaadeaf0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:17.093265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-09f23730-393c-4b0d-b8e9-0e760ae896a0 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7287f2d8-b29b-44e4-9b98-0421c9dcb858 could not be found", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:10:17.094235 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-09f23730-393c-4b0d-b8e9-0e760ae896a0 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] HTTP exception thrown: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-09f23730-393c-4b0d-b8e9-0e760ae896a0 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Request method failure captured: Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-floating-ips/7287f2d8-b29b-44e4-9b98-0421c9dcb858 HTTP/1.1 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkrZEQvmnyf3dKw6EUHzBrUsQY8f-FfRhevEs4WVzrXPqZfyMtXrIQVlm3Eiwi9I1IjZ2NZLM2egic8auoIirq4-Vb4mmuuM-QT4kXpUjvEkyZ2nY1mrXvxtoacqKFguwxkpDWUGJdmAG35VarhJlrVeZIs4Q6Tv4R1ZW7LhB2iKQgI Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0c94d312a7f34740871b72ce58b7653c Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FloatingIPsTestJSON-1701589311 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c94d312a7f34740871b72ce58b7653c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c94d312a7f34740871b72ce58b7653c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c94d312a7f34740871b72ce58b7653c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c94d312a7f34740871b72ce58b7653c"}]}] Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FloatingIPsTestJSON-1701589311 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0c94d312a7f34740871b72ce58b7653c Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1701589311 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FloatingIPsTestJSON-1701589311-project Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c1d673c6b3af4bd793b9deae74d2a6a9 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FloatingIPsTestJSON-1701589311-project Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: exception: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7287f2d8-b29b-44e4-9b98-0421c9dcb858'} Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7287f2d8-b29b-44e4-9b98-0421c9dcb858 could not be found Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-755465fd-5efb-440f-a018-74364631c3da'] Oct 27 09:10:17.096487 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858. Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 Oct 27 09:10:17.100495 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:17.106351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:17.108231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-09f23730-393c-4b0d-b8e9-0e760ae896a0 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] Returning 404 to user: Floating IP not found for ID 7287f2d8-b29b-44e4-9b98-0421c9dcb858 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:10:17.109354 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-09f23730-393c-4b0d-b8e9-0e760ae896a0 tempest-FloatingIPsTestJSON-1701589311 tempest-FloatingIPsTestJSON-1701589311-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/7287f2d8-b29b-44e4-9b98-0421c9dcb858" status: 404 len: 111 microversion: 2.1 time: 0.093566 Oct 27 09:10:17.109966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:17.112005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:17.116713 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ff006ce-501e-4bef-89b9-3bafc75492f8 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1557 microversion: 2.21 time: 0.369806 Oct 27 09:10:17.128364 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1217/2447] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:10:17 2022] DELETE /compute/v2.1/os-floating-ips/7287f2d8-b29b-44e4-9b98-0421c9dcb858 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:10:17.137925 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1231/2448] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:16 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1557 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:17.311852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:17.312862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:17.321710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:17.322544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:17.323184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:17.324485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:17.325205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:17.326584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:17.469417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:17.470722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:17.483314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:17.484926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:17.487001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:17.489203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:17.502256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:17.503075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:17.632360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:17.647916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:17.649506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:17.656802 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c5d30399-2790-46c4-90ae-1f6c1d25b01a tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.191263 Oct 27 09:10:17.659206 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1232/2449] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:17 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:10:17.689730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:17.691141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:17.699640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:17.700401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:17.700998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:17.701852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:17.702464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:17.703048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:17.750427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:17.758743 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0227cb46-efbc-4bca-aae9-1c0883dbd986 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1333 microversion: 2.1 time: 0.451032 Oct 27 09:10:17.759424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1218/2450] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:17 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1333 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:17.971202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:17.980823 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9e02d386-e3b2-4374-a66e-2f3d50f8da2b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1316 microversion: 2.1 time: 0.320459 Oct 27 09:10:18.006823 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1233/2451] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:17 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:18.026795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:18.027468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:18.035495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:18.036717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:18.037257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:18.038439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:18.040789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:18.041465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:18.144045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:18.145595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:18.155930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:18.157790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:18.158811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:18.161690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:18.162330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:18.163147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:18.361710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:18.370983 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33c25c4c-9063-4957-860b-eef86ba5bdbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1308 microversion: 2.1 time: 0.351981 Oct 27 09:10:18.371584 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1219/2452] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:18 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:18.399443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:18.407705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:18.409253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:18.410524 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9157b4b-5361-4f8d-8ba8-3d1266bcb0dd tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1557 microversion: 2.21 time: 0.270557 Oct 27 09:10:18.411741 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1234/2453] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:18 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1557 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:10:18.690678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:18.691306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:18.698228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:18.698756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:18.705497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:18.712691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:18.713586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:18.714301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:18.783282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:18.784595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:18.796955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:18.797460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:18.797910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:18.798645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:18.799113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:18.799545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:18.871783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:18.886610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:18.890162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:18.903955 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fe354f2-81cd-4d56-a96c-02554946190e tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.217529 Oct 27 09:10:18.928436 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1220/2454] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:18 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:19.008308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:19.009188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:19.059945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:19.060598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:19.061072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:19.061982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:19.062306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:19.062749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:19.454451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:19.468835 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b180d8cc-b4b0-48ae-865c-e583e1e864ab tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.690464 Oct 27 09:10:19.469432 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1235/2455] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:18 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:19.479466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:19.483050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:19.498913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:19.500581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:19.501290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:19.502308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:19.503001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:19.508456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:19.587744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:19.611079 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ffb2cc7e-9aca-4871-9f75-da91bd78f6d9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1316 microversion: 2.1 time: 0.608284 Oct 27 09:10:19.624275 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1221/2456] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:19 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:19.637093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:19.637935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:19.646401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:19.647117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:19.647759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:19.649886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:19.650583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:19.651233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:19.992511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:20.001125 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c6fe3bc-2572-48b4-aad9-85d47ef179f3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1308 microversion: 2.1 time: 0.530280 Oct 27 09:10:20.007416 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1236/2457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:19 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1308 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:20.015938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:20.023817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:20.037232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:20.037807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:20.038255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:20.038982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:20.042199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:20.044670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:20.189088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:20.205073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:20.208508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:20.211015 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01f90820-02eb-4484-a9cd-daa6a939f88b tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1557 microversion: 2.21 time: 0.585689 Oct 27 09:10:20.213528 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1222/2458] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:19 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1557 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:20.226045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:20.226853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cd055709-a2ad-4266-b54e-3373b5a92ad0 req-b27de765-3b44-4a0a-afa0-0cbeb8d2fdaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc682645-328d-418c-aeda-55b06824b085", "name": "network-vif-plugged", "status": "completed", "tag": "f7f4087c-e3d8-446a-8011-57745cdec512"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:20.240203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:20.245585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:20.248849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cd055709-a2ad-4266-b54e-3373b5a92ad0 req-b27de765-3b44-4a0a-afa0-0cbeb8d2fdaa service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:20.249344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cd055709-a2ad-4266-b54e-3373b5a92ad0 req-b27de765-3b44-4a0a-afa0-0cbeb8d2fdaa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:20.249779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cd055709-a2ad-4266-b54e-3373b5a92ad0 req-b27de765-3b44-4a0a-afa0-0cbeb8d2fdaa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:20.260837 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1293e9e-627c-466a-860e-32c1b3063dc2 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1546 microversion: 2.91 time: 0.252210 Oct 27 09:10:20.276751 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1237/2459] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:20 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1546 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:20.280608 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cd055709-a2ad-4266-b54e-3373b5a92ad0 req-b27de765-3b44-4a0a-afa0-0cbeb8d2fdaa service nova] Creating event network-vif-plugged:f7f4087c-e3d8-446a-8011-57745cdec512 for instance dc682645-328d-418c-aeda-55b06824b085 on n-h2-858383-16 Oct 27 09:10:20.290990 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cd055709-a2ad-4266-b54e-3373b5a92ad0 req-b27de765-3b44-4a0a-afa0-0cbeb8d2fdaa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074714 Oct 27 09:10:20.293849 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1223/2460] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:20.492968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:20.493767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:20.504578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:20.512311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:20.512964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:20.513859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:20.514830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:20.515981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:20.642468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:20.643853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:20.666976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:20.668796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:20.670684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:20.673266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:20.675313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:20.676657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.421248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:21.431400 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c803b165-fd38-46b5-9420-bbf46c16dd3e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1466 microversion: 2.1 time: 0.797405 Oct 27 09:10:21.448717 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1224/2461] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:20 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1466 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:10:21.479949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:21.492670 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-21cc57d3-82d4-4c0c-b529-6ca71d1cec13 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 1.003812 Oct 27 09:10:21.493457 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1238/2462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:20 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:21.501417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:21.502034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:21.521415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.521918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.522356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.523061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.523621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.528556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.537771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-70ce7ed5-48cb-4597-9b6d-1b307a5c7ea6 req-91959d31-7839-44e2-8dd8-a8d2764317e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc", "name": "network-vif-deleted", "tag": "5cfcef56-5b4d-4a92-a0bb-acbd1ddc4b56"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:21.554958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-70ce7ed5-48cb-4597-9b6d-1b307a5c7ea6 req-91959d31-7839-44e2-8dd8-a8d2764317e8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.555633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-70ce7ed5-48cb-4597-9b6d-1b307a5c7ea6 req-91959d31-7839-44e2-8dd8-a8d2764317e8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.558372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-70ce7ed5-48cb-4597-9b6d-1b307a5c7ea6 req-91959d31-7839-44e2-8dd8-a8d2764317e8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.583115 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-70ce7ed5-48cb-4597-9b6d-1b307a5c7ea6 req-91959d31-7839-44e2-8dd8-a8d2764317e8 service nova] Creating event network-vif-deleted:5cfcef56-5b4d-4a92-a0bb-acbd1ddc4b56 for instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc on n-h1-858383-16 Oct 27 09:10:21.595217 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-70ce7ed5-48cb-4597-9b6d-1b307a5c7ea6 req-91959d31-7839-44e2-8dd8-a8d2764317e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144769 Oct 27 09:10:21.596334 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1225/2463] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:21.604169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:21.605073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:21.613713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.614960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.615561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.616506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.617125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.617711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.671752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.672660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.673756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.674372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lazy-loading 'fault' on Instance uuid 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:10:21.773352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:21.792535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:21.800564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35c49dc808e1466b9202582583e5cc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ae7d1663a42caa17536474bc7f792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:21.802473 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4959314-3bdf-4bb4-b827-ed6f4a52014d tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 200 len: 1348 microversion: 2.21 time: 0.204697 Oct 27 09:10:21.803254 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1226/2464] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:21 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 1348 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:21.808046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:21.808857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:21.815022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.815735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.816369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.817393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.818014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.818596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.828248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:21.840932 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b4158764-f3ca-4964-b6b0-b008f16654a3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1308 microversion: 2.1 time: 0.344344 Oct 27 09:10:21.841560 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1239/2465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:21 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:21.860108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d208016e-bd0d-4d3b-ae4a-444b14ce5b1a req-1dcc68cd-ba51-4599-b40b-22868e523402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "tag": "751baeac-af6f-48a5-aae6-54816b9b6009"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:21.875492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d208016e-bd0d-4d3b-ae4a-444b14ce5b1a req-1dcc68cd-ba51-4599-b40b-22868e523402 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.875918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d208016e-bd0d-4d3b-ae4a-444b14ce5b1a req-1dcc68cd-ba51-4599-b40b-22868e523402 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.876510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d208016e-bd0d-4d3b-ae4a-444b14ce5b1a req-1dcc68cd-ba51-4599-b40b-22868e523402 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.889219 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d208016e-bd0d-4d3b-ae4a-444b14ce5b1a req-1dcc68cd-ba51-4599-b40b-22868e523402 service nova] Creating event network-changed:751baeac-af6f-48a5-aae6-54816b9b6009 for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:10:21.894284 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d208016e-bd0d-4d3b-ae4a-444b14ce5b1a req-1dcc68cd-ba51-4599-b40b-22868e523402 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049464 Oct 27 09:10:21.895223 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1240/2466] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:21.950227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:21.957134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a91058c7-9698-4148-9822-382e648a65e7 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:21.958812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a91058c7-9698-4148-9822-382e648a65e7 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:21.962690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:21.964390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:21.965269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9698-4148-9822-382e648a65e7 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.965770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9698-4148-9822-382e648a65e7 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.966285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9698-4148-9822-382e648a65e7 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.967000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9698-4148-9822-382e648a65e7 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:21.967459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9698-4148-9822-382e648a65e7 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:21.968184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9698-4148-9822-382e648a65e7 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:21.970977 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee00a6be-a81d-4f73-b768-b50062c23236 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1533 microversion: 2.91 time: 0.166829 Oct 27 09:10:21.991965 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1227/2467] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:21 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1533 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:21.998622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:21.999508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:22.010524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.011174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.011918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.012905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.013585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.014230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.141388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] Lazy-loading 'services' on Instance uuid 734f18c8-6747-4af1-a701-95a8698c877d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:10:22.145697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:22.184785 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14b41bfe-704a-4259-beca-37cbb4f65406 tempest-UnshelveToHostMultiNodesTest-1547219923 tempest-UnshelveToHostMultiNodesTest-1547219923-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1940 microversion: 2.91 time: 0.189832 Oct 27 09:10:22.186534 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1228/2468] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:21 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1940 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:22.246471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:22.247056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:22.255416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.256047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.256584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.257479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.258236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.258828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.291268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:10:22.396637 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63a687e7-6611-4452-9736-94cf82b25707 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "DELETE /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 204 len: 0 microversion: 2.91 time: 0.158628 Oct 27 09:10:22.397581 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1229/2469] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:10:22 2022] DELETE /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:10:22.406998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:22.407775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:22.415348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.415589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.415935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.416693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.417162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.417629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.546417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:22.557094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:22.559050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:22.564655 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8671d78-a24d-4c72-8b59-56963f2a8d6c tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.162716 Oct 27 09:10:22.565405 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1230/2470] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:22 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:10:22.572608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:22.573603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:22.580704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.581544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.582217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.583533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.584248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.584931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.606075 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a91058c7-9698-4148-9822-382e648a65e7 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1619 microversion: 2.1 time: 0.709397 Oct 27 09:10:22.606673 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1241/2471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:21 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1619 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:22.630180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25e5101f-7750-4a4f-b917-ce4cf3bea7f2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Action: 'create', calling method: .version_select at 0x7f31aa29d3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-636786962", "policies": ["affinity"]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:22.635998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:22.653061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-25e5101f-7750-4a4f-b917-ce4cf3bea7f2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:22.659472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-25e5101f-7750-4a4f-b917-ce4cf3bea7f2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:22.717241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-25e5101f-7750-4a4f-b917-ce4cf3bea7f2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:22.722933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-25e5101f-7750-4a4f-b917-ce4cf3bea7f2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:22.739767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25e5101f-7750-4a4f-b917-ce4cf3bea7f2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.113413 Oct 27 09:10:22.740826 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1242/2472] 10.222.0.25 () {60 vars in 1174 bytes} [Thu Oct 27 09:10:22 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:10:22.808070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-21812887", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2973b32d-aea0-4a97-8885-edd63a9034aa"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:22.911661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:22.913223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:10:22.926387 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3c61458-e3af-4183-9dcc-474a8fa8b364 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.359017 Oct 27 09:10:22.927673 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1231/2473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:22 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:22.934070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:22.934893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:22.942316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.943152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.943841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.944770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.945409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.945902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.963530 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] HTTP exception thrown: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Request method failure captured: Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc HTTP/1.1 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkq-y63KgIs0uaserATH3MWZwak78lQHHd_8O0K9OtfpcKZZ6qzt55-k65lMZx71v_ECQ1ZRlrZbKTrRaRcy4msnX51PKwRCpw0JZsJJ-2Ptl_68e01oB16EURMQu6U6-V50o9VkCbo3kSePTEUZUVOXpigLT8vb3llLw9n4iD9JPaM Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 953ae7d1663a42caa17536474bc7f792 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-InstanceActionsV221TestJSON-525224574 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/953ae7d1663a42caa17536474bc7f792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_953ae7d1663a42caa17536474bc7f792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/953ae7d1663a42caa17536474bc7f792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/953ae7d1663a42caa17536474bc7f792"}]}] Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-InstanceActionsV221TestJSON-525224574 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 953ae7d1663a42caa17536474bc7f792 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-525224574 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-InstanceActionsV221TestJSON-525224574-project Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 35c49dc808e1466b9202582583e5cc93 Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-InstanceActionsV221TestJSON-525224574-project Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc'} Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:22.966434 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Returning 404 to user: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d099bd42-afa3-4dd0-b383-460007987441 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 404 len: 111 microversion: 2.21 time: 0.038482 Oct 27 09:10:22.976509 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1232/2474] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:22 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:10:22.981458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:22.982200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:22.989234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:22.990708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.991920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.991920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:22.993868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:22.993868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:22.993868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:23.500607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:23.510068 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38c2e30e-c44b-4290-8beb-609654eccf02 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1488 microversion: 2.1 time: 0.536615 Oct 27 09:10:23.510756 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1233/2475] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:22 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1488 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:23.518197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc0b21fa-0457-4a19-a997-1637bed475f4 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '.version_select at 0x7f31aa07a790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:23.519544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc0b21fa-0457-4a19-a997-1637bed475f4 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:23.527003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0b21fa-0457-4a19-a997-1637bed475f4 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:23.527908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0b21fa-0457-4a19-a997-1637bed475f4 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:23.529887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0b21fa-0457-4a19-a997-1637bed475f4 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:23.529887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0b21fa-0457-4a19-a997-1637bed475f4 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:23.529887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0b21fa-0457-4a19-a997-1637bed475f4 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:23.530599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0b21fa-0457-4a19-a997-1637bed475f4 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:23.605014 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc0b21fa-0457-4a19-a997-1637bed475f4 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.092936 Oct 27 09:10:23.605717 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1234/2476] 10.222.0.25 () {60 vars in 1337 bytes} [Thu Oct 27 09:10:23 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc/os-instance-actions => generated 611 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:10:23.610337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12acebed-5fe2-4fc2-91a6-4577ee7a897d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:23.622033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12acebed-5fe2-4fc2-91a6-4577ee7a897d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:23.622872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12acebed-5fe2-4fc2-91a6-4577ee7a897d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:23.623330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12acebed-5fe2-4fc2-91a6-4577ee7a897d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:23.646911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:10:23.648373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:10:23.649207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:10:23.650052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:10:23.653769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:10:23.709269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:23.710301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:23.710977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:23.712858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12acebed-5fe2-4fc2-91a6-4577ee7a897d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Going to try to stop instance {{(pid=120603) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:10:23.713335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:23.714054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:23.715486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:23.779772 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12acebed-5fe2-4fc2-91a6-4577ee7a897d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085/action" status: 202 len: 0 microversion: 2.1 time: 0.170124 Oct 27 09:10:23.788159 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1235/2477] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:10:23 2022] POST /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:10:23.794861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:23.800385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:23.801427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:23.808530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:23.816155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:23.817203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:23.817717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:23.818529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:23.818998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:23.819928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:23.826970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Going to run 2 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:10:23.829921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:10:23.881044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120602) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 27 09:10:23.904241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:23.911521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:23.978865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:23.998005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:24.005641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:24.010224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:24.016758 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b055ce1-f0e0-436a-9579-6fe2d1deb369 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1539 microversion: 2.91 time: 0.222974 Oct 27 09:10:24.018638 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1236/2478] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:23 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:24.025332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:24.026829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:24.035017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:24.035270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:24.036184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:24.036780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:24.037874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:24.038464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:24.039043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:24.055667 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] HTTP exception thrown: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Request method failure captured: Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc HTTP/1.1 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkq-y63KgIs0uaserATH3MWZwak78lQHHd_8O0K9OtfpcKZZ6qzt55-k65lMZx71v_ECQ1ZRlrZbKTrRaRcy4msnX51PKwRCpw0JZsJJ-2Ptl_68e01oB16EURMQu6U6-V50o9VkCbo3kSePTEUZUVOXpigLT8vb3llLw9n4iD9JPaM Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 953ae7d1663a42caa17536474bc7f792 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-InstanceActionsV221TestJSON-525224574 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/953ae7d1663a42caa17536474bc7f792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_953ae7d1663a42caa17536474bc7f792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/953ae7d1663a42caa17536474bc7f792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/953ae7d1663a42caa17536474bc7f792"}]}] Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-InstanceActionsV221TestJSON-525224574 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 953ae7d1663a42caa17536474bc7f792 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-525224574 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-InstanceActionsV221TestJSON-525224574-project Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 35c49dc808e1466b9202582583e5cc93 Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-InstanceActionsV221TestJSON-525224574-project Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc'} Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:10:24.058421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:24.062496 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:24.066279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Returning 404 to user: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:10:24.070023 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e1b4a6d9-b8d9-4e9f-9164-13fee3beafe6 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 404 len: 111 microversion: 2.21 time: 0.049962 Oct 27 09:10:24.071205 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1237/2479] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:10:24 2022] DELETE /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:10:24.077440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:24.079377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:24.093241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:24.094134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:24.094693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=6bc68a20-e621-4812-8f20-a5ababf275c2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:10:24.095022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:24.095930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:24.097538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:24.098175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:24.214815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:24.221249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:24.296043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:24.310262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:24.355511 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d95de197-a3f6-4779-b6d3-b90bba4733cd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.556399 Oct 27 09:10:24.359883 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1243/2480] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:10:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1562 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 27 09:10:24.383746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-89ffa0f5-600f-4f37-9150-a26b424f0901 req-5ae024b1-7d6c-4e40-bae0-61588cfad9cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "tag": "32c369ba-a8d2-4bfb-b533-e951495c2c51"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:24.395084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:24.401682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-89ffa0f5-600f-4f37-9150-a26b424f0901 req-5ae024b1-7d6c-4e40-bae0-61588cfad9cf service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:24.402379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-89ffa0f5-600f-4f37-9150-a26b424f0901 req-5ae024b1-7d6c-4e40-bae0-61588cfad9cf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:24.403018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-89ffa0f5-600f-4f37-9150-a26b424f0901 req-5ae024b1-7d6c-4e40-bae0-61588cfad9cf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:24.416288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-89ffa0f5-600f-4f37-9150-a26b424f0901 req-5ae024b1-7d6c-4e40-bae0-61588cfad9cf service nova] Creating event network-changed:32c369ba-a8d2-4bfb-b533-e951495c2c51 for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:10:24.421537 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-89ffa0f5-600f-4f37-9150-a26b424f0901 req-5ae024b1-7d6c-4e40-bae0-61588cfad9cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053854 Oct 27 09:10:24.422843 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1244/2481] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:24.428920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:24.433841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:24.454533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:24.455599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:24.455776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:24.456577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:24.463410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:24.464142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:24.933944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:24.955773 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45cced19-f665-4917-97a4-27548b27db18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.883225 Oct 27 09:10:24.966535 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1238/2482] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:24 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:24.988438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:24.990118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] [instance: 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:25.014254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:25.016039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:25.017534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:25.018659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:25.018843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:25.022274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:25.023434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:25.024284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:25.033518 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-20a1edf3-d579-4fef-8adf-904dc7bd2c78 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.609386 Oct 27 09:10:25.043604 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1245/2483] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:24 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:25.051621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:25.051894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:25.052617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Searching by: {'deleted': False, 'project_id': '5f5752431c874be58372449a6b71853c'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:10:25.065529 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] HTTP exception thrown: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Request method failure captured: Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc HTTP/1.1 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkq-y63KgIs0uaserATH3MWZwak78lQHHd_8O0K9OtfpcKZZ6qzt55-k65lMZx71v_ECQ1ZRlrZbKTrRaRcy4msnX51PKwRCpw0JZsJJ-2Ptl_68e01oB16EURMQu6U6-V50o9VkCbo3kSePTEUZUVOXpigLT8vb3llLw9n4iD9JPaM Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.21 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 953ae7d1663a42caa17536474bc7f792 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-InstanceActionsV221TestJSON-525224574 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/953ae7d1663a42caa17536474bc7f792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_953ae7d1663a42caa17536474bc7f792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/953ae7d1663a42caa17536474bc7f792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/953ae7d1663a42caa17536474bc7f792"}]}] Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-InstanceActionsV221TestJSON-525224574 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 953ae7d1663a42caa17536474bc7f792 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-525224574 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-InstanceActionsV221TestJSON-525224574-project Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 35c49dc808e1466b9202582583e5cc93 Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-InstanceActionsV221TestJSON-525224574-project Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc'} Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:25.067394 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:25.071389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:25.071389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:25.071389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:25.071389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:25.071389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:10:25.071389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:10:25.071389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. Oct 27 09:10:25.071389 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:25.072556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] Returning 404 to user: Instance 8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:10:25.073564 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0aa204f-23c1-45c9-8689-92819a171d72 tempest-InstanceActionsV221TestJSON-525224574 tempest-InstanceActionsV221TestJSON-525224574-project] 10.222.0.25 "GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc" status: 404 len: 111 microversion: 2.21 time: 0.102236 Oct 27 09:10:25.081068 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1239/2484] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:24 2022] GET /compute/v2.1/servers/8d3d7a4f-fd51-4b11-bbb1-50d8d41bd6bc => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:10:25.091274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:25.095596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:25.110990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:25.115139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:25.115785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:25.117077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:25.117513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:25.118190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:25.120193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:25.121460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:25.121983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:25.123023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:25.126743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:25.127814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:25.202632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:10:25.228438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:25.229509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:25.230150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:25.230852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lazy-loading 'fault' on Instance uuid 734f18c8-6747-4af1-a701-95a8698c877d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:10:25.262364 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1adf56bc-c9a6-4cd8-881d-a88d621e9905 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 999 microversion: 2.1 time: 0.226842 Oct 27 09:10:25.271181 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1246/2485] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:10:25 2022] GET /compute/v2.1/servers => generated 999 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:25.276773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bdce4c17-9009-44b8-8da2-ce2d2ceb7a7a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:25.277676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bdce4c17-9009-44b8-8da2-ce2d2ceb7a7a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:25.866375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:25.879224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:25.883643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984d5cab5251412692c743df3b464407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd690af97f14fef9572fd231d12ddc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:25.889380 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a07c52a-1b61-4d80-b738-185610fe178f tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 200 len: 1544 microversion: 2.91 time: 0.804914 Oct 27 09:10:25.892899 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1240/2486] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:25 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 1544 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:10:25.964755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bdce4c17-9009-44b8-8da2-ce2d2ceb7a7a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:25.971942 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bdce4c17-9009-44b8-8da2-ce2d2ceb7a7a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1217 microversion: 2.1 time: 0.699158 Oct 27 09:10:25.972816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1247/2487] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:25 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1217 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:25.993160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:25.993865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:26.023635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:26.025278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:26.025869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:26.028008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:26.029767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:26.030259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:26.068872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:26.069600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:26.086851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:26.091081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:26.093533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:26.096442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:26.097299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:26.103713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:26.748318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:26.762495 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-81302d37-ef46-4238-8c62-0e49a6078b5b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.768556 Oct 27 09:10:26.772724 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1241/2488] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:25 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:26.790705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-70bf7c57-a241-4910-a86d-dba8732ad5a1 req-5c46e2ee-50cf-49a9-8fb2-b382dbf1093d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "tag": "7b3eba6a-9a1e-4e9b-a5cd-443b479f34bb"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:26.802654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-70bf7c57-a241-4910-a86d-dba8732ad5a1 req-5c46e2ee-50cf-49a9-8fb2-b382dbf1093d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:26.803162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-70bf7c57-a241-4910-a86d-dba8732ad5a1 req-5c46e2ee-50cf-49a9-8fb2-b382dbf1093d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:26.821895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-70bf7c57-a241-4910-a86d-dba8732ad5a1 req-5c46e2ee-50cf-49a9-8fb2-b382dbf1093d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:26.842801 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-70bf7c57-a241-4910-a86d-dba8732ad5a1 req-5c46e2ee-50cf-49a9-8fb2-b382dbf1093d service nova] Creating event network-changed:7b3eba6a-9a1e-4e9b-a5cd-443b479f34bb for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:10:26.856277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-70bf7c57-a241-4910-a86d-dba8732ad5a1 req-5c46e2ee-50cf-49a9-8fb2-b382dbf1093d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081961 Oct 27 09:10:26.861847 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1242/2489] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:26.927837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:26.928771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] [instance: 734f18c8-6747-4af1-a701-95a8698c877d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:26.940566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:26.944782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:26.945461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:26.946245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:26.946881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:26.949243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:26.960690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:26.975629 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99ad02ac-6b8c-40e8-a0f9-12ee1750b9c4 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.917215 Oct 27 09:10:26.980595 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1248/2490] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:26 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:26.995237 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] HTTP exception thrown: Instance 734f18c8-6747-4af1-a701-95a8698c877d could not be found. Oct 27 09:10:27.005110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:27.006161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Request method failure captured: Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d HTTP/1.1 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkogfXalQgI8EjXkJ7Z1aG7oLUrgCXmjGXpOoKabeURscvTMA4heiEih79U_yygqY6FXlkkEA171il8abXjTxy0TUbYiEzWLKHMzNUdBqudzCHvMC5fXM3jIMEKDDM4JNV6it2MUglnITopFL3ZCEc3NKlXaEjUVC2QUGIp5J_ug2Ds Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.91 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6fd690af97f14fef9572fd231d12ddc0 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1503770917 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6fd690af97f14fef9572fd231d12ddc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6fd690af97f14fef9572fd231d12ddc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6fd690af97f14fef9572fd231d12ddc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6fd690af97f14fef9572fd231d12ddc0"}]}] Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1503770917 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6fd690af97f14fef9572fd231d12ddc0 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1503770917 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-UnshelveToHostMultiNodesTest-1503770917-project Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 984d5cab5251412692c743df3b464407 Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1503770917-project Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 734f18c8-6747-4af1-a701-95a8698c877d could not be found. Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '734f18c8-6747-4af1-a701-95a8698c877d'} Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734f18c8-6747-4af1-a701-95a8698c877d could not be found. Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734f18c8-6747-4af1-a701-95a8698c877d could not be found. Oct 27 09:10:27.011133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:27.014750 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:27.014750 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:27.014750 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:27.014750 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:27.014750 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:27.014750 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:10:27.014750 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:10:27.014750 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734f18c8-6747-4af1-a701-95a8698c877d could not be found. Oct 27 09:10:27.014750 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:10:27.017436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] Returning 404 to user: Instance 734f18c8-6747-4af1-a701-95a8698c877d could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:10:27.025949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:27.026893 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4cf62ae3-ad20-4ec1-806c-1b51f07d9aa8 tempest-UnshelveToHostMultiNodesTest-1503770917 tempest-UnshelveToHostMultiNodesTest-1503770917-project] 10.222.0.25 "GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d" status: 404 len: 111 microversion: 2.91 time: 0.101213 Oct 27 09:10:27.028163 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1243/2491] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:10:26 2022] GET /compute/v2.1/servers/734f18c8-6747-4af1-a701-95a8698c877d => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:10:27.029014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:27.029637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:27.030541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:27.043417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:27.044135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:27.172087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:27.196162 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb2b5561-0015-4657-a974-175e8bc13538 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1269 microversion: 2.1 time: 0.195618 Oct 27 09:10:27.198918 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1249/2492] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:26 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1269 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:10:27.779199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:27.779882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:27.804216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:27.809617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:27.810121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:27.813696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:27.816015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:27.816401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:28.008784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:28.009399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:28.021196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:28.021695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:28.027870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:28.028681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:28.029163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:28.029619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:28.482284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:28.491519 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac9adc1d-0a94-4800-a33c-9190e43f4393 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.717000 Oct 27 09:10:28.507984 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1244/2493] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:27 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:28.513239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:28.514073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:28.520341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:28.521220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:28.521655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:28.522505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:28.523112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:28.523733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:28.616260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:28.627085 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-378ff5a5-147b-4f34-a7b3-4f7e7e84be43 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.623395 Oct 27 09:10:28.639511 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1250/2494] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:28 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:10:28.670621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:28.678575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:28.683559 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-876962c7-0752-47cf-b58d-2437a9fd6755 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1275 microversion: 2.1 time: 0.174093 Oct 27 09:10:28.700033 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1245/2495] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:28 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:29.022673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5871c30d-ae6e-454d-a6c7-4b707a0800be tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Action: 'create', calling method: .version_select at 0x7f31aa55d9d0>, body: {"keypair": {"name": "tempest-keypair-896219486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDL5UZNjRzOYzT+VhFygPgvUKfBlLdXLYVNPzaepwXV0fBajJatSJgpq4IPWBlPwy2RKMqwS/JJIzbHir971/tduNOG1BpZLc+RirK0x558cv4XO3cZk9ZwyIJadvyLSBA=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:29.051450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5871c30d-ae6e-454d-a6c7-4b707a0800be tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:29.060178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5871c30d-ae6e-454d-a6c7-4b707a0800be tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for user db06b0a25a384d459ab0994c6e05def7 and project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:29.092691 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5871c30d-ae6e-454d-a6c7-4b707a0800be tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.231269 Oct 27 09:10:29.093484 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1251/2496] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:10:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:29.104946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-842402be-b366-4947-82cc-0d94e47b7f70 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Calling method '.version_select at 0x7f31a9979790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:29.115470 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-842402be-b366-4947-82cc-0d94e47b7f70 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-896219486" status: 200 len: 497 microversion: 2.1 time: 0.015058 Oct 27 09:10:29.132789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ead53784-13ce-4bac-b0fd-613c3ea890a4 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Calling method '.version_select at 0x7f31aa2f8700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:29.143672 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1246/2497] 10.222.0.25 () {58 vars in 1215 bytes} [Thu Oct 27 09:10:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-896219486 => generated 497 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:29.197372 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ead53784-13ce-4bac-b0fd-613c3ea890a4 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896219486" status: 202 len: 0 microversion: 2.1 time: 0.068874 Oct 27 09:10:29.204297 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1252/2498] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:10:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896219486 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:10:29.211862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b29b97d8-0f9e-4e49-a14c-1483d47d3dcf tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Action: 'create', calling method: .version_select at 0x7f31a9949310>, body: {"keypair": {"name": "tempest-keypair-2145253196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO//JuXTqF1Qi43CL4C7x512heG42ZkRXZxvOR2IAzesxhxsTXpZsU575Iqbn/EO8zPCGK5RMI3MiG5+nT8jRlNBd4SfapcJ696TgNKBlcqT8fy5KYbACgCn1cLLHcJP8A=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:29.234612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b29b97d8-0f9e-4e49-a14c-1483d47d3dcf tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:29.245084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b29b97d8-0f9e-4e49-a14c-1483d47d3dcf tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for user db06b0a25a384d459ab0994c6e05def7 and project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:29.282980 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b29b97d8-0f9e-4e49-a14c-1483d47d3dcf tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075865 Oct 27 09:10:29.288754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1247/2499] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:10:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:29.302642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08809cfc-8bbf-4c13-9731-8d842958dd6e tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Calling method '.version_select at 0x7f31aa2bc5e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:29.352580 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08809cfc-8bbf-4c13-9731-8d842958dd6e tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145253196" status: 202 len: 0 microversion: 2.1 time: 0.054622 Oct 27 09:10:29.359664 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1253/2500] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 09:10:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145253196 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:10:29.365444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4efa3e81-23b0-4eb1-a6f9-511a66d1bead tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Action: 'create', calling method: .version_select at 0x7f31a99c9d30>, body: {"keypair": {"name": "tempest-keypair-1298381887", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:29.384850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4efa3e81-23b0-4eb1-a6f9-511a66d1bead tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:29.391254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4efa3e81-23b0-4eb1-a6f9-511a66d1bead tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for user db06b0a25a384d459ab0994c6e05def7 and project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:29.437938 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4efa3e81-23b0-4eb1-a6f9-511a66d1bead tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.076492 Oct 27 09:10:29.440489 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1248/2501] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:10:29 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:10:29.455786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e668e2ef-c962-439a-b1ff-4cd806e0bda1 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Calling method '.version_select at 0x7f31aa17f9d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:29.482206 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e668e2ef-c962-439a-b1ff-4cd806e0bda1 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298381887" status: 202 len: 0 microversion: 2.1 time: 0.033471 Oct 27 09:10:29.483299 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1254/2502] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 09:10:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298381887 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:10:29.505960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13ce9944-1881-4549-a102-a0453f632480 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Action: 'create', calling method: .version_select at 0x7f31a9979550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-147218017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeJE8nG2k9bCil/jeJlwnwCQwLGwb963tqD+eHvKNUwwzJNN8g7sWl87xPgeT3wYxsy1drqDcXJx0afH0XPTSqvNFllEnIF1saof5tsVorZ83Dw0GDROoqKpR2K2IHsaQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:29.520511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:29.527324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:29.532470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-13ce9944-1881-4549-a102-a0453f632480 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:29.542054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-13ce9944-1881-4549-a102-a0453f632480 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for user db06b0a25a384d459ab0994c6e05def7 and project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:29.555331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:29.557100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:29.558699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:29.560853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:29.564643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:29.565352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:29.580405 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13ce9944-1881-4549-a102-a0453f632480 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.085801 Oct 27 09:10:29.584203 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1249/2503] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:10:29 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:29.605923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-542c871a-5dd8-43f0-a0cc-a140f7658ba7 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Action: 'create', calling method: .version_select at 0x7f31aa2fbee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2020227320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObiYr1+YGZMtU9NT51kGADOAmfx0CAOg02pSkUDjuie1HNQXUdzL617YIjgi676J7aXtiJJUD+70DO9b4vBeyAzqx+44rwpCvIDaWzj9tcV1LhanqxKKSM4Z+4grhYDQg=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:29.655276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-542c871a-5dd8-43f0-a0cc-a140f7658ba7 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:29.665735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-542c871a-5dd8-43f0-a0cc-a140f7658ba7 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for user db06b0a25a384d459ab0994c6e05def7 and project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:29.741315 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-542c871a-5dd8-43f0-a0cc-a140f7658ba7 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.147301 Oct 27 09:10:29.743040 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1250/2504] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:10:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:29.765171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:29.767037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:29.776924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:29.777420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:29.778402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:29.778551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:29.778994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:29.779512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:30.301671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:30.317820 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c45f77cc-1176-4630-a9f9-99ce94febeb4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.807118 Oct 27 09:10:30.318778 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1255/2505] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:29 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:30.346623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:30.347484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:30.356896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:30.357930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:30.358554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:30.359948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:30.360878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:30.361513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:30.438011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:30.454852 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5554aebf-6ed0-4ead-9fdb-0216f5e2dd0f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.702760 Oct 27 09:10:30.455457 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1251/2506] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:29 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:30.473623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-035d56c1-921e-4ef5-b20f-ed56bd99f66f tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Action: 'create', calling method: .version_select at 0x7f31a9979160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1531778377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3b9s/FxGolJJ+kJYwWtGdQ0GtpDOq/vpK3c7VBzuQUEBFF3QPzy8qbpINpgD8MzCz9EFlhhWoPKlSUsqmqb6OXE5uPJFJbvomnUWyL0VDlINkwqy25usWqeAXZZHJ1+A=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:30.501242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-035d56c1-921e-4ef5-b20f-ed56bd99f66f tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:30.508896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-035d56c1-921e-4ef5-b20f-ed56bd99f66f tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Getting quotas for user db06b0a25a384d459ab0994c6e05def7 and project d7432cc6dbb04398a3277df87cfc78ee. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:30.548647 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-035d56c1-921e-4ef5-b20f-ed56bd99f66f tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.091813 Oct 27 09:10:30.560319 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1252/2507] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:10:30 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:30.573432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-537dbb35-a18b-4ef0-9e6f-8300b605d7b7 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Calling method '.version_select at 0x7f31a9964f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:30.578880 n-d-858383-16 devstack@n-api.service[120603]: WARNING oslo_db.sqlalchemy.utils [None req-537dbb35-a18b-4ef0-9e6f-8300b605d7b7 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 09:10:30.587383 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-537dbb35-a18b-4ef0-9e6f-8300b605d7b7 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.019080 Oct 27 09:10:30.588307 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1253/2508] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:10:30 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:30.604572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e9a3e16-44c3-427b-bd20-54ec7109885f tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Calling method '.version_select at 0x7f31a99c9310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:30.624470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:30.661312 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e9a3e16-44c3-427b-bd20-54ec7109885f tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1531778377" status: 202 len: 0 microversion: 2.1 time: 0.063739 Oct 27 09:10:30.661968 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1254/2509] 10.222.0.25 () {58 vars in 1278 bytes} [Thu Oct 27 09:10:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1531778377 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:10:30.671287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86c487d6-c822-489c-9132-a06551c829a3 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Calling method '.version_select at 0x7f31a994e700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:30.709420 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-86c487d6-c822-489c-9132-a06551c829a3 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2020227320" status: 202 len: 0 microversion: 2.1 time: 0.042506 Oct 27 09:10:30.710702 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1255/2510] 10.222.0.25 () {58 vars in 1278 bytes} [Thu Oct 27 09:10:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2020227320 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:10:30.744525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5fd3e2d-836b-4461-852f-ba4812e2cf24 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] Calling method '.version_select at 0x7f31a9949af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:30.791719 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5fd3e2d-836b-4461-852f-ba4812e2cf24 tempest-KeyPairsV2TestJSON-847769611 tempest-KeyPairsV2TestJSON-847769611-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-147218017" status: 202 len: 0 microversion: 2.1 time: 0.066654 Oct 27 09:10:30.792409 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1256/2511] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:10:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-147218017 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:10:31.245497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:31.262566 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72db79a9-65ac-4e8a-97d0-0f036629a625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1275 microversion: 2.1 time: 0.938080 Oct 27 09:10:31.264080 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1256/2512] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:30 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1275 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:31.342548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:31.346106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:31.357928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:31.358429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:31.358866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:31.359599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:31.364151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:31.369000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:31.482212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:31.482868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:31.495147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:31.496097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:31.497129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:31.498292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:31.500123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:31.502080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:31.809707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:31.828856 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a5cea24-a870-4222-b115-334a32b89ba0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.490159 Oct 27 09:10:31.830357 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1257/2513] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:31 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:31.980550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:31.999620 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9d09f32b-1c3e-4939-94f1-fbe618d823fd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.521493 Oct 27 09:10:32.000387 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1257/2514] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:31 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:32.289516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:32.290136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:32.297135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:32.297682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:32.298373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:32.299261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:32.299748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:32.300339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:32.481493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:32.491716 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7afde8a1-6dcc-4034-b57d-47a738a8d613 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 0.206275 Oct 27 09:10:32.497263 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1258/2515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:32 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:32.854170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:32.854796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:32.867022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:32.867774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:32.868678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:32.869593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:32.870971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:32.871606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:33.024221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:33.025404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:33.036913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:33.037433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:33.037885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:33.038615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:33.039083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:33.039521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:33.119606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:33.132637 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f38da84-e05e-4255-afc1-86108a95e12b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.282522 Oct 27 09:10:33.148409 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1258/2516] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:32 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:33.392324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:33.406074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5e0f7c5-a49f-4a67-827d-1f39c901cd42 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.385963 Oct 27 09:10:33.408592 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1259/2517] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:33 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:10:33.497637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8f86ffef-09f4-4c43-b6d1-8ada85b48aee req-1b0514d4-3332-437d-84fd-115f0fdda4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc68a20-e621-4812-8f20-a5ababf275c2", "tag": "0b4b967a-c461-4962-a258-a33bae542dc2"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:33.509437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8f86ffef-09f4-4c43-b6d1-8ada85b48aee req-1b0514d4-3332-437d-84fd-115f0fdda4d0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:33.510410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8f86ffef-09f4-4c43-b6d1-8ada85b48aee req-1b0514d4-3332-437d-84fd-115f0fdda4d0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:33.510938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8f86ffef-09f4-4c43-b6d1-8ada85b48aee req-1b0514d4-3332-437d-84fd-115f0fdda4d0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:33.516500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:33.517451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:33.526471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:33.527341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:33.528067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:33.529179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:33.530189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:33.530841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:33.536093 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8f86ffef-09f4-4c43-b6d1-8ada85b48aee req-1b0514d4-3332-437d-84fd-115f0fdda4d0 service nova] Creating event network-changed:0b4b967a-c461-4962-a258-a33bae542dc2 for instance 6bc68a20-e621-4812-8f20-a5ababf275c2 on n-h1-858383-16 Oct 27 09:10:33.545978 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8f86ffef-09f4-4c43-b6d1-8ada85b48aee req-1b0514d4-3332-437d-84fd-115f0fdda4d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051394 Oct 27 09:10:33.549363 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1259/2518] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:10:33.750985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:33.762413 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf8831e7-10a9-4a5a-aa0c-17be893ef4b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 0.250625 Oct 27 09:10:33.765378 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1260/2519] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:33 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:10:34.163118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:34.163902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:34.181467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:34.183054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:34.186492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:34.189647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:34.191228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:34.192279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:34.436657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:34.437269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:34.447060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:34.448104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:34.448702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:34.449796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:34.450628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:34.451674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:34.488188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:34.500408 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ce77d129-14a9-4e45-b4ca-cdaa6f3cd4c9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.344115 Oct 27 09:10:34.501676 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1260/2520] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:34 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:34.718544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:34.729747 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4976ec7-8e72-4bd7-9850-6fed10946698 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.297123 Oct 27 09:10:34.730788 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1261/2521] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:34 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:34.804920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:34.806599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:34.818729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:34.819478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:34.820131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:34.821318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:34.821945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:34.822641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.115833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:35.128644 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1cb2a0b-3ca8-4682-9509-0ba937231ba1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 0.345193 Oct 27 09:10:35.136513 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1262/2522] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:34 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:10:35.152413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:35.340924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79a73297-9120-408d-a66e-d8e6604b461a tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:35.346374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a73297-9120-408d-a66e-d8e6604b461a tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.347315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a73297-9120-408d-a66e-d8e6604b461a tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.348101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a73297-9120-408d-a66e-d8e6604b461a tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.349281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a73297-9120-408d-a66e-d8e6604b461a tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.349896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a73297-9120-408d-a66e-d8e6604b461a tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.350472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a73297-9120-408d-a66e-d8e6604b461a tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.387150 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79a73297-9120-408d-a66e-d8e6604b461a tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.673080 Oct 27 09:10:35.388173 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1261/2523] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:10:34 2022] GET /compute/v2.1/os-services => generated 949 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:35.405894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-238a2479-3e3b-44c8-abf0-0453a8c32aee tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:35.410688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238a2479-3e3b-44c8-abf0-0453a8c32aee tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.411192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238a2479-3e3b-44c8-abf0-0453a8c32aee tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.411666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238a2479-3e3b-44c8-abf0-0453a8c32aee tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.412483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238a2479-3e3b-44c8-abf0-0453a8c32aee tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.415833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238a2479-3e3b-44c8-abf0-0453a8c32aee tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.418623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-238a2479-3e3b-44c8-abf0-0453a8c32aee tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.469009 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-238a2479-3e3b-44c8-abf0-0453a8c32aee tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-858383-16" status: 200 len: 581 microversion: 2.1 time: 0.067078 Oct 27 09:10:35.469996 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1263/2524] 10.222.0.25 () {58 vars in 1174 bytes} [Thu Oct 27 09:10:35 2022] GET /compute/v2.1/os-services?host=n-d-858383-16 => generated 581 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:35.485228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f7568a3-9088-47e7-bdc0-0c692d651a08 tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:35.521409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7568a3-9088-47e7-bdc0-0c692d651a08 tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.525257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7568a3-9088-47e7-bdc0-0c692d651a08 tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.526609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7568a3-9088-47e7-bdc0-0c692d651a08 tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.528041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7568a3-9088-47e7-bdc0-0c692d651a08 tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.528706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7568a3-9088-47e7-bdc0-0c692d651a08 tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.529898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7568a3-9088-47e7-bdc0-0c692d651a08 tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.549228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ccde751f-ff10-4c1e-b236-aa64d20a0320 tempest-AbsoluteLimitsTestJSON-1535209160 tempest-AbsoluteLimitsTestJSON-1535209160-project] Calling method '.version_select at 0x7f31aa456f70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:35.562651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccde751f-ff10-4c1e-b236-aa64d20a0320 tempest-AbsoluteLimitsTestJSON-1535209160 tempest-AbsoluteLimitsTestJSON-1535209160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.563488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccde751f-ff10-4c1e-b236-aa64d20a0320 tempest-AbsoluteLimitsTestJSON-1535209160 tempest-AbsoluteLimitsTestJSON-1535209160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.564241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccde751f-ff10-4c1e-b236-aa64d20a0320 tempest-AbsoluteLimitsTestJSON-1535209160 tempest-AbsoluteLimitsTestJSON-1535209160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.565306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccde751f-ff10-4c1e-b236-aa64d20a0320 tempest-AbsoluteLimitsTestJSON-1535209160 tempest-AbsoluteLimitsTestJSON-1535209160-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.566148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccde751f-ff10-4c1e-b236-aa64d20a0320 tempest-AbsoluteLimitsTestJSON-1535209160 tempest-AbsoluteLimitsTestJSON-1535209160-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.567598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccde751f-ff10-4c1e-b236-aa64d20a0320 tempest-AbsoluteLimitsTestJSON-1535209160 tempest-AbsoluteLimitsTestJSON-1535209160-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.571285 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f7568a3-9088-47e7-bdc0-0c692d651a08 tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.091510 Oct 27 09:10:35.576003 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1264/2525] 10.222.0.25 () {58 vars in 1176 bytes} [Thu Oct 27 09:10:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:35.589747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:35.590590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:35.592032 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ccde751f-ff10-4c1e-b236-aa64d20a0320 tempest-AbsoluteLimitsTestJSON-1535209160 tempest-AbsoluteLimitsTestJSON-1535209160-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.149072 Oct 27 09:10:35.593077 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1262/2526] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 27 09:10:35 2022] GET /compute/v2.1/limits => generated 511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:10:35.598644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-645cb1a6-f644-4a69-b2ad-d66c8db534eb tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:35.602658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645cb1a6-f644-4a69-b2ad-d66c8db534eb tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.607936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645cb1a6-f644-4a69-b2ad-d66c8db534eb tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.607936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645cb1a6-f644-4a69-b2ad-d66c8db534eb tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.607936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645cb1a6-f644-4a69-b2ad-d66c8db534eb tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.607936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645cb1a6-f644-4a69-b2ad-d66c8db534eb tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.607936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645cb1a6-f644-4a69-b2ad-d66c8db534eb tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.618028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.620422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.620898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.621853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.622599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.623037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.652177 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-645cb1a6-f644-4a69-b2ad-d66c8db534eb tempest-ServicesAdminTestJSON-1201016114 tempest-ServicesAdminTestJSON-1201016114-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.057228 Oct 27 09:10:35.653673 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1263/2527] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:10:35 2022] GET /compute/v2.1/os-services => generated 949 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:35.659540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8dd3d6d4-5a47-4108-99fd-db2bbbb738fe req-438d4767-591c-4447-8e39-a8ea8c6a01b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c547d73f-84e1-4055-b8a8-3b56bd9755d7", "tag": "b743cb6c-e9f1-439e-83ac-944b05a76129"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:35.673228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8dd3d6d4-5a47-4108-99fd-db2bbbb738fe req-438d4767-591c-4447-8e39-a8ea8c6a01b7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.673708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8dd3d6d4-5a47-4108-99fd-db2bbbb738fe req-438d4767-591c-4447-8e39-a8ea8c6a01b7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.675773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8dd3d6d4-5a47-4108-99fd-db2bbbb738fe req-438d4767-591c-4447-8e39-a8ea8c6a01b7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.694697 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8dd3d6d4-5a47-4108-99fd-db2bbbb738fe req-438d4767-591c-4447-8e39-a8ea8c6a01b7 service nova] Creating event network-changed:b743cb6c-e9f1-439e-83ac-944b05a76129 for instance c547d73f-84e1-4055-b8a8-3b56bd9755d7 on n-h1-858383-16 Oct 27 09:10:35.702895 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8dd3d6d4-5a47-4108-99fd-db2bbbb738fe req-438d4767-591c-4447-8e39-a8ea8c6a01b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047464 Oct 27 09:10:35.704301 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1264/2528] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:35.762472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:35.763847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:35.782036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.782962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.783552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:35.785158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:35.786649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:35.787689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:36.210614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:36.219862 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0438e322-e788-4dcb-8994-87c129ac9056 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.642585 Oct 27 09:10:36.221869 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1265/2529] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:35 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:36.237129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:36.238439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:36.254916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:36.260732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:36.261723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:36.262898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:36.263643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:36.264190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:36.278985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:36.293929 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-39bd0aea-6d3f-4692-be2c-f926d29147e7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.540284 Oct 27 09:10:36.306900 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1265/2530] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:35 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:36.560922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:36.580911 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d49541c-4d6c-4f9d-b4a9-04991dd386fb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 0.356411 Oct 27 09:10:36.583006 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1266/2531] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:36 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:37.250234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:37.250910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:37.266045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:37.266586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:37.267058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:37.270982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:37.273451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:37.274456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:37.319326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:37.320008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:37.331079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:37.333689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:37.334567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:37.335318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:37.335855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:37.336281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:37.663630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:37.680268 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f5649ce1-75d2-4827-a78c-841e6e4c3a3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.433750 Oct 27 09:10:37.683090 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1266/2532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:37 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:37.702675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:37.703755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:37.712831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:37.713710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:37.714605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:37.716411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:37.717085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:37.717772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:37.756814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:37.770414 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2afc4cad-6bd1-4608-8ae0-62358845e3e9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.455644 Oct 27 09:10:37.771699 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1267/2533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:37 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:37.969612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:37.984288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1f0eaecb-c1ff-49dd-9f1b-5c1abc6e72d6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 0.297985 Oct 27 09:10:37.995459 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1267/2534] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:37 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:38.709827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:38.711173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:38.729618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:38.730468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:38.731084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:38.732305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:38.734914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:38.735602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:38.807024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:38.808379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:38.859743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:38.860332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:38.860779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:38.866907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:38.867442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:38.867937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:39.062544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:39.078601 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91aaf109-0a47-4d62-b8d4-4a732164e3d6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.373330 Oct 27 09:10:39.080274 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1268/2535] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:38 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:39.097272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:39.098418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:39.108801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:39.112307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:39.119546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:39.121117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:39.134864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:39.135361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:39.339939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:39.353011 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f496066f-bf01-45b5-b043-f661e50f52da tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.560257 Oct 27 09:10:39.357948 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1268/2536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:38 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:39.563663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:39.576059 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6debd2e-ff3f-4b0c-b55f-00272231d323 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 0.491836 Oct 27 09:10:39.596378 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1269/2537] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:39 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:40.107815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:40.108569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:40.119828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:40.120337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:40.120786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:40.121567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:40.122028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:40.122629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:40.387529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:40.388899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:40.411130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:40.411751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:40.412669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:40.422395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:40.423434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:40.427621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:40.518211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=20 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:40.547716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:40.569025 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6bc5c433-4366-4989-a246-7844fb06a092 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.467489 Oct 27 09:10:40.579726 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1269/2538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:40 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:40.600707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:40.601366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:40.617954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:40.618442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:40.622453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:40.629710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:40.630592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:40.631246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:40.669996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:41.047758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:41.057918 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1da75b21-7d32-4212-8fa2-78402d1d666c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.675233 Oct 27 09:10:41.058786 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1270/2539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:40 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:10:41.161625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:41.174314 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d4b6ea05-a7d8-44d5-8032-e8befb23f554 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 0.577939 Oct 27 09:10:41.175223 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1270/2540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:40 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:41.601326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:41.602199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:41.610258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.611139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.613278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:41.616418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.620436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.622674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:41.781438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-119a9e53-3c80-4d58-a6ba-a424c81c4288 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:41.786212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-119a9e53-3c80-4d58-a6ba-a424c81c4288 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.786712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-119a9e53-3c80-4d58-a6ba-a424c81c4288 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.787438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-119a9e53-3c80-4d58-a6ba-a424c81c4288 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:41.788632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-119a9e53-3c80-4d58-a6ba-a424c81c4288 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.789975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-119a9e53-3c80-4d58-a6ba-a424c81c4288 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.795243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-119a9e53-3c80-4d58-a6ba-a424c81c4288 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:41.840537 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-119a9e53-3c80-4d58-a6ba-a424c81c4288 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.312862 Oct 27 09:10:41.841583 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1271/2541] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:10:41 2022] GET /compute/v2.1/os-services => generated 949 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:41.870782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5809046e-b495-4d80-ac66-620fd999be9b tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:41.874668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5809046e-b495-4d80-ac66-620fd999be9b tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.875363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5809046e-b495-4d80-ac66-620fd999be9b tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.876015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5809046e-b495-4d80-ac66-620fd999be9b tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:41.877121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5809046e-b495-4d80-ac66-620fd999be9b tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.877922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5809046e-b495-4d80-ac66-620fd999be9b tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.878627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5809046e-b495-4d80-ac66-620fd999be9b tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:41.907613 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5809046e-b495-4d80-ac66-620fd999be9b tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.054576 Oct 27 09:10:41.908857 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1272/2542] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Oct 27 09:10:41 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:41.922688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e27d18ca-f1ef-45d8-8903-f235c89ff7bb tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:41.927864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e27d18ca-f1ef-45d8-8903-f235c89ff7bb tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.928616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e27d18ca-f1ef-45d8-8903-f235c89ff7bb tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.929224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e27d18ca-f1ef-45d8-8903-f235c89ff7bb tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:41.930138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e27d18ca-f1ef-45d8-8903-f235c89ff7bb tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.930765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e27d18ca-f1ef-45d8-8903-f235c89ff7bb tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.931641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e27d18ca-f1ef-45d8-8903-f235c89ff7bb tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:41.960723 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e27d18ca-f1ef-45d8-8903-f235c89ff7bb tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.041593 Oct 27 09:10:41.961946 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1273/2543] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:10:41 2022] GET /compute/v2.1/os-services => generated 949 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:10:41.974704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-932994fa-052d-4b20-8017-f8ed618bef1f tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:41.984480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932994fa-052d-4b20-8017-f8ed618bef1f tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.985714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932994fa-052d-4b20-8017-f8ed618bef1f tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.985940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932994fa-052d-4b20-8017-f8ed618bef1f tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:41.987526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932994fa-052d-4b20-8017-f8ed618bef1f tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:41.987526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932994fa-052d-4b20-8017-f8ed618bef1f tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:41.987978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932994fa-052d-4b20-8017-f8ed618bef1f tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:42.003665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:42.012189 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae2ea482-31bc-4a41-8e88-6914adc10522 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.414917 Oct 27 09:10:42.017225 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1271/2544] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:41 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:10:42.043768 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-932994fa-052d-4b20-8017-f8ed618bef1f tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-858383-16&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.073513 Oct 27 09:10:42.045201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1274/2545] 10.222.0.25 () {58 vars in 1196 bytes} [Thu Oct 27 09:10:41 2022] GET /compute/v2.1/os-services?host=n-d-858383-16&binary=xxx => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:10:42.060870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ca70d549-fc40-4971-87f4-6e5132aebed5 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:42.066855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca70d549-fc40-4971-87f4-6e5132aebed5 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:42.067817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca70d549-fc40-4971-87f4-6e5132aebed5 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:42.068500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca70d549-fc40-4971-87f4-6e5132aebed5 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:42.069676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca70d549-fc40-4971-87f4-6e5132aebed5 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:42.070397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca70d549-fc40-4971-87f4-6e5132aebed5 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:42.070925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca70d549-fc40-4971-87f4-6e5132aebed5 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:42.082582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:42.084256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:42.099137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:42.099667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:42.102170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:42.103265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:42.109485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:42.109830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:42.115471 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ca70d549-fc40-4971-87f4-6e5132aebed5 tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.059482 Oct 27 09:10:42.117414 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1272/2546] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:10:42 2022] GET /compute/v2.1/os-services => generated 949 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:42.131658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1053ad9f-ee58-4d92-9609-47ef630333dc tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:42.137616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1053ad9f-ee58-4d92-9609-47ef630333dc tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:42.138367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1053ad9f-ee58-4d92-9609-47ef630333dc tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:42.139294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1053ad9f-ee58-4d92-9609-47ef630333dc tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:42.140266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1053ad9f-ee58-4d92-9609-47ef630333dc tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:42.140988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1053ad9f-ee58-4d92-9609-47ef630333dc tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:42.141583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1053ad9f-ee58-4d92-9609-47ef630333dc tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:42.174981 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1053ad9f-ee58-4d92-9609-47ef630333dc tempest-ServicesAdminNegativeTestJSON-979401338 tempest-ServicesAdminNegativeTestJSON-979401338-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.049359 Oct 27 09:10:42.177419 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1273/2547] 10.222.0.25 () {58 vars in 1198 bytes} [Thu Oct 27 09:10:42 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:10:42.382629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-498f3804-ecca-4715-824a-44e37dcd3fba tempest-ServicesAdminNegativeTestJSON-81119343 tempest-ServicesAdminNegativeTestJSON-81119343-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:42.390829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-498f3804-ecca-4715-824a-44e37dcd3fba tempest-ServicesAdminNegativeTestJSON-81119343 tempest-ServicesAdminNegativeTestJSON-81119343-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b0e2fbe55d164ca19e3eb193f92d51b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb8a24d3f0c47459104ae0b1efb1b08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-498f3804-ecca-4715-824a-44e37dcd3fba tempest-ServicesAdminNegativeTestJSON-81119343 tempest-ServicesAdminNegativeTestJSON-81119343-project] Request method failure captured: Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWksQ_4QI-S22HLEdXwlklVBRntUHh1R8B8XqD2MuzeOjUASgmy34Tc9XTgi-QsQxxHkZRYrNsLjMebCXsJy1xv2T0-hmYFiMX8cELgYdkXFEjA9EQc8yCtOrdKPyVc8ko1vbBM-4ZYTQYgeu3pwu-00grsut12Zft4_EVsHSxj3BaWY Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bcb8a24d3f0c47459104ae0b1efb1b08 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-81119343 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bcb8a24d3f0c47459104ae0b1efb1b08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bcb8a24d3f0c47459104ae0b1efb1b08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bcb8a24d3f0c47459104ae0b1efb1b08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bcb8a24d3f0c47459104ae0b1efb1b08"}]}] Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-81119343 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bcb8a24d3f0c47459104ae0b1efb1b08 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-81119343 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServicesAdminNegativeTestJSON-81119343-project Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: b0e2fbe55d164ca19e3eb193f92d51b3 Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-81119343-project Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: action_args: {} Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise self.value Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 09:10:42.395792 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:42.400074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:10:42.400074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:42.400074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:10:42.400074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:10:42.400074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:10:42.400074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 27 09:10:42.400074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 27 09:10:42.400074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 27 09:10:42.400074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:10:42.402376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-498f3804-ecca-4715-824a-44e37dcd3fba tempest-ServicesAdminNegativeTestJSON-81119343 tempest-ServicesAdminNegativeTestJSON-81119343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:10:42.408169 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-498f3804-ecca-4715-824a-44e37dcd3fba tempest-ServicesAdminNegativeTestJSON-81119343 tempest-ServicesAdminNegativeTestJSON-81119343-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.217428 Oct 27 09:10:42.409140 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1274/2548] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:10:42 2022] GET /compute/v2.1/os-services => generated 112 bytes in 224 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:10:42.421834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:42.422542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:42.445073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:42.445631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:42.446112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:42.447116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:42.447604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:42.448697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:42.508281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:42.520405 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-536b056a-682a-4085-8cab-98c837458766 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.440686 Oct 27 09:10:42.524609 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1275/2549] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:42 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:42.862337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-227598687", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ea4c4340-a5e1-477d-8511-2ff7dc560289"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:42.938307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:42.954328 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6dcfeaa7-0d2f-4e12-b968-3280e2f52ba6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 0.544052 Oct 27 09:10:42.955413 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1275/2550] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:42 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:42.956895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] validate_networks() for [('ea4c4340-a5e1-477d-8511-2ff7dc560289', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:10:43.041268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:43.042142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:43.052402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:43.062612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:43.063254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:43.064193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:43.064797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:43.065365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:44.064914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:44.093327 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0393b1f6-c4b5-4d0e-bed9-c886413eb172 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 1.042265 Oct 27 09:10:44.108145 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1276/2551] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:43 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:44.116187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:44.116742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:44.135667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:44.138721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:44.139253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:44.140244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:44.145337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:44.146218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:44.522561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:10:44.523039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:10:44.523682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:10:44.524093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:10:44.525110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:10:44.550237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:44.554943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:44.555542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:44.556654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:44.557140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:44.566383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:44.572193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:44.591402 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1b8f9e70-6ff6-4d06-b640-68e9a74f2ea6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.479195 Oct 27 09:10:44.597165 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1277/2552] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:44 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:44.616392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-627b93f3-d208-4470-af05-49aa91b8f0f4 req-8ba0de13-644d-42cc-a473-0bb85aa539b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "name": "network-vif-plugged", "status": "completed", "tag": "751baeac-af6f-48a5-aae6-54816b9b6009"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:44.651447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-627b93f3-d208-4470-af05-49aa91b8f0f4 req-8ba0de13-644d-42cc-a473-0bb85aa539b8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:44.652903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-627b93f3-d208-4470-af05-49aa91b8f0f4 req-8ba0de13-644d-42cc-a473-0bb85aa539b8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:44.653348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-627b93f3-d208-4470-af05-49aa91b8f0f4 req-8ba0de13-644d-42cc-a473-0bb85aa539b8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:44.654928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Getting quotas for project 16083c891b2b4f4f9264fbcf086f3893. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:44.680721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Getting quotas for user c5079fda993e4c1aaca97eff5ae5f14e and project 16083c891b2b4f4f9264fbcf086f3893. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:44.699792 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-627b93f3-d208-4470-af05-49aa91b8f0f4 req-8ba0de13-644d-42cc-a473-0bb85aa539b8 service nova] Creating event network-vif-plugged:751baeac-af6f-48a5-aae6-54816b9b6009 for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:10:44.722209 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-627b93f3-d208-4470-af05-49aa91b8f0f4 req-8ba0de13-644d-42cc-a473-0bb85aa539b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119584 Oct 27 09:10:44.728953 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1278/2553] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:44.735437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:44.742659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:10:44.747738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:44.748060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:10:44.771962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:44.772517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:44.774094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:44.777062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:44.779488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:44.779976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:44.924198 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f6a9df2-5864-4e52-b5be-5709e162cbba tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.157873 Oct 27 09:10:44.940474 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1276/2554] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:10:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:10:45.131057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:45.136914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:45.157553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:45.158111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:45.161946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:45.163291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:45.163821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:45.164266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:45.175342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:45.419600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:45.438460 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3d884add-051b-4684-baeb-1498ba164b0c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 0.705763 Oct 27 09:10:45.439682 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1279/2555] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:44 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:45.456438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1135341522", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ea4c4340-a5e1-477d-8511-2ff7dc560289"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:45.523124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:45.560898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=38 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:45.596008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] validate_networks() for [('ea4c4340-a5e1-477d-8511-2ff7dc560289', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:10:45.947363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:45.960778 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fb975d1-eddb-4a25-a33f-f6927fa55ee9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.843389 Oct 27 09:10:45.963478 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1277/2556] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:45 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:45.968434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:45.974266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:45.990565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:45.991418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:45.992128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:45.993105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:45.998416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:45.999124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:46.588376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:46.610658 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25aadb64-8628-452c-ae02-8d43ab3311f7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 0.638396 Oct 27 09:10:46.636355 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1278/2557] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:45 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:46.656969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:46.656969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:46.673989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:46.675814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:46.678741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:46.679553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:46.680062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:46.680501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:47.808069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:47.839138 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd931a95-da31-4d7f-8186-b0ba3baaae91 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 1.198491 Oct 27 09:10:47.844282 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1279/2558] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:46 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:47.863132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-460d8596-b16e-4f36-b298-2f043981b9d3 req-b339d3cc-c7b5-4349-85f2-ae9bfb654504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "name": "network-vif-plugged", "status": "completed", "tag": "32c369ba-a8d2-4bfb-b533-e951495c2c51"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:47.883073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:10:47.883964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:10:47.886516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:10:47.887517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:10:47.888694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:10:47.913173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-460d8596-b16e-4f36-b298-2f043981b9d3 req-b339d3cc-c7b5-4349-85f2-ae9bfb654504 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:47.916679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-460d8596-b16e-4f36-b298-2f043981b9d3 req-b339d3cc-c7b5-4349-85f2-ae9bfb654504 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:47.920242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-460d8596-b16e-4f36-b298-2f043981b9d3 req-b339d3cc-c7b5-4349-85f2-ae9bfb654504 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:47.947782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:47.948777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:47.951473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:47.955177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:47.960600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:47.961797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:47.981796 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-460d8596-b16e-4f36-b298-2f043981b9d3 req-b339d3cc-c7b5-4349-85f2-ae9bfb654504 service nova] Creating event network-vif-plugged:32c369ba-a8d2-4bfb-b533-e951495c2c51 for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:10:48.007048 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-460d8596-b16e-4f36-b298-2f043981b9d3 req-b339d3cc-c7b5-4349-85f2-ae9bfb654504 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157819 Oct 27 09:10:48.013207 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1280/2559] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:48.032000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:48.033551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:48.046289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:48.047385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:48.048396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:48.050284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:48.051942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:48.052886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:48.096159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Getting quotas for project 16083c891b2b4f4f9264fbcf086f3893. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:48.122134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Getting quotas for user c5079fda993e4c1aaca97eff5ae5f14e and project 16083c891b2b4f4f9264fbcf086f3893. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:48.174157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:10:48.183623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:10:48.356925 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5ece577b-68fc-402c-8bc7-46bc60c19f34 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.915388 Oct 27 09:10:48.360009 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1280/2560] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:10:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:10:48.374292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:48.374966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:48.459839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:48.463415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:48.464359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:48.471320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:48.471946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:48.472744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:48.916396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:48.928654 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-141a5f23-aba6-4761-a16f-cbd39b72bb0e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.909554 Oct 27 09:10:48.931375 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1281/2561] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:48 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:48.950508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1131877445", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "451", "networks": [{"uuid": "ea4c4340-a5e1-477d-8511-2ff7dc560289"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:49.036835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] validate_networks() for [('ea4c4340-a5e1-477d-8511-2ff7dc560289', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:10:49.898161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:49.911317 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb236459-a4a6-4935-8fe3-91a55c1a1f24 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 1.549451 Oct 27 09:10:49.912216 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1281/2562] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:48 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:49.918533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:49.919474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:49.928080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:49.929020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:49.929706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:49.930588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:49.931277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:49.932189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:51.802262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:51.812240 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fcdad6b0-fb0f-48e9-940b-7178398aa8ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 1.898546 Oct 27 09:10:51.829544 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1282/2563] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:49 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:51.836343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:51.837303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:51.843963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:51.844813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:51.845507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:51.846461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:51.847207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:51.848332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:52.161497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:10:52.162046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:10:52.165321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:10:52.167159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:10:52.168076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:10:52.199146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:52.200396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:52.202045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:52.203037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:52.205863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:52.207725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:52.289487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Getting quotas for project 16083c891b2b4f4f9264fbcf086f3893. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:10:52.307975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Getting quotas for user c5079fda993e4c1aaca97eff5ae5f14e and project 16083c891b2b4f4f9264fbcf086f3893. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:10:52.361541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:10:52.367858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:10:52.449259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=92,nova_api:INSERT=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:52.517279 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2bca7aa1-ec49-4cb5-b897-9da28a69e422 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.583732 Oct 27 09:10:52.517959 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1282/2564] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:10:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:10:52.536010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cb8a0fd4-7b3a-4354-a155-6fc41af66ff7 req-e732b5a1-42da-4831-b53c-235149aaa562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "name": "network-vif-plugged", "status": "completed", "tag": "7b3eba6a-9a1e-4e9b-a5cd-443b479f34bb"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:52.550421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cb8a0fd4-7b3a-4354-a155-6fc41af66ff7 req-e732b5a1-42da-4831-b53c-235149aaa562 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:52.551210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cb8a0fd4-7b3a-4354-a155-6fc41af66ff7 req-e732b5a1-42da-4831-b53c-235149aaa562 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:52.552081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cb8a0fd4-7b3a-4354-a155-6fc41af66ff7 req-e732b5a1-42da-4831-b53c-235149aaa562 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:52.577915 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cb8a0fd4-7b3a-4354-a155-6fc41af66ff7 req-e732b5a1-42da-4831-b53c-235149aaa562 service nova] Creating event network-vif-plugged:7b3eba6a-9a1e-4e9b-a5cd-443b479f34bb for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:10:52.590974 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cb8a0fd4-7b3a-4354-a155-6fc41af66ff7 req-e732b5a1-42da-4831-b53c-235149aaa562 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065006 Oct 27 09:10:52.593005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1283/2565] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:52.609094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:52.612057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:52.612833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:52.630302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:52.631492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:52.632908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:52.635541 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6c8d344-6ac3-47ef-925a-715f92e4889e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1498 microversion: 2.1 time: 0.804516 Oct 27 09:10:52.636129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:52.637898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:52.639901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:52.662045 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1283/2566] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:51 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1498 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:52.675499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-763c981a-b67b-45fe-b8ac-aa7ebb9ca73f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:52.676267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-763c981a-b67b-45fe-b8ac-aa7ebb9ca73f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:53.396289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-763c981a-b67b-45fe-b8ac-aa7ebb9ca73f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:53.404858 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-763c981a-b67b-45fe-b8ac-aa7ebb9ca73f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1221 microversion: 2.1 time: 0.741581 Oct 27 09:10:53.411206 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1284/2567] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:52 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1221 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:53.417210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:53.418153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:53.439099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:53.440073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:53.441120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:53.443443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:53.444829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:53.446849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:54.685613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:54.701766 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a55f2d1-b381-4924-999a-237b9ea687b5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1354 microversion: 2.1 time: 2.105334 Oct 27 09:10:54.708246 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1284/2568] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:52 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1354 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:54.724775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:54.725793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:54.755004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:54.755863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:54.757207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:54.761979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:54.762767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:54.765297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:55.133937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:55.167560 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-07ed7cde-67fe-428a-8387-7e29965e69ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 1.754762 Oct 27 09:10:55.185653 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1285/2569] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:53 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:55.202626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:55.203255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:55.227203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:55.229326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:55.233879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:55.234972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:55.235628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:55.236286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:55.702948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:55.719722 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d8717db5-4cd9-48ca-94d9-4becca65a26d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1291 microversion: 2.1 time: 0.530245 Oct 27 09:10:55.721133 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1286/2570] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:55 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1291 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:55.732912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-41ef86bc-719b-48a7-91af-3d135cbdfc56 req-efee69cc-d643-4606-b7e4-8fb950346e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c547d73f-84e1-4055-b8a8-3b56bd9755d7", "name": "network-vif-plugged", "status": "completed", "tag": "b743cb6c-e9f1-439e-83ac-944b05a76129"}, {"server_uuid": "6bc68a20-e621-4812-8f20-a5ababf275c2", "name": "network-vif-plugged", "status": "completed", "tag": "0b4b967a-c461-4962-a258-a33bae542dc2"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:55.763278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-41ef86bc-719b-48a7-91af-3d135cbdfc56 req-efee69cc-d643-4606-b7e4-8fb950346e86 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:55.764899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-41ef86bc-719b-48a7-91af-3d135cbdfc56 req-efee69cc-d643-4606-b7e4-8fb950346e86 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:55.766157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-41ef86bc-719b-48a7-91af-3d135cbdfc56 req-efee69cc-d643-4606-b7e4-8fb950346e86 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:55.803435 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-41ef86bc-719b-48a7-91af-3d135cbdfc56 req-efee69cc-d643-4606-b7e4-8fb950346e86 service nova] Creating event network-vif-plugged:b743cb6c-e9f1-439e-83ac-944b05a76129 for instance c547d73f-84e1-4055-b8a8-3b56bd9755d7 on n-h1-858383-16 Oct 27 09:10:55.812576 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-41ef86bc-719b-48a7-91af-3d135cbdfc56 req-efee69cc-d643-4606-b7e4-8fb950346e86 service nova] Creating event network-vif-plugged:0b4b967a-c461-4962-a258-a33bae542dc2 for instance 6bc68a20-e621-4812-8f20-a5ababf275c2 on n-h1-858383-16 Oct 27 09:10:55.824144 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-41ef86bc-719b-48a7-91af-3d135cbdfc56 req-efee69cc-d643-4606-b7e4-8fb950346e86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098055 Oct 27 09:10:55.826000 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1287/2571] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:55.835392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:55.836138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:55.846272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:55.847023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:55.848376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:55.849560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:55.850953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:55.855496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:56.335842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:56.348862 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ea91f6b-fdff-46c7-9dfd-b3d743c9a23d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 200 len: 1475 microversion: 2.1 time: 1.638981 Oct 27 09:10:56.353089 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1285/2572] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:54 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 1475 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:56.367973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:56.368905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:56.378230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:56.379600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:56.384642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:56.386006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:56.386679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:56.387307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:57.689742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:57.715367 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-28d0b304-2769-4dd9-9ade-e06a652c15d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1317 microversion: 2.1 time: 1.360850 Oct 27 09:10:57.718768 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1286/2573] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:56 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1317 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:57.729821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-747287d8-d2db-42e3-956c-266749d28874 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-307439518"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:57.740326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-747287d8-d2db-42e3-956c-266749d28874 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:57.750849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:57.761631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747287d8-d2db-42e3-956c-266749d28874 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:57.765328 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-322d7144-88d3-4f52-9b18-32a57ec22a22 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1806 microversion: 2.1 time: 1.937876 Oct 27 09:10:57.766051 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1288/2574] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:55 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1806 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:57.766183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747287d8-d2db-42e3-956c-266749d28874 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:57.766643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747287d8-d2db-42e3-956c-266749d28874 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:57.768577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747287d8-d2db-42e3-956c-266749d28874 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:57.769062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747287d8-d2db-42e3-956c-266749d28874 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:57.772187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747287d8-d2db-42e3-956c-266749d28874 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:57.774710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:57.780861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:57.827544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:57.830745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:57.836295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:57.841542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:57.843105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:57.845449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:58.005063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:58.041240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:58.052340 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-73f74cff-e2e5-46bb-b1b3-bff79fa0b2d2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1279 microversion: 2.1 time: 0.284579 Oct 27 09:10:58.063412 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1289/2575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:57 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1279 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:58.071506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ceb8f3dd-a395-4d79-8186-c71e50ff183a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:58.073994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ceb8f3dd-a395-4d79-8186-c71e50ff183a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:58.090818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ceb8f3dd-a395-4d79-8186-c71e50ff183a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:58.098382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ceb8f3dd-a395-4d79-8186-c71e50ff183a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:58.102254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ceb8f3dd-a395-4d79-8186-c71e50ff183a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:58.107204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ceb8f3dd-a395-4d79-8186-c71e50ff183a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:58.108300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ceb8f3dd-a395-4d79-8186-c71e50ff183a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:58.110216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ceb8f3dd-a395-4d79-8186-c71e50ff183a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:58.204308 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ceb8f3dd-a395-4d79-8186-c71e50ff183a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151/ips" status: 200 len: 220 microversion: 2.1 time: 0.136837 Oct 27 09:10:58.204997 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1290/2576] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:10:58 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151/ips => generated 220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:10:58.218872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:58.221807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:58.227558 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-747287d8-d2db-42e3-956c-266749d28874 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085/action" status: 202 len: 0 microversion: 2.1 time: 0.499034 Oct 27 09:10:58.229379 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1287/2577] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:10:57 2022] POST /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:10:58.243501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:58.245258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:58.247632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:58.248615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:58.248740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f32a2e57-08db-421b-b684-5936b6901d3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a993c310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:58.266631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:58.267368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:58.327088 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f32a2e57-08db-421b-b684-5936b6901d3d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.090283 Oct 27 09:10:58.332118 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1288/2578] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:10:58 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:58.341287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:10:58.439770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:10:58.582266 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dacb4cc6-7c85-4fbe-b156-e167bd08051b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 204 len: 0 microversion: 2.1 time: 0.369114 Oct 27 09:10:58.583663 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1291/2579] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:10:58 2022] DELETE /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:10:58.599092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:58.603505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:58.627037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:58.629645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:58.630792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:58.632990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:58.637422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:58.640233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:58.664036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e2a54e21-3bbc-4b95-9492-17de0148c47d req-1f65f1c9-8792-4f76-86f2-6c3fc61133a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc304a43-0894-406b-b290-4e5ae8490403", "tag": "734a98b2-787d-44dd-94a9-f9d1d3f2f96d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:10:58.732639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e2a54e21-3bbc-4b95-9492-17de0148c47d req-1f65f1c9-8792-4f76-86f2-6c3fc61133a2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:58.735894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e2a54e21-3bbc-4b95-9492-17de0148c47d req-1f65f1c9-8792-4f76-86f2-6c3fc61133a2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:58.736604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e2a54e21-3bbc-4b95-9492-17de0148c47d req-1f65f1c9-8792-4f76-86f2-6c3fc61133a2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:58.754756 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e2a54e21-3bbc-4b95-9492-17de0148c47d req-1f65f1c9-8792-4f76-86f2-6c3fc61133a2 service nova] Creating event network-changed:734a98b2-787d-44dd-94a9-f9d1d3f2f96d for instance dc304a43-0894-406b-b290-4e5ae8490403 on n-h2-858383-16 Oct 27 09:10:58.762697 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e2a54e21-3bbc-4b95-9492-17de0148c47d req-1f65f1c9-8792-4f76-86f2-6c3fc61133a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.381479 Oct 27 09:10:58.763327 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1289/2580] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:10:58.769116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:58.771062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:58.779905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:58.781231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:58.781911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:58.782941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:58.783663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:58.784435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:59.467028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:59.516989 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e14b28d-04a0-4f39-9e5b-3a6e37e38518 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1465 microversion: 2.1 time: 0.748928 Oct 27 09:10:59.520109 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1290/2581] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:58 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1465 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:59.532407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:59.533041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:59.548782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:10:59.553283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:59.554282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:59.554912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:59.555985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:59.556722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:59.557681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:59.559428 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9b908702-0963-47ba-a232-5a821c802a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1812 microversion: 2.1 time: 0.970241 Oct 27 09:10:59.572171 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1292/2582] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:58 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1812 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:10:59.581638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6069673c-d3e1-4912-90a2-04e57bdaafd3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa1af5e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:59.660559 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6069673c-d3e1-4912-90a2-04e57bdaafd3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.089848 Oct 27 09:10:59.664973 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1293/2583] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:10:59 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:10:59.673094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:10:59.674611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:10:59.687971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:59.688701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:59.689899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:10:59.690809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:10:59.693562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:10:59.696216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:00.796105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:00.806317 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-604aa041-160b-4021-b44b-488f783693f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 1.285051 Oct 27 09:11:00.825290 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1291/2584] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:59 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:00.843864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:00.843864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:00.850937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:00.852617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:00.855587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:00.858509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:00.859191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:00.861064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:00.940925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:00.979417 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5efe12b9-d1fc-4bd4-b6cb-470c542f30f9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 200 len: 1317 microversion: 2.1 time: 1.311524 Oct 27 09:11:00.986311 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1294/2585] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:10:59 2022] GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 1317 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:01.000545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2068b533-3b9b-44ec-9a35-2b8c857cdc98 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa16c4c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:01.085934 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2068b533-3b9b-44ec-9a35-2b8c857cdc98 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.092825 Oct 27 09:11:01.086937 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1295/2586] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:00 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:01.260576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e9355082-fe6f-43b3-8e28-e0f99c4d1247 req-730607ad-9d21-4178-b729-67683948c876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6994798f-1c49-459b-9269-75765b26f996", "tag": "f5977720-9e78-4f32-81e7-25bbadb0a479"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:01.287537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e9355082-fe6f-43b3-8e28-e0f99c4d1247 req-730607ad-9d21-4178-b729-67683948c876 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:01.288312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e9355082-fe6f-43b3-8e28-e0f99c4d1247 req-730607ad-9d21-4178-b729-67683948c876 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:01.294952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e9355082-fe6f-43b3-8e28-e0f99c4d1247 req-730607ad-9d21-4178-b729-67683948c876 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:01.327239 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e9355082-fe6f-43b3-8e28-e0f99c4d1247 req-730607ad-9d21-4178-b729-67683948c876 service nova] Creating event network-changed:f5977720-9e78-4f32-81e7-25bbadb0a479 for instance 6994798f-1c49-459b-9269-75765b26f996 on n-h2-858383-16 Oct 27 09:11:01.349518 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e9355082-fe6f-43b3-8e28-e0f99c4d1247 req-730607ad-9d21-4178-b729-67683948c876 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092724 Oct 27 09:11:01.362783 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1296/2587] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:11:01.367719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:01.378616 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf0313a2-7332-4631-81ca-aadd8893ceb6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1812 microversion: 2.1 time: 0.550414 Oct 27 09:11:01.396348 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1292/2588] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:00 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1812 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:01.831238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:01.833091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:01.855498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:01.857971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:01.860928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:01.862512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:01.870955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:01.872193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:02.115266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08228f6e-0f57-4fed-a25a-851d01ae175e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: .version_select at 0x7f31a99c9d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1363464215", "description": "tempest-description-1855226458"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:02.247111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:02.258384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=16 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:02.270129 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f31eef4-a3fa-4de1-a701-fa664d2f00ea tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.443370 Oct 27 09:11:02.277265 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1297/2589] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:01 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:02.302118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:02.306281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:02.322292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:02.322989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:02.324559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:02.327273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:02.330780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:02.331495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:02.341555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:02.643885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08228f6e-0f57-4fed-a25a-851d01ae175e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.676883 Oct 27 09:11:02.645187 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1293/2590] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:11:01 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:02.656720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4cb270ea-cd7d-40ea-a5be-65c7c41b635f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a98dc310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:02.740309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:02.754510 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-22ac54bc-71ed-42e4-9ffd-dfd7ce988a26 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 200 len: 1466 microversion: 2.1 time: 0.473527 Oct 27 09:11:02.757923 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4cb270ea-cd7d-40ea-a5be-65c7c41b635f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.106296 Oct 27 09:11:02.761767 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1294/2591] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:02 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:02.772178 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1298/2592] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:02 2022] GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 1466 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:02.774479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:02.775301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:02.780608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-577e9dc1-ae0f-4f30-af86-301f57aa38f6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: .version_select at 0x7f31aa29dca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-256903937", "description": "tempest-description-703028274"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:02.788988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:02.789510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:02.789969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:02.790716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:02.791192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:02.791679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:03.078685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:03.089856 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9bb1298a-cf6f-45c3-9a0b-a059c7f6edca tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1791 microversion: 2.1 time: 0.326632 Oct 27 09:11:03.109448 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1295/2593] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:02 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1791 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:03.127460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:03.134784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:03.139011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Searching by: {'reservation_id': 'r-2zl59r6n', 'deleted': False, 'project_id': '5f5752431c874be58372449a6b71853c'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:03.148271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:03.148938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:03.149817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:03.150766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:03.151388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:03.152013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:03.386469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:03.406366 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-577e9dc1-ae0f-4f30-af86-301f57aa38f6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.632705 Oct 27 09:11:03.406972 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1299/2594] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:11:02 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:03.409074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:03.413870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:03.414700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:03.460030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:03.460900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:03.461844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:03.466488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:03.467418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:03.473387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:03.618593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:03.634743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:03.635235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:03.635697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:03.730770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:03.751873 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d2cd208f-fb3d-4ae6-b017-3fa5627296df tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.343313 Oct 27 09:11:03.752766 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1300/2595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:03 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:03.763229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1790982932", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7be7c07a-f27c-47fe-ada6-01c34a9cf95a"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:03.850991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] validate_networks() for [('7be7c07a-f27c-47fe-ada6-01c34a9cf95a', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:11:03.904425 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94f712fc-a5d9-45ce-8c26-0b8cde71a390 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-2zl59r6n" status: 200 len: 2924 microversion: 2.1 time: 0.793406 Oct 27 09:11:03.905970 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1296/2596] 10.222.0.25 () {58 vars in 1197 bytes} [Thu Oct 27 09:11:03 2022] GET /compute/v2.1/servers/detail?reservation_id=r-2zl59r6n => generated 2924 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:03.914620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-053515d8-e22b-41bb-8482-55beda155ba1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a98e3e50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:04.016757 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-053515d8-e22b-41bb-8482-55beda155ba1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.109389 Oct 27 09:11:04.018081 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1297/2597] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:03 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:04.025971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9ff3bac-ce3d-416d-9c17-19f2aa68f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:04.105881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.server_groups [None req-a9ff3bac-ce3d-416d-9c17-19f2aa68f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Querying cell ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) for 2 instances {{(pid=120603) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 09:11:04.111189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9ff3bac-ce3d-416d-9c17-19f2aa68f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:04.112908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9ff3bac-ce3d-416d-9c17-19f2aa68f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:04.115012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9ff3bac-ce3d-416d-9c17-19f2aa68f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:04.195296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:04.221217 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9ff3bac-ce3d-416d-9c17-19f2aa68f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/2973b32d-aea0-4a97-8885-edd63a9034aa" status: 200 len: 265 microversion: 2.1 time: 0.201691 Oct 27 09:11:04.229484 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1298/2598] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:11:04 2022] GET /compute/v2.1/os-server-groups/2973b32d-aea0-4a97-8885-edd63a9034aa => generated 265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:04.246129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9cfe0158-b763-4378-b59c-6f9d9778798d req-b560284f-125b-42c9-8a14-d7de7e18bf10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "name": "network-vif-deleted", "tag": "751baeac-af6f-48a5-aae6-54816b9b6009"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:04.289060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9cfe0158-b763-4378-b59c-6f9d9778798d req-b560284f-125b-42c9-8a14-d7de7e18bf10 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:04.298245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9cfe0158-b763-4378-b59c-6f9d9778798d req-b560284f-125b-42c9-8a14-d7de7e18bf10 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:04.298977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9cfe0158-b763-4378-b59c-6f9d9778798d req-b560284f-125b-42c9-8a14-d7de7e18bf10 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:04.345247 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9cfe0158-b763-4378-b59c-6f9d9778798d req-b560284f-125b-42c9-8a14-d7de7e18bf10 service nova] Creating event network-vif-deleted:751baeac-af6f-48a5-aae6-54816b9b6009 for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:11:04.360634 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9cfe0158-b763-4378-b59c-6f9d9778798d req-b560284f-125b-42c9-8a14-d7de7e18bf10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120509 Oct 27 09:11:04.362277 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1299/2599] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:04.385927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:04.390053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:04.406501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:04.406501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:04.407237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:04.408244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:04.408943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:04.414663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:05.055192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:05.068597 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-84e88572-789a-418a-b89a-df418498f395 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1676 microversion: 2.1 time: 0.704098 Oct 27 09:11:05.086088 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1300/2600] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:04 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1676 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:05.096588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-756adc5e-5249-4229-8011-400f0c6d9aeb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:05.097201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-756adc5e-5249-4229-8011-400f0c6d9aeb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:05.113990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-756adc5e-5249-4229-8011-400f0c6d9aeb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:05.114973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-756adc5e-5249-4229-8011-400f0c6d9aeb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:05.115590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-756adc5e-5249-4229-8011-400f0c6d9aeb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:05.122879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-756adc5e-5249-4229-8011-400f0c6d9aeb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:05.123664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-756adc5e-5249-4229-8011-400f0c6d9aeb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:05.124259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-756adc5e-5249-4229-8011-400f0c6d9aeb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:05.523581 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-756adc5e-5249-4229-8011-400f0c6d9aeb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 200 len: 1618 microversion: 2.1 time: 0.435930 Oct 27 09:11:05.527340 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1301/2601] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:05 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 1618 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:05.535152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:05.565852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:05.597823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:05.598336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:05.600628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:05.601485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:05.601970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:05.602412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:05.611144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:11:05.611647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:11:05.612285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:11:05.612705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:11:05.613778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:11:05.645010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:05.645520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:05.645967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:05.647053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:05.647554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:05.648015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:05.707379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Getting quotas for project 058070ef4084432b9a1dc94df7f7b17c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:05.719520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Getting quotas for user 8141cfe0a1b448ba9812a8ebe6e3d714 and project 058070ef4084432b9a1dc94df7f7b17c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:05.755557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:11:05.766489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:11:05.915355 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0651c34-67ee-466e-b300-11718193c49b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.161114 Oct 27 09:11:05.930356 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1301/2602] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:11:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:11:05.941025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ac960f30-dcc8-4454-a7c4-b29f636cfb9c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa16c9d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:06.084040 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ac960f30-dcc8-4454-a7c4-b29f636cfb9c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.152405 Oct 27 09:11:06.085395 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1302/2603] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:05 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:06.098108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a49c3e11-89c1-4ded-b77c-2595b6795e15 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:06.101247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a49c3e11-89c1-4ded-b77c-2595b6795e15 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:06.115903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a49c3e11-89c1-4ded-b77c-2595b6795e15 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:06.117393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a49c3e11-89c1-4ded-b77c-2595b6795e15 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:06.119941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a49c3e11-89c1-4ded-b77c-2595b6795e15 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:06.123244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a49c3e11-89c1-4ded-b77c-2595b6795e15 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:06.126825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a49c3e11-89c1-4ded-b77c-2595b6795e15 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:06.130157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a49c3e11-89c1-4ded-b77c-2595b6795e15 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:06.995658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:07.017824 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb01a92d-7516-4563-b094-240e87e89dec tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 1.488771 Oct 27 09:11:07.035347 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1302/2604] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:05 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:07.036602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:07.038621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:07.081054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:07.081598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:07.082100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:07.087274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:07.087807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:07.090947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:07.127050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a49c3e11-89c1-4ded-b77c-2595b6795e15 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 200 len: 1619 microversion: 2.1 time: 1.039082 Oct 27 09:11:07.130087 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1303/2605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:06 2022] GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 1619 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:07.135915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:07.136540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:07.146926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:07.147433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:07.148094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:07.149000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:07.149626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:07.150222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:07.423619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:07.441975 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a7721fa-3c36-45bb-bbd8-b495463a384a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1220 microversion: 2.1 time: 0.417712 Oct 27 09:11:07.442635 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1303/2606] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:07 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1220 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:07.466735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-19238d60-8308-430f-b0a1-87234bd75690 req-0721ba11-cea5-40b1-8e17-0e165c12d014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f81ce93-3183-4d2c-8e4b-4cda961a4a03", "tag": "49f4c3ce-92d8-4dea-9672-c5c20bfd309a"}, {"server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "name": "network-vif-deleted", "tag": "7b3eba6a-9a1e-4e9b-a5cd-443b479f34bb"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:07.498842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-19238d60-8308-430f-b0a1-87234bd75690 req-0721ba11-cea5-40b1-8e17-0e165c12d014 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:07.499359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-19238d60-8308-430f-b0a1-87234bd75690 req-0721ba11-cea5-40b1-8e17-0e165c12d014 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:07.499720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-19238d60-8308-430f-b0a1-87234bd75690 req-0721ba11-cea5-40b1-8e17-0e165c12d014 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:07.555740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-19238d60-8308-430f-b0a1-87234bd75690 req-0721ba11-cea5-40b1-8e17-0e165c12d014 service nova] Creating event network-changed:49f4c3ce-92d8-4dea-9672-c5c20bfd309a for instance 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 on n-h2-858383-16 Oct 27 09:11:07.559236 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-19238d60-8308-430f-b0a1-87234bd75690 req-0721ba11-cea5-40b1-8e17-0e165c12d014 service nova] Creating event network-vif-deleted:7b3eba6a-9a1e-4e9b-a5cd-443b479f34bb for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:11:07.599925 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-19238d60-8308-430f-b0a1-87234bd75690 req-0721ba11-cea5-40b1-8e17-0e165c12d014 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.149698 Oct 27 09:11:07.602237 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1304/2607] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:07.635078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-15d13744-3d14-49b4-8109-856cdc1ae100 req-48ae4d1c-eb70-4d29-9c4e-68375558e7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "name": "network-vif-unplugged", "status": "completed", "tag": "32c369ba-a8d2-4bfb-b533-e951495c2c51"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:07.669040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-15d13744-3d14-49b4-8109-856cdc1ae100 req-48ae4d1c-eb70-4d29-9c4e-68375558e7d6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:07.672380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-15d13744-3d14-49b4-8109-856cdc1ae100 req-48ae4d1c-eb70-4d29-9c4e-68375558e7d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:07.674261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-15d13744-3d14-49b4-8109-856cdc1ae100 req-48ae4d1c-eb70-4d29-9c4e-68375558e7d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:07.709840 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-15d13744-3d14-49b4-8109-856cdc1ae100 req-48ae4d1c-eb70-4d29-9c4e-68375558e7d6 service nova] Creating event network-vif-unplugged:32c369ba-a8d2-4bfb-b533-e951495c2c51 for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:11:07.722486 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-15d13744-3d14-49b4-8109-856cdc1ae100 req-48ae4d1c-eb70-4d29-9c4e-68375558e7d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105827 Oct 27 09:11:07.725978 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1305/2608] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:07.746531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-676c4f85-ac96-4127-89ca-8408ed41420f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a97c8ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:07.841106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:07.859469 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bdc77c35-b79c-4d3a-9d5d-f9535394bdbb tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1655 microversion: 2.1 time: 0.725469 Oct 27 09:11:07.860692 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1304/2609] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:07 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1655 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:07.875886 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-676c4f85-ac96-4127-89ca-8408ed41420f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.136244 Oct 27 09:11:07.883255 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1306/2610] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:07 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:07.886351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-adc8d0e7-6ed2-4b86-8417-7c9bef60d893 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Action: 'create', calling method: .version_select at 0x7f31aa60e550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1772443790", "policies": ["anti-affinity"]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:07.945779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-adc8d0e7-6ed2-4b86-8417-7c9bef60d893 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:07.955215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-adc8d0e7-6ed2-4b86-8417-7c9bef60d893 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:08.046754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:08.047515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:08.070806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:08.072709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:08.075494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:08.077781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:08.079589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:08.081592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:08.109972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-adc8d0e7-6ed2-4b86-8417-7c9bef60d893 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:08.128432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-adc8d0e7-6ed2-4b86-8417-7c9bef60d893 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:08.154476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:08.186202 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-adc8d0e7-6ed2-4b86-8417-7c9bef60d893 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.320415 Oct 27 09:11:08.187504 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1305/2611] 10.222.0.25 () {60 vars in 1174 bytes} [Thu Oct 27 09:11:07 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:08.437167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:08.451014 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2143665b-6c05-4bcc-9a2f-627bfc7b0b93 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.412339 Oct 27 09:11:08.477311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-950100247", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "37b68f63-d250-48d7-a615-354fb9948090"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:08.481663 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1307/2612] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:08 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:08.498893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:08.506549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:08.529612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:08.530384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:08.531002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:08.535980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:08.536652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:08.537647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:08.599091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:11:08.763414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:08.774562 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf1284a3-9ef8-4073-8861-911c05a3976c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1274 microversion: 2.1 time: 0.290375 Oct 27 09:11:08.779908 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1308/2613] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:08 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1274 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:08.884323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:08.885100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:08.896036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:08.896714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:08.900693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:08.901564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:08.902153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:08.902690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:09.060457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:09.070848 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a17e5254-1073-4ae8-a888-976e1901c3c0 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1454 microversion: 2.1 time: 0.191089 Oct 27 09:11:09.077617 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1309/2614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:08 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1454 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:11:09.092085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a37fbda9-91ff-4d5a-b686-bcad473861c1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9981c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:09.098051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:11:09.098757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:11:09.099395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:11:09.099999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:11:09.100581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:11:09.121068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:09.124122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:09.125385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:09.129250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:09.131143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:09.132423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:09.167741 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a37fbda9-91ff-4d5a-b686-bcad473861c1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.088057 Oct 27 09:11:09.168802 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1310/2615] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:09 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:09.180651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:09.193469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:09.231256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Going to run 2 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:11:09.233639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:11:09.353412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:09.371924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:09.478214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:09.478833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:09.491335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:09.491863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:09.494554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:09.496995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:09.497910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:09.498394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:09.498835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:09.523093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:09.573685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=f3b2fef2-ebb0-4f59-b152-dff17798962c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:11:09.675105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:09.684472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:09.778614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:09.794897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'server_group_members'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:09.867627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:09.882420 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04e65397-6326-4f12-9af9-147c5537a56f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.402106 Oct 27 09:11:09.883005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1311/2616] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:09 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:11:09.902804 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d80c71fe-8a24-450d-bf38-69a6e576f6b8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.427294 Oct 27 09:11:09.902804 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1306/2617] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:11:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 1430 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 09:11:09.903107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:09.903107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:09.903292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d48daa26-e7d6-4a6a-b9bc-b5fadd183a1c req-126ed7a8-9981-4c3b-8b9f-90f6f84954e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124f1dc6-5682-4ada-8748-4d9c89d58151", "name": "network-vif-deleted", "tag": "32c369ba-a8d2-4bfb-b533-e951495c2c51"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:09.913207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:09.913720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:09.919977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:09.920894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:09.921389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:09.922212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:09.924953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d48daa26-e7d6-4a6a-b9bc-b5fadd183a1c req-126ed7a8-9981-4c3b-8b9f-90f6f84954e8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:09.926387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d48daa26-e7d6-4a6a-b9bc-b5fadd183a1c req-126ed7a8-9981-4c3b-8b9f-90f6f84954e8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:09.927975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d48daa26-e7d6-4a6a-b9bc-b5fadd183a1c req-126ed7a8-9981-4c3b-8b9f-90f6f84954e8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:09.958090 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d48daa26-e7d6-4a6a-b9bc-b5fadd183a1c req-126ed7a8-9981-4c3b-8b9f-90f6f84954e8 service nova] Creating event network-vif-deleted:32c369ba-a8d2-4bfb-b533-e951495c2c51 for instance 124f1dc6-5682-4ada-8748-4d9c89d58151 on n-h1-858383-16 Oct 27 09:11:09.980757 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d48daa26-e7d6-4a6a-b9bc-b5fadd183a1c req-126ed7a8-9981-4c3b-8b9f-90f6f84954e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083034 Oct 27 09:11:09.983153 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1307/2618] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:09.993830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:09.999855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:10.007104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Searching by: {'deleted': False, 'project_id': '5f5752431c874be58372449a6b71853c'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:10.072010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:10.073725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:10.074572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:10.075330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:10.076405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:10.077014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:10.077613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:10.082005 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c92c20ea-28cb-49b4-9f27-429570cb60f8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1274 microversion: 2.1 time: 0.197877 Oct 27 09:11:10.082602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1312/2619] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:09 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:10.109888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:10.111375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:10.112134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:10.136485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:10.136992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:10.137445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:10.138163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:10.138612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:10.139044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:10.193695 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa5524ea-5721-43b1-8b9e-6f5a7c4d0e0d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1659 microversion: 2.1 time: 0.208161 Oct 27 09:11:10.196327 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1308/2620] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:11:09 2022] GET /compute/v2.1/servers => generated 1659 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:10.202985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ecda3e26-03f8-435b-a4a1-48c860e25150 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa60e550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:10.286409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:10.288819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:10.291515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:10.292155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lazy-loading 'fault' on Instance uuid 124f1dc6-5682-4ada-8748-4d9c89d58151 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:11:10.310499 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ecda3e26-03f8-435b-a4a1-48c860e25150 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.112841 Oct 27 09:11:10.311058 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1309/2621] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:10 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:10.327245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-63646341-0bb9-4af7-9dbc-721d8e7a6f7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:10.335554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-63646341-0bb9-4af7-9dbc-721d8e7a6f7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:10.397247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:10.406577 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0327f465-733a-4bf7-9017-4a927e6728c9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 200 len: 1302 microversion: 2.1 time: 0.307417 Oct 27 09:11:10.408181 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1313/2622] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:10 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 1302 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:10.515691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-63646341-0bb9-4af7-9dbc-721d8e7a6f7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:10.532363 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-63646341-0bb9-4af7-9dbc-721d8e7a6f7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1218 microversion: 2.1 time: 0.211635 Oct 27 09:11:10.532968 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1310/2623] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:10 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1218 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:10.669429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-71891528-5ba1-4ec7-92e1-2ff3ccbcca6b req-1a0f4566-9596-4714-9a8c-ef8a309c63b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc682645-328d-418c-aeda-55b06824b085", "name": "network-vif-plugged", "status": "completed", "tag": "f7f4087c-e3d8-446a-8011-57745cdec512"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:10.680773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-71891528-5ba1-4ec7-92e1-2ff3ccbcca6b req-1a0f4566-9596-4714-9a8c-ef8a309c63b3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:10.681521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-71891528-5ba1-4ec7-92e1-2ff3ccbcca6b req-1a0f4566-9596-4714-9a8c-ef8a309c63b3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:10.682393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-71891528-5ba1-4ec7-92e1-2ff3ccbcca6b req-1a0f4566-9596-4714-9a8c-ef8a309c63b3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:10.704914 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-71891528-5ba1-4ec7-92e1-2ff3ccbcca6b req-1a0f4566-9596-4714-9a8c-ef8a309c63b3 service nova] Creating event network-vif-plugged:f7f4087c-e3d8-446a-8011-57745cdec512 for instance dc682645-328d-418c-aeda-55b06824b085 on n-h2-858383-16 Oct 27 09:11:10.728012 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-71891528-5ba1-4ec7-92e1-2ff3ccbcca6b req-1a0f4566-9596-4714-9a8c-ef8a309c63b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059610 Oct 27 09:11:10.733543 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1314/2624] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:10.928782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:10.929611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:10.975428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:10.988093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:10.988572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:10.989331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:11.002409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:11.006277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:11.111040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:11.112687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:11.130635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:11.132023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:11.132766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:11.133757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:11.134514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:11.136172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:11.368859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:11.388041 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73a05115-18f3-46f7-930f-b12e72c0ab9f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1274 microversion: 2.1 time: 0.274903 Oct 27 09:11:11.389269 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1315/2625] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:11 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1274 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:11.412752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8c94e2d-9004-4dea-b55b-8742ffccddbb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a994ed30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:11.508602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:11.526822 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f94c88e1-97c3-46d0-a52d-6f4d439428e1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.621029 Oct 27 09:11:11.532232 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1311/2626] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:10 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:11.546126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:11.548005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:11.567388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:11.567916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:11.568356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:11.575186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:11.576025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:11.576728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:11.624512 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] HTTP exception thrown: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Request method failure captured: Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 HTTP/1.1 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrgQo3azoqDUvI3cHBO3JP0ThGruhjURF-JSJPs2X781_uaysHzfY3hH83K11G-_4vWTrnf7nyl0SRpw3go6L3HPPps39-TdpgN1QNusX-6LEJk7o-aRVjE129ytJaxqmRRoecTpQcb61bMVRxneKZBArGdVOOFeRfEHNIarh3GeyA Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/58dde0075cf74c558c4b6462803c15e2"}]}] Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestMultiNic-1352912992 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: a3b198587da845bf9237a28f784ae448 Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '124f1dc6-5682-4ada-8748-4d9c89d58151'} Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:11:11.627553 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:11.633073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:11:11.633073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:11:11.633073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:11:11.633073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:11:11.633073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:11:11.633073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:11:11.633073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:11.633599 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8c94e2d-9004-4dea-b55b-8742ffccddbb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.236684 Oct 27 09:11:11.634726 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1316/2627] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:11 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:11.638047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Returning 404 to user: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:11:11.641321 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b10ac3a-5043-4887-8873-3a94dff82c3c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 404 len: 111 microversion: 2.1 time: 0.107775 Oct 27 09:11:11.644785 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1312/2628] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:11 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:11:11.653489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-439e4474-d93c-4da6-a349-c1df3295c53d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:11.654652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-439e4474-d93c-4da6-a349-c1df3295c53d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:12.012478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-439e4474-d93c-4da6-a349-c1df3295c53d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:12.021891 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-439e4474-d93c-4da6-a349-c1df3295c53d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1218 microversion: 2.1 time: 0.382879 Oct 27 09:11:12.022800 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1317/2629] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:11 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1218 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:12.416397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:12.419444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:12.489067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:12.491414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:12.492413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:12.495761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:12.496567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:12.498470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:12.556122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:12.556922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:12.597064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:12.609151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:12.611507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:12.616597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:12.642454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:12.643423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:13.021440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:13.031054 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6bcb380a-05e1-4a1c-9362-f0f42ca7d1fb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.622549 Oct 27 09:11:13.032347 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1313/2630] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:12 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:13.037878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3aa1ac9c-7a55-4d7d-8db7-920a46ea38d0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa40d820>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:13.093035 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3aa1ac9c-7a55-4d7d-8db7-920a46ea38d0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.059055 Oct 27 09:11:13.094154 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1314/2631] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:13 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:13.109109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fdb98265-78a2-48ad-af66-b8954f42742e req-cce39f79-b3f0-47ae-8c58-eaa524937732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc304a43-0894-406b-b290-4e5ae8490403", "name": "network-vif-plugged", "status": "completed", "tag": "734a98b2-787d-44dd-94a9-f9d1d3f2f96d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:13.123460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fdb98265-78a2-48ad-af66-b8954f42742e req-cce39f79-b3f0-47ae-8c58-eaa524937732 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:13.124377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fdb98265-78a2-48ad-af66-b8954f42742e req-cce39f79-b3f0-47ae-8c58-eaa524937732 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:13.125036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fdb98265-78a2-48ad-af66-b8954f42742e req-cce39f79-b3f0-47ae-8c58-eaa524937732 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:13.142818 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fdb98265-78a2-48ad-af66-b8954f42742e req-cce39f79-b3f0-47ae-8c58-eaa524937732 service nova] Creating event network-vif-plugged:734a98b2-787d-44dd-94a9-f9d1d3f2f96d for instance dc304a43-0894-406b-b290-4e5ae8490403 on n-h2-858383-16 Oct 27 09:11:13.151524 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fdb98265-78a2-48ad-af66-b8954f42742e req-cce39f79-b3f0-47ae-8c58-eaa524937732 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046204 Oct 27 09:11:13.152975 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1315/2632] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:13.159772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:13.160716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:13.169893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:13.170588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:13.171204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:13.172196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:13.172809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:13.173396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:13.226533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:13.430467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:13.449863 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-73131465-960c-494a-b28c-4e79d1584617 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1222 microversion: 2.1 time: 0.292507 Oct 27 09:11:13.450598 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1316/2633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:13 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1222 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:13.470120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:13.505715 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa7d2bcc-d117-4707-8ce4-6fa3fdd0260a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.953235 Oct 27 09:11:13.508446 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1318/2634] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:12 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:14.056342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:14.056965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:14.070676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:14.079251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:14.082161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:14.083146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:14.083818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:14.085882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:14.111901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e14beba-7e44-4932-a341-90280baefe09 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a98e3af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:14.667508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:14.755892 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80ce0917-3417-4114-a132-26065a86752c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.702821 Oct 27 09:11:14.762102 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1317/2635] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:14 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:14.804904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:14.806785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:14.841625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:14.843749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:14.846811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:14.849177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:14.850253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:14.851285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:15.038761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:15.054766 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-09c90e71-627c-4fcc-9ea2-63a71fb46424 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1270 microversion: 2.1 time: 0.287704 Oct 27 09:11:15.081527 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1318/2636] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:14 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1270 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:15.101522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:15.102154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:15.130023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:15.130600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:15.131058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:15.138074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:15.140970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:15.142870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:15.217970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:15.639460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:15.661419 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-624c79ae-4a41-487f-83c7-537b3d64da42 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.567875 Oct 27 09:11:15.663316 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1319/2637] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:15 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:15.788623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:15.789316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:15.817988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:15.819608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:15.822919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:15.827371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:15.829928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:15.833611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:16.270850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:16.289806 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4e9d7bd0-0aed-46eb-b052-cbbe61f1b3fc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.506073 Oct 27 09:11:16.292837 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1320/2638] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:15 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:11:16.314583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:16.318621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:16.324576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:16.345631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:16.349465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:16.349999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:16.356463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:16.357152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:16.357703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:16.675224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:16.695150 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb8abfcb-e986-4adf-8d48-fa21b7bd8673 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1278 microversion: 2.1 time: 0.392435 Oct 27 09:11:16.695884 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1321/2639] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:16 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1278 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:16.717469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:16.719184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:16.762688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:16.763255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:16.769727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:16.771806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:16.771806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:16.775192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:17.541775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:17.556478 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f6c4a58-5c45-426a-b077-c083c6d8e5f7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.856355 Oct 27 09:11:17.560140 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1322/2640] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:16 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:17.571451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:17.576728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:17.597965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:17.603179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:17.605896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:17.608092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:17.610669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:17.613493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:18.135161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:18.151096 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-529d2333-4751-4e50-b823-67d00904b9f7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.589442 Oct 27 09:11:18.154548 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1323/2641] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:17 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:18.170018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:18.173519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:18.191427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:18.193980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:18.195031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:18.197577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:18.199266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:18.204166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:18.414029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:18.425630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6db1e748-5fa8-40f1-9977-bba2d8c6c5b5 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1276 microversion: 2.1 time: 0.269595 Oct 27 09:11:18.442350 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1324/2642] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:18 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:18.444023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-471c4b70-9bce-4e6b-a650-e9ead77b2c21 req-dffd0899-75b2-44f3-8714-a4ccd56260d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce459b57-8b9a-4330-a120-05d42e42f1a2", "tag": "88847dbe-75b3-4862-8555-18e520709e8e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:18.475529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-471c4b70-9bce-4e6b-a650-e9ead77b2c21 req-dffd0899-75b2-44f3-8714-a4ccd56260d7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:18.476213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-471c4b70-9bce-4e6b-a650-e9ead77b2c21 req-dffd0899-75b2-44f3-8714-a4ccd56260d7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:18.476750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-471c4b70-9bce-4e6b-a650-e9ead77b2c21 req-dffd0899-75b2-44f3-8714-a4ccd56260d7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:18.514560 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-471c4b70-9bce-4e6b-a650-e9ead77b2c21 req-dffd0899-75b2-44f3-8714-a4ccd56260d7 service nova] Creating event network-changed:88847dbe-75b3-4862-8555-18e520709e8e for instance ce459b57-8b9a-4330-a120-05d42e42f1a2 on n-h1-858383-16 Oct 27 09:11:18.529983 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-471c4b70-9bce-4e6b-a650-e9ead77b2c21 req-dffd0899-75b2-44f3-8714-a4ccd56260d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092020 Oct 27 09:11:18.530944 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1325/2643] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:18.587858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:18.588532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:18.603158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:18.607861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:18.608440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:18.609216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:18.609732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:18.613169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:19.277633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:19.290945 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5fddb0e6-585b-4290-a5d5-351eec3b052e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.707559 Oct 27 09:11:19.297142 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1326/2644] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:18 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:11:19.305555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:19.312844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:19.328274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:19.329299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:19.329989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:19.348855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:19.350311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:19.350934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:19.602721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:19.613986 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf060296-ed60-4ded-a5fb-f39e7ce10fd6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.314548 Oct 27 09:11:19.614569 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1327/2645] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:19 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:19.631748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:19.634531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:19.657815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:19.660699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:19.661175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:19.664539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:19.665107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:19.666842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:20.091227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:20.521354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=38 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:20.570167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:20.588091 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d96a52f9-2274-4895-96b5-ad96bc984b1b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.962717 Oct 27 09:11:20.589067 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1328/2646] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:19 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:20.611760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:20.618212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:20.642504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:20.643620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:20.646832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:20.647826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:20.648715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:20.649277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:21.058914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:21.069710 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-42077d6e-175c-4d9b-9aa0-bfc1bf3f0a4c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.479140 Oct 27 09:11:21.070959 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1329/2647] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:20 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:21.076783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:21.077744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:21.084601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:21.085472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:21.086171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:21.092117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:21.093058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:21.094086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:21.391863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:21.402589 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18c6ab5f-d66f-4356-9af4-da27ee5f7c91 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.330192 Oct 27 09:11:21.404433 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1330/2648] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:21 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:21.618075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:21.619897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:21.634900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:21.635849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:21.638059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:21.639118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:21.641082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:21.643088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:21.975006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:21.986420 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fad687bc-4c46-4438-b873-551c5615854e tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.372333 Oct 27 09:11:22.003462 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1331/2649] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:21 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:22.018320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:22.098560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:22.099838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:22.107605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:22.108640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:22.109336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:22.110373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:22.111078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:22.111796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:22.576003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:22.577134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=66 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:22.588241 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-09571649-cceb-4bd8-81a5-cf7d15fd15d7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.493528 Oct 27 09:11:22.589215 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1332/2650] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:22 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:22.595019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f934737b-e71a-421d-a39f-39fb7dac8708 req-e7641213-1f79-4f05-a202-ca6e160dfaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6994798f-1c49-459b-9269-75765b26f996", "name": "network-vif-plugged", "status": "completed", "tag": "f5977720-9e78-4f32-81e7-25bbadb0a479"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:22.609776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f934737b-e71a-421d-a39f-39fb7dac8708 req-e7641213-1f79-4f05-a202-ca6e160dfaf1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:22.610476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f934737b-e71a-421d-a39f-39fb7dac8708 req-e7641213-1f79-4f05-a202-ca6e160dfaf1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:22.611493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f934737b-e71a-421d-a39f-39fb7dac8708 req-e7641213-1f79-4f05-a202-ca6e160dfaf1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:22.627883 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f934737b-e71a-421d-a39f-39fb7dac8708 req-e7641213-1f79-4f05-a202-ca6e160dfaf1 service nova] Creating event network-vif-plugged:f5977720-9e78-4f32-81e7-25bbadb0a479 for instance 6994798f-1c49-459b-9269-75765b26f996 on n-h2-858383-16 Oct 27 09:11:22.634451 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f934737b-e71a-421d-a39f-39fb7dac8708 req-e7641213-1f79-4f05-a202-ca6e160dfaf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043395 Oct 27 09:11:22.635406 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1333/2651] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:22.641410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:22.642130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:22.655073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:22.655462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:22.655951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:22.659533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:22.662473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:22.663612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:22.986586 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e14beba-7e44-4932-a341-90280baefe09 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 8.879989 Oct 27 09:11:22.989418 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1319/2652] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:14 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 8883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:23.002089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0761e91f-4e88-4773-8bd9-db995eeea80c req-bb9ce834-5473-4353-ae94-4029f7f8b812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4a6784-df8b-47f7-9132-8ad0ab14cb59", "tag": "d7cdd3a8-c93c-43ad-ae1d-1de5d0a79f22"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:23.015069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0761e91f-4e88-4773-8bd9-db995eeea80c req-bb9ce834-5473-4353-ae94-4029f7f8b812 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:23.015941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0761e91f-4e88-4773-8bd9-db995eeea80c req-bb9ce834-5473-4353-ae94-4029f7f8b812 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:23.016664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0761e91f-4e88-4773-8bd9-db995eeea80c req-bb9ce834-5473-4353-ae94-4029f7f8b812 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:23.032981 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0761e91f-4e88-4773-8bd9-db995eeea80c req-bb9ce834-5473-4353-ae94-4029f7f8b812 service nova] Creating event network-changed:d7cdd3a8-c93c-43ad-ae1d-1de5d0a79f22 for instance da4a6784-df8b-47f7-9132-8ad0ab14cb59 on n-h2-858383-16 Oct 27 09:11:23.039487 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0761e91f-4e88-4773-8bd9-db995eeea80c req-bb9ce834-5473-4353-ae94-4029f7f8b812 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043827 Oct 27 09:11:23.041021 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1320/2653] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:23.046644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:23.047695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:23.055389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:23.056411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:23.057119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:23.058333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:23.059029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:23.059691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:23.100609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:23.117015 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-461206a0-c3a1-45d0-889c-efecc531c8fa tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.479367 Oct 27 09:11:23.135690 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1334/2654] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:22 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:23.460444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:23.469571 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9867999-72f0-42b8-87ba-49b4becaa819 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.426971 Oct 27 09:11:23.473882 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1321/2655] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:23 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:23.617632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:23.618434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:23.633886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:23.634405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:23.634857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:23.635597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:23.636065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:23.641219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:23.849247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b3e9efa-8535-49cb-ad42-4183e2d12a17 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:23.849908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b3e9efa-8535-49cb-ad42-4183e2d12a17 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:23.867336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b3e9efa-8535-49cb-ad42-4183e2d12a17 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:23.868224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b3e9efa-8535-49cb-ad42-4183e2d12a17 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:23.869296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b3e9efa-8535-49cb-ad42-4183e2d12a17 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:23.870244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b3e9efa-8535-49cb-ad42-4183e2d12a17 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:23.871064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b3e9efa-8535-49cb-ad42-4183e2d12a17 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:23.871744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b3e9efa-8535-49cb-ad42-4183e2d12a17 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:23.952288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b3e9efa-8535-49cb-ad42-4183e2d12a17 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments/6afe5ede-e465-47b2-908c-54e89ca5b11a" status: 200 len: 194 microversion: 2.20 time: 0.528543 Oct 27 09:11:23.963766 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1335/2656] 10.222.0.25 () {60 vars in 1454 bytes} [Thu Oct 27 09:11:23 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments/6afe5ede-e465-47b2-908c-54e89ca5b11a => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:11:24.006325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a16cd0ba-edb8-4693-9dca-b5a6828617b3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa40d820>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:24.008482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:24.022171 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4997d49-631a-4988-9f68-1cbbf26bf3cd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.409887 Oct 27 09:11:24.023512 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1322/2657] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:23 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:24.063124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:24.063770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:24.075382 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a16cd0ba-edb8-4693-9dca-b5a6828617b3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.074112 Oct 27 09:11:24.075996 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1336/2658] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:24 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:24.085457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.086221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.086841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.087862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.089076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.097798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.129756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:24.146737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:24.148240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:24.161869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.168375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.169171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.174996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.178679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.179895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.353882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lazy-loading 'services' on Instance uuid 3d248926-b23e-472b-9a1e-4b10c924758a {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:11:24.513065 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc9b39f6-4c2d-4c50-9d14-19ddd75c27cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments/6afe5ede-e465-47b2-908c-54e89ca5b11a" status: 202 len: 0 microversion: 2.20 time: 0.451077 Oct 27 09:11:24.513644 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1323/2659] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Oct 27 09:11:24 2022] DELETE /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments/6afe5ede-e465-47b2-908c-54e89ca5b11a => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:11:24.528015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a81f9311-26e3-4824-a6dc-7cc4e6f74827 req-8eb16fa7-e593-4835-960e-05b10202fb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b2fef2-ebb0-4f59-b152-dff17798962c", "tag": "84462fd3-a813-469f-9216-fb63d16087de"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:24.562565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a81f9311-26e3-4824-a6dc-7cc4e6f74827 req-8eb16fa7-e593-4835-960e-05b10202fb4e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.569844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a81f9311-26e3-4824-a6dc-7cc4e6f74827 req-8eb16fa7-e593-4835-960e-05b10202fb4e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.570689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a81f9311-26e3-4824-a6dc-7cc4e6f74827 req-8eb16fa7-e593-4835-960e-05b10202fb4e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.592410 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a81f9311-26e3-4824-a6dc-7cc4e6f74827 req-8eb16fa7-e593-4835-960e-05b10202fb4e service nova] Creating event network-changed:84462fd3-a813-469f-9216-fb63d16087de for instance f3b2fef2-ebb0-4f59-b152-dff17798962c on n-h1-858383-16 Oct 27 09:11:24.601120 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a81f9311-26e3-4824-a6dc-7cc4e6f74827 req-8eb16fa7-e593-4835-960e-05b10202fb4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082762 Oct 27 09:11:24.605202 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1324/2660] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:24.620459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:24.623126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:24.629027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:24.637621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b20ca182-586c-4748-a12d-c21106048147 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.500046 Oct 27 09:11:24.638187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.638747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.639203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.639997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.640464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.640908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.643362 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1337/2661] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:24 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:11:24.650508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c565639b-752a-43b3-b408-b91da1a39114 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:24.657174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c565639b-752a-43b3-b408-b91da1a39114 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:24.672688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c565639b-752a-43b3-b408-b91da1a39114 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.679495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c565639b-752a-43b3-b408-b91da1a39114 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.681230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c565639b-752a-43b3-b408-b91da1a39114 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.690089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c565639b-752a-43b3-b408-b91da1a39114 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.690582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c565639b-752a-43b3-b408-b91da1a39114 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.694421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c565639b-752a-43b3-b408-b91da1a39114 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.742825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:24.825744 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c565639b-752a-43b3-b408-b91da1a39114 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.176933 Oct 27 09:11:24.834517 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1338/2662] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:11:24 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:11:24.947223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8d38b2bf-c25c-45e8-81c7-e924e6e4ac2d req-5ea59c73-208b-4bf4-99b9-8a4d143461e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f81ce93-3183-4d2c-8e4b-4cda961a4a03", "name": "network-vif-plugged", "status": "completed", "tag": "49f4c3ce-92d8-4dea-9672-c5c20bfd309a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:24.974977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d38b2bf-c25c-45e8-81c7-e924e6e4ac2d req-5ea59c73-208b-4bf4-99b9-8a4d143461e7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:24.975601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d38b2bf-c25c-45e8-81c7-e924e6e4ac2d req-5ea59c73-208b-4bf4-99b9-8a4d143461e7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:24.976378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d38b2bf-c25c-45e8-81c7-e924e6e4ac2d req-5ea59c73-208b-4bf4-99b9-8a4d143461e7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:24.995556 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8d38b2bf-c25c-45e8-81c7-e924e6e4ac2d req-5ea59c73-208b-4bf4-99b9-8a4d143461e7 service nova] Creating event network-vif-plugged:49f4c3ce-92d8-4dea-9672-c5c20bfd309a for instance 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 on n-h2-858383-16 Oct 27 09:11:25.025412 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8d38b2bf-c25c-45e8-81c7-e924e6e4ac2d req-5ea59c73-208b-4bf4-99b9-8a4d143461e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089261 Oct 27 09:11:25.028065 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1339/2663] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:11:25.051088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:25.052534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:25.080089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:25.084528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:25.087074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:25.088264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:25.091479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:25.094056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:25.253358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:25.270924 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-984bf687-1b42-4477-8926-f1799fdafcbc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.664167 Oct 27 09:11:25.275302 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1325/2664] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:24 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:25.288027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-150ef021-5a47-4cf7-b00f-f7830b5f9e18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9833040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:25.364043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-150ef021-5a47-4cf7-b00f-f7830b5f9e18 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.085157 Oct 27 09:11:25.366346 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1326/2665] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:25 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:25.670831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:25.671695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:25.681830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:25.684310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:25.685091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:25.689203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:25.690001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:25.690709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:25.959273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:25.974537 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1dc01613-3e0a-4376-8bcc-5b296864f59d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.924452 Oct 27 09:11:25.975525 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1340/2666] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:25 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:25.992502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e470d16c-f28a-4031-b6e7-c105e5822682 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:26.001591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e470d16c-f28a-4031-b6e7-c105e5822682 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:26.021660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e470d16c-f28a-4031-b6e7-c105e5822682 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:26.024464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e470d16c-f28a-4031-b6e7-c105e5822682 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:26.028243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e470d16c-f28a-4031-b6e7-c105e5822682 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:26.029230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e470d16c-f28a-4031-b6e7-c105e5822682 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:26.034256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e470d16c-f28a-4031-b6e7-c105e5822682 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:26.036555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e470d16c-f28a-4031-b6e7-c105e5822682 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:26.132186 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e470d16c-f28a-4031-b6e7-c105e5822682 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.155342 Oct 27 09:11:26.138585 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1341/2667] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:11:25 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:11:26.164400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:26.176932 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4f96c31-afa5-4d31-b4e4-ac2cedebd948 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.511826 Oct 27 09:11:26.189599 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1327/2668] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:25 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:11:26.302192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:26.302877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:26.312453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:26.312961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:26.313411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:26.314130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:26.314599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:26.319245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:26.382328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49945367-dfaa-4b34-b337-d795b2c06990 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a97f1310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:26.479497 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49945367-dfaa-4b34-b337-d795b2c06990 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.102817 Oct 27 09:11:26.482336 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1328/2669] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:26 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:26.719471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:26.728554 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc819e76-b0d6-4349-a82e-5ed63e2a0d98 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.431733 Oct 27 09:11:26.732966 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1342/2670] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:26 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:27.000544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:27.001733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:27.021233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:27.028963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:27.029773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:27.035195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:27.040778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:27.042022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:27.152192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b133688-e1b5-4ff7-87c7-87c4899011bf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:27.154665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b133688-e1b5-4ff7-87c7-87c4899011bf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:27.174904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b133688-e1b5-4ff7-87c7-87c4899011bf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:27.175452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b133688-e1b5-4ff7-87c7-87c4899011bf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:27.175932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b133688-e1b5-4ff7-87c7-87c4899011bf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:27.176652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b133688-e1b5-4ff7-87c7-87c4899011bf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:27.178241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b133688-e1b5-4ff7-87c7-87c4899011bf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:27.180383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b133688-e1b5-4ff7-87c7-87c4899011bf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:27.265787 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b133688-e1b5-4ff7-87c7-87c4899011bf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118197 Oct 27 09:11:27.273853 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1343/2671] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:11:27 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:11:27.291492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:27.292196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:27.308447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:27.311709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:27.312432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:27.317598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:27.318348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:27.319053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:27.495781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:27.512023 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c2e81b09-b97a-4c3b-9800-8eb6b4816d08 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.510925 Oct 27 09:11:27.543663 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1329/2672] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:26 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:27.552370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-301e613c-c327-4a98-bfdd-997dd082c08a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a98e3d30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:27.636467 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-301e613c-c327-4a98-bfdd-997dd082c08a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.091310 Oct 27 09:11:27.645455 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1330/2673] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:27 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:27.748716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:27.757661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:27.758592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:27.773242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2a971f29-bcc8-480f-b4e5-31263908f396 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.498173 Oct 27 09:11:27.774859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:27.777806 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1344/2674] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:27 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:27.778814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:27.780277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:27.783082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:27.783787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:27.787437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:28.048629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:28.066364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94a7fc2b-5472-4b3c-aba8-74cc520cf0bd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.310697 Oct 27 09:11:28.085845 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1331/2675] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:27 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:11:28.286177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7cb49f19-54aa-459c-a1a3-cfc62f579173 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:28.288940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7cb49f19-54aa-459c-a1a3-cfc62f579173 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:28.320434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb49f19-54aa-459c-a1a3-cfc62f579173 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:28.320918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb49f19-54aa-459c-a1a3-cfc62f579173 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:28.321358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb49f19-54aa-459c-a1a3-cfc62f579173 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:28.342741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1485592625", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "cfc18c61-0592-49cf-a443-00e58b194812"}, {"uuid": "413602a7-da14-4ff3-ba18-9636be2b7e47"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:28.346544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb49f19-54aa-459c-a1a3-cfc62f579173 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:28.353645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb49f19-54aa-459c-a1a3-cfc62f579173 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:28.354107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cb49f19-54aa-459c-a1a3-cfc62f579173 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:28.483302 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7cb49f19-54aa-459c-a1a3-cfc62f579173 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.201637 Oct 27 09:11:28.486128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] validate_networks() for [('cfc18c61-0592-49cf-a443-00e58b194812', None, None, None, None, None), ('413602a7-da14-4ff3-ba18-9636be2b7e47', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:11:28.489781 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1345/2676] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:11:28 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:11:28.541245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:28.541877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:28.550632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:28.551130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:28.551588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:28.564162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:28.565011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:28.565651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:29.062515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:29.077471 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5da0cdf3-ef25-4334-b55f-7b4b22f8eb0a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1321 microversion: 2.1 time: 0.540035 Oct 27 09:11:29.091596 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1346/2677] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:28 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:11:29.091596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d88516c-1cfc-426b-8fb7-802c64dfcbc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9c6ff70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:29.191323 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d88516c-1cfc-426b-8fb7-802c64dfcbc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.111659 Oct 27 09:11:29.191987 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1347/2678] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:29 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:29.208612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:29.209300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:29.225042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:29.225539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:29.225978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:29.226690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:29.242301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:29.242783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:29.974155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:29.992806 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d3eccaa-794b-4227-83b4-720121cda685 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.797796 Oct 27 09:11:29.994767 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1348/2679] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:29 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:30.037416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:30.038677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:30.061069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:30.064183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:30.066410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:30.069578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:30.071239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:30.073470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:30.781824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:30.796455 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1b4f67e9-1421-4717-a8ab-fe20ad289349 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.798664 Oct 27 09:11:30.806251 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1349/2680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:29 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:30.817408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc8c8b53-ce80-4cee-aa1d-96271a370fda tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:30.822898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc8c8b53-ce80-4cee-aa1d-96271a370fda tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:30.856172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8c8b53-ce80-4cee-aa1d-96271a370fda tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:30.856836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8c8b53-ce80-4cee-aa1d-96271a370fda tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:30.864004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8c8b53-ce80-4cee-aa1d-96271a370fda tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:30.865331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8c8b53-ce80-4cee-aa1d-96271a370fda tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:30.865975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8c8b53-ce80-4cee-aa1d-96271a370fda tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:30.866610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8c8b53-ce80-4cee-aa1d-96271a370fda tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:30.983626 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc8c8b53-ce80-4cee-aa1d-96271a370fda tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.175505 Oct 27 09:11:30.993543 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1350/2681] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:11:30 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:11:31.018504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:31.037067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:31.119907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:31.132453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:31.133221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:31.140659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:31.142753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:31.145621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:31.221536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:11:31.222804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:11:31.223492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:11:31.224092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:11:31.234635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:11:31.275871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:31.288431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:31.289322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:31.292023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:31.293841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:31.299944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:31.451851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Getting quotas for project 58dde0075cf74c558c4b6462803c15e2. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:31.467263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Getting quotas for user a3b198587da845bf9237a28f784ae448 and project 58dde0075cf74c558c4b6462803c15e2. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:31.552438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:11:31.586027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:11:31.803534 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65e7ea12-44d6-4904-bdf8-dbefd326ee5b tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.467868 Oct 27 09:11:31.808345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:31.809266 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1332/2682] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:11:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:11:31.822482 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c8d60f0-3789-4b0f-804d-5e4834f4ffb8 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1512 microversion: 2.1 time: 0.827442 Oct 27 09:11:31.837090 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1351/2683] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:30 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1512 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:31.842034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40f294e0-be08-481a-ac79-b4ff699410ec tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a992c430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:31.851262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:31.852234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:31.859609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:31.860384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:31.861068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:31.862057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:31.862808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:31.863490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:32.289979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:32.307773 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bb3bad5e-eadd-4aef-8c30-e4f10d2c8faf tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.468796 Oct 27 09:11:32.317334 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1352/2684] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:31 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:32.343492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0fb8220f-4167-41d8-bf39-f12544057248 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:32.344158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0fb8220f-4167-41d8-bf39-f12544057248 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:32.542943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0fb8220f-4167-41d8-bf39-f12544057248 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:32.562867 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0fb8220f-4167-41d8-bf39-f12544057248 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1213 microversion: 2.1 time: 0.244253 Oct 27 09:11:32.576883 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1353/2685] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:32 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:32.594419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:32.603607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:32.694428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:32.708929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:32.712464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:32.715166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:32.719006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:32.721703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:33.328687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:33.402568 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2c65b7f4-7d8c-4592-8e9d-f157f9496f6c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.824082 Oct 27 09:11:33.403370 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1354/2686] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:32 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:33.435011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:33.435657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:33.501583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:33.502068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:33.502508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:33.503262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:33.531553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:33.532156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:34.328241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:34.350860 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-03a94f25-60ac-4fcd-a0a5-1ea3ba28e8c1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1510 microversion: 2.1 time: 0.938339 Oct 27 09:11:34.364280 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1355/2687] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:33 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1510 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:34.369616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ad61e023-5837-4f5f-88c5-7d706473c85b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:34.372122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ad61e023-5837-4f5f-88c5-7d706473c85b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:34.387669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad61e023-5837-4f5f-88c5-7d706473c85b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:34.388529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad61e023-5837-4f5f-88c5-7d706473c85b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:34.389168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad61e023-5837-4f5f-88c5-7d706473c85b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:34.392291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad61e023-5837-4f5f-88c5-7d706473c85b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:34.393167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad61e023-5837-4f5f-88c5-7d706473c85b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:34.395455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad61e023-5837-4f5f-88c5-7d706473c85b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:34.480355 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ad61e023-5837-4f5f-88c5-7d706473c85b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114459 Oct 27 09:11:34.485753 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1356/2688] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:11:34 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:11:34.496144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:34.504570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:34.511940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:34.512723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:34.520332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:34.521373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:34.521993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:34.522581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:34.954760 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40f294e0-be08-481a-ac79-b4ff699410ec tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 3.144381 Oct 27 09:11:34.957052 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1333/2689] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:31 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 3147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:34.968107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:34.969653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:34.986622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:34.988604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:34.992614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:34.993634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:34.994273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:34.995760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:35.279947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:35.288544 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d92e3c03-edfe-4f7f-ac20-30377cf856a9 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1265 microversion: 2.1 time: 0.330239 Oct 27 09:11:35.315303 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1334/2690] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:34 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1265 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:35.366697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:35.374193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:35.379911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:35.384421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:35.405748 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b56977bb-adec-4905-825d-28eb003b942d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.912541 Oct 27 09:11:35.424010 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1357/2691] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:34 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:35.435163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:35.438953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:35.442939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:35.445873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:35.449197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:35.450764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:35.454955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:35.458658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:35.489513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:35.490015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:35.493632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:35.497337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:35.501892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:35.503675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:36.370413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:36.390912 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-582598b2-823e-4cb1-bd8f-aea117a887ff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.964722 Oct 27 09:11:36.407358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1358/2692] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:35 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:36.437265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd873a8c-4561-49c8-b2c5-524de1db88ec tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:36.449803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:36.458671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd873a8c-4561-49c8-b2c5-524de1db88ec tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:36.465523 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d98ac41e-25e4-4c01-bdcc-d007c66d6f07 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996" status: 200 len: 1512 microversion: 2.1 time: 1.148672 Oct 27 09:11:36.475558 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1335/2693] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:35 2022] GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996 => generated 1512 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:36.498878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd873a8c-4561-49c8-b2c5-524de1db88ec tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:36.499671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8122d6e-8467-4913-863d-5a9a52f28a56 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a97a4790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:36.513332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd873a8c-4561-49c8-b2c5-524de1db88ec tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:36.530865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd873a8c-4561-49c8-b2c5-524de1db88ec tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:36.536500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd873a8c-4561-49c8-b2c5-524de1db88ec tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:36.540468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd873a8c-4561-49c8-b2c5-524de1db88ec tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:36.542844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd873a8c-4561-49c8-b2c5-524de1db88ec tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:36.632214 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8122d6e-8467-4913-863d-5a9a52f28a56 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.154146 Oct 27 09:11:36.632955 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1336/2694] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:36 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:36.649486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:36.657404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:36.707814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:36.709974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:36.711990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:36.717849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:36.722603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:36.732819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:36.760104 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd873a8c-4561-49c8-b2c5-524de1db88ec tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.337175 Oct 27 09:11:36.765723 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1359/2695] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:11:36 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 197 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:11:36.785758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:36.786928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:36.804495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:36.805322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:36.809324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:36.810306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:36.811828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:36.812463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:36.951839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:36.960891 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f43b4b7-9970-4f94-a802-b19a59f71c92 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1271 microversion: 2.1 time: 0.326682 Oct 27 09:11:36.975969 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1337/2696] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:36 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1271 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:36.997117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:37.013129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:37.029306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:37.077763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:37.082649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:37.085987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:37.088836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:37.093925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:37.094635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:37.330731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:37.434476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:37.446261 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d702b85f-bdae-465b-905c-29c00a719317 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.678195 Oct 27 09:11:37.447487 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1360/2697] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:36 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:37.466022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:37.467357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:37.491463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:37.498805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:37.501941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:37.502788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:37.503297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:37.503781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:37.614471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:37.650514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:37.657551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:37.663075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:38.123796 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f523e7e-b0c0-42f1-9c47-ddd02752aff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.146324 Oct 27 09:11:38.124638 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1338/2698] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Oct 27 09:11:36 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:38.131037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-977aced6-f72c-4443-92d9-fde161bd9ca1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a97a40d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:38.146085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:38.154861 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6709192-3228-41eb-a654-bb690e481146 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.706252 Oct 27 09:11:38.170745 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1361/2699] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:37 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:38.190158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4d5367d-a367-4796-8757-d583e2ddc23b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:38.193243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e4d5367d-a367-4796-8757-d583e2ddc23b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:38.215169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4d5367d-a367-4796-8757-d583e2ddc23b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:38.215693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4d5367d-a367-4796-8757-d583e2ddc23b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:38.218234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4d5367d-a367-4796-8757-d583e2ddc23b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:38.219157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4d5367d-a367-4796-8757-d583e2ddc23b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:38.225175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4d5367d-a367-4796-8757-d583e2ddc23b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:38.225855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4d5367d-a367-4796-8757-d583e2ddc23b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:38.235441 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-977aced6-f72c-4443-92d9-fde161bd9ca1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.109580 Oct 27 09:11:38.236069 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1339/2700] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:38 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:38.242187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:38.242803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:38.274800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:38.280350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:38.281093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:38.284136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:38.285678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:38.292345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:38.380267 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e4d5367d-a367-4796-8757-d583e2ddc23b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.200320 Oct 27 09:11:38.386887 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1362/2701] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:11:38 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:11:38.433733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:38.461818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:38.465514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-227598687', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:38.535947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:38.540019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:38.543826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:38.549447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:38.552102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:38.558356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:39.439110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:39.468750 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-05ab078a-9203-45ca-a970-580eba0ff4c8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1313 microversion: 2.1 time: 1.219201 Oct 27 09:11:39.472907 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1340/2702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:38 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1313 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:39.504146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:39.519740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:39.521551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:39.560348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:39.567914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:39.570220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:39.572464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:39.576995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:39.580244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:39.772472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:39.782025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:39.782771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:39.783375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:40.174597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:40.183296 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e0dd300-c7bf-4c82-9169-de04085157a9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.704347 Oct 27 09:11:40.207900 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1341/2703] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:39 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:40.222756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:40.223712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:40.257562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:40.257562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:40.257562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:40.257562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:40.257562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:40.257562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:40.590130 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7198877-d530-4b71-92b5-e96d497acd65 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-227598687" status: 200 len: 1513 microversion: 2.1 time: 2.196971 Oct 27 09:11:40.591189 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1363/2704] 10.222.0.25 () {58 vars in 1261 bytes} [Thu Oct 27 09:11:38 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-227598687 => generated 1513 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:40.597325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bddd783-bb25-489e-b469-80ba5f82d305 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa60e550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:40.758181 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5bddd783-bb25-489e-b469-80ba5f82d305 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.165793 Oct 27 09:11:40.760281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1364/2705] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:40 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:40.792539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a4f849f7-dfdc-479c-b579-49a853325ad0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:40.795149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a4f849f7-dfdc-479c-b579-49a853325ad0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:40.842092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f849f7-dfdc-479c-b579-49a853325ad0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:40.842922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f849f7-dfdc-479c-b579-49a853325ad0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:40.844106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f849f7-dfdc-479c-b579-49a853325ad0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:40.846645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f849f7-dfdc-479c-b579-49a853325ad0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:40.850156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f849f7-dfdc-479c-b579-49a853325ad0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:40.854380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f849f7-dfdc-479c-b579-49a853325ad0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:41.034951 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a4f849f7-dfdc-479c-b579-49a853325ad0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.262558 Oct 27 09:11:41.039214 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1365/2706] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:11:40 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a/os-volume_attachments => generated 25 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:41.058664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:41.068641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:41.069403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:41.084713 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97c918db-ce89-453b-af01-6f284e800d8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.886529 Oct 27 09:11:41.092289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:41.092716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:41.093168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:41.093899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:41.094350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:41.100290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:41.103924 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1342/2707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:40 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:41.128737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-36fe65f4-7777-4187-b0f5-a79f204182fb req-e17e2c8d-0ea5-4ee8-9362-c83db4cd5109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce459b57-8b9a-4330-a120-05d42e42f1a2", "name": "network-vif-plugged", "status": "completed", "tag": "88847dbe-75b3-4862-8555-18e520709e8e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:41.196766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-36fe65f4-7777-4187-b0f5-a79f204182fb req-e17e2c8d-0ea5-4ee8-9362-c83db4cd5109 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:41.221116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-36fe65f4-7777-4187-b0f5-a79f204182fb req-e17e2c8d-0ea5-4ee8-9362-c83db4cd5109 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:41.221667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-36fe65f4-7777-4187-b0f5-a79f204182fb req-e17e2c8d-0ea5-4ee8-9362-c83db4cd5109 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:41.370895 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-36fe65f4-7777-4187-b0f5-a79f204182fb req-e17e2c8d-0ea5-4ee8-9362-c83db4cd5109 service nova] Creating event network-vif-plugged:88847dbe-75b3-4862-8555-18e520709e8e for instance ce459b57-8b9a-4330-a120-05d42e42f1a2 on n-h1-858383-16 Oct 27 09:11:41.387376 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-36fe65f4-7777-4187-b0f5-a79f204182fb req-e17e2c8d-0ea5-4ee8-9362-c83db4cd5109 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281914 Oct 27 09:11:41.392363 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1343/2708] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:41.415791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:41.430819 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-138b5290-8619-4086-925f-22f51a88246c tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1313 microversion: 2.1 time: 0.385923 Oct 27 09:11:41.433804 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1366/2709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:41 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:41.460369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:41.463005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:41.464828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:41.481468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:41.482354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:41.484571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:41.485612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:41.486643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:41.488776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:41.491123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:41.497787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:41.528297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:41.533673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:41.534917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:41.538255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:41.539978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:41.540586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:42.054945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:42.094123 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4680f0d3-293b-4cc7-b925-92ee3c5c9dd0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1316 microversion: 2.1 time: 0.636238 Oct 27 09:11:42.096268 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1367/2710] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:41 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:42.115529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:42.116239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:42.140123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:42.143138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:42.147101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:42.148039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:42.151241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:42.155884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:42.293671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:11:42.404327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:42.664375 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-301ff3ce-b32f-4fd7-90b2-581856f89394 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 204 len: 0 microversion: 2.20 time: 0.565541 Oct 27 09:11:42.667056 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1368/2711] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:11:42 2022] DELETE /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:11:42.700731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4511bb20-2579-47ab-8361-e460ed4fcd1e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa331a60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:42.749906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:42.760710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:42.761090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:42.764783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:42.929035 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4511bb20-2579-47ab-8361-e460ed4fcd1e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1413 microversion: 2.1 time: 0.237156 Oct 27 09:11:42.936302 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1369/2712] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:42 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1413 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:42.960386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:42.968602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:43.002519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:43.011310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:43.011854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:43.012313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:43.023393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:43.027486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:43.035120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:43.360641 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b438797-bc72-4ad2-afb0-b8c59e9324b3 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.966624 Oct 27 09:11:43.362853 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1344/2713] 10.222.0.25 () {58 vars in 1173 bytes} [Thu Oct 27 09:11:41 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:43.369187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:43.370195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:43.391348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:43.392379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:43.393016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:43.394993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:43.398920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:43.399787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:45.034371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:45.051803 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62114127-8de0-4b28-9b29-83d1ed591269 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 2.113271 Oct 27 09:11:45.058946 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1370/2714] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:42 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:45.094765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:45.095700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:45.120933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:45.133408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:45.138273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:45.139930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:45.144673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:45.148364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:45.231724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:45.247109 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df46e019-26e0-4939-a684-56783e311361 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 1.882607 Oct 27 09:11:45.249630 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1345/2715] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:43 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:45.260593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:45.262000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:45.305213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:45.305835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:45.306301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:45.307064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:45.307533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:45.308262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:45.348425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:45.955358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:45.964866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:45.976208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:45.977781 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f2d02864-464a-4e0c-ae5b-499254db95a3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1722 microversion: 2.20 time: 0.917566 Oct 27 09:11:45.978901 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1371/2716] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:11:45 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1722 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:11:45.996572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:46.006560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:46.015030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.compute.servers [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Removing options 'limit' from query {{(pid=120602) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 09:11:46.016251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:46.032322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:46.040979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:46.042166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:46.054920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:46.055801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:46.060901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:46.160406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:46.192936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:46.193428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:46.196990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:46.696249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:46.713966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f79232f7-91f8-4f2a-a19b-650dcad92e63 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1503 microversion: 2.1 time: 1.461787 Oct 27 09:11:46.716326 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1346/2717] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:45 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1503 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:46.734636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b2673921-74c2-4264-bf5f-23715d011109 req-84c66377-1972-422b-9761-a8777d17ad32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4a6784-df8b-47f7-9132-8ad0ab14cb59", "name": "network-vif-plugged", "status": "completed", "tag": "d7cdd3a8-c93c-43ad-ae1d-1de5d0a79f22"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:46.770014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b2673921-74c2-4264-bf5f-23715d011109 req-84c66377-1972-422b-9761-a8777d17ad32 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:46.772762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b2673921-74c2-4264-bf5f-23715d011109 req-84c66377-1972-422b-9761-a8777d17ad32 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:46.776090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b2673921-74c2-4264-bf5f-23715d011109 req-84c66377-1972-422b-9761-a8777d17ad32 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:46.817593 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b2673921-74c2-4264-bf5f-23715d011109 req-84c66377-1972-422b-9761-a8777d17ad32 service nova] Creating event network-vif-plugged:d7cdd3a8-c93c-43ad-ae1d-1de5d0a79f22 for instance da4a6784-df8b-47f7-9132-8ad0ab14cb59 on n-h2-858383-16 Oct 27 09:11:46.830476 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b2673921-74c2-4264-bf5f-23715d011109 req-84c66377-1972-422b-9761-a8777d17ad32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111807 Oct 27 09:11:46.830476 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1347/2718] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:46.843038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42449448-705b-446e-8929-0f41959a1b7c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9981040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:47.387492 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1fd2f8e-5623-402e-a473-b1401f210b5f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 1.406507 Oct 27 09:11:47.400285 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1372/2719] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 09:11:45 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:47.423182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1e813a12-7439-4ef0-b517-52f33f2da96b req-2090195e-77bb-4086-bc18-4be52442f6ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d205865b-096d-484d-80d0-747b3b9745fa", "tag": "1c080fc0-f47f-4199-99fb-c95aeb769036"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:47.516913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1e813a12-7439-4ef0-b517-52f33f2da96b req-2090195e-77bb-4086-bc18-4be52442f6ea service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:47.517861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1e813a12-7439-4ef0-b517-52f33f2da96b req-2090195e-77bb-4086-bc18-4be52442f6ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:47.522124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1e813a12-7439-4ef0-b517-52f33f2da96b req-2090195e-77bb-4086-bc18-4be52442f6ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:47.548193 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1e813a12-7439-4ef0-b517-52f33f2da96b req-2090195e-77bb-4086-bc18-4be52442f6ea service nova] Creating event network-changed:1c080fc0-f47f-4199-99fb-c95aeb769036 for instance d205865b-096d-484d-80d0-747b3b9745fa on n-h1-858383-16 Oct 27 09:11:47.660093 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1e813a12-7439-4ef0-b517-52f33f2da96b req-2090195e-77bb-4086-bc18-4be52442f6ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152631 Oct 27 09:11:47.669009 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1373/2720] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:47.707791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:47.713565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:47.748460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:47.750605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:47.753268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:47.756901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:47.758369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:47.759975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:48.168363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:48.179311 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a1b9970-4a76-40cf-8aa1-8b91045490a0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1318 microversion: 2.1 time: 0.508914 Oct 27 09:11:48.179938 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1374/2721] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:47 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:48.203026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:48.209551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:48.227824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:48.228322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:48.232393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:48.233109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:48.233577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:48.234007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:48.251202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:48.581273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:48.595903 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e4f0a2e-075f-40ad-90fa-948d7b649f3a tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 0.408923 Oct 27 09:11:48.599873 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1375/2722] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:48 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:48.611824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1363464215"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:48.613284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:48.630101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:48.630922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:48.631726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:48.632662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:48.633295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:48.633883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:49.120077 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.network.security_group_api [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Adding security group f2a6e56a-74f2-4288-8e7c-f546f1786c28 to port 88847dbe-75b3-4862-8555-18e520709e8e Oct 27 09:11:50.188169 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ccc498d-be23-42bf-88a0-b942bb2ba0e8 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2/action" status: 202 len: 0 microversion: 2.1 time: 1.586836 Oct 27 09:11:50.192295 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1376/2723] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:11:48 2022] POST /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2/action => generated 0 bytes in 1591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:11:50.197908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:50.198860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:50.219920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.220188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.220432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.221139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.222121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.222556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.326341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.326753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.331523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.332844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lazy-loading 'fault' on Instance uuid 3d248926-b23e-472b-9a1e-4b10c924758a {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:11:50.399227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:50.412138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:50.414050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:50.414880 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f2abc634-c176-4c1f-b1e1-b2b461ce443b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 200 len: 1371 microversion: 2.20 time: 0.221232 Oct 27 09:11:50.415454 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1377/2724] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:11:50 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:11:50.426840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:50.435996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:50.445585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:50.462175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.462626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.463135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.463703 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42449448-705b-446e-8929-0f41959a1b7c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1422 microversion: 2.1 time: 3.631101 Oct 27 09:11:50.464199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.464330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.464907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.471237 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1348/2725] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:46 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1422 bytes in 3637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:50.479045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b7f426f9-e521-4498-b92e-401a6b79737f req-3f2bed5f-36fa-4f7a-a813-3d6fe86e7bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d248926-b23e-472b-9a1e-4b10c924758a", "name": "network-vif-deleted", "tag": "c24197dc-db5d-4363-91d8-125f1e441095"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:50.510214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b7f426f9-e521-4498-b92e-401a6b79737f req-3f2bed5f-36fa-4f7a-a813-3d6fe86e7bbe service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.511632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b7f426f9-e521-4498-b92e-401a6b79737f req-3f2bed5f-36fa-4f7a-a813-3d6fe86e7bbe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.512212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b7f426f9-e521-4498-b92e-401a6b79737f req-3f2bed5f-36fa-4f7a-a813-3d6fe86e7bbe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.540348 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b7f426f9-e521-4498-b92e-401a6b79737f req-3f2bed5f-36fa-4f7a-a813-3d6fe86e7bbe service nova] Creating event network-vif-deleted:c24197dc-db5d-4363-91d8-125f1e441095 for instance 3d248926-b23e-472b-9a1e-4b10c924758a on n-h2-858383-16 Oct 27 09:11:50.559684 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b7f426f9-e521-4498-b92e-401a6b79737f req-3f2bed5f-36fa-4f7a-a813-3d6fe86e7bbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086773 Oct 27 09:11:50.561438 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1349/2726] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:50.577577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-bb670dd2-68a0-4331-b92c-c3175b7991ec req-0cb290d5-9c71-40ca-a57f-64d44e950b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b2fef2-ebb0-4f59-b152-dff17798962c", "name": "network-vif-plugged", "status": "completed", "tag": "84462fd3-a813-469f-9216-fb63d16087de"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:50.606400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bb670dd2-68a0-4331-b92c-c3175b7991ec req-0cb290d5-9c71-40ca-a57f-64d44e950b71 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.606925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:50.618741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bb670dd2-68a0-4331-b92c-c3175b7991ec req-0cb290d5-9c71-40ca-a57f-64d44e950b71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.623178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bb670dd2-68a0-4331-b92c-c3175b7991ec req-0cb290d5-9c71-40ca-a57f-64d44e950b71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.682768 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e810e3e5-0ac0-4090-9695-ab2bbfb0cd61 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.261083 Oct 27 09:11:50.684258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1378/2727] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:11:50 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:50.689166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:50.689985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:50.695309 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-bb670dd2-68a0-4331-b92c-c3175b7991ec req-0cb290d5-9c71-40ca-a57f-64d44e950b71 service nova] Creating event network-vif-plugged:84462fd3-a813-469f-9216-fb63d16087de for instance f3b2fef2-ebb0-4f59-b152-dff17798962c on n-h1-858383-16 Oct 27 09:11:50.716946 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-bb670dd2-68a0-4331-b92c-c3175b7991ec req-0cb290d5-9c71-40ca-a57f-64d44e950b71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147814 Oct 27 09:11:50.719712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.722115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.723538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.726008 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1350/2728] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:50.727048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.728611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.729364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.738710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:50.739411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:50.769907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.770431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.770972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:50.787957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:50.790780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:50.791245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:51.125198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:51.136288 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a29be0bd-fa0b-4f06-bb6d-0a03652febfd tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 0.408579 Oct 27 09:11:51.137635 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1351/2729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:50 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:51.144609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cce3a2b8-f0f4-4636-a610-3aab3247b446 req-d8e656bb-e608-4263-a617-3e8a3814c9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d205865b-096d-484d-80d0-747b3b9745fa", "tag": "344fa8d3-6883-438a-8642-563fd0182641"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:51.155336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:51.169747 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c255a205-623e-4c2d-a3c1-e1dc45f6bb71 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1468 microversion: 2.1 time: 0.484192 Oct 27 09:11:51.175908 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1379/2730] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:50 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1468 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:51.180733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-256903937"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:51.181265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:51.189512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cce3a2b8-f0f4-4636-a610-3aab3247b446 req-d8e656bb-e608-4263-a617-3e8a3814c9ce service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:51.189512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cce3a2b8-f0f4-4636-a610-3aab3247b446 req-d8e656bb-e608-4263-a617-3e8a3814c9ce service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:51.189802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cce3a2b8-f0f4-4636-a610-3aab3247b446 req-d8e656bb-e608-4263-a617-3e8a3814c9ce service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:51.208121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:51.208675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:51.210423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:51.213786 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cce3a2b8-f0f4-4636-a610-3aab3247b446 req-d8e656bb-e608-4263-a617-3e8a3814c9ce service nova] Creating event network-changed:344fa8d3-6883-438a-8642-563fd0182641 for instance d205865b-096d-484d-80d0-747b3b9745fa on n-h1-858383-16 Oct 27 09:11:51.214933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:51.215788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:51.216374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:51.226080 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cce3a2b8-f0f4-4636-a610-3aab3247b446 req-d8e656bb-e608-4263-a617-3e8a3814c9ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086592 Oct 27 09:11:51.229822 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1352/2731] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:51.241907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b37c6506-5e19-4162-90c8-5ab32fcf932b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9949790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:51.315236 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b37c6506-5e19-4162-90c8-5ab32fcf932b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 200 len: 1422 microversion: 2.1 time: 0.078893 Oct 27 09:11:51.316444 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1353/2732] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:11:51 2022] GET /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 1422 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:51.321490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:51.327046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:51.328064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.servers [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Removing options 'limit' from query {{(pid=120603) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 09:11:51.329013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:51.336253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:51.336948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:51.337534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:51.338425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:51.339045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:51.339641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:51.448271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:51.510246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.network.security_group_api [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Adding security group 259abcc5-64b8-4539-a297-bd5b458c1e7f to port 88847dbe-75b3-4862-8555-18e520709e8e Oct 27 09:11:51.544546 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80ebccc5-07d8-42e6-9247-32b079b38e1f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.226459 Oct 27 09:11:51.545854 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1354/2733] 10.222.0.25 () {58 vars in 1150 bytes} [Thu Oct 27 09:11:51 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:51.550662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:51.551678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:51.559766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:51.560271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:51.560713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:51.561423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:51.561886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:51.562311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:51.958783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:51.975880 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1d69adc-0a21-4050-a333-8f19020f7787 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c" status: 200 len: 1318 microversion: 2.1 time: 0.428710 Oct 27 09:11:51.976858 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1355/2734] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:51 2022] GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:51.982579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-24b7c3c8-7457-442d-80ae-041a1fab5842 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a992cc10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:52.308865 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7ad493e-6106-4bbb-964d-a55a12dae8d5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2/action" status: 202 len: 0 microversion: 2.1 time: 1.129585 Oct 27 09:11:52.313119 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1380/2735] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:11:51 2022] POST /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:11:52.319138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:52.319803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:52.356834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:52.357364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:52.357811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:52.358561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:52.359042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:52.364122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:52.383695 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] HTTP exception thrown: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Request method failure captured: Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a HTTP/1.1 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWknbVCYXTU8e_4wUYAFufT4tn843sHbUcCd6BDtkcqBSPMkKLRhyaW7Ns9hCK7D3XvSRwnVJ2CwjxZxWbDsggnO0LJbY-ij40d2Erqi5KnS4HbUpTh5VwarMRbu1dxgcJbTfAFcEao1B-S6JJ_4hGrjouNNJkh60d66VrV0VtkEJ-FU Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}] Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0e5cea258c34423e82b53d552b21239f Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '3d248926-b23e-472b-9a1e-4b10c924758a'} Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:52.427361 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Returning 404 to user: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4fefc6b5-267a-46a0-972d-999fc844eae2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 404 len: 111 microversion: 2.20 time: 0.114813 Oct 27 09:11:52.438825 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1381/2736] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:11:52 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:11:52.439965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:52.446060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:52.447885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:52.454773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:52.455520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:52.456704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:52.458482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:52.459172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:52.459898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:52.545497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:52.651839 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ccab23f5-ceef-4d77-ad97-06530df1a493 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.216559 Oct 27 09:11:52.652750 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1382/2737] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:11:52 2022] GET /compute/v2.1/servers => generated 1011 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:52.659433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:52.660528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:52.671898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:52.672860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:52.673503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:52.674407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:52.675073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:52.675909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:52.732986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:53.076535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:53.085937 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-24b7c3c8-7457-442d-80ae-041a1fab5842 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 204 len: 0 microversion: 2.1 time: 1.107820 Oct 27 09:11:53.087280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1356/2738] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:51 2022] DELETE /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 0 bytes in 1110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:11:53.095443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-163ed27d-7d09-4634-8667-6da1c90361b9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:53.099461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-163ed27d-7d09-4634-8667-6da1c90361b9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:53.105835 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f235388-3692-4acb-bf89-3911a1daca31 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 0.451699 Oct 27 09:11:53.123653 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1383/2739] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:52 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:53.130455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:53.132387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-163ed27d-7d09-4634-8667-6da1c90361b9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.135864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-163ed27d-7d09-4634-8667-6da1c90361b9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.136547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-163ed27d-7d09-4634-8667-6da1c90361b9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.137546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-163ed27d-7d09-4634-8667-6da1c90361b9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.138353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-21f07967-47e5-4fcb-9b27-1f48dd44d6e6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '.version_select at 0x7f31a9c78940>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:53.139043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-163ed27d-7d09-4634-8667-6da1c90361b9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.140989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-163ed27d-7d09-4634-8667-6da1c90361b9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.162324 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-21f07967-47e5-4fcb-9b27-1f48dd44d6e6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717960891" status: 204 len: 0 microversion: 2.20 time: 0.037169 Oct 27 09:11:53.186278 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1384/2740] 10.222.0.25 () {60 vars in 1259 bytes} [Thu Oct 27 09:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717960891 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:11:53.201408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8dbe8990-dbb6-4606-9360-2894536c8090 req-565d59bc-1826-4966-89d8-f13bc181db9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce459b57-8b9a-4330-a120-05d42e42f1a2", "tag": "88847dbe-75b3-4862-8555-18e520709e8e"}, {"name": "network-changed", "server_uuid": "ce459b57-8b9a-4330-a120-05d42e42f1a2", "tag": "88847dbe-75b3-4862-8555-18e520709e8e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:53.230293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8dbe8990-dbb6-4606-9360-2894536c8090 req-565d59bc-1826-4966-89d8-f13bc181db9d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.231367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8dbe8990-dbb6-4606-9360-2894536c8090 req-565d59bc-1826-4966-89d8-f13bc181db9d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.233241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8dbe8990-dbb6-4606-9360-2894536c8090 req-565d59bc-1826-4966-89d8-f13bc181db9d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.254761 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8dbe8990-dbb6-4606-9360-2894536c8090 req-565d59bc-1826-4966-89d8-f13bc181db9d service nova] Creating event network-changed:88847dbe-75b3-4862-8555-18e520709e8e for instance ce459b57-8b9a-4330-a120-05d42e42f1a2 on n-h1-858383-16 Oct 27 09:11:53.255703 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8dbe8990-dbb6-4606-9360-2894536c8090 req-565d59bc-1826-4966-89d8-f13bc181db9d service nova] Creating event network-changed:88847dbe-75b3-4862-8555-18e520709e8e for instance ce459b57-8b9a-4330-a120-05d42e42f1a2 on n-h1-858383-16 Oct 27 09:11:53.276246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8dbe8990-dbb6-4606-9360-2894536c8090 req-565d59bc-1826-4966-89d8-f13bc181db9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.084015 Oct 27 09:11:53.277287 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1385/2741] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:53.287696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:53.294505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:53.295503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:53.310821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.311552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.311776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.312713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.313343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.314046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.421103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:53.426533 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-163ed27d-7d09-4634-8667-6da1c90361b9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.337919 Oct 27 09:11:53.428202 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1357/2742] 10.222.0.25 () {58 vars in 1293 bytes} [Thu Oct 27 09:11:53 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2/os-security-groups => generated 1157 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:53.433904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:53.436869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:53.456456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.457195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.459454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.460583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.463021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.463678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.515798 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b0e7d6cc-e177-4169-b16f-5cb82a194353 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.236042 Oct 27 09:11:53.516837 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1386/2743] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:11:53 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:53.525458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:53.526331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:53.532842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.533565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.534912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.535884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.536568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.537211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.568360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:11:53.710886 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f61af36-66c5-4103-8506-a73c7909502d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 204 len: 0 microversion: 2.1 time: 0.192578 Oct 27 09:11:53.711734 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1387/2744] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:11:53 2022] DELETE /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:11:53.723536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17eb9743-34b3-4417-8a24-b6460011c487 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: .version_select at 0x7f31aa331f70>, body: {"security_group": {"name": " tempest-securitygroup -2134260087 ", "description": "tempest-description-799705937"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:53.925527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:53.938909 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5c9f43e-b4a5-4b59-a90f-912cf154b01b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c" status: 200 len: 1467 microversion: 2.1 time: 0.508222 Oct 27 09:11:53.957676 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1358/2745] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:53 2022] GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c => generated 1467 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:53.968519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:53.975274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:53.976046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.servers [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Removing options 'limit' from query {{(pid=120603) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 09:11:53.976898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:53.983532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.985255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.985978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:53.987157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:53.988098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:53.988765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:54.001562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=9 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:54.024192 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6e8121a-a7d6-40a2-a16e-e8d9ca098b52 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.064323 Oct 27 09:11:54.026115 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1359/2746] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Oct 27 09:11:53 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:54.032117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:54.038146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:54.039234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Searching by: {'reservation_id': 'r-e0pthhu3', 'deleted': False, 'project_id': '5f5752431c874be58372449a6b71853c'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:54.045259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:54.046025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:54.046628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:54.047528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:54.048243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:54.048849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:54.192752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:54.282293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:54.294618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:54.295370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:54.295999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:54.609663 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04013f4f-4afd-4434-8e9f-527d89bb255d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-e0pthhu3" status: 200 len: 2928 microversion: 2.1 time: 0.581396 Oct 27 09:11:54.621745 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1360/2747] 10.222.0.25 () {58 vars in 1197 bytes} [Thu Oct 27 09:11:54 2022] GET /compute/v2.1/servers/detail?reservation_id=r-e0pthhu3 => generated 2928 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:54.640395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1719004937", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "8aa86863-8c60-413b-9747-3e375f601520"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:54.643049 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-17eb9743-34b3-4417-8a24-b6460011c487 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.929095 Oct 27 09:11:54.652243 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1388/2748] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:11:53 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:54.657219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:54.670725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:54.670725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-227598687', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:11:54.678193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:54.678782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:54.679105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:54.680388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:54.681149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:54.681737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:54.732494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] validate_networks() for [('8aa86863-8c60-413b-9747-3e375f601520', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:11:54.801155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:11:54.916472 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-af445a4d-8ef7-463b-b794-e4096dbc3380 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-227598687" status: 200 len: 345 microversion: 2.1 time: 0.262511 Oct 27 09:11:54.917482 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1389/2749] 10.222.0.25 () {58 vars in 1240 bytes} [Thu Oct 27 09:11:54 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-227598687 => generated 345 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:54.922290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:54.925424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:54.932082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:54.932588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:54.933475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:54.934006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:54.934486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:54.935015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:56.008288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:56.019360 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-426aaa0f-9b60-4f23-b726-213f2c5277e5 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 1.100767 Oct 27 09:11:56.020679 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1390/2750] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:54 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:56.030495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb271c24-ae73-4859-ae59-31180e436606 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'create', calling method: .version_select at 0x7f31aa028820>, body: {"keypair": {"name": "tempest-keypair-946019008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfKUQ7gYYw93BsNR8RP3fs4O/WV4Qk6lMOE4QQryPvr5HKjTrhGFP5MDGrDEraOUfs9DW41gsdTas2TLai/z2xu/0wO77S1DsYbDe0Z9IWnn6VRt8ca9TTHGzr5C/Gmqg=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:56.055977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-cb271c24-ae73-4859-ae59-31180e436606 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Getting quotas for project 1babaa8dc02a4a04b18cbe0fe7ef5377. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:56.063009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-cb271c24-ae73-4859-ae59-31180e436606 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Getting quotas for user 0e5cea258c34423e82b53d552b21239f and project 1babaa8dc02a4a04b18cbe0fe7ef5377. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:56.113761 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb271c24-ae73-4859-ae59-31180e436606 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.088823 Oct 27 09:11:56.121860 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1391/2751] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Oct 27 09:11:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:11:56.129666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2332dc96-759d-4b69-a21f-d89b10da25ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:56.179890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.compute.server_groups [None req-2332dc96-759d-4b69-a21f-d89b10da25ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Querying cell ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) for 2 instances {{(pid=120602) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 09:11:56.189255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2332dc96-759d-4b69-a21f-d89b10da25ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:56.189728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2332dc96-759d-4b69-a21f-d89b10da25ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:56.190190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2332dc96-759d-4b69-a21f-d89b10da25ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:56.301089 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2332dc96-759d-4b69-a21f-d89b10da25ab tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/37b68f63-d250-48d7-a615-354fb9948090" status: 200 len: 271 microversion: 2.1 time: 0.177567 Oct 27 09:11:56.302755 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1392/2752] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:11:56 2022] GET /compute/v2.1/os-server-groups/37b68f63-d250-48d7-a615-354fb9948090 => generated 271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:56.311294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ab2cfee-4209-4306-bf4a-ea1ee785c042 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31ae6c4e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:56.552473 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ab2cfee-4209-4306-bf4a-ea1ee785c042 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df" status: 200 len: 223 microversion: 2.1 time: 0.248315 Oct 27 09:11:56.553069 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1393/2753] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:11:56 2022] GET /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df => generated 223 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:56.557842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-101a46be-bade-4ad9-903b-c358af347f18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:56.572988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-101a46be-bade-4ad9-903b-c358af347f18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:56.573662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-101a46be-bade-4ad9-903b-c358af347f18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:56.575506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-101a46be-bade-4ad9-903b-c358af347f18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:56.735946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-101a46be-bade-4ad9-903b-c358af347f18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Going to try to stop instance {{(pid=120602) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:11:56.741026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:11:56.854735 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-101a46be-bade-4ad9-903b-c358af347f18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "POST /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403/action" status: 202 len: 0 microversion: 2.1 time: 0.300433 Oct 27 09:11:56.856283 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1394/2754] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:11:56 2022] POST /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:11:56.864724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c66af19b-b46d-49cd-8dc1-75f694833da4 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:56.866853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c66af19b-b46d-49cd-8dc1-75f694833da4 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:56.889728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c66af19b-b46d-49cd-8dc1-75f694833da4 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:56.890470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c66af19b-b46d-49cd-8dc1-75f694833da4 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:56.891098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c66af19b-b46d-49cd-8dc1-75f694833da4 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:56.891999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c66af19b-b46d-49cd-8dc1-75f694833da4 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:56.892613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c66af19b-b46d-49cd-8dc1-75f694833da4 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:56.893395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c66af19b-b46d-49cd-8dc1-75f694833da4 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:57.073697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:11:57.074237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:11:57.074604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:11:57.075067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:11:57.075487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:11:57.094323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:57.097763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:57.099013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:57.103348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:57.104157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:57.106404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:57.179230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:11:57.198524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for user e63dd72032ef4fe098382555888e3ae3 and project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:11:57.257044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:11:57.261771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:11:57.424487 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-843dacb1-cfdf-4713-b6ec-a14fba65187c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.783170 Oct 27 09:11:57.431271 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1361/2755] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:11:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:11:57.456784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f2c27e52-88b0-4927-939e-f6b5d1609ba6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31a992c430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:57.880848 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c66af19b-b46d-49cd-8dc1-75f694833da4 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 200 len: 1621 microversion: 2.1 time: 1.012298 Oct 27 09:11:57.881533 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1395/2756] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:56 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 1621 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:57.903141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:57.910301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:57.938136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:57.940922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:57.941424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:57.954052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:57.954692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:57.957985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:58.712011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:58.726613 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3fc64e22-1c37-4524-b1de-926e3f12fd4f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1520 microversion: 2.1 time: 0.839384 Oct 27 09:11:58.732448 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1396/2757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:57 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1520 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:58.763554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e65c73c9-5d1b-4df1-a335-5574a6ff2c86 req-b3b597bd-0f9f-40b6-b78d-c5082d658dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc682645-328d-418c-aeda-55b06824b085", "name": "network-vif-unplugged", "status": "completed", "tag": "f7f4087c-e3d8-446a-8011-57745cdec512"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:58.815075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e65c73c9-5d1b-4df1-a335-5574a6ff2c86 req-b3b597bd-0f9f-40b6-b78d-c5082d658dc0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:58.823124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e65c73c9-5d1b-4df1-a335-5574a6ff2c86 req-b3b597bd-0f9f-40b6-b78d-c5082d658dc0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:58.823608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e65c73c9-5d1b-4df1-a335-5574a6ff2c86 req-b3b597bd-0f9f-40b6-b78d-c5082d658dc0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:58.876020 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e65c73c9-5d1b-4df1-a335-5574a6ff2c86 req-b3b597bd-0f9f-40b6-b78d-c5082d658dc0 service nova] Creating event network-vif-unplugged:f7f4087c-e3d8-446a-8011-57745cdec512 for instance dc682645-328d-418c-aeda-55b06824b085 on n-h2-858383-16 Oct 27 09:11:58.898884 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e65c73c9-5d1b-4df1-a335-5574a6ff2c86 req-b3b597bd-0f9f-40b6-b78d-c5082d658dc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164985 Oct 27 09:11:58.906036 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1397/2758] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:58.920072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:58.920780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:58.957243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:58.957749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:58.963936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:58.968621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:58.972120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:58.974180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:59.149085 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f2c27e52-88b0-4927-939e-f6b5d1609ba6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df" status: 202 len: 0 microversion: 2.1 time: 1.715782 Oct 27 09:11:59.154008 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1362/2759] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:11:57 2022] DELETE /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df => generated 0 bytes in 1721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:11:59.159683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:59.160579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:59.180181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:59.181091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:59.184025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:59.185042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:59.186993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:59.187705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:59.462190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:59.471201 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c15dcf6a-f26b-4da1-abda-91538d22cb64 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1260 microversion: 2.1 time: 0.315796 Oct 27 09:11:59.474831 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1363/2760] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:59 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1260 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:59.494614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a46c4a6-97bb-4ca1-ad14-72c65713ef60 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:11:59.495717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0a46c4a6-97bb-4ca1-ad14-72c65713ef60 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:11:59.526337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a46c4a6-97bb-4ca1-ad14-72c65713ef60 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:59.527196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a46c4a6-97bb-4ca1-ad14-72c65713ef60 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:59.527888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a46c4a6-97bb-4ca1-ad14-72c65713ef60 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:59.528886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a46c4a6-97bb-4ca1-ad14-72c65713ef60 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:59.530076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a46c4a6-97bb-4ca1-ad14-72c65713ef60 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:59.530734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a46c4a6-97bb-4ca1-ad14-72c65713ef60 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:59.894734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:11:59.906783 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b35ea25-14f9-4cd1-8971-8e19a1ca6a82 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 0.996920 Oct 27 09:11:59.915823 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1398/2761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:58 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:11:59.925843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-138fdad8-6e75-4227-821d-7a67af1fa95c req-72358b13-8234-4925-91b0-a1ada60de14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc682645-328d-418c-aeda-55b06824b085", "name": "network-vif-deleted", "tag": "f7f4087c-e3d8-446a-8011-57745cdec512"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:11:59.956917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-138fdad8-6e75-4227-821d-7a67af1fa95c req-72358b13-8234-4925-91b0-a1ada60de14f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:11:59.957405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-138fdad8-6e75-4227-821d-7a67af1fa95c req-72358b13-8234-4925-91b0-a1ada60de14f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:11:59.957839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-138fdad8-6e75-4227-821d-7a67af1fa95c req-72358b13-8234-4925-91b0-a1ada60de14f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:11:59.970219 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-138fdad8-6e75-4227-821d-7a67af1fa95c req-72358b13-8234-4925-91b0-a1ada60de14f service nova] Creating event network-vif-deleted:f7f4087c-e3d8-446a-8011-57745cdec512 for instance dc682645-328d-418c-aeda-55b06824b085 on n-h2-858383-16 Oct 27 09:11:59.977240 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-138fdad8-6e75-4227-821d-7a67af1fa95c req-72358b13-8234-4925-91b0-a1ada60de14f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058955 Oct 27 09:11:59.980754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1399/2762] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:11:59.992913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d1aa183-83a0-4176-a0da-da266d83c3ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31a96fef70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:00.017430 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a46c4a6-97bb-4ca1-ad14-72c65713ef60 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c" status: 200 len: 1620 microversion: 2.1 time: 0.534286 Oct 27 09:12:00.023737 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1364/2763] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:11:59 2022] GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c => generated 1620 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:00.037527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:00.039492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:00.060644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:00.061560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:00.062399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-8d1aa183-83a0-4176-a0da-da266d83c3ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:12:00.062980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.security_group_api [None req-8d1aa183-83a0-4176-a0da-da266d83c3ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group b1979e9d-8156-4222-a330-2f920f76d4df not found {{(pid=120602) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:12:00.063366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:00.063536 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8d1aa183-83a0-4176-a0da-da266d83c3ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:12:00.063536 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-8451efbe-c661-4a04-bb9d-1edc9c579541'] Oct 27 09:12:00.064446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:00.066001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:00.069786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d1aa183-83a0-4176-a0da-da266d83c3ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df HTTP/1.1 Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: exception: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-8451efbe-c661-4a04-bb9d-1edc9c579541'] Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b1979e9d-8156-4222-a330-2f920f76d4df'} Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:12:00.086344 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8451efbe-c661-4a04-bb9d-1edc9c579541'] Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8451efbe-c661-4a04-bb9d-1edc9c579541'] Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8451efbe-c661-4a04-bb9d-1edc9c579541'] Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8451efbe-c661-4a04-bb9d-1edc9c579541'] Oct 27 09:12:00.090852 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:00.094497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d1aa183-83a0-4176-a0da-da266d83c3ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:12:00.094497 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-8451efbe-c661-4a04-bb9d-1edc9c579541'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:00.095686 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d1aa183-83a0-4176-a0da-da266d83c3ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df" status: 404 len: 194 microversion: 2.1 time: 0.111710 Oct 27 09:12:00.101912 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1400/2764] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:11:59 2022] GET /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:00.107398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a66b3495-d8e5-4ff0-bff4-4c29e34ef632 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Action: 'create', calling method: .version_select at 0x7f31a96ef4c0>, body: {"keypair": {"name": "tempest-keypair-468443101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcCu+BBB/MYK+NA4+D5GrrtGn9ouSh1ssKf6q8iwiVRa9L5dMrmjQhQBpqsqRg28lviGO57y/G1cNPsSayaGvOwvScJdYOoqC5+Ei6R63GA3gfZBwZ+Dew8Uu3sODNv4w=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:00.156857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a66b3495-d8e5-4ff0-bff4-4c29e34ef632 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Getting quotas for project 4c0fac9489e34375b8ecc267d00cbebd. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:12:00.170356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a66b3495-d8e5-4ff0-bff4-4c29e34ef632 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Getting quotas for user 9999a6c576f74271b47cec5e1336ec80 and project 4c0fac9489e34375b8ecc267d00cbebd. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:12:00.223759 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a66b3495-d8e5-4ff0-bff4-4c29e34ef632 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.120074 Oct 27 09:12:00.231306 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1401/2765] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Oct 27 09:12:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:12:00.243037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b0e51b10-9558-4840-9b36-14df9aa536d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: .version_select at 0x7f31a96a1160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-291192790", "description": "tempest-description-1857732374"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:00.758061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:00.773140 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e55626b1-7723-4e44-9a91-2aaf1d568f60 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1520 microversion: 2.1 time: 0.745535 Oct 27 09:12:00.774375 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1365/2766] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:00 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1520 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:00.779247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1745858892", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b27033c1-2e3e-441a-99b0-4038d19ec1ee"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:00.885931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:12:01.648630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:12:01.649135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:12:01.649685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:12:01.650317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:12:01.650808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:12:01.676521 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b0e51b10-9558-4840-9b36-14df9aa536d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.442819 Oct 27 09:12:01.677114 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1402/2767] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:12:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:01.680513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:01.681338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:01.682039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:01.682484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:01.682771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:01.683919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:01.684542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:01.685132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:01.700437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:01.700937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:01.701387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:01.702102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:01.702560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:01.702988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:01.727807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:12:01.744558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:12:01.766178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:12:01.770825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:12:01.851504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:01.856988 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b0ef636-27d2-496f-894e-1df5fa277b78 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081228 Oct 27 09:12:01.858815 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1366/2768] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:12:01.861551 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ff5337eb-697c-45b7-8263-a78af8130bc7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1266 microversion: 2.1 time: 0.183127 Oct 27 09:12:01.863907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:01.864812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:01.874092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:01.874829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:01.876302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:01.877206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:01.878477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:01.879645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:01.886618 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1403/2769] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:01 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:01.898973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3defae9-4ac4-4ca7-985f-6346236ead7f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: .version_select at 0x7f31a96fe1f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1789136980", "description": "tempest-description-742661014"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:02.232038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:02.246794 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8cc8d8b-2a8a-4cac-a45d-6228b9c2685f tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 0.384423 Oct 27 09:12:02.248435 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1367/2770] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:01 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:02.260697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:02.263596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:02.276899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:02.279181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:02.281251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:02.282205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:02.285610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:02.286287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:03.234006 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3defae9-4ac4-4ca7-985f-6346236ead7f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.345544 Oct 27 09:12:03.236173 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1404/2771] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:12:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:03.259778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:03.265986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:03.280593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:03.333799 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd85b0c4-07b3-4dbc-a4ce-9044c6f31727 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1520 microversion: 2.1 time: 1.082333 Oct 27 09:12:03.335169 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1368/2772] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:02 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1520 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:03.356226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:03.362856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:03.363592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1059913376", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "961b416b-7d5a-473c-86ba-d852a4db077b"}, {"port": "0ed98e72-a11f-447c-905c-7876d41e6951", "tag": "port-1"}, {"port": "d55c2a24-6294-46f5-9ee3-aefcef021dc6", "tag": "port-2"}, {"uuid": "6d542b76-87f8-48ac-86d0-e659070e67f6", "tag": "net-1"}, {"uuid": "6d542b76-87f8-48ac-86d0-e659070e67f6"}, {"uuid": "ff67a733-4ee8-4282-8f75-0bf5ca87156f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ff67a733-4ee8-4282-8f75-0bf5ca87156f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c69acca1-0f02-4aa9-8535-0d053bda974e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "76ebbb9b-3baa-406b-b2fa-4b51e0fb2198", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "548454cc-09d4-4d58-bf27-639c555d2e05", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--337582560"}], "key_name": "tempest-keypair-468443101", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:03.368231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:03.371175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:03.376168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:03.379365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:03.559139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:03.570250 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-95b980d6-c99d-478e-af26-c84704d9d5e8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1269 microversion: 2.1 time: 0.315675 Oct 27 09:12:03.572820 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1405/2773] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:03 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1269 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:03.579344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:03.580206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:03.587592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:03.588339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:03.588775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:03.589626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:03.590221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:03.590785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:03.708279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] validate_networks() for [('961b416b-7d5a-473c-86ba-d852a4db077b', None, None, None, None, None), (None, None, '0ed98e72-a11f-447c-905c-7876d41e6951', None, None, None), (None, None, 'd55c2a24-6294-46f5-9ee3-aefcef021dc6', None, None, None), ('6d542b76-87f8-48ac-86d0-e659070e67f6', None, None, None, None, None), ('6d542b76-87f8-48ac-86d0-e659070e67f6', None, None, None, None, None), ('ff67a733-4ee8-4282-8f75-0bf5ca87156f', '10.2.2.100', None, None, None, None), ('ff67a733-4ee8-4282-8f75-0bf5ca87156f', '10.2.2.200', None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:12:04.247750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:04.257960 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3bf4e5d5-7c9c-431f-ba99-f04168373481 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1308 microversion: 2.1 time: 0.683814 Oct 27 09:12:04.262653 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1406/2774] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:03 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1308 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:04.269103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-9851a663-5222-4b87-8997-e6180c4e3a80 req-f1a2d1be-e122-4a47-8cf7-59356d34ff44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d205865b-096d-484d-80d0-747b3b9745fa", "name": "network-vif-plugged", "status": "completed", "tag": "344fa8d3-6883-438a-8642-563fd0182641"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:04.295446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:04.297657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9851a663-5222-4b87-8997-e6180c4e3a80 req-f1a2d1be-e122-4a47-8cf7-59356d34ff44 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:04.298297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9851a663-5222-4b87-8997-e6180c4e3a80 req-f1a2d1be-e122-4a47-8cf7-59356d34ff44 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:04.298884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9851a663-5222-4b87-8997-e6180c4e3a80 req-f1a2d1be-e122-4a47-8cf7-59356d34ff44 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:04.332937 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-9851a663-5222-4b87-8997-e6180c4e3a80 req-f1a2d1be-e122-4a47-8cf7-59356d34ff44 service nova] Creating event network-vif-plugged:344fa8d3-6883-438a-8642-563fd0182641 for instance d205865b-096d-484d-80d0-747b3b9745fa on n-h1-858383-16 Oct 27 09:12:04.342155 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-9851a663-5222-4b87-8997-e6180c4e3a80 req-f1a2d1be-e122-4a47-8cf7-59356d34ff44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076477 Oct 27 09:12:04.345988 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1407/2775] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:04.372631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-22009375-978c-4823-a75a-9b763d98424c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: .version_select at 0x7f31a96a1280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-206703403", "description": "tempest-description-901403843"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:04.712488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:04.941657 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-22009375-978c-4823-a75a-9b763d98424c tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.593555 Oct 27 09:12:04.943049 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1408/2776] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:12:04 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:04.950058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:04.951254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:04.961712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:04.962658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:04.963314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:04.964373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:04.964997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:04.965630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:05.480963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:05.489041 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-470065b1-7d97-4a42-9755-87a0be5252b3 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 0.543562 Oct 27 09:12:05.511753 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1409/2777] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:04 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:05.517691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1269021620", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f506d926-48c7-451d-8629-5f6d284c2bd3"}], "security_groups": [{"name": "tempest-securitygroup--874263159"}], "key_name": "tempest-keypair-946019008", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:05.792898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] validate_networks() for [('f506d926-48c7-451d-8629-5f6d284c2bd3', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:12:06.887803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:12:06.888888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:12:06.889518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:12:06.892992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:12:06.894266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:12:06.906257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=15 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:06.916347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:06.917167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:06.917758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:06.918815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:06.919645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:06.920261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:06.948906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Getting quotas for project 1babaa8dc02a4a04b18cbe0fe7ef5377. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:12:06.957080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Getting quotas for user 0e5cea258c34423e82b53d552b21239f and project 1babaa8dc02a4a04b18cbe0fe7ef5377. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:12:06.980006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:12:06.984263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:12:07.060016 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-289fce06-d0c5-45d9-b128-ae1c89b74b7e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.544992 Oct 27 09:12:07.066538 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1410/2778] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:12:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:12:07.078429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:07.081528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:07.092341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:07.092911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:07.093456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:07.094461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:07.095091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:07.095935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:07.442137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:07.452670 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5df39702-b674-4f8f-81fb-b47919384f47 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1497 microversion: 2.1 time: 0.379250 Oct 27 09:12:07.454569 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1411/2779] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:07 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1497 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:07.461170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:07.462040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:07.468020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:07.468624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:07.469061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:07.469744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:07.470194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:07.470612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.007651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:08.015370 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f119bbfd-f906-4bb0-8fd6-7b528f26d8b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1317 microversion: 2.1 time: 0.559061 Oct 27 09:12:08.015984 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1412/2780] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:07 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:08.021114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37fe3532-7477-4991-bc06-5726a6e926e5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31ae656280>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:08.466116 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37fe3532-7477-4991-bc06-5726a6e926e5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.448948 Oct 27 09:12:08.466707 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1413/2781] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 09:12:08 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:08.472112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:08.472974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:08.480539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.481036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.481475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.482186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.482640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.483065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.683581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:08.691907 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c754dfb-3d5a-4be5-8ea1-604a41e7ef2c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1308 microversion: 2.1 time: 0.224161 Oct 27 09:12:08.692474 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1414/2782] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:08 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:08.696850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a60af536-9775-4e3d-9015-ed2665e32c4c req-afffc463-fd47-4e7f-bfcb-a2439cb4af45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f250c018-e87e-4fe3-be36-06598d515393", "tag": "1544ea5d-4a32-43b3-b89c-897d3157adc3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:08.707544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a60af536-9775-4e3d-9015-ed2665e32c4c req-afffc463-fd47-4e7f-bfcb-a2439cb4af45 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.708043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a60af536-9775-4e3d-9015-ed2665e32c4c req-afffc463-fd47-4e7f-bfcb-a2439cb4af45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.708473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a60af536-9775-4e3d-9015-ed2665e32c4c req-afffc463-fd47-4e7f-bfcb-a2439cb4af45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.720439 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a60af536-9775-4e3d-9015-ed2665e32c4c req-afffc463-fd47-4e7f-bfcb-a2439cb4af45 service nova] Creating event network-changed:1544ea5d-4a32-43b3-b89c-897d3157adc3 for instance f250c018-e87e-4fe3-be36-06598d515393 on n-h1-858383-16 Oct 27 09:12:08.725897 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a60af536-9775-4e3d-9015-ed2665e32c4c req-afffc463-fd47-4e7f-bfcb-a2439cb4af45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032286 Oct 27 09:12:08.726515 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1415/2783] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:08.732722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-9fd1f66d-4a47-4ba3-b860-a1d7a2fc42b0 req-ea3df729-7b99-45fd-87b9-b227a16e8fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d205865b-096d-484d-80d0-747b3b9745fa", "name": "network-vif-plugged", "status": "completed", "tag": "1c080fc0-f47f-4199-99fb-c95aeb769036"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:08.742999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9fd1f66d-4a47-4ba3-b860-a1d7a2fc42b0 req-ea3df729-7b99-45fd-87b9-b227a16e8fde service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.743533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9fd1f66d-4a47-4ba3-b860-a1d7a2fc42b0 req-ea3df729-7b99-45fd-87b9-b227a16e8fde service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.744136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9fd1f66d-4a47-4ba3-b860-a1d7a2fc42b0 req-ea3df729-7b99-45fd-87b9-b227a16e8fde service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.756784 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-9fd1f66d-4a47-4ba3-b860-a1d7a2fc42b0 req-ea3df729-7b99-45fd-87b9-b227a16e8fde service nova] Creating event network-vif-plugged:1c080fc0-f47f-4199-99fb-c95aeb769036 for instance d205865b-096d-484d-80d0-747b3b9745fa on n-h1-858383-16 Oct 27 09:12:08.762519 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-9fd1f66d-4a47-4ba3-b860-a1d7a2fc42b0 req-ea3df729-7b99-45fd-87b9-b227a16e8fde service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032695 Oct 27 09:12:08.762519 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1416/2784] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:08.767327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:08.768927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:08.774719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.775223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.775701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.776405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.776867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.777296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.791683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:12:08.792234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:12:08.792565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:12:08.793366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:12:08.793779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:12:08.803644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.804170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.804741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.805478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.806075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.806510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.825304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Getting quotas for project 4c0fac9489e34375b8ecc267d00cbebd. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:12:08.831409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Getting quotas for user 9999a6c576f74271b47cec5e1336ec80 and project 4c0fac9489e34375b8ecc267d00cbebd. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:12:08.921160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:08.929450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e976982-b644-4912-a260-a2784c687ca8 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 0.166028 Oct 27 09:12:08.930028 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1417/2785] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:08 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:08.934709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-92f4b386-83f7-4695-8b9e-10a2be6d1675 req-61a188fa-5b61-4520-b59b-a22df11ee6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae674039-cf22-428c-9b75-466061b9d46b", "tag": "576a0cdb-2cf3-4a70-b166-3c04ce0c32e6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:08.944923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-92f4b386-83f7-4695-8b9e-10a2be6d1675 req-61a188fa-5b61-4520-b59b-a22df11ee6c1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.945493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-92f4b386-83f7-4695-8b9e-10a2be6d1675 req-61a188fa-5b61-4520-b59b-a22df11ee6c1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.945827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-92f4b386-83f7-4695-8b9e-10a2be6d1675 req-61a188fa-5b61-4520-b59b-a22df11ee6c1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.956949 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-92f4b386-83f7-4695-8b9e-10a2be6d1675 req-61a188fa-5b61-4520-b59b-a22df11ee6c1 service nova] Creating event network-changed:576a0cdb-2cf3-4a70-b166-3c04ce0c32e6 for instance ae674039-cf22-428c-9b75-466061b9d46b on n-h2-858383-16 Oct 27 09:12:08.961665 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-92f4b386-83f7-4695-8b9e-10a2be6d1675 req-61a188fa-5b61-4520-b59b-a22df11ee6c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030556 Oct 27 09:12:08.962254 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1418/2786] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:08.967323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:08.968046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:08.974616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.975104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.975545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.976261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:08.976721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:08.977142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:08.986004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:12:08.989524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c69acca1-0f02-4aa9-8535-0d053bda974e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='76ebbb9b-3baa-406b-b2fa-4b51e0fb2198',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='548454cc-09d4-4d58-bf27-639c555d2e05',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:12:09.047769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:09.056559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:09.057999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:09.059356 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c13e3e7e-f724-40b8-b699-734be14179cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1333 microversion: 2.20 time: 0.095980 Oct 27 09:12:09.059926 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1419/2787] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:08 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:09.164717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85dde721-3931-48b8-a407-636d15e7dc72 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Action: 'create', calling method: .version_select at 0x7f31ae4adf70>, body: {"keypair": {"name": "tempest-keypair-205875907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBBm7Q0jt/uzKQ+UNuSy3/qYew5csPqjAvtoD5f4TqUWyV17z81PcKg1DLBrJrqsykJqpBxn2ppw1k/DYE5hIuKXQxxTdgzfI8EX+/R2uSg4QVISEpfiCS8WQFxWIqx2Q=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:09.181103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-85dde721-3931-48b8-a407-636d15e7dc72 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Getting quotas for project f1472f8bee2d4303adf611315bcc6215. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:12:09.186542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-85dde721-3931-48b8-a407-636d15e7dc72 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Getting quotas for user 2e26a9a64a304845834c1c969e9a0131 and project f1472f8bee2d4303adf611315bcc6215. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:12:09.210564 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85dde721-3931-48b8-a407-636d15e7dc72 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149574 Oct 27 09:12:09.211240 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1420/2788] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:12:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:09.215920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:09.221065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:09.222540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:09.228757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:09.229236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:09.229724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:09.230442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:09.230895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:09.231318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:09.262950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:12:09.283383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:09.298034 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e24da06e-2621-4ada-b35b-a758666c4a6f tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.085670 Oct 27 09:12:09.298818 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1421/2789] 10.222.0.25 () {58 vars in 1154 bytes} [Thu Oct 27 09:12:09 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:09.303448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cc6b2853-dab5-405e-953b-cc75fb54cfec tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31a968edc0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:09.333013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fdf995c-0125-4a15-8eac-b49fadc1296c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.994221 Oct 27 09:12:09.334102 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1369/2790] 10.222.0.25 () {62 vars in 1189 bytes} [Thu Oct 27 09:12:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 5998 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:12:09.339090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:09.340220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:09.347465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:09.348199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:09.348686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:09.349385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:09.349997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:09.350419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:09.611837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:09.632168 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a947f11-a83c-4bde-b1de-c5c088dcd97d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1317 microversion: 2.1 time: 0.296582 Oct 27 09:12:09.633222 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1370/2791] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:09 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:09.638834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7e311ce-5d9b-4c70-bb7c-746b5d18485e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:09.647099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7e311ce-5d9b-4c70-bb7c-746b5d18485e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:09.647935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7e311ce-5d9b-4c70-bb7c-746b5d18485e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:09.648577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7e311ce-5d9b-4c70-bb7c-746b5d18485e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:09.678271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:09.689618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7e311ce-5d9b-4c70-bb7c-746b5d18485e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Going to try to start instance {{(pid=120603) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 09:12:09.753404 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7e311ce-5d9b-4c70-bb7c-746b5d18485e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "POST /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403/action" status: 202 len: 0 microversion: 2.1 time: 0.118148 Oct 27 09:12:09.756807 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1371/2792] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:12:09 2022] POST /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:12:09.762530 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cc6b2853-dab5-405e-953b-cc75fb54cfec tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/0b39f3e3-5f06-4948-be79-5abf998f13de" status: 202 len: 0 microversion: 2.1 time: 0.462704 Oct 27 09:12:09.766925 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1422/2793] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:12:09 2022] DELETE /compute/v2.1/os-security-groups/0b39f3e3-5f06-4948-be79-5abf998f13de => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:12:09.772118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:09.772837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:09.780324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63143b22-6d0e-45e3-ae8b-0f739e85e20b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:09.780587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:09.781082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:09.781521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:09.781868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63143b22-6d0e-45e3-ae8b-0f739e85e20b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:09.782479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:09.782945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:09.784034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:09.857349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-63143b22-6d0e-45e3-ae8b-0f739e85e20b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:09.866761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-63143b22-6d0e-45e3-ae8b-0f739e85e20b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:09.868774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-63143b22-6d0e-45e3-ae8b-0f739e85e20b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:09.870353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63143b22-6d0e-45e3-ae8b-0f739e85e20b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1285 microversion: 2.42 time: 0.114023 Oct 27 09:12:09.871637 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1372/2794] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:09 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:09.876394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:09.877263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:09.885035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:09.885731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:09.886189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:09.886919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:09.887347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:09.887940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:10.052404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:10.063437 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1a2a7da3-1f36-41f2-a823-5e22208c9e6e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1308 microversion: 2.1 time: 0.296115 Oct 27 09:12:10.064629 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1423/2795] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:09 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:10.072129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8304561e-a908-4df2-a02a-6da99b4da82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31a96feb80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:10.084435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:10.092362 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5319a629-2f0f-4a75-b8ff-169d7d869d18 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1506 microversion: 2.1 time: 0.219349 Oct 27 09:12:10.093046 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1373/2796] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:09 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:10.097567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:10.098175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:10.104153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:10.105051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:10.105197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:10.105783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:10.106239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:10.107058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:10.129190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-8304561e-a908-4df2-a02a-6da99b4da82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:12:10.130055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.security_group_api [None req-8304561e-a908-4df2-a02a-6da99b4da82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group 0b39f3e3-5f06-4948-be79-5abf998f13de not found {{(pid=120602) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:12:10.130782 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8304561e-a908-4df2-a02a-6da99b4da82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:12:10.130782 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-1b921a50-2d1e-4e8b-85af-13e878a0b849'] Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8304561e-a908-4df2-a02a-6da99b4da82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-security-groups/0b39f3e3-5f06-4948-be79-5abf998f13de HTTP/1.1 Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: exception: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-1b921a50-2d1e-4e8b-85af-13e878a0b849'] Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '0b39f3e3-5f06-4948-be79-5abf998f13de'} Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:12:10.134034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b921a50-2d1e-4e8b-85af-13e878a0b849'] Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b921a50-2d1e-4e8b-85af-13e878a0b849'] Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b921a50-2d1e-4e8b-85af-13e878a0b849'] Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b921a50-2d1e-4e8b-85af-13e878a0b849'] Oct 27 09:12:10.137696 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:10.142158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8304561e-a908-4df2-a02a-6da99b4da82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:12:10.142158 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-1b921a50-2d1e-4e8b-85af-13e878a0b849'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:10.143933 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8304561e-a908-4df2-a02a-6da99b4da82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/0b39f3e3-5f06-4948-be79-5abf998f13de" status: 404 len: 194 microversion: 2.1 time: 0.076093 Oct 27 09:12:10.147977 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1424/2797] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:12:10 2022] GET /compute/v2.1/os-security-groups/0b39f3e3-5f06-4948-be79-5abf998f13de => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:10.153195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:10.154272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:10.167944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:10.168760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:10.169325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:10.170185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:10.170652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:10.171345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:10.320764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:10.348232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2171014f-59d0-476a-9a4c-a3e4ef8285db tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1334 microversion: 2.1 time: 0.254185 Oct 27 09:12:10.360143 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1374/2798] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:10 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1334 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:10.371046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6280d7b-0d4c-4359-8b1e-0b024bab0da1 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31a991d550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:10.636999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:10.652583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:10.665145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:10.667008 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed84b8b6-e832-4f08-8f0c-76a7a7387386 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1333 microversion: 2.20 time: 0.517563 Oct 27 09:12:10.669840 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1425/2799] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:10 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1333 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:10.675942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:10.676562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:10.692960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:10.693532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:10.693989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:10.694711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:10.695173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:10.695626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:10.964985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:10.977757 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6280d7b-0d4c-4359-8b1e-0b024bab0da1 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5919524d-f468-4abb-abd1-4dd0e7e46e6a" status: 202 len: 0 microversion: 2.1 time: 0.614694 Oct 27 09:12:10.978499 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1375/2800] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:12:10 2022] DELETE /compute/v2.1/os-security-groups/5919524d-f468-4abb-abd1-4dd0e7e46e6a => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:12:10.987770 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0d81997-95de-4391-bc63-8c7972bcf106 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1317 microversion: 2.1 time: 0.314275 Oct 27 09:12:10.988502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:10.988726 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1426/2801] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:10 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:10.989590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:10.998540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f61dae26-4b97-4319-902a-95bca438aac6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31a964adc0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:11.016051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:11.017517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:11.018700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:11.020522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:11.021156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:11.021741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:11.036794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-f61dae26-4b97-4319-902a-95bca438aac6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:12:11.038102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.security_group_api [None req-f61dae26-4b97-4319-902a-95bca438aac6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a not found {{(pid=120602) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:12:11.039023 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f61dae26-4b97-4319-902a-95bca438aac6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:12:11.039023 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-501e7ce1-78ac-46ef-babb-37ae935de110'] Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f61dae26-4b97-4319-902a-95bca438aac6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-security-groups/5919524d-f468-4abb-abd1-4dd0e7e46e6a HTTP/1.1 Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: exception: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-501e7ce1-78ac-46ef-babb-37ae935de110'] Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5919524d-f468-4abb-abd1-4dd0e7e46e6a'} Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:12:11.042626 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-501e7ce1-78ac-46ef-babb-37ae935de110'] Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-501e7ce1-78ac-46ef-babb-37ae935de110'] Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-501e7ce1-78ac-46ef-babb-37ae935de110'] Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-501e7ce1-78ac-46ef-babb-37ae935de110'] Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f61dae26-4b97-4319-902a-95bca438aac6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-501e7ce1-78ac-46ef-babb-37ae935de110'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:11.046750 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f61dae26-4b97-4319-902a-95bca438aac6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/5919524d-f468-4abb-abd1-4dd0e7e46e6a" status: 404 len: 194 microversion: 2.1 time: 0.055912 Oct 27 09:12:11.049234 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1427/2802] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:12:10 2022] GET /compute/v2.1/os-security-groups/5919524d-f468-4abb-abd1-4dd0e7e46e6a => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:11.057603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b2d4b5d1-4598-44e8-b676-c869fed2c74f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31a96feca0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:11.224045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:11.253526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:11.256470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:11.258300 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73dc071e-4284-48d7-98c3-b6e7c150ba50 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1519 microversion: 2.42 time: 0.275591 Oct 27 09:12:11.259709 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1376/2803] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:10 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:11.265057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:11.266275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:11.277205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:11.278033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:11.278750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:11.280663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:11.281323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:11.281950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:11.731776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:11.745327 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2aedf72-c57c-4948-b209-c978e16fa882 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1308 microversion: 2.1 time: 0.480443 Oct 27 09:12:11.745982 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1377/2804] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:11 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:11.755671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:11.756290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:11.775424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:11.776206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:11.776652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:11.777353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:11.777807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:11.778227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.042211 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b2d4b5d1-4598-44e8-b676-c869fed2c74f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/def324a4-5780-4715-8a83-ec636dca8dde" status: 202 len: 0 microversion: 2.1 time: 0.989944 Oct 27 09:12:12.042845 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1428/2805] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:12:11 2022] DELETE /compute/v2.1/os-security-groups/def324a4-5780-4715-8a83-ec636dca8dde => generated 0 bytes in 992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:12:12.050241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:12.050930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:12.056966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.057598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.058104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.059151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.059705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.060226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.092157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:12.100764 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f2dba2a2-e4a4-4b77-97ca-33daaa609fc2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1506 microversion: 2.1 time: 0.353735 Oct 27 09:12:12.101344 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1378/2806] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:11 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:12.109855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:12.110858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:12.117507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.117992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.118431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.119127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.119598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.120029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.253304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:12.265751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:12.269487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:12.270991 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b14cbb46-ae64-45b2-84e1-af421e288ec7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1339 microversion: 2.20 time: 0.164879 Oct 27 09:12:12.272147 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1379/2807] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:12 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:12.277529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:12.278330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:12.286912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.287537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.288010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.288908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.289384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.290048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.352881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:12.363487 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f5545dc-72e3-40a3-8720-8d290b62847e tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1671 microversion: 2.1 time: 0.319546 Oct 27 09:12:12.364105 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1429/2808] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:12 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1671 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:12.368715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-27042385", "imageRef": "84411cc0-0f77-4130-87f5-baa490c0de78", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9e2bdb91-9942-4d1c-abe5-32300fcb9872"}], "security_groups": [{"name": "tempest-securitygroup--987683032"}], "key_name": "tempest-keypair-205875907", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:12.564082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:12.573018 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-393c2ec6-751d-4658-9fdb-efac87b52264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1317 microversion: 2.1 time: 0.299592 Oct 27 09:12:12.573600 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1380/2809] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:12 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:12.579020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49ffc768-94f5-47e0-b518-235c7e866d60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31a991da60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:12.603841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] validate_networks() for [('9e2bdb91-9942-4d1c-abe5-32300fcb9872', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:12:12.667718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-49ffc768-94f5-47e0-b518-235c7e866d60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:12:12.668396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.security_group_api [None req-49ffc768-94f5-47e0-b518-235c7e866d60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group def324a4-5780-4715-8a83-ec636dca8dde not found {{(pid=120603) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:12:12.669249 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-49ffc768-94f5-47e0-b518-235c7e866d60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:12:12.669249 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-d8711cca-465a-400c-aa47-52261bd6c4c7'] Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49ffc768-94f5-47e0-b518-235c7e866d60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-security-groups/def324a4-5780-4715-8a83-ec636dca8dde HTTP/1.1 Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: exception: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-d8711cca-465a-400c-aa47-52261bd6c4c7'] Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'def324a4-5780-4715-8a83-ec636dca8dde'} Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:12:12.671379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8711cca-465a-400c-aa47-52261bd6c4c7'] Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8711cca-465a-400c-aa47-52261bd6c4c7'] Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8711cca-465a-400c-aa47-52261bd6c4c7'] Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8711cca-465a-400c-aa47-52261bd6c4c7'] Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49ffc768-94f5-47e0-b518-235c7e866d60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-d8711cca-465a-400c-aa47-52261bd6c4c7'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:12.674898 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49ffc768-94f5-47e0-b518-235c7e866d60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/def324a4-5780-4715-8a83-ec636dca8dde" status: 404 len: 194 microversion: 2.1 time: 0.098762 Oct 27 09:12:12.680676 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1381/2810] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:12:12 2022] GET /compute/v2.1/os-security-groups/def324a4-5780-4715-8a83-ec636dca8dde => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:12.684465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:12.685158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:12.693012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.693513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.693992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.694736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.695196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.695678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.816967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:12.826690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:12.828522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:12.830005 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a07d66e-533a-43f8-99fa-19721a1299dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1593 microversion: 2.42 time: 0.150153 Oct 27 09:12:12.843279 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1382/2811] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:12 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:12.850971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a508a59-4893-408b-8c43-e4c1cf9440a2 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:12.851763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a508a59-4893-408b-8c43-e4c1cf9440a2 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:12.857885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a508a59-4893-408b-8c43-e4c1cf9440a2 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.858472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a508a59-4893-408b-8c43-e4c1cf9440a2 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.858985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a508a59-4893-408b-8c43-e4c1cf9440a2 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.860124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a508a59-4893-408b-8c43-e4c1cf9440a2 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:12.860808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a508a59-4893-408b-8c43-e4c1cf9440a2 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:12.861323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a508a59-4893-408b-8c43-e4c1cf9440a2 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:12.886378 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a508a59-4893-408b-8c43-e4c1cf9440a2 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa/ips" status: 200 len: 181 microversion: 2.1 time: 0.041281 Oct 27 09:12:12.887249 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1383/2812] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:12:12 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa/ips => generated 181 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:12.892095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5aaca438-3611-40b4-b5f6-0577aba9df8f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aa286670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:13.881067 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5aaca438-3611-40b4-b5f6-0577aba9df8f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.992410 Oct 27 09:12:13.882398 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1384/2813] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 09:12:12 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:13.900212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:13.901042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:13.909909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:13.910411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:13.910857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:13.911594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:13.912240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:13.912685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:13.965171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:12:13.965715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:12:13.966127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:12:13.966695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:12:13.967112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:12:13.977275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:13.977779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:13.978223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:13.978963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:13.979775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:13.979914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.001430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Getting quotas for project f1472f8bee2d4303adf611315bcc6215. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:12:14.006967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Getting quotas for user 2e26a9a64a304845834c1c969e9a0131 and project f1472f8bee2d4303adf611315bcc6215. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:12:14.022033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:12:14.024927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='84411cc0-0f77-4130-87f5-baa490c0de78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:12:14.097517 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f890ecf-ceda-42d5-b27f-89216d929f31 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.732029 Oct 27 09:12:14.099107 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1430/2814] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:12:14.104634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:14.106539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:14.117645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.118218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.118676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.121535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.123415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.124274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.204508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:14.208217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:12:14.218309 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc049ad8-0bfe-4777-bcc3-69dad0c482a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1308 microversion: 2.1 time: 0.322219 Oct 27 09:12:14.219434 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1385/2815] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:13 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1308 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:14.226036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:14.229110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:14.237955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.239211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.239856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.241081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.241855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.242491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.326523 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f62eef6-281f-4300-9936-fd633eef0a58 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 204 len: 0 microversion: 2.1 time: 0.225892 Oct 27 09:12:14.332695 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1431/2816] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:12:14 2022] DELETE /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:12:14.348817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:14.349846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:14.356845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.357639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.358283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.359787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.360449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.361036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.741402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:14.752457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:14.754945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:14.756394 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f57d82b1-fa0f-40d1-a079-a640ec0d45b4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1406 microversion: 2.20 time: 0.413520 Oct 27 09:12:14.758180 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1432/2817] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:14 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:14.764261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8cc10296-9886-4345-8158-48891b902f13 req-90989b10-5342-46c2-a1fb-1d60920379cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f250c018-e87e-4fe3-be36-06598d515393", "name": "network-vif-plugged", "status": "completed", "tag": "1544ea5d-4a32-43b3-b89c-897d3157adc3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:14.775591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8cc10296-9886-4345-8158-48891b902f13 req-90989b10-5342-46c2-a1fb-1d60920379cc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.777287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8cc10296-9886-4345-8158-48891b902f13 req-90989b10-5342-46c2-a1fb-1d60920379cc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.778148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8cc10296-9886-4345-8158-48891b902f13 req-90989b10-5342-46c2-a1fb-1d60920379cc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.792107 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8cc10296-9886-4345-8158-48891b902f13 req-90989b10-5342-46c2-a1fb-1d60920379cc service nova] Creating event network-vif-plugged:1544ea5d-4a32-43b3-b89c-897d3157adc3 for instance f250c018-e87e-4fe3-be36-06598d515393 on n-h1-858383-16 Oct 27 09:12:14.799149 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8cc10296-9886-4345-8158-48891b902f13 req-90989b10-5342-46c2-a1fb-1d60920379cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039324 Oct 27 09:12:14.800711 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1433/2818] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:14.806675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:14.807533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:14.811031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:14.817629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.818241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.818769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.820702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.821304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.821838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.824967 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92fe7c2a-cf68-48b0-abb1-87995b5ca9c5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1510 microversion: 2.1 time: 0.603344 Oct 27 09:12:14.825746 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1386/2819] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:14 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1510 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:14.830798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:14.831398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:14.838070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:14.839852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.840525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.841133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.841992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:14.842616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:14.843923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:14.990814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:15.001144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:15.002683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:15.003860 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33fce6a4-aa00-47a7-bc6d-2ef66ba98e46 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1593 microversion: 2.42 time: 0.176999 Oct 27 09:12:15.004419 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1387/2820] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:14 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1593 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:15.009426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e51f254-f7d1-4360-9d2f-2fa1926c57dd tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: .version_select at 0x7f31a9949040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1434421770", "description": "tempest-description-1992336729"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:15.218103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:15.227945 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-418938a3-5491-4fbe-86fe-6abf405cfc4c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1317 microversion: 2.1 time: 0.425919 Oct 27 09:12:15.228614 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1434/2821] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:14 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:15.237850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:15.238917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:15.246795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:15.247402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:15.247958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:15.248846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:15.249394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:15.250068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:15.384227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:15.395425 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7bf738d6-6ffc-481d-8518-2a2732011371 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1247 microversion: 2.1 time: 0.165444 Oct 27 09:12:15.396458 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1435/2822] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:15 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1247 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:15.414087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:15.414846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:15.421111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:15.421730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:15.422276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:15.423105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:15.423699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:15.424297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:15.620428 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e51f254-f7d1-4360-9d2f-2fa1926c57dd tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.614240 Oct 27 09:12:15.622001 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1388/2823] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:12:15 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:15.627914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:15.645798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:15.646358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.servers [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Removing options 'limit' from query {{(pid=120603) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 09:12:15.647062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:15.648676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:15.648836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:15.649240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:15.649992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:15.650456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:15.652315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:15.666105 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb9a5507-355b-4c15-a48d-f95aad7a1dc4 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.030477 Oct 27 09:12:15.676050 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1389/2824] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Oct 27 09:12:15 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:12:15.681694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:15.682484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:15.690722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:15.693506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:15.694150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:15.694887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:15.695382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:15.695923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:15.866476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:15.884163 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-339c1dc4-705b-4838-8221-4b8f5e2134b6 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1677 microversion: 2.1 time: 0.486009 Oct 27 09:12:15.884900 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1436/2825] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:15 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1677 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:15.890216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7ed69a7-5639-445d-9ed4-8d236bc94334 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: .version_select at 0x7f31a96a1dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1763966829", "description": "tempest-description-1921238565"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:16.100248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:16.109977 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b8ed7a8-cf95-467c-87c3-f22a35b0df9a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1308 microversion: 2.1 time: 0.432341 Oct 27 09:12:16.110581 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1390/2826] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:15 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:16.122766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:16.124204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:16.131388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:16.132164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:16.132623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:16.133429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:16.134300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:16.134922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:16.509481 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d7ed69a7-5639-445d-9ed4-8d236bc94334 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.623126 Oct 27 09:12:16.523329 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1437/2827] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:12:15 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:16.547973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:16.550616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:16.569537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:16.571089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:16.571657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:16.573479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:16.575648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:16.576289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:16.589534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:16.601388 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-581b95b1-0a5b-4249-a3df-20743f2d19dd tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1510 microversion: 2.1 time: 0.485983 Oct 27 09:12:16.602516 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1391/2828] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:16 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1510 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:16.621034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:16.621956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:16.628840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:16.629557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:16.630168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:16.631042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:16.636117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:16.636811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:17.028288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:17.037701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:17.039481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:17.040670 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49ceb042-3cf4-4222-8692-659fce03758d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1406 microversion: 2.20 time: 0.510364 Oct 27 09:12:17.041238 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1438/2829] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:16 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:17.045713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:17.046516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:17.053405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:17.054113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:17.054733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:17.055619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:17.056229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:17.056829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:17.191677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:17.215157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:17.217987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:17.219466 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1e47e69-60e4-48c3-9cf7-f06d9f2804d5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1660 microversion: 2.42 time: 0.615963 Oct 27 09:12:17.223676 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1392/2830] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:16 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1660 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:17.230030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:17.237783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:17.250074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:17.252239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:17.253075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:17.253743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:17.254523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:17.257514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:17.320108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:17.504838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:17.512872 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-52736492-b0d8-4e42-8394-b84a411390e2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1295 microversion: 2.1 time: 0.287735 Oct 27 09:12:17.513466 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1393/2831] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:17 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1295 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:17.547322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-51e16625-130b-44e3-995d-28c8433ebe80 req-fe2216c9-c419-4251-a059-897feb09f1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f468cf4-43cf-4bba-bfcb-0f725bf735e3", "tag": "e537d4a4-12d3-46d5-b30a-f4aa9120f51e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:17.569933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51e16625-130b-44e3-995d-28c8433ebe80 req-fe2216c9-c419-4251-a059-897feb09f1f4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:17.570422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51e16625-130b-44e3-995d-28c8433ebe80 req-fe2216c9-c419-4251-a059-897feb09f1f4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:17.570862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51e16625-130b-44e3-995d-28c8433ebe80 req-fe2216c9-c419-4251-a059-897feb09f1f4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:17.607471 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-51e16625-130b-44e3-995d-28c8433ebe80 req-fe2216c9-c419-4251-a059-897feb09f1f4 service nova] Creating event network-changed:e537d4a4-12d3-46d5-b30a-f4aa9120f51e for instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 on n-h2-858383-16 Oct 27 09:12:17.611258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:17.615820 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-51e16625-130b-44e3-995d-28c8433ebe80 req-fe2216c9-c419-4251-a059-897feb09f1f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077707 Oct 27 09:12:17.616688 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1394/2832] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:17.623887 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9ed488a4-06b0-4486-adc3-8352ecca547f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1317 microversion: 2.1 time: 0.578384 Oct 27 09:12:17.625096 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1439/2833] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:17 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:17.625477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:17.626272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:17.642367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-349278748", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7be7c07a-f27c-47fe-ada6-01c34a9cf95a"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:17.655449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:17.657962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:17.659761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:17.661032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:17.663169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:17.664969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:17.665885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:17.804383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] validate_networks() for [('7be7c07a-f27c-47fe-ada6-01c34a9cf95a', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:12:18.088913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:18.098514 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2180285d-5ccb-462f-9428-a2a6ff12890e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996" status: 200 len: 1512 microversion: 2.1 time: 0.480448 Oct 27 09:12:18.135969 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1395/2834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:17 2022] GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996 => generated 1512 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:18.147136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-362a7d7d-5576-463c-a3ec-cbdc789d8a11 req-075a2ad9-92f0-4d1e-99f8-f64fdb0332d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae674039-cf22-428c-9b75-466061b9d46b", "name": "network-vif-plugged", "status": "completed", "tag": "576a0cdb-2cf3-4a70-b166-3c04ce0c32e6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:18.172433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-362a7d7d-5576-463c-a3ec-cbdc789d8a11 req-075a2ad9-92f0-4d1e-99f8-f64fdb0332d6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:18.173210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-362a7d7d-5576-463c-a3ec-cbdc789d8a11 req-075a2ad9-92f0-4d1e-99f8-f64fdb0332d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:18.173879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-362a7d7d-5576-463c-a3ec-cbdc789d8a11 req-075a2ad9-92f0-4d1e-99f8-f64fdb0332d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:18.200909 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-362a7d7d-5576-463c-a3ec-cbdc789d8a11 req-075a2ad9-92f0-4d1e-99f8-f64fdb0332d6 service nova] Creating event network-vif-plugged:576a0cdb-2cf3-4a70-b166-3c04ce0c32e6 for instance ae674039-cf22-428c-9b75-466061b9d46b on n-h2-858383-16 Oct 27 09:12:18.223125 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-362a7d7d-5576-463c-a3ec-cbdc789d8a11 req-075a2ad9-92f0-4d1e-99f8-f64fdb0332d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075150 Oct 27 09:12:18.225642 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1396/2835] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:18.239507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:18.240535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:18.264718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:18.266961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:18.267674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:18.269647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:18.272332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:18.275659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:18.724078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b198587da845bf9237a28f784ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dde0075cf74c558c4b6462803c15e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:18.733208 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0e4d774-7309-4129-826f-54d02c060465 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 200 len: 1298 microversion: 2.1 time: 0.505732 Oct 27 09:12:18.744212 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1397/2836] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:18 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 1298 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:18.755509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:18.756500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:18.762928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:18.763912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:18.765410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:18.766609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:18.767369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:18.768042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:18.819507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=9 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:18.966711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:12:18.967813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:12:18.968299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:12:18.968720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:12:18.969139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:12:18.981225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:18.981739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:18.982188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:18.983086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:18.984025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:18.984649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.000988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:19.007523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Getting quotas for project 058070ef4084432b9a1dc94df7f7b17c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:12:19.009656 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9bf299ba-6831-4dd3-9db7-614e1478f1ac tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1308 microversion: 2.1 time: 0.264074 Oct 27 09:12:19.010249 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1398/2837] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:18 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:19.014634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Getting quotas for user 8141cfe0a1b448ba9812a8ebe6e3d714 and project 058070ef4084432b9a1dc94df7f7b17c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:12:19.016692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-539a9759-2da0-4a8e-9bf5-3a4dd1a824a5 req-9da71f30-6e22-4a40-a1fc-1bc55416c8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d205865b-096d-484d-80d0-747b3b9745fa", "name": "network-vif-deleted", "tag": "344fa8d3-6883-438a-8642-563fd0182641"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:19.027804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-539a9759-2da0-4a8e-9bf5-3a4dd1a824a5 req-9da71f30-6e22-4a40-a1fc-1bc55416c8be service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:19.028501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-539a9759-2da0-4a8e-9bf5-3a4dd1a824a5 req-9da71f30-6e22-4a40-a1fc-1bc55416c8be service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:19.029129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-539a9759-2da0-4a8e-9bf5-3a4dd1a824a5 req-9da71f30-6e22-4a40-a1fc-1bc55416c8be service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.044098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:12:19.044665 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-539a9759-2da0-4a8e-9bf5-3a4dd1a824a5 req-9da71f30-6e22-4a40-a1fc-1bc55416c8be service nova] Creating event network-vif-deleted:344fa8d3-6883-438a-8642-563fd0182641 for instance d205865b-096d-484d-80d0-747b3b9745fa on n-h1-858383-16 Oct 27 09:12:19.047299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:12:19.051371 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-539a9759-2da0-4a8e-9bf5-3a4dd1a824a5 req-9da71f30-6e22-4a40-a1fc-1bc55416c8be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038487 Oct 27 09:12:19.052545 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1399/2838] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:19.058737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:19.060049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:19.067614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:19.068362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:19.068991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.069876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:19.071086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:19.071725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.110234 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ca1bd06c-8b20-4a1a-bf71-a295bce67150 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482492 Oct 27 09:12:19.111498 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1440/2839] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:12:19.116974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:19.117907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:19.125463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:19.126896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:19.128051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.129200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:19.129950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:19.130713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.462762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:19.471663 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d7feb4d8-b703-4e5e-bb52-d061effbf18c tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1512 microversion: 2.1 time: 0.358646 Oct 27 09:12:19.484693 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1441/2840] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:19 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:19.485263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:19.485710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:19.485710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:19.495074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:19.496815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:19.499416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:19.499582 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1fa3e2bf-91a1-471f-89ee-833f9db5f2db tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1406 microversion: 2.20 time: 0.445490 Oct 27 09:12:19.500020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:19.500433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.500895 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1400/2841] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:19 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:19.501178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:19.508537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:19.509095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.526936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:19.528944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:19.546234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:19.548119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:19.574381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.588470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:19.589135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:19.589591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:19.863109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=22 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:19.925424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:19.954577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:19.960255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:19.966432 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-188a753e-bf4f-4264-95ae-e378aeb7bb43 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1706 microversion: 2.42 time: 0.485732 Oct 27 09:12:19.972359 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1442/2842] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:19 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1706 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:19.987308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:19.997985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:20.021312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:20.022249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:20.024842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:20.026221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:20.028595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:20.031400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:20.079849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:20.090905 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f333081-92e2-4ee3-907e-8adb32b69bae tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 0.588896 Oct 27 09:12:20.110121 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1401/2843] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:19 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:20.117477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d012078a-c253-4c37-94d5-9353e2bba470 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:20.125682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d012078a-c253-4c37-94d5-9353e2bba470 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:20.240156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d012078a-c253-4c37-94d5-9353e2bba470 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:20.257191 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d012078a-c253-4c37-94d5-9353e2bba470 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1215 microversion: 2.1 time: 0.143326 Oct 27 09:12:20.261079 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1402/2844] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:20 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:20.280031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:20.300540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:20.301834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:20.370812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:20.374980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:20.387138 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f5fb589c-b393-4275-8426-f9de96102d88 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1467 microversion: 2.1 time: 0.412826 Oct 27 09:12:20.408423 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1443/2845] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:19 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1467 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:20.414070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:20.414954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:20.432239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:20.433130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:20.438612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:20.439398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:20.439955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:20.440395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:20.478253 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] HTTP exception thrown: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Request method failure captured: Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa HTTP/1.1 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrgQo3azoqDUvI3cHBO3JP0ThGruhjURF-JSJPs2X781_uaysHzfY3hH83K11G-_4vWTrnf7nyl0SRpw3go6L3HPPps39-TdpgN1QNusX-6LEJk7o-aRVjE129ytJaxqmRRoecTpQcb61bMVRxneKZBArGdVOOFeRfEHNIarh3GeyA Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/58dde0075cf74c558c4b6462803c15e2"}]}] Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: a3b198587da845bf9237a28f784ae448 Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd205865b-096d-484d-80d0-747b3b9745fa'} Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:20.482694 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:20.487377 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:20.487377 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:20.487377 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:20.487377 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:20.487377 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:20.487377 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:20.487377 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:20.489042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Returning 404 to user: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:20.492213 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7bf600d8-9b3b-4fc7-9200-c635037d2571 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 404 len: 111 microversion: 2.1 time: 0.081833 Oct 27 09:12:20.509053 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1444/2846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:20 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:20.524604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:20.531920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:20.532658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:20.533381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:20.534795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:20.536225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:20.539293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:20.540079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:20.554177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:20.554682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:20.555130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:20.555885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:20.556349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:20.556786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:20.768678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:12:20.967822 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8340c561-d476-44ad-9eb2-18d229a54a49 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.704543 Oct 27 09:12:20.968946 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1403/2847] 10.222.0.25 () {58 vars in 1154 bytes} [Thu Oct 27 09:12:20 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:20.974185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3362286-b969-4248-bd16-58073dfd8216 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:20.990220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3362286-b969-4248-bd16-58073dfd8216 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:21.013507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3362286-b969-4248-bd16-58073dfd8216 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:21.019363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3362286-b969-4248-bd16-58073dfd8216 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:21.019996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3362286-b969-4248-bd16-58073dfd8216 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:21.020883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3362286-b969-4248-bd16-58073dfd8216 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:21.021467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3362286-b969-4248-bd16-58073dfd8216 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:21.022012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3362286-b969-4248-bd16-58073dfd8216 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:22.158404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:22.206702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-11dfa009-a320-42af-82e1-7cf4389d27e6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1308 microversion: 2.1 time: 1.693754 Oct 27 09:12:22.240149 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1445/2848] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:20 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1308 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:22.262249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:22.264337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:22.274247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:22.275046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:22.276083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:22.277378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:22.278026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:22.278652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:23.223722 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3362286-b969-4248-bd16-58073dfd8216 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1620 microversion: 2.1 time: 2.242969 Oct 27 09:12:23.229666 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1404/2849] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:20 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1620 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:23.258284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:23.281954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:23.301563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:23.309647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:23.310357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:23.311280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:23.317353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:23.319608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:23.348602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:23.359052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:23.365412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:23.370037 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a97cb8b-a87b-4b40-86b0-4f13935bd48d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1406 microversion: 2.20 time: 1.125030 Oct 27 09:12:23.370972 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1446/2850] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:22 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1406 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:23.390198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:23.391096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:23.401863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:23.404890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:23.405581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:23.411373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:23.413928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:23.414712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:24.331842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:24.355905 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-56da5419-3702-4cd1-8497-38e89ad01619 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1510 microversion: 2.1 time: 1.122961 Oct 27 09:12:24.358395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:24.372799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:24.373657 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1405/2851] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:23 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1510 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:24.390002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:24.392087 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3cc1fd80-0f94-4622-bb29-5c83dfd653ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1752 microversion: 2.42 time: 1.019921 Oct 27 09:12:24.396415 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1447/2852] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:23 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1752 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:24.406863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-dcf1b203-8fc3-464b-8fe2-4f29ba6aa2c3 req-aed1fd8e-27f0-4f82-9a4b-a255c1359259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d205865b-096d-484d-80d0-747b3b9745fa", "name": "network-vif-deleted", "tag": "1c080fc0-f47f-4199-99fb-c95aeb769036"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:24.407149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:24.413355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:24.438463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:24.439755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:24.440825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:24.442698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:24.443686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-dcf1b203-8fc3-464b-8fe2-4f29ba6aa2c3 req-aed1fd8e-27f0-4f82-9a4b-a255c1359259 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:24.444212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:24.444357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-dcf1b203-8fc3-464b-8fe2-4f29ba6aa2c3 req-aed1fd8e-27f0-4f82-9a4b-a255c1359259 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:24.444744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-dcf1b203-8fc3-464b-8fe2-4f29ba6aa2c3 req-aed1fd8e-27f0-4f82-9a4b-a255c1359259 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:24.445840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:24.486238 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-dcf1b203-8fc3-464b-8fe2-4f29ba6aa2c3 req-aed1fd8e-27f0-4f82-9a4b-a255c1359259 service nova] Creating event network-vif-deleted:1c080fc0-f47f-4199-99fb-c95aeb769036 for instance d205865b-096d-484d-80d0-747b3b9745fa on n-h1-858383-16 Oct 27 09:12:24.509524 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-dcf1b203-8fc3-464b-8fe2-4f29ba6aa2c3 req-aed1fd8e-27f0-4f82-9a4b-a255c1359259 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111430 Oct 27 09:12:24.514490 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1448/2853] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:24.525042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:24.541061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:24.560035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:24.568441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:24.569301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:24.570310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:24.571276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:24.577099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:24.990939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:25.010376 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c8df655a-9eea-47f0-9ea8-259e1ae7c82f tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1273 microversion: 2.1 time: 0.494165 Oct 27 09:12:25.017310 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1449/2854] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:24 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1273 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:25.030711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:25.031328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:25.055660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:25.056086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:25.056524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:25.072847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:25.078597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:25.079312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:25.145438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:25.156188 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa3bfd6d-ce31-40c8-85fa-928db824f82f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 0.781322 Oct 27 09:12:25.180562 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1406/2855] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:24 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:25.194309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-698960075", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b27033c1-2e3e-441a-99b0-4038d19ec1ee"]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:25.318874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:12:25.439141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:25.448036 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a475e1e5-eeaa-4edb-87cb-88d7fee84d25 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1488 microversion: 2.1 time: 0.429445 Oct 27 09:12:25.468013 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1450/2856] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:25 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1488 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:25.477282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:25.484682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:25.496688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:25.497458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:25.499262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:25.502032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:25.502814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:25.506383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:26.217632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:26.228447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37fc6c28-75de-4321-a38f-22470f7ae315 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996" status: 200 len: 1512 microversion: 2.1 time: 0.758952 Oct 27 09:12:26.229036 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1451/2857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:25 2022] GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996 => generated 1512 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:26.237238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:26.238213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:26.253576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:26.260063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:26.260899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:26.262042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:26.262748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:26.263434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:26.506377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:12:26.507458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:12:26.508390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:12:26.509721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:12:26.510397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:12:26.531551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:26.532247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:26.538637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:26.539689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:26.540305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:26.540938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:26.584181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:12:26.597433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:12:26.634361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:12:26.637139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:12:26.748291 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92d5229b-92b3-4598-90f6-c1e6843a14ed tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566092 Oct 27 09:12:26.757865 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1407/2858] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:12:26.764178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-75499857-0f19-4203-b393-7ed66c69f2ff req-c1359f66-170e-4021-aa85-0f6c9a8de4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f468cf4-43cf-4bba-bfcb-0f725bf735e3", "name": "network-vif-plugged", "status": "completed", "tag": "e537d4a4-12d3-46d5-b30a-f4aa9120f51e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:26.817109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-75499857-0f19-4203-b393-7ed66c69f2ff req-c1359f66-170e-4021-aa85-0f6c9a8de4a9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:26.817783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-75499857-0f19-4203-b393-7ed66c69f2ff req-c1359f66-170e-4021-aa85-0f6c9a8de4a9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:26.822269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-75499857-0f19-4203-b393-7ed66c69f2ff req-c1359f66-170e-4021-aa85-0f6c9a8de4a9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:26.861054 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-75499857-0f19-4203-b393-7ed66c69f2ff req-c1359f66-170e-4021-aa85-0f6c9a8de4a9 service nova] Creating event network-vif-plugged:e537d4a4-12d3-46d5-b30a-f4aa9120f51e for instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 on n-h2-858383-16 Oct 27 09:12:26.888834 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-75499857-0f19-4203-b393-7ed66c69f2ff req-c1359f66-170e-4021-aa85-0f6c9a8de4a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134766 Oct 27 09:12:26.895115 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1408/2859] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:26.900741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:26.909358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:26.914147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:26.930113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:26.930905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:26.931483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:26.931970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:26.932898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:26.933894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:26.934564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:26.941666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:26.945695 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34eb3467-762b-417e-8c86-6f5a2f89b62e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1406 microversion: 2.20 time: 0.714719 Oct 27 09:12:26.950193 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1452/2860] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:26 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1406 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:26.982087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:26.983632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:27.004372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:27.007470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:27.009631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:27.023139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:27.024297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:27.026111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:27.088158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lazy-loading 'flavor' on Instance uuid ae674039-cf22-428c-9b75-466061b9d46b {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:12:27.318791 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46208be9-db80-4da3-82c9-9309bc94fe5e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b/action" status: 202 len: 0 microversion: 2.1 time: 0.355843 Oct 27 09:12:27.319801 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1453/2861] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:12:26 2022] POST /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:12:27.344310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:27.345202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:27.367767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:27.368271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:27.376204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:27.377027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:27.377557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:27.378127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:27.878327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:27.887652 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f55fae0c-a590-441a-80fe-0ffd180597f9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.559824 Oct 27 09:12:27.892735 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1454/2862] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:27 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:27.907037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:27.911154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:27.912330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:27.929623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:27.931765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:27.933200 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18c48d52-c312-4ec7-a053-fce2ccf8eb89 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1798 microversion: 2.42 time: 1.036636 Oct 27 09:12:27.934611 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1409/2863] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:26 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1798 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:27.947935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:27.950487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:27.951218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:27.954723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:27.958420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:27.959975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:27.968062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:27.968679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:27.973409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:27.974188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:27.975506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:27.976825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:27.978064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:27.978922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:28.999774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:29.037417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=21 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:29.357935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:29.367713 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-58fbc03b-8720-4fff-97cf-bd07e1c9b9db tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1512 microversion: 2.1 time: 1.431440 Oct 27 09:12:29.372335 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1410/2864] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:27 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1512 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:29.383444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:29.383776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e54b7bfa-d314-43ba-bdaa-de963050fe4a req-ee0d3a0f-a982-4339-9036-3e12e32ab28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c829e85-d998-438d-8574-2bd136bacf72", "tag": "3e677692-d625-44bf-b691-120c347bce6e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:29.398726 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc3f1d5d-f93b-4180-b100-052d4fabfde9 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 1.503471 Oct 27 09:12:29.400937 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1455/2865] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:27 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:29.408827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e54b7bfa-d314-43ba-bdaa-de963050fe4a req-ee0d3a0f-a982-4339-9036-3e12e32ab28d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:29.417925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e54b7bfa-d314-43ba-bdaa-de963050fe4a req-ee0d3a0f-a982-4339-9036-3e12e32ab28d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:29.418665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e54b7bfa-d314-43ba-bdaa-de963050fe4a req-ee0d3a0f-a982-4339-9036-3e12e32ab28d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:29.423855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:29.428136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:29.432591 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e54b7bfa-d314-43ba-bdaa-de963050fe4a req-ee0d3a0f-a982-4339-9036-3e12e32ab28d service nova] Creating event network-changed:3e677692-d625-44bf-b691-120c347bce6e for instance 4c829e85-d998-438d-8574-2bd136bacf72 on n-h1-858383-16 Oct 27 09:12:29.440800 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e54b7bfa-d314-43ba-bdaa-de963050fe4a req-ee0d3a0f-a982-4339-9036-3e12e32ab28d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066756 Oct 27 09:12:29.443671 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1411/2866] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:29.448343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:29.452418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:29.453102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:29.454050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:29.454694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:29.455883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:29.456940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:29.460097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:29.482040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:29.482860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:29.483490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:29.484446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:29.485088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:29.485668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:29.505905 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] HTTP exception thrown: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Request method failure captured: Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa HTTP/1.1 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkrgQo3azoqDUvI3cHBO3JP0ThGruhjURF-JSJPs2X781_uaysHzfY3hH83K11G-_4vWTrnf7nyl0SRpw3go6L3HPPps39-TdpgN1QNusX-6LEJk7o-aRVjE129ytJaxqmRRoecTpQcb61bMVRxneKZBArGdVOOFeRfEHNIarh3GeyA Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/58dde0075cf74c558c4b6462803c15e2"}]}] Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: a3b198587da845bf9237a28f784ae448 Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd205865b-096d-484d-80d0-747b3b9745fa'} Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:12:29.510482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:29.516339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:29.529097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Returning 404 to user: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:29.530274 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-771dbecc-4bec-4b8d-8384-8d19c1075358 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 404 len: 111 microversion: 2.1 time: 0.083019 Oct 27 09:12:29.531026 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1412/2867] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:12:29 2022] DELETE /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:29.540012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:29.541027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:29.549122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:29.549637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:29.550172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:29.550782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:29.551246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:29.551783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:29.829144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:29.842456 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56df3e9e-8092-4652-b7bf-88a7f788df24 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1268 microversion: 2.1 time: 0.438579 Oct 27 09:12:29.855625 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1456/2868] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:29 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1268 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:29.855625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:29.855625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:29.869377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:29.873258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:29.874332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:29.875361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:29.878372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:29.879083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:30.207408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:30.217312 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d9fd2a7-98f0-4bac-8f46-c940c3af0c34 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 200 len: 1479 microversion: 2.1 time: 0.681199 Oct 27 09:12:30.240247 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1413/2869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:29 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 1479 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:30.245863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:30.246858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:30.253993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:30.255130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:30.256074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:30.257071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:30.257731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:30.258378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:30.259043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:30.280946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:30.282952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:30.292767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-631183f2-eeea-4375-af7e-d9580320ab54 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1597 microversion: 2.20 time: 0.448073 Oct 27 09:12:30.295948 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1457/2870] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:29 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1597 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:30.313617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:30.315361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:30.338747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:30.342092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:30.343356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:30.352528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:30.353342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:30.354778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:30.898529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:30.906507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:30.909470 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ff7a9e4-3cdd-4729-a351-1b2b82d8387b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.667611 Oct 27 09:12:30.918015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:30.920723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:30.924180 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1414/2871] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:30 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:30.925001 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-934c6553-dd77-477e-8fd8-5d2f15c5a77e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1844 microversion: 2.42 time: 0.623346 Oct 27 09:12:30.926099 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1458/2872] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:30 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1844 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:30.932601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:30.933505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: d205865b-096d-484d-80d0-747b3b9745fa] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:30.942386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:30.943173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:30.949578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:30.950463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:30.952146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:30.953102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:30.953812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:30.954977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:30.956727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:30.962863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:30.963769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:30.964411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:30.965358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:30.966510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:30.967132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:30.973664 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] HTTP exception thrown: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Request method failure captured: Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa HTTP/1.1 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrgQo3azoqDUvI3cHBO3JP0ThGruhjURF-JSJPs2X781_uaysHzfY3hH83K11G-_4vWTrnf7nyl0SRpw3go6L3HPPps39-TdpgN1QNusX-6LEJk7o-aRVjE129ytJaxqmRRoecTpQcb61bMVRxneKZBArGdVOOFeRfEHNIarh3GeyA Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/58dde0075cf74c558c4b6462803c15e2"}]}] Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: a3b198587da845bf9237a28f784ae448 Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd205865b-096d-484d-80d0-747b3b9745fa'} Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:30.976024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:30.980158 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:30.980158 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:30.980158 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:30.980158 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:30.980158 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:30.980158 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. Oct 27 09:12:30.980158 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:30.982548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Returning 404 to user: Instance d205865b-096d-484d-80d0-747b3b9745fa could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:30.984281 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1d91c54-7a3d-4dac-8e84-8c35f180ad17 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa" status: 404 len: 111 microversion: 2.1 time: 0.056935 Oct 27 09:12:30.985954 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1459/2873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:30 2022] GET /compute/v2.1/servers/d205865b-096d-484d-80d0-747b3b9745fa => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:30.989734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:30.993923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5ec6a386-0034-4156-b479-7655b2779e9f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-475176561"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:30.997350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5ec6a386-0034-4156-b479-7655b2779e9f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:31.005675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ec6a386-0034-4156-b479-7655b2779e9f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.006448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:12:31.006830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ec6a386-0034-4156-b479-7655b2779e9f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.007461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ec6a386-0034-4156-b479-7655b2779e9f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.008423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ec6a386-0034-4156-b479-7655b2779e9f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.009121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ec6a386-0034-4156-b479-7655b2779e9f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.009723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ec6a386-0034-4156-b479-7655b2779e9f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.044990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:31.060846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:31.070612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.071308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.071856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.257670 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5ec6a386-0034-4156-b479-7655b2779e9f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b/action" status: 202 len: 0 microversion: 2.1 time: 0.268774 Oct 27 09:12:31.258334 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1460/2874] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:12:30 2022] POST /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:12:31.264812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46d32f26-4f1f-4c22-868d-146890174593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:31.265789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46d32f26-4f1f-4c22-868d-146890174593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:31.272997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46d32f26-4f1f-4c22-868d-146890174593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.273499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46d32f26-4f1f-4c22-868d-146890174593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.275020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46d32f26-4f1f-4c22-868d-146890174593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.275943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46d32f26-4f1f-4c22-868d-146890174593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.276419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46d32f26-4f1f-4c22-868d-146890174593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.277375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46d32f26-4f1f-4c22-868d-146890174593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.285745 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-589de14c-8d04-4c13-874a-0e153bdf6965 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.360268 Oct 27 09:12:31.286676 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1415/2875] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:12:30 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:31.293034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:31.293996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:31.306333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.307092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.307930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.309144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.309838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.310688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.459606 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46d32f26-4f1f-4c22-868d-146890174593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.199204 Oct 27 09:12:31.467702 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1461/2876] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Oct 27 09:12:31 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:12:31.473566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:31.474983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:31.487715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.488052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.488497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.490098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.490774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.491769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.648601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:31.659400 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5627a276-dda9-4754-80dc-758bb3a732ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1268 microversion: 2.1 time: 0.189150 Oct 27 09:12:31.662114 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1462/2877] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:31 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:31.667422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:31.668404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:31.676626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.677259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.677811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.678663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.679607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.680151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.701748 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] HTTP exception thrown: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Request method failure captured: Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 HTTP/1.1 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrgQo3azoqDUvI3cHBO3JP0ThGruhjURF-JSJPs2X781_uaysHzfY3hH83K11G-_4vWTrnf7nyl0SRpw3go6L3HPPps39-TdpgN1QNusX-6LEJk7o-aRVjE129ytJaxqmRRoecTpQcb61bMVRxneKZBArGdVOOFeRfEHNIarh3GeyA Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/58dde0075cf74c558c4b6462803c15e2"}]}] Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: a3b198587da845bf9237a28f784ae448 Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '124f1dc6-5682-4ada-8748-4d9c89d58151'} Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:12:31.703666 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.709996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Returning 404 to user: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:31.711387 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb981956-66ce-45d7-855c-949321b4bad7 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 404 len: 111 microversion: 2.1 time: 0.047562 Oct 27 09:12:31.715636 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1463/2878] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:12:31 2022] DELETE /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:31.720643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a895a84-ecd1-4511-97bd-9c089b7eb039 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae4adb80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:31.735226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:31.743081 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b60074b-7d38-47ff-90ee-a42424a8e6db tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 0.454815 Oct 27 09:12:31.744368 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1416/2879] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:31 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:31.749283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:31.754840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:31.755728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:31.787152 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a895a84-ecd1-4511-97bd-9c089b7eb039 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.070121 Oct 27 09:12:31.788010 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1464/2880] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:31 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:31.792663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-622ff1e6-385b-416e-a2f4-0093b7348bc4 req-9d73242d-edcb-4dbe-95f2-4ed5cf73e067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617af9bd-1546-41f2-ae91-daf745dc43eb", "tag": "52b516c3-0eee-40e6-8fe1-0576e63ce4da"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:31.803908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-622ff1e6-385b-416e-a2f4-0093b7348bc4 req-9d73242d-edcb-4dbe-95f2-4ed5cf73e067 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.804571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-622ff1e6-385b-416e-a2f4-0093b7348bc4 req-9d73242d-edcb-4dbe-95f2-4ed5cf73e067 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.805132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-622ff1e6-385b-416e-a2f4-0093b7348bc4 req-9d73242d-edcb-4dbe-95f2-4ed5cf73e067 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.819063 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-622ff1e6-385b-416e-a2f4-0093b7348bc4 req-9d73242d-edcb-4dbe-95f2-4ed5cf73e067 service nova] Creating event network-changed:52b516c3-0eee-40e6-8fe1-0576e63ce4da for instance 617af9bd-1546-41f2-ae91-daf745dc43eb on n-h1-858383-16 Oct 27 09:12:31.825474 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-622ff1e6-385b-416e-a2f4-0093b7348bc4 req-9d73242d-edcb-4dbe-95f2-4ed5cf73e067 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036194 Oct 27 09:12:31.826339 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1465/2881] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:31.833873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0e437e31-884f-4bfa-b660-ba74c3dd0def req-33dfcd4a-3920-4fb3-b013-b646c9156f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "tag": "4757d336-0d53-4876-83cf-55f3b46f3a76"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:31.846412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0e437e31-884f-4bfa-b660-ba74c3dd0def req-33dfcd4a-3920-4fb3-b013-b646c9156f73 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.846770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0e437e31-884f-4bfa-b660-ba74c3dd0def req-33dfcd4a-3920-4fb3-b013-b646c9156f73 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.847116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0e437e31-884f-4bfa-b660-ba74c3dd0def req-33dfcd4a-3920-4fb3-b013-b646c9156f73 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.858378 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0e437e31-884f-4bfa-b660-ba74c3dd0def req-33dfcd4a-3920-4fb3-b013-b646c9156f73 service nova] Creating event network-changed:4757d336-0d53-4876-83cf-55f3b46f3a76 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:12:31.863545 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0e437e31-884f-4bfa-b660-ba74c3dd0def req-33dfcd4a-3920-4fb3-b013-b646c9156f73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035132 Oct 27 09:12:31.864401 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1466/2882] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:31.869456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:31.870165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] [instance: 124f1dc6-5682-4ada-8748-4d9c89d58151] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:31.876589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.877119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.877559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.878262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.878717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.879143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.893822 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] HTTP exception thrown: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Request method failure captured: Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 HTTP/1.1 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrgQo3azoqDUvI3cHBO3JP0ThGruhjURF-JSJPs2X781_uaysHzfY3hH83K11G-_4vWTrnf7nyl0SRpw3go6L3HPPps39-TdpgN1QNusX-6LEJk7o-aRVjE129ytJaxqmRRoecTpQcb61bMVRxneKZBArGdVOOFeRfEHNIarh3GeyA Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/58dde0075cf74c558c4b6462803c15e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/58dde0075cf74c558c4b6462803c15e2"}]}] Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 58dde0075cf74c558c4b6462803c15e2 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestMultiNic-1352912992 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: a3b198587da845bf9237a28f784ae448 Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestMultiNic-1352912992-project Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '124f1dc6-5682-4ada-8748-4d9c89d58151'} Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:31.895532 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] Returning 404 to user: Instance 124f1dc6-5682-4ada-8748-4d9c89d58151 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37dfdc50-3170-4eca-b27c-7b1bd8088152 tempest-ServersTestMultiNic-1352912992 tempest-ServersTestMultiNic-1352912992-project] 10.222.0.25 "GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151" status: 404 len: 111 microversion: 2.1 time: 0.031626 Oct 27 09:12:31.903086 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1467/2883] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:31 2022] GET /compute/v2.1/servers/124f1dc6-5682-4ada-8748-4d9c89d58151 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:31.931730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.932592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.933178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.934776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.935516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.936089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.954097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:31.954897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:31.967918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.972531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.972809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:31.973678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:31.975244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:31.975988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:32.001434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:12:32.060087 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b4250fd-ea4a-4365-bf87-7b2979089cdb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.314452 Oct 27 09:12:32.061256 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1417/2884] 10.222.0.25 () {58 vars in 1150 bytes} [Thu Oct 27 09:12:31 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:32.067071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:32.067944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:32.075048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:32.075542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:32.080002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:32.081433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:32.081915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:32.082352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:32.675797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:32.690246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e57985a-a6e9-40a0-b44d-faa0133d6dc0 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.744081 Oct 27 09:12:32.692249 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1468/2885] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:31 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:32.697804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:32.706517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:32.709022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:32.717406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:32.718759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:32.720695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:32.722837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:32.724504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:32.725206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:32.760389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:32.776922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:32.778378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:32.779549 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-03d11001-a110-47be-add9-b869d4bd1b52 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1844 microversion: 2.42 time: 0.717188 Oct 27 09:12:32.786244 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1418/2886] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:32 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1844 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:32.791140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:32.791790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:32.813679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:32.814151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:32.815351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:32.816264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:32.816881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:32.817465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:32.872904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:12:32.955295 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08350cc1-0ac7-4dea-a85d-007b3307ec44 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.260967 Oct 27 09:12:32.956666 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1469/2887] 10.222.0.25 () {58 vars in 1212 bytes} [Thu Oct 27 09:12:32 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:32.963393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:32.964381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:32.973002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:32.973897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:32.974635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:32.975698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:32.977012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:32.977749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:33.406998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:33.424439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-037e319b-84ca-452e-9735-b80d83cea30c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1268 microversion: 2.1 time: 0.636855 Oct 27 09:12:33.425037 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1419/2888] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:32 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1268 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:33.429671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfc9df90-d1db-4998-b5c2-6c9d2703aca4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9981310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:33.493037 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cfc9df90-d1db-4998-b5c2-6c9d2703aca4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.066735 Oct 27 09:12:33.493959 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1420/2889] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:33 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:33.502313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:33.514505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:33.521851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:33.529181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:33.531873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:33.532375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:33.533154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:33.538164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:33.538651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:33.752815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:12:33.757332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:33.767071 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19f69a4d-203d-4b2e-8898-ce6803a015ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 0.808959 Oct 27 09:12:33.773776 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1470/2890] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:32 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:33.789659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:33.790293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:33.805114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:33.805624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:33.806069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:33.806802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:33.807263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:33.807728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:33.917249 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f86726f-d121-40b4-aafa-141756d2db06 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.421766 Oct 27 09:12:33.917936 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1421/2891] 10.222.0.25 () {58 vars in 1196 bytes} [Thu Oct 27 09:12:33 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:33.937131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:33.937847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:33.953056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:33.953553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:33.954001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:33.954711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:33.969382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:33.969956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:34.613031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:34.627331 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3e50ad6c-9827-4f63-b5f6-cfc5af65ad9a tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.851995 Oct 27 09:12:34.632700 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1471/2892] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:33 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:34.638975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:34.649456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:34.652707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'name': '-227598687', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:34.672845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:34.673497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:34.674580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:34.676790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:34.676790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:34.677060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:34.873703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:12:34.922640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:34.951119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:34.963528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:34.979385 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb54d295-a572-4be4-8258-b66998451b24 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1865 microversion: 2.42 time: 1.060267 Oct 27 09:12:34.979989 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1422/2893] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:33 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1865 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:35.001983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:35.002912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:35.028624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.029154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.036750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.036750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.045043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.045554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.086905 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f2cb90e-a5b9-48f1-963c-e1c7f438bb12 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-227598687" status: 200 len: 345 microversion: 2.1 time: 0.452940 Oct 27 09:12:35.088143 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1472/2894] 10.222.0.25 () {58 vars in 1156 bytes} [Thu Oct 27 09:12:34 2022] GET /compute/v2.1/servers?name=-227598687 => generated 345 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:35.093362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1dfe79f6-9cde-4e6a-b5e9-cb03bdcebcea tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa0e10d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:35.148699 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1dfe79f6-9cde-4e6a-b5e9-cb03bdcebcea tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.059253 Oct 27 09:12:35.149618 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1473/2895] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:35 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:35.154786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:35.155406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:35.163769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.164349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.164797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.166148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.166672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.167346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.270775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:35.279164 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f9cf725-70a0-463d-b1d7-c398b4692471 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1274 microversion: 2.1 time: 0.298000 Oct 27 09:12:35.279783 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1423/2896] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:34 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1274 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:35.288622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:35.301209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:35.310277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:35.321069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.324743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.327672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.328689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.333508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.334140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.443591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:12:35.542419 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2cdcf411-e208-466e-95ec-9945862e9450 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.257462 Oct 27 09:12:35.543034 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1424/2897] 10.222.0.25 () {58 vars in 1154 bytes} [Thu Oct 27 09:12:35 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:35.555404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:35.568155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:35.568899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-22759868', 'deleted': False, 'project_id': '16083c891b2b4f4f9264fbcf086f3893'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:12:35.581863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.582351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.582786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.583511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.583986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.588332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.602267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:35.610511 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9d879797-ef5d-4758-9382-9fdf9244ec69 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 0.459735 Oct 27 09:12:35.616117 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1474/2898] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:35 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:35.658142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:35.659451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:35.668988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.672469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.673017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.675858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.680262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.692700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.740910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:12:35.846200 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2880f0d2-7aae-4703-a224-0d7ceb4d4106 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-22759868" status: 200 len: 345 microversion: 2.1 time: 0.294432 Oct 27 09:12:35.857729 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1425/2899] 10.222.0.25 () {58 vars in 1226 bytes} [Thu Oct 27 09:12:35 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-22759868 => generated 345 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:35.857729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9dfc868d-2737-43a0-bc97-f40261e322c4 req-c3cf22b4-90cc-4b3c-8c65-8b7fdb089e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "tag": "0ed98e72-a11f-447c-905c-7876d41e6951"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:35.862928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9dfc868d-2737-43a0-bc97-f40261e322c4 req-c3cf22b4-90cc-4b3c-8c65-8b7fdb089e9a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.863305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9dfc868d-2737-43a0-bc97-f40261e322c4 req-c3cf22b4-90cc-4b3c-8c65-8b7fdb089e9a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.863780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9dfc868d-2737-43a0-bc97-f40261e322c4 req-c3cf22b4-90cc-4b3c-8c65-8b7fdb089e9a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.875655 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9dfc868d-2737-43a0-bc97-f40261e322c4 req-c3cf22b4-90cc-4b3c-8c65-8b7fdb089e9a service nova] Creating event network-changed:0ed98e72-a11f-447c-905c-7876d41e6951 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:12:35.883253 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9dfc868d-2737-43a0-bc97-f40261e322c4 req-c3cf22b4-90cc-4b3c-8c65-8b7fdb089e9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034022 Oct 27 09:12:35.884550 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1426/2900] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:35.890188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:35.890797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:35.899301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.899882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.900298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.901138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:35.901618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:35.902054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:35.954856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:12:36.179286 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d2e0eb0-fb50-47a9-8194-78e8f77f80b0 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 204 len: 0 microversion: 2.1 time: 0.293497 Oct 27 09:12:36.184602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1427/2901] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:12:35 2022] DELETE /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:12:36.192567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:36.193454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:36.221786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:36.221786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:36.222075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:36.222765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:36.223228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:36.223694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:36.228886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:36.245857 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3d9fb7a8-ae4f-4f4f-801c-ba08b9598c65 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.593019 Oct 27 09:12:36.246767 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1475/2902] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:35 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:12:36.259742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-edc11378-28ea-4932-8482-f783a0614a58 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa1b8d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:36.355868 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-edc11378-28ea-4932-8482-f783a0614a58 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.107824 Oct 27 09:12:36.357146 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1476/2903] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:36 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:36.362688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:36.363525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:36.371951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:36.372634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:36.373367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:36.374349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:36.374995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:36.375746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:37.067539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:37.083615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:37.086021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:37.089099 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e7eabaf-6c99-4c12-8947-6db4f9888b9f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1865 microversion: 2.42 time: 0.903214 Oct 27 09:12:37.093386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:37.103087 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1428/2904] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:36 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1865 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:37.110834 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ad0917e-5457-4f68-978f-f016d9ea313d tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1518 microversion: 2.1 time: 0.752179 Oct 27 09:12:37.128471 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1477/2905] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:36 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1518 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:37.136135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:37.139242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:37.141853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:37.142762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:37.150224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:37.150734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:37.151190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:37.156109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:37.156617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:37.157071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:37.158802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:37.159384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:37.159867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:37.160613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:37.161079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:37.164825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:37.349667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:37.363891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:37.371438 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-957ff218-9231-4b2c-a846-f9888506b1b1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1274 microversion: 2.1 time: 0.262865 Oct 27 09:12:37.382924 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1429/2906] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:37 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:37.396178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:37.396814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:37.409282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:37.413041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:37.416051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:37.416939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:37.418772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:37.420895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:37.422329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:38.239903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:38.256833 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-29c3b407-5db2-4832-b732-8cd68aa3cfaa tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 1.126884 Oct 27 09:12:38.257445 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1478/2907] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:37 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:38.261975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f89cc897-9b90-4d28-9441-c48d0be7ccd0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa29dca0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:38.362795 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f89cc897-9b90-4d28-9441-c48d0be7ccd0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.104286 Oct 27 09:12:38.364363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:38.371270 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1479/2908] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:38 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:38.373465 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4920f90-9dde-4b61-ba6e-54c99b320c99 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.992601 Oct 27 09:12:38.374732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1430/2909] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:37 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:38.380155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:38.380980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:38.387167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:38.387913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:38.388930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:38.389807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:38.390424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:38.391013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:38.396336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:38.396964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:38.418723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:38.419236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:38.419719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:38.420454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:38.420919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:38.421356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:39.006894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:39.015060 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-295516a3-edb7-4b1b-b5d6-e4040fe0e9be tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1518 microversion: 2.1 time: 0.638994 Oct 27 09:12:39.015661 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1431/2910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:38 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1518 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:39.020405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ba3dcf43-893a-451b-9227-fc752f71ad97 req-8f99c29d-9f47-427d-9a12-4943d32edab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f468cf4-43cf-4bba-bfcb-0f725bf735e3", "tag": "e537d4a4-12d3-46d5-b30a-f4aa9120f51e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:39.031552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ba3dcf43-893a-451b-9227-fc752f71ad97 req-8f99c29d-9f47-427d-9a12-4943d32edab8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:39.032073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ba3dcf43-893a-451b-9227-fc752f71ad97 req-8f99c29d-9f47-427d-9a12-4943d32edab8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:39.032504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ba3dcf43-893a-451b-9227-fc752f71ad97 req-8f99c29d-9f47-427d-9a12-4943d32edab8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:39.045988 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ba3dcf43-893a-451b-9227-fc752f71ad97 req-8f99c29d-9f47-427d-9a12-4943d32edab8 service nova] Creating event network-changed:e537d4a4-12d3-46d5-b30a-f4aa9120f51e for instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 on n-h2-858383-16 Oct 27 09:12:39.056443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:39.063059 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ba3dcf43-893a-451b-9227-fc752f71ad97 req-8f99c29d-9f47-427d-9a12-4943d32edab8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046006 Oct 27 09:12:39.074038 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1432/2911] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:39.079016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:39.084808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:39.089528 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f307393-404e-46d8-a9b2-6d622842b0fb tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1886 microversion: 2.42 time: 0.714816 Oct 27 09:12:39.090861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:39.091610 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1480/2912] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:38 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1886 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:39.093510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:39.107626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-bec39dca-9ca1-4103-9dd1-a312ec03e513 req-5f3f0a5d-1d5b-4988-a6a7-3b5c6e52114f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae674039-cf22-428c-9b75-466061b9d46b", "name": "network-vif-plugged", "status": "completed", "tag": "576a0cdb-2cf3-4a70-b166-3c04ce0c32e6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:39.113015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:39.113829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:39.116194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:39.117097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:39.117727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:39.119327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:39.136258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bec39dca-9ca1-4103-9dd1-a312ec03e513 req-5f3f0a5d-1d5b-4988-a6a7-3b5c6e52114f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:39.140166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bec39dca-9ca1-4103-9dd1-a312ec03e513 req-5f3f0a5d-1d5b-4988-a6a7-3b5c6e52114f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:39.140830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bec39dca-9ca1-4103-9dd1-a312ec03e513 req-5f3f0a5d-1d5b-4988-a6a7-3b5c6e52114f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:39.173782 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-bec39dca-9ca1-4103-9dd1-a312ec03e513 req-5f3f0a5d-1d5b-4988-a6a7-3b5c6e52114f service nova] Creating event network-vif-plugged:576a0cdb-2cf3-4a70-b166-3c04ce0c32e6 for instance ae674039-cf22-428c-9b75-466061b9d46b on n-h2-858383-16 Oct 27 09:12:39.188740 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-bec39dca-9ca1-4103-9dd1-a312ec03e513 req-5f3f0a5d-1d5b-4988-a6a7-3b5c6e52114f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093096 Oct 27 09:12:39.191613 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1481/2913] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:39.286246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:39.288195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:39.307976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:39.309611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:39.310520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:39.311761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:39.312686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:39.314153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:39.476099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:39.483940 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1039bb05-d1f3-48f9-a24c-f832f4bf6aff tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1274 microversion: 2.1 time: 0.407088 Oct 27 09:12:39.484793 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1433/2914] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:39 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1274 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:39.491278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c130ff1e-7b30-4cec-bfb2-9f1515c9ff50 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa25d160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:39.540032 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c130ff1e-7b30-4cec-bfb2-9f1515c9ff50 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.053777 Oct 27 09:12:39.541165 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1434/2915] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:39 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:39.547440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:39.548515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:39.554809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:39.555308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:39.555777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:39.556534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:39.556927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:39.557353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:39.799682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:39.807529 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-11088d17-052c-4f21-8f05-87d4127ac97f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 0.526993 Oct 27 09:12:39.808139 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1482/2916] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:39 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:12:39.960522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-099f17b1-bce2-413e-b8c1-e4d449eb2e5a tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1415847537", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:39.964092 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-099f17b1-bce2-413e-b8c1-e4d449eb2e5a tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] HTTP exception thrown: min_count must be <= max_count Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-099f17b1-bce2-413e-b8c1-e4d449eb2e5a tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Request method failure captured: Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 184 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkuHuipwXq5q3wE8EAeF9yJbwyhyxV9MvliusW_oMjSJoHjJvlSEeasfKyhStLzkk7i1IsErYW3b6TiXkB8Fr1_Jvn5q9iZEQOBTa2tBPv6ttWmyDwUn72C126e3kvSoVXcIZLuXhrDPmXjaJDc3OE35b519ea2QXe5TWRMsOP0bx_0 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5eeeb38ce89463ab27df2df25b2e227"}]}] Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 61addf71ca2b4e9f8e2341df8ba04a10 Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1415847537", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: exception: min_count must be <= max_count Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1415847537', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 27 09:12:39.970365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:39.976920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-099f17b1-bce2-413e-b8c1-e4d449eb2e5a tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Returning 400 to user: min_count must be <= max_count {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:39.976920 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-099f17b1-bce2-413e-b8c1-e4d449eb2e5a tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.164416 Oct 27 09:12:39.976920 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1483/2917] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:39 2022] POST /compute/v2.1/servers => generated 74 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:12:40.025173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7e39d030-0706-431e-abc7-ca58a80c439a tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-221230684", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "max_count": 0}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7e39d030-0706-431e-abc7-ca58a80c439a tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Request method failure captured: Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 167 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkuHuipwXq5q3wE8EAeF9yJbwyhyxV9MvliusW_oMjSJoHjJvlSEeasfKyhStLzkk7i1IsErYW3b6TiXkB8Fr1_Jvn5q9iZEQOBTa2tBPv6ttWmyDwUn72C126e3kvSoVXcIZLuXhrDPmXjaJDc3OE35b519ea2QXe5TWRMsOP0bx_0 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5eeeb38ce89463ab27df2df25b2e227"}]}] Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 61addf71ca2b4e9f8e2341df8ba04a10 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-221230684", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "max_count": 0}} Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-221230684', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'max_count': 0}}} Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 0 Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:12:40.029956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7e39d030-0706-431e-abc7-ca58a80c439a tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:40.034710 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7e39d030-0706-431e-abc7-ca58a80c439a tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010133 Oct 27 09:12:40.036254 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1484/2918] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:12:40.040910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:40.041527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:40.049752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:40.050324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:40.050841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:40.051675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:40.052208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:40.052850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:40.057687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:40.082878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:40.091308 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0534b464-6b92-4e53-9793-0e503fd0523d tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.548938 Oct 27 09:12:40.092004 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1435/2919] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:39 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:40.096959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be5bee01-82be-4862-8fc2-80acebc45785 tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1912486070", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "max_count": 2.5}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be5bee01-82be-4862-8fc2-80acebc45785 tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Request method failure captured: Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 170 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkuHuipwXq5q3wE8EAeF9yJbwyhyxV9MvliusW_oMjSJoHjJvlSEeasfKyhStLzkk7i1IsErYW3b6TiXkB8Fr1_Jvn5q9iZEQOBTa2tBPv6ttWmyDwUn72C126e3kvSoVXcIZLuXhrDPmXjaJDc3OE35b519ea2QXe5TWRMsOP0bx_0 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5eeeb38ce89463ab27df2df25b2e227"}]}] Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 61addf71ca2b4e9f8e2341df8ba04a10 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1912486070", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "max_count": 2.5}} Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1912486070', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'max_count': 2.5}}} Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 2.5 Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:12:40.112933 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be5bee01-82be-4862-8fc2-80acebc45785 tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:40.117372 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be5bee01-82be-4862-8fc2-80acebc45785 tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021365 Oct 27 09:12:40.122648 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1436/2920] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:12:40.133117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:40.133826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:40.141697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:40.142864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:40.143555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:40.144817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:40.145496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:40.146121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:40.686592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:40.701468 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5af9473-53be-4f2b-aed0-6350ed14b881 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1518 microversion: 2.1 time: 0.663698 Oct 27 09:12:40.704708 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1485/2921] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:40 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1518 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:40.718165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f47b7dc-ec64-4ee6-9fe3-cc4a35319146 tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-868951393", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 0}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f47b7dc-ec64-4ee6-9fe3-cc4a35319146 tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Request method failure captured: Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 167 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkuHuipwXq5q3wE8EAeF9yJbwyhyxV9MvliusW_oMjSJoHjJvlSEeasfKyhStLzkk7i1IsErYW3b6TiXkB8Fr1_Jvn5q9iZEQOBTa2tBPv6ttWmyDwUn72C126e3kvSoVXcIZLuXhrDPmXjaJDc3OE35b519ea2QXe5TWRMsOP0bx_0 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5eeeb38ce89463ab27df2df25b2e227"}]}] Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 61addf71ca2b4e9f8e2341df8ba04a10 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-868951393", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 0}} Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-868951393', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'min_count': 0}}} Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 0 Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:12:40.724131 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 27 09:12:40.728845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:40.730623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f47b7dc-ec64-4ee6-9fe3-cc4a35319146 tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:40.731658 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f47b7dc-ec64-4ee6-9fe3-cc4a35319146 tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025150 Oct 27 09:12:40.744630 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1486/2922] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:12:40.749548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:40.759060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:40.777714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:40.778487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:40.779159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:40.780380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:40.781256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:40.782143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:40.966488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:40.986839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:40.988325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:40.989688 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8671be33-299f-4374-ab36-949ef36aa246 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.865077 Oct 27 09:12:41.014323 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1437/2923] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:40 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:41.020268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5aab6e8a-72a8-4bb5-90ff-467be305673c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa358670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:41.059720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:41.091429 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5aab6e8a-72a8-4bb5-90ff-467be305673c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.075696 Oct 27 09:12:41.092241 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1438/2924] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:41 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:41.098183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfa8c58e-cf55-4cee-8bad-7bd627be665f tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1366599383", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 2.5}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfa8c58e-cf55-4cee-8bad-7bd627be665f tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Request method failure captured: Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 170 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkuHuipwXq5q3wE8EAeF9yJbwyhyxV9MvliusW_oMjSJoHjJvlSEeasfKyhStLzkk7i1IsErYW3b6TiXkB8Fr1_Jvn5q9iZEQOBTa2tBPv6ttWmyDwUn72C126e3kvSoVXcIZLuXhrDPmXjaJDc3OE35b519ea2QXe5TWRMsOP0bx_0 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eeeb38ce89463ab27df2df25b2e227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5eeeb38ce89463ab27df2df25b2e227"}]}] Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: e5eeeb38ce89463ab27df2df25b2e227 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1239738034 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 61addf71ca2b4e9f8e2341df8ba04a10 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1239738034-project Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1366599383", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 2.5}} Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1366599383', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'min_count': 2.5}}} Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 2.5 Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:12:41.103380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 27 09:12:41.108641 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:41.113025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfa8c58e-cf55-4cee-8bad-7bd627be665f tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:41.113992 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dfa8c58e-cf55-4cee-8bad-7bd627be665f tempest-MultipleCreateNegativeTestJSON-1239738034 tempest-MultipleCreateNegativeTestJSON-1239738034-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020647 Oct 27 09:12:41.119764 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1439/2925] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:12:41.137296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:41.137928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:41.168495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:41.169021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:41.178293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:41.179258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:41.179875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:41.180380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:41.600354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:41.622218 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-96cc6c6c-e0d1-4358-b2ae-e6b5e439f1a9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 0.876317 Oct 27 09:12:41.625724 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1487/2926] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:40 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:41.645105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:41.646376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:41.659196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:41.659749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:41.665198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:41.665975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:41.666804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:41.667406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:41.773263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:41.785374 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cee34588-32d0-49b1-89f3-dc52da27540e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 0.667631 Oct 27 09:12:41.809682 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1440/2927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:41 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:41.816692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a2edbd51-1cf7-414a-ae91-312aa3028c62 req-64595b50-50f8-4074-ba14-0a6fc42c079a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "tag": "d55c2a24-6294-46f5-9ee3-aefcef021dc6"}, {"server_uuid": "0f81ce93-3183-4d2c-8e4b-4cda961a4a03", "name": "network-vif-deleted", "tag": "49f4c3ce-92d8-4dea-9672-c5c20bfd309a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:41.833137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a2edbd51-1cf7-414a-ae91-312aa3028c62 req-64595b50-50f8-4074-ba14-0a6fc42c079a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:41.834047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a2edbd51-1cf7-414a-ae91-312aa3028c62 req-64595b50-50f8-4074-ba14-0a6fc42c079a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:41.835526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a2edbd51-1cf7-414a-ae91-312aa3028c62 req-64595b50-50f8-4074-ba14-0a6fc42c079a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:41.866842 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a2edbd51-1cf7-414a-ae91-312aa3028c62 req-64595b50-50f8-4074-ba14-0a6fc42c079a service nova] Creating event network-changed:d55c2a24-6294-46f5-9ee3-aefcef021dc6 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:12:41.868332 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a2edbd51-1cf7-414a-ae91-312aa3028c62 req-64595b50-50f8-4074-ba14-0a6fc42c079a service nova] Creating event network-vif-deleted:49f4c3ce-92d8-4dea-9672-c5c20bfd309a for instance 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 on n-h2-858383-16 Oct 27 09:12:41.887553 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a2edbd51-1cf7-414a-ae91-312aa3028c62 req-64595b50-50f8-4074-ba14-0a6fc42c079a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.075943 Oct 27 09:12:41.889040 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1441/2928] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:41.907197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:41.908634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:41.926615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:41.927864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:41.928432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:41.932157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:41.932647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:41.934511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:42.035615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:42.036188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:42.036354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:42.036848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lazy-loading 'fault' on Instance uuid 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:12:42.672827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:42.687178 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec3e0951-8351-4ae0-a002-ab7bfabda37e tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 200 len: 1311 microversion: 2.1 time: 0.793632 Oct 27 09:12:42.689504 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1442/2929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:41 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 1311 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:42.714749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:42.717820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:42.743199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:42.743751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:42.745329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:42.751093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:42.754177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:42.754733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:43.318783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:43.328905 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c296af3-5aad-4819-a009-531eb5823758 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 1.701685 Oct 27 09:12:43.336650 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1488/2930] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:41 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:43.353752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e8281dd0-e9ea-49a4-9fe5-99b05c8bc029 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31abb5fc10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:43.466701 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e8281dd0-e9ea-49a4-9fe5-99b05c8bc029 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.126958 Oct 27 09:12:43.479978 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1489/2931] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:43 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:43.487293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:43.488359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:43.500518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:43.501526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:43.502991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:43.504018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:43.505118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:43.506022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:43.846630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:43.863847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:43.868718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:43.875358 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5772d3a1-40ca-44bd-8c23-646b5ee3c091 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 1.182040 Oct 27 09:12:43.888828 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1443/2932] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:42 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:43.902656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b04bae56-41f5-424b-9af7-a25463559acb req-68519962-a4e3-403f-b4c6-fa4128bcac73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c829e85-d998-438d-8574-2bd136bacf72", "name": "network-vif-plugged", "status": "completed", "tag": "3e677692-d625-44bf-b691-120c347bce6e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:43.918477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b04bae56-41f5-424b-9af7-a25463559acb req-68519962-a4e3-403f-b4c6-fa4128bcac73 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:43.919364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b04bae56-41f5-424b-9af7-a25463559acb req-68519962-a4e3-403f-b4c6-fa4128bcac73 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:43.919829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b04bae56-41f5-424b-9af7-a25463559acb req-68519962-a4e3-403f-b4c6-fa4128bcac73 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:43.933580 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b04bae56-41f5-424b-9af7-a25463559acb req-68519962-a4e3-403f-b4c6-fa4128bcac73 service nova] Creating event network-vif-plugged:3e677692-d625-44bf-b691-120c347bce6e for instance 4c829e85-d998-438d-8574-2bd136bacf72 on n-h1-858383-16 Oct 27 09:12:43.939501 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b04bae56-41f5-424b-9af7-a25463559acb req-68519962-a4e3-403f-b4c6-fa4128bcac73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049335 Oct 27 09:12:43.940558 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1444/2933] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:43.947911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:43.948896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:43.958499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:43.959240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:43.959903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:43.960783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:43.961444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:43.962417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:44.461420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:44.480858 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27297e05-da8c-489a-9d89-4b511b5ecda7 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 0.998834 Oct 27 09:12:44.485795 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1490/2934] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:43 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:44.504308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:44.504540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:44.507600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 0f81ce93-3183-4d2c-8e4b-4cda961a4a03] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:44.513961 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79cc5204-ac31-42a8-9185-51afa3f95cde tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 0.572049 Oct 27 09:12:44.523755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:44.525316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:44.525678 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1445/2935] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:43 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:44.529800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:44.530420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:44.531242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:44.532080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:44.533830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:44.535163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:44.535815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:44.543327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:44.545537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:44.546151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:44.560264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:44.561032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:44.561650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:44.596642 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] HTTP exception thrown: Instance 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 could not be found. Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Request method failure captured: Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 HTTP/1.1 Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWksSwnAER2WQ6tRm56e1HBdRpsoLRduMXtFFyMKkVz2hh0tplCzqLdY55i9Mg56pTtuduTIuaLXRcUtUxOLhoqFq0q6e934x1Kfa6_DEwc0woKtym18fZ54YPBqNci-_owai45luys4Xs2tSl1OcZHWMvm24IyREvwaXAZHQmzVlkvM Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 16083c891b2b4f4f9264fbcf086f3893 Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ListServerFiltersTestJSON-1785354040 Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16083c891b2b4f4f9264fbcf086f3893"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16083c891b2b4f4f9264fbcf086f3893"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16083c891b2b4f4f9264fbcf086f3893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16083c891b2b4f4f9264fbcf086f3893"}]}] Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ListServerFiltersTestJSON-1785354040 Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 16083c891b2b4f4f9264fbcf086f3893 Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1785354040 Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ListServerFiltersTestJSON-1785354040-project Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c5079fda993e4c1aaca97eff5ae5f14e Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ListServerFiltersTestJSON-1785354040-project Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 could not be found. Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '0f81ce93-3183-4d2c-8e4b-4cda961a4a03'} Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 could not be found. Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 could not be found. Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:44.599315 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:44.603722 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:44.603722 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:44.603722 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:44.603722 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:44.603722 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:44.603722 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 could not be found. Oct 27 09:12:44.603722 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:12:44.603722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Returning 404 to user: Instance 0f81ce93-3183-4d2c-8e4b-4cda961a4a03 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:44.604234 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4df6acd1-80d3-47c5-92bc-0b1ae789839b tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03" status: 404 len: 111 microversion: 2.1 time: 0.115066 Oct 27 09:12:44.610691 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1491/2936] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:44 2022] GET /compute/v2.1/servers/0f81ce93-3183-4d2c-8e4b-4cda961a4a03 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:12:44.625010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3c98b1ff-8a83-47dc-9c81-600543daf889 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31abb5faf0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:44.711920 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3c98b1ff-8a83-47dc-9c81-600543daf889 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.099269 Oct 27 09:12:44.712712 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1492/2937] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:44 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:44.727705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:44.728325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:44.734980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:44.747990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:44.748609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:44.749612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:44.750300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:44.750967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:44.754211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:44.806577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:12:45.000367 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fde8339e-d960-4ecb-97cd-fe4f0ef2202a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996" status: 204 len: 0 microversion: 2.1 time: 0.276520 Oct 27 09:12:45.001593 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1493/2938] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:12:44 2022] DELETE /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:12:45.012946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:45.014945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:45.015705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:45.022448 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-066b5eff-f213-4bd0-aced-fd174bbd4c77 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.495312 Oct 27 09:12:45.025833 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1446/2939] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:44 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:45.030712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:45.041057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:45.044798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:45.045552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:45.046486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:45.047706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:45.048335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:45.048964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:45.053890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:45.063419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:45.064099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:45.065500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:45.066124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:45.066650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:45.680755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=14 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:45.778473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:45.791813 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc267325-f879-4161-ad65-6a6d6ae66f80 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996" status: 200 len: 1518 microversion: 2.1 time: 0.764645 Oct 27 09:12:45.799070 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1447/2940] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:45 2022] GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996 => generated 1518 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:45.819931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fb26d6af-70e7-4d9e-b7a8-9f63d2d6b8ba req-41f33d52-7341-413d-8859-942f88197703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "tag": "11599d02-495f-4773-8d4b-4f4e7e5ef3bf"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:45.870562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:45.878238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fb26d6af-70e7-4d9e-b7a8-9f63d2d6b8ba req-41f33d52-7341-413d-8859-942f88197703 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:45.878745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fb26d6af-70e7-4d9e-b7a8-9f63d2d6b8ba req-41f33d52-7341-413d-8859-942f88197703 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:45.888962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:45.891545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:45.893009 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b1957aeb-83bf-4287-92f1-2a80df236aaf tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.888818 Oct 27 09:12:45.903597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fb26d6af-70e7-4d9e-b7a8-9f63d2d6b8ba req-41f33d52-7341-413d-8859-942f88197703 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:45.904840 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1494/2941] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:45 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:45.920853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:45.921718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:45.931662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:45.932400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:45.933027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:45.934379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:45.934993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:45.935675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:46.002686 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fb26d6af-70e7-4d9e-b7a8-9f63d2d6b8ba req-41f33d52-7341-413d-8859-942f88197703 service nova] Creating event network-changed:11599d02-495f-4773-8d4b-4f4e7e5ef3bf for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:12:46.014559 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fb26d6af-70e7-4d9e-b7a8-9f63d2d6b8ba req-41f33d52-7341-413d-8859-942f88197703 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213500 Oct 27 09:12:46.015633 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1448/2942] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:46.037679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:46.044346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:46.057299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:46.059491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:46.060004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:46.060737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:46.066412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:46.067130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:46.296580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:46.315300 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2d680347-060f-4c34-a1a4-ffc738e3c57b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 0.404819 Oct 27 09:12:46.316821 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1495/2943] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:45 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:46.327147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-002fc97d-1bc3-4d19-a82c-35c3e8867cb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa55d550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:46.460496 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-002fc97d-1bc3-4d19-a82c-35c3e8867cb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.141981 Oct 27 09:12:46.472424 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1496/2944] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:46 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:46.488809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:46.492482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:46.509375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:46.514551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:46.517064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:46.519272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:46.520025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:46.522033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:46.875244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:46.883411 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19dce1fa-e44a-42a8-9293-86a4808744ff tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1368 microversion: 2.1 time: 0.865882 Oct 27 09:12:46.887967 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1449/2945] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:46 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1368 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:46.893341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8444d693-88b1-46a7-9b2d-9c6f82152510 req-5bcacd7c-9bfa-49bd-9550-b6cad067f5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "617af9bd-1546-41f2-ae91-daf745dc43eb", "name": "network-vif-plugged", "status": "completed", "tag": "52b516c3-0eee-40e6-8fe1-0576e63ce4da"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:46.943648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8444d693-88b1-46a7-9b2d-9c6f82152510 req-5bcacd7c-9bfa-49bd-9550-b6cad067f5d9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:46.944148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8444d693-88b1-46a7-9b2d-9c6f82152510 req-5bcacd7c-9bfa-49bd-9550-b6cad067f5d9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:46.944587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8444d693-88b1-46a7-9b2d-9c6f82152510 req-5bcacd7c-9bfa-49bd-9550-b6cad067f5d9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:46.960903 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8444d693-88b1-46a7-9b2d-9c6f82152510 req-5bcacd7c-9bfa-49bd-9550-b6cad067f5d9 service nova] Creating event network-vif-plugged:52b516c3-0eee-40e6-8fe1-0576e63ce4da for instance 617af9bd-1546-41f2-ae91-daf745dc43eb on n-h1-858383-16 Oct 27 09:12:46.971286 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8444d693-88b1-46a7-9b2d-9c6f82152510 req-5bcacd7c-9bfa-49bd-9550-b6cad067f5d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081319 Oct 27 09:12:46.976740 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1450/2946] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:46.994308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:46.995486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:47.030225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:47.031485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:47.034382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:47.035392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:47.036965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:47.038053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:47.476416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:47.494911 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b9b81bd-1024-4669-ab0b-af36957cc659 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 1.017814 Oct 27 09:12:47.496381 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1497/2947] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:46 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:47.504928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:47.506584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:47.515464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:47.516617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:47.517352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:47.518943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:47.519695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:47.520532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:47.874382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:47.882693 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dea26fef-9ab9-4e40-9e67-d51308d338a7 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996" status: 200 len: 1518 microversion: 2.1 time: 0.904397 Oct 27 09:12:47.883289 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1451/2948] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:46 2022] GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996 => generated 1518 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:47.892557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:47.905211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:47.913062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:47.913851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:47.915634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:47.916647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:47.917279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:47.917869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:48.388603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:48.397166 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6cd0b832-5ff2-4d18-897d-1d0507162264 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 0.508393 Oct 27 09:12:48.397754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1452/2949] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:47 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:48.416973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de0bf3a4-db1d-4934-8c93-f1e937627a6d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aaadeee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:48.496096 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-de0bf3a4-db1d-4934-8c93-f1e937627a6d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.083343 Oct 27 09:12:48.507934 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1453/2950] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:48 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:48.520929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:48.523090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:48.534004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:48.536624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:48.537407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:48.538484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:48.539205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:48.539887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:48.558602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:48.583523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:48.587678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:48.589017 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b3123ed3-864d-4a16-afde-0a60a36f04ee tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 1.091278 Oct 27 09:12:48.589569 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1498/2951] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:47 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:48.600741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:48.609728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-087e103e-87c1-4e96-abf1-a623378e2d28 req-098a0383-833a-44c6-8c52-1234110903aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f32d9ac3-679c-4dbd-a101-a244c42ee14e", "tag": "d39c2450-a7a4-48c5-8001-90e0ea3b6b70"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:48.649579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-087e103e-87c1-4e96-abf1-a623378e2d28 req-098a0383-833a-44c6-8c52-1234110903aa service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:48.650382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-087e103e-87c1-4e96-abf1-a623378e2d28 req-098a0383-833a-44c6-8c52-1234110903aa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:48.650994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-087e103e-87c1-4e96-abf1-a623378e2d28 req-098a0383-833a-44c6-8c52-1234110903aa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:48.665766 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-087e103e-87c1-4e96-abf1-a623378e2d28 req-098a0383-833a-44c6-8c52-1234110903aa service nova] Creating event network-changed:d39c2450-a7a4-48c5-8001-90e0ea3b6b70 for instance f32d9ac3-679c-4dbd-a101-a244c42ee14e on n-h1-858383-16 Oct 27 09:12:48.673434 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-087e103e-87c1-4e96-abf1-a623378e2d28 req-098a0383-833a-44c6-8c52-1234110903aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081625 Oct 27 09:12:48.674405 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1499/2952] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:48.688404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:48.693712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:48.706070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:48.707337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:48.708392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:48.710095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:48.711249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:48.712359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:49.489511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:49.498981 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7648d84-fd14-42a6-995c-a4a1ad67de60 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1553 microversion: 2.1 time: 0.986065 Oct 27 09:12:49.516101 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1454/2953] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:48 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1553 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:49.538141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:49.541774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:49.560341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:49.561267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:49.561871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:49.562771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:49.563392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:49.563993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:49.641325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:49.649733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:49.650568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:49.651154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:49.651844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lazy-loading 'fault' on Instance uuid 6994798f-1c49-459b-9269-75765b26f996 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:12:49.675012 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-17d54c22-ce12-4fe8-9b0e-8e21c449dd22 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.999215 Oct 27 09:12:49.678929 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1500/2954] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:48 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:49.701177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2160e909-1ede-4370-a6eb-3eebe6634c01 req-18da8239-1a68-4d10-909e-8de50d0285a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6994798f-1c49-459b-9269-75765b26f996", "name": "network-vif-deleted", "tag": "f5977720-9e78-4f32-81e7-25bbadb0a479"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:49.727872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2160e909-1ede-4370-a6eb-3eebe6634c01 req-18da8239-1a68-4d10-909e-8de50d0285a5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:49.728789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2160e909-1ede-4370-a6eb-3eebe6634c01 req-18da8239-1a68-4d10-909e-8de50d0285a5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:49.729435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2160e909-1ede-4370-a6eb-3eebe6634c01 req-18da8239-1a68-4d10-909e-8de50d0285a5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:49.747089 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2160e909-1ede-4370-a6eb-3eebe6634c01 req-18da8239-1a68-4d10-909e-8de50d0285a5 service nova] Creating event network-vif-deleted:f5977720-9e78-4f32-81e7-25bbadb0a479 for instance 6994798f-1c49-459b-9269-75765b26f996 on n-h2-858383-16 Oct 27 09:12:49.761544 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2160e909-1ede-4370-a6eb-3eebe6634c01 req-18da8239-1a68-4d10-909e-8de50d0285a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078844 Oct 27 09:12:49.767908 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1501/2955] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:49.773795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:49.774864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:49.783719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:49.784570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:49.785234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:49.787729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:49.788454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:49.789105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:49.824162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:49.841274 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c277cbc-f306-4f78-b1f0-8ee1815a0ea6 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996" status: 200 len: 1311 microversion: 2.1 time: 0.311732 Oct 27 09:12:49.855793 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1455/2956] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:49 2022] GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996 => generated 1311 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:49.866100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af9bbf2f-a271-4814-93cd-bde86e596504 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa5e0160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:49.927204 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af9bbf2f-a271-4814-93cd-bde86e596504 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.069850 Oct 27 09:12:49.930726 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1456/2957] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:49 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:49.938483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffceef15-8e63-4209-9211-92e3e3c6ac8c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:49.939398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ffceef15-8e63-4209-9211-92e3e3c6ac8c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:49.949349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffceef15-8e63-4209-9211-92e3e3c6ac8c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:49.950425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffceef15-8e63-4209-9211-92e3e3c6ac8c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:49.951283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffceef15-8e63-4209-9211-92e3e3c6ac8c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:49.952413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffceef15-8e63-4209-9211-92e3e3c6ac8c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:49.953449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffceef15-8e63-4209-9211-92e3e3c6ac8c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:49.954096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffceef15-8e63-4209-9211-92e3e3c6ac8c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.181995 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ffceef15-8e63-4209-9211-92e3e3c6ac8c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.249914 Oct 27 09:12:50.182916 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1457/2958] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:12:49 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:50.195553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:50.196229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:50.207620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:50.209438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:50.212022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.215939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:50.217227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:50.217845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.236365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:50.246295 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ec9d704-de55-4c97-bf64-5807dfb0340f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 0.476855 Oct 27 09:12:50.259724 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1502/2959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:49 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:50.550948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:50.568454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:50.570058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:50.573474 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cda41d37-03e8-4205-8364-1d89b5764dec tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.389373 Oct 27 09:12:50.576252 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1458/2960] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:50 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:50.704530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:50.705611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:50.712263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:50.713016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:50.713813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.714771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:50.715420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:50.716030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.781451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-03c4497f-7161-4a24-aa52-b66a30020f48 req-77eb468b-6e9d-4426-9178-8250d50bca89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "tag": "2cde9751-eb67-4cae-b058-60bba7fb3b65"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:50.800341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-03c4497f-7161-4a24-aa52-b66a30020f48 req-77eb468b-6e9d-4426-9178-8250d50bca89 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:50.802110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-03c4497f-7161-4a24-aa52-b66a30020f48 req-77eb468b-6e9d-4426-9178-8250d50bca89 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:50.802827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-03c4497f-7161-4a24-aa52-b66a30020f48 req-77eb468b-6e9d-4426-9178-8250d50bca89 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.821607 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-03c4497f-7161-4a24-aa52-b66a30020f48 req-77eb468b-6e9d-4426-9178-8250d50bca89 service nova] Creating event network-changed:2cde9751-eb67-4cae-b058-60bba7fb3b65 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:12:50.827174 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-03c4497f-7161-4a24-aa52-b66a30020f48 req-77eb468b-6e9d-4426-9178-8250d50bca89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050864 Oct 27 09:12:50.828515 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1459/2961] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:50.870283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:50.871435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: 6994798f-1c49-459b-9269-75765b26f996] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:50.885478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:50.886533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:50.887240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.888382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:50.889066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:50.889709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.916377 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] HTTP exception thrown: Instance 6994798f-1c49-459b-9269-75765b26f996 could not be found. Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Request method failure captured: Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996 HTTP/1.1 Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWksSwnAER2WQ6tRm56e1HBdRpsoLRduMXtFFyMKkVz2hh0tplCzqLdY55i9Mg56pTtuduTIuaLXRcUtUxOLhoqFq0q6e934x1Kfa6_DEwc0woKtym18fZ54YPBqNci-_owai45luys4Xs2tSl1OcZHWMvm24IyREvwaXAZHQmzVlkvM Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 16083c891b2b4f4f9264fbcf086f3893 Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ListServerFiltersTestJSON-1785354040 Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16083c891b2b4f4f9264fbcf086f3893"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16083c891b2b4f4f9264fbcf086f3893"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16083c891b2b4f4f9264fbcf086f3893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16083c891b2b4f4f9264fbcf086f3893"}]}] Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ListServerFiltersTestJSON-1785354040 Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 16083c891b2b4f4f9264fbcf086f3893 Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1785354040 Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ListServerFiltersTestJSON-1785354040-project Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c5079fda993e4c1aaca97eff5ae5f14e Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ListServerFiltersTestJSON-1785354040-project Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 6994798f-1c49-459b-9269-75765b26f996 could not be found. Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '6994798f-1c49-459b-9269-75765b26f996'} Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6994798f-1c49-459b-9269-75765b26f996 could not be found. Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6994798f-1c49-459b-9269-75765b26f996 could not be found. Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:12:50.919031 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:50.923004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:12:50.923004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:12:50.923004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:12:50.923004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:12:50.923004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:12:50.923004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6994798f-1c49-459b-9269-75765b26f996 could not be found. Oct 27 09:12:50.923004 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:12:50.927908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Returning 404 to user: Instance 6994798f-1c49-459b-9269-75765b26f996 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:12:50.929204 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dcc7d3fc-aba5-4000-ae83-81584a84192a tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996" status: 404 len: 111 microversion: 2.1 time: 0.063300 Oct 27 09:12:50.930332 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1460/2962] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:50 2022] GET /compute/v2.1/servers/6994798f-1c49-459b-9269-75765b26f996 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:12:50.947951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:50.948882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:50.953597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:50.966006 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1b1c4e5f-aaed-4751-aded-5c388ad64dba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.264960 Oct 27 09:12:50.967476 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1503/2963] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:50 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:50.969054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:50.969321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:50.969925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.975785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:50.976540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:50.977144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:50.977293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ac7da65c-119e-4b6f-a77e-41d7484677c1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae694670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:51.024218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:12:51.056870 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ac7da65c-119e-4b6f-a77e-41d7484677c1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.083123 Oct 27 09:12:51.059892 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1504/2964] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:50 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:51.147945 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-398f3353-d444-4638-af82-bb36e9df1ec2 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 204 len: 0 microversion: 2.1 time: 0.212419 Oct 27 09:12:51.154965 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1461/2965] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:12:50 2022] DELETE /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:12:51.158794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:51.159914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:51.174313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:51.175166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:51.176667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:51.178463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:51.180844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:51.181197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:51.282399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:51.286130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:51.315382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:51.319933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:51.320966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:51.353644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:51.355160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:51.357514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:51.664050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:51.675886 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-795142c2-e825-49db-8463-47d01eecddf1 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1516 microversion: 2.1 time: 0.519189 Oct 27 09:12:51.676528 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1505/2966] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:51 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1516 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:12:51.684626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:51.694244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:51.700482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:51.711474 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70b4879f-b810-4b5e-a387-98ea790b4e5f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 0.435175 Oct 27 09:12:51.725164 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1462/2967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:51 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:51.730900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:51.732018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:51.732748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:51.733680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:51.734144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:51.734580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:51.991977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:51.993023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:52.008808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:52.009740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:52.010382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:52.011450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:52.012111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:52.012695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:52.253707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:52.268105 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a7a6dd9-fd93-44ef-acde-34893b510f79 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1315 microversion: 2.1 time: 0.282364 Oct 27 09:12:52.270686 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1463/2968] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:51 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:52.284604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc4b1223-6e1a-4593-a437-d321b7f2244d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa826dc0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:52.349293 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc4b1223-6e1a-4593-a437-d321b7f2244d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.077258 Oct 27 09:12:52.358344 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1464/2969] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:52 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:52.397634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:52.413810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:52.415636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:52.418681 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-968265e9-26fb-453f-a66d-552bb55bf390 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.741130 Oct 27 09:12:52.422032 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1506/2970] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:51 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:52.705717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:52.707270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:52.737957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:52.739312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:52.745522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:52.750008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:52.750883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:52.754809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:52.755795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:52.756734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:52.757396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:52.758324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:52.758967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:52.759912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:52.763391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:52.764927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:52.781725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:12:53.542184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:53.555360 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-880bd34c-e0f9-4804-b391-704ccd3a8937 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1516 microversion: 2.1 time: 0.854530 Oct 27 09:12:53.556686 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1465/2971] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:52 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1516 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:53.562632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-496ae4b4-7e2c-411a-a5b2-fcbda901b4bc req-cd171122-d545-4863-b42c-e19f75df2eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "tag": "544be81e-f783-47ec-8081-b057c946342d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:53.582324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-496ae4b4-7e2c-411a-a5b2-fcbda901b4bc req-cd171122-d545-4863-b42c-e19f75df2eed service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:53.584772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-496ae4b4-7e2c-411a-a5b2-fcbda901b4bc req-cd171122-d545-4863-b42c-e19f75df2eed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:53.585850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-496ae4b4-7e2c-411a-a5b2-fcbda901b4bc req-cd171122-d545-4863-b42c-e19f75df2eed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:53.604082 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-496ae4b4-7e2c-411a-a5b2-fcbda901b4bc req-cd171122-d545-4863-b42c-e19f75df2eed service nova] Creating event network-changed:544be81e-f783-47ec-8081-b057c946342d for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:12:53.611605 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-496ae4b4-7e2c-411a-a5b2-fcbda901b4bc req-cd171122-d545-4863-b42c-e19f75df2eed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052341 Oct 27 09:12:53.612537 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1466/2972] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:53.630287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:53.632406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:53.641251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:53.642339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:53.644042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:53.646254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:53.647039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:53.680025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:53.970216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:53.992042 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e03f36b-cf61-4dc5-95df-c68b57f77350 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 1.254674 Oct 27 09:12:53.992886 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1507/2973] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:52 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:12:54.004187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37bc7040-42e2-445f-9043-d8d91096ff3c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa18d310>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:54.105694 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37bc7040-42e2-445f-9043-d8d91096ff3c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.108766 Oct 27 09:12:54.115237 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1508/2974] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:53 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:54.130786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:54.132323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:54.152618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:54.153427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:54.154040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:54.159426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:54.160287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:54.160897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:55.031781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:55.046424 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25fabc99-4237-43a2-ba25-d9b7b53d6aa4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1502 microversion: 2.1 time: 1.431646 Oct 27 09:12:55.079848 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1467/2975] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:53 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1502 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:55.092933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:55.099238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:55.106274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:55.125776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:55.132723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:55.136029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:55.138517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:55.139608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:55.140526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:55.141750 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-20a73257-118b-4cd5-ac7a-07d68a57c556 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 1.025179 Oct 27 09:12:55.144457 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1509/2976] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:54 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:55.151131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:55.162416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:55.163214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:55.163682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:55.175049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:55.181056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:55.181923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:55.185944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:55.186622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:55.188216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:55.509255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:55.518528 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40f1aee7-49bf-4009-ade5-bc933e340ff5 tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1474 microversion: 2.1 time: 0.436901 Oct 27 09:12:55.519127 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1468/2977] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:55 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1474 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:55.526978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1434421770"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:55.532222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:55.549768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:55.550517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:55.551158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:55.552079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:55.555262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:55.555994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:55.747867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:55.765885 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c2ee49af-e005-447f-a331-7164c8f40fe0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 0.619725 Oct 27 09:12:55.766380 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1510/2978] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:55 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:55.779410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c52c867-e070-4e90-b166-84975cea69af tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa9fb280>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:55.879785 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c52c867-e070-4e90-b166-84975cea69af tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.112211 Oct 27 09:12:55.882707 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1511/2979] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:55 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:55.896620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-cf9adcc2-0816-4883-a3ef-65de448e3392 req-9f83a8da-94de-4b57-837c-9f1dce29c1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c829e85-d998-438d-8574-2bd136bacf72", "tag": "3e677692-d625-44bf-b691-120c347bce6e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:55.917552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cf9adcc2-0816-4883-a3ef-65de448e3392 req-9f83a8da-94de-4b57-837c-9f1dce29c1c6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:55.918745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cf9adcc2-0816-4883-a3ef-65de448e3392 req-9f83a8da-94de-4b57-837c-9f1dce29c1c6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:55.919707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cf9adcc2-0816-4883-a3ef-65de448e3392 req-9f83a8da-94de-4b57-837c-9f1dce29c1c6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:55.921601 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.network.security_group_api [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Adding security group 9e139488-74ca-478f-bf18-44f233b8ac64 to port 52b516c3-0eee-40e6-8fe1-0576e63ce4da Oct 27 09:12:55.935795 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-cf9adcc2-0816-4883-a3ef-65de448e3392 req-9f83a8da-94de-4b57-837c-9f1dce29c1c6 service nova] Creating event network-changed:3e677692-d625-44bf-b691-120c347bce6e for instance 4c829e85-d998-438d-8574-2bd136bacf72 on n-h1-858383-16 Oct 27 09:12:55.942226 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-cf9adcc2-0816-4883-a3ef-65de448e3392 req-9f83a8da-94de-4b57-837c-9f1dce29c1c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057811 Oct 27 09:12:55.943505 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1512/2980] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:55.959552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-eac1d84c-a170-4a3b-88cb-d2f9450dc409 req-6c20bc29-0e36-47a1-ba7c-1476718250af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "tag": "7dc176e6-58b3-4ec1-9928-173ca4ea6e6d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:56.001720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eac1d84c-a170-4a3b-88cb-d2f9450dc409 req-6c20bc29-0e36-47a1-ba7c-1476718250af service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:56.002224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eac1d84c-a170-4a3b-88cb-d2f9450dc409 req-6c20bc29-0e36-47a1-ba7c-1476718250af service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:56.005134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eac1d84c-a170-4a3b-88cb-d2f9450dc409 req-6c20bc29-0e36-47a1-ba7c-1476718250af service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:56.073328 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-eac1d84c-a170-4a3b-88cb-d2f9450dc409 req-6c20bc29-0e36-47a1-ba7c-1476718250af service nova] Creating event network-changed:7dc176e6-58b3-4ec1-9928-173ca4ea6e6d for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:12:56.102628 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-eac1d84c-a170-4a3b-88cb-d2f9450dc409 req-6c20bc29-0e36-47a1-ba7c-1476718250af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157149 Oct 27 09:12:56.118194 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1513/2981] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:56.178313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:56.179552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:56.200533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:56.204687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:56.212119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:56.213942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:56.213942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:56.215314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:57.154010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:57.166921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:57.179255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:57.180512 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8958aca-11a5-4c09-becb-f79d6f97938e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 1.007571 Oct 27 09:12:57.181471 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1514/2982] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:56 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:12:57.216380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:57.217008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:57.278156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:57.278776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:57.285563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:57.287395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:57.291613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:57.294385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:57.482966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:57.485969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:57.488352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:57.493141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lazy-loading 'fault' on Instance uuid dc304a43-0894-406b-b290-4e5ae8490403 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:12:57.952643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5079fda993e4c1aaca97eff5ae5f14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16083c891b2b4f4f9264fbcf086f3893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:57.966212 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-355ae3b2-a9f0-4ded-9105-93bc16b9dfbe tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 200 len: 1310 microversion: 2.1 time: 0.752692 Oct 27 09:12:57.969598 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1515/2983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:57 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 1310 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:57.984023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:57.986823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:58.001200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:58.005058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:58.005688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:58.008483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:58.009140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:58.013335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:58.858763 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9b3d1b4-3cdd-4631-9ca0-5dcef8df37e9 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb/action" status: 202 len: 0 microversion: 2.1 time: 3.337718 Oct 27 09:12:58.859809 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1469/2984] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:12:55 2022] POST /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb/action => generated 0 bytes in 3339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:12:58.862620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:58.868150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e74e1648-e1d8-41a0-bf28-47a20fe5e604 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa1ae0d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:58.880846 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa9e0fad-4b3e-4991-862f-f1b98f032bc6 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 0.909650 Oct 27 09:12:58.881768 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1516/2985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:12:57 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:58.984909 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e74e1648-e1d8-41a0-bf28-47a20fe5e604 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.123903 Oct 27 09:12:58.988316 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1470/2986] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:12:58 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:12:58.995383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ce8f84c0-de84-4e9b-967a-cef2294068c0 req-245ba58a-2c20-44c7-ae51-fdc63d4e3054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc304a43-0894-406b-b290-4e5ae8490403", "name": "network-vif-deleted", "tag": "734a98b2-787d-44dd-94a9-f9d1d3f2f96d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:59.010345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ce8f84c0-de84-4e9b-967a-cef2294068c0 req-245ba58a-2c20-44c7-ae51-fdc63d4e3054 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:59.011208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ce8f84c0-de84-4e9b-967a-cef2294068c0 req-245ba58a-2c20-44c7-ae51-fdc63d4e3054 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:59.011823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ce8f84c0-de84-4e9b-967a-cef2294068c0 req-245ba58a-2c20-44c7-ae51-fdc63d4e3054 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:59.029711 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ce8f84c0-de84-4e9b-967a-cef2294068c0 req-245ba58a-2c20-44c7-ae51-fdc63d4e3054 service nova] Creating event network-vif-deleted:734a98b2-787d-44dd-94a9-f9d1d3f2f96d for instance dc304a43-0894-406b-b290-4e5ae8490403 on n-h2-858383-16 Oct 27 09:12:59.036006 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ce8f84c0-de84-4e9b-967a-cef2294068c0 req-245ba58a-2c20-44c7-ae51-fdc63d4e3054 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045634 Oct 27 09:12:59.037216 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1471/2987] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:59.045856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:12:59.046823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:12:59.058386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:59.059535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:59.060524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:59.061467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:59.062111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:59.062712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:59.198442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1653879324", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:59.307089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] validate_networks() for [('8645ef92-89af-4ed2-b137-b0ee289bccd9', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:12:59.589810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:59.618561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:59.620873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:12:59.622125 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e986411-fd39-4351-810c-5ec8ee81dfc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.583264 Oct 27 09:12:59.622731 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1472/2988] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:12:59 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:12:59.646901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-65915953-fefd-4497-ade2-4c2634fc0e0f req-55b762a7-ce05-45a4-8742-a1dbccfa410f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32d9ac3-679c-4dbd-a101-a244c42ee14e", "name": "network-vif-plugged", "status": "completed", "tag": "d39c2450-a7a4-48c5-8001-90e0ea3b6b70"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:12:59.671703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-65915953-fefd-4497-ade2-4c2634fc0e0f req-55b762a7-ce05-45a4-8742-a1dbccfa410f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:12:59.672223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-65915953-fefd-4497-ade2-4c2634fc0e0f req-55b762a7-ce05-45a4-8742-a1dbccfa410f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:12:59.672673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-65915953-fefd-4497-ade2-4c2634fc0e0f req-55b762a7-ce05-45a4-8742-a1dbccfa410f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:12:59.702944 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-65915953-fefd-4497-ade2-4c2634fc0e0f req-55b762a7-ce05-45a4-8742-a1dbccfa410f service nova] Creating event network-vif-plugged:d39c2450-a7a4-48c5-8001-90e0ea3b6b70 for instance f32d9ac3-679c-4dbd-a101-a244c42ee14e on n-h1-858383-16 Oct 27 09:12:59.713678 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-65915953-fefd-4497-ade2-4c2634fc0e0f req-55b762a7-ce05-45a4-8742-a1dbccfa410f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084268 Oct 27 09:12:59.716945 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1473/2989] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:12:59.739300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71ca9a6f-5fdf-48f0-9a07-898eb5e293e5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aa25aaf0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:00.286469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-71ca9a6f-5fdf-48f0-9a07-898eb5e293e5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9e139488-74ca-478f-bf18-44f233b8ac64 in use.", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:13:00.287963 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-71ca9a6f-5fdf-48f0-9a07-898eb5e293e5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security Group 9e139488-74ca-478f-bf18-44f233b8ac64 in use. Oct 27 09:13:00.287963 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-224b53b3-14cd-4fc7-8c2b-91f7fe2ebe73'] Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71ca9a6f-5fdf-48f0-9a07-898eb5e293e5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-security-groups/9e139488-74ca-478f-bf18-44f233b8ac64 HTTP/1.1 Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: exception: Security Group 9e139488-74ca-478f-bf18-44f233b8ac64 in use. Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-224b53b3-14cd-4fc7-8c2b-91f7fe2ebe73'] Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '9e139488-74ca-478f-bf18-44f233b8ac64'} Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:13:00.290286 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9e139488-74ca-478f-bf18-44f233b8ac64 in use. Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-224b53b3-14cd-4fc7-8c2b-91f7fe2ebe73'] Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9e139488-74ca-478f-bf18-44f233b8ac64 in use. Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-224b53b3-14cd-4fc7-8c2b-91f7fe2ebe73'] Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9e139488-74ca-478f-bf18-44f233b8ac64 in use. Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-224b53b3-14cd-4fc7-8c2b-91f7fe2ebe73'] Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9e139488-74ca-478f-bf18-44f233b8ac64 in use. Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-224b53b3-14cd-4fc7-8c2b-91f7fe2ebe73'] Oct 27 09:13:00.294891 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.301056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71ca9a6f-5fdf-48f0-9a07-898eb5e293e5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 400 to user: Security Group 9e139488-74ca-478f-bf18-44f233b8ac64 in use. Oct 27 09:13:00.301056 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-224b53b3-14cd-4fc7-8c2b-91f7fe2ebe73'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:00.302431 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71ca9a6f-5fdf-48f0-9a07-898eb5e293e5 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/9e139488-74ca-478f-bf18-44f233b8ac64" status: 400 len: 185 microversion: 2.1 time: 0.583495 Oct 27 09:13:00.303847 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1474/2990] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:12:59 2022] DELETE /compute/v2.1/os-security-groups/9e139488-74ca-478f-bf18-44f233b8ac64 => generated 185 bytes in 586 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:13:00.329497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e9d893ee-c470-4dc5-81f9-d2b98e45e508 req-297b18e5-838d-46ad-ac7f-7d47a67b4483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617af9bd-1546-41f2-ae91-daf745dc43eb", "tag": "52b516c3-0eee-40e6-8fe1-0576e63ce4da"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:00.367038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e9d893ee-c470-4dc5-81f9-d2b98e45e508 req-297b18e5-838d-46ad-ac7f-7d47a67b4483 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:00.367721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e9d893ee-c470-4dc5-81f9-d2b98e45e508 req-297b18e5-838d-46ad-ac7f-7d47a67b4483 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:00.368474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e9d893ee-c470-4dc5-81f9-d2b98e45e508 req-297b18e5-838d-46ad-ac7f-7d47a67b4483 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:00.389634 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e9d893ee-c470-4dc5-81f9-d2b98e45e508 req-297b18e5-838d-46ad-ac7f-7d47a67b4483 service nova] Creating event network-changed:52b516c3-0eee-40e6-8fe1-0576e63ce4da for instance 617af9bd-1546-41f2-ae91-daf745dc43eb on n-h1-858383-16 Oct 27 09:13:00.409761 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e9d893ee-c470-4dc5-81f9-d2b98e45e508 req-297b18e5-838d-46ad-ac7f-7d47a67b4483 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104181 Oct 27 09:13:00.410801 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1475/2991] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:00.419233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:00.420419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] [instance: dc304a43-0894-406b-b290-4e5ae8490403] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:00.439786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:00.440457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:00.440911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:00.441781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:00.442265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:00.456387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:00.491091 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] HTTP exception thrown: Instance dc304a43-0894-406b-b290-4e5ae8490403 could not be found. Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Request method failure captured: Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 HTTP/1.1 Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWksSwnAER2WQ6tRm56e1HBdRpsoLRduMXtFFyMKkVz2hh0tplCzqLdY55i9Mg56pTtuduTIuaLXRcUtUxOLhoqFq0q6e934x1Kfa6_DEwc0woKtym18fZ54YPBqNci-_owai45luys4Xs2tSl1OcZHWMvm24IyREvwaXAZHQmzVlkvM Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 16083c891b2b4f4f9264fbcf086f3893 Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ListServerFiltersTestJSON-1785354040 Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16083c891b2b4f4f9264fbcf086f3893"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16083c891b2b4f4f9264fbcf086f3893"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16083c891b2b4f4f9264fbcf086f3893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16083c891b2b4f4f9264fbcf086f3893"}]}] Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ListServerFiltersTestJSON-1785354040 Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 16083c891b2b4f4f9264fbcf086f3893 Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1785354040 Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ListServerFiltersTestJSON-1785354040-project Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c5079fda993e4c1aaca97eff5ae5f14e Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ListServerFiltersTestJSON-1785354040-project Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance dc304a43-0894-406b-b290-4e5ae8490403 could not be found. Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'dc304a43-0894-406b-b290-4e5ae8490403'} Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc304a43-0894-406b-b290-4e5ae8490403 could not be found. Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc304a43-0894-406b-b290-4e5ae8490403 could not be found. Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:00.493352 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.498651 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:00.498651 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:00.498651 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:00.498651 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:00.498651 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:00.498651 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc304a43-0894-406b-b290-4e5ae8490403 could not be found. Oct 27 09:13:00.498651 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:00.501080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] Returning 404 to user: Instance dc304a43-0894-406b-b290-4e5ae8490403 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:00.502808 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-434426a1-a44b-4119-903e-e10b0fbd14cb tempest-ListServerFiltersTestJSON-1785354040 tempest-ListServerFiltersTestJSON-1785354040-project] 10.222.0.25 "GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403" status: 404 len: 111 microversion: 2.1 time: 0.090772 Oct 27 09:13:00.504113 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1476/2992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:00 2022] GET /compute/v2.1/servers/dc304a43-0894-406b-b290-4e5ae8490403 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:00.509415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:00.510352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:00.518181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:00.518992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:00.519659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:00.520654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:00.521352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:00.521976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:00.756263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:13:00.763280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:13:00.764189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:13:00.764786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:13:00.765391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:13:00.825966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:00.826511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:00.827019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:00.832907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:00.833671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:00.834126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:00.891428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Getting quotas for project 1bfa9429f0fc463bafee4c25b310a008. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:13:00.901973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Getting quotas for user b301dc23d4934d62a4be5b5fbdb4888b and project 1bfa9429f0fc463bafee4c25b310a008. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:13:00.928489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:13:00.935283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:13:01.020223 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a5acef3c-b27b-4bd8-8676-5f7ace378251 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.137264 Oct 27 09:13:01.022227 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1517/2993] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:13:01.027518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b74840d4-55b4-43bc-885c-211fafa93017 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa535ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:01.096454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b74840d4-55b4-43bc-885c-211fafa93017 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.072631 Oct 27 09:13:01.097668 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1518/2994] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:01 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:01.103548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d3cab10c-bba6-4f8c-8530-66eeaa3690d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:01.106544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d3cab10c-bba6-4f8c-8530-66eeaa3690d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:01.115848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3cab10c-bba6-4f8c-8530-66eeaa3690d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:01.116838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3cab10c-bba6-4f8c-8530-66eeaa3690d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:01.117490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3cab10c-bba6-4f8c-8530-66eeaa3690d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:01.118457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3cab10c-bba6-4f8c-8530-66eeaa3690d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:01.119145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3cab10c-bba6-4f8c-8530-66eeaa3690d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:01.119823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3cab10c-bba6-4f8c-8530-66eeaa3690d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:01.146157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:01.155190 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-592bf746-881b-4fa9-9450-b9f3a01f050f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1316 microversion: 2.1 time: 0.649755 Oct 27 09:13:01.160959 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1477/2995] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:00 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1316 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:01.175980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:01.177147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:01.190672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:01.191657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:01.192473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:01.194290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:01.196849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:01.197560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:01.265278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:01.319326 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d3cab10c-bba6-4f8c-8530-66eeaa3690d7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb/action" status: 202 len: 0 microversion: 2.1 time: 0.219876 Oct 27 09:13:01.321905 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1519/2996] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:13:01 2022] POST /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:13:01.345791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51adb1d9-7646-4891-b2c4-814844e3d849 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:01.351171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-51adb1d9-7646-4891-b2c4-814844e3d849 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:01.714605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-51adb1d9-7646-4891-b2c4-814844e3d849 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:01.722291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-51adb1d9-7646-4891-b2c4-814844e3d849 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1224 microversion: 2.1 time: 0.392087 Oct 27 09:13:01.740336 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1520/2997] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:01 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1224 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:01.749535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:01.757359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:01.770476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:01.771188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:01.771823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:01.772699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:01.773327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:01.776750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:02.209959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:02.241067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:02.252392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:02.256941 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d37ca25-689e-4b8f-8c9d-d2688cc9cd60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 1.094401 Oct 27 09:13:02.258490 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1478/2998] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:01 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:02.288720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77599e1c-5aee-48b1-b924-380e7b1d6b96 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa71e430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:02.426051 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77599e1c-5aee-48b1-b924-380e7b1d6b96 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.161122 Oct 27 09:13:02.427266 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1479/2999] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:02 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:02.433287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:02.437168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:02.447204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:02.449192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:02.450044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:02.452506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:02.453660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:02.454531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:02.639514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:02.677578 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c32d6e2b-45c7-4ec3-8af3-ab47350edffe tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1573 microversion: 2.1 time: 0.930079 Oct 27 09:13:02.687663 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1521/3000] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:01 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1573 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:02.748279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:02.748985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:02.765462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:02.766146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:02.766505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:02.767267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:02.767847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:02.768326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:02.948129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:02.960625 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c9c15a0f-6b0f-4e94-b62d-3b82132fac57 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1276 microversion: 2.1 time: 0.216624 Oct 27 09:13:02.976070 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1522/3001] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:02 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:03.136376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:03.150036 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79bbcd8c-452a-459d-b717-a37660e95339 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1466 microversion: 2.1 time: 0.721317 Oct 27 09:13:03.151109 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1480/3002] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:02 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1466 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:03.180997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e6cfed4-3931-4fb4-af36-abc160a52506 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:03.181610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e6cfed4-3931-4fb4-af36-abc160a52506 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:03.191313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6cfed4-3931-4fb4-af36-abc160a52506 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:03.191946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6cfed4-3931-4fb4-af36-abc160a52506 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:03.192776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6cfed4-3931-4fb4-af36-abc160a52506 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:03.193861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6cfed4-3931-4fb4-af36-abc160a52506 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:03.194811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6cfed4-3931-4fb4-af36-abc160a52506 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:03.195549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6cfed4-3931-4fb4-af36-abc160a52506 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:03.303760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:03.316776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:03.350223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:03.350702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:03.351209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:03.351987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:03.357979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:03.358778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:03.671586 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e6cfed4-3931-4fb4-af36-abc160a52506 tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1619 microversion: 2.1 time: 0.495481 Oct 27 09:13:03.674597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1523/3003] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:03 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1619 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:03.688381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc544c0d-74ec-4e45-82ed-a790f2ef8e0b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa2e7700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:03.838888 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc544c0d-74ec-4e45-82ed-a790f2ef8e0b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.154894 Oct 27 09:13:03.856909 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1524/3004] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:03 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:03.880123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:03.881231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:03.901716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:03.904200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:03.905917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:03.908748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:03.909586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:03.911962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:04.135068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:04.148368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:04.156487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:04.158340 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0686279-d7ed-464a-b071-1d12b9724eb2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.869009 Oct 27 09:13:04.164011 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1481/3005] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:03 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:04.179261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-914212299", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b27033c1-2e3e-441a-99b0-4038d19ec1ee"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:04.277520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:13:04.600344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:04.616737 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da273f5c-3eb2-4875-bbfc-200ee281ea17 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1573 microversion: 2.1 time: 0.747386 Oct 27 09:13:04.617326 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1525/3006] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:03 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1573 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:04.622197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:04.632489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:04.638804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:04.639296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:04.639761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:04.640480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:04.640919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:04.641340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:04.803344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:04.818584 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-11a5842f-6513-4476-b47e-05ab9de2f4ac tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1276 microversion: 2.1 time: 0.196926 Oct 27 09:13:04.819933 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1526/3007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:04 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:04.873743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b63bf569-33b8-4ea3-b7be-90dc63c90002 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ab0163a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:04.963338 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b63bf569-33b8-4ea3-b7be-90dc63c90002 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1439 microversion: 2.1 time: 0.093694 Oct 27 09:13:04.964481 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1527/3008] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:04 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:05.045829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:13:05.047061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:13:05.047731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:13:05.048348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:13:05.049554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:13:05.073222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:05.074020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:05.074770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:05.075823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:05.076497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:05.077174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:05.119187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:13:05.130882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:05.137412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Getting quotas for user e302f037bf934b958cef21d6001e7562 and project 5f5752431c874be58372449a6b71853c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:13:05.165752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:13:05.169213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:13:05.194849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:05.196899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:05.206624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:05.208107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:05.208765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:05.209761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:05.210397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:05.211026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:05.272410 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11d19f7e-520a-471c-aaf9-222df1ca67b3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103667 Oct 27 09:13:05.280698 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1482/3009] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:13:05.290171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-272b5d60-1e8b-496f-818f-f7d883c4f4f0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:05.291104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-272b5d60-1e8b-496f-818f-f7d883c4f4f0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:05.373496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-272b5d60-1e8b-496f-818f-f7d883c4f4f0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:05.384830 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-272b5d60-1e8b-496f-818f-f7d883c4f4f0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1216 microversion: 2.1 time: 0.102704 Oct 27 09:13:05.386427 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1483/3010] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:05 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1216 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:05.556663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:05.568290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:05.572105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:05.573296 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d525c450-56c9-46bb-857d-47c36a21503a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.384358 Oct 27 09:13:05.573858 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1528/3011] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:05 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:13:05.640356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:05.640963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:05.650186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:05.650803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:05.651320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:05.652116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:05.652668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:05.653201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:05.821910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:05.833277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85be3b4a-503e-4427-9844-c1c0542ce129 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1578 microversion: 2.1 time: 0.196939 Oct 27 09:13:05.833848 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1484/3012] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:05 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:05.842194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:05.842869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:05.850749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:05.851562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:05.852264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:05.853192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:05.854529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:05.855298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:05.940364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:05.958201 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ecb58a8c-48e3-4e7d-90ae-4e97b0b89660 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1282 microversion: 2.1 time: 0.119824 Oct 27 09:13:05.959126 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1529/3013] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:05 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:05.980323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ba0762e-280a-4769-a6e9-fc115cf8148f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa13e670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:06.040168 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ba0762e-280a-4769-a6e9-fc115cf8148f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1448 microversion: 2.1 time: 0.063241 Oct 27 09:13:06.040168 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1485/3014] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:05 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1448 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:06.055851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ff0a00a-c9c0-493d-b937-0409d76b0716 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa507670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:06.120204 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ff0a00a-c9c0-493d-b937-0409d76b0716 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 200 len: 1448 microversion: 2.1 time: 0.068236 Oct 27 09:13:06.122466 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1530/3015] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:06 2022] GET /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 1448 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:06.137242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-065f71f9-273f-4e2c-bc08-eba42fbceacb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa7434c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:06.409966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:06.410813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:06.419780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:06.420284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:06.425203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:06.425990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:06.426478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:06.426920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:06.456549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:06.568197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:06.583598 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82acad77-86d0-4392-a3e7-595b6602ac8b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1268 microversion: 2.1 time: 0.177572 Oct 27 09:13:06.599491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1531/3016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:06 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:06.608936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:06.610000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:06.621101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:06.621860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:06.622461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:06.623873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:06.625130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:06.627896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:06.891061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:06.904153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:06.905612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:06.906971 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-189c8057-783e-4a78-87d1-1e446af11cc7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.303454 Oct 27 09:13:06.907581 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1532/3017] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:06 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:06.929423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:06.930163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:06.937108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:06.937601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:06.938222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:06.939822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:06.940291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:06.940842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:07.122252 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-065f71f9-273f-4e2c-bc08-eba42fbceacb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 204 len: 0 microversion: 2.1 time: 0.989652 Oct 27 09:13:07.123048 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1486/3018] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:06 2022] DELETE /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 0 bytes in 991 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:07.132216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:07.132959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:07.158840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:07.160040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:07.160870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:07.161775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:07.162385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:07.162969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:07.167829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:07.178733 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8fafce85-e026-4d64-8a3d-b07d0fe496a3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1571 microversion: 2.1 time: 0.269807 Oct 27 09:13:07.180024 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1533/3019] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:06 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1571 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:07.185780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:07.186477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:07.193454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:07.194346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:07.195053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:07.195789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:07.196492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:07.197147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:07.231430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:13:07.379836 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b824904a-48bb-4875-9d06-3b2473cbea8c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 204 len: 0 microversion: 2.1 time: 0.198241 Oct 27 09:13:07.380340 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1534/3020] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:07 2022] DELETE /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:07.390288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1763966829"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:07.390931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:07.392911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:07.403789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:07.404291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:07.404736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:07.405449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:07.412737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:07.413498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:07.465697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:07.501930 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5468c92-c3f4-42da-81e0-209178f29488 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.376963 Oct 27 09:13:07.504089 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1487/3021] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:07 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:07.611673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:07.612749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:07.626641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:07.627423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:07.628578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:07.630520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:07.631209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:07.632297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:07.678054 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.network.security_group_api [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Adding security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a to port 52b516c3-0eee-40e6-8fe1-0576e63ce4da Oct 27 09:13:07.729659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:07.738204 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60d88b03-7b9e-4be4-bef3-eef9067fdb5b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1274 microversion: 2.1 time: 0.131710 Oct 27 09:13:07.739406 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1488/3022] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:07 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:07.745848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-769018102", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "8aa86863-8c60-413b-9747-3e375f601520"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:07.821606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] validate_networks() for [('8aa86863-8c60-413b-9747-3e375f601520', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:13:08.299061 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed520b67-d746-4d77-a10f-f703eb41e089 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb/action" status: 202 len: 0 microversion: 2.1 time: 0.914525 Oct 27 09:13:08.302972 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1535/3023] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:13:07 2022] POST /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb/action => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:13:08.307764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3da93ee2-3b39-4458-a06b-4eb0689c3b1c req-26aa10c9-d791-49f4-ab9d-b12e0316d186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a68363e6-08e4-49a8-b10f-7b954e13edb6", "tag": "842bfa9f-5d7b-4938-8428-64e04fd2e183"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:08.333085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3da93ee2-3b39-4458-a06b-4eb0689c3b1c req-26aa10c9-d791-49f4-ab9d-b12e0316d186 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:08.333811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3da93ee2-3b39-4458-a06b-4eb0689c3b1c req-26aa10c9-d791-49f4-ab9d-b12e0316d186 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:08.334388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3da93ee2-3b39-4458-a06b-4eb0689c3b1c req-26aa10c9-d791-49f4-ab9d-b12e0316d186 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:08.348628 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3da93ee2-3b39-4458-a06b-4eb0689c3b1c req-26aa10c9-d791-49f4-ab9d-b12e0316d186 service nova] Creating event network-changed:842bfa9f-5d7b-4938-8428-64e04fd2e183 for instance a68363e6-08e4-49a8-b10f-7b954e13edb6 on n-h2-858383-16 Oct 27 09:13:08.353879 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3da93ee2-3b39-4458-a06b-4eb0689c3b1c req-26aa10c9-d791-49f4-ab9d-b12e0316d186 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052487 Oct 27 09:13:08.355347 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1536/3024] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:08.368528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:08.369335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:08.375836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:08.376950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:08.377660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:08.378611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:08.379294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:08.380009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:08.918430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:13:08.919087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:13:08.920521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:13:08.921306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:13:08.922390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:13:08.940235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:08.941500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:08.943026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:08.944822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:08.945715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:08.946433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:08.956524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:08.968901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:08.971147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:08.972735 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99f01b1e-6470-429d-8e4a-c58b25dea4df tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.617162 Oct 27 09:13:08.973335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:13:08.992991 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1537/3025] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:08 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:08.996029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for user e63dd72032ef4fe098382555888e3ae3 and project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:13:08.998862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a27af55f-d383-4a3c-96f3-c49ab037a919 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aa18d0d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:09.020137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:13:09.023371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:13:09.090412 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e29f8072-e162-466b-a669-31b0a816dd14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349517 Oct 27 09:13:09.091983 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1489/3026] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:13:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:13:09.099626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-487bc5c7-2885-4fa3-8bf4-a6f1f635db87 req-d910dab1-9300-4db0-bed7-dfa0f0df2fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617af9bd-1546-41f2-ae91-daf745dc43eb", "tag": "52b516c3-0eee-40e6-8fe1-0576e63ce4da"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:09.113629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-487bc5c7-2885-4fa3-8bf4-a6f1f635db87 req-d910dab1-9300-4db0-bed7-dfa0f0df2fa6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:09.114483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-487bc5c7-2885-4fa3-8bf4-a6f1f635db87 req-d910dab1-9300-4db0-bed7-dfa0f0df2fa6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:09.115248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-487bc5c7-2885-4fa3-8bf4-a6f1f635db87 req-d910dab1-9300-4db0-bed7-dfa0f0df2fa6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:09.132134 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-487bc5c7-2885-4fa3-8bf4-a6f1f635db87 req-d910dab1-9300-4db0-bed7-dfa0f0df2fa6 service nova] Creating event network-changed:52b516c3-0eee-40e6-8fe1-0576e63ce4da for instance 617af9bd-1546-41f2-ae91-daf745dc43eb on n-h1-858383-16 Oct 27 09:13:09.142763 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-487bc5c7-2885-4fa3-8bf4-a6f1f635db87 req-d910dab1-9300-4db0-bed7-dfa0f0df2fa6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047448 Oct 27 09:13:09.144173 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1490/3027] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:09.156910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:09.158891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:09.167665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-a27af55f-d383-4a3c-96f3-c49ab037a919 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a in use.", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:13:09.168439 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a27af55f-d383-4a3c-96f3-c49ab037a919 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security Group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a in use. Oct 27 09:13:09.168439 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-df403774-036f-4c83-9393-ff24d2261eef'] Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a27af55f-d383-4a3c-96f3-c49ab037a919 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-security-groups/b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a HTTP/1.1 Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: exception: Security Group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a in use. Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-df403774-036f-4c83-9393-ff24d2261eef'] Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a'} Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:13:09.170738 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a in use. Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df403774-036f-4c83-9393-ff24d2261eef'] Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a in use. Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df403774-036f-4c83-9393-ff24d2261eef'] Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a in use. Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df403774-036f-4c83-9393-ff24d2261eef'] Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a in use. Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df403774-036f-4c83-9393-ff24d2261eef'] Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a27af55f-d383-4a3c-96f3-c49ab037a919 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 400 to user: Security Group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a in use. Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-df403774-036f-4c83-9393-ff24d2261eef'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a27af55f-d383-4a3c-96f3-c49ab037a919 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a" status: 400 len: 185 microversion: 2.1 time: 0.178043 Oct 27 09:13:09.175255 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1538/3028] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:08 2022] DELETE /compute/v2.1/os-security-groups/b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a => generated 185 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:13:09.181937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:09.181937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:09.181937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:09.181937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:09.181937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:09.181937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:09.185484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:09.189442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:09.201155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:09.201747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:09.202248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:09.209691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:09.210290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:09.210731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:09.386684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:09.399852 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34d87def-36a7-4a9f-b359-be09ddda6092 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1274 microversion: 2.1 time: 0.221238 Oct 27 09:13:09.404588 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1539/3029] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:09 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:09.414849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6fa39795-cd09-42d1-94b7-bf906afdabd4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:09.415811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6fa39795-cd09-42d1-94b7-bf906afdabd4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:09.546572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6fa39795-cd09-42d1-94b7-bf906afdabd4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:09.555538 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6fa39795-cd09-42d1-94b7-bf906afdabd4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1207 microversion: 2.1 time: 0.146602 Oct 27 09:13:09.567632 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1540/3030] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:09 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1207 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:09.567632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:09.567632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:09.574421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:09.575412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:09.576202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:09.577574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:09.578269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:09.579335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:09.626277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:13:09.635881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:09.649984 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87bc0d89-d8eb-4c05-bcd2-330cf320b2f8 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.502196 Oct 27 09:13:09.664242 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1491/3031] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:09 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:09.740314 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bb7d13d6-cf3f-4b7f-8453-beb6d5c5e030 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 204 len: 0 microversion: 2.1 time: 0.182075 Oct 27 09:13:09.742883 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1541/3032] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:09 2022] DELETE /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:09.753619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:09.754530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:09.763276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:09.764203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:09.764934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:09.765895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:09.766627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:09.767224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:09.991708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:10.002199 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4db4e67d-e8ee-406a-9239-0a572b561ee7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1646 microversion: 2.1 time: 0.253842 Oct 27 09:13:10.003391 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1492/3033] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:09 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1646 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:10.009260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:10.009983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:10.024393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:10.024908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:10.025353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:10.026070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:10.026534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:10.026963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:10.429159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:10.429977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:10.444139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:10.444874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:10.445547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:10.448958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:10.450908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:10.452303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:10.499017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:10.515768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:10.518762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:10.521995 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da008fa9-bb2b-456d-a112-f866a23e3014 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.517068 Oct 27 09:13:10.523675 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1542/3034] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:10 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:13:10.585422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:10.586297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:10.598251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:10.598876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:10.599348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:10.601510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:10.603149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:10.603621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:10.835246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:10.848267 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-13f30b29-45c3-4399-a8b6-22ff39437317 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1259 microversion: 2.1 time: 0.267703 Oct 27 09:13:10.849464 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1543/3035] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:10 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:10.854840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:10.855945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:10.866175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:10.867134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:10.868250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:10.870414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:10.871135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:10.871701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:10.872388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:10.976434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:10.989794 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91bf84c6-9ac5-4221-bf6a-2958212ea8d1 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.569998 Oct 27 09:13:10.993758 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1493/3036] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:10 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:11.028357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:11.028976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:11.037777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:11.038624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:11.039382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:11.040352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:11.041121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:11.041774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:11.285988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:11.298201 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6fbc503e-f7d7-4f27-9f9f-1283a68f427b tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.447452 Oct 27 09:13:11.298907 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1544/3037] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:10 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:11.303412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-54287366-a7b5-424d-be73-e2ef387b42a4 req-afb4b687-5745-44dd-96f1-007d2ca9291c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae674039-cf22-428c-9b75-466061b9d46b", "name": "network-vif-unplugged", "status": "completed", "tag": "576a0cdb-2cf3-4a70-b166-3c04ce0c32e6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:11.349657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-54287366-a7b5-424d-be73-e2ef387b42a4 req-afb4b687-5745-44dd-96f1-007d2ca9291c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:11.350270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-54287366-a7b5-424d-be73-e2ef387b42a4 req-afb4b687-5745-44dd-96f1-007d2ca9291c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:11.350730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-54287366-a7b5-424d-be73-e2ef387b42a4 req-afb4b687-5745-44dd-96f1-007d2ca9291c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:11.372370 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-54287366-a7b5-424d-be73-e2ef387b42a4 req-afb4b687-5745-44dd-96f1-007d2ca9291c service nova] Creating event network-vif-unplugged:576a0cdb-2cf3-4a70-b166-3c04ce0c32e6 for instance ae674039-cf22-428c-9b75-466061b9d46b on n-h2-858383-16 Oct 27 09:13:11.379599 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-54287366-a7b5-424d-be73-e2ef387b42a4 req-afb4b687-5745-44dd-96f1-007d2ca9291c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079406 Oct 27 09:13:11.386916 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1545/3038] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:11.473065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:11.484103 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35819d1c-74a5-4a95-a295-6ad86bb191ea tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1646 microversion: 2.1 time: 0.459509 Oct 27 09:13:11.495676 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1494/3039] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:11 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1646 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:11.556105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:11.557654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:11.565885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:11.571323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:11.574606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:11.579475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:11.581936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:11.584549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:11.874290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:11.874920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:11.886738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:11.887936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:11.888658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:11.889768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:11.890774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:11.891811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:12.168417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:12.179959 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-074b3a81-c9f2-47f0-8b3f-62bdf962ec5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1265 microversion: 2.1 time: 0.308849 Oct 27 09:13:12.181726 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1495/3040] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:11 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:12.187529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-11f1f5df-3edf-43ac-8c12-4cea1287675e req-bb0ab48d-3afd-44bb-b0e0-218774c22d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7a67ad-fd9f-44bc-bfab-5ed9d887667e", "tag": "a6af17f6-0e6d-4048-9ff5-e5c7319fe3b9"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:12.198016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-11f1f5df-3edf-43ac-8c12-4cea1287675e req-bb0ab48d-3afd-44bb-b0e0-218774c22d61 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:12.198494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-11f1f5df-3edf-43ac-8c12-4cea1287675e req-bb0ab48d-3afd-44bb-b0e0-218774c22d61 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:12.198975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-11f1f5df-3edf-43ac-8c12-4cea1287675e req-bb0ab48d-3afd-44bb-b0e0-218774c22d61 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:12.212738 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-11f1f5df-3edf-43ac-8c12-4cea1287675e req-bb0ab48d-3afd-44bb-b0e0-218774c22d61 service nova] Creating event network-changed:a6af17f6-0e6d-4048-9ff5-e5c7319fe3b9 for instance 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e on n-h2-858383-16 Oct 27 09:13:12.219234 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-11f1f5df-3edf-43ac-8c12-4cea1287675e req-bb0ab48d-3afd-44bb-b0e0-218774c22d61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036048 Oct 27 09:13:12.220798 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1496/3041] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:12.226995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:12.227832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:12.237391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:12.238054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:12.238571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:12.239385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:12.239941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:12.240441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:12.291133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:12.304838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:12.307085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:12.308707 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d41a45da-ecd7-4ffe-8ffc-5e1796ca5b76 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.757087 Oct 27 09:13:12.324918 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1546/3042] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:11 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:12.339745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-36fc320b-76b3-43cd-b9a5-b8e0f0ab65ac req-b385c06c-e2db-4ece-bbf9-01b086b92fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae674039-cf22-428c-9b75-466061b9d46b", "name": "network-vif-deleted", "tag": "576a0cdb-2cf3-4a70-b166-3c04ce0c32e6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:12.354459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-36fc320b-76b3-43cd-b9a5-b8e0f0ab65ac req-b385c06c-e2db-4ece-bbf9-01b086b92fd4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:12.355307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-36fc320b-76b3-43cd-b9a5-b8e0f0ab65ac req-b385c06c-e2db-4ece-bbf9-01b086b92fd4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:12.356003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-36fc320b-76b3-43cd-b9a5-b8e0f0ab65ac req-b385c06c-e2db-4ece-bbf9-01b086b92fd4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:12.372552 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-36fc320b-76b3-43cd-b9a5-b8e0f0ab65ac req-b385c06c-e2db-4ece-bbf9-01b086b92fd4 service nova] Creating event network-vif-deleted:576a0cdb-2cf3-4a70-b166-3c04ce0c32e6 for instance ae674039-cf22-428c-9b75-466061b9d46b on n-h2-858383-16 Oct 27 09:13:12.378004 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-36fc320b-76b3-43cd-b9a5-b8e0f0ab65ac req-b385c06c-e2db-4ece-bbf9-01b086b92fd4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051775 Oct 27 09:13:12.378702 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1547/3043] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:12.384566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:12.385471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:12.392903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:12.393479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:12.393995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:12.394758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:12.395437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:12.396118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:12.753737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:12.763306 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d4c56721-ee29-436a-b09a-f6c451f1ac7f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.541186 Oct 27 09:13:12.764056 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1497/3044] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:12 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:12.770350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:12.771525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:12.778792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:12.779713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:12.780412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:12.781195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:12.781723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:12.782214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:12.803848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:12.818578 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de35135b-408e-4a08-ab18-85b065a0c76c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.437712 Oct 27 09:13:12.822506 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1548/3045] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:12 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:13.190066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:13.198389 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ba30ac4f-e3b9-4b24-b191-aba16a30ebb7 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1646 microversion: 2.1 time: 0.432860 Oct 27 09:13:13.199368 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1498/3046] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:12 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1646 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:13.214072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:13.215483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:13.222816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:13.223547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:13.224413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:13.225291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:13.225917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:13.226643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:13.231489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:13.342364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:13.346717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:13.354786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:13.355534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:13.356425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:13.357305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:13.357930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:13.358550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:13.745020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:13.759643 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1f1cb3e7-09d0-4d01-90ba-f6f9ab135cdf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.551782 Oct 27 09:13:13.760769 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1549/3047] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:13 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:13.789564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:13.791227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:13.799076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:13.800134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:13.800816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:13.801982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:13.802696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:13.803501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:13.807882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:13.819887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:13.822877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:13.824370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-89f3ea29-68ee-4635-8e64-3dd8a927cad2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.487026 Oct 27 09:13:13.848262 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1499/3048] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:13 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:13.855847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:13.856816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:13.863622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:13.864628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:13.865557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:13.870146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:13.870827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:13.871728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:14.095785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:14.097076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:14.105159 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6382f49e-fb46-4c9f-8f4d-53911f586867 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.255619 Oct 27 09:13:14.105687 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eaa7e97e-a077-42e9-821b-6a879b03f071 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.321677 Oct 27 09:13:14.106001 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1500/3049] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:13 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:14.106265 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1550/3050] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:13 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:14.221934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:14.222665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:14.229123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:14.229721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:14.230162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:14.230964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:14.231465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:14.231933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:14.265655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:14.266149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:14.266576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:14.267732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lazy-loading 'fault' on Instance uuid 617af9bd-1546-41f2-ae91-daf745dc43eb {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:13:14.270739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:14.311741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:14.320730 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-586c07c7-5c2a-4f6c-92f0-b459031299ee tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 200 len: 1305 microversion: 2.1 time: 0.102599 Oct 27 09:13:14.321324 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1501/3051] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:14 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:14.423699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-441f56c7-5252-4247-be51-f961aad32c87 req-eb8abf46-6c0a-4034-90e7-52f98f3ba48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "617af9bd-1546-41f2-ae91-daf745dc43eb", "name": "network-vif-deleted", "tag": "52b516c3-0eee-40e6-8fe1-0576e63ce4da"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:14.433658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-441f56c7-5252-4247-be51-f961aad32c87 req-eb8abf46-6c0a-4034-90e7-52f98f3ba48e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:14.434128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-441f56c7-5252-4247-be51-f961aad32c87 req-eb8abf46-6c0a-4034-90e7-52f98f3ba48e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:14.434827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-441f56c7-5252-4247-be51-f961aad32c87 req-eb8abf46-6c0a-4034-90e7-52f98f3ba48e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:14.447329 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-441f56c7-5252-4247-be51-f961aad32c87 req-eb8abf46-6c0a-4034-90e7-52f98f3ba48e service nova] Creating event network-vif-deleted:52b516c3-0eee-40e6-8fe1-0576e63ce4da for instance 617af9bd-1546-41f2-ae91-daf745dc43eb on n-h1-858383-16 Oct 27 09:13:14.464581 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-441f56c7-5252-4247-be51-f961aad32c87 req-eb8abf46-6c0a-4034-90e7-52f98f3ba48e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046604 Oct 27 09:13:14.465236 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1551/3052] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:14.785064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:14.786145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:14.793626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:14.794321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:14.795046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:14.795935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:14.796815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:14.797406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:14.862592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:14.863842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:14.876930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:14.877675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:14.878397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:14.879997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:14.881919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:14.882640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:15.196492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:15.210384 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3315e023-50a2-4e0b-aae7-0ac9e9e3bdd6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.428271 Oct 27 09:13:15.224363 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1502/3053] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:14 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:15.233644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:15.234753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:15.241385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:15.242400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:15.242923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:15.243739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:15.244549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:15.245181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:15.628621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:15.646687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:15.649454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:15.652900 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91ca71a3-150c-45f3-806d-f3f00694183d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.795586 Oct 27 09:13:15.654517 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1552/3054] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:14 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:13:15.667057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:15.668272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:15.675853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:15.676345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:15.676783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:15.677495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:15.678287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:15.678743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:15.912954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:15.922285 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-192f11a8-e19c-4762-bdc8-0254822be690 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.695916 Oct 27 09:13:15.922871 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1503/3055] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:15 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:15.941357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:15.942075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:15.948075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:15.949037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:15.949037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:15.949698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:15.950156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:15.950590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:15.965863 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb HTTP/1.1 Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '617af9bd-1546-41f2-ae91-daf745dc43eb'} Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:15.967392 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9f78896-57bb-4b48-994d-113c77a28e43 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 404 len: 111 microversion: 2.1 time: 0.031710 Oct 27 09:13:15.975152 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1504/3056] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:15 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:15.980881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0ab4fd9-4847-451d-a830-a1c0344a6290 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aa787d30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:16.014765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:16.022949 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d9ce36d-6f57-4a67-b263-2acd59133c37 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.366746 Oct 27 09:13:16.023537 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1553/3057] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:15 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:16.241801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:16.242763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:16.250838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:16.252464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:16.253483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:16.254416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:16.255168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:16.255827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:16.437709 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0ab4fd9-4847-451d-a830-a1c0344a6290 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/9e139488-74ca-478f-bf18-44f233b8ac64" status: 202 len: 0 microversion: 2.1 time: 0.462826 Oct 27 09:13:16.441426 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1505/3058] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:15 2022] DELETE /compute/v2.1/os-security-groups/9e139488-74ca-478f-bf18-44f233b8ac64 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:13:16.446654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1e8a4fc2-453f-4649-a2bd-98c918e19cc4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aa25d1f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:16.506717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:16.515493 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9929f69-2493-44b0-a541-a317e3607744 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.280515 Oct 27 09:13:16.516284 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1554/3059] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:16 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:16.522206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-4046df54-15b4-4ab6-83fc-eb1ae538a6b5 req-b152c1c9-ab87-4533-83e2-7fef738a1c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119dcc89-5176-4b9f-b784-cba0bb8c1444", "tag": "41e4ebd1-dbca-4093-be4e-10f1ad3b6519"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:16.535391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4046df54-15b4-4ab6-83fc-eb1ae538a6b5 req-b152c1c9-ab87-4533-83e2-7fef738a1c6d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:16.536231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4046df54-15b4-4ab6-83fc-eb1ae538a6b5 req-b152c1c9-ab87-4533-83e2-7fef738a1c6d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:16.537095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4046df54-15b4-4ab6-83fc-eb1ae538a6b5 req-b152c1c9-ab87-4533-83e2-7fef738a1c6d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:16.550796 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-4046df54-15b4-4ab6-83fc-eb1ae538a6b5 req-b152c1c9-ab87-4533-83e2-7fef738a1c6d service nova] Creating event network-changed:41e4ebd1-dbca-4093-be4e-10f1ad3b6519 for instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 on n-h2-858383-16 Oct 27 09:13:16.556429 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-4046df54-15b4-4ab6-83fc-eb1ae538a6b5 req-b152c1c9-ab87-4533-83e2-7fef738a1c6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038600 Oct 27 09:13:16.558053 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1555/3060] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:16.683469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:16.684228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:16.686908 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1e8a4fc2-453f-4649-a2bd-98c918e19cc4 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a" status: 202 len: 0 microversion: 2.1 time: 0.244007 Oct 27 09:13:16.691209 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1506/3061] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:16 2022] DELETE /compute/v2.1/os-security-groups/b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:13:16.700555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:16.701308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:16.702014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:16.702267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf63e3a2-5bc3-4dfa-918d-19d7d585dfce tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'create', calling method: .version_select at 0x7f31aa286a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1981006506", "description": "tempest-description-1630188594"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:16.703164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:16.704126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:16.705337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:16.991336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:17.002777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:17.015292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:17.030664 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-285dcfb9-0e3d-47a7-aafe-cfd0f8382711 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.352122 Oct 27 09:13:17.035209 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf63e3a2-5bc3-4dfa-918d-19d7d585dfce tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.337274 Oct 27 09:13:17.036548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1507/3062] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:13:16 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:17.041994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:17.042615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:17.050176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.050685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.051319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.052076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.052555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.052760 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1556/3063] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:16 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:17.053076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.068548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:17.070647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:17.077336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.077725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.078235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.079166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.080460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.080902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.286364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:17.291222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:17.294639 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4bd67752-df16-47de-91d0-5af1c8751a71 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.257022 Oct 27 09:13:17.311652 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b4c51b5d-9ca2-4acf-bdd0-75e330671a8a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.246503 Oct 27 09:13:17.311652 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1557/3064] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:17 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:17.312281 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1508/3065] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:17 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:17.317223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a96bf9ce-7645-412c-897e-81a13bad2956 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Action: 'update', calling method: .version_select at 0x7f31aa020430>, body: {"security_group": {"name": "tempest-sg-hth-1422671196", "description": "tempest-description-hth-289161144"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:17.478232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a96bf9ce-7645-412c-897e-81a13bad2956 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/060d45c9-f46f-4f15-ab49-d6b7ea9f60e8" status: 200 len: 217 microversion: 2.1 time: 0.175103 Oct 27 09:13:17.479101 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1558/3066] 10.222.0.25 () {60 vars in 1290 bytes} [Thu Oct 27 09:13:17 2022] PUT /compute/v2.1/os-security-groups/060d45c9-f46f-4f15-ab49-d6b7ea9f60e8 => generated 217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:17.502937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1aeac826-b05c-4aea-b170-85323cff8a68 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aaa055e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:17.541717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:17.542592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:17.550722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.551510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.551941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.552819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.553277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.553693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.589000 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1aeac826-b05c-4aea-b170-85323cff8a68 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/060d45c9-f46f-4f15-ab49-d6b7ea9f60e8" status: 200 len: 217 microversion: 2.1 time: 0.098852 Oct 27 09:13:17.589761 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1509/3067] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:13:17 2022] GET /compute/v2.1/os-security-groups/060d45c9-f46f-4f15-ab49-d6b7ea9f60e8 => generated 217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:17.603832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3868382-3499-40e4-90f5-47477897d1dc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aa826790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:17.768134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:17.777115 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba5b5eed-1f8a-4bc6-8bdb-de7975597be8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.239680 Oct 27 09:13:17.786062 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1559/3068] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:17 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:17.833620 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:13:17.834008 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 09:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups/060d45c9-f46f-4f15-ab49-d6b7ea9f60e8 (ip 10.222.0.25) !!! Oct 27 09:13:17.874469 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3868382-3499-40e4-90f5-47477897d1dc tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/060d45c9-f46f-4f15-ab49-d6b7ea9f60e8" status: 202 len: 0 microversion: 2.1 time: 0.274822 Oct 27 09:13:17.875203 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1510/3069] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:17 2022] DELETE /compute/v2.1/os-security-groups/060d45c9-f46f-4f15-ab49-d6b7ea9f60e8 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:13:17.883472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:17.884423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:17.891934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.892568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.893190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.893901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.894356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.894885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.909758 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb HTTP/1.1 Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '617af9bd-1546-41f2-ae91-daf745dc43eb'} Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:17.911647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3fbf9e0-5cfe-43f2-8426-0a82182598e6 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 404 len: 111 microversion: 2.1 time: 0.033423 Oct 27 09:13:17.916404 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1560/3070] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:17 2022] DELETE /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:13:17.924218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:17.925764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: 617af9bd-1546-41f2-ae91-daf745dc43eb] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:17.932113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.932875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.933588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.934570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:17.935036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:17.935465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:17.950417 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb HTTP/1.1 Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '617af9bd-1546-41f2-ae91-daf745dc43eb'} Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:17.952010 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Instance 617af9bd-1546-41f2-ae91-daf745dc43eb could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-03e64ac2-188c-4e71-8653-018f2703de54 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb" status: 404 len: 111 microversion: 2.1 time: 0.034903 Oct 27 09:13:17.956998 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1511/3071] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:17 2022] GET /compute/v2.1/servers/617af9bd-1546-41f2-ae91-daf745dc43eb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:17.962812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0bb68baa-ffd3-4b22-9db8-5f7510c3a8ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aa395040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:17.987364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-0bb68baa-ffd3-4b22-9db8-5f7510c3a8ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a does not exist", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:13:17.988118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.security_group_api [None req-0bb68baa-ffd3-4b22-9db8-5f7510c3a8ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a not found {{(pid=120602) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:13:17.988670 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-0bb68baa-ffd3-4b22-9db8-5f7510c3a8ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a does not exist Oct 27 09:13:17.988670 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-bb3838e4-c990-4696-9fb1-7c0fceb54d11'] Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0bb68baa-ffd3-4b22-9db8-5f7510c3a8ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-security-groups/b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a HTTP/1.1 Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: exception: Security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a does not exist Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-bb3838e4-c990-4696-9fb1-7c0fceb54d11'] Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a'} Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:13:17.990534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a does not exist Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb3838e4-c990-4696-9fb1-7c0fceb54d11'] Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a does not exist Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb3838e4-c990-4696-9fb1-7c0fceb54d11'] Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a does not exist Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb3838e4-c990-4696-9fb1-7c0fceb54d11'] Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a does not exist Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb3838e4-c990-4696-9fb1-7c0fceb54d11'] Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0bb68baa-ffd3-4b22-9db8-5f7510c3a8ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a does not exist Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-bb3838e4-c990-4696-9fb1-7c0fceb54d11'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0bb68baa-ffd3-4b22-9db8-5f7510c3a8ba tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a" status: 404 len: 194 microversion: 2.1 time: 0.033751 Oct 27 09:13:17.994817 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1561/3072] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:17 2022] DELETE /compute/v2.1/os-security-groups/b43ac734-d6dc-43ec-b9ca-cf96db5f1a7a => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:18.002731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54712602-e28d-42a8-9e6f-2927159629e1 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aaa05160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.025719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-54712602-e28d-42a8-9e6f-2927159629e1 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9e139488-74ca-478f-bf18-44f233b8ac64 does not exist", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:13:18.026344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.security_group_api [None req-54712602-e28d-42a8-9e6f-2927159629e1 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group 9e139488-74ca-478f-bf18-44f233b8ac64 not found {{(pid=120603) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:13:18.026885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-54712602-e28d-42a8-9e6f-2927159629e1 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group 9e139488-74ca-478f-bf18-44f233b8ac64 does not exist Oct 27 09:13:18.026885 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-d35c5bca-c660-4e51-9213-38fc77c81762'] Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54712602-e28d-42a8-9e6f-2927159629e1 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-security-groups/9e139488-74ca-478f-bf18-44f233b8ac64 HTTP/1.1 Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: exception: Security group 9e139488-74ca-478f-bf18-44f233b8ac64 does not exist Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-d35c5bca-c660-4e51-9213-38fc77c81762'] Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '9e139488-74ca-478f-bf18-44f233b8ac64'} Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:13:18.028761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9e139488-74ca-478f-bf18-44f233b8ac64 does not exist Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d35c5bca-c660-4e51-9213-38fc77c81762'] Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9e139488-74ca-478f-bf18-44f233b8ac64 does not exist Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d35c5bca-c660-4e51-9213-38fc77c81762'] Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9e139488-74ca-478f-bf18-44f233b8ac64 does not exist Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d35c5bca-c660-4e51-9213-38fc77c81762'] Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9e139488-74ca-478f-bf18-44f233b8ac64 does not exist Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d35c5bca-c660-4e51-9213-38fc77c81762'] Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54712602-e28d-42a8-9e6f-2927159629e1 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group 9e139488-74ca-478f-bf18-44f233b8ac64 does not exist Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-d35c5bca-c660-4e51-9213-38fc77c81762'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54712602-e28d-42a8-9e6f-2927159629e1 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/9e139488-74ca-478f-bf18-44f233b8ac64" status: 404 len: 194 microversion: 2.1 time: 0.031338 Oct 27 09:13:18.034218 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1512/3073] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:17 2022] DELETE /compute/v2.1/os-security-groups/9e139488-74ca-478f-bf18-44f233b8ac64 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:18.040985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4eeba1ec-2250-4ad3-a6e6-ac257a813c60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aadbd040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.066831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG neutronclient.v2_0.client [None req-4eeba1ec-2250-4ad3-a6e6-ac257a813c60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist", "detail": ""}} {{(pid=120602) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:13:18.067445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.security_group_api [None req-4eeba1ec-2250-4ad3-a6e6-ac257a813c60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group def324a4-5780-4715-8a83-ec636dca8dde not found {{(pid=120602) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:13:18.068001 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4eeba1ec-2250-4ad3-a6e6-ac257a813c60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:13:18.068001 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-e630655c-5a37-4a4f-bfe0-a162d71a4349'] Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4eeba1ec-2250-4ad3-a6e6-ac257a813c60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-security-groups/def324a4-5780-4715-8a83-ec636dca8dde HTTP/1.1 Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: exception: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-e630655c-5a37-4a4f-bfe0-a162d71a4349'] Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'def324a4-5780-4715-8a83-ec636dca8dde'} Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:13:18.069827 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e630655c-5a37-4a4f-bfe0-a162d71a4349'] Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e630655c-5a37-4a4f-bfe0-a162d71a4349'] Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e630655c-5a37-4a4f-bfe0-a162d71a4349'] Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e630655c-5a37-4a4f-bfe0-a162d71a4349'] Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4eeba1ec-2250-4ad3-a6e6-ac257a813c60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group def324a4-5780-4715-8a83-ec636dca8dde does not exist Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: Neutron server returns request_ids: ['req-e630655c-5a37-4a4f-bfe0-a162d71a4349'] {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4eeba1ec-2250-4ad3-a6e6-ac257a813c60 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/def324a4-5780-4715-8a83-ec636dca8dde" status: 404 len: 194 microversion: 2.1 time: 0.034511 Oct 27 09:13:18.075027 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1562/3074] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:18 2022] DELETE /compute/v2.1/os-security-groups/def324a4-5780-4715-8a83-ec636dca8dde => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:18.079882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08a0a91e-7f67-4fdc-8135-75898d9285ab tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31ae5f78b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.083771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.084554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:18.090772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.091270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.091750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.092474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.092937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.093372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.106133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-08a0a91e-7f67-4fdc-8135-75898d9285ab tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:13:18.106746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.security_group_api [None req-08a0a91e-7f67-4fdc-8135-75898d9285ab tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a not found {{(pid=120603) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:13:18.107268 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-08a0a91e-7f67-4fdc-8135-75898d9285ab tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:13:18.107268 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-12696c41-007e-4d14-99ce-7611f7e85af8'] Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08a0a91e-7f67-4fdc-8135-75898d9285ab tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-security-groups/5919524d-f468-4abb-abd1-4dd0e7e46e6a HTTP/1.1 Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: exception: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-12696c41-007e-4d14-99ce-7611f7e85af8'] Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5919524d-f468-4abb-abd1-4dd0e7e46e6a'} Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:13:18.109132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12696c41-007e-4d14-99ce-7611f7e85af8'] Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12696c41-007e-4d14-99ce-7611f7e85af8'] Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12696c41-007e-4d14-99ce-7611f7e85af8'] Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12696c41-007e-4d14-99ce-7611f7e85af8'] Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08a0a91e-7f67-4fdc-8135-75898d9285ab tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group 5919524d-f468-4abb-abd1-4dd0e7e46e6a does not exist Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-12696c41-007e-4d14-99ce-7611f7e85af8'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:18.114648 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08a0a91e-7f67-4fdc-8135-75898d9285ab tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5919524d-f468-4abb-abd1-4dd0e7e46e6a" status: 404 len: 194 microversion: 2.1 time: 0.034623 Oct 27 09:13:18.119157 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1513/3075] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:18 2022] DELETE /compute/v2.1/os-security-groups/5919524d-f468-4abb-abd1-4dd0e7e46e6a => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:18.121111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b8cfb47-94ca-4324-bdeb-bd24c10578ac tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aa027b80>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.157771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-1b8cfb47-94ca-4324-bdeb-bd24c10578ac tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:13:18.158481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.security_group_api [None req-1b8cfb47-94ca-4324-bdeb-bd24c10578ac tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group 0b39f3e3-5f06-4948-be79-5abf998f13de not found {{(pid=120603) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:13:18.159071 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-1b8cfb47-94ca-4324-bdeb-bd24c10578ac tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:13:18.159071 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-7509e47a-2805-46f5-b17a-24e5e26b9a7b'] Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b8cfb47-94ca-4324-bdeb-bd24c10578ac tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-security-groups/0b39f3e3-5f06-4948-be79-5abf998f13de HTTP/1.1 Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: exception: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-7509e47a-2805-46f5-b17a-24e5e26b9a7b'] Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '0b39f3e3-5f06-4948-be79-5abf998f13de'} Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:13:18.161465 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7509e47a-2805-46f5-b17a-24e5e26b9a7b'] Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7509e47a-2805-46f5-b17a-24e5e26b9a7b'] Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7509e47a-2805-46f5-b17a-24e5e26b9a7b'] Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7509e47a-2805-46f5-b17a-24e5e26b9a7b'] Oct 27 09:13:18.165860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.169610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b8cfb47-94ca-4324-bdeb-bd24c10578ac tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group 0b39f3e3-5f06-4948-be79-5abf998f13de does not exist Oct 27 09:13:18.169610 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-7509e47a-2805-46f5-b17a-24e5e26b9a7b'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:18.169610 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b8cfb47-94ca-4324-bdeb-bd24c10578ac tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/0b39f3e3-5f06-4948-be79-5abf998f13de" status: 404 len: 194 microversion: 2.1 time: 0.052025 Oct 27 09:13:18.173720 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1514/3076] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:18 2022] DELETE /compute/v2.1/os-security-groups/0b39f3e3-5f06-4948-be79-5abf998f13de => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:18.179423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b20a0f0-3e79-48f3-926d-a8c402996bad tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31ae5f7e50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.215140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-2b20a0f0-3e79-48f3-926d-a8c402996bad tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:13:18.215784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.security_group_api [None req-2b20a0f0-3e79-48f3-926d-a8c402996bad tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Neutron security group b1979e9d-8156-4222-a330-2f920f76d4df not found {{(pid=120603) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 27 09:13:18.216300 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-2b20a0f0-3e79-48f3-926d-a8c402996bad tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:13:18.216300 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-bf71d42c-4b70-4e57-aeba-38acc0d142bf'] Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b20a0f0-3e79-48f3-926d-a8c402996bad tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df HTTP/1.1 Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: exception: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-bf71d42c-4b70-4e57-aeba-38acc0d142bf'] Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'b1979e9d-8156-4222-a330-2f920f76d4df'} Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:13:18.218293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf71d42c-4b70-4e57-aeba-38acc0d142bf'] Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf71d42c-4b70-4e57-aeba-38acc0d142bf'] Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf71d42c-4b70-4e57-aeba-38acc0d142bf'] Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf71d42c-4b70-4e57-aeba-38acc0d142bf'] Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b20a0f0-3e79-48f3-926d-a8c402996bad tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Security group b1979e9d-8156-4222-a330-2f920f76d4df does not exist Oct 27 09:13:18.223091 n-d-858383-16 devstack@n-api.service[120603]: Neutron server returns request_ids: ['req-bf71d42c-4b70-4e57-aeba-38acc0d142bf'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:18.227615 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b20a0f0-3e79-48f3-926d-a8c402996bad tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df" status: 404 len: 194 microversion: 2.1 time: 0.046522 Oct 27 09:13:18.232657 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1515/3077] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:18 2022] DELETE /compute/v2.1/os-security-groups/b1979e9d-8156-4222-a330-2f920f76d4df => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:18.237580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.240307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:18.247315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.248405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.248943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.249554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.250006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.250427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.303209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:13:18.425941 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45f66156-71f8-4807-b388-41f373bd615b tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 204 len: 0 microversion: 2.1 time: 0.191938 Oct 27 09:13:18.427400 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1516/3078] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:18 2022] DELETE /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:18.431226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:18.433397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.437053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:18.443728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.444320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.444859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.445658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.445923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:18.446118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.446544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.448174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:18.449671 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-836edec4-8552-4f69-9384-9189c666b2a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.369679 Oct 27 09:13:18.464750 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1563/3079] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:18 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:18.476883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.477766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:18.484421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.485105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.485886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.486767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.487598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.488187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.762647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:18.771308 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2cabe883-26f5-4158-a82a-625308dae9f2 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.342425 Oct 27 09:13:18.787881 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1517/3080] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:18 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:18.792905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.793771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:18.803091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.803822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.804436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.805336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.805794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.806379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.828418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:18.869762 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-65983f41-3ade-433b-9e53-150a6e93f3cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.403471 Oct 27 09:13:18.871630 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1564/3081] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:18 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:18.880572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:18.881600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:18.890275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.890999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.892842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.894887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:18.896547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:18.897199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:18.959124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:19.012170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=14 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:19.204804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:19.213498 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18a80d69-c4c2-4e49-b206-b949a54b3f10 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.339506 Oct 27 09:13:19.214374 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1565/3082] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:18 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:19.218631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:19.219294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ea68a770-2f2e-48a2-8247-bdaba3b64871 req-514b3796-3e3d-44be-b8df-c96d6d9add6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68363e6-08e4-49a8-b10f-7b954e13edb6", "name": "network-vif-plugged", "status": "completed", "tag": "842bfa9f-5d7b-4938-8428-64e04fd2e183"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:19.227205 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b3b01516-ca8a-4db1-a944-479d907f8d94 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1646 microversion: 2.1 time: 0.438132 Oct 27 09:13:19.227944 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1518/3083] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:18 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1646 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:19.228956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ea68a770-2f2e-48a2-8247-bdaba3b64871 req-514b3796-3e3d-44be-b8df-c96d6d9add6d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.229625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ea68a770-2f2e-48a2-8247-bdaba3b64871 req-514b3796-3e3d-44be-b8df-c96d6d9add6d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.230243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ea68a770-2f2e-48a2-8247-bdaba3b64871 req-514b3796-3e3d-44be-b8df-c96d6d9add6d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.246651 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ea68a770-2f2e-48a2-8247-bdaba3b64871 req-514b3796-3e3d-44be-b8df-c96d6d9add6d service nova] Creating event network-vif-plugged:842bfa9f-5d7b-4938-8428-64e04fd2e183 for instance a68363e6-08e4-49a8-b10f-7b954e13edb6 on n-h2-858383-16 Oct 27 09:13:19.254463 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ea68a770-2f2e-48a2-8247-bdaba3b64871 req-514b3796-3e3d-44be-b8df-c96d6d9add6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038290 Oct 27 09:13:19.255179 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1566/3084] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:19.370421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Calling method '.version_select at 0x7f31ae608430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:19.372236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.372733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.373174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.388114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.388560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.389005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.400778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.401693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.402299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.409746 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13581670-f291-4659-9611-659773970a9f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2043968703-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.180533 Oct 27 09:13:19.410340 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1519/3085] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:13:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:19.482025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:19.482893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:19.490587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.491136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.491708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.492474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.492935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.493364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.554983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=10 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:19.683688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:19.693774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:19.695233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:19.696446 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cc19f2b0-dfb5-4c2b-8e7f-0ea23efd4d60 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.218913 Oct 27 09:13:19.697016 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1567/3086] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:19 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:19.794563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:19.795194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:19.801222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.801712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.802148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.802856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.803310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.803765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.899100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:19.899855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:19.907334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.908395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.909126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.909914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:19.910535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:19.910968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:19.953012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:19.961675 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37a9edc1-d26d-48ba-bbe8-36c69c3d2e55 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.171038 Oct 27 09:13:19.979704 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1520/3087] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:19 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:20.087301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:20.095283 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94193235-5336-46da-8ec6-16f9be6d98ca tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.200551 Oct 27 09:13:20.096010 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1568/3088] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:19 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:20.237287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:20.238473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:20.245096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:20.245693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:20.249721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:20.250612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:20.251870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:20.253904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:20.256268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:20.259682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:20.273605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:20.274437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:20.274874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:20.275593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:20.276202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:20.276787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:20.573981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:20.581976 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d122710a-3d00-49b6-a06e-b677e4768055 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.348603 Oct 27 09:13:20.582781 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1521/3089] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:20 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:20.677602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:20.686358 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-905dcd90-7089-4371-9b17-94da3c9d35bb tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1646 microversion: 2.1 time: 0.439787 Oct 27 09:13:20.686944 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1569/3090] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:20 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1646 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:20.725286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:20.726113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:20.732666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:20.733468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:20.734085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:20.734775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:20.735912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:20.736515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:20.984908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:20.986247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:20.993303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:20.993921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:20.994599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:20.995401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:20.995981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:20.996497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:21.160234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:21.171508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:21.174731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:21.176196 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5dec76cf-d49c-4ba3-b2c6-46f6fc06f6a6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.457814 Oct 27 09:13:21.176761 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1522/3091] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:20 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:21.181618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:21.182222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:21.203145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:21.203962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:21.205128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:21.205915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:21.206405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:21.207042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:21.257392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:21.279825 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4256dbd7-72ef-4062-8db1-92270a417262 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.298069 Oct 27 09:13:21.281990 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1570/3092] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:20 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:21.415364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:21.426528 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40092fc7-bb9f-4a21-84a2-39aa41d200a2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.248359 Oct 27 09:13:21.439728 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1523/3093] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:21 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:21.555049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a485a231-7e98-47a8-945b-4db9ee6e6805 req-f4e51cfe-e034-469d-921c-500a44a13476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce459b57-8b9a-4330-a120-05d42e42f1a2", "name": "network-vif-deleted", "tag": "88847dbe-75b3-4862-8555-18e520709e8e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:21.571973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a485a231-7e98-47a8-945b-4db9ee6e6805 req-f4e51cfe-e034-469d-921c-500a44a13476 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:21.572764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a485a231-7e98-47a8-945b-4db9ee6e6805 req-f4e51cfe-e034-469d-921c-500a44a13476 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:21.573207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a485a231-7e98-47a8-945b-4db9ee6e6805 req-f4e51cfe-e034-469d-921c-500a44a13476 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:21.585894 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a485a231-7e98-47a8-945b-4db9ee6e6805 req-f4e51cfe-e034-469d-921c-500a44a13476 service nova] Creating event network-vif-deleted:88847dbe-75b3-4862-8555-18e520709e8e for instance ce459b57-8b9a-4330-a120-05d42e42f1a2 on n-h1-858383-16 Oct 27 09:13:21.591023 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a485a231-7e98-47a8-945b-4db9ee6e6805 req-f4e51cfe-e034-469d-921c-500a44a13476 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039747 Oct 27 09:13:21.592031 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1571/3094] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:21.605386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:21.606237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:21.612456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:21.613175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:21.613608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:21.614531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:21.615138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:21.615798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:21.711343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:21.712250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:21.719116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:21.719982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:21.720435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:21.721157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:21.721614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:21.730932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:21.739215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:21.779127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:21.779471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:21.780100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:21.780749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lazy-loading 'fault' on Instance uuid ce459b57-8b9a-4330-a120-05d42e42f1a2 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:13:21.784046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:21.792705 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca41ab97-921e-47f5-9ff6-a0d8b9015659 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.191121 Oct 27 09:13:21.793516 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1524/3095] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:21 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:21.838681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8141cfe0a1b448ba9812a8ebe6e3d714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058070ef4084432b9a1dc94df7f7b17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:21.847430 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b1c36997-4930-4a40-8831-37e02c8ecef3 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 200 len: 1306 microversion: 2.1 time: 0.140396 Oct 27 09:13:21.848133 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1572/3096] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:21 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 1306 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:22.202417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:22.203161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:22.210146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.210636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.211078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.211811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.212269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.212698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.312137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:22.312785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:22.320041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.320537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.320979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.321685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.322152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.322586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.590470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:22.600580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:22.602119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:22.603277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ce7752f-6a3d-42b0-ab9a-64e55309e06e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.404869 Oct 27 09:13:22.603878 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1525/3097] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:22 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:22.608480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:22.609093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:22.611505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:22.617604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.618331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.618884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.619616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.620077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.620504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.628728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:22.637513 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-36551249-7867-400b-b369-8e54e942b773 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1324 microversion: 2.1 time: 0.329611 Oct 27 09:13:22.648020 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1573/3098] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:22 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:22.815638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:22.816720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:22.823263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.824076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.824408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.825365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.825824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.826493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.881680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:22.885308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:22.892265 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-323e2242-5785-4e38-82fd-b50c4ef2cbb8 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.286730 Oct 27 09:13:22.892862 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1526/3099] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:22 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:22.898468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:22.899300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] [instance: ce459b57-8b9a-4330-a120-05d42e42f1a2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:22.906226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.906943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.907978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.908874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:22.909341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:22.909776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:22.925825 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] HTTP exception thrown: Instance ce459b57-8b9a-4330-a120-05d42e42f1a2 could not be found. Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Request method failure captured: Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 HTTP/1.1 Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkslp2IaYmBKex3CRvO-W_yjT7SrVJC2aIWMJHS3Hc_RVmAfi6oZSnCSBLkwCJ9x1bDyCJXrYJdtZ0v7caj5exEEjw_xGXl0qqZPhcqMuO0uqAdkC7SljZnCdtuMoOQGMpJv0HrIHwKKmU-laHuWqJfQlqZySD8BZvzn5Jv9ZLPerXQ Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/058070ef4084432b9a1dc94df7f7b17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/058070ef4084432b9a1dc94df7f7b17c"}]}] Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 058070ef4084432b9a1dc94df7f7b17c Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-970419367 Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8141cfe0a1b448ba9812a8ebe6e3d714 Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-SecurityGroupsTestJSON-970419367-project Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance ce459b57-8b9a-4330-a120-05d42e42f1a2 could not be found. Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'ce459b57-8b9a-4330-a120-05d42e42f1a2'} Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce459b57-8b9a-4330-a120-05d42e42f1a2 could not be found. Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce459b57-8b9a-4330-a120-05d42e42f1a2 could not be found. Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:22.927817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce459b57-8b9a-4330-a120-05d42e42f1a2 could not be found. Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Returning 404 to user: Instance ce459b57-8b9a-4330-a120-05d42e42f1a2 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5f80917-51ec-4ddd-9c01-b1c29b81756e tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2" status: 404 len: 111 microversion: 2.1 time: 0.035259 Oct 27 09:13:22.931766 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1527/3100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:22 2022] GET /compute/v2.1/servers/ce459b57-8b9a-4330-a120-05d42e42f1a2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:22.938038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2da872f9-30b1-46b2-bcce-6c127751c897 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31ae5a15e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:23.148842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:23.160642 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae12f38a-909c-46ea-8c76-9a06e43a8b99 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.348989 Oct 27 09:13:23.161229 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1574/3101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:22 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:23.189440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6929f8da-bb48-4ddd-9825-b60a627e11d3 req-069ffd28-873d-442a-8504-d9093d10afa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7a67ad-fd9f-44bc-bfab-5ed9d887667e", "name": "network-vif-plugged", "status": "completed", "tag": "a6af17f6-0e6d-4048-9ff5-e5c7319fe3b9"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:23.202028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6929f8da-bb48-4ddd-9825-b60a627e11d3 req-069ffd28-873d-442a-8504-d9093d10afa2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:23.202606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6929f8da-bb48-4ddd-9825-b60a627e11d3 req-069ffd28-873d-442a-8504-d9093d10afa2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:23.203053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6929f8da-bb48-4ddd-9825-b60a627e11d3 req-069ffd28-873d-442a-8504-d9093d10afa2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:23.220392 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6929f8da-bb48-4ddd-9825-b60a627e11d3 req-069ffd28-873d-442a-8504-d9093d10afa2 service nova] Creating event network-vif-plugged:a6af17f6-0e6d-4048-9ff5-e5c7319fe3b9 for instance 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e on n-h2-858383-16 Oct 27 09:13:23.227399 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6929f8da-bb48-4ddd-9825-b60a627e11d3 req-069ffd28-873d-442a-8504-d9093d10afa2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052454 Oct 27 09:13:23.228194 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1575/3102] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:23.357376 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2da872f9-30b1-46b2-bcce-6c127751c897 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/259abcc5-64b8-4539-a297-bd5b458c1e7f" status: 202 len: 0 microversion: 2.1 time: 0.423275 Oct 27 09:13:23.358715 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1528/3103] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:22 2022] DELETE /compute/v2.1/os-security-groups/259abcc5-64b8-4539-a297-bd5b458c1e7f => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:13:23.366995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a4428f1a-8672-4a71-9a55-477d3d22d261 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] Calling method '.version_select at 0x7f31aa020700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:23.632681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:23.633365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:23.645501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:23.646017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:23.646503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:23.647295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:23.647844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:23.648275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:23.828366 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a4428f1a-8672-4a71-9a55-477d3d22d261 tempest-SecurityGroupsTestJSON-970419367 tempest-SecurityGroupsTestJSON-970419367-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f2a6e56a-74f2-4288-8e7c-f546f1786c28" status: 202 len: 0 microversion: 2.1 time: 0.465451 Oct 27 09:13:23.829040 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1576/3104] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:13:23 2022] DELETE /compute/v2.1/os-security-groups/f2a6e56a-74f2-4288-8e7c-f546f1786c28 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:13:23.835915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:23.837012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:23.850107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:23.856081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:23.856981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:23.857982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:23.858687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:23.859359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:24.350678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:24.362154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:24.364782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:24.365986 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7536ab95-6f23-41b7-949c-6e7861134413 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.738097 Oct 27 09:13:24.366548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1529/3105] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:23 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:13:24.371441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:24.372426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:24.388165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:24.388784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:24.389285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:24.390419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:24.391035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:24.392089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:24.439165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:24.448228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ab79c89-aca7-40a9-afe7-8cb74df5d028 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1521 microversion: 2.1 time: 0.617574 Oct 27 09:13:24.448933 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1577/3106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:23 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1521 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:24.492660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:24.493447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:24.503179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:24.503920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:24.504485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:24.505464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:24.506311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:24.506955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:24.656307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:24.665836 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c0764e4-305c-4429-9489-a3dff7055621 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.297947 Oct 27 09:13:24.666421 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1530/3107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:24 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:24.677650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18dc5e5a-b63b-4a8a-b74e-7bbcbfd4a309 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1083327246", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18dc5e5a-b63b-4a8a-b74e-7bbcbfd4a309 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Request method failure captured: Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 243 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkuYh1hu_FLIGf8bVKaVaM93mt8-_36gffRb2AOFFIbhtFzV4ZzWSgrHJsPfcj3E7mPdBo-5wlDu1c9EZKBIkniIex2jUp2gSD0CD0k388YckJ1ftr1seCjl2ecddmgE5cHti0g3gb4GrJtXvf8rBv0LjuqIaQoiQvwQsMPVIeq1l88 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bfa9429f0fc463bafee4c25b310a008"}]}] Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b301dc23d4934d62a4be5b5fbdb4888b Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1083327246", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1083327246', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8645ef92-89af-4ed2-b137-b0ee289bccd9'}]}}} Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:24.683027 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.687199 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.689999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18dc5e5a-b63b-4a8a-b74e-7bbcbfd4a309 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:24.691014 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18dc5e5a-b63b-4a8a-b74e-7bbcbfd4a309 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.023353 Oct 27 09:13:24.691900 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1531/3108] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:13:24 2022] POST /compute/v2.1/servers => generated 175 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:13:24.702265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2099fd13-3adb-4d37-aa24-c478e58fc870 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:24.702761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2099fd13-3adb-4d37-aa24-c478e58fc870 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: 575fbd16-2836-43e4-bab8-6fb7bb090eb9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:24.709828 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-2099fd13-3adb-4d37-aa24-c478e58fc870 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] HTTP exception thrown: Instance 575fbd16-2836-43e4-bab8-6fb7bb090eb9 could not be found. Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2099fd13-3adb-4d37-aa24-c478e58fc870 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Request method failure captured: Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/575fbd16-2836-43e4-bab8-6fb7bb090eb9/metadata HTTP/1.1 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkuYh1hu_FLIGf8bVKaVaM93mt8-_36gffRb2AOFFIbhtFzV4ZzWSgrHJsPfcj3E7mPdBo-5wlDu1c9EZKBIkniIex2jUp2gSD0CD0k388YckJ1ftr1seCjl2ecddmgE5cHti0g3gb4GrJtXvf8rBv0LjuqIaQoiQvwQsMPVIeq1l88 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bfa9429f0fc463bafee4c25b310a008"}]}] Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b301dc23d4934d62a4be5b5fbdb4888b Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 575fbd16-2836-43e4-bab8-6fb7bb090eb9 could not be found. Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': '575fbd16-2836-43e4-bab8-6fb7bb090eb9'} Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575fbd16-2836-43e4-bab8-6fb7bb090eb9 could not be found. Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575fbd16-2836-43e4-bab8-6fb7bb090eb9 could not be found. Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.720948 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.725427 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:24.725427 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:24.725427 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575fbd16-2836-43e4-bab8-6fb7bb090eb9 could not be found. Oct 27 09:13:24.725427 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.725427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2099fd13-3adb-4d37-aa24-c478e58fc870 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Returning 404 to user: Instance 575fbd16-2836-43e4-bab8-6fb7bb090eb9 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:24.725427 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2099fd13-3adb-4d37-aa24-c478e58fc870 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/575fbd16-2836-43e4-bab8-6fb7bb090eb9/metadata" status: 404 len: 111 microversion: 2.1 time: 0.024568 Oct 27 09:13:24.734025 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1532/3109] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:13:24 2022] GET /compute/v2.1/servers/575fbd16-2836-43e4-bab8-6fb7bb090eb9/metadata => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:13:24.777511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfa3e9be-6a0c-4b57-bbb0-6f1727882091 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1798029836", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfa3e9be-6a0c-4b57-bbb0-6f1727882091 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Request method failure captured: Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 499 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkuYh1hu_FLIGf8bVKaVaM93mt8-_36gffRb2AOFFIbhtFzV4ZzWSgrHJsPfcj3E7mPdBo-5wlDu1c9EZKBIkniIex2jUp2gSD0CD0k388YckJ1ftr1seCjl2ecddmgE5cHti0g3gb4GrJtXvf8rBv0LjuqIaQoiQvwQsMPVIeq1l88 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bfa9429f0fc463bafee4c25b310a008"}]}] Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b301dc23d4934d62a4be5b5fbdb4888b Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1798029836", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1798029836', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8645ef92-89af-4ed2-b137-b0ee289bccd9'}]}}} Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 09:13:24.783786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfa3e9be-6a0c-4b57-bbb0-6f1727882091 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:24.786790 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dfa3e9be-6a0c-4b57-bbb0-6f1727882091 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.012289 Oct 27 09:13:24.790887 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1533/3110] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:13:24 2022] POST /compute/v2.1/servers => generated 687 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:13:24.821940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:24.832512 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f8569e31-4c70-4521-99a7-fe314599a243 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.349416 Oct 27 09:13:24.833393 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1578/3111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:24 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:24.842845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad873c1c-7cd5-44e9-8064-ef94ffd6f47c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-782630209", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad873c1c-7cd5-44e9-8064-ef94ffd6f47c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Request method failure captured: Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 499 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkuYh1hu_FLIGf8bVKaVaM93mt8-_36gffRb2AOFFIbhtFzV4ZzWSgrHJsPfcj3E7mPdBo-5wlDu1c9EZKBIkniIex2jUp2gSD0CD0k388YckJ1ftr1seCjl2ecddmgE5cHti0g3gb4GrJtXvf8rBv0LjuqIaQoiQvwQsMPVIeq1l88 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bfa9429f0fc463bafee4c25b310a008"}]}] Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b301dc23d4934d62a4be5b5fbdb4888b Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-782630209", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-782630209', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8645ef92-89af-4ed2-b137-b0ee289bccd9'}]}}} Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 09:13:24.851811 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad873c1c-7cd5-44e9-8064-ef94ffd6f47c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad873c1c-7cd5-44e9-8064-ef94ffd6f47c tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.014996 Oct 27 09:13:24.855515 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1534/3112] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:13:24 2022] POST /compute/v2.1/servers => generated 689 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:13:24.906640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb788d2a-5d5b-48c2-98c4-8af1aff10f2e tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-6765736", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb788d2a-5d5b-48c2-98c4-8af1aff10f2e tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Request method failure captured: Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 751 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkuYh1hu_FLIGf8bVKaVaM93mt8-_36gffRb2AOFFIbhtFzV4ZzWSgrHJsPfcj3E7mPdBo-5wlDu1c9EZKBIkniIex2jUp2gSD0CD0k388YckJ1ftr1seCjl2ecddmgE5cHti0g3gb4GrJtXvf8rBv0LjuqIaQoiQvwQsMPVIeq1l88 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bfa9429f0fc463bafee4c25b310a008"}]}] Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: b301dc23d4934d62a4be5b5fbdb4888b Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-6765736", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-6765736', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8645ef92-89af-4ed2-b137-b0ee289bccd9'}]}}} Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:13:24.912178 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:13:24.914677 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:13:24.916957 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.916957 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.916957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb788d2a-5d5b-48c2-98c4-8af1aff10f2e tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:24.916957 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb788d2a-5d5b-48c2-98c4-8af1aff10f2e tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.011152 Oct 27 09:13:24.916957 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1579/3113] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:13:24 2022] POST /compute/v2.1/servers => generated 1197 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 27 09:13:24.977668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f874068f-bbdd-4049-96c0-9802d6f077bc tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-166685068", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f874068f-bbdd-4049-96c0-9802d6f077bc tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Request method failure captured: Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 1265 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkuYh1hu_FLIGf8bVKaVaM93mt8-_36gffRb2AOFFIbhtFzV4ZzWSgrHJsPfcj3E7mPdBo-5wlDu1c9EZKBIkniIex2jUp2gSD0CD0k388YckJ1ftr1seCjl2ecddmgE5cHti0g3gb4GrJtXvf8rBv0LjuqIaQoiQvwQsMPVIeq1l88 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bfa9429f0fc463bafee4c25b310a008"}]}] Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b301dc23d4934d62a4be5b5fbdb4888b Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-166685068", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8645ef92-89af-4ed2-b137-b0ee289bccd9"}]}} Oct 27 09:13:24.985230 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-166685068', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8645ef92-89af-4ed2-b137-b0ee289bccd9'}]}}} Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.987840 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:13:24.988889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:13:24.990563 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:13:24.990563 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:24.992537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f874068f-bbdd-4049-96c0-9802d6f077bc tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:24.993663 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f874068f-bbdd-4049-96c0-9802d6f077bc tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.020415 Oct 27 09:13:24.994569 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1535/3114] 10.222.0.25 () {60 vars in 1148 bytes} [Thu Oct 27 09:13:24 2022] POST /compute/v2.1/servers => generated 2221 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 27 09:13:25.006472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a07f1bd0-c729-4092-9949-0cedf84b973d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:25.006971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a07f1bd0-c729-4092-9949-0cedf84b973d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: 4525b501-dc39-4412-9184-1cd9f3c8e642] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:25.013861 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a07f1bd0-c729-4092-9949-0cedf84b973d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] HTTP exception thrown: Instance 4525b501-dc39-4412-9184-1cd9f3c8e642 could not be found. Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a07f1bd0-c729-4092-9949-0cedf84b973d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Request method failure captured: Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4525b501-dc39-4412-9184-1cd9f3c8e642/metadata/test2 HTTP/1.1 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkuYh1hu_FLIGf8bVKaVaM93mt8-_36gffRb2AOFFIbhtFzV4ZzWSgrHJsPfcj3E7mPdBo-5wlDu1c9EZKBIkniIex2jUp2gSD0CD0k388YckJ1ftr1seCjl2ecddmgE5cHti0g3gb4GrJtXvf8rBv0LjuqIaQoiQvwQsMPVIeq1l88 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bfa9429f0fc463bafee4c25b310a008"}]}] Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: b301dc23d4934d62a4be5b5fbdb4888b Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4525b501-dc39-4412-9184-1cd9f3c8e642 could not be found. Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'server_id': '4525b501-dc39-4412-9184-1cd9f3c8e642', 'id': 'test2'} Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4525b501-dc39-4412-9184-1cd9f3c8e642 could not be found. Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4525b501-dc39-4412-9184-1cd9f3c8e642 could not be found. Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:25.015967 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:25.020963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:25.020963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:25.020963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4525b501-dc39-4412-9184-1cd9f3c8e642 could not be found. Oct 27 09:13:25.020963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:25.020963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a07f1bd0-c729-4092-9949-0cedf84b973d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Returning 404 to user: Instance 4525b501-dc39-4412-9184-1cd9f3c8e642 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:25.020963 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a07f1bd0-c729-4092-9949-0cedf84b973d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/4525b501-dc39-4412-9184-1cd9f3c8e642/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014930 Oct 27 09:13:25.020963 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1580/3115] 10.222.0.25 () {58 vars in 1281 bytes} [Thu Oct 27 09:13:24 2022] GET /compute/v2.1/servers/4525b501-dc39-4412-9184-1cd9f3c8e642/metadata/test2 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:25.033054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:25.033867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:25.045041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.045543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.045988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.046769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.047157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.047603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.076674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:13:25.166384 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5f4cac29-5c1c-48d2-9d44-1405ef08903d tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 204 len: 0 microversion: 2.1 time: 0.136895 Oct 27 09:13:25.170204 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1536/3116] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:25 2022] DELETE /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:25.180065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:25.182422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:25.196141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.196935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.197834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.198972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.199664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.200490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.393787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:25.394607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:25.408353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.408857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.409299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.410023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.415213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.416062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.480009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:25.493394 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-592b5434-ac06-4700-a45a-a0e31baf08b3 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1527 microversion: 2.1 time: 0.321715 Oct 27 09:13:25.493996 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1581/3117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:25 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1527 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:25.689273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:25.690089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:25.697195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.697859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.698594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.699539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.700184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.700777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.721791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:25.734075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:25.740865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:25.744240 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fa8ac4d-0bfe-41cb-92a4-d2ca7e489a44 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.354831 Oct 27 09:13:25.747095 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1537/3118] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:25 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:25.770096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-56f86e87-86a5-436f-b0fd-872dd8b60ccd req-3347a098-5aef-452d-8950-0db69d19ae45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119dcc89-5176-4b9f-b784-cba0bb8c1444", "name": "network-vif-plugged", "status": "completed", "tag": "41e4ebd1-dbca-4093-be4e-10f1ad3b6519"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:25.781258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56f86e87-86a5-436f-b0fd-872dd8b60ccd req-3347a098-5aef-452d-8950-0db69d19ae45 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.781793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56f86e87-86a5-436f-b0fd-872dd8b60ccd req-3347a098-5aef-452d-8950-0db69d19ae45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.783351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56f86e87-86a5-436f-b0fd-872dd8b60ccd req-3347a098-5aef-452d-8950-0db69d19ae45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.801579 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-56f86e87-86a5-436f-b0fd-872dd8b60ccd req-3347a098-5aef-452d-8950-0db69d19ae45 service nova] Creating event network-vif-plugged:41e4ebd1-dbca-4093-be4e-10f1ad3b6519 for instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 on n-h2-858383-16 Oct 27 09:13:25.809723 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-56f86e87-86a5-436f-b0fd-872dd8b60ccd req-3347a098-5aef-452d-8950-0db69d19ae45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044397 Oct 27 09:13:25.811823 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1538/3119] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:25.863144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:25.864291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:25.874058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.875407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.876550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:25.877562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:25.881573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:25.884131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:26.046512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:26.056094 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c5f057a-0671-4b5b-9020-66cd79a5c38f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.370609 Oct 27 09:13:26.056695 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1582/3120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:25 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:26.146430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:26.159293 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37639aa7-852e-4e8d-b977-8eee0e56cfda tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.305719 Oct 27 09:13:26.160397 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1539/3121] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:25 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:26.517218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:26.517843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:26.525279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:26.526029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:26.531753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:26.533073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:26.533728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:26.534382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:26.784673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:26.787097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:26.795639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:26.796152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:26.796869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:26.797623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:26.798921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:26.799542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:26.907607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:26.917301 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2335fc1c-a95d-4bef-9287-dbf246e85480 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1527 microversion: 2.1 time: 0.404316 Oct 27 09:13:26.931593 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1583/3122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:26 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1527 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:27.081062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:27.082050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:27.103307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:27.103948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:27.104473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:27.105295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:27.105928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:27.106514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:27.190167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:27.210587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:27.212080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:27.213269 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0cca680-a222-443a-8485-a459e1d5c3da tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.439291 Oct 27 09:13:27.213833 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1540/3123] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:26 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:13:27.230838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:27.231734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:27.239135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:27.240119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:27.240767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:27.241695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:27.242229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:27.242753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:27.551116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:27.568536 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3d5ec0b-4d2f-4739-9292-28c954ab98c3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.491805 Oct 27 09:13:27.573474 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1584/3124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:27 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:27.703651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:27.720585 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a26ddd2f-a3fb-4f7c-86ca-254b1afb4664 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.504909 Oct 27 09:13:27.733587 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1541/3125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:27 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:27.942540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:27.943462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:27.953231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:27.954680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:27.955517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:27.956409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:27.957154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:27.958099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:28.222094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:28.240461 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94422486-7437-4aa5-afc6-9e2c565eb1df tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1527 microversion: 2.1 time: 0.301656 Oct 27 09:13:28.244458 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1585/3126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:27 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:28.245304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:28.246793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:28.259917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:28.260529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:28.261188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:28.262143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:28.262657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:28.263155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:28.556626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:28.570255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:28.574404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:28.574607 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e932ef00-ef98-4948-b9f2-9983444c7da5 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.333854 Oct 27 09:13:28.575959 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1542/3127] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:28 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:13:28.601687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:28.602324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:28.605994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:28.612340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:28.612860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:28.613244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:28.613957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:28.614416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:28.614918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:28.758689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:28.759526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:28.768310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:28.771029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:28.772515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:28.775463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:28.776090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:28.779980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:28.780322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:28.790234 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-832a4ad7-e970-426a-ae4b-861cb9c71fbe tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1316 microversion: 2.1 time: 0.197033 Oct 27 09:13:28.796121 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1586/3128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:28 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:28.963777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:28.973586 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2753cff9-f6db-4ec6-a46e-fbbdd0b4810d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1307 microversion: 2.1 time: 0.219941 Oct 27 09:13:28.975530 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1543/3129] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:28 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:29.267529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:29.268192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:29.277382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:29.278175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:29.278314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:29.279015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:29.279470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:29.279930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:29.608517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:29.609741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:29.620583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:29.621317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:29.622457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:29.624944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:29.625614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:29.627329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:29.631862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:29.639551 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d87a5301-0635-4278-8158-c4d64ade94fd tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1527 microversion: 2.1 time: 0.377167 Oct 27 09:13:29.640157 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1587/3130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:29 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1527 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:29.840610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c8a62f5-0574-4166-9bc7-75775b28c737 tempest-AZV2TestJSON-1526148254 tempest-AZV2TestJSON-1526148254-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:29.842355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8a62f5-0574-4166-9bc7-75775b28c737 tempest-AZV2TestJSON-1526148254 tempest-AZV2TestJSON-1526148254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:29.842849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8a62f5-0574-4166-9bc7-75775b28c737 tempest-AZV2TestJSON-1526148254 tempest-AZV2TestJSON-1526148254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:29.843284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8a62f5-0574-4166-9bc7-75775b28c737 tempest-AZV2TestJSON-1526148254 tempest-AZV2TestJSON-1526148254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:29.844230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8a62f5-0574-4166-9bc7-75775b28c737 tempest-AZV2TestJSON-1526148254 tempest-AZV2TestJSON-1526148254-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:29.847280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8a62f5-0574-4166-9bc7-75775b28c737 tempest-AZV2TestJSON-1526148254 tempest-AZV2TestJSON-1526148254-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:29.847773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c8a62f5-0574-4166-9bc7-75775b28c737 tempest-AZV2TestJSON-1526148254 tempest-AZV2TestJSON-1526148254-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:29.906479 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c8a62f5-0574-4166-9bc7-75775b28c737 tempest-AZV2TestJSON-1526148254 tempest-AZV2TestJSON-1526148254-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.214855 Oct 27 09:13:29.908165 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1588/3131] 10.222.0.25 () {58 vars in 1164 bytes} [Thu Oct 27 09:13:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:13:29.913315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:29.914336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:29.923799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:29.924637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:29.925273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:29.926174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:29.926824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:29.927469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.051242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:30.063483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:30.067029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:30.068251 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5f6dc22-2e2f-41f8-b1f5-a6161c136000 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.464947 Oct 27 09:13:30.069158 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1544/3132] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:29 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:30.081735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:30.082591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:30.090722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.091460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.092144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.093316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.094116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.097260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.267435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:30.281102 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5874e86-24fa-4a79-a1de-badeed732c53 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1466 microversion: 2.1 time: 0.371562 Oct 27 09:13:30.296971 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1589/3133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:29 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1466 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:30.316808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e6ca013c-332b-49bf-bd84-82d27dae2ddb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:30.317429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e6ca013c-332b-49bf-bd84-82d27dae2ddb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:30.328292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6ca013c-332b-49bf-bd84-82d27dae2ddb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.329650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6ca013c-332b-49bf-bd84-82d27dae2ddb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.330264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6ca013c-332b-49bf-bd84-82d27dae2ddb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.338191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6ca013c-332b-49bf-bd84-82d27dae2ddb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.338904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6ca013c-332b-49bf-bd84-82d27dae2ddb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.339792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6ca013c-332b-49bf-bd84-82d27dae2ddb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.404063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:30.416408 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-350df9bc-21a2-42c8-9c0e-a7f5c213239b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 200 len: 1486 microversion: 2.1 time: 0.338841 Oct 27 09:13:30.423742 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1545/3134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:30 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 1486 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:30.429277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3f75f3d1-656f-4c91-9f7a-77e2b7e1d98f req-de4d81f8-fa78-4567-8b7f-8b433925562c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68363e6-08e4-49a8-b10f-7b954e13edb6", "name": "network-vif-deleted", "tag": "842bfa9f-5d7b-4938-8428-64e04fd2e183"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:30.456374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3f75f3d1-656f-4c91-9f7a-77e2b7e1d98f req-de4d81f8-fa78-4567-8b7f-8b433925562c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.456873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3f75f3d1-656f-4c91-9f7a-77e2b7e1d98f req-de4d81f8-fa78-4567-8b7f-8b433925562c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.457305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3f75f3d1-656f-4c91-9f7a-77e2b7e1d98f req-de4d81f8-fa78-4567-8b7f-8b433925562c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.476025 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3f75f3d1-656f-4c91-9f7a-77e2b7e1d98f req-de4d81f8-fa78-4567-8b7f-8b433925562c service nova] Creating event network-vif-deleted:842bfa9f-5d7b-4938-8428-64e04fd2e183 for instance a68363e6-08e4-49a8-b10f-7b954e13edb6 on n-h2-858383-16 Oct 27 09:13:30.495740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3f75f3d1-656f-4c91-9f7a-77e2b7e1d98f req-de4d81f8-fa78-4567-8b7f-8b433925562c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064940 Oct 27 09:13:30.496430 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1546/3135] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:30.506881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc6af81d-07a8-40db-abef-60292384db24 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-931654859"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:30.509353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc6af81d-07a8-40db-abef-60292384db24 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:30.533249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6af81d-07a8-40db-abef-60292384db24 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.535476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6af81d-07a8-40db-abef-60292384db24 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.536197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6af81d-07a8-40db-abef-60292384db24 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.536948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6af81d-07a8-40db-abef-60292384db24 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.540656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6af81d-07a8-40db-abef-60292384db24 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.541130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6af81d-07a8-40db-abef-60292384db24 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.655116 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e6ca013c-332b-49bf-bd84-82d27dae2ddb tempest-ServersOnMultiNodesTest-725366087 tempest-ServersOnMultiNodesTest-725366087-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1619 microversion: 2.1 time: 0.348036 Oct 27 09:13:30.656236 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1590/3136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:30 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1619 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:30.663755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:30.664630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:30.671623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.672364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.673179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.679077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.679775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.680604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.725463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.726136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.726933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.727275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lazy-loading 'fault' on Instance uuid a68363e6-08e4-49a8-b10f-7b954e13edb6 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:13:30.810737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:30.822160 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-42e48ede-c432-4b13-b652-8e53bfd5a481 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1314 microversion: 2.1 time: 0.162488 Oct 27 09:13:30.824157 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1591/3137] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:30 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:30.839944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:30.843164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:30.853927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.854756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.855738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.857566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:30.858957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:30.859759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:30.869301 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc6af81d-07a8-40db-abef-60292384db24 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444/action" status: 202 len: 0 microversion: 2.1 time: 0.366249 Oct 27 09:13:30.873016 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1547/3138] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:13:30 2022] POST /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:13:30.894240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c4ce872-9e61-4c4d-a539-e343ae197c28 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa0ef5e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:30.914887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:30.942195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:13:30.967021 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c4ce872-9e61-4c4d-a539-e343ae197c28 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.085932 Oct 27 09:13:30.967632 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1548/3139] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:30 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:31.057896 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c5709fc8-1125-42de-ae82-692237be4652 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 204 len: 0 microversion: 2.1 time: 0.232034 Oct 27 09:13:31.058526 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1592/3140] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:30 2022] DELETE /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:31.068707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:31.069452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:31.076602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:31.077571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:31.078027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:31.078743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:31.079442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:31.080053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:31.095247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:31.096046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:31.107254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:31.110991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:31.111429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:31.111904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:31.116043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:31.116995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:31.118188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:31.534795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:31.544972 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7307f541-a107-4d4f-bc58-dcf74747cbcd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1472 microversion: 2.1 time: 0.481403 Oct 27 09:13:31.548741 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1549/3141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:31 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:31.550292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:31.563097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:31.564963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:31.566244 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea582a35-9d34-497e-8047-fb7b8158cd82 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.475517 Oct 27 09:13:31.566852 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1593/3142] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:31 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:31.848612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:31.849473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:31.856406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:31.856893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:31.857335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:31.858030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:31.858480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:31.858898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:31.895660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:31.896586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:31.897238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:31.897933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lazy-loading 'fault' on Instance uuid a68363e6-08e4-49a8-b10f-7b954e13edb6 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:13:31.947666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301dc23d4934d62a4be5b5fbdb4888b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa9429f0fc463bafee4c25b310a008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:31.955898 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea09f418-f732-4b04-a9dd-401dee00429f tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 200 len: 1314 microversion: 2.1 time: 0.111691 Oct 27 09:13:31.959654 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1550/3143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:31 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 1314 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:31.982027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2d79c7bd-c6ec-4350-aec3-592775a0726e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa0f9ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:32.031080 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2d79c7bd-c6ec-4350-aec3-592775a0726e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.052769 Oct 27 09:13:32.032985 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1594/3144] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:31 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:32.578700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:32.585323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:32.593912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:32.594640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:32.596818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:32.597597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:32.598293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:32.599796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:32.601404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:32.602237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:32.615181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:32.615723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:32.616176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:32.618006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:32.620414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:32.621396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:32.922023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:32.932212 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a770e66-9151-4802-bfed-cbb6bd4063dd tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1472 microversion: 2.1 time: 0.357723 Oct 27 09:13:32.933088 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1551/3145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:32 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:32.980032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:32.981069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] [instance: a68363e6-08e4-49a8-b10f-7b954e13edb6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:32.988458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:32.989423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:32.990045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:32.991071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:32.991630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:32.992219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:32.994301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:33.008594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:33.009256 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] HTTP exception thrown: Instance a68363e6-08e4-49a8-b10f-7b954e13edb6 could not be found. Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Request method failure captured: Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 HTTP/1.1 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkuYh1hu_FLIGf8bVKaVaM93mt8-_36gffRb2AOFFIbhtFzV4ZzWSgrHJsPfcj3E7mPdBo-5wlDu1c9EZKBIkniIex2jUp2gSD0CD0k388YckJ1ftr1seCjl2ecddmgE5cHti0g3gb4GrJtXvf8rBv0LjuqIaQoiQvwQsMPVIeq1l88 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1bfa9429f0fc463bafee4c25b310a008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1bfa9429f0fc463bafee4c25b310a008"}]}] Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1bfa9429f0fc463bafee4c25b310a008 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1589282734 Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: b301dc23d4934d62a4be5b5fbdb4888b Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1589282734-project Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance a68363e6-08e4-49a8-b10f-7b954e13edb6 could not be found. Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'a68363e6-08e4-49a8-b10f-7b954e13edb6'} Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68363e6-08e4-49a8-b10f-7b954e13edb6 could not be found. Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68363e6-08e4-49a8-b10f-7b954e13edb6 could not be found. Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:33.011283 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:33.016070 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:33.016070 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:33.016070 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:33.016070 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:33.016070 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:33.016070 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:33.016070 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68363e6-08e4-49a8-b10f-7b954e13edb6 could not be found. Oct 27 09:13:33.016070 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:33.016605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:33.016605 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9c01a46-0c58-4bde-b609-8873b923f260 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.426969 Oct 27 09:13:33.017788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] Returning 404 to user: Instance a68363e6-08e4-49a8-b10f-7b954e13edb6 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:33.018838 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-777d8598-8b76-42d1-8bac-a5fb00229e37 tempest-ServerMetadataNegativeTestJSON-1589282734 tempest-ServerMetadataNegativeTestJSON-1589282734-project] 10.222.0.25 "GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6" status: 404 len: 111 microversion: 2.1 time: 0.043501 Oct 27 09:13:33.019592 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1552/3146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:32 2022] GET /compute/v2.1/servers/a68363e6-08e4-49a8-b10f-7b954e13edb6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:13:33.024641 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1595/3147] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:32 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:13:33.049294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c3807d2c-19e5-4d06-b167-ffa67f53b48f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa1f58b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:33.124144 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c3807d2c-19e5-4d06-b167-ffa67f53b48f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.079679 Oct 27 09:13:33.125170 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1553/3148] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:33 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:33.896921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d2127e04-eef8-4048-ad3f-c826cb2b41bb req-c39b203b-6c99-4738-aa87-41460d0ee00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7a67ad-fd9f-44bc-bfab-5ed9d887667e", "name": "network-vif-deleted", "tag": "a6af17f6-0e6d-4048-9ff5-e5c7319fe3b9"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:33.910965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d2127e04-eef8-4048-ad3f-c826cb2b41bb req-c39b203b-6c99-4738-aa87-41460d0ee00e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:33.911924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d2127e04-eef8-4048-ad3f-c826cb2b41bb req-c39b203b-6c99-4738-aa87-41460d0ee00e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:33.912536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d2127e04-eef8-4048-ad3f-c826cb2b41bb req-c39b203b-6c99-4738-aa87-41460d0ee00e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:33.929762 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d2127e04-eef8-4048-ad3f-c826cb2b41bb req-c39b203b-6c99-4738-aa87-41460d0ee00e service nova] Creating event network-vif-deleted:a6af17f6-0e6d-4048-9ff5-e5c7319fe3b9 for instance 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e on n-h2-858383-16 Oct 27 09:13:33.949735 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d2127e04-eef8-4048-ad3f-c826cb2b41bb req-c39b203b-6c99-4738-aa87-41460d0ee00e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057475 Oct 27 09:13:33.951072 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1596/3149] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:33.958129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:33.958820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:33.990009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:33.990916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:33.991534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:33.992583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:33.993273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:33.994215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:34.045114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:34.046778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:34.063154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:34.068220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:34.069134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:34.070143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:34.072481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:34.073166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:34.103832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:34.117781 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11b05793-2c77-4602-9ffc-c69a2c0edf5d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1301 microversion: 2.1 time: 0.165686 Oct 27 09:13:34.119775 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1554/3150] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:33 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1301 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:34.140631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1e48f91-cde2-4747-bc22-061ed4eb32f8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa0ff430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:34.243165 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e1e48f91-cde2-4747-bc22-061ed4eb32f8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.103416 Oct 27 09:13:34.247664 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1555/3151] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:34 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:34.431560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:34.450192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:34.453485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:34.455815 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97384ec1-0251-4cf1-9720-9c4f148b7ed1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.416321 Oct 27 09:13:34.457301 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1597/3152] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:34 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:13:35.148883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:35.150765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:35.184081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:35.188023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:35.189784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:35.190712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:35.191362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:35.191979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:35.256588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:35.257848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:35.258884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:35.259629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lazy-loading 'fault' on Instance uuid 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:13:35.265122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-52a72748-2b18-461d-ae0b-26f7031af016 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa020af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:35.360526 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-52a72748-2b18-461d-ae0b-26f7031af016 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.100179 Oct 27 09:13:35.361216 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1598/3153] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:35 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:35.410881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:35.437112 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f33a5a7-e04a-436c-9d49-e639ddf55505 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 200 len: 1306 microversion: 2.1 time: 0.298549 Oct 27 09:13:35.460711 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1556/3154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:35 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 1306 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:35.483161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:35.484315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:35.499802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:35.500410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:35.501569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:35.515803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:35.516701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:35.517257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:35.802106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:35.812632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:35.814892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:35.816288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3e39966-d9b0-4cd3-bcce-d85a58def9f2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.337445 Oct 27 09:13:35.828959 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1599/3155] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:35 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:36.381361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-399b0ff5-9abe-4250-8c60-d0b9b9936ee3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aaabeaf0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:36.448371 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-399b0ff5-9abe-4250-8c60-d0b9b9936ee3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.075971 Oct 27 09:13:36.458132 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1557/3156] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:36 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:36.471387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:36.472627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:36.488528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:36.489689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:36.490317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:36.491253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:36.492679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:36.493289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:36.520056 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] HTTP exception thrown: Instance 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e could not be found. Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Request method failure captured: Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e HTTP/1.1 Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrV_D9bp6urp78ucYOTrOZmbeQ_kkODzD3R8k_SARjktG_yNDClzW8LkUxMq0-mTrRxUh16uGI83EOuM4nEDERfw7OGPVnLsSXz2T-r0jcylVZvHG7-LZHPsHoMPm970n2t-5mUO_vhipeFsmb_sEipOxGYesM152NdfzY7u4s0wAE Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f5752431c874be58372449a6b71853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f5752431c874be58372449a6b71853c"}]}] Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e302f037bf934b958cef21d6001e7562 Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e could not be found. Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5a7a67ad-fd9f-44bc-bfab-5ed9d887667e'} Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e could not be found. Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e could not be found. Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:36.523251 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:36.528058 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:36.528058 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:36.528058 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:36.528058 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:36.528058 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:36.528058 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e could not be found. Oct 27 09:13:36.528058 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:36.530696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Returning 404 to user: Instance 5a7a67ad-fd9f-44bc-bfab-5ed9d887667e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:36.532768 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4b4334fd-f58b-44d6-92f8-d0a73e9dfeec tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e" status: 404 len: 111 microversion: 2.1 time: 0.067100 Oct 27 09:13:36.543046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:36.543838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:36.547059 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1600/3157] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:36 2022] GET /compute/v2.1/servers/5a7a67ad-fd9f-44bc-bfab-5ed9d887667e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:36.552417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:36.553250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:36.554053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:36.554953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:36.555667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:36.556297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:36.606173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:13:36.742101 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f34df77c-4240-4f36-a915-5dfe3124bf3f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 204 len: 0 microversion: 2.1 time: 0.203415 Oct 27 09:13:36.744230 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1558/3158] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:36 2022] DELETE /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:13:36.753793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:36.754805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:36.762177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:36.762972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:36.763604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:36.764496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:36.765134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:36.765750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:36.849644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:36.850357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:36.859891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:36.860529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:36.861003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:36.869124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:36.869752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:36.870203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:37.527768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:37.546039 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0268489-611d-4608-87cf-47ad037bfa6d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1472 microversion: 2.1 time: 0.794459 Oct 27 09:13:37.548458 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1601/3159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:36 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1472 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:37.566111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6cbce4ba-d31a-4966-a2ee-bd1c80991f15 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9e244c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:37.633883 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6cbce4ba-d31a-4966-a2ee-bd1c80991f15 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.081595 Oct 27 09:13:37.635061 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1602/3160] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:37 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:37.881395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:37.913886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:37.917415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:37.922105 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-57ca4330-34bf-4ad5-aea4-d7da3bc0f4b3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 1.080472 Oct 27 09:13:37.924855 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1559/3161] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:36 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:38.577959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:38.578594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:38.609464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:38.612505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:38.615877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:38.617122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:38.617820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:38.618423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:38.650414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-035bf84a-eebd-494e-bf0f-f1cce081f62e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae5c80d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:38.747625 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-035bf84a-eebd-494e-bf0f-f1cce081f62e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.083963 Oct 27 09:13:38.748940 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1560/3162] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:38 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:38.952885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:38.954708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:38.964240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:38.964746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:38.965189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:38.965901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:38.981366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:38.983827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:39.728094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:39.740048 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3968e1a1-1664-43ea-aed0-4af239429b2f tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1472 microversion: 2.1 time: 1.167536 Oct 27 09:13:39.740793 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1603/3163] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:38 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1472 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:39.741484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:39.754021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d5906359-0f1d-4414-8dd3-b1b25cccd5ec req-8a395dfd-f6f8-4f5f-a7e3-8b389b9ac6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-plugged", "status": "completed", "tag": "544be81e-f783-47ec-8081-b057c946342d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:39.761470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:39.764797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:39.769898 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01d502b3-b61d-40e5-9f50-6846d02a1422 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.819810 Oct 27 09:13:39.786038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d5906359-0f1d-4414-8dd3-b1b25cccd5ec req-8a395dfd-f6f8-4f5f-a7e3-8b389b9ac6c8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:39.786805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d5906359-0f1d-4414-8dd3-b1b25cccd5ec req-8a395dfd-f6f8-4f5f-a7e3-8b389b9ac6c8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:39.787399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d5906359-0f1d-4414-8dd3-b1b25cccd5ec req-8a395dfd-f6f8-4f5f-a7e3-8b389b9ac6c8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:39.791213 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1561/3164] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:38 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:13:39.803512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-180d62fe-c2fc-4a22-92a9-a48935dc1898 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae5324c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:39.810376 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d5906359-0f1d-4414-8dd3-b1b25cccd5ec req-8a395dfd-f6f8-4f5f-a7e3-8b389b9ac6c8 service nova] Creating event network-vif-plugged:544be81e-f783-47ec-8081-b057c946342d for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:13:39.828895 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d5906359-0f1d-4414-8dd3-b1b25cccd5ec req-8a395dfd-f6f8-4f5f-a7e3-8b389b9ac6c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077244 Oct 27 09:13:39.830211 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1604/3165] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:39.912929 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-180d62fe-c2fc-4a22-92a9-a48935dc1898 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.119044 Oct 27 09:13:39.924495 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1562/3166] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:39 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:40.123160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-bf3e314b-fefd-4371-9542-a3218cce7d9c req-634d6ba9-c6fe-4ddb-b040-6c9958be8e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32d9ac3-679c-4dbd-a101-a244c42ee14e", "name": "network-vif-deleted", "tag": "d39c2450-a7a4-48c5-8001-90e0ea3b6b70"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:40.131034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:40.138671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bf3e314b-fefd-4371-9542-a3218cce7d9c req-634d6ba9-c6fe-4ddb-b040-6c9958be8e95 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:40.139155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bf3e314b-fefd-4371-9542-a3218cce7d9c req-634d6ba9-c6fe-4ddb-b040-6c9958be8e95 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:40.140280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bf3e314b-fefd-4371-9542-a3218cce7d9c req-634d6ba9-c6fe-4ddb-b040-6c9958be8e95 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:40.169537 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-bf3e314b-fefd-4371-9542-a3218cce7d9c req-634d6ba9-c6fe-4ddb-b040-6c9958be8e95 service nova] Creating event network-vif-deleted:d39c2450-a7a4-48c5-8001-90e0ea3b6b70 for instance f32d9ac3-679c-4dbd-a101-a244c42ee14e on n-h1-858383-16 Oct 27 09:13:40.193484 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-bf3e314b-fefd-4371-9542-a3218cce7d9c req-634d6ba9-c6fe-4ddb-b040-6c9958be8e95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074557 Oct 27 09:13:40.198371 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1605/3167] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:40.771561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:40.776435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:40.787945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:40.792074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:40.792542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:40.793303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:40.793788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:40.794214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:40.804309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:40.805024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:40.822936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:40.824738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:40.825274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:40.830392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:40.831921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:40.834015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:40.925165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:40.925683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:40.926317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:40.926974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lazy-loading 'fault' on Instance uuid f32d9ac3-679c-4dbd-a101-a244c42ee14e {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:13:41.223713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:41.241951 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb95df88-bf01-42bc-ab8b-457deebc6b13 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 200 len: 1306 microversion: 2.1 time: 0.475457 Oct 27 09:13:41.259310 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1563/3168] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:40 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 1306 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:41.290452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9339af16-5717-4e5a-a6ec-8cb418273ace tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa1f55e0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:41.418226 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9339af16-5717-4e5a-a6ec-8cb418273ace tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.138525 Oct 27 09:13:41.419552 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1564/3169] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:41 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:41.680642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:41.701797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:41.707895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:41.709924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c2474c73-c45a-440f-9b12-696d11b871d1 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.913474 Oct 27 09:13:41.711013 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1606/3170] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:40 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:42.287135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:42.288079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f32d9ac3-679c-4dbd-a101-a244c42ee14e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:42.311237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:42.319337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:42.329921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:42.332523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:42.333034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:42.333484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:42.377696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-de6753ee-b92f-49dc-ae67-e79ff34c82e7 req-af8a8ee5-db9e-464a-8703-31fa5800dc37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-plugged", "status": "completed", "tag": "11599d02-495f-4773-8d4b-4f4e7e5ef3bf"}, {"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-plugged", "status": "completed", "tag": "2cde9751-eb67-4cae-b058-60bba7fb3b65"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:42.394206 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] HTTP exception thrown: Instance f32d9ac3-679c-4dbd-a101-a244c42ee14e could not be found. Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Request method failure captured: Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e HTTP/1.1 Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkrV_D9bp6urp78ucYOTrOZmbeQ_kkODzD3R8k_SARjktG_yNDClzW8LkUxMq0-mTrRxUh16uGI83EOuM4nEDERfw7OGPVnLsSXz2T-r0jcylVZvHG7-LZHPsHoMPm970n2t-5mUO_vhipeFsmb_sEipOxGYesM152NdfzY7u4s0wAE Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f5752431c874be58372449a6b71853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f5752431c874be58372449a6b71853c"}]}] Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: e302f037bf934b958cef21d6001e7562 Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance f32d9ac3-679c-4dbd-a101-a244c42ee14e could not be found. Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f32d9ac3-679c-4dbd-a101-a244c42ee14e'} Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f32d9ac3-679c-4dbd-a101-a244c42ee14e could not be found. Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f32d9ac3-679c-4dbd-a101-a244c42ee14e could not be found. Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:42.398556 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:42.403543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:42.403543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:42.403543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:42.403543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:42.403543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:42.403543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f32d9ac3-679c-4dbd-a101-a244c42ee14e could not be found. Oct 27 09:13:42.403543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:13:42.406132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Returning 404 to user: Instance f32d9ac3-679c-4dbd-a101-a244c42ee14e could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:42.407950 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b3a9755-eacb-4bca-9282-29be13cf8a72 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e" status: 404 len: 111 microversion: 2.1 time: 0.125256 Oct 27 09:13:42.412489 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1565/3171] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:42 2022] GET /compute/v2.1/servers/f32d9ac3-679c-4dbd-a101-a244c42ee14e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:42.418344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:42.420182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:42.420794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-de6753ee-b92f-49dc-ae67-e79ff34c82e7 req-af8a8ee5-db9e-464a-8703-31fa5800dc37 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:42.421308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-de6753ee-b92f-49dc-ae67-e79ff34c82e7 req-af8a8ee5-db9e-464a-8703-31fa5800dc37 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:42.421779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-de6753ee-b92f-49dc-ae67-e79ff34c82e7 req-af8a8ee5-db9e-464a-8703-31fa5800dc37 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:42.438155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:42.439309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:42.439970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:42.442032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:42.442707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:42.443378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:42.451561 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-de6753ee-b92f-49dc-ae67-e79ff34c82e7 req-af8a8ee5-db9e-464a-8703-31fa5800dc37 service nova] Creating event network-vif-plugged:11599d02-495f-4773-8d4b-4f4e7e5ef3bf for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:13:42.452501 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-de6753ee-b92f-49dc-ae67-e79ff34c82e7 req-af8a8ee5-db9e-464a-8703-31fa5800dc37 service nova] Creating event network-vif-plugged:2cde9751-eb67-4cae-b058-60bba7fb3b65 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:13:42.461288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-de6753ee-b92f-49dc-ae67-e79ff34c82e7 req-af8a8ee5-db9e-464a-8703-31fa5800dc37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087998 Oct 27 09:13:42.469273 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1607/3172] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:13:42.496309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:13:42.722508 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8722551-7070-4793-96f6-3dca5639f3c2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 204 len: 0 microversion: 2.1 time: 0.308354 Oct 27 09:13:42.743885 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1566/3173] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:42 2022] DELETE /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:42.752996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:42.776285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:42.812312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:42.818843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:42.824403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:42.826181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:42.836071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:42.837726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:43.039825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9dff5cf4-f909-42ca-9377-d33ed80e96a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9dc0940>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:43.122085 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9dff5cf4-f909-42ca-9377-d33ed80e96a8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.650798 Oct 27 09:13:43.123283 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1608/3174] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:42 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:43.137634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:43.138616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:43.153664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:43.155069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:43.156143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:43.157169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:43.157886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:43.158509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:43.695057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:43.738313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:43.744739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:43.746838 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45ca89c7-32ee-4770-b11e-5d4c01a95531 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.999340 Oct 27 09:13:43.748719 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1567/3175] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:42 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:44.022743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:44.037822 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be996407-348d-4d29-8135-077c44c5efb2 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1473 microversion: 2.1 time: 0.910778 Oct 27 09:13:44.051552 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1609/3176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:43 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1473 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:44.139314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59716fb2-58e3-41d1-a878-50147632a03d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa3955e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:44.231019 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59716fb2-58e3-41d1-a878-50147632a03d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.096520 Oct 27 09:13:44.232817 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1610/3177] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:44 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:44.541590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-366106044", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "e8c5aa29-49fa-4f99-9901-1bf66a4b8089"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:44.680141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] validate_networks() for [('e8c5aa29-49fa-4f99-9901-1bf66a4b8089', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:13:44.793844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:44.795931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:44.834079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:44.835849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:44.836830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:44.839332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:44.841244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:44.857988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:46.637017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:46.650636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:46.652608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:46.654252 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d4694d56-a098-4cc6-a972-94725170797e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 1.881526 Oct 27 09:13:46.655507 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1611/3178] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:44 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:46.662151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:46.663014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:46.670810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:46.671640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:46.672451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:46.688778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:46.692305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:46.693083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:47.423558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:47.443189 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f6158bc-c0b0-4cbb-8b5a-d51a9b8481ba tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1431 microversion: 2.1 time: 0.786241 Oct 27 09:13:47.443841 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1612/3179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:46 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1431 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:47.460872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-777b8eca-a731-429d-b040-58eb798706c3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9fdbd30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:47.600292 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-777b8eca-a731-429d-b040-58eb798706c3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.155114 Oct 27 09:13:47.604199 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1613/3180] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:47 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:47.615955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ffad96df-0d1d-4330-909e-1096eafb597a req-96f9939d-8834-4d35-a0ca-958850b857f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-plugged", "status": "completed", "tag": "d55c2a24-6294-46f5-9ee3-aefcef021dc6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:47.665173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ffad96df-0d1d-4330-909e-1096eafb597a req-96f9939d-8834-4d35-a0ca-958850b857f1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:47.665870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ffad96df-0d1d-4330-909e-1096eafb597a req-96f9939d-8834-4d35-a0ca-958850b857f1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:47.666244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ffad96df-0d1d-4330-909e-1096eafb597a req-96f9939d-8834-4d35-a0ca-958850b857f1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:47.718916 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ffad96df-0d1d-4330-909e-1096eafb597a req-96f9939d-8834-4d35-a0ca-958850b857f1 service nova] Creating event network-vif-plugged:d55c2a24-6294-46f5-9ee3-aefcef021dc6 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:13:47.731358 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ffad96df-0d1d-4330-909e-1096eafb597a req-96f9939d-8834-4d35-a0ca-958850b857f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122847 Oct 27 09:13:47.733863 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1614/3181] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:47.746382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d85ed9ee-583a-442a-a444-4d3f7dcc5fea req-c08bb1d2-52db-4c86-a51e-3d9ae902a8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f250c018-e87e-4fe3-be36-06598d515393", "name": "network-vif-deleted", "tag": "1544ea5d-4a32-43b3-b89c-897d3157adc3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:47.776687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d85ed9ee-583a-442a-a444-4d3f7dcc5fea req-c08bb1d2-52db-4c86-a51e-3d9ae902a8f6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:47.777496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d85ed9ee-583a-442a-a444-4d3f7dcc5fea req-c08bb1d2-52db-4c86-a51e-3d9ae902a8f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:47.778107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d85ed9ee-583a-442a-a444-4d3f7dcc5fea req-c08bb1d2-52db-4c86-a51e-3d9ae902a8f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:47.815665 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d85ed9ee-583a-442a-a444-4d3f7dcc5fea req-c08bb1d2-52db-4c86-a51e-3d9ae902a8f6 service nova] Creating event network-vif-deleted:1544ea5d-4a32-43b3-b89c-897d3157adc3 for instance f250c018-e87e-4fe3-be36-06598d515393 on n-h1-858383-16 Oct 27 09:13:47.833311 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d85ed9ee-583a-442a-a444-4d3f7dcc5fea req-c08bb1d2-52db-4c86-a51e-3d9ae902a8f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095280 Oct 27 09:13:47.834169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:13:47.835522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:13:47.835859 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1615/3182] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:47.836338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:13:47.836763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:13:47.837279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:13:47.855906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:47.856926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:47.872360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:47.873031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:47.873711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:47.875056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:47.876057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:47.876214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:47.880562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:47.881423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:47.882028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:47.883120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:47.883659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:47.884106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:47.959318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Getting quotas for project 6d4749452cdb43de9f6b0ad5db5822bb. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:13:47.970496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Getting quotas for user 1474887555fd46f2817f0543ab5f522b and project 6d4749452cdb43de9f6b0ad5db5822bb. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:13:48.001999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:13:48.008307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:13:48.122437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9e0f8330-ee7e-42b2-a751-84a93693721e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.011931 Oct 27 09:13:48.123592 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1568/3183] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:13:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 4022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:13:48.136096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-226fee2a-bbee-4719-a04d-290b732336cd tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:48.143470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-226fee2a-bbee-4719-a04d-290b732336cd tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:48.151109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:48.368432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-226fee2a-bbee-4719-a04d-290b732336cd tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:48.376884 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-226fee2a-bbee-4719-a04d-290b732336cd tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1224 microversion: 2.1 time: 0.245171 Oct 27 09:13:48.382961 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1569/3184] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:48 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1224 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:48.472456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:48.473041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:48.490487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:48.492214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:48.492677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:48.493432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:48.493889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:48.494412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:48.620268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:48.620766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:48.622575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:48.623253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lazy-loading 'fault' on Instance uuid f250c018-e87e-4fe3-be36-06598d515393 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:13:48.632588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:48.743226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:48.765909 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e934fa2-737c-4f2a-8fe4-6e3e6b6cb47c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 200 len: 1307 microversion: 2.1 time: 0.298012 Oct 27 09:13:48.783664 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1570/3185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:48 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 1307 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:48.790221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ca6e7e3-6616-4b35-ae22-de8af49c5ab2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa0ffee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:48.961753 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ca6e7e3-6616-4b35-ae22-de8af49c5ab2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.189174 Oct 27 09:13:48.965283 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1571/3186] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:48 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:48.973856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:48.993835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:48.998774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:49.003646 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c955c323-3e7a-4be6-b8c4-53b509655ba3 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 1.163093 Oct 27 09:13:49.005325 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1616/3187] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:47 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:49.401543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:49.402170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:49.431282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:49.432047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:49.432632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:49.433460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:49.436129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:49.436718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:49.605137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:49.620451 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12e60467-8b7b-44b9-b970-06ad6c8eef92 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1228 microversion: 2.1 time: 0.223965 Oct 27 09:13:49.625726 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1572/3188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:49 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1228 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:49.801473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:49.802340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f250c018-e87e-4fe3-be36-06598d515393] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:49.817841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:49.819340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:49.820715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:49.822196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:49.824412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:49.826205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:49.864288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] HTTP exception thrown: Instance f250c018-e87e-4fe3-be36-06598d515393 could not be found. Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Request method failure captured: Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 HTTP/1.1 Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrV_D9bp6urp78ucYOTrOZmbeQ_kkODzD3R8k_SARjktG_yNDClzW8LkUxMq0-mTrRxUh16uGI83EOuM4nEDERfw7OGPVnLsSXz2T-r0jcylVZvHG7-LZHPsHoMPm970n2t-5mUO_vhipeFsmb_sEipOxGYesM152NdfzY7u4s0wAE Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f5752431c874be58372449a6b71853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f5752431c874be58372449a6b71853c"}]}] Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e302f037bf934b958cef21d6001e7562 Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f250c018-e87e-4fe3-be36-06598d515393 could not be found. Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f250c018-e87e-4fe3-be36-06598d515393'} Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f250c018-e87e-4fe3-be36-06598d515393 could not be found. Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f250c018-e87e-4fe3-be36-06598d515393 could not be found. Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:13:49.872120 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:49.879920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:13:49.879920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:13:49.879920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:13:49.879920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:13:49.879920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:13:49.879920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f250c018-e87e-4fe3-be36-06598d515393 could not be found. Oct 27 09:13:49.879920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:13:49.894585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Returning 404 to user: Instance f250c018-e87e-4fe3-be36-06598d515393 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:13:49.895799 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a827d8af-97f7-4da0-92a5-9a6e327d5687 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393" status: 404 len: 111 microversion: 2.1 time: 0.103421 Oct 27 09:13:49.906269 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1617/3189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:49 2022] GET /compute/v2.1/servers/f250c018-e87e-4fe3-be36-06598d515393 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:13:49.911092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:49.911668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:49.928854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:49.929643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:49.930334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:49.931560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:49.933681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:49.934289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:49.938213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-bf7c8ce1-77cc-4d1c-b283-812602d77de0 req-1ac7d365-498f-4213-8348-1bfbe7c5013b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-plugged", "status": "completed", "tag": "4757d336-0d53-4876-83cf-55f3b46f3a76"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:49.957485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bf7c8ce1-77cc-4d1c-b283-812602d77de0 req-1ac7d365-498f-4213-8348-1bfbe7c5013b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:49.957989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bf7c8ce1-77cc-4d1c-b283-812602d77de0 req-1ac7d365-498f-4213-8348-1bfbe7c5013b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:49.958677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bf7c8ce1-77cc-4d1c-b283-812602d77de0 req-1ac7d365-498f-4213-8348-1bfbe7c5013b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:49.973932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:13:49.987632 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-bf7c8ce1-77cc-4d1c-b283-812602d77de0 req-1ac7d365-498f-4213-8348-1bfbe7c5013b service nova] Creating event network-vif-plugged:4757d336-0d53-4876-83cf-55f3b46f3a76 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:13:50.002753 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-bf7c8ce1-77cc-4d1c-b283-812602d77de0 req-1ac7d365-498f-4213-8348-1bfbe7c5013b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068968 Oct 27 09:13:50.003696 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1618/3190] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:13:50.017211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f2d4f48-8e63-48f2-b689-51d90d2e25e8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9e16310>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:50.111509 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f2d4f48-8e63-48f2-b689-51d90d2e25e8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.106568 Oct 27 09:13:50.112128 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1619/3191] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:50 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:50.125944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:50.136680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:50.157672 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-39dc1257-9d5e-40d7-b993-e44bac970fa9 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c" status: 204 len: 0 microversion: 2.1 time: 0.256205 Oct 27 09:13:50.158990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:50.160111 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1573/3192] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:49 2022] DELETE /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:50.163357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:50.165141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:50.165972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:50.168447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:50.169143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:50.176017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:50.177036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:50.185920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:50.186779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:50.187379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:50.189323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:50.190058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:50.190719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:50.220218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:50.229479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:13:50.410657 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-753614ef-ed3e-4fc1-84e4-113449fba625 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 204 len: 0 microversion: 2.1 time: 0.240175 Oct 27 09:13:50.412854 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1574/3193] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:13:50 2022] DELETE /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:50.429412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:50.430134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:50.458676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:50.459320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:50.459694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:50.461179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:50.461427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:50.462494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:50.603419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:50.616968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:50.621738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:50.627609 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38dea067-459e-4112-929b-bf8e70183b49 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.514180 Oct 27 09:13:50.630863 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1620/3194] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:50 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:50.697413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:50.699050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:50.709444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:50.710348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:50.716223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:50.717285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:50.717762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:50.718195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:50.864097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:50.889395 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-194fa95c-390f-4e55-9e19-d7edd0dea17c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c" status: 200 len: 1473 microversion: 2.1 time: 0.470145 Oct 27 09:13:50.892037 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1575/3195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:50 2022] GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c => generated 1473 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:50.910462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:50.933031 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b44e13f0-1e1a-4d65-af93-bbd49a1c2f24 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1276 microversion: 2.1 time: 0.257438 Oct 27 09:13:50.935511 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1621/3196] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:50 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:51.127347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a4f43c7-7b3d-4f29-b022-124617ccc3c0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa0ef700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:51.197863 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a4f43c7-7b3d-4f29-b022-124617ccc3c0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.074213 Oct 27 09:13:51.199694 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1576/3197] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:51 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:51.657410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:51.658853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:51.667298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:51.671835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:51.672792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:51.673713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:51.676221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:51.676843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:51.914174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:51.914768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:51.943222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:51.943699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:51.944156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:51.951648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:51.952202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:51.955667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:52.042695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:52.059318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:52.081612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:52.082924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-333ff69b-efad-4122-b7b5-8d833682d0d0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 0.430356 Oct 27 09:13:52.083517 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1622/3198] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:51 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:52.112103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6231c5d1-da05-4e7a-bccc-45d59ee8dbb5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:52.112926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6231c5d1-da05-4e7a-bccc-45d59ee8dbb5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:52.124832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6231c5d1-da05-4e7a-bccc-45d59ee8dbb5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:52.125748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6231c5d1-da05-4e7a-bccc-45d59ee8dbb5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:52.126454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6231c5d1-da05-4e7a-bccc-45d59ee8dbb5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:52.127509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6231c5d1-da05-4e7a-bccc-45d59ee8dbb5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:52.128190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6231c5d1-da05-4e7a-bccc-45d59ee8dbb5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:52.129501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6231c5d1-da05-4e7a-bccc-45d59ee8dbb5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:52.194327 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6231c5d1-da05-4e7a-bccc-45d59ee8dbb5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/ips" status: 200 len: 150 microversion: 2.20 time: 0.098433 Oct 27 09:13:52.195796 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1623/3199] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Oct 27 09:13:52 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/ips => generated 150 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:13:52.210821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:52.212748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:52.230478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:52.231986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:52.232698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:52.233659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:52.234306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:52.236177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:52.738647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:52.763599 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46051091-c2c2-4d3e-a097-66debca4356a tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1284 microversion: 2.1 time: 0.565502 Oct 27 09:13:52.767969 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1624/3200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:52 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1284 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:52.782855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-684d3379-b08f-44f7-a3e0-aaad83124880 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae6943a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:52.879162 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-684d3379-b08f-44f7-a3e0-aaad83124880 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.110067 Oct 27 09:13:52.881006 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1625/3201] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:52 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:52.897904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-66efda03-1757-4c77-abbc-dd36696ea542 req-28c4f38c-04a1-4986-9d70-bb43fbd9da30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-plugged", "status": "completed", "tag": "7dc176e6-58b3-4ec1-9928-173ca4ea6e6d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:52.910728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-66efda03-1757-4c77-abbc-dd36696ea542 req-28c4f38c-04a1-4986-9d70-bb43fbd9da30 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:52.913019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-66efda03-1757-4c77-abbc-dd36696ea542 req-28c4f38c-04a1-4986-9d70-bb43fbd9da30 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:52.917575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-66efda03-1757-4c77-abbc-dd36696ea542 req-28c4f38c-04a1-4986-9d70-bb43fbd9da30 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:52.951356 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-66efda03-1757-4c77-abbc-dd36696ea542 req-28c4f38c-04a1-4986-9d70-bb43fbd9da30 service nova] Creating event network-vif-plugged:7dc176e6-58b3-4ec1-9928-173ca4ea6e6d for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:13:52.976404 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-66efda03-1757-4c77-abbc-dd36696ea542 req-28c4f38c-04a1-4986-9d70-bb43fbd9da30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093249 Oct 27 09:13:52.982508 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1626/3202] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:53.115714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:53.116433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:53.134310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:53.134822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:53.142932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:53.147628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:53.150659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:53.151122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:55.852180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:55.876057 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-747aa624-ad3a-4cee-bf62-8f73ed36c8bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c" status: 200 len: 1473 microversion: 2.1 time: 3.966946 Oct 27 09:13:55.878064 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1577/3203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:51 2022] GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c => generated 1473 bytes in 3969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:13:55.899850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:55.912783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:55.940252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:55.941250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:55.941937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:55.945171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:55.945844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:55.946551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:56.377691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:56.393465 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d9b7e1f-ebac-4fbd-b4ca-416be6cee874 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1282 microversion: 2.1 time: 0.512346 Oct 27 09:13:56.395108 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1578/3204] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:55 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1282 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:56.414524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf47beb0-f6d9-428d-86ca-bca0b1e980b3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae5bd670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:56.426892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:56.456555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:56.466978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:56.468319 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10fcc63d-f1d1-4d24-8ee8-b0cf3c467c1c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1874 microversion: 2.42 time: 3.356834 Oct 27 09:13:56.470118 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1627/3205] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:53 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1874 bytes in 3360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:13:56.486084 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf47beb0-f6d9-428d-86ca-bca0b1e980b3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.089228 Oct 27 09:13:56.487109 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1579/3206] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:13:56 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:56.489645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e5cc7157-1d42-4ee9-aaea-4cf79a534bc4 req-839aee27-5150-4785-811b-1512006e54c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-plugged", "status": "completed", "tag": "0ed98e72-a11f-447c-905c-7876d41e6951"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:56.527932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e5cc7157-1d42-4ee9-aaea-4cf79a534bc4 req-839aee27-5150-4785-811b-1512006e54c5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:56.528319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e5cc7157-1d42-4ee9-aaea-4cf79a534bc4 req-839aee27-5150-4785-811b-1512006e54c5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:56.529021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e5cc7157-1d42-4ee9-aaea-4cf79a534bc4 req-839aee27-5150-4785-811b-1512006e54c5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:56.559033 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e5cc7157-1d42-4ee9-aaea-4cf79a534bc4 req-839aee27-5150-4785-811b-1512006e54c5 service nova] Creating event network-vif-plugged:0ed98e72-a11f-447c-905c-7876d41e6951 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:13:56.574458 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e5cc7157-1d42-4ee9-aaea-4cf79a534bc4 req-839aee27-5150-4785-811b-1512006e54c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102195 Oct 27 09:13:56.576737 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1628/3207] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:56.738178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-905b8206-7baf-42a1-8369-ba0e22b5e21c req-72dce9f8-213b-4fc6-bd86-71bd339f1666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4a6784-df8b-47f7-9132-8ad0ab14cb59", "name": "network-vif-deleted", "tag": "d7cdd3a8-c93c-43ad-ae1d-1de5d0a79f22"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:56.787496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-905b8206-7baf-42a1-8369-ba0e22b5e21c req-72dce9f8-213b-4fc6-bd86-71bd339f1666 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:56.790931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-905b8206-7baf-42a1-8369-ba0e22b5e21c req-72dce9f8-213b-4fc6-bd86-71bd339f1666 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:56.791608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-905b8206-7baf-42a1-8369-ba0e22b5e21c req-72dce9f8-213b-4fc6-bd86-71bd339f1666 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:56.853434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-917450657", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "c6eedf27-5b33-475b-bdb2-bdf61370474c"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:56.861902 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-905b8206-7baf-42a1-8369-ba0e22b5e21c req-72dce9f8-213b-4fc6-bd86-71bd339f1666 service nova] Creating event network-vif-deleted:d7cdd3a8-c93c-43ad-ae1d-1de5d0a79f22 for instance da4a6784-df8b-47f7-9132-8ad0ab14cb59 on n-h2-858383-16 Oct 27 09:13:56.885531 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-905b8206-7baf-42a1-8369-ba0e22b5e21c req-72dce9f8-213b-4fc6-bd86-71bd339f1666 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151671 Oct 27 09:13:56.894734 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1629/3208] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:13:56.917019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:13:56.921010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:56.941776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:56.942439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:56.943913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:56.944966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:56.945884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:56.946616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:57.018977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lazy-loading 'flavor' on Instance uuid 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:13:57.019282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] validate_networks() for [('c6eedf27-5b33-475b-bdb2-bdf61370474c', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:13:57.469272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ad0c1048-86af-4706-9025-be6b23ee62b0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/action" status: 202 len: 0 microversion: 2.20 time: 0.568346 Oct 27 09:13:57.473976 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1630/3209] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:13:56 2022] POST /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:13:57.486668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:57.487171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:57.501895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:57.502391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:57.512322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:57.513431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:57.514071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:57.514704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:57.587997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:57.591069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:57.592564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:57.593151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lazy-loading 'fault' on Instance uuid f3b2fef2-ebb0-4f59-b152-dff17798962c {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:13:57.861302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:57.881522 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d787113a-2a32-43b2-834f-3714ad31e2b0 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c" status: 200 len: 1308 microversion: 2.1 time: 0.405824 Oct 27 09:13:57.882320 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1631/3210] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:57 2022] GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:57.909260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:57.910158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:57.926267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:57.944878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:57.955845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:57.958417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:57.959454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:57.963817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:57.972262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:58.375991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:59.278212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:13:59.287015 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49f48e5c-1f98-4562-b816-169db09a2800 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 1.390217 Oct 27 09:13:59.293498 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1632/3211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:13:57 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:13:59.298690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:13:59.303949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:13:59.317725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:13:59.332792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:59.333483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:59.341385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:13:59.342435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:13:59.344217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:13:59.344941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.212546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:00.257063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:00.257063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:00.261275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:14:00.262457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:14:00.263191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:14:00.263725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:14:00.264215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:14:00.265321 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc139575-1b9e-4deb-ad6a-a7839763512b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1721 microversion: 2.20 time: 0.965857 Oct 27 09:14:00.277342 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1633/3212] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:13:59 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1721 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:00.294377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:00.300080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.300588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.301470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:00.304040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.305655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.308447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.309076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.350765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.351422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.351950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.352841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.353513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.354010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.377160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Getting quotas for project 86393a468f9a4e498507a8749d35bfab. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:14:00.389980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Getting quotas for user c1680fb5ed3844e9a8623f7a83009572 and project 86393a468f9a4e498507a8749d35bfab. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:14:00.425754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:14:00.430610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:14:00.524789 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9dc66d1-793a-49a8-90c8-79ea84b44298 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.035429 Oct 27 09:14:00.526011 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1580/3213] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:13:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4038 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:14:00.532161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e7e882c-ece3-4813-adc7-c71d55da8afd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae6088b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:00.598936 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e7e882c-ece3-4813-adc7-c71d55da8afd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.071566 Oct 27 09:14:00.600186 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1581/3214] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:14:00 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:00.606427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f09f961f-122a-4991-8e9b-82914d221d15 req-7b802804-04ee-4804-bb2b-f0e7dd23fa4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119dcc89-5176-4b9f-b784-cba0bb8c1444", "name": "network-vif-plugged", "status": "completed", "tag": "41e4ebd1-dbca-4093-be4e-10f1ad3b6519"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:00.631004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f09f961f-122a-4991-8e9b-82914d221d15 req-7b802804-04ee-4804-bb2b-f0e7dd23fa4d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.635621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f09f961f-122a-4991-8e9b-82914d221d15 req-7b802804-04ee-4804-bb2b-f0e7dd23fa4d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.636593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f09f961f-122a-4991-8e9b-82914d221d15 req-7b802804-04ee-4804-bb2b-f0e7dd23fa4d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.667150 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f09f961f-122a-4991-8e9b-82914d221d15 req-7b802804-04ee-4804-bb2b-f0e7dd23fa4d service nova] Creating event network-vif-plugged:41e4ebd1-dbca-4093-be4e-10f1ad3b6519 for instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 on n-h2-858383-16 Oct 27 09:14:00.676999 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f09f961f-122a-4991-8e9b-82914d221d15 req-7b802804-04ee-4804-bb2b-f0e7dd23fa4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074040 Oct 27 09:14:00.677884 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1582/3215] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:00.692728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:00.693778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: f3b2fef2-ebb0-4f59-b152-dff17798962c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:00.706573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.709553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.711895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.713089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.714929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.715486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.747030 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] HTTP exception thrown: Instance f3b2fef2-ebb0-4f59-b152-dff17798962c could not be found. Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Request method failure captured: Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c HTTP/1.1 Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkrV_D9bp6urp78ucYOTrOZmbeQ_kkODzD3R8k_SARjktG_yNDClzW8LkUxMq0-mTrRxUh16uGI83EOuM4nEDERfw7OGPVnLsSXz2T-r0jcylVZvHG7-LZHPsHoMPm970n2t-5mUO_vhipeFsmb_sEipOxGYesM152NdfzY7u4s0wAE Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f5752431c874be58372449a6b71853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f5752431c874be58372449a6b71853c"}]}] Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: e302f037bf934b958cef21d6001e7562 Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance f3b2fef2-ebb0-4f59-b152-dff17798962c could not be found. Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f3b2fef2-ebb0-4f59-b152-dff17798962c'} Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b2fef2-ebb0-4f59-b152-dff17798962c could not be found. Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b2fef2-ebb0-4f59-b152-dff17798962c could not be found. Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:00.753413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:00.757405 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:00.757405 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:00.757405 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:00.757405 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:00.757405 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:00.757405 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b2fef2-ebb0-4f59-b152-dff17798962c could not be found. Oct 27 09:14:00.757405 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:00.761806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Returning 404 to user: Instance f3b2fef2-ebb0-4f59-b152-dff17798962c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:00.766764 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5027fb39-afbb-4232-bd49-b6eb31873409 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c" status: 404 len: 111 microversion: 2.1 time: 0.084217 Oct 27 09:14:00.767696 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1583/3216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:00 2022] GET /compute/v2.1/servers/f3b2fef2-ebb0-4f59-b152-dff17798962c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:14:00.793114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fe4a5864-2f3b-45df-bdfe-17f170dade85 req-0c17a052-f99a-4dfc-8f7a-5ca0a96d5745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b2fef2-ebb0-4f59-b152-dff17798962c", "name": "network-vif-deleted", "tag": "84462fd3-a813-469f-9216-fb63d16087de"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:00.822727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fe4a5864-2f3b-45df-bdfe-17f170dade85 req-0c17a052-f99a-4dfc-8f7a-5ca0a96d5745 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.823491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fe4a5864-2f3b-45df-bdfe-17f170dade85 req-0c17a052-f99a-4dfc-8f7a-5ca0a96d5745 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.824778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fe4a5864-2f3b-45df-bdfe-17f170dade85 req-0c17a052-f99a-4dfc-8f7a-5ca0a96d5745 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.839650 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fe4a5864-2f3b-45df-bdfe-17f170dade85 req-0c17a052-f99a-4dfc-8f7a-5ca0a96d5745 service nova] Creating event network-vif-deleted:84462fd3-a813-469f-9216-fb63d16087de for instance f3b2fef2-ebb0-4f59-b152-dff17798962c on n-h1-858383-16 Oct 27 09:14:00.847134 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fe4a5864-2f3b-45df-bdfe-17f170dade85 req-0c17a052-f99a-4dfc-8f7a-5ca0a96d5745 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070347 Oct 27 09:14:00.848289 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1584/3217] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:00.860093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:00.862165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:00.879804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.881595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.882900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:00.885123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:00.886078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:00.887498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:01.039966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:01.064547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:01.066126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:01.067437 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-07ac33b0-240e-462b-8782-764e53f3f544 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2829 microversion: 2.42 time: 0.787671 Oct 27 09:14:01.068037 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1634/3218] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:00 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2829 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:01.122776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64f1fa98-48e7-4365-bc35-b720f6854641 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:01.123709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64f1fa98-48e7-4365-bc35-b720f6854641 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:01.297735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:01.301984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64f1fa98-48e7-4365-bc35-b720f6854641 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:01.332879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64f1fa98-48e7-4365-bc35-b720f6854641 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:01.336099 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef186393-678e-4541-b775-fee2fe5220b6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 0.486554 Oct 27 09:14:01.337014 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1585/3219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:00 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:01.355015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64f1fa98-48e7-4365-bc35-b720f6854641 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:01.360728 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64f1fa98-48e7-4365-bc35-b720f6854641 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1261 microversion: 2.26 time: 0.260395 Oct 27 09:14:01.364409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:01.364852 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1635/3220] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:01 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1261 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:01.380534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: da4a6784-df8b-47f7-9132-8ad0ab14cb59] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:01.385866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72fdcbd8-fc62-4bfd-ba8e-e529223915b2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:01.386365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72fdcbd8-fc62-4bfd-ba8e-e529223915b2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:01.403771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:01.404285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:01.404735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:01.405464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:01.405916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:01.406383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:01.421669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72fdcbd8-fc62-4bfd-ba8e-e529223915b2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:01.422296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72fdcbd8-fc62-4bfd-ba8e-e529223915b2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:01.426879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72fdcbd8-fc62-4bfd-ba8e-e529223915b2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:01.427707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72fdcbd8-fc62-4bfd-ba8e-e529223915b2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:01.428300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72fdcbd8-fc62-4bfd-ba8e-e529223915b2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:01.429151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72fdcbd8-fc62-4bfd-ba8e-e529223915b2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:01.461201 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] HTTP exception thrown: Instance da4a6784-df8b-47f7-9132-8ad0ab14cb59 could not be found. Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Request method failure captured: Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 HTTP/1.1 Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkrV_D9bp6urp78ucYOTrOZmbeQ_kkODzD3R8k_SARjktG_yNDClzW8LkUxMq0-mTrRxUh16uGI83EOuM4nEDERfw7OGPVnLsSXz2T-r0jcylVZvHG7-LZHPsHoMPm970n2t-5mUO_vhipeFsmb_sEipOxGYesM152NdfzY7u4s0wAE Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f5752431c874be58372449a6b71853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f5752431c874be58372449a6b71853c"}]}] Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: e302f037bf934b958cef21d6001e7562 Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance da4a6784-df8b-47f7-9132-8ad0ab14cb59 could not be found. Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'da4a6784-df8b-47f7-9132-8ad0ab14cb59'} Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4a6784-df8b-47f7-9132-8ad0ab14cb59 could not be found. Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4a6784-df8b-47f7-9132-8ad0ab14cb59 could not be found. Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:01.463291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:01.467356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:01.467356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:01.467356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:01.467356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:01.467356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:01.467356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4a6784-df8b-47f7-9132-8ad0ab14cb59 could not be found. Oct 27 09:14:01.467356 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:01.480473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Returning 404 to user: Instance da4a6784-df8b-47f7-9132-8ad0ab14cb59 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:01.485336 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37479f73-8695-4c89-9969-e4a113814462 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59" status: 404 len: 111 microversion: 2.1 time: 0.127210 Oct 27 09:14:01.490595 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1586/3221] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:01 2022] GET /compute/v2.1/servers/da4a6784-df8b-47f7-9132-8ad0ab14cb59 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:14:01.497442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:01.498059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:01.532967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:01.533611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:01.537280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:01.538297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:01.538928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:01.540972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:01.786025 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72fdcbd8-fc62-4bfd-ba8e-e529223915b2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.416710 Oct 27 09:14:01.786620 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1636/3222] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Oct 27 09:14:01 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f/os-interface => generated 1831 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:01.791355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a941b39b-e61e-4c5e-a2fe-d0764b5a3a34 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:01.881642 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a941b39b-e61e-4c5e-a2fe-d0764b5a3a34 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/37b68f63-d250-48d7-a615-354fb9948090" status: 204 len: 0 microversion: 2.1 time: 0.093617 Oct 27 09:14:01.886457 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1637/3223] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:14:01 2022] DELETE /compute/v2.1/os-server-groups/37b68f63-d250-48d7-a615-354fb9948090 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:14:01.892110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b75170b5-0328-4489-9158-a7c804522235 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa0e1280>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:01.952214 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b75170b5-0328-4489-9158-a7c804522235 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.063929 Oct 27 09:14:01.962021 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1638/3224] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:14:01 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:01.968023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:01.968918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:01.976598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:01.977436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:01.978028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:01.979078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:01.979754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:01.980383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:02.018138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:14:02.108373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:02.177848 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3be76d75-1d5d-4f5c-bebf-45bd62c5e920 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 204 len: 0 microversion: 2.1 time: 0.210193 Oct 27 09:14:02.184242 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1639/3225] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:14:01 2022] DELETE /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:14:02.197567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:02.198717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:02.207132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:02.207654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:02.208335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:02.209045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:02.209857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:02.210536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:02.245062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:14:02.276375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:02.286854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:02.288482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:02.299859 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e476e2e2-32e9-4dc6-b0ab-6bde6cdbb6ab tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1721 microversion: 2.20 time: 0.798091 Oct 27 09:14:02.301024 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1587/3226] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:01 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1721 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:02.365886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:02.366759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:02.386473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:02.386963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:02.387404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:02.388175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:02.388633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:02.389055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:02.390624 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16faacc6-9485-43d0-8406-4620913b676a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 204 len: 0 microversion: 2.1 time: 0.203232 Oct 27 09:14:02.400682 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1640/3227] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:14:02 2022] DELETE /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:14:02.443635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:02.454515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:02.478562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:02.480711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:02.481376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:02.483754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:02.484458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:02.487059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:02.627913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:02.651635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:02.653571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:02.665690 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ec8b2bbc-e62f-4154-8e85-eaaeee73f43d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1313 microversion: 2.26 time: 0.253813 Oct 27 09:14:02.667193 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1641/3228] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:02 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:02.673393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:02.674246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:02.683020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:02.683763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:02.684376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:02.686179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:02.689036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:02.690901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:02.822407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:02.873820 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a974bbf-5fa4-44ef-864e-289db4252af0 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 0.498909 Oct 27 09:14:02.876068 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1588/3229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:02 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:02.968801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-51d3cd5d-f7f3-42f2-aad7-1fedd509bd5f req-99bf4d5f-cafb-4019-b733-4b943350278a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "020e4660-afd9-40d7-b896-b745bcf182c7", "tag": "640fe564-e9b3-4251-a54d-7b1145ff3e73"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:03.002368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51d3cd5d-f7f3-42f2-aad7-1fedd509bd5f req-99bf4d5f-cafb-4019-b733-4b943350278a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:03.003025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51d3cd5d-f7f3-42f2-aad7-1fedd509bd5f req-99bf4d5f-cafb-4019-b733-4b943350278a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:03.003559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51d3cd5d-f7f3-42f2-aad7-1fedd509bd5f req-99bf4d5f-cafb-4019-b733-4b943350278a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:03.021324 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-51d3cd5d-f7f3-42f2-aad7-1fedd509bd5f req-99bf4d5f-cafb-4019-b733-4b943350278a service nova] Creating event network-changed:640fe564-e9b3-4251-a54d-7b1145ff3e73 for instance 020e4660-afd9-40d7-b896-b745bcf182c7 on n-h1-858383-16 Oct 27 09:14:03.032841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:03.034819 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-51d3cd5d-f7f3-42f2-aad7-1fedd509bd5f req-99bf4d5f-cafb-4019-b733-4b943350278a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070269 Oct 27 09:14:03.036253 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1589/3230] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:03.046627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8399e2f4-3b50-4046-9be2-2122d233e9eb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae5bd280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:03.047585 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-097714eb-10dc-4c14-84c0-b11d2ad4608c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 200 len: 1472 microversion: 2.1 time: 0.378592 Oct 27 09:14:03.048184 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1642/3231] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:02 2022] GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 1472 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:03.124505 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8399e2f4-3b50-4046-9be2-2122d233e9eb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.086256 Oct 27 09:14:03.126056 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1590/3232] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:14:03 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:03.333264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:03.333989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:03.349338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:03.349831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:03.350498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:03.351905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:03.352590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:03.355211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:03.622991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:03.644431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:03.648666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:03.657418 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-55502fc3-c68d-4712-a360-5db6dfb691b6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1721 microversion: 2.20 time: 0.328607 Oct 27 09:14:03.678555 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1643/3233] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:03 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1721 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:03.698282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:03.699017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:03.710326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:03.710826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:03.713888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:03.717288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:03.720106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:03.720688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:03.731877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f1def00e-475b-435b-beca-9007138795ef req-83b5c2a9-14c0-43e7-ba5e-1d9f1e49799f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "tag": "4757d336-0d53-4876-83cf-55f3b46f3a76"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:03.750311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f1def00e-475b-435b-beca-9007138795ef req-83b5c2a9-14c0-43e7-ba5e-1d9f1e49799f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:03.750974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f1def00e-475b-435b-beca-9007138795ef req-83b5c2a9-14c0-43e7-ba5e-1d9f1e49799f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:03.751911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f1def00e-475b-435b-beca-9007138795ef req-83b5c2a9-14c0-43e7-ba5e-1d9f1e49799f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:03.767874 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f1def00e-475b-435b-beca-9007138795ef req-83b5c2a9-14c0-43e7-ba5e-1d9f1e49799f service nova] Creating event network-changed:4757d336-0d53-4876-83cf-55f3b46f3a76 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:14:03.779262 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f1def00e-475b-435b-beca-9007138795ef req-83b5c2a9-14c0-43e7-ba5e-1d9f1e49799f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051640 Oct 27 09:14:03.785141 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1644/3234] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:14:03.903151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:03.904211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:03.920588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:03.928394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:03.929281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:03.930496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:03.931112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:03.931935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:04.006238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:04.032587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:04.038995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:04.049776 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d767e0b1-10c4-46f4-afd1-2e54223a577c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1313 microversion: 2.26 time: 0.352495 Oct 27 09:14:04.066954 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1591/3235] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:03 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:04.078653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:04.079667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:04.087375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:04.088145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:04.088785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:04.089700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:04.090344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:04.090931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:04.398068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:04.410952 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba5bb9ab-9166-40bd-8cb2-ca33b3355da7 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 0.510251 Oct 27 09:14:04.423594 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1645/3236] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:03 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:04.423594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb708508-9a35-4a82-9e28-d63b1d19f6da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9e16670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:04.512116 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb708508-9a35-4a82-9e28-d63b1d19f6da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.092900 Oct 27 09:14:04.512965 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1646/3237] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:14:04 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:04.521339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:04.521339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:04.525919 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1179db6-69ca-4fe5-91ab-2c90929352ea tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 200 len: 1472 microversion: 2.1 time: 0.453435 Oct 27 09:14:04.541000 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1592/3238] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:04 2022] GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 1472 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:04.693180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:04.693754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:04.708081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:04.711192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:04.711993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:04.712745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:04.713217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:04.723950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:04.987243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:05.000639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:05.002380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:05.003872 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a691ab8c-a012-4945-a0ca-1a2a62c3bb97 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1721 microversion: 2.20 time: 0.318144 Oct 27 09:14:05.004992 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1647/3239] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:04 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:05.081617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:05.082733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:05.099145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:05.100740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:05.101991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:05.104153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:05.105219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:05.107823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:05.224290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:05.250410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:05.252069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:05.254018 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf9702e9-8235-4f4c-8a24-306e47f44d29 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1313 microversion: 2.26 time: 0.177251 Oct 27 09:14:05.255308 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1593/3240] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:05 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:05.438880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:05.440019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:05.449929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:05.450540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:05.450999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:05.451974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:05.452466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:05.452900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:05.528595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df2d68c8-99f8-4cb8-a973-5310cd5c73b2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae4b5a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:05.599923 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df2d68c8-99f8-4cb8-a973-5310cd5c73b2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.075084 Oct 27 09:14:05.609375 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1594/3241] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:14:05 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:05.630976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:05.641804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:05.656755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:05.657274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:05.657766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:05.658492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:05.659604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:05.660192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:05.799292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:05.813808 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b024243-5819-49f6-84c0-67183b758fb4 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 0.379097 Oct 27 09:14:05.814435 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1648/3242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:05 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:05.926128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:05.943299 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-683a3f25-f12f-4ba0-b7b4-d9712f1c9c2c tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 200 len: 1472 microversion: 2.1 time: 0.332694 Oct 27 09:14:05.948005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1595/3243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:05 2022] GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:06.034260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:06.035198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:06.045713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:06.046939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:06.047392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:06.048144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:06.048781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:06.049384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:06.284141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:06.285560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:06.293314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:06.294083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:06.294690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:06.295642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:06.296330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:06.297357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:06.297727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:06.314692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:06.317098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:06.319981 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e0ede3e-aa52-4772-8047-e0fd312cd24d tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1721 microversion: 2.20 time: 0.288920 Oct 27 09:14:06.369155 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1649/3244] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:06 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:06.416792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:06.425911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:06.429473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:06.430828 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18a7b374-45bd-4be7-bab3-3843bd622bd9 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1313 microversion: 2.26 time: 0.152654 Oct 27 09:14:06.431884 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1596/3245] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:06 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:06.620786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61f07e17-1dd3-4827-9d17-e5d7ee09c7cb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9d728b0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:06.707690 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61f07e17-1dd3-4827-9d17-e5d7ee09c7cb tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.094580 Oct 27 09:14:06.708291 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1650/3246] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:14:06 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:06.846067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:06.846067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:06.855253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:06.855253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:06.855253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:06.856254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:06.856814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:06.857547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:06.967600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:06.969797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:06.980392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:06.981595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:06.983239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:06.984077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:06.984687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:06.985135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:07.466829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:07.475230 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c08a568e-e545-4022-8ca1-8eb8014cbabf tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 0.638515 Oct 27 09:14:07.486208 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1597/3247] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:06 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:07.491437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:07.496131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:07.506997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:07.508707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:07.509422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:07.512395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:07.514009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:07.514900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:07.559396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:07.569101 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-70d5820f-f691-4f25-ac77-13b44e65c073 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 200 len: 1472 microversion: 2.1 time: 0.605542 Oct 27 09:14:07.577077 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1651/3248] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:06 2022] GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 1472 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:07.582612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:07.586488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:07.601149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:07.602003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:07.602676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:07.603684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:07.604349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:07.606881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:07.766364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:07.785491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:07.790229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:07.794941 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6162b846-0bc5-4eea-8177-eaf461635aac tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1319 microversion: 2.26 time: 0.216575 Oct 27 09:14:07.796116 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1652/3249] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:07 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:07.803332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6663bb90-04fb-47d3-9086-e7d4770ed778 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9ca2ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:07.874557 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6663bb90-04fb-47d3-9086-e7d4770ed778 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1413 microversion: 2.1 time: 0.077046 Oct 27 09:14:07.875716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1653/3250] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:14:07 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:07.987196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:07.999455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:08.001070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:08.007173 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6da97cb5-b2f0-4a61-a622-52b40b1722d9 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1721 microversion: 2.20 time: 0.519460 Oct 27 09:14:08.007769 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1598/3251] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:07 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1721 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:08.214742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-76e11217-ebfa-4f9f-8620-052527f7a2fe req-b26d2846-deb0-42a3-875b-df9047f8b4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c547d73f-84e1-4055-b8a8-3b56bd9755d7", "name": "network-vif-deleted", "tag": "b743cb6c-e9f1-439e-83ac-944b05a76129"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:08.235972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-76e11217-ebfa-4f9f-8620-052527f7a2fe req-b26d2846-deb0-42a3-875b-df9047f8b4e3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:08.237383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-76e11217-ebfa-4f9f-8620-052527f7a2fe req-b26d2846-deb0-42a3-875b-df9047f8b4e3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:08.238129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-76e11217-ebfa-4f9f-8620-052527f7a2fe req-b26d2846-deb0-42a3-875b-df9047f8b4e3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:08.263233 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-76e11217-ebfa-4f9f-8620-052527f7a2fe req-b26d2846-deb0-42a3-875b-df9047f8b4e3 service nova] Creating event network-vif-deleted:b743cb6c-e9f1-439e-83ac-944b05a76129 for instance c547d73f-84e1-4055-b8a8-3b56bd9755d7 on n-h1-858383-16 Oct 27 09:14:08.272610 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-76e11217-ebfa-4f9f-8620-052527f7a2fe req-b26d2846-deb0-42a3-875b-df9047f8b4e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064089 Oct 27 09:14:08.274293 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1654/3252] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:08.428421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-21c0f4b2-4e57-4da6-835c-6092c1b5bbc7 req-3473363c-a9a0-4264-9b02-879d85e07025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc68a20-e621-4812-8f20-a5ababf275c2", "name": "network-vif-deleted", "tag": "0b4b967a-c461-4962-a258-a33bae542dc2"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:08.446340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-21c0f4b2-4e57-4da6-835c-6092c1b5bbc7 req-3473363c-a9a0-4264-9b02-879d85e07025 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:08.447148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-21c0f4b2-4e57-4da6-835c-6092c1b5bbc7 req-3473363c-a9a0-4264-9b02-879d85e07025 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:08.447840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-21c0f4b2-4e57-4da6-835c-6092c1b5bbc7 req-3473363c-a9a0-4264-9b02-879d85e07025 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:08.466457 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-21c0f4b2-4e57-4da6-835c-6092c1b5bbc7 req-3473363c-a9a0-4264-9b02-879d85e07025 service nova] Creating event network-vif-deleted:0b4b967a-c461-4962-a258-a33bae542dc2 for instance 6bc68a20-e621-4812-8f20-a5ababf275c2 on n-h1-858383-16 Oct 27 09:14:08.472675 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-21c0f4b2-4e57-4da6-835c-6092c1b5bbc7 req-3473363c-a9a0-4264-9b02-879d85e07025 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051232 Oct 27 09:14:08.476037 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1599/3253] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:08.513239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:08.514321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:08.557609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:08.564558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:08.569176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:08.574469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:08.575011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:08.575469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:08.601917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:08.603004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:08.616026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:08.620764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:08.621696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:08.622693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:08.623676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:08.624439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:08.692420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:08.698497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:08.699166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:08.700075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lazy-loading 'fault' on Instance uuid 6bc68a20-e621-4812-8f20-a5ababf275c2 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:09.139670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:09.155560 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ff43069-cc8e-4079-b3ef-c0d57c77bef3 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 200 len: 1307 microversion: 2.1 time: 0.558534 Oct 27 09:14:09.156722 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1600/3254] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:08 2022] GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 1307 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:09.172764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:09.173815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:09.191985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:09.192785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:09.193418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:09.195556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:09.196222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:09.198551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:09.414282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:09.437351 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2f44ead3-a67b-4064-b280-ba63ea335f29 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 0.930375 Oct 27 09:14:09.441229 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1655/3255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:08 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:09.448775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73e4d85d-d9fc-408b-8588-60677a732377 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9c90f70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:09.541606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:09.544540 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-73e4d85d-d9fc-408b-8588-60677a732377 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1422 microversion: 2.1 time: 0.089051 Oct 27 09:14:09.555017 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1656/3256] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:14:09 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:09.555256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:09.559345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:09.561177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:09.561918 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a160399e-c684-48ba-8a6d-abb3ed7ed91e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1361 microversion: 2.26 time: 0.400372 Oct 27 09:14:09.563601 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1601/3257] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:09 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:09.566332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:09.584313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8a1d3012-bdd2-4483-8b81-ef63a581c385 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa1f5310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:09.596294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:09.597288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:09.597999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:09.599020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:09.599792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:09.600662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:09.646120 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8a1d3012-bdd2-4483-8b81-ef63a581c385 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 200 len: 1422 microversion: 2.1 time: 0.081222 Oct 27 09:14:09.646997 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1602/3258] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:14:09 2022] GET /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:09.867252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:09.878406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:09.880263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:09.881628 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-68dfdb01-d6c8-4f05-a860-afe5944c5788 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1742 microversion: 2.20 time: 0.324992 Oct 27 09:14:09.882382 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1657/3259] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:09 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1742 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:09.907968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1598263778", "imageRef": "83707bc5-de1f-43fa-9252-085cd501d004", "flavorRef": "452", "networks": [{"uuid": "8aa86863-8c60-413b-9747-3e375f601520"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:09.968269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] validate_networks() for [('8aa86863-8c60-413b-9747-3e375f601520', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:14:10.185501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:10.186407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: 6bc68a20-e621-4812-8f20-a5ababf275c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:10.200685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.201396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.201999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.203425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.204064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.204653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.223193 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] HTTP exception thrown: Instance 6bc68a20-e621-4812-8f20-a5ababf275c2 could not be found. Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Request method failure captured: Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 HTTP/1.1 Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrV_D9bp6urp78ucYOTrOZmbeQ_kkODzD3R8k_SARjktG_yNDClzW8LkUxMq0-mTrRxUh16uGI83EOuM4nEDERfw7OGPVnLsSXz2T-r0jcylVZvHG7-LZHPsHoMPm970n2t-5mUO_vhipeFsmb_sEipOxGYesM152NdfzY7u4s0wAE Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f5752431c874be58372449a6b71853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f5752431c874be58372449a6b71853c"}]}] Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e302f037bf934b958cef21d6001e7562 Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 6bc68a20-e621-4812-8f20-a5ababf275c2 could not be found. Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '6bc68a20-e621-4812-8f20-a5ababf275c2'} Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc68a20-e621-4812-8f20-a5ababf275c2 could not be found. Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc68a20-e621-4812-8f20-a5ababf275c2 could not be found. Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:10.225345 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc68a20-e621-4812-8f20-a5ababf275c2 could not be found. Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Returning 404 to user: Instance 6bc68a20-e621-4812-8f20-a5ababf275c2 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7d5ae09-e96f-403c-88d0-660210d4bd3d tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2" status: 404 len: 111 microversion: 2.1 time: 0.045640 Oct 27 09:14:10.229763 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1658/3260] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:10 2022] GET /compute/v2.1/servers/6bc68a20-e621-4812-8f20-a5ababf275c2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:14:10.247124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:10.248608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: c547d73f-84e1-4055-b8a8-3b56bd9755d7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:10.257264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.257754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.258402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.259497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.260678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.261108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.280238 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] HTTP exception thrown: Instance c547d73f-84e1-4055-b8a8-3b56bd9755d7 could not be found. Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Request method failure captured: Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 HTTP/1.1 Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkrV_D9bp6urp78ucYOTrOZmbeQ_kkODzD3R8k_SARjktG_yNDClzW8LkUxMq0-mTrRxUh16uGI83EOuM4nEDERfw7OGPVnLsSXz2T-r0jcylVZvHG7-LZHPsHoMPm970n2t-5mUO_vhipeFsmb_sEipOxGYesM152NdfzY7u4s0wAE Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f5752431c874be58372449a6b71853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f5752431c874be58372449a6b71853c"}]}] Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e302f037bf934b958cef21d6001e7562 Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance c547d73f-84e1-4055-b8a8-3b56bd9755d7 could not be found. Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'c547d73f-84e1-4055-b8a8-3b56bd9755d7'} Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c547d73f-84e1-4055-b8a8-3b56bd9755d7 could not be found. Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c547d73f-84e1-4055-b8a8-3b56bd9755d7 could not be found. Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:10.282614 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.287732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:10.287732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:10.287732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:10.287732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:10.287732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:10.287732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c547d73f-84e1-4055-b8a8-3b56bd9755d7 could not be found. Oct 27 09:14:10.287732 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:10.287732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Returning 404 to user: Instance c547d73f-84e1-4055-b8a8-3b56bd9755d7 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:10.287732 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d868ddc1-3fad-4682-be25-77b4566f59cb tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7" status: 404 len: 111 microversion: 2.1 time: 0.051887 Oct 27 09:14:10.288612 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1659/3261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:10 2022] GET /compute/v2.1/servers/c547d73f-84e1-4055-b8a8-3b56bd9755d7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:14:10.293660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5cce3912-195c-49f1-95a0-107510374d1a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:10.339312 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5cce3912-195c-49f1-95a0-107510374d1a tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/2973b32d-aea0-4a97-8885-edd63a9034aa" status: 204 len: 0 microversion: 2.1 time: 0.049133 Oct 27 09:14:10.340445 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1660/3262] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:14:10 2022] DELETE /compute/v2.1/os-server-groups/2973b32d-aea0-4a97-8885-edd63a9034aa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:14:10.346825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c0f6baf1-6764-4605-952c-77ce526443b2 req-0c1390b0-facb-4e18-8d48-788eb5f46549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c407dfe-478d-486c-8250-adda5b1b6fdd", "tag": "04c78d72-4bf6-4c4e-8c7b-d63bd4032ae4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:10.353445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:10.361491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c0f6baf1-6764-4605-952c-77ce526443b2 req-0c1390b0-facb-4e18-8d48-788eb5f46549 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.362062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c0f6baf1-6764-4605-952c-77ce526443b2 req-0c1390b0-facb-4e18-8d48-788eb5f46549 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.362575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c0f6baf1-6764-4605-952c-77ce526443b2 req-0c1390b0-facb-4e18-8d48-788eb5f46549 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.375409 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c0f6baf1-6764-4605-952c-77ce526443b2 req-0c1390b0-facb-4e18-8d48-788eb5f46549 service nova] Creating event network-changed:04c78d72-4bf6-4c4e-8c7b-d63bd4032ae4 for instance 1c407dfe-478d-486c-8250-adda5b1b6fdd on n-h1-858383-16 Oct 27 09:14:10.380919 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c0f6baf1-6764-4605-952c-77ce526443b2 req-0c1390b0-facb-4e18-8d48-788eb5f46549 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038798 Oct 27 09:14:10.381970 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1661/3263] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:10.387806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:10.388437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:10.395197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.395898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.396345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.397065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.397526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.397953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.402564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:10.441133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:14:10.459172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:10.466906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:14:10.467334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:14:10.468308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:14:10.469285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:14:10.470260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:14:10.480698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.481308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.481862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.482570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.483071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.483502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.504703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:14:10.510516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for user e63dd72032ef4fe098382555888e3ae3 and project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:14:10.525035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:14:10.527824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='83707bc5-de1f-43fa-9252-085cd501d004',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:14:10.563830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:10.572613 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c03ecd3-7180-4c96-b016-23cb5a2563bc tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 204 len: 0 microversion: 2.1 time: 0.185474 Oct 27 09:14:10.573229 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1662/3264] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:14:10 2022] DELETE /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:14:10.580526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:10.581578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:10.588158 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63b0ed75-17a1-4ad4-ae10-703967fac88f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685254 Oct 27 09:14:10.588354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.588773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.589822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.591441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.592435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.593018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.596411 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1603/3265] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:14:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:14:10.606646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:10.607347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:10.619220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.620055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.620686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.621875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:10.622503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:10.623084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:10.963239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:10.973824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:10.974846 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1a190d03-4c38-4f03-985c-3977286a557b tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 0.399980 Oct 27 09:14:10.975670 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1663/3266] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:10 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:10.994319 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97dc8b21-1e6d-44f8-a1e0-2cf1a22d0b6b tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1472 microversion: 2.1 time: 0.396203 Oct 27 09:14:10.995142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:10.995357 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1604/3267] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:10 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:10.996055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:11.001143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbbd87d7-11ae-45a4-9826-2e6dd06d70e9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:11.001988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dbbd87d7-11ae-45a4-9826-2e6dd06d70e9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:11.003681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:11.004687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:11.005221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:11.006014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:11.006567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:11.007111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:11.109783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dbbd87d7-11ae-45a4-9826-2e6dd06d70e9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:11.118725 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbbd87d7-11ae-45a4-9826-2e6dd06d70e9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1208 microversion: 2.1 time: 0.122097 Oct 27 09:14:11.120021 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1605/3268] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:10 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1208 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:11.126832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8a9e097d-b741-429a-a032-8e06a2313773 req-35900586-f98e-4825-b39e-e7c0620593f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020e4660-afd9-40d7-b896-b745bcf182c7", "name": "network-vif-plugged", "status": "completed", "tag": "640fe564-e9b3-4251-a54d-7b1145ff3e73"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:11.137335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8a9e097d-b741-429a-a032-8e06a2313773 req-35900586-f98e-4825-b39e-e7c0620593f1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:11.138093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8a9e097d-b741-429a-a032-8e06a2313773 req-35900586-f98e-4825-b39e-e7c0620593f1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:11.138686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8a9e097d-b741-429a-a032-8e06a2313773 req-35900586-f98e-4825-b39e-e7c0620593f1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:11.150992 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8a9e097d-b741-429a-a032-8e06a2313773 req-35900586-f98e-4825-b39e-e7c0620593f1 service nova] Creating event network-vif-plugged:640fe564-e9b3-4251-a54d-7b1145ff3e73 for instance 020e4660-afd9-40d7-b896-b745bcf182c7 on n-h1-858383-16 Oct 27 09:14:11.156459 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8a9e097d-b741-429a-a032-8e06a2313773 req-35900586-f98e-4825-b39e-e7c0620593f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034716 Oct 27 09:14:11.157433 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1606/3269] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:11.164009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:11.164720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:11.171028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:11.171519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:11.172075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:11.172817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:11.173278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:11.173819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:11.314549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:11.325067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:11.326691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:11.328728 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8f24c34-2775-4b66-8f18-019e0d4c60e7 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1361 microversion: 2.26 time: 0.351462 Oct 27 09:14:11.329520 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1664/3270] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:10 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1361 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:11.363902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:11.372525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:11.374363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:11.376205 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6466cc3b-ff0f-4c78-b65d-6624a5371581 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1742 microversion: 2.20 time: 0.217362 Oct 27 09:14:11.376919 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1607/3271] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:11 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1742 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:12.000723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:12.001861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:12.005035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:12.025111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:12.026133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:12.044482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.045090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.045552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.046333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.049692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.053212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.054244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.055592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.056290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.057287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.057752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.058187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.356493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:12.364644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:12.365826 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e43493bf-9039-49e9-a07e-e55d18730c55 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1472 microversion: 2.1 time: 0.349017 Oct 27 09:14:12.369287 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1608/3272] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:12 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1472 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:12.375203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:12.375532 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c5c4746-32c7-4d03-8119-c4a2f1860567 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 0.381736 Oct 27 09:14:12.375876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:12.387592 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1665/3273] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:11 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:14:12.387947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.387947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.387947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.387947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.387947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.387947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.395626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:12.404946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:12.417589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.418016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.418525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.419214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.419694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.420122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.474078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:12.485492 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83a1528d-cbff-47fc-8bfe-e1447b7bac23 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1260 microversion: 2.1 time: 0.114231 Oct 27 09:14:12.486108 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1609/3274] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:12 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1260 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:12.496719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:12.498053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:12.508414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.510003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.511226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.512737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:12.514299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:12.514934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:12.678644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:12.693275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:12.702252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:12.707037 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3ac15727-30c8-4286-aeee-bc065049629a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1361 microversion: 2.26 time: 0.317876 Oct 27 09:14:12.708647 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1666/3275] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:12 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:12.858368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:12.873068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:12.875045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:12.877704 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c6d592c-330a-4454-871e-0adeb061acca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1742 microversion: 2.20 time: 0.389289 Oct 27 09:14:12.878449 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1610/3276] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:12 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1742 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:13.394494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:13.395799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:13.404186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:13.405416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:13.406520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:13.407443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:13.410085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:13.411226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:13.412340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:13.413067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:13.424922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:13.425426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:13.425867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:13.426586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:13.427047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:13.427481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:14.010916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:14.024206 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-90949b67-6f7f-48bd-9272-f6fc15f760be tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1472 microversion: 2.1 time: 0.637330 Oct 27 09:14:14.025163 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1667/3277] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:13 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1472 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:14.034255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:14.035088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:14.049238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:14.049743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:14.050187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:14.050896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:14.051353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:14.051813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:14.142310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:14.158965 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e3b086b-b312-4dee-ac41-998c56dde498 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1324 microversion: 2.1 time: 0.758470 Oct 27 09:14:14.163897 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1611/3278] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:13 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1324 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:14.178111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f6f9b7e4-9c0d-4c59-b47d-26aee34c9383 req-6911338a-319d-44f4-942f-58c04b52f187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f468cf4-43cf-4bba-bfcb-0f725bf735e3", "name": "network-vif-plugged", "status": "completed", "tag": "e537d4a4-12d3-46d5-b30a-f4aa9120f51e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:14.209208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f6f9b7e4-9c0d-4c59-b47d-26aee34c9383 req-6911338a-319d-44f4-942f-58c04b52f187 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:14.213365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f6f9b7e4-9c0d-4c59-b47d-26aee34c9383 req-6911338a-319d-44f4-942f-58c04b52f187 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:14.214909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f6f9b7e4-9c0d-4c59-b47d-26aee34c9383 req-6911338a-319d-44f4-942f-58c04b52f187 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:14.245017 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f6f9b7e4-9c0d-4c59-b47d-26aee34c9383 req-6911338a-319d-44f4-942f-58c04b52f187 service nova] Creating event network-vif-plugged:e537d4a4-12d3-46d5-b30a-f4aa9120f51e for instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 on n-h2-858383-16 Oct 27 09:14:14.253206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:14.262788 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f6f9b7e4-9c0d-4c59-b47d-26aee34c9383 req-6911338a-319d-44f4-942f-58c04b52f187 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097486 Oct 27 09:14:14.266082 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1612/3279] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:14.273041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:14.273551 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1f36c7e-6d71-4d2d-ba05-83921df6ff0d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1266 microversion: 2.1 time: 0.247104 Oct 27 09:14:14.274281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1668/3280] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:14 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:14.299866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:14.300612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:14.304138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:14.318452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:14.319730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:14.320348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:14.334532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:14.335605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:14.336220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:14.341067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:14.341575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:14.345278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:14.346240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:14.348190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:14.348807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:14.807140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:14.821826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:14.824050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:14.826188 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b8b65c0-07c8-440d-ad9e-179a3ace84ba tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1361 microversion: 2.26 time: 0.558680 Oct 27 09:14:14.826938 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1613/3281] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:14 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1361 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:14.855920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-622dc42f-c16a-459d-896f-c7c44d5e93f9 req-29abc209-a113-4fb6-89fc-41467f21499d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27033c1-2e3e-441a-99b0-4038d19ec1ee", "name": "network-vif-deleted", "tag": "c0234ad9-452a-427c-adc9-6a1769a3da75"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:14.883196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-622dc42f-c16a-459d-896f-c7c44d5e93f9 req-29abc209-a113-4fb6-89fc-41467f21499d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:14.884171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-622dc42f-c16a-459d-896f-c7c44d5e93f9 req-29abc209-a113-4fb6-89fc-41467f21499d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:14.885905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-622dc42f-c16a-459d-896f-c7c44d5e93f9 req-29abc209-a113-4fb6-89fc-41467f21499d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:14.894294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:14.906706 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-622dc42f-c16a-459d-896f-c7c44d5e93f9 req-29abc209-a113-4fb6-89fc-41467f21499d service nova] Creating event network-vif-deleted:c0234ad9-452a-427c-adc9-6a1769a3da75 for instance b27033c1-2e3e-441a-99b0-4038d19ec1ee on n-h2-858383-16 Oct 27 09:14:14.907924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:14.909614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:14.915235 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-622dc42f-c16a-459d-896f-c7c44d5e93f9 req-29abc209-a113-4fb6-89fc-41467f21499d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086463 Oct 27 09:14:14.916704 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1614/3282] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:14.927172 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-29980387-8d8e-4235-9570-82f087306b7a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1742 microversion: 2.20 time: 0.648695 Oct 27 09:14:14.949099 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1669/3283] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:14 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1742 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:15.062871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:15.066289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:15.100378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:15.104071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:15.104991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:15.107329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:15.110444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:15.111483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:15.187191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:15.198061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:15.198688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:15.211768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:15.212941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:15.214596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:15.219090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:15.220411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:15.221042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:15.238627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:15.241180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:15.242525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:15.243963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lazy-loading 'fault' on Instance uuid b27033c1-2e3e-441a-99b0-4038d19ec1ee {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:15.345543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:15.369635 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1839d427-c738-4283-b064-291f4ed3cf96 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1306 microversion: 2.1 time: 0.318635 Oct 27 09:14:15.374147 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1615/3284] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:15 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1306 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:15.386679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd703ffb-a56f-4015-9977-488debc781d4 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96be7308-9e78-452b-9eda-a9af64eae8a5"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:15.395064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cd703ffb-a56f-4015-9977-488debc781d4 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:15.406992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd703ffb-a56f-4015-9977-488debc781d4 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:15.409280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd703ffb-a56f-4015-9977-488debc781d4 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:15.409981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd703ffb-a56f-4015-9977-488debc781d4 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:15.410914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd703ffb-a56f-4015-9977-488debc781d4 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:15.411857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd703ffb-a56f-4015-9977-488debc781d4 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:15.412468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd703ffb-a56f-4015-9977-488debc781d4 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:15.774377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:15.799666 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c3a9d13-fcab-4f50-a3d6-2e3ab3b4fa33 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1522 microversion: 2.1 time: 0.605504 Oct 27 09:14:15.841226 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1670/3285] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:15 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1522 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:15.855679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:15.867363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:15.887511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:15.888719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:15.889921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:15.891880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:15.903370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:15.904886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.041225 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd703ffb-a56f-4015-9977-488debc781d4 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "POST /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.656197 Oct 27 09:14:16.042573 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1616/3286] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:14:15 2022] POST /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:16.066992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:16.068600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:16.079382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.080728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.081385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.082799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.083182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.083943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.160277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] HTTP exception thrown: Action 999 not found Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Request method failure captured: Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7/os-instance-actions/999 HTTP/1.1 Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkvHv5T6FgpxsZ7y5opGLbjQUk1YjrnW8p3tMTNV2hZPHK1ywHU2qK-hyuO71OjYg1oGXMXr7I0-jSlR2F6zmoTQFn8JVgy6XTxQz0I12wi3XUGDPYzjt0rDovu4V6vWfjUXzoO2uCx-f94ZdKp7LgVD5w9pu2_iauJ6Zj_kPK9JCZk Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6d4749452cdb43de9f6b0ad5db5822bb Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-211231894 Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d4749452cdb43de9f6b0ad5db5822bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6d4749452cdb43de9f6b0ad5db5822bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d4749452cdb43de9f6b0ad5db5822bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6d4749452cdb43de9f6b0ad5db5822bb"}]}] Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-211231894 Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6d4749452cdb43de9f6b0ad5db5822bb Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-211231894 Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-InstanceActionsNegativeTestJSON-211231894-project Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 1474887555fd46f2817f0543ab5f522b Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-211231894-project Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: exception: Action 999 not found Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': '020e4660-afd9-40d7-b896-b745bcf182c7', 'id': '999'} Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 27 09:14:16.166776 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:16.171024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Returning 404 to user: Action 999 not found {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:16.171024 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50f555d6-3338-47ec-b0a5-62476a107c31 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.115354 Oct 27 09:14:16.171024 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1617/3287] 10.222.0.25 () {58 vars in 1308 bytes} [Thu Oct 27 09:14:16 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7/os-instance-actions/999 => generated 66 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:14:16.179381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:16.181588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:16.196592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.197094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.197545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.198261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.198719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.199142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.358503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:16.370861 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b6876e22-f777-4b54-91c7-7d52f02d4dd9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.524580 Oct 27 09:14:16.372900 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1671/3288] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:15 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:16.383798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:16.385490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:16.387611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:UPDATE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:16.400775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.403250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.403792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.404521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.407333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.407891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.782887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:16.814494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:16.820241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:16.823055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:16.826112 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-520f6aeb-8284-464c-b383-987f81f3fbf4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1361 microversion: 2.26 time: 0.655446 Oct 27 09:14:16.829273 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1618/3289] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:16 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1361 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:16.833497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:16.836254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cc4b8b5-75a7-4569-b742-4b3bdcd131f5 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '.version_select at 0x7f31a99c98b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:16.836987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7cc4b8b5-75a7-4569-b742-4b3bdcd131f5 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 1a44a876-05f2-4b60-b45e-8aeeedca168c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:16.839060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:16.844487 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0305cafa-da4e-4ebe-8957-5eb7690e58cf tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1742 microversion: 2.20 time: 0.469951 Oct 27 09:14:16.845208 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1672/3290] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:16 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1742 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:16.846595 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7cc4b8b5-75a7-4569-b742-4b3bdcd131f5 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] HTTP exception thrown: Instance 1a44a876-05f2-4b60-b45e-8aeeedca168c could not be found. Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cc4b8b5-75a7-4569-b742-4b3bdcd131f5 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Request method failure captured: Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/1a44a876-05f2-4b60-b45e-8aeeedca168c/os-instance-actions HTTP/1.1 Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkvHv5T6FgpxsZ7y5opGLbjQUk1YjrnW8p3tMTNV2hZPHK1ywHU2qK-hyuO71OjYg1oGXMXr7I0-jSlR2F6zmoTQFn8JVgy6XTxQz0I12wi3XUGDPYzjt0rDovu4V6vWfjUXzoO2uCx-f94ZdKp7LgVD5w9pu2_iauJ6Zj_kPK9JCZk Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6d4749452cdb43de9f6b0ad5db5822bb Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-211231894 Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d4749452cdb43de9f6b0ad5db5822bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6d4749452cdb43de9f6b0ad5db5822bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d4749452cdb43de9f6b0ad5db5822bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6d4749452cdb43de9f6b0ad5db5822bb"}]}] Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-211231894 Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6d4749452cdb43de9f6b0ad5db5822bb Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-211231894 Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-InstanceActionsNegativeTestJSON-211231894-project Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 1474887555fd46f2817f0543ab5f522b Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-211231894-project Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 1a44a876-05f2-4b60-b45e-8aeeedca168c could not be found. Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': '1a44a876-05f2-4b60-b45e-8aeeedca168c'} Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a44a876-05f2-4b60-b45e-8aeeedca168c could not be found. Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:14:16.848878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a44a876-05f2-4b60-b45e-8aeeedca168c could not be found. Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a44a876-05f2-4b60-b45e-8aeeedca168c could not be found. Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:16.853482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cc4b8b5-75a7-4569-b742-4b3bdcd131f5 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Returning 404 to user: Instance 1a44a876-05f2-4b60-b45e-8aeeedca168c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:16.857441 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7cc4b8b5-75a7-4569-b742-4b3bdcd131f5 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/1a44a876-05f2-4b60-b45e-8aeeedca168c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.025642 Oct 27 09:14:16.858020 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1619/3291] 10.222.0.25 () {58 vars in 1296 bytes} [Thu Oct 27 09:14:16 2022] GET /compute/v2.1/servers/1a44a876-05f2-4b60-b45e-8aeeedca168c/os-instance-actions => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:14:16.871830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:16.873257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:16.877452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-4256016d-9d5e-461c-9983-1f1af4e78cc4 req-0f3900a8-45cb-41d7-a14e-3f307dc42d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119dcc89-5176-4b9f-b784-cba0bb8c1444", "name": "network-vif-unplugged", "status": "completed", "tag": "41e4ebd1-dbca-4093-be4e-10f1ad3b6519"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:16.895977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.896775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.897237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.901569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.902073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.902521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.918016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4256016d-9d5e-461c-9983-1f1af4e78cc4 req-0f3900a8-45cb-41d7-a14e-3f307dc42d27 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.919728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4256016d-9d5e-461c-9983-1f1af4e78cc4 req-0f3900a8-45cb-41d7-a14e-3f307dc42d27 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.920292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4256016d-9d5e-461c-9983-1f1af4e78cc4 req-0f3900a8-45cb-41d7-a14e-3f307dc42d27 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.946143 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-4256016d-9d5e-461c-9983-1f1af4e78cc4 req-0f3900a8-45cb-41d7-a14e-3f307dc42d27 service nova] Creating event network-vif-unplugged:41e4ebd1-dbca-4093-be4e-10f1ad3b6519 for instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 on n-h2-858383-16 Oct 27 09:14:16.962334 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-4256016d-9d5e-461c-9983-1f1af4e78cc4 req-0f3900a8-45cb-41d7-a14e-3f307dc42d27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115520 Oct 27 09:14:16.964230 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1673/3292] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:16.972418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:16.976146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:16.979499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.980136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.980785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.981315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lazy-loading 'fault' on Instance uuid b27033c1-2e3e-441a-99b0-4038d19ec1ee {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:16.987411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.991421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.992225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:16.993208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:16.993884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:16.994531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:17.035306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:14:17.136316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:17.169335 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67dafcc5-74a0-4ef1-b657-f006aa344397 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1306 microversion: 2.1 time: 0.287367 Oct 27 09:14:17.174524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1620/3293] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:16 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1306 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:17.199036 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-95591895-fd85-4af5-890d-a3209258216e tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "DELETE /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 204 len: 0 microversion: 2.1 time: 0.232577 Oct 27 09:14:17.201082 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1674/3294] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:14:16 2022] DELETE /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:14:17.210057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:17.210927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:17.229011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:17.229545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:17.230002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:17.238119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:17.238634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:17.239149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:17.406172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:17.406897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:17.419776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:17.436245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:17.436883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:17.438521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:17.439856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:17.460451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:17.580427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:17.590378 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7cd8614-0ce0-4d31-b0d4-db266cef9244 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1528 microversion: 2.1 time: 0.384067 Oct 27 09:14:17.626859 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1621/3295] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:17 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1528 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:17.858648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:17.860781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:17.874733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:17.876176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:17.877247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:17.881524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:17.882302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:17.883201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:17.884424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:17.895761 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b407614-4cdc-4084-9e6b-2959824c47a0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.498587 Oct 27 09:14:17.898285 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1675/3296] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:17 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:17.912872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:17.914506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:17.928977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:17.931680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:17.933225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:17.934869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:17.936134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:17.938136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:18.363356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:18.382478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:18.386754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:18.393133 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1286de22-a4e4-4237-903e-18bbf009bcb1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1361 microversion: 2.26 time: 0.538842 Oct 27 09:14:18.394338 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1622/3297] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:17 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1361 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:18.400167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:18.418616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:18.426817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:18.428344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:18.429581 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3a91f1c6-17bd-4f7e-87a8-e1ea30f9b593 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 0.529230 Oct 27 09:14:18.430145 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1676/3298] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:17 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:18.431034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:18.457615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:18.458134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:18.458663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:18.459368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:18.459848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:18.460271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:18.587457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:18.594122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:18.595256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:18.596292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lazy-loading 'fault' on Instance uuid b27033c1-2e3e-441a-99b0-4038d19ec1ee {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:18.650349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:18.656773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:18.675889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:18.676711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:18.677466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:18.678943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:18.679511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:18.688696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:18.696804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:18.708840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e302f037bf934b958cef21d6001e7562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5752431c874be58372449a6b71853c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:18.721139 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4895845d-8e0b-45bf-a3ef-58defc2b96ef tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 200 len: 1306 microversion: 2.1 time: 0.325347 Oct 27 09:14:18.735654 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1623/3299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:18 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 1306 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:18.932985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:18.933567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:18.948140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:18.955948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:18.956781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:18.959283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:18.960214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:18.962395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:19.267093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:19.279520 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d918e043-dea5-4262-bfc6-8a6a086ef0fa tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1528 microversion: 2.1 time: 0.641391 Oct 27 09:14:19.280584 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1677/3300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:18 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1528 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:19.304811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-9f2ed333-e666-41d5-a50d-c6cec866b016 req-563db660-7281-4fdb-a337-fe4ddaa2a640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c407dfe-478d-486c-8250-adda5b1b6fdd", "name": "network-vif-plugged", "status": "completed", "tag": "04c78d72-4bf6-4c4e-8c7b-d63bd4032ae4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:19.364168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9f2ed333-e666-41d5-a50d-c6cec866b016 req-563db660-7281-4fdb-a337-fe4ddaa2a640 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:19.368807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9f2ed333-e666-41d5-a50d-c6cec866b016 req-563db660-7281-4fdb-a337-fe4ddaa2a640 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:19.371765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9f2ed333-e666-41d5-a50d-c6cec866b016 req-563db660-7281-4fdb-a337-fe4ddaa2a640 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:19.421336 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-9f2ed333-e666-41d5-a50d-c6cec866b016 req-563db660-7281-4fdb-a337-fe4ddaa2a640 service nova] Creating event network-vif-plugged:04c78d72-4bf6-4c4e-8c7b-d63bd4032ae4 for instance 1c407dfe-478d-486c-8250-adda5b1b6fdd on n-h1-858383-16 Oct 27 09:14:19.448242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-9f2ed333-e666-41d5-a50d-c6cec866b016 req-563db660-7281-4fdb-a337-fe4ddaa2a640 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163441 Oct 27 09:14:19.450857 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1678/3301] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:19.497837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:19.515006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:19.515990 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6ddbb51-50af-4d59-9bd3-e8d9162f4ff3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.597373 Oct 27 09:14:19.520112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:19.525357 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1624/3302] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:18 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:19.548738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:19.550504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:19.551116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:19.553360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:19.556258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:19.563150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:19.568811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:19.569330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:19.589694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:19.595515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:19.596072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:19.616812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:19.618475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:19.621655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:20.494761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:20.636710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:20.667284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:20.672876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:20.681352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:20.687784 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2efdcace-08d0-4766-9348-f1ac8efeed70 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 1.147720 Oct 27 09:14:20.693747 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1625/3303] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:19 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:20.704470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:20.711208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:20.714110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:20.718013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] [instance: b27033c1-2e3e-441a-99b0-4038d19ec1ee] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:20.718614 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f1b50b85-7f5f-4e5e-9ea2-96147540689d tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1361 microversion: 2.26 time: 1.244083 Oct 27 09:14:20.722311 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1679/3304] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:19 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1361 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:20.745759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:20.746356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:20.747146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:20.747825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:20.748935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:20.750310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:20.754393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:20.755845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:20.769032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:20.770492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:20.773037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:20.774783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:20.776760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:20.777468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:20.816622 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] HTTP exception thrown: Instance b27033c1-2e3e-441a-99b0-4038d19ec1ee could not be found. Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Request method failure captured: Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee HTTP/1.1 Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkrV_D9bp6urp78ucYOTrOZmbeQ_kkODzD3R8k_SARjktG_yNDClzW8LkUxMq0-mTrRxUh16uGI83EOuM4nEDERfw7OGPVnLsSXz2T-r0jcylVZvHG7-LZHPsHoMPm970n2t-5mUO_vhipeFsmb_sEipOxGYesM152NdfzY7u4s0wAE Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f5752431c874be58372449a6b71853c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f5752431c874be58372449a6b71853c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f5752431c874be58372449a6b71853c"}]}] Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 5f5752431c874be58372449a6b71853c Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850019270 Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: e302f037bf934b958cef21d6001e7562 Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersOnMultiNodesTest-1850019270-project Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance b27033c1-2e3e-441a-99b0-4038d19ec1ee could not be found. Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'b27033c1-2e3e-441a-99b0-4038d19ec1ee'} Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27033c1-2e3e-441a-99b0-4038d19ec1ee could not be found. Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27033c1-2e3e-441a-99b0-4038d19ec1ee could not be found. Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:20.818200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:20.823844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:20.823844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:20.823844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:20.823844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:20.823844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:20.823844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27033c1-2e3e-441a-99b0-4038d19ec1ee could not be found. Oct 27 09:14:20.823844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:20.831458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] Returning 404 to user: Instance b27033c1-2e3e-441a-99b0-4038d19ec1ee could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:20.832380 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6019d1e1-ac2a-41f6-9e39-be4418636715 tempest-ServersOnMultiNodesTest-1850019270 tempest-ServersOnMultiNodesTest-1850019270-project] 10.222.0.25 "GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee" status: 404 len: 111 microversion: 2.1 time: 0.136747 Oct 27 09:14:20.834080 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1626/3305] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:20 2022] GET /compute/v2.1/servers/b27033c1-2e3e-441a-99b0-4038d19ec1ee => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:14:20.851464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:20.852127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:20.890488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:20.890993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:20.891435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:20.902367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:20.902850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:20.906341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:20.983003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1474887555fd46f2817f0543ab5f522b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4749452cdb43de9f6b0ad5db5822bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:21.004910 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-388da59a-860c-4e54-a1e1-2f29f5ffc50c tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 200 len: 1486 microversion: 2.1 time: 0.278731 Oct 27 09:14:21.029065 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1680/3306] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:20 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 1486 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:21.040698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-32c65b47-d6e7-4a50-a557-379882ebf516 req-cdff3b66-8e05-4b10-8f5c-74b9a98173ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020e4660-afd9-40d7-b896-b745bcf182c7", "name": "network-vif-deleted", "tag": "640fe564-e9b3-4251-a54d-7b1145ff3e73"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:21.075617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-32c65b47-d6e7-4a50-a557-379882ebf516 req-cdff3b66-8e05-4b10-8f5c-74b9a98173ba service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:21.076909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-32c65b47-d6e7-4a50-a557-379882ebf516 req-cdff3b66-8e05-4b10-8f5c-74b9a98173ba service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:21.077426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-32c65b47-d6e7-4a50-a557-379882ebf516 req-cdff3b66-8e05-4b10-8f5c-74b9a98173ba service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:21.114074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:21.142337 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-32c65b47-d6e7-4a50-a557-379882ebf516 req-cdff3b66-8e05-4b10-8f5c-74b9a98173ba service nova] Creating event network-vif-deleted:640fe564-e9b3-4251-a54d-7b1145ff3e73 for instance 020e4660-afd9-40d7-b896-b745bcf182c7 on n-h1-858383-16 Oct 27 09:14:21.169872 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-32c65b47-d6e7-4a50-a557-379882ebf516 req-cdff3b66-8e05-4b10-8f5c-74b9a98173ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141866 Oct 27 09:14:21.175240 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1681/3307] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:21.505484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:21.570739 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c8c429d-4bfb-409c-8324-92d2d134a182 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.708267 Oct 27 09:14:21.573937 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1627/3308] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:20 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:21.724916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:21.726878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:21.757598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:21.758120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:21.759982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:21.760700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:21.761047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:21.763343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:21.769889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:21.772417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:21.790661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:21.800255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:21.801583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:21.802350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:21.808365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:21.809224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:22.677251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:22.694952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:22.705383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:22.739538 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b1911cbe-2ecb-478d-aed9-e73136759deb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 0.988222 Oct 27 09:14:22.742757 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1682/3309] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:21 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:22.760827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:22.774965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] [instance: 020e4660-afd9-40d7-b896-b745bcf182c7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:22.816680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:22.817196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:22.817642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:22.818375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:22.818831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:22.819256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:22.874311 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] HTTP exception thrown: Instance 020e4660-afd9-40d7-b896-b745bcf182c7 could not be found. Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Request method failure captured: Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 HTTP/1.1 Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkvHv5T6FgpxsZ7y5opGLbjQUk1YjrnW8p3tMTNV2hZPHK1ywHU2qK-hyuO71OjYg1oGXMXr7I0-jSlR2F6zmoTQFn8JVgy6XTxQz0I12wi3XUGDPYzjt0rDovu4V6vWfjUXzoO2uCx-f94ZdKp7LgVD5w9pu2_iauJ6Zj_kPK9JCZk Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6d4749452cdb43de9f6b0ad5db5822bb Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-211231894 Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d4749452cdb43de9f6b0ad5db5822bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6d4749452cdb43de9f6b0ad5db5822bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d4749452cdb43de9f6b0ad5db5822bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6d4749452cdb43de9f6b0ad5db5822bb"}]}] Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-211231894 Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6d4749452cdb43de9f6b0ad5db5822bb Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-211231894 Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-InstanceActionsNegativeTestJSON-211231894-project Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 1474887555fd46f2817f0543ab5f522b Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-211231894-project Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 020e4660-afd9-40d7-b896-b745bcf182c7 could not be found. Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '020e4660-afd9-40d7-b896-b745bcf182c7'} Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 020e4660-afd9-40d7-b896-b745bcf182c7 could not be found. Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 020e4660-afd9-40d7-b896-b745bcf182c7 could not be found. Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:22.879788 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:22.885502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:22.885502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:22.885502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:22.885502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:22.885502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:22.885502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:22.885502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 020e4660-afd9-40d7-b896-b745bcf182c7 could not be found. Oct 27 09:14:22.885502 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:14:22.889916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] Returning 404 to user: Instance 020e4660-afd9-40d7-b896-b745bcf182c7 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:22.892093 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b4640c90-37cc-431d-9c3a-1769998fb4c6 tempest-InstanceActionsNegativeTestJSON-211231894 tempest-InstanceActionsNegativeTestJSON-211231894-project] 10.222.0.25 "GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7" status: 404 len: 111 microversion: 2.1 time: 0.148610 Oct 27 09:14:22.895445 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1683/3310] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:22 2022] GET /compute/v2.1/servers/020e4660-afd9-40d7-b896-b745bcf182c7 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:14:22.912018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:22.912963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:22.923874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:22.929397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:22.931898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:22.933130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:22.938423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:22.940626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:22.945243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:22.955292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:22.970616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:22.971941 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70a42cea-1dad-4e14-8e9c-195702cf762f tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1545 microversion: 2.26 time: 1.224064 Oct 27 09:14:22.972585 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1628/3311] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:21 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1545 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:23.002157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31ae4b5dc0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:23.024847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.025720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.026852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.028183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:23.035538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.036436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.037185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.039684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.040960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.041600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.099499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.103395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.108438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.175662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.197972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.198439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.280493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:23.297212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:23.392730 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-17c5ac35-8220-45a8-8677-0b25daee13fb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-588680721" status: 201 len: 0 microversion: 2.26 time: 0.391888 Oct 27 09:14:23.394278 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1629/3312] 10.222.0.25 () {62 vars in 1377 bytes} [Thu Oct 27 09:14:22 2022] PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-588680721 => generated 0 bytes in 399 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 27 09:14:23.405394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c725ebcf-3d68-4177-913a-ef56884a88c4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31ae532c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:23.428910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c725ebcf-3d68-4177-913a-ef56884a88c4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.444841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c725ebcf-3d68-4177-913a-ef56884a88c4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.445667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c725ebcf-3d68-4177-913a-ef56884a88c4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.496062 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c725ebcf-3d68-4177-913a-ef56884a88c4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-588680721" status: 204 len: 0 microversion: 2.26 time: 0.095154 Oct 27 09:14:23.498656 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1630/3313] 10.222.0.25 () {60 vars in 1358 bytes} [Thu Oct 27 09:14:23 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-588680721 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 09:14:23.512089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5ea8af66-d9fb-4c4a-9fce-d721d7a3a615 req-13e0df51-5923-4ff4-bd4f-a9490c500759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8dbd143-6100-4d9c-87e5-b0df7b176859", "tag": "0f571485-82e1-4e1d-9f24-667ffcc013aa"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:23.548317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5ea8af66-d9fb-4c4a-9fce-d721d7a3a615 req-13e0df51-5923-4ff4-bd4f-a9490c500759 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.550711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5ea8af66-d9fb-4c4a-9fce-d721d7a3a615 req-13e0df51-5923-4ff4-bd4f-a9490c500759 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.557253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5ea8af66-d9fb-4c4a-9fce-d721d7a3a615 req-13e0df51-5923-4ff4-bd4f-a9490c500759 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.584939 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5ea8af66-d9fb-4c4a-9fce-d721d7a3a615 req-13e0df51-5923-4ff4-bd4f-a9490c500759 service nova] Creating event network-changed:0f571485-82e1-4e1d-9f24-667ffcc013aa for instance f8dbd143-6100-4d9c-87e5-b0df7b176859 on n-h2-858383-16 Oct 27 09:14:23.612589 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5ea8af66-d9fb-4c4a-9fce-d721d7a3a615 req-13e0df51-5923-4ff4-bd4f-a9490c500759 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110350 Oct 27 09:14:23.615838 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1631/3314] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:23.633132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31a9254a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:23.663291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.674188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.675020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.676956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:23.693958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.701968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:23.703649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.706124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.707202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.708140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.711204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.720398 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7e28d3e7-d176-4577-b137-ba3c71e1e18b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.822970 Oct 27 09:14:23.725967 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1684/3315] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:22 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:23.770031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:23.771039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:23.777804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.786006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.787653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.812716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.813248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.817589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.821325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.823375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.825512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.829480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:23.884094 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83e9b8d9-6dd9-4f0a-bb1f-463e6f694357 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 204 len: 0 microversion: 2.26 time: 0.248971 Oct 27 09:14:23.884897 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1632/3316] 10.222.0.25 () {60 vars in 1295 bytes} [Thu Oct 27 09:14:23 2022] DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:14:23.898201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f640f62f-07dc-4a3b-abd3-6cb66550c56a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31a97a49d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:23.923625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f640f62f-07dc-4a3b-abd3-6cb66550c56a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:23.941006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f640f62f-07dc-4a3b-abd3-6cb66550c56a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:23.942662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f640f62f-07dc-4a3b-abd3-6cb66550c56a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:23.975616 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f640f62f-07dc-4a3b-abd3-6cb66550c56a tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 200 len: 12 microversion: 2.26 time: 0.082271 Oct 27 09:14:23.985609 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1633/3317] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Oct 27 09:14:23 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 12 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:14:23.994489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31a92541f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:24.031187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.033881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.034576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.035379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:24.054682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.055529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.056241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.057205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.057907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.061333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.161337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.163049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.167048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.182999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.185915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.187513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.260719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:24.297657 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70d73211-7ef7-4f5c-9abe-ca84869edc7b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-1832134721" status: 201 len: 0 microversion: 2.26 time: 0.307045 Oct 27 09:14:24.298970 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1634/3318] 10.222.0.25 () {62 vars in 1380 bytes} [Thu Oct 27 09:14:23 2022] PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-1832134721 => generated 0 bytes in 309 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 27 09:14:24.317890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40ed6f5b-2afa-4de3-8867-9a857842b9e8 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31a9254c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:24.337947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40ed6f5b-2afa-4de3-8867-9a857842b9e8 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.344481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40ed6f5b-2afa-4de3-8867-9a857842b9e8 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.345310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40ed6f5b-2afa-4de3-8867-9a857842b9e8 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.362790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:24.367832 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40ed6f5b-2afa-4de3-8867-9a857842b9e8 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 200 len: 36 microversion: 2.26 time: 0.062053 Oct 27 09:14:24.368826 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1635/3319] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Oct 27 09:14:24 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 36 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:24.379174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:24.380304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31a9254430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:24.382433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:24.383949 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b00ef26-88d9-4220-af64-0b791b64060e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 0.619223 Oct 27 09:14:24.385046 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1685/3320] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:23 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:24.399998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.400891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.401561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.402296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:24.418928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.419826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.420457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.421406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.422944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.424983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.509976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.510489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.510933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.577127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:24.600507 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99722a6e-b69b-49ae-ac1a-fc534a4b40f4 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-1832134721" status: 204 len: 0 microversion: 2.26 time: 0.224987 Oct 27 09:14:24.611207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-96a5904f-0f61-4c68-bd3d-fd5e0685c8c1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31aa535af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:24.617198 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1636/3321] 10.222.0.25 () {60 vars in 1364 bytes} [Thu Oct 27 09:14:24 2022] DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-1832134721 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 09:14:24.621605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96a5904f-0f61-4c68-bd3d-fd5e0685c8c1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.622261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96a5904f-0f61-4c68-bd3d-fd5e0685c8c1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.622818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96a5904f-0f61-4c68-bd3d-fd5e0685c8c1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.643481 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-96a5904f-0f61-4c68-bd3d-fd5e0685c8c1 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 200 len: 12 microversion: 2.26 time: 0.036920 Oct 27 09:14:24.655547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31ae5328b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:24.659115 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1686/3322] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Oct 27 09:14:24 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 12 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:24.675235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.675888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.676369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.676858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:24.683215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.688013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.689620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.689620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.690291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.690291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.739203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.739731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.740800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.750728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:24.751722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:24.767187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.767818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.768494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.769598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.770251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.771372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.784049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:24.826958 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b677690-6585-4e89-bca4-e9a0ae266abf tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 204 len: 0 microversion: 2.26 time: 0.175904 Oct 27 09:14:24.832365 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1637/3323] 10.222.0.25 () {60 vars in 1295 bytes} [Thu Oct 27 09:14:24 2022] DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:14:24.852236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31ae5bd0d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:24.890953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.907461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.907960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.908582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:24.931077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.931609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.932045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:24.932782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:24.933237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:24.955376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.093596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:25.095333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:25.095333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.151600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:25.153799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:25.156449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.318033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:25.411810 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d29798d-ae8b-4c18-8179-3fbe0f884d20 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-931658828" status: 201 len: 0 microversion: 2.26 time: 0.574034 Oct 27 09:14:25.417323 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1638/3324] 10.222.0.25 () {62 vars in 1377 bytes} [Thu Oct 27 09:14:24 2022] PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-931658828 => generated 0 bytes in 582 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 27 09:14:25.440176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:25.440701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:25.466682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:25.467086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:25.472014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.473942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:25.474445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:25.474889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.538547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:25.577087 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c867244-961b-49be-a1c9-3d10e492959c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.833304 Oct 27 09:14:25.586649 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1687/3325] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:24 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:25.619921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31ae6a1700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:25.672049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:25.673078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:25.674994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.679693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:25.713752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:25.716017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:25.727378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.728178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:25.728653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:25.729084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.820590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:25.821257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:25.821505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.850991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:25.851483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:25.851957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:25.936640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:25.985901 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99492aab-3a14-4c00-9792-91c6d9bfb854 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-1198675836" status: 201 len: 0 microversion: 2.26 time: 0.397048 Oct 27 09:14:25.987020 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1688/3326] 10.222.0.25 () {62 vars in 1380 bytes} [Thu Oct 27 09:14:25 2022] PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-1198675836 => generated 0 bytes in 399 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 09:14:25.999262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31a9fff4c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:26.030520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.039825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.052327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.053109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:26.063146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.064065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.064720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.065762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.066476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.069148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.130121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.133523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.134252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.175270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:26.224288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd374a6e-3c8f-4348-9477-f7a58f538426 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 204 len: 0 microversion: 2.26 time: 0.229063 Oct 27 09:14:26.226175 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1689/3327] 10.222.0.25 () {60 vars in 1295 bytes} [Thu Oct 27 09:14:25 2022] DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:14:26.242636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b4a4c6f-73f8-4c20-b3b0-b665db33dbdd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31a9d72c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:26.265304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b4a4c6f-73f8-4c20-b3b0-b665db33dbdd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.281497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b4a4c6f-73f8-4c20-b3b0-b665db33dbdd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.284792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b4a4c6f-73f8-4c20-b3b0-b665db33dbdd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.308646 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b4a4c6f-73f8-4c20-b3b0-b665db33dbdd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 200 len: 12 microversion: 2.26 time: 0.075660 Oct 27 09:14:26.310645 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1690/3328] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Oct 27 09:14:26 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 12 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:26.340847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31ae6a1d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:26.361321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.364632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.365573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.368363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:26.381857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.382712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.386163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.387257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.388883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.389566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.446964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.447788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.450033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.497626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:26.528439 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64f83c27-785b-43af-bebc-0c86e75d9937 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 204 len: 0 microversion: 2.26 time: 0.209291 Oct 27 09:14:26.530496 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1691/3329] 10.222.0.25 () {60 vars in 1295 bytes} [Thu Oct 27 09:14:26 2022] DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:14:26.556510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31a9fffb80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:26.582769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.586940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.587823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.590873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:26.610910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.614297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.614900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.615726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.616207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.622909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.716312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.716781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.717239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.755088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.755622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.756116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.787993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:26.819442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:26.873693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aa1d1b58-09ae-4bd7-8284-347ce5320617 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-488329512" status: 201 len: 0 microversion: 2.26 time: 0.337107 Oct 27 09:14:26.896420 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1692/3330] 10.222.0.25 () {62 vars in 1377 bytes} [Thu Oct 27 09:14:26 2022] PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-488329512 => generated 0 bytes in 357 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 27 09:14:26.909551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:26.915875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:26.936909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.937433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.937838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:26.938558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:26.939009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:26.950922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:27.780269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:27.821901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:27.823427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:27.824704 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3021fc3d-9a4d-4ee0-a7bd-c682778915bd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 2.395915 Oct 27 09:14:27.832259 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1639/3331] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:25 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:27.842624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31aa1f5160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:27.858975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:27.878980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:27.881364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:27.882184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:27.884369 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae59e577-cf92-4191-a2c4-db72ea2573db tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.971326 Oct 27 09:14:27.885715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:27.899982 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1693/3332] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:26 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:27.909541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:27.910354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:27.910998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:27.911949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:27.912597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:27.913205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.021575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.022093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.023716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.061723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.071498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.072145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.146500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:28.195815 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-373184d7-5b2a-4095-be10-1b3049f36c5c tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-1018499025" status: 201 len: 0 microversion: 2.26 time: 0.361981 Oct 27 09:14:28.201590 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1640/3333] 10.222.0.25 () {62 vars in 1380 bytes} [Thu Oct 27 09:14:27 2022] PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags/tempest-tag-1018499025 => generated 0 bytes in 368 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 27 09:14:28.210157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Action: 'update_all', calling method: .version_select at 0x7f31a9d7aaf0>, body: {"tags": ["tempest-tag-477143418", "tempest-tag-1627469497"]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:28.252198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.252789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.254939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.257141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:28.292223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.298241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.299113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.300280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.302062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.303179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.398208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.408649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.410901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.471440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:28.518294 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cfbd13f5-e1ba-47fc-a09d-d510672b2c9e tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 200 len: 61 microversion: 2.26 time: 0.314312 Oct 27 09:14:28.525003 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1694/3334] 10.222.0.25 () {62 vars in 1312 bytes} [Thu Oct 27 09:14:28 2022] PUT /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 61 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:28.536310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5cde4657-8c10-404e-907c-24e07d20b422 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31a9254f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:28.548820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cde4657-8c10-404e-907c-24e07d20b422 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.556703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cde4657-8c10-404e-907c-24e07d20b422 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.557418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cde4657-8c10-404e-907c-24e07d20b422 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.567054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=88,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:28.569729 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5cde4657-8c10-404e-907c-24e07d20b422 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 200 len: 61 microversion: 2.26 time: 0.042966 Oct 27 09:14:28.570864 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1641/3335] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Oct 27 09:14:28 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 61 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:28.583469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '.version_select at 0x7f31aa1a3670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:28.595980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.597351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.598182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.599182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:28.613348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.614633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.615844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.616824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.617826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.618658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.693672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.694589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.696313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.718174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'flavor' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:28.773222 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fe61bb2f-8673-479a-b6b6-149a2153debb tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags" status: 204 len: 0 microversion: 2.26 time: 0.195090 Oct 27 09:14:28.779092 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1695/3336] 10.222.0.25 () {60 vars in 1295 bytes} [Thu Oct 27 09:14:28 2022] DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd/tags => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:14:28.789336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:28.790552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:28.812765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:28.818022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.825667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.827302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.835038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.835525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.836814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.861767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:28.863220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:28.884045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.885939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.891320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.897995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:28.899795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:28.902645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:28.934533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:14:29.271954 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a8bd800-e575-48e4-a6b2-38f6346555e2 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 204 len: 0 microversion: 2.26 time: 0.487045 Oct 27 09:14:29.286048 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1642/3337] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:14:28 2022] DELETE /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:14:29.301856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:29.302563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:29.340403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:29.340898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:29.347921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:29.348949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:29.360203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:29.360991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:29.805337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:29.852455 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b82d4f6-7c3d-451b-b55d-9492913a4e5d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.563408 Oct 27 09:14:29.854958 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1643/3338] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:29 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:29.872656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:29.879841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:29.904931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:29.905598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:29.907401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:29.910842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:29.911356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:29.911825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:30.340184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:30.356141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:30.361423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:30.370352 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0ea93d2-cd63-48bb-91bc-f19accf97ce1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 1.516995 Oct 27 09:14:30.372472 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1696/3339] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:28 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:30.618688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:30.638164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:30.646584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:30.649109 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-307f16a9-e2d4-4a63-9f5a-4713131cdffd tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1551 microversion: 2.26 time: 0.789188 Oct 27 09:14:30.692657 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1644/3340] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:29 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1551 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:30.887505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:30.888710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:30.903555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:30.907544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:30.909726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:30.913089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:30.914675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:30.916039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:31.404199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:31.406412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:31.423981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:31.426923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:31.430050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:31.437380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:31.438421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:31.439136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:31.991942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:32.006450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7746f03-b56c-4ea9-aff8-4615ddd4087b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 1.123099 Oct 27 09:14:32.028516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:32.034079 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1697/3341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:30 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:32.039447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:32.040107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:32.045403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:32.051478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:32.054546 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db357e75-c7cb-4b29-b610-88457763353e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 0.655346 Oct 27 09:14:32.056962 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1645/3342] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:31 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:32.085587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:32.086126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:32.086731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:32.087321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:32.100075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:32.100829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:32.669449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:32.699252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:32.711465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:32.715262 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-487e4b1c-bf1b-4954-9dc9-2efd8029c5be tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1551 microversion: 2.26 time: 0.679397 Oct 27 09:14:32.721582 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1698/3343] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:32 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1551 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:33.040970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:33.042492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:33.072713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:33.073289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:33.073755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:33.084322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:33.085490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:33.095196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:33.096511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:33.099002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:33.109382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:33.112283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:33.115424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:33.120186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:33.129801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:33.131833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:33.967845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:34.002907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:34.010018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:34.011819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:34.018319 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79041328-0521-409c-b466-081abc4bb5e7 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 0.935901 Oct 27 09:14:34.020101 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1699/3344] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:33 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:34.026111 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec54744c-f607-42a7-9dbc-c21ce3276fd7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.990835 Oct 27 09:14:34.030298 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1646/3345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:33 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:34.039254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:34.041983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:34.042554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cbbc4787-3523-40d7-93b6-0fb316fe86f4 req-19257b94-448f-4349-b2a6-993ad0ebdfc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c407dfe-478d-486c-8250-adda5b1b6fdd", "name": "network-vif-deleted", "tag": "04c78d72-4bf6-4c4e-8c7b-d63bd4032ae4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:34.057540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:34.058283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:34.058893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:34.059824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:34.064341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:34.068524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:34.073376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cbbc4787-3523-40d7-93b6-0fb316fe86f4 req-19257b94-448f-4349-b2a6-993ad0ebdfc1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:34.073920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cbbc4787-3523-40d7-93b6-0fb316fe86f4 req-19257b94-448f-4349-b2a6-993ad0ebdfc1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:34.074738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cbbc4787-3523-40d7-93b6-0fb316fe86f4 req-19257b94-448f-4349-b2a6-993ad0ebdfc1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:34.105755 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cbbc4787-3523-40d7-93b6-0fb316fe86f4 req-19257b94-448f-4349-b2a6-993ad0ebdfc1 service nova] Creating event network-vif-deleted:04c78d72-4bf6-4c4e-8c7b-d63bd4032ae4 for instance 1c407dfe-478d-486c-8250-adda5b1b6fdd on n-h1-858383-16 Oct 27 09:14:34.120203 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cbbc4787-3523-40d7-93b6-0fb316fe86f4 req-19257b94-448f-4349-b2a6-993ad0ebdfc1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087534 Oct 27 09:14:34.121504 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1647/3346] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:34.183500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:34.184111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:34.186466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:34.187243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lazy-loading 'fault' on Instance uuid 1c407dfe-478d-486c-8250-adda5b1b6fdd {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:34.277455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:34.289106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:34.291419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1680fb5ed3844e9a8623f7a83009572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86393a468f9a4e498507a8749d35bfab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:34.293318 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0d7ed9f3-a906-4deb-9097-88e3ce60ed10 tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 200 len: 1351 microversion: 2.26 time: 0.270746 Oct 27 09:14:34.294411 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1700/3347] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:34 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 1351 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:35.050632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:35.051969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:35.060771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:35.061668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:35.081982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:35.083132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:35.084261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:35.084726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:35.085491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:35.085954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:35.089435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:35.091647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:35.092685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:35.094206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:35.097720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:35.098633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:36.552700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:36.557593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:36.563807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:36.569414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:36.570697 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ec671c6e-a068-4c5c-a746-3a7995e7abb9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 1.514806 Oct 27 09:14:36.572850 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67ad0912-23fe-4a7d-9dd7-313c0e25f9c4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 1.528467 Oct 27 09:14:36.577143 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1648/3348] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:35 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:36.586191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:36.586371 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1701/3349] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:35 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:14:36.589302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] [instance: 1c407dfe-478d-486c-8250-adda5b1b6fdd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:36.618018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:36.622378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:36.623111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:36.624105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:36.624808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:36.625468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:36.643167 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] HTTP exception thrown: Instance 1c407dfe-478d-486c-8250-adda5b1b6fdd could not be found. Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Request method failure captured: Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd HTTP/1.1 Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkvTt-ZM4sQ9A7qL0dLKIX_D020tovGZMmR6k6MtD9CTkqwHM0HQXjDPWGuV48xj3CrugZvz2eM-aLIwwrFnB5NvkmjSHR-RKIQMagGRRVjpS_lOKXrcXzBq1f735ojEtuEgj4vz5KR15Sga-duDduAndYW9TgigIp43otTeZLEA54k Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.26 Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 86393a468f9a4e498507a8749d35bfab Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerTagsTestJSON-1206929829 Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86393a468f9a4e498507a8749d35bfab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86393a468f9a4e498507a8749d35bfab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86393a468f9a4e498507a8749d35bfab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86393a468f9a4e498507a8749d35bfab"}]}] Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerTagsTestJSON-1206929829 Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 86393a468f9a4e498507a8749d35bfab Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerTagsTestJSON-1206929829 Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerTagsTestJSON-1206929829-project Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c1680fb5ed3844e9a8623f7a83009572 Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerTagsTestJSON-1206929829-project Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 1c407dfe-478d-486c-8250-adda5b1b6fdd could not be found. Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '1c407dfe-478d-486c-8250-adda5b1b6fdd'} Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c407dfe-478d-486c-8250-adda5b1b6fdd could not be found. Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c407dfe-478d-486c-8250-adda5b1b6fdd could not be found. Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:36.645260 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:36.649704 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:36.649704 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:36.649704 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:36.649704 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:36.649704 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:36.649704 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c407dfe-478d-486c-8250-adda5b1b6fdd could not be found. Oct 27 09:14:36.649704 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:36.653070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] Returning 404 to user: Instance 1c407dfe-478d-486c-8250-adda5b1b6fdd could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:36.654276 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8659444e-4468-4e76-8685-fb23667f304b tempest-ServerTagsTestJSON-1206929829 tempest-ServerTagsTestJSON-1206929829-project] 10.222.0.25 "GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd" status: 404 len: 111 microversion: 2.26 time: 0.075839 Oct 27 09:14:36.655954 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1649/3350] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:36 2022] GET /compute/v2.1/servers/1c407dfe-478d-486c-8250-adda5b1b6fdd => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:14:37.450202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38586fa3-68a5-4a88-a838-eec7628652ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:37.453207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38586fa3-68a5-4a88-a838-eec7628652ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:37.463217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38586fa3-68a5-4a88-a838-eec7628652ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:37.464124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38586fa3-68a5-4a88-a838-eec7628652ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:37.465681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38586fa3-68a5-4a88-a838-eec7628652ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:37.467221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38586fa3-68a5-4a88-a838-eec7628652ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:37.469908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38586fa3-68a5-4a88-a838-eec7628652ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:37.470658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38586fa3-68a5-4a88-a838-eec7628652ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:37.535221 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38586fa3-68a5-4a88-a838-eec7628652ce tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089144 Oct 27 09:14:37.542932 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1702/3351] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:14:37 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:37.548278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:37.549133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:37.567358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:37.568461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:37.570536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:37.572050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:37.572050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:37.576638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:37.602007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:37.603762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:37.617241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:37.617753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:37.618199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:37.618920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:37.619376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:37.619835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:37.779067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lazy-loading 'services' on Instance uuid 4c829e85-d998-438d-8574-2bd136bacf72 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:37.928033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:37.939904 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-766c778a-93d6-47d3-911a-7f65e6d6addf tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments/96be7308-9e78-452b-9eda-a9af64eae8a5" status: 202 len: 0 microversion: 2.1 time: 0.394067 Oct 27 09:14:37.944237 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1650/3352] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:14:37 2022] DELETE /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments/96be7308-9e78-452b-9eda-a9af64eae8a5 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:14:37.963071 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66b0c480-df67-451d-bf83-438d43e6542d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.366115 Oct 27 09:14:37.965426 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1703/3353] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:37 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:37.966107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:37.967198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:37.981432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:37.986153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:37.987018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:37.988082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:37.990348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:37.991144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:38.262592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:38.278291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:38.280549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:38.286913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efcb010b-14c2-45e6-8476-e42ccc20b2c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 0.339505 Oct 27 09:14:38.295235 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1651/3354] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:37 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:38.992395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:38.994092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:39.019348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:39.021739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:39.028380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:39.029400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:39.030066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:39.031319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:39.323322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:39.324061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:39.348422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:39.349822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:39.350962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:39.352039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:39.353384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:39.354385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:39.553195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:39.568865 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9b1dc772-32b1-4888-9434-9725af90122e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 0.581047 Oct 27 09:14:39.569923 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1704/3355] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:38 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:40.114965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:40.154445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:40.157229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:40.159465 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37670d9d-bfb4-4340-b147-f417a03485cd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 0.847495 Oct 27 09:14:40.186295 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1652/3356] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:39 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:40.598472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:40.599482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:40.647407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:40.647407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:40.651490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:40.652948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:40.653795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:40.664730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:41.238908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:41.254107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:41.317079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:41.356816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:41.359176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:41.368988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:41.377242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:41.382412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:42.419344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:42.431447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f8ec159-e20d-4b6f-8a95-af672896ffb7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 1.840912 Oct 27 09:14:42.452885 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1705/3357] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:40 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:42.513010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:42.531396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:42.534435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:42.544107 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0da0ffd-3947-45a9-9d5e-54534bc5ca22 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 1.313780 Oct 27 09:14:42.545252 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1653/3358] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:41 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:43.214202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a3ee843f-af72-4bfa-84d1-749227c82ef9 req-51bb738d-ab91-482a-8ebb-8d2f4d2c7307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8dbd143-6100-4d9c-87e5-b0df7b176859", "name": "network-vif-plugged", "status": "completed", "tag": "0f571485-82e1-4e1d-9f24-667ffcc013aa"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:43.265957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a3ee843f-af72-4bfa-84d1-749227c82ef9 req-51bb738d-ab91-482a-8ebb-8d2f4d2c7307 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:43.267353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a3ee843f-af72-4bfa-84d1-749227c82ef9 req-51bb738d-ab91-482a-8ebb-8d2f4d2c7307 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:43.269635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a3ee843f-af72-4bfa-84d1-749227c82ef9 req-51bb738d-ab91-482a-8ebb-8d2f4d2c7307 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:43.310003 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a3ee843f-af72-4bfa-84d1-749227c82ef9 req-51bb738d-ab91-482a-8ebb-8d2f4d2c7307 service nova] Creating event network-vif-plugged:0f571485-82e1-4e1d-9f24-667ffcc013aa for instance f8dbd143-6100-4d9c-87e5-b0df7b176859 on n-h2-858383-16 Oct 27 09:14:43.336886 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a3ee843f-af72-4bfa-84d1-749227c82ef9 req-51bb738d-ab91-482a-8ebb-8d2f4d2c7307 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118545 Oct 27 09:14:43.339941 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1706/3359] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:43.458874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:43.459561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:43.476105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:43.476733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:43.477089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:43.481194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:43.482269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:43.482998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:43.576943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:43.577725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:43.585834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:43.586665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:43.587521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:43.589612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:43.589612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:43.589612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:43.723707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:44.714878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:44.739390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:44.742925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:44.743744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:44.752948 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-89bd8ab5-e6cc-4830-b17b-ebbb1b31add8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 1.179882 Oct 27 09:14:44.756228 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8eca090c-9b4c-493e-8914-fb18dc077264 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 1.301077 Oct 27 09:14:44.757024 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1654/3360] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:43 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:44.757503 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1707/3361] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:43 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:45.790158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:45.790886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:45.794606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:45.796576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:45.815683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:45.816279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:45.817771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:45.818979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:45.819145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:45.824213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:45.826684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:45.831323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:45.833074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:45.834715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:45.834983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:45.835658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:46.825308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:46.844756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:46.845875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c53c3aee-7d32-488b-922c-e408f0ea9828 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1308 microversion: 2.1 time: 1.050239 Oct 27 09:14:46.848896 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1708/3362] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:45 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1308 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:46.853854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:46.855308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:46.856513 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b01a9b3-c369-424f-ad0f-309cfc608c39 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 1.067199 Oct 27 09:14:46.880005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1655/3363] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:45 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:14:47.147957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-594524975", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ab13eded-e8f5-4da5-879a-e47232da5d73"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:47.221278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:47.308683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] validate_networks() for [('ab13eded-e8f5-4da5-879a-e47232da5d73', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:14:47.876084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:47.877418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:47.896606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:47.897168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:47.897639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:47.898350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:47.898884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:47.904220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:49.381044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:49.389249 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9218c1bc-19fd-4442-9a03-9e91a9aeee41 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1487 microversion: 2.1 time: 1.518053 Oct 27 09:14:49.396832 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1656/3364] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:47 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1487 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:49.401883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:49.402481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:49.433575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:49.434120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:49.434557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:49.435260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:49.448087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:49.448964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:49.504192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:50.097497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:50.109624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:50.116684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:14:50.118237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:14:50.118999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:14:50.119676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:14:50.120404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:14:50.128417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:50.163805 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b0f5890-f989-4f75-af55-c6e710f033e8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 0.759117 Oct 27 09:14:50.166220 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1657/3365] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:49 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:50.175552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:50.176382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:50.177014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:50.179382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:50.180730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:50.184042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:50.184702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:50.185722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:50.209565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:50.212161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:50.212744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:50.213874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:50.213980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:50.221670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:50.274083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Getting quotas for project 1469f50688644411a306ae4f0305d56c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:14:50.305539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Getting quotas for user 9b4eb0adbf5d4df5b292794045947ee1 and project 1469f50688644411a306ae4f0305d56c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:14:50.370591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:14:50.390656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:14:50.393186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:14:50.562299 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31882c30-0c63-4f60-a03d-8ce332c26cf0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.692439 Oct 27 09:14:50.572329 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1709/3366] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:14:50.590691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-838dbfba-cbba-424a-b1e1-f7178b023a87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:50.590976 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f78c6bb-a718-4bd4-ba5d-cb1ac7e6dac8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 204 len: 0 microversion: 2.1 time: 0.423313 Oct 27 09:14:50.591482 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1658/3367] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:14:50 2022] DELETE /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:14:50.592489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-838dbfba-cbba-424a-b1e1-f7178b023a87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:50.605219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:50.605986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:50.619805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:50.620311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:50.620810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:50.621509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:50.622143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:50.623269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:50.736378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-838dbfba-cbba-424a-b1e1-f7178b023a87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:50.748298 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-838dbfba-cbba-424a-b1e1-f7178b023a87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1223 microversion: 2.1 time: 0.165576 Oct 27 09:14:50.752208 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1710/3368] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:50 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1223 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:14:50.896794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1577193d-c0b8-4054-af85-d1bc653c211f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:50.900670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1577193d-c0b8-4054-af85-d1bc653c211f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:50.918206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1577193d-c0b8-4054-af85-d1bc653c211f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:50.928339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1577193d-c0b8-4054-af85-d1bc653c211f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:50.937352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1577193d-c0b8-4054-af85-d1bc653c211f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:50.938520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1577193d-c0b8-4054-af85-d1bc653c211f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:50.940312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1577193d-c0b8-4054-af85-d1bc653c211f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:50.942895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1577193d-c0b8-4054-af85-d1bc653c211f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.051275 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1577193d-c0b8-4054-af85-d1bc653c211f tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.159738 Oct 27 09:14:51.053586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:51.068608 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e9643cc-ed1c-4eb3-9186-5bbe1949c293 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1493 microversion: 2.1 time: 0.469766 Oct 27 09:14:51.070147 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1659/3369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:50 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1493 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:51.082201 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1711/3370] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:14:50 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:14:51.195899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d4e5eb5c-21c8-4de4-83bf-b83bcb3a59ed tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:51.197129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:51.198240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d4e5eb5c-21c8-4de4-83bf-b83bcb3a59ed tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:51.199114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:51.213974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.214855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.215471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.221479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.223353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.224041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.226711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4e5eb5c-21c8-4de4-83bf-b83bcb3a59ed tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.227383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4e5eb5c-21c8-4de4-83bf-b83bcb3a59ed tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.227877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4e5eb5c-21c8-4de4-83bf-b83bcb3a59ed tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.228635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4e5eb5c-21c8-4de4-83bf-b83bcb3a59ed tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.229093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4e5eb5c-21c8-4de4-83bf-b83bcb3a59ed tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.232461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4e5eb5c-21c8-4de4-83bf-b83bcb3a59ed tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.336147 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d4e5eb5c-21c8-4de4-83bf-b83bcb3a59ed tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148276 Oct 27 09:14:51.344706 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1660/3371] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:14:51 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:14:51.481885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:51.482397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:51.497247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.497756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.500096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.500843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.501322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.501779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.605733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:14:51.609931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:51.637839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:51.639900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:51.645382 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-12548d7a-c27a-4abe-a224-0f5e27d5ef07 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1737 microversion: 2.20 time: 0.454473 Oct 27 09:14:51.651173 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1712/3372] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:51 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1737 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:14:51.773872 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-09572275-2697-4ca1-baee-097d6d6b18b1 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 204 len: 0 microversion: 2.1 time: 0.295580 Oct 27 09:14:51.775022 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1661/3373] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:14:51 2022] DELETE /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:14:51.777839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:51.778611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:51.792263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:51.794288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:51.804439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.805163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.805733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.807254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.808824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.809497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.812229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.812506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.812673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.813402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:51.813965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:51.814270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:51.962839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:51.972897 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f58ff0e1-b71e-4b15-88d9-4ee7ea2ca58a tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1227 microversion: 2.1 time: 0.199467 Oct 27 09:14:51.974195 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1713/3374] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:51 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1227 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:14:52.069557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:52.100348 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0d06d93-cd32-41d8-820e-522f77575958 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1677 microversion: 2.1 time: 0.317964 Oct 27 09:14:52.101866 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1662/3375] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:51 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1677 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:52.103886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:52.104731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:52.117059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:52.117810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:52.118486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:52.119370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:52.120032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:52.120621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:52.357138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:52.369920 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e8876de9-ec24-4658-aab6-c73f45523b4a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1493 microversion: 2.1 time: 0.277109 Oct 27 09:14:52.370883 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1714/3376] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:52 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1493 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:14:52.677109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:52.678715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:52.689496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:52.691901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:52.692674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:52.693734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:52.694247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:52.694676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:52.999653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:53.000800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:53.018407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:53.020012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:53.024282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:53.028423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:53.028933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:53.029379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:53.463242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:53.485156 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-188ae35a-d0bb-49dc-93c4-0a30f5eb43ad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1219 microversion: 2.1 time: 0.484533 Oct 27 09:14:53.486487 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1715/3377] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:52 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1219 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:14:53.492096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:53.493182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:53.499799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:53.500505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:53.501093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:53.501935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:53.502536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:53.503115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:54.067714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:54.085993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:54.087750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:54.095083 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33dc02b8-9185-44ab-9e45-a6768ee4d60b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1719 microversion: 2.20 time: 1.422120 Oct 27 09:14:54.099933 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1663/3378] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:52 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1719 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:54.119360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:54.120307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:54.136174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:54.136909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:54.137498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:54.138356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:54.138970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:54.139703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:54.402457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:54.414943 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b7b6908d-3e15-4a06-841c-0c604ee67da0 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1677 microversion: 2.1 time: 0.924035 Oct 27 09:14:54.417562 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1716/3379] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:53 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1677 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:54.429673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-aa880e84-9c7b-44ef-a5f3-13cf1998ce19 req-78fd0ee6-924f-4d49-b9aa-75257ec73838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f468cf4-43cf-4bba-bfcb-0f725bf735e3", "name": "network-vif-unplugged", "status": "completed", "tag": "e537d4a4-12d3-46d5-b30a-f4aa9120f51e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:54.444865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-aa880e84-9c7b-44ef-a5f3-13cf1998ce19 req-78fd0ee6-924f-4d49-b9aa-75257ec73838 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:54.445721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-aa880e84-9c7b-44ef-a5f3-13cf1998ce19 req-78fd0ee6-924f-4d49-b9aa-75257ec73838 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:54.446422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-aa880e84-9c7b-44ef-a5f3-13cf1998ce19 req-78fd0ee6-924f-4d49-b9aa-75257ec73838 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:54.471922 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-aa880e84-9c7b-44ef-a5f3-13cf1998ce19 req-78fd0ee6-924f-4d49-b9aa-75257ec73838 service nova] Creating event network-vif-unplugged:e537d4a4-12d3-46d5-b30a-f4aa9120f51e for instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 on n-h2-858383-16 Oct 27 09:14:54.496477 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-aa880e84-9c7b-44ef-a5f3-13cf1998ce19 req-78fd0ee6-924f-4d49-b9aa-75257ec73838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077507 Oct 27 09:14:54.497443 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1717/3380] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:54.518486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:54.521169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:54.528644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:54.532319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:54.533125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:54.534016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:54.534596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:54.535125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:54.690106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:54.703305 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f087287b-0e74-47c8-bf3b-40c56a3e07e0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1281 microversion: 2.1 time: 0.190942 Oct 27 09:14:54.704351 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1718/3381] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:54 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:55.137288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:55.142529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:55.148211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:55.157826 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dca8756d-9f79-44b0-93c3-cd4904227fb3 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1493 microversion: 2.1 time: 1.053736 Oct 27 09:14:55.195984 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1664/3382] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:54 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1493 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:55.205238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:55.208178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:55.209662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:55.210610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:55.212709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:55.213421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:55.409329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f751841a-111a-46cc-bcec-3b4212b957a0 req-498900c1-66f7-4435-b351-34f0baa9539a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8dbd143-6100-4d9c-87e5-b0df7b176859", "name": "network-vif-deleted", "tag": "0f571485-82e1-4e1d-9f24-667ffcc013aa"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:55.431992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f751841a-111a-46cc-bcec-3b4212b957a0 req-498900c1-66f7-4435-b351-34f0baa9539a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:55.436965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f751841a-111a-46cc-bcec-3b4212b957a0 req-498900c1-66f7-4435-b351-34f0baa9539a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:55.436965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f751841a-111a-46cc-bcec-3b4212b957a0 req-498900c1-66f7-4435-b351-34f0baa9539a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:55.473866 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f751841a-111a-46cc-bcec-3b4212b957a0 req-498900c1-66f7-4435-b351-34f0baa9539a service nova] Creating event network-vif-deleted:0f571485-82e1-4e1d-9f24-667ffcc013aa for instance f8dbd143-6100-4d9c-87e5-b0df7b176859 on n-h2-858383-16 Oct 27 09:14:55.488997 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f751841a-111a-46cc-bcec-3b4212b957a0 req-498900c1-66f7-4435-b351-34f0baa9539a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086593 Oct 27 09:14:55.489611 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1665/3383] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:55.501849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:55.502543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:55.511272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:55.512080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:55.512659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:55.513508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:55.514104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:55.520324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:55.629797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:55.659555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:55.679302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:55.680393 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb879e02-05dd-4d59-9253-13c2d3548d49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1719 microversion: 2.20 time: 0.551988 Oct 27 09:14:55.689569 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1719/3384] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:55 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1719 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:55.731608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:55.735093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:55.754293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:55.755508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:55.757055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:55.760098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:55.762537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:55.762990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:55.930717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:55.943035 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3242258c-cac4-40b0-97c8-ca17a8bed679 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1677 microversion: 2.1 time: 0.452194 Oct 27 09:14:55.947180 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1666/3385] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:55 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1677 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:55.952269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:55.963891 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-87c4badf-ffa3-4be3-a6d4-5196d19cdcb1 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1281 microversion: 2.1 time: 0.240031 Oct 27 09:14:55.965885 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1720/3386] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:55 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:56.186819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:56.187479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:56.208387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:56.209778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:56.216376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:56.217144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:56.218157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:56.218652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:56.347069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:56.347509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:56.347988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:56.348436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lazy-loading 'fault' on Instance uuid f8dbd143-6100-4d9c-87e5-b0df7b176859 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:56.506881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:56.519172 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-26703c92-a92c-4e55-85bc-d4f2953568cf tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 200 len: 1298 microversion: 2.1 time: 0.339261 Oct 27 09:14:56.528596 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1667/3387] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:56 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 1298 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:14:56.714170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:56.714831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:56.729888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:56.730647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:56.731289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:56.732409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:56.733650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:56.737977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:56.971320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:56.972432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:56.992594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:56.992594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:56.992594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:56.992594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:56.992594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:56.992594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:57.128233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:57.146097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:57.153527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:57.162318 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-54812601-2c33-44c8-a873-add2c6df3aa2 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1722 microversion: 2.20 time: 0.457060 Oct 27 09:14:57.177525 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1721/3388] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:56 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1722 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:57.191560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:57.192496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:57.199821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:57.200600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:57.201240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:57.202688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:57.203319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:57.203998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:57.401578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:57.403214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:57.404008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:57.405421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lazy-loading 'fault' on Instance uuid 4c829e85-d998-438d-8574-2bd136bacf72 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:14:57.571448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e26a9a64a304845834c1c969e9a0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1472f8bee2d4303adf611315bcc6215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:57.583217 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3c749ca-899c-4fab-af57-e2540b3f803c tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 200 len: 1329 microversion: 2.1 time: 0.616347 Oct 27 09:14:57.585341 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1668/3389] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:56 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 1329 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:14:57.682322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:57.697759 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c64c121b-b48a-4436-88de-778bb73d8e4f tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1323 microversion: 2.1 time: 0.518987 Oct 27 09:14:57.703531 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1722/3390] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:57 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1323 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:14:57.712662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c456388e-2543-4d6f-8a5e-e5811a2534c3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b615e96f-6836-416f-87f8-1b8e75938cfb"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:57.722788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c456388e-2543-4d6f-8a5e-e5811a2534c3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:57.737185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c456388e-2543-4d6f-8a5e-e5811a2534c3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:57.737982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c456388e-2543-4d6f-8a5e-e5811a2534c3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:57.738524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c456388e-2543-4d6f-8a5e-e5811a2534c3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:57.739862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c456388e-2543-4d6f-8a5e-e5811a2534c3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:57.742898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c456388e-2543-4d6f-8a5e-e5811a2534c3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:57.743520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c456388e-2543-4d6f-8a5e-e5811a2534c3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:57.971013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-987871641", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": "none"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:58.104851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:14:58.105261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:14:58.105920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:14:58.106582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:14:58.107151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:14:58.126961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:58.128763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:58.129210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:58.131618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:58.132107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:58.132569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:58.163196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Getting quotas for project bd11ea6fd55c4b5fb4a006ab6ace9fe7. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:14:58.170227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Getting quotas for user 7ba42c0fc7b34ffaba25f5004dad583a and project bd11ea6fd55c4b5fb4a006ab6ace9fe7. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:14:58.187302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:14:58.190750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:14:58.270981 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-566ee4d9-e22f-484a-8997-d1328d715b72 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.683144 Oct 27 09:14:58.274007 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1669/3391] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:14:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:14:58.283900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cb110e23-187b-4635-b7e3-d046890fbf1c req-bb5afbc8-2f64-409f-b4b9-62630df569e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c829e85-d998-438d-8574-2bd136bacf72", "name": "network-vif-deleted", "tag": "3e677692-d625-44bf-b691-120c347bce6e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:58.313827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cb110e23-187b-4635-b7e3-d046890fbf1c req-bb5afbc8-2f64-409f-b4b9-62630df569e8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:58.314845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cb110e23-187b-4635-b7e3-d046890fbf1c req-bb5afbc8-2f64-409f-b4b9-62630df569e8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:58.315471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cb110e23-187b-4635-b7e3-d046890fbf1c req-bb5afbc8-2f64-409f-b4b9-62630df569e8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:58.353416 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cb110e23-187b-4635-b7e3-d046890fbf1c req-bb5afbc8-2f64-409f-b4b9-62630df569e8 service nova] Creating event network-vif-deleted:3e677692-d625-44bf-b691-120c347bce6e for instance 4c829e85-d998-438d-8574-2bd136bacf72 on n-h1-858383-16 Oct 27 09:14:58.384675 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cb110e23-187b-4635-b7e3-d046890fbf1c req-bb5afbc8-2f64-409f-b4b9-62630df569e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107818 Oct 27 09:14:58.387394 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1670/3392] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:14:58.398143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:58.405826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:58.425975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:58.432737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:58.433609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:58.433908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:58.434859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:58.436612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:58.437700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:58.452852 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c456388e-2543-4d6f-8a5e-e5811a2534c3 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.746668 Oct 27 09:14:58.462503 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:14:58.464704 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1723/3393] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Oct 27 09:14:57 2022] POST /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/os-volume_attachments => generated 188 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 HTTP/1.1 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f8dbd143-6100-4d9c-87e5-b0df7b176859'} Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:58.465134 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:14:58.469979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:14:58.469979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:14:58.469979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:14:58.469979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:14:58.469979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:14:58.469979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:14:58.472244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:14:58.473318 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6ac7e91c-77f9-4f28-bc70-7c7062f444da tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 404 len: 111 microversion: 2.1 time: 0.084346 Oct 27 09:14:58.475555 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1671/3394] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:58 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:14:58.477870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:58.477870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:58.509098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:58.509767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:58.510031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:58.514008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:14:58.514643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:14:58.515991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:14:58.963956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:58.975922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:58.977432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:58.978941 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-881191bf-7f5d-4c17-9118-c7939d32c1b0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2948 microversion: 2.42 time: 0.512957 Oct 27 09:14:58.988201 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1724/3395] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:58 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2948 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:59.011053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-04bc2c61-8671-4214-afe6-386c5898f862 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:59.020472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-04bc2c61-8671-4214-afe6-386c5898f862 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:14:59.182655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-04bc2c61-8671-4214-afe6-386c5898f862 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:59.195554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-04bc2c61-8671-4214-afe6-386c5898f862 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:59.202921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-04bc2c61-8671-4214-afe6-386c5898f862 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:14:59.204796 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-04bc2c61-8671-4214-afe6-386c5898f862 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1277 microversion: 2.54 time: 0.210814 Oct 27 09:14:59.206720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1435246671", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a5e89054-f218-4c42-867e-075e57d60d88"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:14:59.208272 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1725/3396] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:14:58 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:14:59.224117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d72933ac-026d-4b01-b7b0-0c6c988ee74a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a948ca60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:14:59.234424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:14:59.426715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] validate_networks() for [('a5e89054-f218-4c42-867e-075e57d60d88', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:15:00.226692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:00.288195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:15:00.288631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:15:00.289439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:15:00.290544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:15:00.291588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:15:00.305363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:00.306343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:00.307307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:00.309118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:00.311847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:00.312773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:00.347722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Getting quotas for project b6e1b238d6ce43fc932ea1bd5e4413f5. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:15:00.360600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Getting quotas for user 8b9b05c3cdcd4b5fbffc78e6508002c8 and project b6e1b238d6ce43fc932ea1bd5e4413f5. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:15:00.389935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Going to run 3 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:15:00.393627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:15:00.466378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: a0460dce-a27a-4974-b3d5-71f416e50a61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=ffe57d00-6179-49d1-99ef-7a9df351eb95,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:15:00.510871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=a0460dce-a27a-4974-b3d5-71f416e50a61,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:15:00.610918 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2feff151-4762-4fff-85f0-67065be8830d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.131219 Oct 27 09:15:00.616598 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1672/3397] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:15:00.624681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:00.625899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:00.656372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:00.657039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:00.659078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:00.660730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:00.662350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:00.662974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:00.675060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:00.712477 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] HTTP exception thrown: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Request method failure captured: Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 HTTP/1.1 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkspJeqHYNbNOtJ9KS5peVFgha0boPAv9Jeh1RQ9VJBDH7xNDgLgtzIpdPzAgBhKfLDn9ovsrZ2KSi8SG9zD0jGAEMPQOA-vruAfsXSZ7n8MfB-sVVV2aJCTAcMESfU0G6XuBdob-Zx3lqATPPcYInl4B6lTG32Ax3TQ9QHr38pT98w Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: f1472f8bee2d4303adf611315bcc6215 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2056773808 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1472f8bee2d4303adf611315bcc6215"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1472f8bee2d4303adf611315bcc6215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1472f8bee2d4303adf611315bcc6215"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1472f8bee2d4303adf611315bcc6215"}]}] Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2056773808 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: f1472f8bee2d4303adf611315bcc6215 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2056773808 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachSCSIVolumeTestJSON-2056773808-project Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 2e26a9a64a304845834c1c969e9a0131 Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2056773808-project Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '4c829e85-d998-438d-8574-2bd136bacf72'} Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:00.717331 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:00.721853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:00.721853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:00.721853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:00.721853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:00.721853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:00.721853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:00.721853 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:00.723702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Returning 404 to user: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:00.729599 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f545a200-7287-436b-846f-622159d85dc2 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 404 len: 111 microversion: 2.1 time: 0.111520 Oct 27 09:15:00.735312 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1673/3398] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:00 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:15:00.740282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:00.745573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:00.756611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:00.757525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:00.759959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:00.761693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:00.763076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:00.767313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:00.833407 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d72933ac-026d-4b01-b7b0-0c6c988ee74a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 204 len: 0 microversion: 2.1 time: 1.623803 Oct 27 09:15:00.837399 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1726/3399] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:14:59 2022] DELETE /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 0 bytes in 1625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:00.844892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9aad243d-6541-467c-9026-aecaf508995e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:00.845405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9aad243d-6541-467c-9026-aecaf508995e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:00.871823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aad243d-6541-467c-9026-aecaf508995e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:00.872337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aad243d-6541-467c-9026-aecaf508995e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:00.872791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aad243d-6541-467c-9026-aecaf508995e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:00.874214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aad243d-6541-467c-9026-aecaf508995e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:00.874692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aad243d-6541-467c-9026-aecaf508995e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:00.875127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aad243d-6541-467c-9026-aecaf508995e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.058793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:01.068682 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8e6f967-efb7-409a-8091-c3d0b7b045b3 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1323 microversion: 2.1 time: 0.332178 Oct 27 09:15:01.069898 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1674/3400] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:00 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1323 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:01.075055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa80a175-5097-4fca-b84e-e91d1c1c2452 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:01.075856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa80a175-5097-4fca-b84e-e91d1c1c2452 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:01.082633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa80a175-5097-4fca-b84e-e91d1c1c2452 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.083353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa80a175-5097-4fca-b84e-e91d1c1c2452 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.083997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa80a175-5097-4fca-b84e-e91d1c1c2452 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.085025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa80a175-5097-4fca-b84e-e91d1c1c2452 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.085713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa80a175-5097-4fca-b84e-e91d1c1c2452 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.086356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa80a175-5097-4fca-b84e-e91d1c1c2452 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.276886 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa80a175-5097-4fca-b84e-e91d1c1c2452 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.204025 Oct 27 09:15:01.277847 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1675/3401] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Oct 27 09:15:01 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f/os-interface => generated 1831 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:01.286648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-af7670ea-7ecf-41ff-9e5f-63f7ebf56541 req-b297ea34-f832-4289-8c7d-e196b46c01d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d339b0a-f7bc-4d58-90d1-e5d4beb1834e", "tag": "de3d506c-8d30-4307-947f-6fb004d3c625"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:01.298313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-af7670ea-7ecf-41ff-9e5f-63f7ebf56541 req-b297ea34-f832-4289-8c7d-e196b46c01d8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.299356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-af7670ea-7ecf-41ff-9e5f-63f7ebf56541 req-b297ea34-f832-4289-8c7d-e196b46c01d8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.300102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-af7670ea-7ecf-41ff-9e5f-63f7ebf56541 req-b297ea34-f832-4289-8c7d-e196b46c01d8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.315261 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-af7670ea-7ecf-41ff-9e5f-63f7ebf56541 req-b297ea34-f832-4289-8c7d-e196b46c01d8 service nova] Creating event network-changed:de3d506c-8d30-4307-947f-6fb004d3c625 for instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e on n-h1-858383-16 Oct 27 09:15:01.328515 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-af7670ea-7ecf-41ff-9e5f-63f7ebf56541 req-b297ea34-f832-4289-8c7d-e196b46c01d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048071 Oct 27 09:15:01.329666 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1676/3402] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:01.338373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:01.339349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:01.348135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.348638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.349087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.349570 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9aad243d-6541-467c-9026-aecaf508995e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/os-volume_attachments/b615e96f-6836-416f-87f8-1b8e75938cfb" status: 202 len: 0 microversion: 2.20 time: 0.510336 Oct 27 09:15:01.350028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.350300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.351101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.352771 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1727/3403] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Oct 27 09:15:00 2022] DELETE /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/os-volume_attachments/b615e96f-6836-416f-87f8-1b8e75938cfb => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:01.372412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:01.388546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:01.394101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Searching by: {'deleted': False, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:15:01.444486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.445241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.446296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.458995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.462242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.463561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.466986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:01.483290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:01.486124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:01.487902 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b83a670-978f-490b-b8ef-fd6eb65cab75 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1335 microversion: 2.54 time: 0.156770 Oct 27 09:15:01.489202 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1677/3404] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:01 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1335 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:01.495557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87b4a74a-db04-43e9-a1ca-c6e799e71991 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '.version_select at 0x7f31a92829d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:01.515972 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dedf6a6e-060b-4cf2-85b3-392cf3b98632 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.161157 Oct 27 09:15:01.520074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87b4a74a-db04-43e9-a1ca-c6e799e71991 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205875907" status: 202 len: 0 microversion: 2.1 time: 0.029526 Oct 27 09:15:01.521100 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1678/3405] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205875907 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:15:01.529353 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1728/3406] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:15:01 2022] GET /compute/v2.1/servers => generated 1018 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:01.535488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:01.535768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:01.536023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:01.539542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:01.549869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.550373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.551483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.556506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.557004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.557453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.562095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.562777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.563468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.567476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.569176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.570871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.635615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:15:01.644475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120602) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 27 09:15:01.771355 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bceea554-c03f-40bc-8020-8a209e323c64 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "POST /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/action" status: 202 len: 0 microversion: 2.20 time: 0.239332 Oct 27 09:15:01.776203 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1729/3407] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:15:01 2022] POST /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:01.783256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-351e65ed-6535-4fe5-9404-4dd9ca0f0870 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:01.786454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-351e65ed-6535-4fe5-9404-4dd9ca0f0870 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:01.813635 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4518d3fb-2c1d-4749-8955-1910c51cc84c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 204 len: 0 microversion: 2.1 time: 0.290812 Oct 27 09:15:01.814681 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1679/3408] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:15:01 2022] DELETE /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:01.833662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:01.834582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:01.875121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.876143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.876898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.880354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:01.881172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:01.883099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:01.885248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-351e65ed-6535-4fe5-9404-4dd9ca0f0870 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:01.895785 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-351e65ed-6535-4fe5-9404-4dd9ca0f0870 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1223 microversion: 2.1 time: 0.117947 Oct 27 09:15:01.896619 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1730/3409] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:01 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:02.094869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:02.095843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:02.116456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:02.116969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:02.117416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:02.118145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:02.118611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:02.119077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:02.382318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:02.399095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:02.404383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:02.408724 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-75f2f851-beb5-4b8a-a394-bc0f8635c6a4 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1670 microversion: 2.20 time: 0.591939 Oct 27 09:15:02.420178 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1680/3410] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:01 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1670 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:02.448766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-806478245", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "8aa86863-8c60-413b-9747-3e375f601520"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:02.560066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:02.573405 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b237b5b-9470-4161-abc4-7d00c0a903ab tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1323 microversion: 2.1 time: 0.484380 Oct 27 09:15:02.574514 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1731/3411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:02 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1323 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:02.593781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:02.594692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:02.603790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:02.604062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] validate_networks() for [('8aa86863-8c60-413b-9747-3e375f601520', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:15:02.604582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:02.605301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:02.606316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:02.607103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:02.607793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:02.824005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:02.844027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:02.854453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:02.864031 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b45ff8fb-3971-416b-9f62-29fc66e6a064 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1335 microversion: 2.54 time: 0.287591 Oct 27 09:15:02.865858 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1732/3412] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:02 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1335 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:02.927247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:02.928359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:02.976441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:02.978436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:02.980729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:02.986831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:02.988461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:02.990634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:03.381011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:03.403976 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-876feaff-a57b-4694-970d-732ddec9430e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1219 microversion: 2.1 time: 0.482870 Oct 27 09:15:03.409935 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1733/3413] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:02 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1219 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:03.464819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:03.465610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:03.491419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:03.492058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:03.500316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:03.501249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:03.501919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:03.502179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:03.797828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:15:03.798370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:15:03.798798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:15:03.799264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:15:03.799880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:15:03.824189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:03.825175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:03.830038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:03.830874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:03.833383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:03.839167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:03.908949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:15:03.930648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Getting quotas for user e63dd72032ef4fe098382555888e3ae3 and project be73c8404fc741cfb680a7447af0f232. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:15:04.001524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:15:04.004633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:15:04.134704 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-184d90b7-1af1-457d-9af0-2285b6e4da7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.706065 Oct 27 09:15:04.136170 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1681/3414] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:15:04.144505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:04.146140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:04.154686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:04.155968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:04.157093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:04.158045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:04.158833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:04.159779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:05.090314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:05.124184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:05.125834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:05.127232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-76bd2ecb-bd35-44f8-85f3-1a81924fa8f0 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1670 microversion: 2.20 time: 1.681366 Oct 27 09:15:05.138036 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1734/3415] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:03 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1670 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:05.140622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:05.152293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:05.172817 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af6ec8bc-b1ed-4fc8-81aa-e4cc10342069 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1323 microversion: 2.1 time: 1.028452 Oct 27 09:15:05.176176 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1682/3416] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:04 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1323 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:05.179133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:05.191155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:05.195162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:05.212005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:05.216013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:05.216484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:05.217772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:05.218237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:05.218688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:05.225349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:05.234875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:05.235391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:05.237349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:05.237847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:05.240928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:05.538912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:05.548640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:05.550977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:05.552360 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91f7a5aa-5d7c-4090-94ec-2fd04a81c91a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1335 microversion: 2.54 time: 0.413151 Oct 27 09:15:05.552905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:05.564612 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f59c106f-1b4b-45f2-91f6-b3fad6b9cb53 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1211 microversion: 2.1 time: 0.386661 Oct 27 09:15:05.572134 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1735/3417] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:05 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1335 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:05.578332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:05.579261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:05.582215 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1683/3418] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:05 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1211 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:05.586579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:05.587282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:05.587909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:05.588610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:05.589059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:05.589480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:06.084832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:06.097634 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e8b600c4-45dc-488c-b5f1-878d2d86f356 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1281 microversion: 2.1 time: 0.523617 Oct 27 09:15:06.099595 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1736/3419] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:05 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1281 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:06.169235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:06.170622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:06.177838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:06.178706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:06.179374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:06.180333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:06.181187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:06.181763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:06.199912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:06.200581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:06.211144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:06.213406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:06.214134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:06.214793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:06.215247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:06.221403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:06.725652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:06.727383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:06.736774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:06.737528 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b4cc4365-5ed0-41a8-a30f-b0a91fa3b57e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1323 microversion: 2.1 time: 0.542171 Oct 27 09:15:06.738715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:06.740370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-091904e9-2b11-42ca-a9cc-97ac4fc14ace tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1672 microversion: 2.20 time: 0.575287 Oct 27 09:15:06.740769 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1737/3420] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:06 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1323 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:06.764407 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1684/3421] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:06 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1672 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:15:06.769063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:06.771621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:06.772660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:06.773438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:06.780522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:06.781218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:06.781821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:06.782738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:06.783365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:06.784030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:06.785232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:06.785928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:06.786384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:06.787757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:06.788673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:06.789648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:06.987324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:06.988173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:07.001270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:07.002711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:07.003871 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-622d90dc-61f4-4ab2-875f-b9b551ae8f3f tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1335 microversion: 2.54 time: 0.261982 Oct 27 09:15:07.006430 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53a5d8d5-0550-4e17-8938-c65ced9189cc tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1203 microversion: 2.1 time: 0.238010 Oct 27 09:15:07.009142 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1685/3422] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:06 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1203 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:07.020010 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1738/3423] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:06 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1335 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:07.122983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:07.124464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:07.140813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:07.146792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:07.149023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:07.150246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:07.151118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:07.151838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:07.398010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:07.409801 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2dc10702-1c94-412a-8e53-f034aa975930 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1281 microversion: 2.1 time: 0.292274 Oct 27 09:15:07.430566 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1686/3424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:07 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:07.697647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3ac2a782-6e24-4232-a000-a2b84872c740 req-a3bbafaf-018f-4cc3-98f8-25665ada900d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d339b0a-f7bc-4d58-90d1-e5d4beb1834e", "name": "network-vif-plugged", "status": "completed", "tag": "de3d506c-8d30-4307-947f-6fb004d3c625"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:07.743604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3ac2a782-6e24-4232-a000-a2b84872c740 req-a3bbafaf-018f-4cc3-98f8-25665ada900d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:07.745123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3ac2a782-6e24-4232-a000-a2b84872c740 req-a3bbafaf-018f-4cc3-98f8-25665ada900d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:07.746544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3ac2a782-6e24-4232-a000-a2b84872c740 req-a3bbafaf-018f-4cc3-98f8-25665ada900d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:07.770698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:07.771363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:07.783153 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3ac2a782-6e24-4232-a000-a2b84872c740 req-a3bbafaf-018f-4cc3-98f8-25665ada900d service nova] Creating event network-vif-plugged:de3d506c-8d30-4307-947f-6fb004d3c625 for instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e on n-h1-858383-16 Oct 27 09:15:07.783377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:07.783810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:07.784257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:07.786106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:07.786578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:07.788724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:07.797811 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3ac2a782-6e24-4232-a000-a2b84872c740 req-a3bbafaf-018f-4cc3-98f8-25665ada900d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104262 Oct 27 09:15:07.800042 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1739/3425] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:07.812607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:07.819129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:07.831432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:07.832640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:07.833787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:07.836208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:07.836863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:07.838974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:08.930113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:08.941918 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9e1e12d5-5910-43d9-99c9-fe5e23269810 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1323 microversion: 2.1 time: 1.176259 Oct 27 09:15:08.942527 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1687/3426] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:07 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1323 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:08.955520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:08.956171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:08.985461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:08.992870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:08.996532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:08.997016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:08.997781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.001557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:09.001787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.002175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:09.005918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:09.009616 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-70b67663-35c4-4566-9e79-6e066e95fafc tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 1.207113 Oct 27 09:15:09.011367 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1740/3427] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:07 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:09.036719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:09.037543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:09.062396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.063015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.063552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:09.066802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.067626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.068375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:09.123070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:09.285799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:09.288498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:09.297454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-940162d3-5f3a-4408-90c8-ebf0e4aa43e7 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1259 microversion: 2.1 time: 0.284754 Oct 27 09:15:09.300833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:09.303964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:09.308146 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1741/3428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:09 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1259 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:09.309185 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3013a22-d989-4cff-bdde-f0a54ebe98a4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1356 microversion: 2.54 time: 0.361665 Oct 27 09:15:09.311650 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1688/3429] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:08 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1356 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:09.319338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ef0f3e91-851c-48b8-a694-0c4470543cfa req-e638c9d1-1f9e-44e9-be62-3c38ac934241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119dcc89-5176-4b9f-b784-cba0bb8c1444", "name": "network-vif-deleted", "tag": "41e4ebd1-dbca-4093-be4e-10f1ad3b6519"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:09.336077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ef0f3e91-851c-48b8-a694-0c4470543cfa req-e638c9d1-1f9e-44e9-be62-3c38ac934241 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.336868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ef0f3e91-851c-48b8-a694-0c4470543cfa req-e638c9d1-1f9e-44e9-be62-3c38ac934241 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.337523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ef0f3e91-851c-48b8-a694-0c4470543cfa req-e638c9d1-1f9e-44e9-be62-3c38ac934241 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:09.346408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:09.347059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:09.358980 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ef0f3e91-851c-48b8-a694-0c4470543cfa req-e638c9d1-1f9e-44e9-be62-3c38ac934241 service nova] Creating event network-vif-deleted:41e4ebd1-dbca-4093-be4e-10f1ad3b6519 for instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 on n-h2-858383-16 Oct 27 09:15:09.366782 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ef0f3e91-851c-48b8-a694-0c4470543cfa req-e638c9d1-1f9e-44e9-be62-3c38ac934241 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051626 Oct 27 09:15:09.368160 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1689/3430] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:09.376797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.377305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.377745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:09.378456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.378907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.379332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:09.380182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-243478f8-87c7-46e3-b778-99d8679a6b74 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Action: 'create', calling method: .version_select at 0x7f31ae5bd5e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-138104561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4xJicvC5K4sW2nUg+cbnZlHmrfiJkD4ZgNLvDdzsQ/mHQrWwhwWMFZViXP/tXhFXJPdBnYCOgDPdzn85WhF+P1V0/vOdJx6pK61jX727LjfFfCkcIN3XRhkZYfc79G+g=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:09.407757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-243478f8-87c7-46e3-b778-99d8679a6b74 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Getting quotas for project bd11ea6fd55c4b5fb4a006ab6ace9fe7. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:15:09.414810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-243478f8-87c7-46e3-b778-99d8679a6b74 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Getting quotas for user 7ba42c0fc7b34ffaba25f5004dad583a and project bd11ea6fd55c4b5fb4a006ab6ace9fe7. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:15:09.473708 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-243478f8-87c7-46e3-b778-99d8679a6b74 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.103658 Oct 27 09:15:09.475119 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1690/3431] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Oct 27 09:15:09 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:15:09.499746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-138104561", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:09.508858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:09.528088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.531085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.534547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:09.535852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.536507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.539673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:09.736869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:15:09.737308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:15:09.737768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:15:09.740239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:15:09.740845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:15:09.809777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:09.887364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:09.910325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.910866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.911321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:09.912087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:09.912629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:09.918265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:10.043747 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9573c65b-4ccc-49ce-ae94-f7553aa8f90a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "POST /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102/action" status: 202 len: 1138 microversion: 2.54 time: 0.560845 Oct 27 09:15:10.069352 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1691/3432] 10.222.0.25 () {62 vars in 1320 bytes} [Thu Oct 27 09:15:09 2022] POST /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102/action => generated 1138 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 09:15:10.084443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:10.085125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:10.089289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=13,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:10.093641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:10.094143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:10.094747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:10.095650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:10.096113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:10.108407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:10.559992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:10.573688 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f66630d5-1720-42ae-8184-f8cc40cd7277 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 1.260919 Oct 27 09:15:10.575407 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1742/3433] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:09 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:10.593850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:10.596270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:10.618036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:10.620280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:10.621476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:10.625463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:10.626647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:10.628144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:10.831715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:10.840115 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5e3b76d-c1ca-4089-8637-6af1bc054e22 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1520 microversion: 2.1 time: 0.763805 Oct 27 09:15:10.840983 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1692/3434] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:10 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1520 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:10.846873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:10.847963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:10.854815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:10.855506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:10.856437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:10.857395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:10.858758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:10.859421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:10.985749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:10.995101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:11.001604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:11.002842 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-90ecfe20-ebd8-419c-a60b-fcb21eec3875 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.159982 Oct 27 09:15:11.006992 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1693/3435] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:10 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:11.014165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:11.021476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:11.033206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:11.033806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:11.034510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:11.035463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:11.036192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:11.036849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:11.487165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:11.572942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:11.595183 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc907a12-d594-4f18-9aa5-84aaee8322ab tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1265 microversion: 2.1 time: 0.586332 Oct 27 09:15:11.600522 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1694/3436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:11 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1265 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:11.615755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:11.616477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:11.629534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:11.630075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:11.631219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:11.631219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:11.631731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:11.632162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:11.650819 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] HTTP exception thrown: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Request method failure captured: Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 HTTP/1.1 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkspJeqHYNbNOtJ9KS5peVFgha0boPAv9Jeh1RQ9VJBDH7xNDgLgtzIpdPzAgBhKfLDn9ovsrZ2KSi8SG9zD0jGAEMPQOA-vruAfsXSZ7n8MfB-sVVV2aJCTAcMESfU0G6XuBdob-Zx3lqATPPcYInl4B6lTG32Ax3TQ9QHr38pT98w Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: f1472f8bee2d4303adf611315bcc6215 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2056773808 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1472f8bee2d4303adf611315bcc6215"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1472f8bee2d4303adf611315bcc6215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1472f8bee2d4303adf611315bcc6215"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1472f8bee2d4303adf611315bcc6215"}]}] Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2056773808 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: f1472f8bee2d4303adf611315bcc6215 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2056773808 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachSCSIVolumeTestJSON-2056773808-project Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 2e26a9a64a304845834c1c969e9a0131 Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2056773808-project Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '4c829e85-d998-438d-8574-2bd136bacf72'} Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:15:11.652307 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Returning 404 to user: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef377478-175e-4a42-9319-b827d3c46e7e tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 404 len: 111 microversion: 2.1 time: 0.051986 Oct 27 09:15:11.659128 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1695/3437] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:15:11 2022] DELETE /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:15:11.662615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e8f4bc8-2b0e-4b19-9e18-fb18dcd5575b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Action: 'create', calling method: .version_select at 0x7f31a9215040>, body: {"pool": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:11.765095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:11.778084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:11.780500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:11.782249 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7817b30-716c-4dee-b98e-d40cd29a9852 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 1.203301 Oct 27 09:15:11.783059 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1743/3438] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:10 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:11.792232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7968c348-b9bb-4567-813a-d105681b3177 req-83b47903-6cc6-4a98-9fc7-02f68f74954b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0460dce-a27a-4974-b3d5-71f416e50a61", "tag": "677bc06b-dbc9-4f90-b0d9-8b7d9f829e9c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:11.806094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7968c348-b9bb-4567-813a-d105681b3177 req-83b47903-6cc6-4a98-9fc7-02f68f74954b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:11.806769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7968c348-b9bb-4567-813a-d105681b3177 req-83b47903-6cc6-4a98-9fc7-02f68f74954b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:11.807199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7968c348-b9bb-4567-813a-d105681b3177 req-83b47903-6cc6-4a98-9fc7-02f68f74954b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:11.819948 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7968c348-b9bb-4567-813a-d105681b3177 req-83b47903-6cc6-4a98-9fc7-02f68f74954b service nova] Creating event network-changed:677bc06b-dbc9-4f90-b0d9-8b7d9f829e9c for instance a0460dce-a27a-4974-b3d5-71f416e50a61 on n-h2-858383-16 Oct 27 09:15:11.826156 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7968c348-b9bb-4567-813a-d105681b3177 req-83b47903-6cc6-4a98-9fc7-02f68f74954b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041346 Oct 27 09:15:11.827513 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1744/3439] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:11.833441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:11.834162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:11.841682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:11.842128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:11.842564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:11.843262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:11.843755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:11.844179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:11.895265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:12.421799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:12.429477 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-df250e64-4e56-49dd-b58c-68acc42ea229 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 0.600340 Oct 27 09:15:12.430057 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1745/3440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:11 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:12.435534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:12.436682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] [instance: 4c829e85-d998-438d-8574-2bd136bacf72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:12.442502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:12.442972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:12.444177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:12.445272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:12.445725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:12.446152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:12.461345 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] HTTP exception thrown: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Request method failure captured: Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 HTTP/1.1 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkspJeqHYNbNOtJ9KS5peVFgha0boPAv9Jeh1RQ9VJBDH7xNDgLgtzIpdPzAgBhKfLDn9ovsrZ2KSi8SG9zD0jGAEMPQOA-vruAfsXSZ7n8MfB-sVVV2aJCTAcMESfU0G6XuBdob-Zx3lqATPPcYInl4B6lTG32Ax3TQ9QHr38pT98w Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: f1472f8bee2d4303adf611315bcc6215 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2056773808 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1472f8bee2d4303adf611315bcc6215"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1472f8bee2d4303adf611315bcc6215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1472f8bee2d4303adf611315bcc6215"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1472f8bee2d4303adf611315bcc6215"}]}] Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2056773808 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: f1472f8bee2d4303adf611315bcc6215 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2056773808 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachSCSIVolumeTestJSON-2056773808-project Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 2e26a9a64a304845834c1c969e9a0131 Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2056773808-project Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4c829e85-d998-438d-8574-2bd136bacf72'} Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:12.462983 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] Returning 404 to user: Instance 4c829e85-d998-438d-8574-2bd136bacf72 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-73d9e0a4-4e1d-4097-8ecf-bcb2b6790d16 tempest-AttachSCSIVolumeTestJSON-2056773808 tempest-AttachSCSIVolumeTestJSON-2056773808-project] 10.222.0.25 "GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72" status: 404 len: 111 microversion: 2.1 time: 0.033159 Oct 27 09:15:12.467253 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1746/3441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:12 2022] GET /compute/v2.1/servers/4c829e85-d998-438d-8574-2bd136bacf72 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:15:12.470604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:12.471214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:12.476531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:12.478998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:12.479519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:12.480113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:12.481353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:12.481973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:12.482590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:12.669662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:12.681531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:12.683026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:12.685167 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c403c130-e7c7-4517-be1e-8f757f6629c9 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.218584 Oct 27 09:15:12.686284 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1747/3442] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:12 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:12.691623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8333f60a-eeae-4632-b4f8-631ff04392a8 req-e69810a4-72bb-44f6-a95d-3da8a3009b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe57d00-6179-49d1-99ef-7a9df351eb95", "tag": "97f92e5a-4709-4a48-acf2-272d213c7a56"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:12.702868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8333f60a-eeae-4632-b4f8-631ff04392a8 req-e69810a4-72bb-44f6-a95d-3da8a3009b84 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:12.703649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8333f60a-eeae-4632-b4f8-631ff04392a8 req-e69810a4-72bb-44f6-a95d-3da8a3009b84 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:12.704321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8333f60a-eeae-4632-b4f8-631ff04392a8 req-e69810a4-72bb-44f6-a95d-3da8a3009b84 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:12.718050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8333f60a-eeae-4632-b4f8-631ff04392a8 req-e69810a4-72bb-44f6-a95d-3da8a3009b84 service nova] Creating event network-changed:97f92e5a-4709-4a48-acf2-272d213c7a56 for instance ffe57d00-6179-49d1-99ef-7a9df351eb95 on n-h1-858383-16 Oct 27 09:15:12.728576 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8333f60a-eeae-4632-b4f8-631ff04392a8 req-e69810a4-72bb-44f6-a95d-3da8a3009b84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040516 Oct 27 09:15:12.729341 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1748/3443] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:12.739345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:12.740550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:12.758452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:12.759504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:12.760503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:12.761694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:12.762691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:12.763320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:13.424139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:13.438126 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82f183c5-773d-41cc-a04c-e26da6218a5c tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.706281 Oct 27 09:15:13.439315 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1749/3444] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:12 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:13.446397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:13.447214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:13.456627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:13.457249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:13.457798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:13.459033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:13.459591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:13.460093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:13.883820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:14.287069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:14.306888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:14.312182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:14.320924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e312fe2c-c3ee-4b3b-aca6-bc58b039fbdd tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.876850 Oct 27 09:15:14.323663 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1750/3445] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:13 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:14.355887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:14.358692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:14.369178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:14.369884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:14.370570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:14.371530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:14.372624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:14.373250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:15.833228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:15.851113 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f381371d-70a3-4751-84c6-cf55271800ed tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 1.522935 Oct 27 09:15:15.851760 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1751/3446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:14 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:15.864525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:15.865486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:15.879538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:15.881719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:15.882104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:15.883103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:15.884683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:15.885507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:16.282948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:16.299394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:16.316522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:16.323077 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f4119984-9281-4e66-ab7d-c819a7e7e57b tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.468953 Oct 27 09:15:16.349138 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1752/3447] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:15 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:16.387422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:16.398605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:16.407104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:16.408253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:16.410381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:16.411759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:16.413927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:16.416454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:17.274601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:17.295878 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43d00756-4a83-46a2-a794-643c782b299a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.941449 Oct 27 09:15:17.311662 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1753/3448] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:16 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:17.329047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-98a4fdbb-70d4-4793-a53c-a549951b913c req-c9a72146-0bbb-4458-8f3b-08f0765af84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006b29e2-6978-427b-a0d6-c42e4829bf23", "tag": "adbc8770-5ce9-4b35-8b14-327b6bd1104b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:17.369303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-98a4fdbb-70d4-4793-a53c-a549951b913c req-c9a72146-0bbb-4458-8f3b-08f0765af84c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:17.369786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-98a4fdbb-70d4-4793-a53c-a549951b913c req-c9a72146-0bbb-4458-8f3b-08f0765af84c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:17.386677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-98a4fdbb-70d4-4793-a53c-a549951b913c req-c9a72146-0bbb-4458-8f3b-08f0765af84c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:17.416841 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-98a4fdbb-70d4-4793-a53c-a549951b913c req-c9a72146-0bbb-4458-8f3b-08f0765af84c service nova] Creating event network-changed:adbc8770-5ce9-4b35-8b14-327b6bd1104b for instance 006b29e2-6978-427b-a0d6-c42e4829bf23 on n-h1-858383-16 Oct 27 09:15:17.426146 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-98a4fdbb-70d4-4793-a53c-a549951b913c req-c9a72146-0bbb-4458-8f3b-08f0765af84c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124503 Oct 27 09:15:17.427294 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1754/3449] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:17.435143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:17.436854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:17.446387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:17.447137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:17.447828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:17.448711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:17.449360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:17.449969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:17.531142 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e8f4bc8-2b0e-4b19-9e18-fb18dcd5575b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.872388 Oct 27 09:15:17.532098 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1696/3450] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:15:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:17.537287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:17.538388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:17.560261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:17.561076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:17.568055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:17.569599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:17.570752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:17.573054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:18.486687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:18.505547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:18.507367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:18.508954 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f85d6ab-aa1e-44cc-9da3-996384861e49 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 1.080324 Oct 27 09:15:18.509685 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1755/3451] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:17 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:18.527853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:18.528909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:18.537646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:18.544647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:18.545565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:18.546641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:18.547313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:18.548003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:18.591879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:18.606674 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4c754116-760c-4847-83d2-09c8977b7bf2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 1.073251 Oct 27 09:15:18.610959 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1697/3452] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:17 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:18.629109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1521061144", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ab13eded-e8f5-4da5-879a-e47232da5d73"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:18.797381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] validate_networks() for [('ab13eded-e8f5-4da5-879a-e47232da5d73', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:15:18.994288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:19.010835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:19.012980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:19.015415 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-26818bd5-e441-40e8-b5fb-2b7869f00bdd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.504362 Oct 27 09:15:19.016027 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1756/3453] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:18 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:19.034998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:19.035937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:19.054699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:19.056102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:19.057079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:19.058109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:19.060260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:19.061179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:19.425647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=22 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:20.032631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:20.047130 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a829a2e7-46e5-45cf-8961-a5a147db8d20 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 1.014591 Oct 27 09:15:20.052562 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1757/3454] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:19 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:20.719822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-beff7983-28e5-428b-bfcc-978fa17d5023 req-d5905d85-88df-497d-b1a9-fa1a9731eefb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0460dce-a27a-4974-b3d5-71f416e50a61", "name": "network-vif-plugged", "status": "completed", "tag": "677bc06b-dbc9-4f90-b0d9-8b7d9f829e9c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:20.741726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-beff7983-28e5-428b-bfcc-978fa17d5023 req-d5905d85-88df-497d-b1a9-fa1a9731eefb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:20.742481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-beff7983-28e5-428b-bfcc-978fa17d5023 req-d5905d85-88df-497d-b1a9-fa1a9731eefb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:20.745307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-beff7983-28e5-428b-bfcc-978fa17d5023 req-d5905d85-88df-497d-b1a9-fa1a9731eefb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:20.775912 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-beff7983-28e5-428b-bfcc-978fa17d5023 req-d5905d85-88df-497d-b1a9-fa1a9731eefb service nova] Creating event network-vif-plugged:677bc06b-dbc9-4f90-b0d9-8b7d9f829e9c for instance a0460dce-a27a-4974-b3d5-71f416e50a61 on n-h2-858383-16 Oct 27 09:15:20.787430 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-beff7983-28e5-428b-bfcc-978fa17d5023 req-d5905d85-88df-497d-b1a9-fa1a9731eefb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.733134 Oct 27 09:15:20.788529 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1758/3455] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:20.805612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:20.806773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:20.815042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:20.818100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:20.820078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:20.820963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:20.822084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:20.824336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.110778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:15:21.111354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:15:21.111790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:15:21.112274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:15:21.112691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:15:21.114592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:21.123128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:21.124973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:21.126083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:21.126582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:21.126794 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-babcfe56-f30a-4f66-a002-3596fdb58eca tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.337003 Oct 27 09:15:21.127529 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1759/3456] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:20 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:21.132362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a6030b34-8a92-4940-9c8f-220896568ff3 req-91fb50a0-18dc-4b22-a036-bfed1497e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8901fe0-0223-4b98-9a13-90cb604273b9", "tag": "573acdf5-4df7-4810-b86c-7e8b4a077454"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:21.142645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a6030b34-8a92-4940-9c8f-220896568ff3 req-91fb50a0-18dc-4b22-a036-bfed1497e8aa service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:21.143407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a6030b34-8a92-4940-9c8f-220896568ff3 req-91fb50a0-18dc-4b22-a036-bfed1497e8aa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:21.144103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a6030b34-8a92-4940-9c8f-220896568ff3 req-91fb50a0-18dc-4b22-a036-bfed1497e8aa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.145543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.146576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:21.147079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:21.147889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.167750 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a6030b34-8a92-4940-9c8f-220896568ff3 req-91fb50a0-18dc-4b22-a036-bfed1497e8aa service nova] Creating event network-changed:573acdf5-4df7-4810-b86c-7e8b4a077454 for instance b8901fe0-0223-4b98-9a13-90cb604273b9 on n-h2-858383-16 Oct 27 09:15:21.176534 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a6030b34-8a92-4940-9c8f-220896568ff3 req-91fb50a0-18dc-4b22-a036-bfed1497e8aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047571 Oct 27 09:15:21.177754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1760/3457] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:21.184422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Getting quotas for project 1469f50688644411a306ae4f0305d56c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:15:21.184870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:21.185650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:21.194527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:21.195292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:21.196057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.196858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:21.197325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:21.197817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.200747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Getting quotas for user 9b4eb0adbf5d4df5b292794045947ee1 and project 1469f50688644411a306ae4f0305d56c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:15:21.252984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:15:21.255373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:15:21.318311 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33d6c874-7e74-4d68-97c8-2d28475cdd31 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.705672 Oct 27 09:15:21.320373 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1698/3458] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:15:21.328542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:21.329495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:21.337359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:21.338111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:21.338737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.339785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:21.340468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:21.342441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.531534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:21.548857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:21.550208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:21.551457 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d42d45a6-f23f-492a-99db-a65005fc26a2 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.229791 Oct 27 09:15:21.552292 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1699/3459] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:21 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:21.562961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:21.563922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:21.565858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:21.578395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:21.578877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:21.579334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.580136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:21.580578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:21.581011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:21.582547 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7cce67f4-3a95-4680-8efb-f82a75207a24 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 0.402663 Oct 27 09:15:21.583369 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1761/3460] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:21 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:21.592924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e25e527-b6fe-4464-bc16-9f619f3d4a20 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:21.594322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e25e527-b6fe-4464-bc16-9f619f3d4a20 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:21.673871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e25e527-b6fe-4464-bc16-9f619f3d4a20 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:21.682493 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e25e527-b6fe-4464-bc16-9f619f3d4a20 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1224 microversion: 2.1 time: 0.096839 Oct 27 09:15:21.684558 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1762/3461] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:21 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:21.824906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:21.835737 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19555384-25b8-4acb-ba16-175b6b0a7ec6 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.281888 Oct 27 09:15:21.837380 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1700/3462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:21 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:22.159382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:22.161513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:22.180788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:22.182598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:22.183235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:22.185674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:22.187308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:22.188840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:22.245985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:22.580515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:22.582298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:22.604848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:22.605635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:22.606312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:22.607253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:22.607973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:22.608561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:23.354142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:23.367425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:23.369066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:23.374813 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b11af685-9b07-46b8-81ff-d862bdcefd7c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 1.218101 Oct 27 09:15:23.378742 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1763/3463] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:22 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:23.389959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:23.391621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:23.407531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:23.408346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:23.411846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:23.412847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:23.413486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:23.414079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:23.524150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:23.540652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:23.545027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:23.559004 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a91039f4-07ef-41df-8a37-1d7a560f12b7 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.971080 Oct 27 09:15:23.561291 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1701/3464] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:22 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:23.575409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:23.578485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:23.603413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:23.608209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:23.609683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:23.611961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:23.615991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:23.616707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:23.938260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:23.957731 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-93b36f35-b593-4ca6-9d85-676b1f2a26a4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1294 microversion: 2.1 time: 0.395031 Oct 27 09:15:23.971801 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1702/3465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:23 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1294 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:23.971801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:23.978933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:24.004849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:24.006445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:24.009195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:24.011391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:24.014767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:24.015524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:24.868427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:24.890793 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5963162a-6234-4c99-84eb-8291252eaa48 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 1.510695 Oct 27 09:15:24.895710 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1764/3466] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:23 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:24.908117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d2f21209-a50f-4590-aa58-254ce86fa415 req-d67d5a78-6131-4bb8-8203-2c92c145bf26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe57d00-6179-49d1-99ef-7a9df351eb95", "name": "network-vif-plugged", "status": "completed", "tag": "97f92e5a-4709-4a48-acf2-272d213c7a56"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:24.924459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d2f21209-a50f-4590-aa58-254ce86fa415 req-d67d5a78-6131-4bb8-8203-2c92c145bf26 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:24.925114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d2f21209-a50f-4590-aa58-254ce86fa415 req-d67d5a78-6131-4bb8-8203-2c92c145bf26 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:24.925728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d2f21209-a50f-4590-aa58-254ce86fa415 req-d67d5a78-6131-4bb8-8203-2c92c145bf26 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:24.950067 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d2f21209-a50f-4590-aa58-254ce86fa415 req-d67d5a78-6131-4bb8-8203-2c92c145bf26 service nova] Creating event network-vif-plugged:97f92e5a-4709-4a48-acf2-272d213c7a56 for instance ffe57d00-6179-49d1-99ef-7a9df351eb95 on n-h1-858383-16 Oct 27 09:15:24.956842 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d2f21209-a50f-4590-aa58-254ce86fa415 req-d67d5a78-6131-4bb8-8203-2c92c145bf26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058612 Oct 27 09:15:24.960210 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1765/3467] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:25.001033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:25.002054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:25.015315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:25.016503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:25.017656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:25.018631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:25.019342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:25.020381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:25.020708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:25.055365 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2fd95618-ada3-44a8-9c6e-5636de8dc951 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 1.088597 Oct 27 09:15:25.059317 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1703/3468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:23 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:25.071102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:25.079368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:25.102542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:25.102914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:25.103343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:25.111985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:25.113064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:25.118044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:25.496219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:25.515511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:25.520368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:25.524770 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2d3411b8-23d0-4aec-9ab6-919ea46a53bd tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.464194 Oct 27 09:15:25.537536 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1704/3469] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:25 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:25.555915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:25.560063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:25.582643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:25.583167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:25.583641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:25.587911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:25.590168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:25.591092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:25.732699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:25.746150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:25.748482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:25.752560 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7bb5d934-8d18-4c23-975c-20bad84e8391 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.790136 Oct 27 09:15:25.756115 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1766/3470] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:24 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:25.919476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:25.921689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:25.936782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:25.952241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:25.953102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:25.955443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:25.959943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:25.968757 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abae31e3-a23c-4dd6-9bcb-81c74c3b91fa tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1324 microversion: 2.1 time: 0.430031 Oct 27 09:15:25.969777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:25.970463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:25.972883 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1705/3471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:25 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1324 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:26.083344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:26.084245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:26.095395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:26.096114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:26.101850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:26.102786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:26.104700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:26.105256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:26.401654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:26.414438 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cabee16c-c60c-4a31-941a-f80c49c583f3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 0.498684 Oct 27 09:15:26.431618 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1767/3472] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:25 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:26.560157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:26.561221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:26.575310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:26.576021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:26.576567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:26.577399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:26.577986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:26.578520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:26.688771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:26.699647 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50cb5ce7-3dbd-47fe-b626-ebcbf1817c1d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.620626 Oct 27 09:15:26.704526 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1706/3473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:26 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:26.758629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:26.768666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:26.781010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:26.782735 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c5f54ee9-1061-47ef-ab24-7bedf5d8526c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.226202 Oct 27 09:15:26.788761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:26.789488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:26.798970 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1768/3474] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:26 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:26.801434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:26.803821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:26.816260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:26.817935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:26.820522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:26.826706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:26.999499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:27.001843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:27.011849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:27.012898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:27.016211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:27.017262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:27.017957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:27.018636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:27.440979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:27.449441 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-498e5367-7956-435b-b8e3-98300c23c472 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1324 microversion: 2.1 time: 0.453685 Oct 27 09:15:27.454537 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1769/3475] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:26 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:27.463147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:27.469107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:27.483229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:27.484033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:27.484639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:27.485523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:27.486147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:27.489300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:27.568086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:27.610292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:27.619960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:27.630209 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a533473-5a7c-4dcc-899a-e68f3b755f23 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.839298 Oct 27 09:15:27.635140 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1707/3476] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:26 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:27.724401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:27.725198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:27.809378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:27.812509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:27.813313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:27.814336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:27.815049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:27.815973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:28.015478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:28.025690 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f9bb9dd-c7cd-46e9-8296-75d013ceccea tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 0.569791 Oct 27 09:15:28.040184 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1770/3477] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:27 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:28.059987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:28.061163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:28.071651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:28.072418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:28.073103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:28.074027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:28.074686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:28.075352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:28.296299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:28.314706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:28.321326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:28.324205 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25cb145b-6cec-4830-b650-f9020b932f21 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.282805 Oct 27 09:15:28.326651 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1771/3478] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:28 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:28.348607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-bcdab172-01ca-4b69-8de9-074f8e027d2e req-341d5345-96d3-41c7-b019-87d7c9e0a9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006b29e2-6978-427b-a0d6-c42e4829bf23", "name": "network-vif-plugged", "status": "completed", "tag": "adbc8770-5ce9-4b35-8b14-327b6bd1104b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:28.360311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bcdab172-01ca-4b69-8de9-074f8e027d2e req-341d5345-96d3-41c7-b019-87d7c9e0a9b6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:28.361227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bcdab172-01ca-4b69-8de9-074f8e027d2e req-341d5345-96d3-41c7-b019-87d7c9e0a9b6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:28.362141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bcdab172-01ca-4b69-8de9-074f8e027d2e req-341d5345-96d3-41c7-b019-87d7c9e0a9b6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:28.393358 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-bcdab172-01ca-4b69-8de9-074f8e027d2e req-341d5345-96d3-41c7-b019-87d7c9e0a9b6 service nova] Creating event network-vif-plugged:adbc8770-5ce9-4b35-8b14-327b6bd1104b for instance 006b29e2-6978-427b-a0d6-c42e4829bf23 on n-h1-858383-16 Oct 27 09:15:28.399288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-bcdab172-01ca-4b69-8de9-074f8e027d2e req-341d5345-96d3-41c7-b019-87d7c9e0a9b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066499 Oct 27 09:15:28.400955 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1772/3479] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:28.630030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:28.640344 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5a3e726-a7c3-4f6e-9fcf-a64a560efc01 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.921583 Oct 27 09:15:28.656846 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1708/3480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:27 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:28.672684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:28.673591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:28.686992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:28.691201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:28.691899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:28.694291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:28.695507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:28.698439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:28.934966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3d867876-5c3d-46c1-9218-5f754aa30bde req-256a5e25-ca49-48e7-884d-668f440d4562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5733e89b-e5f0-455b-b596-16f0f6a280d3", "tag": "7c621738-d4dc-44f3-99b9-b323bf8f3ad3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:28.978033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3d867876-5c3d-46c1-9218-5f754aa30bde req-256a5e25-ca49-48e7-884d-668f440d4562 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:28.978617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3d867876-5c3d-46c1-9218-5f754aa30bde req-256a5e25-ca49-48e7-884d-668f440d4562 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:28.978998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3d867876-5c3d-46c1-9218-5f754aa30bde req-256a5e25-ca49-48e7-884d-668f440d4562 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:29.013246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3d867876-5c3d-46c1-9218-5f754aa30bde req-256a5e25-ca49-48e7-884d-668f440d4562 service nova] Creating event network-changed:7c621738-d4dc-44f3-99b9-b323bf8f3ad3 for instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 on n-h1-858383-16 Oct 27 09:15:29.026066 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3d867876-5c3d-46c1-9218-5f754aa30bde req-256a5e25-ca49-48e7-884d-668f440d4562 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.622905 Oct 27 09:15:29.028457 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1773/3481] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:29.040248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:29.041430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:29.054548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:29.055399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:29.056155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:29.057285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:29.074995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:29.077821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:29.298598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:29.306228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:29.316514 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8969455-b3d0-4363-92db-cf36174d83e6 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1324 microversion: 2.1 time: 0.650854 Oct 27 09:15:29.319753 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1709/3482] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:28 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1324 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:29.348235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:29.352281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:29.372805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:29.376511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:29.378264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:29.379256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:29.381290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:29.384630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:29.429035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:29.439862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:29.441447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:29.442710 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ecc37e0a-a47a-4cb3-8174-9939c8307475 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.412424 Oct 27 09:15:29.451544 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1774/3483] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:29 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:29.469742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:29.471851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:29.489840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:29.492449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:29.494380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:29.495821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:29.499818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:29.501059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:29.634232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:29.647457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:29.653369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:29.657717 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9bfd802e-b0f4-4372-8dd0-c6c0e3ccea2d tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.203836 Oct 27 09:15:29.660557 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1775/3484] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:29 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:29.679889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:29.680795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:29.691607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:29.692430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:29.693056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:29.696804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:29.697474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:29.698102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:29.709540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:29.727244 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ff7f526-fe08-470e-8e5e-291c4dcb90ef tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 0.386135 Oct 27 09:15:29.731402 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1710/3485] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:29 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:30.005819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:30.021847 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e48c8f3-642f-4b5c-9deb-fc0e3b427f2e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.356488 Oct 27 09:15:30.023588 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1776/3486] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:29 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:30.360256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:30.361106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:30.383988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:30.385074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:30.385849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:30.387231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:30.396476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:30.397563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:30.470471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:30.471170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:30.478699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:30.479202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:30.479664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:30.480391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:30.480946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:30.481471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:30.636477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:30.648743 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4adf0433-3750-43b0-8c38-513549cf96d2 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1324 microversion: 2.1 time: 0.302253 Oct 27 09:15:30.650499 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1711/3487] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:30 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:30.656822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8168a935-f1d3-4ae0-baa3-5aed75c25c01 req-2ba90f31-b1bd-4172-a0c2-f7b2485b4a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8901fe0-0223-4b98-9a13-90cb604273b9", "name": "network-vif-plugged", "status": "completed", "tag": "573acdf5-4df7-4810-b86c-7e8b4a077454"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:30.667249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8168a935-f1d3-4ae0-baa3-5aed75c25c01 req-2ba90f31-b1bd-4172-a0c2-f7b2485b4a59 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:30.668143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8168a935-f1d3-4ae0-baa3-5aed75c25c01 req-2ba90f31-b1bd-4172-a0c2-f7b2485b4a59 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:30.668803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8168a935-f1d3-4ae0-baa3-5aed75c25c01 req-2ba90f31-b1bd-4172-a0c2-f7b2485b4a59 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:30.684042 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8168a935-f1d3-4ae0-baa3-5aed75c25c01 req-2ba90f31-b1bd-4172-a0c2-f7b2485b4a59 service nova] Creating event network-vif-plugged:573acdf5-4df7-4810-b86c-7e8b4a077454 for instance b8901fe0-0223-4b98-9a13-90cb604273b9 on n-h2-858383-16 Oct 27 09:15:30.693293 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8168a935-f1d3-4ae0-baa3-5aed75c25c01 req-2ba90f31-b1bd-4172-a0c2-f7b2485b4a59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041384 Oct 27 09:15:30.693927 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1712/3488] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:30.704149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:30.708568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:30.711953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:30.712575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:30.714806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:30.717014 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c46fc566-5f51-45c0-b792-a1e6cc13ea6b tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.250632 Oct 27 09:15:30.723876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:30.725075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:30.725815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:30.726883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:30.727889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:30.728802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:30.732037 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1777/3489] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:30 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:15:30.759306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:30.759964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:30.767435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:30.768406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:30.769029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:30.770654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:30.771264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:30.771901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:30.821028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:30.833246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:30.835424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:30.836929 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e61f49fa-e5cb-46b4-a4a6-78c21aac384a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.141899 Oct 27 09:15:30.837663 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1713/3490] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:30 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:30.939669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:30.947533 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-52c135c4-ccc0-405c-8663-dfe1a35fb222 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 0.193697 Oct 27 09:15:30.948977 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1778/3491] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:30 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:31.045441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.046126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:31.052616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:31.053365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:31.053936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:31.055397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:31.056149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:31.057174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:31.169463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:31.217480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:31.225529 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-64b9affe-2a73-460a-bab5-1353cb89db49 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.183935 Oct 27 09:15:31.226694 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1714/3492] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:31.373456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ce19d7ee-0f2c-4217-bde5-3a5d6e730ed9 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.381257 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ce19d7ee-0f2c-4217-bde5-3a5d6e730ed9 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.276194 Oct 27 09:15:31.381825 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1779/3493] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:15:31.395498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eaa6832d-d610-4985-a2d8-774b589d0df1 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.401836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:31.420407 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eaa6832d-d610-4985-a2d8-774b589d0df1 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.028305 Oct 27 09:15:31.421004 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1715/3494] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:31.439705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-964a75c3-3c71-404a-8de8-56719b07fa5f tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.458414 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-964a75c3-3c71-404a-8de8-56719b07fa5f tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023208 Oct 27 09:15:31.459029 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1780/3495] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:31.472467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6374601f-656f-43a1-a0f3-06400e1e5e47 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.480338 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6374601f-656f-43a1-a0f3-06400e1e5e47 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011960 Oct 27 09:15:31.480919 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1716/3496] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:31.493457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2cdb9d7d-a649-42d6-86d9-981fba5428d2 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.520476 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2cdb9d7d-a649-42d6-86d9-981fba5428d2 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.030795 Oct 27 09:15:31.521059 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1781/3497] 10.222.0.25 () {58 vars in 1165 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:31.538032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77f32413-70f3-41ae-af3c-c0a8110c6953 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.546963 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77f32413-70f3-41ae-af3c-c0a8110c6953 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012953 Oct 27 09:15:31.547528 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1717/3498] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:31.559424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fee1677c-bdbf-41e1-99e9-896db20f5e5b tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.584505 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fee1677c-bdbf-41e1-99e9-896db20f5e5b tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.028560 Oct 27 09:15:31.584922 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1782/3499] 10.222.0.25 () {58 vars in 1169 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:31.604757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc322ad1-a3ca-457b-8ded-d87d3b28fa4a tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.620178 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc322ad1-a3ca-457b-8ded-d87d3b28fa4a tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.019090 Oct 27 09:15:31.620805 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1718/3500] 10.222.0.25 () {58 vars in 1161 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:31.637754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3df0ea75-82c3-49af-b134-1e9f16a5567e tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.643434 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3df0ea75-82c3-49af-b134-1e9f16a5567e tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011929 Oct 27 09:15:31.644451 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1783/3501] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:31.657118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-324977a9-4734-4897-b257-216db78487ce tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.674309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.674934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:31.681403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:31.683560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:31.684055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:31.684689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:31.686572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:31.686572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:31.687113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:31.696950 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-324977a9-4734-4897-b257-216db78487ce tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.043812 Oct 27 09:15:31.697556 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1719/3502] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:31.713821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19626ff5-dcdf-461d-8bad-f48142ecd1ba tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.722998 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19626ff5-dcdf-461d-8bad-f48142ecd1ba tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012985 Oct 27 09:15:31.723605 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1720/3503] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:15:31.736246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1020383-fe65-4c11-9fce-2aa12039757b tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.764751 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1020383-fe65-4c11-9fce-2aa12039757b tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.033066 Oct 27 09:15:31.765300 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1721/3504] 10.222.0.25 () {58 vars in 1144 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:31.779959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.780676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:31.791371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:31.791970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:31.792430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:31.793136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:31.793602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:31.794037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:31.853760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:31.880222 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-06c07b39-5e06-4e83-befd-b26c86f7c54c tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1324 microversion: 2.1 time: 0.210139 Oct 27 09:15:31.892287 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1784/3505] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1324 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:31.901481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49c6103c-0ba0-4db1-a694-9fee1ed52482 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.910801 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49c6103c-0ba0-4db1-a694-9fee1ed52482 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016963 Oct 27 09:15:31.911404 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1785/3506] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:31.923904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:31.924847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:31.931518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:31.932120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:31.932643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:31.933410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:31.933965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:31.934400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:31.972163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:31.985046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:31.986611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:31.988938 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebbeaad8-51cd-42ed-8945-25c46370609e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.219199 Oct 27 09:15:31.989545 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1722/3507] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:31.996905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0a290701-90b5-45e9-bdaf-a891e270fcc1 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:32.010151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:32.021152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:32.023984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:32.025613 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-164b6676-4074-4f76-9b25-8a4102713ae4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.112867 Oct 27 09:15:32.026351 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1786/3508] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:32.031444 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0a290701-90b5-45e9-bdaf-a891e270fcc1 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.040789 Oct 27 09:15:32.032184 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1723/3509] 10.222.0.25 () {58 vars in 1148 bytes} [Thu Oct 27 09:15:31 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:32.032634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:32.033477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:32.048318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:32.048810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:32.049243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:32.050130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:32.051000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:32.051261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:32.055300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bbcbb2d3-8c9c-478f-a37b-a3fb67e0d2d5 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:32.069264 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bbcbb2d3-8c9c-478f-a37b-a3fb67e0d2d5 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017650 Oct 27 09:15:32.080498 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1724/3510] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Oct 27 09:15:32 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:32.086815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4ab56b9-eab5-49bb-ab71-7a8d490e4647 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:32.103867 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f4ab56b9-eab5-49bb-ab71-7a8d490e4647 tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019233 Oct 27 09:15:32.103867 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1725/3511] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:15:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:32.115070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a73083b2-0e78-404f-9ada-7e04e866f7aa tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:32.137827 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a73083b2-0e78-404f-9ada-7e04e866f7aa tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.027454 Oct 27 09:15:32.139050 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1726/3512] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:15:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:32.153521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08f62ac9-4f30-4701-acff-effb9a091cbb tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:32.175596 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08f62ac9-4f30-4701-acff-effb9a091cbb tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026157 Oct 27 09:15:32.176186 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1727/3513] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:15:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:32.194152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0681fdae-8059-4a97-9e1d-3cde98f8bb6e tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:32.202550 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0681fdae-8059-4a97-9e1d-3cde98f8bb6e tempest-FlavorsV2TestJSON-181364140 tempest-FlavorsV2TestJSON-181364140-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012101 Oct 27 09:15:32.203108 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1728/3514] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:15:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:15:32.248484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:32.249113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:32.256233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:32.257005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:32.257623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:32.258515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:32.259319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:32.259978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:32.262945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:32.268819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:32.281034 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-744b3bc0-0206-405f-ba8e-a06729e7c898 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1323 microversion: 2.1 time: 0.250715 Oct 27 09:15:32.284987 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1787/3515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:32 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1323 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:32.487443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:32.496580 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0d285eb-b33b-4ad1-b8c3-266cfc40bf4e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.251895 Oct 27 09:15:32.497325 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1729/3516] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:32 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:32.906366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:32.907850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:32.915013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:32.915612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:32.916123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:32.917100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:32.917616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:32.918151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.020554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:33.022421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:33.031392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.032953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.033619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.034554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.035348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.035978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.095967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.104693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2219f439-7a20-4e9e-95a6-1c3d40a76aad tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1324 microversion: 2.1 time: 0.201654 Oct 27 09:15:33.105330 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1788/3517] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:32 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:33.133889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:33.135251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:33.152934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.154823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.156733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.157506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.157986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.158417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.276244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.287164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.289042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.290472 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df002117-a2ad-4971-b467-d96dca50949c tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.276066 Oct 27 09:15:33.300309 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1730/3518] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:33 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:15:33.313624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.314151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:33.317060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:33.325144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.327988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.329561 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46ef887f-de5d-487c-a8da-54400da3dc50 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.211044 Oct 27 09:15:33.330716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1789/3519] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:33 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:33.349909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.351548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.354943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.356162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.363078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.363767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.522744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:33.523641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:33.530820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.531307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.531791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.532699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.533086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.533505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.561855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.590212 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd5e771d-5f3b-4650-93f1-6a358b3fe308 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 200 len: 1516 microversion: 2.1 time: 0.287479 Oct 27 09:15:33.590902 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1731/3520] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:33 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:33.618953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:33.619596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: a0460dce-a27a-4974-b3d5-71f416e50a61] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:33.636204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.636713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.637157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.647261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.652003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.652745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.774325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.782759 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d8f412b0-e274-4cdc-8275-29ee8c257187 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.264452 Oct 27 09:15:33.787925 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1790/3521] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:33 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:33.880343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:33.889472 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38b465cb-ce9c-4cff-8c29-54f67b6101fa tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61" status: 200 len: 1515 microversion: 2.1 time: 0.276070 Oct 27 09:15:33.890066 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1732/3522] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:33 2022] GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:33.915260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:33.915994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:33.927783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.927783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.927783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:33.927783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:33.927783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:33.927783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.129696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:34.130627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:34.137468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:34.137670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.139352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.139919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.140739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.141641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.142083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.151524 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ddbb6cd-089f-44d2-ac69-06ac78da8202 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95" status: 200 len: 1515 microversion: 2.1 time: 0.242524 Oct 27 09:15:34.153142 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1791/3523] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:33 2022] GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:34.210935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:34.211522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:34.223600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.225350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.226141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.227261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.230918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.233943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.290027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:15:34.432314 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ede8b598-31bd-4140-bd40-3e1834c35712 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95" status: 204 len: 0 microversion: 2.1 time: 0.255119 Oct 27 09:15:34.433357 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1792/3524] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:15:34 2022] DELETE /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:34.439511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:34.440233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:34.443215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:34.447092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.448617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.449064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.450163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.451080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.451699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.457114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:34.486269 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72711326-6194-43a7-9baf-12983ec4d9c0 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1324 microversion: 2.1 time: 0.359018 Oct 27 09:15:34.491944 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1733/3525] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:34 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:34.502906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:34.504345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:34.512739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.513315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.513753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.514997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.515466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.515936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.626553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:34.637048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:34.638818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:34.639976 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45d318ad-2b50-4b7d-a22e-cc14e7fb912a tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.149657 Oct 27 09:15:34.641038 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1734/3526] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:34 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:34.645908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:34.646528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:34.651677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:34.655246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.656061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.656660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.658090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.658961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.659554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.788708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:34.798387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:34.800384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:34.802132 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ef4ead15-5e53-4e98-a171-10ce222c9b9f tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.367807 Oct 27 09:15:34.803599 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1793/3527] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:34 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:34.808801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:34.809701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:34.817804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.819213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.820027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.820970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:34.821659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:34.822308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:34.967609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:34.976722 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-16a0f2c8-8b33-47d0-b00d-3a721a3a95a3 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95" status: 200 len: 1521 microversion: 2.1 time: 0.334435 Oct 27 09:15:34.992180 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1735/3528] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:34 2022] GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:35.038887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:35.047844 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64d3825a-1d23-491d-b531-ad55c1e12565 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.242666 Oct 27 09:15:35.048784 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1794/3529] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:34 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:35.522058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:35.522676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:35.531950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:35.532447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:35.533420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:35.534313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:35.534930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:35.535809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:35.678256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:35.679032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:35.688488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:35.691135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:35.692111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:35.693284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:35.694176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:35.694995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:36.249643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:36.270949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:36.275777 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-64a4e56f-72e5-4cee-b388-36e8ee071dcc tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1324 microversion: 2.1 time: 0.757405 Oct 27 09:15:36.280344 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1736/3530] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:35 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1324 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:36.285909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:36.289936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:36.292841 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-48db31ca-f4ff-47cb-98a8-397a588eed46 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.627452 Oct 27 09:15:36.293428 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1795/3531] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:35 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:36.299175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:36.303854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:36.332240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:36.333065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:36.334129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-eb500255-722b-47e5-a24d-b9f9313357fb req-1652a19a-9273-447c-96d1-5ee4d5b830b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5733e89b-e5f0-455b-b596-16f0f6a280d3", "name": "network-vif-plugged", "status": "completed", "tag": "7c621738-d4dc-44f3-99b9-b323bf8f3ad3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:36.334782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:36.336343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:36.337762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:36.338328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:36.352290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eb500255-722b-47e5-a24d-b9f9313357fb req-1652a19a-9273-447c-96d1-5ee4d5b830b1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:36.353027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eb500255-722b-47e5-a24d-b9f9313357fb req-1652a19a-9273-447c-96d1-5ee4d5b830b1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:36.353649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eb500255-722b-47e5-a24d-b9f9313357fb req-1652a19a-9273-447c-96d1-5ee4d5b830b1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:36.368520 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-eb500255-722b-47e5-a24d-b9f9313357fb req-1652a19a-9273-447c-96d1-5ee4d5b830b1 service nova] Creating event network-vif-plugged:7c621738-d4dc-44f3-99b9-b323bf8f3ad3 for instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 on n-h1-858383-16 Oct 27 09:15:36.374043 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-eb500255-722b-47e5-a24d-b9f9313357fb req-1652a19a-9273-447c-96d1-5ee4d5b830b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050295 Oct 27 09:15:36.375049 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1796/3532] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:36.382105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:36.383820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:36.391546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:36.392257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:36.392871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:36.393795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:36.394409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:36.394994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:36.861205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:36.862557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:36.891508 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80498527-348c-46f4-a545-79efe36c86fe tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95" status: 200 len: 1521 microversion: 2.1 time: 0.514838 Oct 27 09:15:36.896174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:36.896993 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1797/3533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:36 2022] GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:36.901469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:36.910217 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5c15384-beb2-4d1e-a64c-4cb77c638a16 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.627911 Oct 27 09:15:36.918311 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1737/3534] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:36 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:36.919134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:36.923803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:36.939930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:36.941170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:36.942931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:36.954735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:36.956745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:36.957210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:36.970299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1f63f108-9f77-4c23-904d-51bf1f487114 req-09d6049f-4ddf-471d-aac0-74fce990cc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe57d00-6179-49d1-99ef-7a9df351eb95", "name": "network-vif-deleted", "tag": "97f92e5a-4709-4a48-acf2-272d213c7a56"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:36.980986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1f63f108-9f77-4c23-904d-51bf1f487114 req-09d6049f-4ddf-471d-aac0-74fce990cc60 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:36.982079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1f63f108-9f77-4c23-904d-51bf1f487114 req-09d6049f-4ddf-471d-aac0-74fce990cc60 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:36.982202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1f63f108-9f77-4c23-904d-51bf1f487114 req-09d6049f-4ddf-471d-aac0-74fce990cc60 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.008466 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1f63f108-9f77-4c23-904d-51bf1f487114 req-09d6049f-4ddf-471d-aac0-74fce990cc60 service nova] Creating event network-vif-deleted:97f92e5a-4709-4a48-acf2-272d213c7a56 for instance ffe57d00-6179-49d1-99ef-7a9df351eb95 on n-h1-858383-16 Oct 27 09:15:37.016290 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1f63f108-9f77-4c23-904d-51bf1f487114 req-09d6049f-4ddf-471d-aac0-74fce990cc60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050235 Oct 27 09:15:37.020971 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1738/3535] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:15:37.313090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:37.314128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:37.322727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:37.323514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:37.324180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.325417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:37.326719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:37.327734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.458365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:37.469609 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-15f3dbe1-9127-40be-a12f-af5c492c7f7d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.566555 Oct 27 09:15:37.470478 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1798/3536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:36 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:37.476169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:37.477165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:37.485898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:37.486777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:37.487646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.488927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:37.489538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:37.490276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.610481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:37.621460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:37.623867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:37.625454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-effc6011-5f73-4194-b389-1396eef55397 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.153704 Oct 27 09:15:37.644121 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1799/3537] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:37 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:37.651993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:37.660495 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79d6c09e-a89f-4767-929a-59b26086dc87 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1324 microversion: 2.1 time: 0.354584 Oct 27 09:15:37.661065 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1739/3538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:37 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:37.923743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:37.925225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:37.934717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:37.936325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:37.936929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.937830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:37.940434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:37.941307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.944780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:37.947894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:37.956039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:37.956868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:37.957522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.958578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:37.959257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:37.959950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.983429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:37.983961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:37.984399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:37.984878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lazy-loading 'fault' on Instance uuid ffe57d00-6179-49d1-99ef-7a9df351eb95 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:15:38.042838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:38.054412 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f146e081-962c-485c-951c-1e48078aa84d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95" status: 200 len: 1313 microversion: 2.1 time: 0.138814 Oct 27 09:15:38.055816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1800/3539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:37 2022] GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:38.221668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:38.225507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:38.231170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:38.233058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:38.234453 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-022420ab-60ca-4661-a308-856803377985 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.294338 Oct 27 09:15:38.235327 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1740/3540] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:37 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:15:38.495591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:38.496314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:38.507706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:38.510300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:38.512506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:38.514108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:38.517115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:38.519897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:38.656417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:38.657358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:38.665504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:38.666406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:38.667051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:38.668012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:38.668959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:38.669689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:38.804015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:38.831728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:38.835545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:38.837952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:38.840675 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f79cc590-18cb-4905-8228-425c02593e25 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.189087 Oct 27 09:15:38.842155 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1741/3541] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:38 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:38.844824 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34350ba2-468d-42ca-8b6b-6a1f499e0be9 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1307 microversion: 2.1 time: 0.354375 Oct 27 09:15:38.857406 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1801/3542] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:38 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:38.862227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:38.865860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:38.874349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:38.875198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:38.875851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:38.876760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:38.877382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:38.878500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.081593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:39.082516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:39.094898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.097435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.098186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.099115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.100101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.104978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.115435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:39.128752 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9fd7bdb-4284-45a6-8af1-91375641962e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 200 len: 1520 microversion: 2.1 time: 0.284664 Oct 27 09:15:39.129937 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1742/3543] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:38 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:39.132917 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] HTTP exception thrown: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Request method failure captured: Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 HTTP/1.1 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkwRQ7WzjnzCP04s3CtmtUU8jWSuKQP_VSij33_SN_Cz054sG65ds9eixdVc6Zadc6nrYa09r1gDvqlikF-XPRY17QrRFh-2vzq0Vi5m1dcOxXQ6IJXTx2UTKkkh-E8B068suD0qtz8myZJCDx5TMojFxnIlZPqxzPZKUkx1AEQdWPw Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}] Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8b9b05c3cdcd4b5fbffc78e6508002c8 Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'ffe57d00-6179-49d1-99ef-7a9df351eb95'} Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.135288 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:39.140432 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.140432 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:39.140432 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:39.140432 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:39.140432 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:39.140432 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:39.140432 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:39.140432 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.142399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Returning 404 to user: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:39.143636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-097628ba-3677-48c8-a3f8-38fe8f9ddce1 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95" status: 404 len: 111 microversion: 2.1 time: 0.065831 Oct 27 09:15:39.144744 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1802/3544] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:39 2022] GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:15:39.153773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:39.161344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:39.162621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:15:39.172274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.173637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.111"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:39.173925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.174571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.176681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.177446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.178780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.180491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:39.192819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.193310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.193748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.194452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.194902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.195321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.260744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "refresh_cache-9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:15:39.261154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquired lock "refresh_cache-9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:15:39.313985 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6cd490b6-2a5e-45f4-9b37-1f243e99c7ab tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.164020 Oct 27 09:15:39.317783 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1743/3545] 10.222.0.25 () {58 vars in 1230 bytes} [Thu Oct 27 09:15:39 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:15:39.331254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:39.332350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:39.351846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.352740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.353393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.354307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.354974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.355700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.719359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:39.736994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:39.738974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:39.742498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-84d5e2ba-ff3e-44d1-b50c-b9de4b64a520 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.423308 Oct 27 09:15:39.746065 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1744/3546] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:39 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:39.754147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6c99b1f-7c44-4bc6-85d1-09205260c2c2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6c99b1f-7c44-4bc6-85d1-09205260c2c2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Request method failure captured: Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwRQ7WzjnzCP04s3CtmtUU8jWSuKQP_VSij33_SN_Cz054sG65ds9eixdVc6Zadc6nrYa09r1gDvqlikF-XPRY17QrRFh-2vzq0Vi5m1dcOxXQ6IJXTx2UTKkkh-E8B068suD0qtz8myZJCDx5TMojFxnIlZPqxzPZKUkx1AEQdWPw Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}] Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8b9b05c3cdcd4b5fbffc78e6508002c8 Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: action_args: {} Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 09:15:39.767762 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 27 09:15:39.773326 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:39.774392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6c99b1f-7c44-4bc6-85d1-09205260c2c2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:39.775491 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6c99b1f-7c44-4bc6-85d1-09205260c2c2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.028374 Oct 27 09:15:39.785459 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1745/3547] 10.222.0.25 () {58 vars in 1182 bytes} [Thu Oct 27 09:15:39 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:15:39.792664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:39.819261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:39.820441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Searching by: {'deleted': False, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:15:39.831961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.832446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.836793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.837699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.838186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.839370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.878139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:15:39.926221 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a970605d-0290-4e60-99da-32b7f899df3e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.139503 Oct 27 09:15:39.933433 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1746/3548] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:15:39 2022] GET /compute/v2.1/servers => generated 683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:39.944951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:39.946575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:39.969482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.970357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.971347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:39.977294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:39.978097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:39.979067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:40.127036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:40.136605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:40.146320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:40.147709 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dfc743a1-4a59-4759-83a5-80999d8bd063 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1407 microversion: 2.54 time: 0.212573 Oct 27 09:15:40.148393 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1747/3549] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:39 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:40.161459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:40.162236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:40.171890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:40.176132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:40.176844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:40.177819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:40.178498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:40.179012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:40.497128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:40.506500 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a62aa01f-ac2e-4dcf-8461-878d2f1174f0 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1487 microversion: 2.1 time: 0.356817 Oct 27 09:15:40.511218 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1748/3550] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:40 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1487 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:40.516181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:40.533253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:40.533743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.servers [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Removing options 'limit' from query {{(pid=120603) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 27 09:15:40.534436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Searching by: {'deleted': False, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:15:40.546124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:40.546631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:40.547068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:40.547848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:40.554701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:40.555230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:40.613445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:15:40.674643 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d8a73e8-0289-4f83-adf5-63d3b5e2746c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.162078 Oct 27 09:15:40.675750 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1749/3551] 10.222.0.25 () {58 vars in 1144 bytes} [Thu Oct 27 09:15:40 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:40.718180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8920361a-6876-4470-af3c-898788cc49ef tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1814922034"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:40.729979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8920361a-6876-4470-af3c-898788cc49ef tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:40.738153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8920361a-6876-4470-af3c-898788cc49ef tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:40.739020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8920361a-6876-4470-af3c-898788cc49ef tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:40.739750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8920361a-6876-4470-af3c-898788cc49ef tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:40.740743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8920361a-6876-4470-af3c-898788cc49ef tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:40.741421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8920361a-6876-4470-af3c-898788cc49ef tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:40.742066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8920361a-6876-4470-af3c-898788cc49ef tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:41.178196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Building network info cache for instance {{(pid=120602) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:15:41.181478 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8920361a-6876-4470-af3c-898788cc49ef tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "POST /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9/action" status: 202 len: 0 microversion: 2.1 time: 0.503546 Oct 27 09:15:41.181998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:41.182167 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1750/3552] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:15:40 2022] POST /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:15:41.210137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97d91bdf-0542-41fb-b421-7406c53b1db4 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97d91bdf-0542-41fb-b421-7406c53b1db4 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Request method failure captured: Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwRQ7WzjnzCP04s3CtmtUU8jWSuKQP_VSij33_SN_Cz054sG65ds9eixdVc6Zadc6nrYa09r1gDvqlikF-XPRY17QrRFh-2vzq0Vi5m1dcOxXQ6IJXTx2UTKkkh-E8B068suD0qtz8myZJCDx5TMojFxnIlZPqxzPZKUkx1AEQdWPw Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}] Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8b9b05c3cdcd4b5fbffc78e6508002c8 Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: action_args: {} Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '-1' Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 09:15:41.236459 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97d91bdf-0542-41fb-b421-7406c53b1db4 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:41.240977 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97d91bdf-0542-41fb-b421-7406c53b1db4 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.046244 Oct 27 09:15:41.246283 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1751/3553] 10.222.0.25 () {58 vars in 1142 bytes} [Thu Oct 27 09:15:41 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:15:41.256172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:41.257164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:41.289516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:41.290423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:41.291020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:41.291937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:41.292548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:41.293152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:41.801604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:41.811759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:41.820385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:41.821666 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-647e2070-cc12-47d0-aa80-7e6c023e4368 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.574104 Oct 27 09:15:41.824234 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1752/3554] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:41 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:41.835856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6d7d5105-9e63-4c14-8d41-25b722f72eb0 req-6d8e632a-02a3-4419-8022-0a0748986bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f468cf4-43cf-4bba-bfcb-0f725bf735e3", "name": "network-vif-plugged", "status": "completed", "tag": "e537d4a4-12d3-46d5-b30a-f4aa9120f51e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:41.851831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6d7d5105-9e63-4c14-8d41-25b722f72eb0 req-6d8e632a-02a3-4419-8022-0a0748986bab service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:41.853642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6d7d5105-9e63-4c14-8d41-25b722f72eb0 req-6d8e632a-02a3-4419-8022-0a0748986bab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:41.856455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6d7d5105-9e63-4c14-8d41-25b722f72eb0 req-6d8e632a-02a3-4419-8022-0a0748986bab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:41.886727 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6d7d5105-9e63-4c14-8d41-25b722f72eb0 req-6d8e632a-02a3-4419-8022-0a0748986bab service nova] Creating event network-vif-plugged:e537d4a4-12d3-46d5-b30a-f4aa9120f51e for instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 on n-h2-858383-16 Oct 27 09:15:41.894177 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6d7d5105-9e63-4c14-8d41-25b722f72eb0 req-6d8e632a-02a3-4419-8022-0a0748986bab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068338 Oct 27 09:15:41.895531 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1753/3555] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:41.903860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:41.904915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:41.911977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:41.912866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:41.914612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:41.915610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:41.917007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:41.917611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:42.029186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:42.039872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:42.041318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:42.042502 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71a0eb64-c876-4f20-b680-f5c9926e6559 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1413 microversion: 2.54 time: 0.145361 Oct 27 09:15:42.043423 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1754/3556] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:41 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:42.048685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-56cb6709-4fa3-434c-98f7-e2997398cf1d req-e83daa5d-2387-4a94-a8d1-33c954d965d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d339b0a-f7bc-4d58-90d1-e5d4beb1834e", "tag": "de3d506c-8d30-4307-947f-6fb004d3c625"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:42.059485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56cb6709-4fa3-434c-98f7-e2997398cf1d req-e83daa5d-2387-4a94-a8d1-33c954d965d6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:42.060892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56cb6709-4fa3-434c-98f7-e2997398cf1d req-e83daa5d-2387-4a94-a8d1-33c954d965d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:42.061974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-56cb6709-4fa3-434c-98f7-e2997398cf1d req-e83daa5d-2387-4a94-a8d1-33c954d965d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:42.080934 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-56cb6709-4fa3-434c-98f7-e2997398cf1d req-e83daa5d-2387-4a94-a8d1-33c954d965d6 service nova] Creating event network-changed:de3d506c-8d30-4307-947f-6fb004d3c625 for instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e on n-h1-858383-16 Oct 27 09:15:42.091354 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-56cb6709-4fa3-434c-98f7-e2997398cf1d req-e83daa5d-2387-4a94-a8d1-33c954d965d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046535 Oct 27 09:15:42.095538 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1755/3557] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:42.104584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e07d8ce4-221e-42da-a2db-995cd00963d8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae5c8670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:42.224880 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e07d8ce4-221e-42da-a2db-995cd00963d8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71" status: 200 len: 1414 microversion: 2.1 time: 0.127794 Oct 27 09:15:42.225584 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1756/3558] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:15:42 2022] GET /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:42.243738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25e586c3-eba8-4a71-b42d-27c74379e9d2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25e586c3-eba8-4a71-b42d-27c74379e9d2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Request method failure captured: Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwRQ7WzjnzCP04s3CtmtUU8jWSuKQP_VSij33_SN_Cz054sG65ds9eixdVc6Zadc6nrYa09r1gDvqlikF-XPRY17QrRFh-2vzq0Vi5m1dcOxXQ6IJXTx2UTKkkh-E8B068suD0qtz8myZJCDx5TMojFxnIlZPqxzPZKUkx1AEQdWPw Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}] Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8b9b05c3cdcd4b5fbffc78e6508002c8 Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: action_args: {} Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'testing' Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 27 09:15:42.248420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 27 09:15:42.253532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.255534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25e586c3-eba8-4a71-b42d-27c74379e9d2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:42.256636 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25e586c3-eba8-4a71-b42d-27c74379e9d2 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.030275 Oct 27 09:15:42.257374 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1757/3559] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:15:42 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:15:42.530265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d29d9eeb-91af-49b5-b6f5-5bcabec136b2 tempest-FloatingIPDetailsNegativeTestJSON-2086378809 tempest-FloatingIPDetailsNegativeTestJSON-2086378809-project] Calling method '.version_select at 0x7f31ae570550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:42.783412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Updating instance_info_cache with network_info: [{"id": "de3d506c-8d30-4307-947f-6fb004d3c625", "address": "fa:16:3e:ae:d7:28", "network": {"id": "ab13eded-e8f5-4da5-879a-e47232da5d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1354117030-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1469f50688644411a306ae4f0305d56c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapde3d506c-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120602) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:15:42.812884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Releasing lock "refresh_cache-9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:15:42.813787 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6e08f843-dba5-4ffd-933d-b7c9cc10561b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "POST /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e/action" status: 202 len: 0 microversion: 2.1 time: 3.655576 Oct 27 09:15:42.814404 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1803/3560] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:15:39 2022] POST /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e/action => generated 0 bytes in 3657 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 09:15:42.822045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-af5f34ec-7e32-4bf3-b4be-a4342eb0966d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a940bdc0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:42.857838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG neutronclient.v2_0.client [None req-d29d9eeb-91af-49b5-b6f5-5bcabec136b2 tempest-FloatingIPDetailsNegativeTestJSON-2086378809 tempest-FloatingIPDetailsNegativeTestJSON-2086378809-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c4defcd4-8489-4c05-a63a-53aacc28c80e could not be found", "detail": ""}} {{(pid=120603) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 27 09:15:42.859346 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d29d9eeb-91af-49b5-b6f5-5bcabec136b2 tempest-FloatingIPDetailsNegativeTestJSON-2086378809 tempest-FloatingIPDetailsNegativeTestJSON-2086378809-project] HTTP exception thrown: Floating IP not found for ID c4defcd4-8489-4c05-a63a-53aacc28c80e Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d29d9eeb-91af-49b5-b6f5-5bcabec136b2 tempest-FloatingIPDetailsNegativeTestJSON-2086378809 tempest-FloatingIPDetailsNegativeTestJSON-2086378809-project] Request method failure captured: Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-floating-ips/c4defcd4-8489-4c05-a63a-53aacc28c80e HTTP/1.1 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkw9lgvcCqm40NW-md2b2T9CEx9ejmb_OAsFL9pZwE4nB7qetuGXUO77QOZdCwSKsxT1sbjYgIAvaqqSxqShXZ1i4sQsTJWik9n0-a6QHARn9ncSwp7EpuScAuxQ9_IT_QyMowVdbL_XevtVxyeVjUqpGCmbK3xRmJPUhXZTONHLqg0 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 50f45ece78ad49f1a8508e0076cdeae9 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2086378809 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50f45ece78ad49f1a8508e0076cdeae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_50f45ece78ad49f1a8508e0076cdeae9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50f45ece78ad49f1a8508e0076cdeae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/50f45ece78ad49f1a8508e0076cdeae9"}]}] Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2086378809 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 50f45ece78ad49f1a8508e0076cdeae9 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2086378809 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2086378809-project Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: ad34a57f8abf4f008ef985184171bf50 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2086378809-project Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: exception: Floating IP not found for ID c4defcd4-8489-4c05-a63a-53aacc28c80e Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'c4defcd4-8489-4c05-a63a-53aacc28c80e'} Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 27 09:15:42.862347 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c4defcd4-8489-4c05-a63a-53aacc28c80e could not be found Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c7ad8af-3056-4824-a25e-5a83ec84ece7'] Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c4defcd4-8489-4c05-a63a-53aacc28c80e. Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c4defcd4-8489-4c05-a63a-53aacc28c80e Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c4defcd4-8489-4c05-a63a-53aacc28c80e Oct 27 09:15:42.867127 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:42.878114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d29d9eeb-91af-49b5-b6f5-5bcabec136b2 tempest-FloatingIPDetailsNegativeTestJSON-2086378809 tempest-FloatingIPDetailsNegativeTestJSON-2086378809-project] Returning 404 to user: Floating IP not found for ID c4defcd4-8489-4c05-a63a-53aacc28c80e {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:42.879444 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d29d9eeb-91af-49b5-b6f5-5bcabec136b2 tempest-FloatingIPDetailsNegativeTestJSON-2086378809 tempest-FloatingIPDetailsNegativeTestJSON-2086378809-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/c4defcd4-8489-4c05-a63a-53aacc28c80e" status: 404 len: 111 microversion: 2.1 time: 0.620797 Oct 27 09:15:42.881272 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1758/3561] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:15:42 2022] GET /compute/v2.1/os-floating-ips/c4defcd4-8489-4c05-a63a-53aacc28c80e => generated 111 bytes in 623 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:15:42.888456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dff32b6a-b706-4e86-a160-d9ace27e7f5a tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:42.904779 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-af5f34ec-7e32-4bf3-b4be-a4342eb0966d tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71" status: 200 len: 1414 microversion: 2.1 time: 0.085500 Oct 27 09:15:42.907946 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1804/3562] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:15:42 2022] GET /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:42.912783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dff32b6a-b706-4e86-a160-d9ace27e7f5a tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:42.917476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dff32b6a-b706-4e86-a160-d9ace27e7f5a tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:15:42.925086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.111"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:42.933356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:42.942461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.servers [None req-dff32b6a-b706-4e86-a160-d9ace27e7f5a tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Flavor 'non_existing_flavor' could not be found {{(pid=120603) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 27 09:15:42.947167 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dff32b6a-b706-4e86-a160-d9ace27e7f5a tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.062156 Oct 27 09:15:42.951325 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1759/3563] 10.222.0.25 () {58 vars in 1178 bytes} [Thu Oct 27 09:15:42 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:15:42.965245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:42.968173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:42.968699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:42.969480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:42.969962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:42.970398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:42.974892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:42.975743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:42.985076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:42.985997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:42.986672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:42.987866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:42.988771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:42.989419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:43.029163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "refresh_cache-5733e89b-e5f0-455b-b596-16f0f6a280d3" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:15:43.030064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquired lock "refresh_cache-5733e89b-e5f0-455b-b596-16f0f6a280d3" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:15:43.602806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:43.618077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:43.624552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:43.626799 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab687991-acd3-4dc1-acc0-e12cab1996c1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.665270 Oct 27 09:15:43.628185 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1760/3564] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:42 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:43.648619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bb2d590-2de4-45f0-92ac-fe2edbb07776 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa4a33a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:43.883353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bb2d590-2de4-45f0-92ac-fe2edbb07776 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71" status: 204 len: 0 microversion: 2.1 time: 0.253308 Oct 27 09:15:43.884120 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1761/3565] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:43 2022] DELETE /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:43.889708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:43.894962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:43.903293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:15:43.918795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:43.919542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:43.920072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:43.920868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:43.921391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:43.922147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:44.094353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e707fcdc-ba38-42ce-83d7-8c1c37952b6b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.208902 Oct 27 09:15:44.095217 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1762/3566] 10.222.0.25 () {58 vars in 1174 bytes} [Thu Oct 27 09:15:43 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:15:44.108682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:44.109496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:44.124191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:44.135354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:44.136211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:44.137132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:44.138014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:44.138643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:44.821905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:44.838062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:44.839996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:44.844378 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-22091d93-dbf3-4913-91d9-e4ad8e886ff3 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1413 microversion: 2.54 time: 0.747817 Oct 27 09:15:44.847202 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1763/3567] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:44 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1413 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:44.876276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ffd55cf-4cac-4985-ae6d-f5092144a34b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31ae570550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:44.911181 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-9ffd55cf-4cac-4985-ae6d-f5092144a34b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Image not found. Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ffd55cf-4cac-4985-ae6d-f5092144a34b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 HTTP/1.1 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'b2999179-a0b0-4d2b-b27e-e6a1f10e2b71'} Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:15:44.913947 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 could not be found. Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:15:44.918946 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:44.923390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ffd55cf-4cac-4985-ae6d-f5092144a34b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:44.925028 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ffd55cf-4cac-4985-ae6d-f5092144a34b tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71" status: 404 len: 62 microversion: 2.1 time: 0.058824 Oct 27 09:15:44.929197 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1764/3568] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:15:44 2022] GET /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:15:44.939290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:44.947368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:44.954021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:15:44.966934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:44.974175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:44.974950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:44.976123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:44.976793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:44.977400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:45.133036 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df897293-fddc-456a-88b2-3d655567b616 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.202466 Oct 27 09:15:45.133911 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1765/3569] 10.222.0.25 () {58 vars in 1184 bytes} [Thu Oct 27 09:15:44 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:15:45.150204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:45.150735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:45.159359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:45.160253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:45.160860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:45.161885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:45.162528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:45.163112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:45.611194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:45.615697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:45.624308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:45.625746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:45.626917 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c234b8f3-d76e-408f-9329-8c2971a4e761 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.481293 Oct 27 09:15:45.647987 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1766/3570] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:45 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:45.675160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:45.677129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:45.710930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:45.711402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:45.711979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:45.712742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:45.713195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:45.713616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:46.096886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:46.109935 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-409a10e5-325c-4e73-9ae7-e9d3e5556b14 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1499 microversion: 2.1 time: 0.455320 Oct 27 09:15:46.111978 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1767/3571] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:45 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1499 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:46.119860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:46.126974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:46.128544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Searching by: {'deleted': False, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:15:46.135318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:46.136337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:46.136878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:46.138608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:46.139301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:46.139890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:46.207660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:15:46.322553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:46.354145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:46.358046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:46.358918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:47.820144 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e074f22-b5ce-4b62-b2ad-dfd87f18cf8c tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 1.706526 Oct 27 09:15:47.820758 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1768/3572] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:15:46 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:47.825967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:47.826657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:47.837372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:47.837862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:47.844928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:47.846113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:47.846751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:47.847347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:47.985290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:48.005123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:48.006555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:48.008453 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99aa911c-431f-4bd7-818d-9f17dfccb9e4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1398 microversion: 2.54 time: 0.186385 Oct 27 09:15:48.010830 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1769/3573] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:47 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1398 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:48.040696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:48.041302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:48.050887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:48.051423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:48.051884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:48.052596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:48.053084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:48.053521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:48.432019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:48.444284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:48.445806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:48.451174 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2def39be-647b-44b0-a917-94fc1ac61044 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1728 microversion: 2.20 time: 0.438958 Oct 27 09:15:48.451794 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1770/3574] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:48 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1728 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:48.479312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:48.481216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:48.489620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:48.490339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:48.491396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:48.496338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:48.496987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:48.499883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:48.587929 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.network.neutron [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] re-assign floating IP 172.25.6.111 from instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e Oct 27 09:15:48.661376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Building network info cache for instance {{(pid=120602) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:15:48.978101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:48.998690 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f2038db-9003-4c9d-8187-3f787a763e29 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1505 microversion: 2.1 time: 0.535594 Oct 27 09:15:48.999201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1771/3575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:48 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:49.016459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95348e6b-a116-4ffe-88cd-fc4c5037332b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:49.030019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-95348e6b-a116-4ffe-88cd-fc4c5037332b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:49.031051 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95348e6b-a116-4ffe-88cd-fc4c5037332b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.026976 Oct 27 09:15:49.031621 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1772/3576] 10.222.0.25 () {58 vars in 1178 bytes} [Thu Oct 27 09:15:48 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:15:49.044064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5bf5b8e3-f873-4b4a-8532-c4da0aaa7585 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '.version_select at 0x7f31a9215e50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:49.078618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5bf5b8e3-f873-4b4a-8532-c4da0aaa7585 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-138104561" status: 204 len: 0 microversion: 2.54 time: 0.040263 Oct 27 09:15:49.080435 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1773/3577] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Oct 27 09:15:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-138104561 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:15:49.086254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6db30f55-eac6-471b-8909-dad701247d7b req-c204a66a-d696-4c09-b2b1-b862608f4c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d339b0a-f7bc-4d58-90d1-e5d4beb1834e", "tag": "de3d506c-8d30-4307-947f-6fb004d3c625"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:49.113551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6db30f55-eac6-471b-8909-dad701247d7b req-c204a66a-d696-4c09-b2b1-b862608f4c65 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:49.114408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6db30f55-eac6-471b-8909-dad701247d7b req-c204a66a-d696-4c09-b2b1-b862608f4c65 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:49.115049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6db30f55-eac6-471b-8909-dad701247d7b req-c204a66a-d696-4c09-b2b1-b862608f4c65 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:49.135401 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6db30f55-eac6-471b-8909-dad701247d7b req-c204a66a-d696-4c09-b2b1-b862608f4c65 service nova] Creating event network-changed:de3d506c-8d30-4307-947f-6fb004d3c625 for instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e on n-h1-858383-16 Oct 27 09:15:49.164505 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6db30f55-eac6-471b-8909-dad701247d7b req-c204a66a-d696-4c09-b2b1-b862608f4c65 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082438 Oct 27 09:15:49.165437 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1774/3578] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:49.171525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:49.178620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:49.179749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Searching by: {'deleted': False, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:15:49.187390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:49.188201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:49.188885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:49.189873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:49.190555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:49.191358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:49.253424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:15:49.317783 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-537cd6f6-020c-4426-9a51-76dfd0068bca tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.150593 Oct 27 09:15:49.318866 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1775/3579] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:15:49 2022] GET /compute/v2.1/servers => generated 683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:49.328721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:49.329336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:49.351489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:49.352148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:49.352714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:49.353590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:49.354161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:49.354828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:49.404394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:15:49.613696 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b40f112-e882-4982-95da-b46d503d3916 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 204 len: 0 microversion: 2.54 time: 0.284944 Oct 27 09:15:49.614951 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1776/3580] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:15:49 2022] DELETE /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:15:49.629371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:49.630251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:49.643101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:49.643697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:49.654421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:49.655357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:49.655875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:49.656316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:49.703505 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] HTTP exception thrown: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Request method failure captured: Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 HTTP/1.1 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwRQ7WzjnzCP04s3CtmtUU8jWSuKQP_VSij33_SN_Cz054sG65ds9eixdVc6Zadc6nrYa09r1gDvqlikF-XPRY17QrRFh-2vzq0Vi5m1dcOxXQ6IJXTx2UTKkkh-E8B068suD0qtz8myZJCDx5TMojFxnIlZPqxzPZKUkx1AEQdWPw Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}] Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8b9b05c3cdcd4b5fbffc78e6508002c8 Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'ffe57d00-6179-49d1-99ef-7a9df351eb95'} Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:15:49.711129 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:49.719934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Returning 404 to user: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:49.722342 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1aaa431c-4ab1-4f6f-b40e-69dbe83813ce tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95" status: 404 len: 111 microversion: 2.1 time: 0.104544 Oct 27 09:15:49.722342 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1777/3581] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:15:49 2022] DELETE /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:15:49.728898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:49.729507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:49.752216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:49.752709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:49.753150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:49.753856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:49.754308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:49.754791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:50.364591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:50.374311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:50.381090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:50.384917 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cfb1538d-f404-4f9d-96d5-e2fc7949720e tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1715 microversion: 2.20 time: 0.659785 Oct 27 09:15:50.388435 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1778/3582] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:49 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1715 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:50.394265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6e9e20e2-ce80-4da9-86dd-c5bc334fcf14 req-cb100e3e-7d71-4053-a799-161bc819db75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8901fe0-0223-4b98-9a13-90cb604273b9", "name": "network-vif-plugged", "status": "completed", "tag": "573acdf5-4df7-4810-b86c-7e8b4a077454"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:50.417943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Updating instance_info_cache with network_info: [{"id": "de3d506c-8d30-4307-947f-6fb004d3c625", "address": "fa:16:3e:ae:d7:28", "network": {"id": "ab13eded-e8f5-4da5-879a-e47232da5d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1354117030-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1469f50688644411a306ae4f0305d56c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapde3d506c-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120602) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:15:50.420539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6e9e20e2-ce80-4da9-86dd-c5bc334fcf14 req-cb100e3e-7d71-4053-a799-161bc819db75 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:50.421250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6e9e20e2-ce80-4da9-86dd-c5bc334fcf14 req-cb100e3e-7d71-4053-a799-161bc819db75 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:50.424458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6e9e20e2-ce80-4da9-86dd-c5bc334fcf14 req-cb100e3e-7d71-4053-a799-161bc819db75 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:50.452772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Building network info cache for instance {{(pid=120602) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:15:50.453328 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6e9e20e2-ce80-4da9-86dd-c5bc334fcf14 req-cb100e3e-7d71-4053-a799-161bc819db75 service nova] Creating event network-vif-plugged:573acdf5-4df7-4810-b86c-7e8b4a077454 for instance b8901fe0-0223-4b98-9a13-90cb604273b9 on n-h2-858383-16 Oct 27 09:15:50.465102 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6e9e20e2-ce80-4da9-86dd-c5bc334fcf14 req-cb100e3e-7d71-4053-a799-161bc819db75 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072207 Oct 27 09:15:50.467876 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1779/3583] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:50.482765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:50.483791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:50.490992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:50.491759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:50.492364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:50.493458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:50.494078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:50.494660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:50.666170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:50.679700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:50.686877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:50.691180 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bbaa05a1-e3f5-4bad-b153-a4aab8c98307 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1404 microversion: 2.54 time: 0.219918 Oct 27 09:15:50.692697 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1780/3584] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:50 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:50.704825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:50.705322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: a0460dce-a27a-4974-b3d5-71f416e50a61] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:50.724704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:50.727081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:50.728603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:50.729572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:50.732852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:50.733686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:50.801946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: a0460dce-a27a-4974-b3d5-71f416e50a61] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:15:50.964099 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-28901252-105a-44ac-94ee-93a73a3f066d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61" status: 204 len: 0 microversion: 2.1 time: 0.269729 Oct 27 09:15:50.965341 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1781/3585] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:15:50 2022] DELETE /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:50.976137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:50.976856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:50.994104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:50.995838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:50.996689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:50.998653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.019691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.021023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.405944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:51.416083 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-de2a5ac6-e8df-4ff4-ab99-171fc72ca0e1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1505 microversion: 2.1 time: 0.449594 Oct 27 09:15:51.416687 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1782/3586] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:50 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:51.430461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:51.430965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:51.452980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.453765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.454981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.461470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.462462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.463161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.475420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:51.534111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:15:51.601704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Updating instance_info_cache with network_info: [{"id": "7c621738-d4dc-44f3-99b9-b323bf8f3ad3", "address": "fa:16:3e:da:6c:2e", "network": {"id": "ab13eded-e8f5-4da5-879a-e47232da5d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1354117030-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1469f50688644411a306ae4f0305d56c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7c621738-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120602) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:15:51.626082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Releasing lock "refresh_cache-5733e89b-e5f0-455b-b596-16f0f6a280d3" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:15:51.627055 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1b56da0-1346-4f57-8ea7-3ab5f86cf180 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "POST /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3/action" status: 202 len: 0 microversion: 2.1 time: 8.717019 Oct 27 09:15:51.627680 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1805/3587] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:15:42 2022] POST /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3/action => generated 0 bytes in 8718 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 09:15:51.634793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b8b127e8-bb42-422d-9549-35840f3f6ffa req-4cbed63d-9c77-4145-a5f4-b3174989cbeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5733e89b-e5f0-455b-b596-16f0f6a280d3", "tag": "7c621738-d4dc-44f3-99b9-b323bf8f3ad3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:51.660474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b8b127e8-bb42-422d-9549-35840f3f6ffa req-4cbed63d-9c77-4145-a5f4-b3174989cbeb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.660958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b8b127e8-bb42-422d-9549-35840f3f6ffa req-4cbed63d-9c77-4145-a5f4-b3174989cbeb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.661400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b8b127e8-bb42-422d-9549-35840f3f6ffa req-4cbed63d-9c77-4145-a5f4-b3174989cbeb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.683171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:51.686490 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b8b127e8-bb42-422d-9549-35840f3f6ffa req-4cbed63d-9c77-4145-a5f4-b3174989cbeb service nova] Creating event network-changed:7c621738-d4dc-44f3-99b9-b323bf8f3ad3 for instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 on n-h1-858383-16 Oct 27 09:15:51.692579 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f191c3bf-35b6-4149-a390-e25de1b48e4d tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "DELETE /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 204 len: 0 microversion: 2.1 time: 0.272155 Oct 27 09:15:51.693332 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1783/3588] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:15:51 2022] DELETE /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:51.699000 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b8b127e8-bb42-422d-9549-35840f3f6ffa req-4cbed63d-9c77-4145-a5f4-b3174989cbeb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068470 Oct 27 09:15:51.699631 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1806/3589] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:51.705927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.111"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:51.708286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:51.709184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: ffe57d00-6179-49d1-99ef-7a9df351eb95] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:51.718134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.718955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.719653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.720605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.721279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.721902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.739114 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] HTTP exception thrown: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Request method failure captured: Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 HTTP/1.1 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkwRQ7WzjnzCP04s3CtmtUU8jWSuKQP_VSij33_SN_Cz054sG65ds9eixdVc6Zadc6nrYa09r1gDvqlikF-XPRY17QrRFh-2vzq0Vi5m1dcOxXQ6IJXTx2UTKkkh-E8B068suD0qtz8myZJCDx5TMojFxnIlZPqxzPZKUkx1AEQdWPw Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}] Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8b9b05c3cdcd4b5fbffc78e6508002c8 Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'ffe57d00-6179-49d1-99ef-7a9df351eb95'} Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:51.742845 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Returning 404 to user: Instance ffe57d00-6179-49d1-99ef-7a9df351eb95 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1cb29fa-6c1b-4120-8a22-30cfb724d29b tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95" status: 404 len: 111 microversion: 2.1 time: 0.040324 Oct 27 09:15:51.747017 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1807/3590] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:51 2022] GET /compute/v2.1/servers/ffe57d00-6179-49d1-99ef-7a9df351eb95 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:15:51.750160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:51.750774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:51.759894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.760130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.760757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.762225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.762921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.763726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.869627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:51.879025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:51.882036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:51.883793 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9740b3c4-4285-45c6-be06-5f5cdfda9c1c tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1404 microversion: 2.54 time: 0.137995 Oct 27 09:15:51.884580 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1808/3591] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:51 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:51.889422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:51.890175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: a0460dce-a27a-4974-b3d5-71f416e50a61] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:51.896921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.897518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.898036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.899315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.899315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.899815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.913479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:51.922494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.923207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.923860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:51.924769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:51.925545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:51.926167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:52.217339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:52.234066 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08190642-bc1a-431c-b99e-bf82249aa1e0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61" status: 200 len: 1521 microversion: 2.1 time: 0.347941 Oct 27 09:15:52.241855 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1809/3592] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:51 2022] GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:52.285037 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] HTTP exception thrown: Floating IP 172.25.6.111 is not associated with instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e. Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Request method failure captured: Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e/action HTTP/1.1 Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 49 Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwF5q9jsEAlQWkOcEEDviiC6_h0d4gpWhoZKabkDIIlilUaDEGNDvr3JpMiaGzHO_Ut2h_O5fonGaMknyasiQpmK8ZArl8ZXPXs6LCz6-d5PLd15F3rvTfvk2Yr2y42vdyYrhm2WGyAiagMvK8Qy7dVZw7xzrrL5Mg-7abQCFqy72E Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1469f50688644411a306ae4f0305d56c Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1469f50688644411a306ae4f0305d56c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1469f50688644411a306ae4f0305d56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1469f50688644411a306ae4f0305d56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1469f50688644411a306ae4f0305d56c"}]}] Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1469f50688644411a306ae4f0305d56c Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FloatingIPsAssociationTestJSON-934170578-project Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9b4eb0adbf5d4df5b292794045947ee1 Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-934170578-project Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: {"removeFloatingIp": {"address": "172.25.6.111"}} Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: exception: Floating IP 172.25.6.111 is not associated with instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e. Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '9d339b0a-f7bc-4d58-90d1-e5d4beb1834e', 'body': {'removeFloatingIp': {'address': '172.25.6.111'}}} Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.111 is not associated with instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e. Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.111 is not associated with instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e. Oct 27 09:15:52.286584 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:52.290682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Returning 409 to user: Floating IP 172.25.6.111 is not associated with instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:52.290682 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f4561e8e-4368-4064-b523-4fb753ffac99 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "POST /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e/action" status: 409 len: 146 microversion: 2.1 time: 0.591294 Oct 27 09:15:52.290682 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1784/3593] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:15:51 2022] POST /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e/action => generated 146 bytes in 593 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:15:52.298665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Action: 'action', calling method: .version_select at 0x7f31abfee280>, body: {"removeFloatingIp": {"address": "172.25.6.111"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:52.440924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:52.441553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:52.453036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:52.456544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:52.458003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:52.460978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:52.463422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:52.466301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:53.000084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:53.013710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:53.014884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:53.017657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:53.026812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:53.027919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:53.029442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:53.036217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:53.061649 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e88f37e0-49da-493d-aea1-de5d4e525bc1 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1505 microversion: 2.1 time: 0.614538 Oct 27 09:15:53.062336 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1785/3594] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:52 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:15:53.081337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:53.092214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:53.108288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:53.113471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:53.114710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:53.116372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:53.117744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:53.118386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:53.263847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:53.279386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:53.284076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:53.286653 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ba3ba3c-8a76-41fe-9a7b-c3f0303ed534 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1404 microversion: 2.54 time: 0.216766 Oct 27 09:15:53.289181 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1786/3595] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:53 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:53.299298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:53.306979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: a0460dce-a27a-4974-b3d5-71f416e50a61] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:53.316661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:53.317529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:53.318606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:53.319628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:53.320341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:53.321152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:53.695828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "refresh_cache-5733e89b-e5f0-455b-b596-16f0f6a280d3" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:15:53.696348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquired lock "refresh_cache-5733e89b-e5f0-455b-b596-16f0f6a280d3" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:15:53.874079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:53.888154 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e37ae049-49a5-4644-964b-4f9d0cfe7075 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61" status: 200 len: 1521 microversion: 2.1 time: 0.595849 Oct 27 09:15:53.900844 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1787/3596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:53 2022] GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61 => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:54.093270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:54.093948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:54.107263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:54.107796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:54.108231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:54.110206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:54.110849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:54.111558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:54.807804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:54.819876 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78eeda53-9cc4-4161-84e5-ad3ad8471271 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1500 microversion: 2.1 time: 0.735114 Oct 27 09:15:54.820714 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1788/3597] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:54 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1500 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:54.838505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:54.839225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:54.845746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:54.846371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:54.846879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:54.847892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:54.848533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:54.848967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:54.916207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:54.916906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:54.919708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:54.919708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lazy-loading 'fault' on Instance uuid 9f81839e-215c-43da-8d9a-9628eb7db102 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:15:55.101592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:55.116202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:55.119757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ba42c0fc7b34ffaba25f5004dad583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd11ea6fd55c4b5fb4a006ab6ace9fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:55.121336 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b35660c0-8c43-4771-a2b8-0b57b3409ad4 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 200 len: 1409 microversion: 2.54 time: 0.287604 Oct 27 09:15:55.123155 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1789/3598] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:54 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 1409 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:15:55.128438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:55.129460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: a0460dce-a27a-4974-b3d5-71f416e50a61] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:55.135892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:55.136916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:55.137617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:55.138534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:55.139206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:55.139983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:55.698357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b05c3cdcd4b5fbffc78e6508002c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e1b238d6ce43fc932ea1bd5e4413f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:55.709108 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-39bd30a7-1674-478c-9fda-16ced5fedd7e tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61" status: 200 len: 1521 microversion: 2.1 time: 0.584537 Oct 27 09:15:55.710962 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1790/3599] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:55 2022] GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61 => generated 1521 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:55.914264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-278018580", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:55.985967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:15:56.316203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:15:56.593594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Building network info cache for instance {{(pid=120602) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:15:56.888390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:15:56.889114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:15:56.889756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:15:56.890318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:15:56.890910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:15:56.910470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:56.911149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:56.911885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:56.912806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:56.913368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:56.913817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:56.939875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Getting quotas for project 03f1a443472e442e8d5fdd76e7caa469. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:15:56.948641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Getting quotas for user efa9d44a698142dab4cd9d04e8afb20f and project 03f1a443472e442e8d5fdd76e7caa469. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:15:56.964920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:15:56.968614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:15:57.065391 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b5c6827-107b-452e-b8bc-0a63546ef834 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.352804 Oct 27 09:15:57.069041 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1791/3600] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:15:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:15:57.077452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c77dca95-1057-4de6-beed-67d22f1b8f09 req-0e91ec25-c700-40f3-bfc8-39461893789d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006b29e2-6978-427b-a0d6-c42e4829bf23", "name": "network-vif-deleted", "tag": "adbc8770-5ce9-4b35-8b14-327b6bd1104b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:57.097785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c77dca95-1057-4de6-beed-67d22f1b8f09 req-0e91ec25-c700-40f3-bfc8-39461893789d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.098357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c77dca95-1057-4de6-beed-67d22f1b8f09 req-0e91ec25-c700-40f3-bfc8-39461893789d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.098804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c77dca95-1057-4de6-beed-67d22f1b8f09 req-0e91ec25-c700-40f3-bfc8-39461893789d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.114192 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c77dca95-1057-4de6-beed-67d22f1b8f09 req-0e91ec25-c700-40f3-bfc8-39461893789d service nova] Creating event network-vif-deleted:adbc8770-5ce9-4b35-8b14-327b6bd1104b for instance 006b29e2-6978-427b-a0d6-c42e4829bf23 on n-h1-858383-16 Oct 27 09:15:57.122687 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c77dca95-1057-4de6-beed-67d22f1b8f09 req-0e91ec25-c700-40f3-bfc8-39461893789d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052054 Oct 27 09:15:57.123954 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1792/3601] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:57.130856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:57.131769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:57.142371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.143683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.144342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.145447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.146079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.146673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.521627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:57.529864 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79dfdeff-bd4d-416c-a6f2-2eb414a51314 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1487 microversion: 2.1 time: 0.404414 Oct 27 09:15:57.534827 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1793/3602] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:57 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1487 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:57.547775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:57.548411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] [instance: 9f81839e-215c-43da-8d9a-9628eb7db102] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:57.562758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.563304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.563799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.564675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.565183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.565672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.583925 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] HTTP exception thrown: Instance 9f81839e-215c-43da-8d9a-9628eb7db102 could not be found. Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Request method failure captured: Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 HTTP/1.1 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwQfzAwd6IuFkI5TIT2zaeZzYaFbLponltsnFM95PC-mMY_avoHQA7WE-QOTU5pdDer84up9DYU7BDJ3Oa0wMBUmNI4YPTBU5jEOwbg-a_2RC7gbgMLgCcFSkOg0BygGer9upxaaWYUwXIgjagDLSdUtT8CdMQ5RVSwrNXEMV2E1og Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.54 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: bd11ea6fd55c4b5fb4a006ab6ace9fe7 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerShowV254Test-13078201 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd11ea6fd55c4b5fb4a006ab6ace9fe7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd11ea6fd55c4b5fb4a006ab6ace9fe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd11ea6fd55c4b5fb4a006ab6ace9fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd11ea6fd55c4b5fb4a006ab6ace9fe7"}]}] Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerShowV254Test-13078201 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: bd11ea6fd55c4b5fb4a006ab6ace9fe7 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerShowV254Test-13078201 Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerShowV254Test-13078201-project Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 7ba42c0fc7b34ffaba25f5004dad583a Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerShowV254Test-13078201-project Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 9f81839e-215c-43da-8d9a-9628eb7db102 could not be found. Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '9f81839e-215c-43da-8d9a-9628eb7db102'} Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f81839e-215c-43da-8d9a-9628eb7db102 could not be found. Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f81839e-215c-43da-8d9a-9628eb7db102 could not be found. Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:57.585760 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f81839e-215c-43da-8d9a-9628eb7db102 could not be found. Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] Returning 404 to user: Instance 9f81839e-215c-43da-8d9a-9628eb7db102 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36836452-4669-4773-af28-59cb2bf92e87 tempest-ServerShowV254Test-13078201 tempest-ServerShowV254Test-13078201-project] 10.222.0.25 "GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102" status: 404 len: 111 microversion: 2.54 time: 0.054078 Oct 27 09:15:57.590640 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1794/3603] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:15:57 2022] GET /compute/v2.1/servers/9f81839e-215c-43da-8d9a-9628eb7db102 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:15:57.609604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-721e8698-2f58-4f38-b01e-5737d54b6cc9 req-dd487d2e-91be-4ede-b3c2-a1537c5cdb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8901fe0-0223-4b98-9a13-90cb604273b9", "name": "network-vif-unplugged", "status": "completed", "tag": "573acdf5-4df7-4810-b86c-7e8b4a077454"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:57.640972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-721e8698-2f58-4f38-b01e-5737d54b6cc9 req-dd487d2e-91be-4ede-b3c2-a1537c5cdb7d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.641773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-721e8698-2f58-4f38-b01e-5737d54b6cc9 req-dd487d2e-91be-4ede-b3c2-a1537c5cdb7d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.641876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-721e8698-2f58-4f38-b01e-5737d54b6cc9 req-dd487d2e-91be-4ede-b3c2-a1537c5cdb7d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.682156 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-721e8698-2f58-4f38-b01e-5737d54b6cc9 req-dd487d2e-91be-4ede-b3c2-a1537c5cdb7d service nova] Creating event network-vif-unplugged:573acdf5-4df7-4810-b86c-7e8b4a077454 for instance b8901fe0-0223-4b98-9a13-90cb604273b9 on n-h2-858383-16 Oct 27 09:15:57.694442 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-721e8698-2f58-4f38-b01e-5737d54b6cc9 req-dd487d2e-91be-4ede-b3c2-a1537c5cdb7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103395 Oct 27 09:15:57.695083 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1795/3604] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:15:57.705200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:57.706121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: a0460dce-a27a-4974-b3d5-71f416e50a61] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:57.718856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.723041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.723816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.725706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.726124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.726572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.764366 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] HTTP exception thrown: Instance a0460dce-a27a-4974-b3d5-71f416e50a61 could not be found. Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Request method failure captured: Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61 HTTP/1.1 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwRQ7WzjnzCP04s3CtmtUU8jWSuKQP_VSij33_SN_Cz054sG65ds9eixdVc6Zadc6nrYa09r1gDvqlikF-XPRY17QrRFh-2vzq0Vi5m1dcOxXQ6IJXTx2UTKkkh-E8B068suD0qtz8myZJCDx5TMojFxnIlZPqxzPZKUkx1AEQdWPw Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}] Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8b9b05c3cdcd4b5fbffc78e6508002c8 Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance a0460dce-a27a-4974-b3d5-71f416e50a61 could not be found. Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'a0460dce-a27a-4974-b3d5-71f416e50a61'} Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0460dce-a27a-4974-b3d5-71f416e50a61 could not be found. Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0460dce-a27a-4974-b3d5-71f416e50a61 could not be found. Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.772068 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0460dce-a27a-4974-b3d5-71f416e50a61 could not be found. Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Returning 404 to user: Instance a0460dce-a27a-4974-b3d5-71f416e50a61 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a927d9d3-8a60-48ba-a811-b95e65558016 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61" status: 404 len: 111 microversion: 2.1 time: 0.075562 Oct 27 09:15:57.777486 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1796/3605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:57 2022] GET /compute/v2.1/servers/a0460dce-a27a-4974-b3d5-71f416e50a61 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:15:57.802621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9fa9ad3-0a45-4923-94b8-5e4419c8a02c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:57.804920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b9fa9ad3-0a45-4923-94b8-5e4419c8a02c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:57.858394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Updating instance_info_cache with network_info: [{"id": "7c621738-d4dc-44f3-99b9-b323bf8f3ad3", "address": "fa:16:3e:da:6c:2e", "network": {"id": "ab13eded-e8f5-4da5-879a-e47232da5d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1354117030-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1469f50688644411a306ae4f0305d56c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7c621738-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120602) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:15:57.878538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Releasing lock "refresh_cache-5733e89b-e5f0-455b-b596-16f0f6a280d3" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:15:57.880527 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-947f791d-0a3a-4a2f-a361-82f7d7696b26 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "POST /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3/action" status: 202 len: 0 microversion: 2.1 time: 5.587072 Oct 27 09:15:57.882596 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1810/3606] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:15:52 2022] POST /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3/action => generated 0 bytes in 5590 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 09:15:57.898175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:57.900649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:57.915315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.919196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.920591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.922898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:57.924547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:57.925505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:57.988434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:15:58.025687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b9fa9ad3-0a45-4923-94b8-5e4419c8a02c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:58.036333 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9fa9ad3-0a45-4923-94b8-5e4419c8a02c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1216 microversion: 2.1 time: 0.260065 Oct 27 09:15:58.040280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1797/3607] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:57 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1216 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:58.056251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:58.057132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] [instance: 006b29e2-6978-427b-a0d6-c42e4829bf23] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:58.068347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.068923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.069288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.069993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.074007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.074470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.108193 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] HTTP exception thrown: Instance 006b29e2-6978-427b-a0d6-c42e4829bf23 could not be found. Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Request method failure captured: Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 HTTP/1.1 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwRQ7WzjnzCP04s3CtmtUU8jWSuKQP_VSij33_SN_Cz054sG65ds9eixdVc6Zadc6nrYa09r1gDvqlikF-XPRY17QrRFh-2vzq0Vi5m1dcOxXQ6IJXTx2UTKkkh-E8B068suD0qtz8myZJCDx5TMojFxnIlZPqxzPZKUkx1AEQdWPw Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6e1b238d6ce43fc932ea1bd5e4413f5"}]}] Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b6e1b238d6ce43fc932ea1bd5e4413f5 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-282046433 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8b9b05c3cdcd4b5fbffc78e6508002c8 Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ListServersNegativeTestJSON-282046433-project Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 006b29e2-6978-427b-a0d6-c42e4829bf23 could not be found. Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '006b29e2-6978-427b-a0d6-c42e4829bf23'} Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006b29e2-6978-427b-a0d6-c42e4829bf23 could not be found. Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006b29e2-6978-427b-a0d6-c42e4829bf23 could not be found. Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.112468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:58.116781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.116781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:58.116781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:58.116781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:58.116781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:58.116781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:58.116781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006b29e2-6978-427b-a0d6-c42e4829bf23 could not be found. Oct 27 09:15:58.116781 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.119118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] Returning 404 to user: Instance 006b29e2-6978-427b-a0d6-c42e4829bf23 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:58.121971 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e4f818d-4090-40b8-b449-0233e9f55cc0 tempest-ListServersNegativeTestJSON-282046433 tempest-ListServersNegativeTestJSON-282046433-project] 10.222.0.25 "GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23" status: 404 len: 111 microversion: 2.1 time: 0.080414 Oct 27 09:15:58.123352 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1798/3608] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:58 2022] GET /compute/v2.1/servers/006b29e2-6978-427b-a0d6-c42e4829bf23 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:15:58.146809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:58.147746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:58.169826 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ad92e5f7-c9d4-40cb-9a96-ba5f294e4f6a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 204 len: 0 microversion: 2.1 time: 0.281515 Oct 27 09:15:58.171028 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1811/3609] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:15:57 2022] DELETE /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:58.182384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c67d2b42-f827-42f5-891b-27adb804d24a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a9470a60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:58.200211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.200721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.201172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.201891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.202354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.216805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.266007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:15:58.276606 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c67d2b42-f827-42f5-891b-27adb804d24a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Image not found. Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c67d2b42-f827-42f5-891b-27adb804d24a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 HTTP/1.1 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b2999179-a0b0-4d2b-b27e-e6a1f10e2b71'} Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 to delete Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 could not be found. Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.279494 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:15:58.284396 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:15:58.287074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c67d2b42-f827-42f5-891b-27adb804d24a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:15:58.288367 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c67d2b42-f827-42f5-891b-27adb804d24a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71" status: 404 len: 62 microversion: 2.1 time: 0.110261 Oct 27 09:15:58.289080 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1812/3610] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:58 2022] DELETE /compute/v2.1/images/b2999179-a0b0-4d2b-b27e-e6a1f10e2b71 => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:15:58.302712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:58.310869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:58.326910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.327458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.328172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.328918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.329387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.329824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.399044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:15:58.466701 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-569d6ec9-a530-44e7-9c1c-c542e14ce39d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 204 len: 0 microversion: 2.1 time: 0.341047 Oct 27 09:15:58.468421 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1799/3611] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:15:58 2022] DELETE /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:58.481612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.111"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:58.486508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:58.498445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.499440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.500160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.501138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.502798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.503730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.535857 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.api [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Instance is already in deleting state, ignoring this request Oct 27 09:15:58.540298 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f2b76d82-92a8-4ece-953e-7407bb76bde8 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 204 len: 0 microversion: 2.1 time: 0.246599 Oct 27 09:15:58.543011 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1813/3612] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:15:58 2022] DELETE /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:15:58.553779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:58.554666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:58.563159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.563927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.565101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.566046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:58.566708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:58.567989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:58.572377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "refresh_cache-9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:15:58.572811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquired lock "refresh_cache-9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:15:58.968698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:58.978862 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ca09c82-f5f9-44b3-9adb-f706b2913ecd tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1493 microversion: 2.1 time: 0.430484 Oct 27 09:15:58.980565 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1814/3613] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:58 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1493 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:59.067416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:15:59.069221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:15:59.078372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:59.079161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:59.080094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:59.081219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:59.081933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:59.082753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:59.217187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:15:59.227232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-378e4294-502e-4ed4-8e27-d6ee24cb3dd4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1220 microversion: 2.1 time: 0.164851 Oct 27 09:15:59.228210 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1815/3614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:59 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1220 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:15:59.436787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6d52c2f6-c8aa-4478-be9a-bd04555138f4 req-4bcc9082-98f1-4eea-8296-db50fbd3dfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0460dce-a27a-4974-b3d5-71f416e50a61", "name": "network-vif-deleted", "tag": "677bc06b-dbc9-4f90-b0d9-8b7d9f829e9c"}, {"name": "network-changed", "server_uuid": "5733e89b-e5f0-455b-b596-16f0f6a280d3", "tag": "7c621738-d4dc-44f3-99b9-b323bf8f3ad3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:15:59.458225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d52c2f6-c8aa-4478-be9a-bd04555138f4 req-4bcc9082-98f1-4eea-8296-db50fbd3dfda service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:15:59.460463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d52c2f6-c8aa-4478-be9a-bd04555138f4 req-4bcc9082-98f1-4eea-8296-db50fbd3dfda service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:15:59.461586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d52c2f6-c8aa-4478-be9a-bd04555138f4 req-4bcc9082-98f1-4eea-8296-db50fbd3dfda service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:15:59.486615 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6d52c2f6-c8aa-4478-be9a-bd04555138f4 req-4bcc9082-98f1-4eea-8296-db50fbd3dfda service nova] Creating event network-vif-deleted:677bc06b-dbc9-4f90-b0d9-8b7d9f829e9c for instance a0460dce-a27a-4974-b3d5-71f416e50a61 on n-h2-858383-16 Oct 27 09:15:59.487117 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6d52c2f6-c8aa-4478-be9a-bd04555138f4 req-4bcc9082-98f1-4eea-8296-db50fbd3dfda service nova] Creating event network-changed:7c621738-d4dc-44f3-99b9-b323bf8f3ad3 for instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 on n-h1-858383-16 Oct 27 09:15:59.508753 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6d52c2f6-c8aa-4478-be9a-bd04555138f4 req-4bcc9082-98f1-4eea-8296-db50fbd3dfda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.279236 Oct 27 09:15:59.510281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1816/3615] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:00.018403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:00.021259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:00.057496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:00.058251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:00.059823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:00.060782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:00.061691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:00.068012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:00.134775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=85,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=6,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:01.548778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:01.560726 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-24253ae3-61f9-4b1e-ba16-064ea00d7490 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1493 microversion: 2.1 time: 1.555042 Oct 27 09:16:01.576227 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1817/3616] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:15:59 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1493 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:01.585175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:01.587106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:01.595356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:01.596785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:01.597493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:01.598529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:01.599279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:01.599940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:02.041006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:02.056832 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8898bcd8-94ae-4eb7-befe-b06444677da9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1286 microversion: 2.1 time: 0.478755 Oct 27 09:16:02.075925 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1818/3617] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:01 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1286 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:02.490872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2a1f85cd-383b-4bb0-925b-ee3592e3a9c3 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Action: 'create', calling method: .version_select at 0x7f31a93e0310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-526470714", "metadata": {"Type": "work"}}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:02.988524 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2a1f85cd-383b-4bb0-925b-ee3592e3a9c3 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.911018 Oct 27 09:16:03.002106 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1819/3618] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Oct 27 09:16:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 925 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 09:16:03.011296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-785529ae-ecba-4ee8-b2fb-71a3f798772e req-e5eecff1-8f1a-4d49-b745-c0b18312e062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5733e89b-e5f0-455b-b596-16f0f6a280d3", "name": "network-vif-deleted", "tag": "7c621738-d4dc-44f3-99b9-b323bf8f3ad3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:03.031610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-785529ae-ecba-4ee8-b2fb-71a3f798772e req-e5eecff1-8f1a-4d49-b745-c0b18312e062 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:03.033381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-785529ae-ecba-4ee8-b2fb-71a3f798772e req-e5eecff1-8f1a-4d49-b745-c0b18312e062 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:03.034083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-785529ae-ecba-4ee8-b2fb-71a3f798772e req-e5eecff1-8f1a-4d49-b745-c0b18312e062 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:03.047918 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-785529ae-ecba-4ee8-b2fb-71a3f798772e req-e5eecff1-8f1a-4d49-b745-c0b18312e062 service nova] Creating event network-vif-deleted:7c621738-d4dc-44f3-99b9-b323bf8f3ad3 for instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 on n-h1-858383-16 Oct 27 09:16:03.055684 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-785529ae-ecba-4ee8-b2fb-71a3f798772e req-e5eecff1-8f1a-4d49-b745-c0b18312e062 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050115 Oct 27 09:16:03.056493 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1820/3619] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:03.064885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:03.066070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:03.079962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:03.081075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:03.081720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:03.084771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:03.086300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:03.096393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:03.700371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:03.711033 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da4f1d29-244d-4c79-b6a1-5ae39009da11 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1493 microversion: 2.1 time: 0.652936 Oct 27 09:16:03.716412 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1821/3620] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:03 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1493 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:03.722981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f4f1e26e-de3b-4a58-b145-bebc433598ee tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Calling method '.version_select at 0x7f31a93a13a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:03.809504 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f4f1e26e-de3b-4a58-b145-bebc433598ee tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1" status: 200 len: 352 microversion: 2.1 time: 0.091390 Oct 27 09:16:03.811040 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1822/3621] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:16:03 2022] GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1 => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:03.816712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:03.817324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:03.835481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:03.836031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:03.837941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:03.839994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:03.845717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:03.846331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:03.868997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Building network info cache for instance {{(pid=120603) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:16:04.082002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:04.101807 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b98ec99c-4a73-46c0-9ab9-53765d180abb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1274 microversion: 2.1 time: 0.288930 Oct 27 09:16:04.103494 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1823/3622] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:03 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1274 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:04.113859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-84771062-c76b-4de1-8a80-a8f8663381fb req-06243d6d-7e64-4fb0-b76a-9995946f0c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d339b0a-f7bc-4d58-90d1-e5d4beb1834e", "tag": "de3d506c-8d30-4307-947f-6fb004d3c625"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:04.147610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-84771062-c76b-4de1-8a80-a8f8663381fb req-06243d6d-7e64-4fb0-b76a-9995946f0c3e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:04.149038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-84771062-c76b-4de1-8a80-a8f8663381fb req-06243d6d-7e64-4fb0-b76a-9995946f0c3e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:04.149787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-84771062-c76b-4de1-8a80-a8f8663381fb req-06243d6d-7e64-4fb0-b76a-9995946f0c3e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:04.167195 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-84771062-c76b-4de1-8a80-a8f8663381fb req-06243d6d-7e64-4fb0-b76a-9995946f0c3e service nova] Creating event network-changed:de3d506c-8d30-4307-947f-6fb004d3c625 for instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e on n-h1-858383-16 Oct 27 09:16:04.202544 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-84771062-c76b-4de1-8a80-a8f8663381fb req-06243d6d-7e64-4fb0-b76a-9995946f0c3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078794 Oct 27 09:16:04.204923 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1824/3623] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:04.739050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:04.739815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:04.753349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:04.757342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:04.757844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:04.758286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:04.758998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:04.759449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:04.767132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:04.851028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:04.851613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:04.852001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:04.855213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lazy-loading 'fault' on Instance uuid b8901fe0-0223-4b98-9a13-90cb604273b9 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:16:05.060287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63dd72032ef4fe098382555888e3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be73c8404fc741cfb680a7447af0f232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:05.069553 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-848d3edb-f89d-4194-a0ae-d03e5aa2fe84 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 200 len: 1297 microversion: 2.1 time: 0.334859 Oct 27 09:16:05.074238 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1825/3624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:04 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 1297 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:16:05.080023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e0f324c6-dc6a-444b-b110-c862e2769354 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Calling method '.version_select at 0x7f31a93cc9d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:05.155258 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e0f324c6-dc6a-444b-b110-c862e2769354 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1" status: 200 len: 353 microversion: 2.1 time: 0.078989 Oct 27 09:16:05.164493 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1826/3625] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:16:05 2022] GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:05.173683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:05.174499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:05.183761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:05.184581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:05.185253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:05.187955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:05.187955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:05.187955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:05.675103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:05.709448 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-254bb99b-fb34-4807-8a0f-e6d44856c4a2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1316 microversion: 2.1 time: 0.537973 Oct 27 09:16:05.710364 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1827/3626] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:05 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:05.750565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26dfd728-3fe8-4182-9f65-950fa060540f tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Calling method '.version_select at 0x7f31a9d0e040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:05.821899 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-26dfd728-3fe8-4182-9f65-950fa060540f tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1" status: 200 len: 353 microversion: 2.1 time: 0.102743 Oct 27 09:16:05.822944 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1828/3627] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:16:05 2022] GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:05.838773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6fe51180-abc0-470d-a675-1882f8d71c48 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Calling method '.version_select at 0x7f31a939f550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:05.945275 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6fe51180-abc0-470d-a675-1882f8d71c48 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1" status: 202 len: 0 microversion: 2.1 time: 0.111087 Oct 27 09:16:05.948846 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1829/3628] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:16:05 2022] DELETE /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:16:05.962768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8ea0d00-fd06-405d-afdd-10f58f072126 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Calling method '.version_select at 0x7f31a939f1f0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:06.115855 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8ea0d00-fd06-405d-afdd-10f58f072126 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1" status: 200 len: 352 microversion: 2.1 time: 0.161504 Oct 27 09:16:06.117056 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1830/3629] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:16:05 2022] GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1 => generated 352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:06.140404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:06.141356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: b8901fe0-0223-4b98-9a13-90cb604273b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:06.164423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.166196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.166888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.170436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.171333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.172467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.243021 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance b8901fe0-0223-4b98-9a13-90cb604273b9 could not be found. Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 HTTP/1.1 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b8901fe0-0223-4b98-9a13-90cb604273b9 could not be found. Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b8901fe0-0223-4b98-9a13-90cb604273b9'} Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8901fe0-0223-4b98-9a13-90cb604273b9 could not be found. Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8901fe0-0223-4b98-9a13-90cb604273b9 could not be found. Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.257697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.263318 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.263318 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.263318 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:06.263318 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:06.263318 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8901fe0-0223-4b98-9a13-90cb604273b9 could not be found. Oct 27 09:16:06.263318 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.263318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance b8901fe0-0223-4b98-9a13-90cb604273b9 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:06.263318 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ee929b60-2c8e-4086-9b64-eeeed1c39337 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9" status: 404 len: 111 microversion: 2.1 time: 0.141840 Oct 27 09:16:06.267687 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1831/3630] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:06 2022] GET /compute/v2.1/servers/b8901fe0-0223-4b98-9a13-90cb604273b9 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:06.283270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:06.286172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:06.298578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.299262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.299790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.300672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.301307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.301943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.328595 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 HTTP/1.1 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f8dbd143-6100-4d9c-87e5-b0df7b176859'} Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:06.330970 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.339041 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.340925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:06.342192 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f5603622-f7f7-44f1-ab8f-a555e17a808e tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 404 len: 111 microversion: 2.1 time: 0.073308 Oct 27 09:16:06.346555 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1832/3631] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:16:06 2022] DELETE /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:06.353272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:06.354253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: f8dbd143-6100-4d9c-87e5-b0df7b176859] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:06.364033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.364902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.365617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.366793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.367611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.370358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.407715 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 HTTP/1.1 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f8dbd143-6100-4d9c-87e5-b0df7b176859'} Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.413381 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.423761 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.423761 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.423761 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:06.423761 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:06.423761 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. Oct 27 09:16:06.423761 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.428656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance f8dbd143-6100-4d9c-87e5-b0df7b176859 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:06.429943 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-beeacc4b-c0b2-48a9-a781-1d088b5fa35f tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859" status: 404 len: 111 microversion: 2.1 time: 0.081605 Oct 27 09:16:06.430180 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1833/3632] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:06 2022] GET /compute/v2.1/servers/f8dbd143-6100-4d9c-87e5-b0df7b176859 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:06.438800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23c0d759-1378-4cd2-8dc1-efc3f8b403c2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a93a1160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:06.492854 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-23c0d759-1378-4cd2-8dc1-efc3f8b403c2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Image not found. Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23c0d759-1378-4cd2-8dc1-efc3f8b403c2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 HTTP/1.1 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '83707bc5-de1f-43fa-9252-085cd501d004'} Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 83707bc5-de1f-43fa-9252-085cd501d004 to delete Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83707bc5-de1f-43fa-9252-085cd501d004 could not be found. Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.494841 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23c0d759-1378-4cd2-8dc1-efc3f8b403c2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23c0d759-1378-4cd2-8dc1-efc3f8b403c2 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004" status: 404 len: 62 microversion: 2.1 time: 0.062773 Oct 27 09:16:06.501523 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1834/3633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:06 2022] DELETE /compute/v2.1/images/83707bc5-de1f-43fa-9252-085cd501d004 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:16:06.511247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:06.512742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:06.526508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.529187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.531363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.532448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.534390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.534955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.566926 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 HTTP/1.1 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '119dcc89-5176-4b9f-b784-cba0bb8c1444'} Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:06.572576 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.579020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:06.581151 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a45e47f5-488f-4c7d-bf4c-c6acfdf3fc37 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 404 len: 111 microversion: 2.1 time: 0.076103 Oct 27 09:16:06.585666 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1835/3634] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:16:06 2022] DELETE /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:06.593423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-14bc23a5-0f5f-49e2-9a47-8fa8e32c5561 req-879204ba-9e90-42f8-860a-61ffb10df8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8901fe0-0223-4b98-9a13-90cb604273b9", "name": "network-vif-deleted", "tag": "573acdf5-4df7-4810-b86c-7e8b4a077454"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:06.617285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-14bc23a5-0f5f-49e2-9a47-8fa8e32c5561 req-879204ba-9e90-42f8-860a-61ffb10df8d7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.619895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-14bc23a5-0f5f-49e2-9a47-8fa8e32c5561 req-879204ba-9e90-42f8-860a-61ffb10df8d7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.620633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-14bc23a5-0f5f-49e2-9a47-8fa8e32c5561 req-879204ba-9e90-42f8-860a-61ffb10df8d7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.645548 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-14bc23a5-0f5f-49e2-9a47-8fa8e32c5561 req-879204ba-9e90-42f8-860a-61ffb10df8d7 service nova] Creating event network-vif-deleted:573acdf5-4df7-4810-b86c-7e8b4a077454 for instance b8901fe0-0223-4b98-9a13-90cb604273b9 on n-h2-858383-16 Oct 27 09:16:06.659990 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-14bc23a5-0f5f-49e2-9a47-8fa8e32c5561 req-879204ba-9e90-42f8-860a-61ffb10df8d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072792 Oct 27 09:16:06.663000 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1836/3635] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:06.668629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:06.677854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: 119dcc89-5176-4b9f-b784-cba0bb8c1444] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:06.696067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.697124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.697980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.698986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.700346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.701074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.719485 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 HTTP/1.1 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '119dcc89-5176-4b9f-b784-cba0bb8c1444'} Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.721872 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:06.731686 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:06.731686 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:06.731686 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:06.731686 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:06.731686 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. Oct 27 09:16:06.731686 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:06.731686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance 119dcc89-5176-4b9f-b784-cba0bb8c1444 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:06.731686 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8743e33e-57c3-4a9c-95d0-a360ad2fb033 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444" status: 404 len: 111 microversion: 2.1 time: 0.061596 Oct 27 09:16:06.733510 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1837/3636] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:06 2022] GET /compute/v2.1/servers/119dcc89-5176-4b9f-b784-cba0bb8c1444 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:06.739846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:06.740195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:06.747921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.748681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.749327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.750233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:06.750876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:06.751526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:06.922725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=16 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:06.970842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Updating instance_info_cache with network_info: [{"id": "de3d506c-8d30-4307-947f-6fb004d3c625", "address": "fa:16:3e:ae:d7:28", "network": {"id": "ab13eded-e8f5-4da5-879a-e47232da5d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1354117030-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1469f50688644411a306ae4f0305d56c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapde3d506c-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120603) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:16:06.987677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:06.992178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Releasing lock "refresh_cache-9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:16:06.994478 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d3c2098-b528-48ec-8e80-3b70e430997e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "POST /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e/action" status: 202 len: 0 microversion: 2.1 time: 8.518023 Oct 27 09:16:06.999543 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1800/3637] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:15:58 2022] POST /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e/action => generated 0 bytes in 8521 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 09:16:07.007172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a4b4c35-cc32-4289-9fa8-8e5aa7404892 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31aa358040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.051895 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4a4b4c35-cc32-4289-9fa8-8e5aa7404892 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Image not found. Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a4b4c35-cc32-4289-9fa8-8e5aa7404892 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 HTTP/1.1 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5c709592-dc2a-459a-9a01-357e7cbc18e5'} Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5c709592-dc2a-459a-9a01-357e7cbc18e5 to delete Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c709592-dc2a-459a-9a01-357e7cbc18e5 could not be found. Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.053791 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:16:07.059713 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.065058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:07.065530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a4b4c35-cc32-4289-9fa8-8e5aa7404892 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:07.072314 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a4b4c35-cc32-4289-9fa8-8e5aa7404892 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5" status: 404 len: 62 microversion: 2.1 time: 0.072616 Oct 27 09:16:07.073289 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1801/3638] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:06 2022] DELETE /compute/v2.1/images/5c709592-dc2a-459a-9a01-357e7cbc18e5 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:16:07.079267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-405e65a7-1a83-4669-9fa1-7c126203dc5e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '.version_select at 0x7f31aa800ee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.079730 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f45fae08-632a-4c3e-9ea9-82707223e5d9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1316 microversion: 2.1 time: 0.344786 Oct 27 09:16:07.091801 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1838/3639] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:06 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:07.091801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.091801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:07.093350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.093856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.094303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.095017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.098957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.098957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.143838 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b HTTP/1.1 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'ae674039-cf22-428c-9b75-466061b9d46b'} Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:07.145523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.150609 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.151883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:07.153091 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b6d9ffd-7291-4deb-b580-ebb6f3840fbe tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 404 len: 111 microversion: 2.1 time: 0.071316 Oct 27 09:16:07.153770 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1839/3640] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:16:07 2022] DELETE /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:07.162365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-254ed3e6-9676-40fc-aa4f-466f28d98721 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Calling method '.version_select at 0x7f31a94f8ca0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.221626 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-254ed3e6-9676-40fc-aa4f-466f28d98721 tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1" status: 200 len: 352 microversion: 2.1 time: 0.063474 Oct 27 09:16:07.225288 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1840/3641] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:16:07 2022] GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1 => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:07.235032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.236359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: ae674039-cf22-428c-9b75-466061b9d46b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:07.248666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.250315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.253262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.255547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.255547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.256595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.295501 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b HTTP/1.1 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'ae674039-cf22-428c-9b75-466061b9d46b'} Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.297963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.304039 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.304039 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.304039 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:07.304039 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:07.304039 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. Oct 27 09:16:07.304039 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.304039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance ae674039-cf22-428c-9b75-466061b9d46b could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:07.304039 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ecfa8567-c91c-4d4e-bf62-4ff357d7ba1a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b" status: 404 len: 111 microversion: 2.1 time: 0.073128 Oct 27 09:16:07.304039 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1841/3642] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:07 2022] GET /compute/v2.1/servers/ae674039-cf22-428c-9b75-466061b9d46b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:07.309866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1701ef3e-faa4-4cc4-8e13-00b71c8c1b95 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a93a14c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.350755 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-1701ef3e-faa4-4cc4-8e13-00b71c8c1b95 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Image not found. Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1701ef3e-faa4-4cc4-8e13-00b71c8c1b95 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 HTTP/1.1 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'ebe485b5-5add-4a99-902b-e3f779ac1de6'} Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ebe485b5-5add-4a99-902b-e3f779ac1de6 to delete Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ebe485b5-5add-4a99-902b-e3f779ac1de6 could not be found. Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.352971 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:16:07.359224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.364059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1701ef3e-faa4-4cc4-8e13-00b71c8c1b95 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:07.365771 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1701ef3e-faa4-4cc4-8e13-00b71c8c1b95 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6" status: 404 len: 62 microversion: 2.1 time: 0.060192 Oct 27 09:16:07.369971 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1842/3643] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:07 2022] DELETE /compute/v2.1/images/ebe485b5-5add-4a99-902b-e3f779ac1de6 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:16:07.380445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a4b6724d-51b2-44fa-af37-bb0a9b113b02 req-2fe4b715-4d55-4641-8b9f-0ac8d0495b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47545e3-12d5-44d9-9d89-d99673b0dd60", "tag": "30117189-50cc-42e4-a2f8-1f7c1845b42a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:07.394332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a4b6724d-51b2-44fa-af37-bb0a9b113b02 req-2fe4b715-4d55-4641-8b9f-0ac8d0495b53 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.395051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a4b6724d-51b2-44fa-af37-bb0a9b113b02 req-2fe4b715-4d55-4641-8b9f-0ac8d0495b53 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.395713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a4b6724d-51b2-44fa-af37-bb0a9b113b02 req-2fe4b715-4d55-4641-8b9f-0ac8d0495b53 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.409291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a4b6724d-51b2-44fa-af37-bb0a9b113b02 req-2fe4b715-4d55-4641-8b9f-0ac8d0495b53 service nova] Creating event network-changed:30117189-50cc-42e4-a2f8-1f7c1845b42a for instance b47545e3-12d5-44d9-9d89-d99673b0dd60 on n-h2-858383-16 Oct 27 09:16:07.417644 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a4b6724d-51b2-44fa-af37-bb0a9b113b02 req-2fe4b715-4d55-4641-8b9f-0ac8d0495b53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045285 Oct 27 09:16:07.419268 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1843/3644] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:07.425766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.427834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:07.436146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.437487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.438150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.439100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.440008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.440652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.470971 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 HTTP/1.1 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'dc682645-328d-418c-aeda-55b06824b085'} Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:07.473151 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.477573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.481864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:07.482677 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-42278445-2c6c-44d8-b189-3be7143a5070 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 404 len: 111 microversion: 2.1 time: 0.062010 Oct 27 09:16:07.486821 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1844/3645] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:16:07 2022] DELETE /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:07.501191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.502615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: dc682645-328d-418c-aeda-55b06824b085] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:07.510151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.511225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.512495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.514398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.515107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.516113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.519188 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-405e65a7-1a83-4669-9fa1-7c126203dc5e tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/584f7dc9-53fa-4405-866f-53444f14793b" status: 200 len: 185 microversion: 2.1 time: 0.444680 Oct 27 09:16:07.521242 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1802/3646] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:16:07 2022] GET /compute/v2.1/os-floating-ips/584f7dc9-53fa-4405-866f-53444f14793b => generated 185 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:07.538017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.111"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:07.566154 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 HTTP/1.1 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'dc682645-328d-418c-aeda-55b06824b085'} Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.568114 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.573303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.573303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.573303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:07.573303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:07.573303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. Oct 27 09:16:07.573303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.575939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance dc682645-328d-418c-aeda-55b06824b085 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:07.577063 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9702c18f-e3a4-4eb3-bd62-8dfa1f78a800 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085" status: 404 len: 111 microversion: 2.1 time: 0.088521 Oct 27 09:16:07.581666 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1845/3647] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:07 2022] GET /compute/v2.1/servers/dc682645-328d-418c-aeda-55b06824b085 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:07.587657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a8d0097-9a56-4ff0-acfd-44862cbc8ab4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '.version_select at 0x7f31a939f670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.618424 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6a8d0097-9a56-4ff0-acfd-44862cbc8ab4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Image not found. Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a8d0097-9a56-4ff0-acfd-44862cbc8ab4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 HTTP/1.1 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'daf95a0b-b825-48ae-b8f5-1a02d2272545'} Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image daf95a0b-b825-48ae-b8f5-1a02d2272545 to delete Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image daf95a0b-b825-48ae-b8f5-1a02d2272545 could not be found. Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.621132 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a8d0097-9a56-4ff0-acfd-44862cbc8ab4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a8d0097-9a56-4ff0-acfd-44862cbc8ab4 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545" status: 404 len: 62 microversion: 2.1 time: 0.040638 Oct 27 09:16:07.630440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1846/3648] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:07 2022] DELETE /compute/v2.1/images/daf95a0b-b825-48ae-b8f5-1a02d2272545 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:16:07.635710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.635710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:07.641202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.641890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.642704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.643840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.644475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.645073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.664019 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff HTTP/1.1 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'e5b3e594-7d26-4197-b977-8f60fc81a4ff'} Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:07.665964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.671821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.674472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:07.675630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b29e94d-bcd4-4d06-9365-623910204673 tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 404 len: 111 microversion: 2.1 time: 0.046731 Oct 27 09:16:07.679909 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1847/3649] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:16:07 2022] DELETE /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:07.686564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:07.687597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] [instance: e5b3e594-7d26-4197-b977-8f60fc81a4ff] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:07.698581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.699134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.700508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.701288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.702417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.703002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.722029 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] HTTP exception thrown: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Request method failure captured: Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff HTTP/1.1 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkqaUiJLNyJDiF-6PbfhgwsHpGqAYfYWf3tACLbg0UQN11Egd_lAKWZRVuiz5xZoAM-eDlV05jJbw5cX7B2tZ5PlzXJJPCCmp_alN9lN1vpCNDqVIN3R3R1_UxMaSpiRWiB2TSQknBrEg34E9_mkDvecqFqJXL2UwJFwjRHLSacoJJA Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be73c8404fc741cfb680a7447af0f232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be73c8404fc741cfb680a7447af0f232"}]}] Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: be73c8404fc741cfb680a7447af0f232 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesTestJSON-1596684360 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e63dd72032ef4fe098382555888e3ae3 Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesTestJSON-1596684360-project Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'e5b3e594-7d26-4197-b977-8f60fc81a4ff'} Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.723731 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:07.729002 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:07.729002 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:07.729002 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:07.729002 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:07.729002 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. Oct 27 09:16:07.729002 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:07.729002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] Returning 404 to user: Instance e5b3e594-7d26-4197-b977-8f60fc81a4ff could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:07.729002 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a80ec2f5-e76d-4316-bee8-b9b3fda3e90a tempest-ImagesTestJSON-1596684360 tempest-ImagesTestJSON-1596684360-project] 10.222.0.25 "GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff" status: 404 len: 111 microversion: 2.1 time: 0.043903 Oct 27 09:16:07.729764 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1848/3650] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:07 2022] GET /compute/v2.1/servers/e5b3e594-7d26-4197-b977-8f60fc81a4ff => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:07.892551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:07.903543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.904078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.904533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:07.905260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:07.910995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:07.913717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:08.030938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:08.107661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:08.108449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:08.125094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:08.125597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:08.126055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:08.127076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:08.127536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:08.127984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:08.264166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "refresh_cache-9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:16:08.264465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquired lock "refresh_cache-9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:16:08.611787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:08.624940 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5be5ab1e-992b-4bb3-8220-d6ce4de3b5c4 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1316 microversion: 2.1 time: 0.521017 Oct 27 09:16:08.641423 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1849/3651] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:08 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:08.655857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe61d229-0082-4402-87fd-1bc61b5c950c tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Calling method '.version_select at 0x7f31a93dbe50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:08.760457 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fe61d229-0082-4402-87fd-1bc61b5c950c tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1" status: 200 len: 352 microversion: 2.1 time: 0.117529 Oct 27 09:16:08.761625 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1850/3652] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:16:08 2022] GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:09.440580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Building network info cache for instance {{(pid=120603) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:16:09.675285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1761804561", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": "none"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:09.770628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:16:09.771068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:16:09.771546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:16:09.771991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:16:09.772396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:16:09.799066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:09.799789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:09.800021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:09.800771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:09.806903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:09.807515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:09.862715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Getting quotas for project 28517bb3b66e4ed782c0824572521d76. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:16:09.870060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Getting quotas for user 5375148687e144128aeeeec0351f1bfe and project 28517bb3b66e4ed782c0824572521d76. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:16:09.886690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:16:09.889769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:16:09.988567 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9985cc6e-dd8d-488d-a90d-ce39fb8a0b3c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.556542 Oct 27 09:16:09.989607 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1851/3653] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 09:16:09.999675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-286b78a3-d79c-4b8b-87b5-c5f77f3c10b4 req-5f071f90-8005-407d-949d-9497eaff68d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d339b0a-f7bc-4d58-90d1-e5d4beb1834e", "tag": "de3d506c-8d30-4307-947f-6fb004d3c625"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:10.025452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-286b78a3-d79c-4b8b-87b5-c5f77f3c10b4 req-5f071f90-8005-407d-949d-9497eaff68d2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:10.026299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-286b78a3-d79c-4b8b-87b5-c5f77f3c10b4 req-5f071f90-8005-407d-949d-9497eaff68d2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:10.028189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-286b78a3-d79c-4b8b-87b5-c5f77f3c10b4 req-5f071f90-8005-407d-949d-9497eaff68d2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:10.056592 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-286b78a3-d79c-4b8b-87b5-c5f77f3c10b4 req-5f071f90-8005-407d-949d-9497eaff68d2 service nova] Creating event network-changed:de3d506c-8d30-4307-947f-6fb004d3c625 for instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e on n-h1-858383-16 Oct 27 09:16:10.068446 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-286b78a3-d79c-4b8b-87b5-c5f77f3c10b4 req-5f071f90-8005-407d-949d-9497eaff68d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077196 Oct 27 09:16:10.069791 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1852/3654] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:10.096714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:10.098195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:10.108496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:10.112370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:10.113282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:10.114186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:10.114795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:10.115407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:10.740429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Updating instance_info_cache with network_info: [{"id": "de3d506c-8d30-4307-947f-6fb004d3c625", "address": "fa:16:3e:ae:d7:28", "network": {"id": "ab13eded-e8f5-4da5-879a-e47232da5d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1354117030-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1469f50688644411a306ae4f0305d56c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapde3d506c-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120603) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:16:10.766390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Releasing lock "refresh_cache-9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:16:10.767531 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10d77869-b4f5-4176-a5f2-09e7f32509c8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "POST /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e/action" status: 202 len: 0 microversion: 2.1 time: 3.237826 Oct 27 09:16:10.768275 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1803/3655] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:16:07 2022] POST /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e/action => generated 0 bytes in 3240 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 09:16:10.785738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e99eb907-acea-490e-bf3f-493336c83a8a tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Calling method '.version_select at 0x7f31aa4ab4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:10.800581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:10.809718 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-838e1de6-f8f3-406d-b38c-988039a6ff52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1316 microversion: 2.1 time: 0.736903 Oct 27 09:16:10.810536 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1853/3656] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:10 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:10.839623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2cbd40bb-177d-49a6-a5c1-3b599b23b112 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:10.842222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2cbd40bb-177d-49a6-a5c1-3b599b23b112 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:10.856819 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e99eb907-acea-490e-bf3f-493336c83a8a tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] HTTP exception thrown: Volume 39a78b26-6e46-4e3b-b037-7d7163baf7a1 could not be found. Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e99eb907-acea-490e-bf3f-493336c83a8a tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Request method failure captured: Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1 HTTP/1.1 Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkxQjRIzkUZv6JPLis9XiqRkhesCkQyCXelhy2eIi69JAj5PLtomYq7KPLCyhN7CZd2ewFMO7Ni5h_bf2VhdHzZ9Bn-qdVhzXoSBFoeO8dG7e5W35_BizWq4PiPT3FGKgyQqOW-B8_MWiN0A9dJrA2LX-R5salIMcwJ1Q8-BBm-ISZ8 Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 650fa13e3b5d450e8adff7570074f3df Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesGetTestJSON-601366303 Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650fa13e3b5d450e8adff7570074f3df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_650fa13e3b5d450e8adff7570074f3df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650fa13e3b5d450e8adff7570074f3df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/650fa13e3b5d450e8adff7570074f3df"}]}] Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-VolumesGetTestJSON-601366303 Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 650fa13e3b5d450e8adff7570074f3df Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesGetTestJSON-601366303 Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-VolumesGetTestJSON-601366303-project Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 47f6561b3d74407daff262564e65cfc9 Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-VolumesGetTestJSON-601366303-project Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: exception: Volume 39a78b26-6e46-4e3b-b037-7d7163baf7a1 could not be found. Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '39a78b26-6e46-4e3b-b037-7d7163baf7a1'} Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39a78b26-6e46-4e3b-b037-7d7163baf7a1 could not be found. (HTTP 404) (Request-ID: req-518f60d8-bac8-4951-b100-807324dac582) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:16:10.893443 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39a78b26-6e46-4e3b-b037-7d7163baf7a1 could not be found. Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39a78b26-6e46-4e3b-b037-7d7163baf7a1 could not be found. Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39a78b26-6e46-4e3b-b037-7d7163baf7a1 could not be found. Oct 27 09:16:10.898820 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:10.903556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e99eb907-acea-490e-bf3f-493336c83a8a tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] Returning 404 to user: Volume 39a78b26-6e46-4e3b-b037-7d7163baf7a1 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:10.904692 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e99eb907-acea-490e-bf3f-493336c83a8a tempest-VolumesGetTestJSON-601366303 tempest-VolumesGetTestJSON-601366303-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1" status: 404 len: 109 microversion: 2.1 time: 0.135241 Oct 27 09:16:10.905745 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1804/3657] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:16:10 2022] GET /compute/v2.1/os-volumes/39a78b26-6e46-4e3b-b037-7d7163baf7a1 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:10.914469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:10.922494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:10.930603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:10.940122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:10.943912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:10.946189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:10.949182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:10.954713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:11.013448 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] HTTP exception thrown: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Request method failure captured: Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 HTTP/1.1 Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwF5q9jsEAlQWkOcEEDviiC6_h0d4gpWhoZKabkDIIlilUaDEGNDvr3JpMiaGzHO_Ut2h_O5fonGaMknyasiQpmK8ZArl8ZXPXs6LCz6-d5PLd15F3rvTfvk2Yr2y42vdyYrhm2WGyAiagMvK8Qy7dVZw7xzrrL5Mg-7abQCFqy72E Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1469f50688644411a306ae4f0305d56c Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1469f50688644411a306ae4f0305d56c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1469f50688644411a306ae4f0305d56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1469f50688644411a306ae4f0305d56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1469f50688644411a306ae4f0305d56c"}]}] Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1469f50688644411a306ae4f0305d56c Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FloatingIPsAssociationTestJSON-934170578-project Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9b4eb0adbf5d4df5b292794045947ee1 Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-934170578-project Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5733e89b-e5f0-455b-b596-16f0f6a280d3'} Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:11.019679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.024909 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.029261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Returning 404 to user: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:11.030460 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4cc3153-3167-42fe-b0cd-01431f31d134 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 404 len: 111 microversion: 2.1 time: 0.123497 Oct 27 09:16:11.033619 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1805/3658] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:16:10 2022] DELETE /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:11.042880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2cbd40bb-177d-49a6-a5c1-3b599b23b112 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:11.046654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:11.049839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 5733e89b-e5f0-455b-b596-16f0f6a280d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:11.062675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2cbd40bb-177d-49a6-a5c1-3b599b23b112 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:11.062918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:11.063430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:11.067683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:11.068809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:11.069489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:11.070125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:11.072576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2cbd40bb-177d-49a6-a5c1-3b599b23b112 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:11.080039 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2cbd40bb-177d-49a6-a5c1-3b599b23b112 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1281 microversion: 2.47 time: 0.267910 Oct 27 09:16:11.085180 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1854/3659] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:10 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1281 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:11.119989 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] HTTP exception thrown: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Request method failure captured: Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 HTTP/1.1 Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwF5q9jsEAlQWkOcEEDviiC6_h0d4gpWhoZKabkDIIlilUaDEGNDvr3JpMiaGzHO_Ut2h_O5fonGaMknyasiQpmK8ZArl8ZXPXs6LCz6-d5PLd15F3rvTfvk2Yr2y42vdyYrhm2WGyAiagMvK8Qy7dVZw7xzrrL5Mg-7abQCFqy72E Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1469f50688644411a306ae4f0305d56c Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1469f50688644411a306ae4f0305d56c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1469f50688644411a306ae4f0305d56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1469f50688644411a306ae4f0305d56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1469f50688644411a306ae4f0305d56c"}]}] Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1469f50688644411a306ae4f0305d56c Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FloatingIPsAssociationTestJSON-934170578-project Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9b4eb0adbf5d4df5b292794045947ee1 Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-934170578-project Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5733e89b-e5f0-455b-b596-16f0f6a280d3'} Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.125218 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:11.131336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.131336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:11.131336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:11.131336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:11.131336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:11.131336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:11.131336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. Oct 27 09:16:11.131336 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:11.134053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Returning 404 to user: Instance 5733e89b-e5f0-455b-b596-16f0f6a280d3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:11.137271 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4846f271-db75-4b1d-a8ba-550ed2bdf969 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3" status: 404 len: 111 microversion: 2.1 time: 0.098592 Oct 27 09:16:11.139526 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1806/3660] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:11 2022] GET /compute/v2.1/servers/5733e89b-e5f0-455b-b596-16f0f6a280d3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:11.149856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd653402-6dc4-4556-97a8-40b61ee6d14d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '.version_select at 0x7f31a939fd30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:11.843799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:11.844441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:11.878073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:11.878634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:11.879115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:11.879853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:11.881529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:11.885662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:12.582098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:12.607435 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ecb8f2ba-16aa-4e63-8046-812e9667b19c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1316 microversion: 2.1 time: 0.773582 Oct 27 09:16:12.608265 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1807/3661] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:11 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1316 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:16:12.614614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:12.615434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:12.621460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:12.621952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:12.622412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:12.623106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:12.623780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:12.624382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:12.752636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:12.761370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:12.763928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:12.765379 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b89232c4-ad15-49e8-ac99-0dd575984948 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1339 microversion: 2.47 time: 0.155813 Oct 27 09:16:12.766195 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1808/3662] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:12 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:13.217702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd653402-6dc4-4556-97a8-40b61ee6d14d tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/584f7dc9-53fa-4405-866f-53444f14793b" status: 202 len: 0 microversion: 2.1 time: 2.071965 Oct 27 09:16:13.219598 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1855/3663] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:16:11 2022] DELETE /compute/v2.1/os-floating-ips/584f7dc9-53fa-4405-866f-53444f14793b => generated 0 bytes in 2075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:16:13.226994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:13.227562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:13.234817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:13.235316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:13.235798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:13.236513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:13.236975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:13.237404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:13.293343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:16:13.442715 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3101b960-c0de-444c-bdce-e3556dd3cee4 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 204 len: 0 microversion: 2.1 time: 0.218909 Oct 27 09:16:13.444827 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1809/3664] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:16:13 2022] DELETE /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:16:13.454217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:13.454906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:13.466841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:13.468640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:13.469116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:13.471810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:13.472294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:13.472735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:13.633394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:13.634446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:13.652297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:13.655811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:13.656330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:13.658275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:13.658980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:13.660104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:13.718478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:13.732817 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1c628a3-7f20-4633-b84a-6a6710810893 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1526 microversion: 2.1 time: 0.283966 Oct 27 09:16:13.747602 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1856/3665] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:13 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1526 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:13.796576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:13.797195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:13.810347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:13.810867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:13.811605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:13.812419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:13.812885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:13.813329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:13.901175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:13.903745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:13.920757 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa877c9e-e16c-4fb6-95ac-323b63a4e7a7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1316 microversion: 2.1 time: 0.286179 Oct 27 09:16:13.921395 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1810/3666] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:13 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:16:13.925067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:13.928628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:13.929801 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-201c00cc-f746-476b-b96b-3a40dfad0e5b tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1339 microversion: 2.47 time: 0.137938 Oct 27 09:16:13.931382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-771165ce-fd83-462e-a815-50bbd2965ada req-a4fbce86-3492-4279-ae32-5baf817ef294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47545e3-12d5-44d9-9d89-d99673b0dd60", "name": "network-vif-plugged", "status": "completed", "tag": "30117189-50cc-42e4-a2f8-1f7c1845b42a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:13.932491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1857/3667] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:13 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:16:13.943383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-771165ce-fd83-462e-a815-50bbd2965ada req-a4fbce86-3492-4279-ae32-5baf817ef294 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:13.944510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-771165ce-fd83-462e-a815-50bbd2965ada req-a4fbce86-3492-4279-ae32-5baf817ef294 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:13.945333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-771165ce-fd83-462e-a815-50bbd2965ada req-a4fbce86-3492-4279-ae32-5baf817ef294 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:13.962495 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-771165ce-fd83-462e-a815-50bbd2965ada req-a4fbce86-3492-4279-ae32-5baf817ef294 service nova] Creating event network-vif-plugged:30117189-50cc-42e4-a2f8-1f7c1845b42a for instance b47545e3-12d5-44d9-9d89-d99673b0dd60 on n-h2-858383-16 Oct 27 09:16:13.970455 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-771165ce-fd83-462e-a815-50bbd2965ada req-a4fbce86-3492-4279-ae32-5baf817ef294 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047340 Oct 27 09:16:13.971409 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1811/3668] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:14.758114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:14.759973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:14.774005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:14.774790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:14.775433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:14.776386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:14.777019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:14.779095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:14.832753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:14.946492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:14.948172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:14.960707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:14.962090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:14.962824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:14.964127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:14.964880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:14.966685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:15.163848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:15.200507 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9ef88716-275d-4ebf-ba41-55097d9755b8 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1526 microversion: 2.1 time: 0.440166 Oct 27 09:16:15.201187 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1858/3669] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:14 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1526 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:15.211086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:15.214114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:15.230396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:15.230942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:15.231395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:15.232145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:15.238118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:15.240406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:15.282700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:15.294794 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9a96281-d854-42eb-80a3-58d0753a874e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1316 microversion: 2.1 time: 0.352179 Oct 27 09:16:15.296280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1812/3670] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:14 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:16:15.397699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:15.411066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:15.412563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:15.413717 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8031dcfb-75f0-4858-9e3f-54ff7798d82c tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1339 microversion: 2.47 time: 0.211565 Oct 27 09:16:15.414277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1859/3671] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:15 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1339 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:16.232090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:16.232090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:16.235321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:16.235919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:16.236438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:16.237405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:16.238223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:16.239132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:16.319116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:16.319937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:16.328082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:16.328984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:16.329958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:16.332322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:16.333178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:16.333837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:16.397308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:16.410965 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f6b94d05-cd60-4a25-8060-bcb8e146379b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1526 microversion: 2.1 time: 0.190723 Oct 27 09:16:16.412278 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1813/3672] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:16 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1526 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:16.443876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:16.443876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:16.458961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:16.459561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:16.460056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:16.460820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:16.461294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:16.466650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:16.587527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:16.598509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:16.600438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:16.601964 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-172a579f-6802-4bd7-92b2-83857ee3e731 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1339 microversion: 2.47 time: 0.163882 Oct 27 09:16:16.617160 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1814/3673] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:16 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:16.832976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:16.843395 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66d46418-a162-4d79-8a05-df4d87a621fc tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1465 microversion: 2.1 time: 0.528538 Oct 27 09:16:16.844605 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1860/3674] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:16 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1465 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:16.870997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-771758508", "metadata": {"image_type": "test"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:16.870997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:16.878062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:16.878062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:16.878062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:16.878905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:16.879117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:16.879554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:16.962343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Getting quotas for project 03f1a443472e442e8d5fdd76e7caa469. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:16:16.968698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Getting quotas for user efa9d44a698142dab4cd9d04e8afb20f and project 03f1a443472e442e8d5fdd76e7caa469. Resources: dict_keys(['metadata_items']) {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:16:17.293963 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94552252-91f8-4ff7-ae24-1bcc451d7e42 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "POST /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60/action" status: 202 len: 0 microversion: 2.1 time: 0.430167 Oct 27 09:16:17.294663 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1815/3675] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:16:16 2022] POST /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:16:17.306564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-615fc89c-4d1e-41b5-b4bf-4106f4aa4f03 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a93ba4c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:17.410818 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-615fc89c-4d1e-41b5-b4bf-4106f4aa4f03 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.108257 Oct 27 09:16:17.412893 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1861/3676] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:17 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:17.436554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:17.437391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:17.446111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:17.456794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:17.457305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:17.457753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:17.458495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:17.458954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:17.459379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:17.701546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4e487b05-2ffa-40ec-af9c-6016678ceacb tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Calling method '.version_select at 0x7f31a93e0310>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:17.727768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e487b05-2ffa-40ec-af9c-6016678ceacb tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:17.728213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e487b05-2ffa-40ec-af9c-6016678ceacb tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:17.728651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e487b05-2ffa-40ec-af9c-6016678ceacb tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:17.729411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e487b05-2ffa-40ec-af9c-6016678ceacb tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:17.732139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e487b05-2ffa-40ec-af9c-6016678ceacb tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:17.732593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e487b05-2ffa-40ec-af9c-6016678ceacb tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:17.748196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4eb0adbf5d4df5b292794045947ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1469f50688644411a306ae4f0305d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:17.759699 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2bcab73c-0e14-44c1-8990-628f2f08559b tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 200 len: 1526 microversion: 2.1 time: 0.328456 Oct 27 09:16:17.759848 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1816/3677] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:17 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 1526 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:17.771015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:17.779986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:17.786621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4e487b05-2ffa-40ec-af9c-6016678ceacb tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.280697 Oct 27 09:16:17.789148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:17.789658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:17.790109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:17.790816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:17.791279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:17.800186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:17.801867 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1862/3678] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 27 09:16:17 2022] GET /compute/v2.1/limits => generated 511 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:16:17.867315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32c47ea2-0f21-4209-8122-ccb26bf13149 tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-816360810", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:17.898154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:17.912806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:17.916537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:17.917889 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-788f0deb-2e8a-4c37-be2e-6d8773be6961 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1360 microversion: 2.47 time: 0.154800 Oct 27 09:16:17.929278 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1817/3679] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:17 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:17.937227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-08c2eab0-cf2b-47d9-8440-924aeda7e741 req-b9467310-df98-415e-b4e5-e63f51a7328b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d339b0a-f7bc-4d58-90d1-e5d4beb1834e", "name": "network-vif-deleted", "tag": "de3d506c-8d30-4307-947f-6fb004d3c625"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:17.953306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-08c2eab0-cf2b-47d9-8440-924aeda7e741 req-b9467310-df98-415e-b4e5-e63f51a7328b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:17.953796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-08c2eab0-cf2b-47d9-8440-924aeda7e741 req-b9467310-df98-415e-b4e5-e63f51a7328b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:17.954231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-08c2eab0-cf2b-47d9-8440-924aeda7e741 req-b9467310-df98-415e-b4e5-e63f51a7328b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:17.960501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:17.962405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-32c47ea2-0f21-4209-8122-ccb26bf13149 tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:16:17.982515 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-08c2eab0-cf2b-47d9-8440-924aeda7e741 req-b9467310-df98-415e-b4e5-e63f51a7328b service nova] Creating event network-vif-deleted:de3d506c-8d30-4307-947f-6fb004d3c625 for instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e on n-h1-858383-16 Oct 27 09:16:17.990754 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-08c2eab0-cf2b-47d9-8440-924aeda7e741 req-b9467310-df98-415e-b4e5-e63f51a7328b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059050 Oct 27 09:16:17.991791 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1818/3680] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:17.999704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b37eca5d-cda5-4a82-bb06-2af133dea126 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1495878034"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:18.003851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b37eca5d-cda5-4a82-bb06-2af133dea126 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:18.012668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b37eca5d-cda5-4a82-bb06-2af133dea126 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:18.013560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b37eca5d-cda5-4a82-bb06-2af133dea126 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:18.014306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b37eca5d-cda5-4a82-bb06-2af133dea126 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:18.015259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b37eca5d-cda5-4a82-bb06-2af133dea126 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:18.016049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b37eca5d-cda5-4a82-bb06-2af133dea126 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:18.016745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b37eca5d-cda5-4a82-bb06-2af133dea126 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:18.368382 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b37eca5d-cda5-4a82-bb06-2af133dea126 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "POST /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8/action" status: 202 len: 52 microversion: 2.47 time: 0.373271 Oct 27 09:16:18.370970 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1819/3681] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:16:17 2022] POST /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8/action => generated 52 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:16:18.383078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:18.384164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:18.406943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:18.408020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:18.409083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:18.410107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:18.410659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:18.411208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:18.461294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:16:18.593449 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48345a46-2aa0-49da-aaed-6f3bdd25d790 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 204 len: 0 microversion: 2.47 time: 0.216915 Oct 27 09:16:18.595278 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1820/3682] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:16:18 2022] DELETE /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:16:18.603099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4deac82f-1e75-466e-948c-0321c114e945 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa7309d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:18.678126 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4deac82f-1e75-466e-948c-0321c114e945 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.081167 Oct 27 09:16:18.678811 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1821/3683] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:18 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:18.694574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:18.696151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:18.717836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:18.719156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:18.719724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:18.721069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:18.724429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:18.725706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:18.857720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:18.871898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:18.875767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:18.877007 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0d828962-c79d-4567-bd81-07536172ec25 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1366 microversion: 2.47 time: 0.189102 Oct 27 09:16:18.882470 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1822/3684] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:18 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:18.894158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:18.896554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] [instance: 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:18.908599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:18.909182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:18.909890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:18.910846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:18.911519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:18.912183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:18.930196 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] HTTP exception thrown: Instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e could not be found. Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Request method failure captured: Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e HTTP/1.1 Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkwF5q9jsEAlQWkOcEEDviiC6_h0d4gpWhoZKabkDIIlilUaDEGNDvr3JpMiaGzHO_Ut2h_O5fonGaMknyasiQpmK8ZArl8ZXPXs6LCz6-d5PLd15F3rvTfvk2Yr2y42vdyYrhm2WGyAiagMvK8Qy7dVZw7xzrrL5Mg-7abQCFqy72E Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1469f50688644411a306ae4f0305d56c Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1469f50688644411a306ae4f0305d56c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1469f50688644411a306ae4f0305d56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1469f50688644411a306ae4f0305d56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1469f50688644411a306ae4f0305d56c"}]}] Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1469f50688644411a306ae4f0305d56c Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-934170578 Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-FloatingIPsAssociationTestJSON-934170578-project Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9b4eb0adbf5d4df5b292794045947ee1 Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-934170578-project Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e could not be found. Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '9d339b0a-f7bc-4d58-90d1-e5d4beb1834e'} Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e could not be found. Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e could not be found. Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:18.932609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:18.937617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:18.937617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:18.937617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:18.937617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:18.937617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:18.937617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:18.937617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e could not be found. Oct 27 09:16:18.937617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:16:18.940298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] Returning 404 to user: Instance 9d339b0a-f7bc-4d58-90d1-e5d4beb1834e could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:18.941565 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6ce6e431-8eb8-4745-8023-7be0c3346017 tempest-FloatingIPsAssociationTestJSON-934170578 tempest-FloatingIPsAssociationTestJSON-934170578-project] 10.222.0.25 "GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e" status: 404 len: 111 microversion: 2.1 time: 0.057837 Oct 27 09:16:18.942254 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1823/3685] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:18 2022] GET /compute/v2.1/servers/9d339b0a-f7bc-4d58-90d1-e5d4beb1834e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:16:19.079998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-32c47ea2-0f21-4209-8122-ccb26bf13149 tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Getting quotas for project 221a7b2155244ec1bbba0d85e20188b8. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:16:19.088993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-32c47ea2-0f21-4209-8122-ccb26bf13149 tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Getting quotas for user feb8801267894ba4b433bc03c8ac23e8 and project 221a7b2155244ec1bbba0d85e20188b8. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:16:19.106480 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-32c47ea2-0f21-4209-8122-ccb26bf13149 tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32c47ea2-0f21-4209-8122-ccb26bf13149 tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Request method failure captured: Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 1751 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkxhkY_EgYHC2KlqOHqlVMdKKvR_B6Kas2oyguu_GZyyqM2R57TcFe-im7GaLJvuh7Qjsg5dnGq2cUTPTq332K7Wr_C3nQuAaDi6-eYyGnfBYAc13X4Q85YIeSsYmwRnRURr_RBIj38lX791P9SKirpvRHCnHtJFjCMHY3NJ7W_LoH0 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 221a7b2155244ec1bbba0d85e20188b8 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1596213181 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/221a7b2155244ec1bbba0d85e20188b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_221a7b2155244ec1bbba0d85e20188b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/221a7b2155244ec1bbba0d85e20188b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/221a7b2155244ec1bbba0d85e20188b8"}]}] Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1596213181 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 221a7b2155244ec1bbba0d85e20188b8 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1596213181 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: feb8801267894ba4b433bc03c8ac23e8 Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-816360810", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:19.108914 n-d-858383-16 devstack@n-api.service[120602]: exception: Maximum number of metadata items exceeds 128 Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-816360810', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:16:19.111830 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32c47ea2-0f21-4209-8122-ccb26bf13149 tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-32c47ea2-0f21-4209-8122-ccb26bf13149 tempest-AbsoluteLimitsNegativeTestJSON-1596213181 tempest-AbsoluteLimitsNegativeTestJSON-1596213181-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.249776 Oct 27 09:16:19.115523 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1863/3686] 10.222.0.25 () {60 vars in 1148 bytes} [Thu Oct 27 09:16:17 2022] POST /compute/v2.1/servers => generated 87 bytes in 1251 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:16:19.696828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68d9c81e-e16a-4cd2-910e-e96b4b44a19d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aaabe790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:19.761990 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68d9c81e-e16a-4cd2-910e-e96b4b44a19d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.070593 Oct 27 09:16:19.780006 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1824/3687] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:19 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:19.908004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:19.909015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:19.919168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:19.920359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:19.921042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:19.922237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:19.922947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:19.923671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:19.999540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:20.009612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:20.011643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:20.013350 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-854a80cd-ea6c-469b-be10-49623684f394 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1366 microversion: 2.47 time: 0.110611 Oct 27 09:16:20.014150 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1864/3688] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:19 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:20.781086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99830afa-1898-41f3-96ab-905c31873c67 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa826790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:21.041188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:21.042478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:21.060093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:21.060878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:21.072126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:21.073217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:21.079044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:21.081223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:21.206270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:21.218601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:21.222443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:21.224224 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-96e174a9-98fb-46c8-932d-23f847392d36 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1366 microversion: 2.47 time: 0.187994 Oct 27 09:16:21.225321 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1865/3689] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:21 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:16:21.295870 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99830afa-1898-41f3-96ab-905c31873c67 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.521469 Oct 27 09:16:21.297732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1825/3690] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:20 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:22.254155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:22.255433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:22.276492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:22.277840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:22.278678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:22.281662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:22.282383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:22.285184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:22.313348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-211767b2-dadb-484c-a4f4-24db5791a420 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aaa3b4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:22.423464 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-211767b2-dadb-484c-a4f4-24db5791a420 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.114297 Oct 27 09:16:22.424692 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1826/3691] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:22 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:16:22.659202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:22.680515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:22.686127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:22.694630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a5d7705-f224-4903-8744-40ff886967a4 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1366 microversion: 2.47 time: 0.445252 Oct 27 09:16:22.697795 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1866/3692] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:22 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:23.439375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d236e3f6-6c2b-41ff-a06b-02fe90e10b86 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa2d7ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:23.571001 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d236e3f6-6c2b-41ff-a06b-02fe90e10b86 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.136603 Oct 27 09:16:23.572327 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1827/3693] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:23 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:23.731477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:23.733626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:23.761413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:23.764472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:23.766660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:23.770048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:23.771776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:23.775507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:23.947229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:23.949021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:23.953763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:23.955621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lazy-loading 'fault' on Instance uuid 9409983c-7f2b-47c0-9b41-68debc872aa8 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:16:24.103797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:24.128339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:24.134925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5375148687e144128aeeeec0351f1bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28517bb3b66e4ed782c0824572521d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:24.144205 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc0f0827-99bd-4ea0-8ac4-140930605280 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 200 len: 1371 microversion: 2.47 time: 0.419706 Oct 27 09:16:24.151500 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1867/3694] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:23 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:24.608872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e3337744-f29e-4e05-b64b-96f67057fd30 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa2fb790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:24.633942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3fca1e16-5873-47c2-b43a-84c7ce4d585f req-7e1e854b-f76a-4758-bc00-dd70cba27eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47545e3-12d5-44d9-9d89-d99673b0dd60", "name": "network-vif-plugged", "status": "completed", "tag": "30117189-50cc-42e4-a2f8-1f7c1845b42a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:24.670039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3fca1e16-5873-47c2-b43a-84c7ce4d585f req-7e1e854b-f76a-4758-bc00-dd70cba27eb4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:24.670588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3fca1e16-5873-47c2-b43a-84c7ce4d585f req-7e1e854b-f76a-4758-bc00-dd70cba27eb4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:24.671052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3fca1e16-5873-47c2-b43a-84c7ce4d585f req-7e1e854b-f76a-4758-bc00-dd70cba27eb4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:24.720459 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3fca1e16-5873-47c2-b43a-84c7ce4d585f req-7e1e854b-f76a-4758-bc00-dd70cba27eb4 service nova] Creating event network-vif-plugged:30117189-50cc-42e4-a2f8-1f7c1845b42a for instance b47545e3-12d5-44d9-9d89-d99673b0dd60 on n-h2-858383-16 Oct 27 09:16:24.740324 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3fca1e16-5873-47c2-b43a-84c7ce4d585f req-7e1e854b-f76a-4758-bc00-dd70cba27eb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111519 Oct 27 09:16:24.742865 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1868/3695] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:24.894823 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e3337744-f29e-4e05-b64b-96f67057fd30 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.310878 Oct 27 09:16:24.895517 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1828/3696] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:24 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:25.186009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:25.186979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] [instance: 9409983c-7f2b-47c0-9b41-68debc872aa8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:25.201799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:25.202536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:25.203157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:25.204095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:25.204731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:25.208443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:25.235171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] HTTP exception thrown: Instance 9409983c-7f2b-47c0-9b41-68debc872aa8 could not be found. Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Request method failure captured: Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 HTTP/1.1 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkxZ5HzRXnj3HR_9TOQiBRqRe36BixhlNW5_hrI0kbS0PrXzbLwRdMMyEvrP1OaF01oycCshmhbDpD4m4bZ1YkNezDmKKniHhJ5RaXFRTsrP6w4-sEXwpDBaywTg5C0rvcBLSVYvkHP6Y_6ra8xptWoncqScjT-XHDBmN58n5cdz5Q4 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 28517bb3b66e4ed782c0824572521d76 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAaction247Test-285690410 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28517bb3b66e4ed782c0824572521d76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_28517bb3b66e4ed782c0824572521d76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/28517bb3b66e4ed782c0824572521d76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/28517bb3b66e4ed782c0824572521d76"}]}] Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAaction247Test-285690410 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 28517bb3b66e4ed782c0824572521d76 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAaction247Test-285690410 Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAaction247Test-285690410-project Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5375148687e144128aeeeec0351f1bfe Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAaction247Test-285690410-project Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 9409983c-7f2b-47c0-9b41-68debc872aa8 could not be found. Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '9409983c-7f2b-47c0-9b41-68debc872aa8'} Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9409983c-7f2b-47c0-9b41-68debc872aa8 could not be found. Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9409983c-7f2b-47c0-9b41-68debc872aa8 could not be found. Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:16:25.241217 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9409983c-7f2b-47c0-9b41-68debc872aa8 could not be found. Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] Returning 404 to user: Instance 9409983c-7f2b-47c0-9b41-68debc872aa8 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3d4be3a5-b908-4993-9b1f-2a041eabc436 tempest-ServersAaction247Test-285690410 tempest-ServersAaction247Test-285690410-project] 10.222.0.25 "GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8" status: 404 len: 111 microversion: 2.47 time: 0.062578 Oct 27 09:16:25.249975 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1869/3697] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:25 2022] GET /compute/v2.1/servers/9409983c-7f2b-47c0-9b41-68debc872aa8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:16:25.913257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14d89c84-2369-4f6a-9845-354a46996daf tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa8269d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:28.908269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:28.918972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:35.133182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:35.140203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=14 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:35.201622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:35.217896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=49 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:36.033174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38cb5eb7-1888-4822-99c1-62636fd45129 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Action: 'create', calling method: .version_select at 0x7f31a941dc10>, body: {"keypair": {"name": "tempest-keypair-1878637727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPs9A7JllhxBnb4AlEL8HRMWti1CXNU4w+WdL5f78jebAV8OTfNduSfAlSZZDoKzGSKPPKqsQ46QnvwZf9IdcFeTV41lGkJnfVdWQKdPFXfZpiIKOQqRdORW8dgGxZzREw=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:36.103775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-38cb5eb7-1888-4822-99c1-62636fd45129 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Getting quotas for project e2d261b7e9ea4fd384b5598854df8e3f. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:16:36.138847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-38cb5eb7-1888-4822-99c1-62636fd45129 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Getting quotas for user 7f6df849894f45e2816c749e222d84ed and project e2d261b7e9ea4fd384b5598854df8e3f. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:16:36.229015 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38cb5eb7-1888-4822-99c1-62636fd45129 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.105886 Oct 27 09:16:36.232449 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1870/3698] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:16:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:37.588789 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14d89c84-2369-4f6a-9845-354a46996daf tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 11.678743 Oct 27 09:16:37.602569 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1829/3699] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:25 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 11695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:16:38.608030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-280e32c3-03d1-4249-b84b-3ba8ea1d33a1 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a93a1e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:38.711481 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-280e32c3-03d1-4249-b84b-3ba8ea1d33a1 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.109538 Oct 27 09:16:38.725186 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1871/3700] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:38 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:39.733612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89f3f791-bf08-4881-8cc7-4421005eb67c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa0194c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:39.929855 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-89f3f791-bf08-4881-8cc7-4421005eb67c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.201466 Oct 27 09:16:39.931367 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1830/3701] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:39 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:40.946742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2857ae3e-6204-4db3-a7de-3a9de1226b18 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a940b040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:41.061975 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2857ae3e-6204-4db3-a7de-3a9de1226b18 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.118718 Oct 27 09:16:41.071833 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1872/3702] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:40 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:42.081571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9acdc461-0610-4a38-b56e-b6aff5bfc2e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a9949280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:42.100815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-792871050", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4012625c-8b33-47ef-b854-015673a98003"}], "security_groups": [{"name": "tempest-securitygroup--591801277"}], "key_name": "tempest-keypair-1878637727", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:42.181541 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9acdc461-0610-4a38-b56e-b6aff5bfc2e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.107563 Oct 27 09:16:42.184479 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1831/3703] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:42 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:42.577522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] validate_networks() for [('4012625c-8b33-47ef-b854-015673a98003', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:16:43.202669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c6718cd-3cbb-4472-bb79-41cd472a35df tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a99c40d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:43.373681 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c6718cd-3cbb-4472-bb79-41cd472a35df tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.179114 Oct 27 09:16:43.375173 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1832/3704] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:43 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:16:44.524426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Getting quotas for project e2d261b7e9ea4fd384b5598854df8e3f. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:16:44.546788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Getting quotas for user 7f6df849894f45e2816c749e222d84ed and project e2d261b7e9ea4fd384b5598854df8e3f. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:16:44.591101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:16:44.591523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:16:44.592037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:16:44.592449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:16:44.592882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:16:44.633760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:44.634263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:44.634706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:44.635459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:44.639928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:44.640408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:44.712424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Getting quotas for project e2d261b7e9ea4fd384b5598854df8e3f. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:16:44.737875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Getting quotas for user 7f6df849894f45e2816c749e222d84ed and project e2d261b7e9ea4fd384b5598854df8e3f. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:16:44.787639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:16:44.802023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:16:45.024850 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62e2f53e-62e7-4546-a89e-fadde797e2d7 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.929678 Oct 27 09:16:45.030342 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1873/3705] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:16:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 2936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:16:45.041898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1b279d26-f20d-4ce6-8b2c-23887dec59a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a940b040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:45.141740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9aa6f375-910b-4d5e-81ca-2eca00f617ec tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Action: 'create', calling method: .version_select at 0x7f31a991daf0>, body: {"pool": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:45.207090 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1b279d26-f20d-4ce6-8b2c-23887dec59a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.174316 Oct 27 09:16:45.216192 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1874/3706] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:45 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:45.216714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ac2d4976-7ff8-4a7d-b70f-3a73895534ca tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:45.217431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ac2d4976-7ff8-4a7d-b70f-3a73895534ca tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:45.465690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ac2d4976-7ff8-4a7d-b70f-3a73895534ca tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:45.494827 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ac2d4976-7ff8-4a7d-b70f-3a73895534ca tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1269 microversion: 2.1 time: 0.285492 Oct 27 09:16:45.497317 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1875/3707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:45 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1269 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:46.231190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bacc92a6-045f-4eaf-9c4b-ffb135b7f13d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a949f0d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:46.358401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bacc92a6-045f-4eaf-9c4b-ffb135b7f13d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.136432 Oct 27 09:16:46.360211 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1876/3708] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:46 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:46.519600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bf240817-9327-44cf-aad7-fc76ee30d242 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:46.520236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bf240817-9327-44cf-aad7-fc76ee30d242 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:46.666651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bf240817-9327-44cf-aad7-fc76ee30d242 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:46.682213 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bf240817-9327-44cf-aad7-fc76ee30d242 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1269 microversion: 2.1 time: 0.167370 Oct 27 09:16:46.685608 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1877/3709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:46 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:47.376787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14022955-71e4-4449-9f22-bc6063ddac0d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a93e0ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:47.478242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-14022955-71e4-4449-9f22-bc6063ddac0d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.107303 Oct 27 09:16:47.479663 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1878/3710] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:47 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:47.719554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:47.721722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:47.756834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:47.757693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:47.764325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:47.769132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:47.773239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:47.779959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:48.388760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:48.403443 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79c74506-8f8b-4ae6-aade-93ba62e1fd15 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1321 microversion: 2.1 time: 0.689680 Oct 27 09:16:48.437473 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1879/3711] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:47 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1321 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:48.501247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a7a4fbd-55dc-41a6-8474-59f6584fd53d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94700d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:48.661877 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3a7a4fbd-55dc-41a6-8474-59f6584fd53d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.169247 Oct 27 09:16:48.662456 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1880/3712] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:48 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:49.434506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:49.435145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:49.461606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:49.465709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:49.467146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:49.471142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:49.471932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:49.473059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:49.734523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:49.749972 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-902693e0-2be8-4c57-bd08-e3046bc16dfd tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1327 microversion: 2.1 time: 0.319197 Oct 27 09:16:49.750978 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1881/3713] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:49 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1327 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:16:49.762545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bfefe9a3-0742-4f73-acbd-6f5631b97f7a tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94ffd30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:49.866618 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bfefe9a3-0742-4f73-acbd-6f5631b97f7a tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.113768 Oct 27 09:16:49.867534 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1882/3714] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:49 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:50.775115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:50.777094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:50.803820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:50.806434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:50.817184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:50.822462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:50.824067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:50.824760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:51.084765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:51.121736 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-844c3a79-47c7-46c4-8ad9-dfaf5cce6a04 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1327 microversion: 2.1 time: 0.351201 Oct 27 09:16:51.123556 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1883/3715] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:50 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1327 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:16:51.132301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31bbb7a3-21d3-494f-bdf9-12249ed82a25 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94f8040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:51.392523 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31bbb7a3-21d3-494f-bdf9-12249ed82a25 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.264248 Oct 27 09:16:51.400967 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1884/3716] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:51 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:52.090869 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9aa6f375-910b-4d5e-81ca-2eca00f617ec tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.716909 Oct 27 09:16:52.092156 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1833/3717] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:16:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:52.105208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a37ac24c-11b2-448f-8433-945584c11724 tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Action: 'create', calling method: .version_select at 0x7f31a97f3ca0>, body: {"pool": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:52.178533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1630565805", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "834dba6e-587d-4a86-84eb-a836332cd67b"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:52.301286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] validate_networks() for [('834dba6e-587d-4a86-84eb-a836332cd67b', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:16:54.659902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:16:54.741645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:16:54.742065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:16:54.742533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:16:54.743426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:16:54.744110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:16:54.760284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:54.761844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:54.762291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:54.765576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:54.766327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:54.767443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:54.805975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Getting quotas for project a33f53f152b549dbbe440ce0a71ee364. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:16:54.829968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Getting quotas for user d89aeac4dbfd497caa6fa3c322b44f74 and project a33f53f152b549dbbe440ce0a71ee364. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:16:54.859466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:16:54.862542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:16:54.967479 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-13f942aa-74a7-45f1-b3b9-06fbced45c9e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.572310 Oct 27 09:16:54.968564 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1885/3718] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:16:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:16:54.980525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:54.981710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:54.997870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:54.998617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:55.000910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:55.002183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:55.002846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:55.003649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:55.915695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:55.926315 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cff4704f-079b-4558-84eb-28c5cd2d2ef0 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1394 microversion: 2.1 time: 0.951365 Oct 27 09:16:55.935033 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1886/3719] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:54 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1394 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:55.965096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a014f43-8227-428d-918e-393a8f7304eb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a945e790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:56.054924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a014f43-8227-428d-918e-393a8f7304eb tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.095274 Oct 27 09:16:56.064732 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1887/3720] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:55 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:56.070462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:56.071378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:56.078758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:56.079650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:56.080555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:56.081559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:56.082269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:56.082929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:56.308479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:56.321763 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-76a4166a-b26b-40a7-8458-e4c1fb172c0e tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1229 microversion: 2.1 time: 0.253564 Oct 27 09:16:56.344302 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1888/3721] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:56 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1229 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:56.967619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:56.968337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:56.978378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:56.978891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:56.979622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:56.980645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:56.981811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:56.982250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:57.946156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:57.959413 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-515ba922-d8b3-47af-9630-a2578a3d4113 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1394 microversion: 2.1 time: 0.997196 Oct 27 09:16:57.960283 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1889/3722] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:56 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1394 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:57.978555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-24ba1205-a727-41b9-a56b-f90d187c8a5d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a93a1160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:58.102441 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-24ba1205-a727-41b9-a56b-f90d187c8a5d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1423 microversion: 2.1 time: 0.139724 Oct 27 09:16:58.103718 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1890/3723] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:57 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1423 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:58.129608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:58.130248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:58.139875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:58.141253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:58.141970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:58.143392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:58.144620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:58.145461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:58.285391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:58.295357 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d69d136f-5349-4826-abaa-5db5d0e5dfe5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1283 microversion: 2.1 time: 0.187004 Oct 27 09:16:58.304575 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1891/3724] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:58 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1283 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:58.327604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1359bc61-5129-48e1-9769-685e1c16e860 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:58.329966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1359bc61-5129-48e1-9769-685e1c16e860 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:58.343325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1359bc61-5129-48e1-9769-685e1c16e860 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:58.345136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1359bc61-5129-48e1-9769-685e1c16e860 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:58.345627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1359bc61-5129-48e1-9769-685e1c16e860 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:58.346385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1359bc61-5129-48e1-9769-685e1c16e860 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:58.346841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1359bc61-5129-48e1-9769-685e1c16e860 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:58.347261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1359bc61-5129-48e1-9769-685e1c16e860 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:58.426883 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1359bc61-5129-48e1-9769-685e1c16e860 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.120683 Oct 27 09:16:58.428752 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1892/3725] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Oct 27 09:16:58 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:58.538455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:58.539275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:58.546571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:58.547911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:58.548545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:58.550200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:58.554589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:58.555344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:58.590103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:16:58.749492 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c11c5e65-59e8-4142-905a-77360b9e9f62 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 204 len: 0 microversion: 2.20 time: 0.216834 Oct 27 09:16:58.750154 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1893/3726] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:16:58 2022] DELETE /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:16:58.775798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5799a480-6db0-4cae-b78a-19c508ced839 req-012fcf23-50b9-43eb-a64a-40161abe64c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a60576e-141a-41bf-9ab6-fce2f9edd488", "tag": "460a6647-8986-42e5-af32-7778fac89207"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:58.804711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5799a480-6db0-4cae-b78a-19c508ced839 req-012fcf23-50b9-43eb-a64a-40161abe64c2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:58.805205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5799a480-6db0-4cae-b78a-19c508ced839 req-012fcf23-50b9-43eb-a64a-40161abe64c2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:58.805651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5799a480-6db0-4cae-b78a-19c508ced839 req-012fcf23-50b9-43eb-a64a-40161abe64c2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:58.838496 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5799a480-6db0-4cae-b78a-19c508ced839 req-012fcf23-50b9-43eb-a64a-40161abe64c2 service nova] Creating event network-changed:460a6647-8986-42e5-af32-7778fac89207 for instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 on n-h1-858383-16 Oct 27 09:16:58.850360 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-5799a480-6db0-4cae-b78a-19c508ced839 req-012fcf23-50b9-43eb-a64a-40161abe64c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097159 Oct 27 09:16:58.853974 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1894/3727] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:16:58.863093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:58.864019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:58.871807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:58.872308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:58.872759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:58.873630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:58.874107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:58.874545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:59.436979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:59.437702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a37ac24c-11b2-448f-8433-945584c11724 tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.334673 Oct 27 09:16:59.439231 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1834/3728] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:16:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:16:59.445714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:59.446963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:59.453551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:59.454999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:59.456158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:59.456352 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-527ece8e-717e-4643-9cab-f6ee1568cfa6 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1721 microversion: 2.20 time: 0.599000 Oct 27 09:16:59.457175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:59.457393 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1895/3729] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:16:58 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1721 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:16:59.471729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:59.471729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:59.471729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:59.471729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:59.484081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7c347b0-5cb2-4af7-9cdb-a698d3f8df52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a93dbee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:59.543553 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d7c347b0-5cb2-4af7-9cdb-a698d3f8df52 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1432 microversion: 2.1 time: 0.069537 Oct 27 09:16:59.544307 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1896/3730] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:59 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1432 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:59.557896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:16:59.558505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:16:59.565053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:59.565830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:59.566454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:59.567332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:16:59.568078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:16:59.568671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:16:59.838645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:59.850555 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bcff166-cb8c-4a03-9f0e-60fc051bc7f3 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1394 microversion: 2.1 time: 0.409980 Oct 27 09:16:59.866370 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1835/3731] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:59 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1394 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:59.871720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-06bd8044-c456-41ae-9099-240c9b85e1ad tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Action: 'create', calling method: .version_select at 0x7f31aa502940>, body: {"pool": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:16:59.877519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:16:59.907614 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0888ccf5-a272-469e-bc8a-acbee67e6805 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1325 microversion: 2.1 time: 0.338238 Oct 27 09:16:59.908705 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1897/3732] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:16:59 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:16:59.933712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-41d051dd-5eb7-4481-87e6-ffdcff621a78 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a941d430>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:00.007857 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-41d051dd-5eb7-4481-87e6-ffdcff621a78 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 200 len: 1432 microversion: 2.1 time: 0.096253 Oct 27 09:17:00.009822 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1898/3733] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:16:59 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 1432 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:00.041266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:00.042406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:00.053091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:00.055629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:00.056859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:00.059163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:00.061899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:00.062475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:00.389712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:00.398600 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5138091-af46-4401-814d-4a9dda4c07e7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1478 microversion: 2.1 time: 0.363001 Oct 27 09:17:00.402735 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1899/3734] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:00 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1478 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:00.488727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:00.489387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:00.504273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:00.504884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:00.505338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:00.506677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:00.507325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:00.508116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:00.868168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:00.885651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:00.887639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:00.889089 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56a2eb78-05af-459c-b124-958b24bda2f1 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1721 microversion: 2.20 time: 0.405539 Oct 27 09:17:00.904625 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1900/3735] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:00 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1721 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:17:00.920193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:00.926322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:00.942113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:00.942918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:00.945997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:00.947000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:00.947774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:00.948920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:01.249686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:01.269148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:01.276983 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d4ab811a-7d3e-4bf9-b1ea-b5568a6dd027 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1394 microversion: 2.1 time: 0.369140 Oct 27 09:17:01.279144 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1901/3736] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:00 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1394 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:01.285694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:01.286686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:01.293403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:01.305603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:01.306333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:01.306877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:01.307824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:01.308493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:01.309213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:01.735370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:01.752214 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b5ee98f-d950-4e78-89ad-094b0d7ac1a1 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1325 microversion: 2.1 time: 0.471304 Oct 27 09:17:01.753776 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1902/3737] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:01 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1325 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:01.767594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:01.768224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:01.785475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:01.786498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:01.786498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:01.787091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:01.787809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:01.789399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:02.303815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:02.330157 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d808f637-dfbf-4494-bde3-8b379d27be0b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1465 microversion: 2.1 time: 0.561197 Oct 27 09:17:02.330969 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1903/3738] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:01 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1465 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:02.369211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-567348a1-9d4a-4d31-a827-dee2f08ff75a req-d14045db-d525-4722-b1fa-1839c9ae0663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec29626-d7ee-4bcb-a3e1-aceee1921a84", "tag": "f5311ad7-b53f-43fe-b5fc-aa8bd701f9d0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:02.382652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-567348a1-9d4a-4d31-a827-dee2f08ff75a req-d14045db-d525-4722-b1fa-1839c9ae0663 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:02.384065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-567348a1-9d4a-4d31-a827-dee2f08ff75a req-d14045db-d525-4722-b1fa-1839c9ae0663 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:02.384744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-567348a1-9d4a-4d31-a827-dee2f08ff75a req-d14045db-d525-4722-b1fa-1839c9ae0663 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:02.413446 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-567348a1-9d4a-4d31-a827-dee2f08ff75a req-d14045db-d525-4722-b1fa-1839c9ae0663 service nova] Creating event network-changed:f5311ad7-b53f-43fe-b5fc-aa8bd701f9d0 for instance fec29626-d7ee-4bcb-a3e1-aceee1921a84 on n-h2-858383-16 Oct 27 09:17:02.422215 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-567348a1-9d4a-4d31-a827-dee2f08ff75a req-d14045db-d525-4722-b1fa-1839c9ae0663 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071369 Oct 27 09:17:02.423618 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1904/3739] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:02.430392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:02.431204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:02.439967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:02.440865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:02.441546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:02.443161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:02.443917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:02.444622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:03.396880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:03.406878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:03.408682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5cea258c34423e82b53d552b21239f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babaa8dc02a4a04b18cbe0fe7ef5377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:03.409888 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f662f23-09e1-4cf3-93c6-ca33f044a39a tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 200 len: 1721 microversion: 2.20 time: 0.984636 Oct 27 09:17:03.424163 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1905/3740] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:02 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 1721 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:03.435657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:03.437093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:03.445098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:03.445777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:03.446408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:03.447284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:03.448005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:03.449162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:03.504162 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-06bd8044-c456-41ae-9099-240c9b85e1ad tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.636279 Oct 27 09:17:03.504765 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1836/3741] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:16:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:03.514623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d063f30f-5878-42f5-b072-8988da03475f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a99c4040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:03.573543 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d063f30f-5878-42f5-b072-8988da03475f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/a5a38eaa-9305-45a5-98b3-c9ecee92f0b1" status: 200 len: 784 microversion: 2.1 time: 0.067111 Oct 27 09:17:03.574135 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1837/3742] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:03 2022] GET /compute/v2.1/images/a5a38eaa-9305-45a5-98b3-c9ecee92f0b1 => generated 784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:03.585932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:03.585932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:03.588024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:03.588622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:03.589575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:03.590530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:03.591063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:03.591502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:03.993689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:04.004281 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b49b1f0e-c41c-4585-8381-95c9c2689914 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1394 microversion: 2.1 time: 0.578672 Oct 27 09:17:04.004892 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1906/3743] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:03 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1394 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:04.044956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7e44ac37-414b-44ec-a1ca-c1966d97d872 tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Action: 'create', calling method: .version_select at 0x7f31a93a1700>, body: {"pool": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:04.081619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:04.093677 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-730d57c7-72ba-4535-90f2-fb0296850324 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1325 microversion: 2.1 time: 0.516217 Oct 27 09:17:04.098425 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1838/3744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:03 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1325 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:04.109174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4663d2a6-4ef5-474a-8814-ee664d02e2b8 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:04.130999 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4663d2a6-4ef5-474a-8814-ee664d02e2b8 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031299 Oct 27 09:17:04.133728 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1839/3745] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:17:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:04.150947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1df50085-205e-443a-9b1a-f9d455bf9468 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a99794c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:04.780815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:04.838777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=24 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:05.545898 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1df50085-205e-443a-9b1a-f9d455bf9468 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "DELETE /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 204 len: 0 microversion: 2.1 time: 1.399551 Oct 27 09:17:05.547140 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1840/3746] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:04 2022] DELETE /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 0 bytes in 1402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:17:05.553844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-876baf2c-4601-4fb3-be78-94af35c30db1 req-8d5c89a0-825f-4370-a3dc-b49cd2ce1595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47545e3-12d5-44d9-9d89-d99673b0dd60", "name": "network-vif-unplugged", "status": "completed", "tag": "30117189-50cc-42e4-a2f8-1f7c1845b42a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:05.567457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-876baf2c-4601-4fb3-be78-94af35c30db1 req-8d5c89a0-825f-4370-a3dc-b49cd2ce1595 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:05.568323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-876baf2c-4601-4fb3-be78-94af35c30db1 req-8d5c89a0-825f-4370-a3dc-b49cd2ce1595 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:05.568897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-876baf2c-4601-4fb3-be78-94af35c30db1 req-8d5c89a0-825f-4370-a3dc-b49cd2ce1595 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:05.590124 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-876baf2c-4601-4fb3-be78-94af35c30db1 req-8d5c89a0-825f-4370-a3dc-b49cd2ce1595 service nova] Creating event network-vif-unplugged:30117189-50cc-42e4-a2f8-1f7c1845b42a for instance b47545e3-12d5-44d9-9d89-d99673b0dd60 on n-h2-858383-16 Oct 27 09:17:05.596667 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-876baf2c-4601-4fb3-be78-94af35c30db1 req-8d5c89a0-825f-4370-a3dc-b49cd2ce1595 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047680 Oct 27 09:17:05.598277 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1841/3747] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:05.604087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:05.605528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:05.613656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:05.614250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:05.614700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:05.615498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:05.616064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:05.617185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:05.635687 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] HTTP exception thrown: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Request method failure captured: Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 HTTP/1.1 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWknbVCYXTU8e_4wUYAFufT4tn843sHbUcCd6BDtkcqBSPMkKLRhyaW7Ns9hCK7D3XvSRwnVJ2CwjxZxWbDsggnO0LJbY-ij40d2Erqi5KnS4HbUpTh5VwarMRbu1dxgcJbTfAFcEao1B-S6JJ_4hGrjouNNJkh60d66VrV0VtkEJ-FU Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}] Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0e5cea258c34423e82b53d552b21239f Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '6f468cf4-43cf-4bba-bfcb-0f725bf735e3'} Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:05.637880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Returning 404 to user: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0fd9a7f5-e222-4b34-813c-2ba154f9c208 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 404 len: 111 microversion: 2.20 time: 0.040900 Oct 27 09:17:05.642958 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1842/3748] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:05 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:17:05.647548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-be9792b9-84e5-4bdd-b9b0-0def62513513 req-cdb4a7e7-6de3-48e3-a079-27d820ed4667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f468cf4-43cf-4bba-bfcb-0f725bf735e3", "name": "network-vif-deleted", "tag": "e537d4a4-12d3-46d5-b30a-f4aa9120f51e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:05.658133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-be9792b9-84e5-4bdd-b9b0-0def62513513 req-cdb4a7e7-6de3-48e3-a079-27d820ed4667 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:05.658620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-be9792b9-84e5-4bdd-b9b0-0def62513513 req-cdb4a7e7-6de3-48e3-a079-27d820ed4667 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:05.659113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-be9792b9-84e5-4bdd-b9b0-0def62513513 req-cdb4a7e7-6de3-48e3-a079-27d820ed4667 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:05.672605 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-be9792b9-84e5-4bdd-b9b0-0def62513513 req-cdb4a7e7-6de3-48e3-a079-27d820ed4667 service nova] Creating event network-vif-deleted:e537d4a4-12d3-46d5-b30a-f4aa9120f51e for instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 on n-h2-858383-16 Oct 27 09:17:05.680512 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-be9792b9-84e5-4bdd-b9b0-0def62513513 req-cdb4a7e7-6de3-48e3-a079-27d820ed4667 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037676 Oct 27 09:17:05.681503 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1843/3749] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:05.688029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:05.689009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:05.697284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:05.698176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:05.698896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:05.699870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:05.700541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:05.701219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:06.093984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:06.102267 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-008c93bc-4b05-48d3-8159-fe4ecf0c1b27 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1394 microversion: 2.1 time: 0.419237 Oct 27 09:17:06.105100 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1844/3750] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:05 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1394 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:06.112749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:06.113360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:06.120052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:06.127693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:06.134221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:06.135145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:06.141618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:06.142309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:06.471482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:06.486885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a8475f4-ca83-496b-9e13-d8ca51dea030 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1325 microversion: 2.1 time: 0.380689 Oct 27 09:17:06.494118 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1845/3751] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:06 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1325 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:06.515117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-900b6cca-3666-4846-bfb1-bb22902f20b3 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a9979550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:06.552330 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-900b6cca-3666-4846-bfb1-bb22902f20b3 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] HTTP exception thrown: Image not found. Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-900b6cca-3666-4846-bfb1-bb22902f20b3 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Request method failure captured: Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d HTTP/1.1 Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkxLGHyh3c0eiJxQnA52HYaCK2V63iQM5At1lMRKrxyXurEGfqFAxkE5EOsE8_Zh8EP91Y0OCY4XanMsNr2uGNnMolTZs6qy6sFTs0lJX2M05UiHlQdqQPW0OP0GxPe7dyjM98-Laks2i5D-gU0L_Ii0V_4S3C8exv99Iw1CGJjs0xk Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 03f1a443472e442e8d5fdd76e7caa469 Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesOneServerTestJSON-1918736899 Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03f1a443472e442e8d5fdd76e7caa469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03f1a443472e442e8d5fdd76e7caa469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03f1a443472e442e8d5fdd76e7caa469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03f1a443472e442e8d5fdd76e7caa469"}]}] Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesOneServerTestJSON-1918736899 Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 03f1a443472e442e8d5fdd76e7caa469 Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1918736899 Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesOneServerTestJSON-1918736899-project Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: efa9d44a698142dab4cd9d04e8afb20f Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesOneServerTestJSON-1918736899-project Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d'} Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:17:06.554478 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d could not be found. Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-900b6cca-3666-4846-bfb1-bb22902f20b3 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-900b6cca-3666-4846-bfb1-bb22902f20b3 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 404 len: 62 microversion: 2.1 time: 0.060351 Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1846/3752] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:06 2022] GET /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:17:06.567769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e6af237-deb8-4225-8fc8-fb3a787570fb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '.version_select at 0x7f31ae608a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:06.611208 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e6af237-deb8-4225-8fc8-fb3a787570fb tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-946019008" status: 204 len: 0 microversion: 2.20 time: 0.053598 Oct 27 09:17:06.621288 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1847/3753] 10.222.0.25 () {60 vars in 1259 bytes} [Thu Oct 27 09:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-946019008 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:17:07.080022 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7e44ac37-414b-44ec-a1ca-c1966d97d872 tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.040079 Oct 27 09:17:07.081667 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1907/3754] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:17:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:07.089114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7adb4648-61de-40fb-b0eb-cfb3d76824a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1812919371"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:07.096893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7adb4648-61de-40fb-b0eb-cfb3d76824a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:07.105827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7adb4648-61de-40fb-b0eb-cfb3d76824a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.106752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7adb4648-61de-40fb-b0eb-cfb3d76824a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.107665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7adb4648-61de-40fb-b0eb-cfb3d76824a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:07.109062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7adb4648-61de-40fb-b0eb-cfb3d76824a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.109992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7adb4648-61de-40fb-b0eb-cfb3d76824a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.111193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7adb4648-61de-40fb-b0eb-cfb3d76824a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:07.166953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:07.167620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:07.177634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.178145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.178594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:07.179314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.179812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.185915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:07.225674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:17:07.358955 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14555dd9-f21c-4bea-8397-d55cffc7828a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 204 len: 0 microversion: 2.42 time: 0.736153 Oct 27 09:17:07.360555 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1848/3755] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:17:06 2022] DELETE /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 0 bytes in 738 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:17:07.368249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bb2ccd4-8336-48cb-aa82-ed3f392eb3bd tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Calling method '.version_select at 0x7f31aa2fbdc0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:07.433588 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7adb4648-61de-40fb-b0eb-cfb3d76824a6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "POST /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60/action" status: 202 len: 0 microversion: 2.1 time: 0.349277 Oct 27 09:17:07.435269 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1908/3756] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:17:07 2022] POST /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:17:07.441851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:07.443174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:07.450587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.451409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.452050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:07.453560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.454029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.454465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:07.670080 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bb2ccd4-8336-48cb-aa82-ed3f392eb3bd tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/3031f5b0-fa6f-4c85-8544-36c39fcbd6f7" status: 200 len: 142 microversion: 2.1 time: 0.306903 Oct 27 09:17:07.678500 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1849/3757] 10.222.0.25 () {58 vars in 1260 bytes} [Thu Oct 27 09:17:07 2022] GET /compute/v2.1/os-floating-ips/3031f5b0-fa6f-4c85-8544-36c39fcbd6f7 => generated 142 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:07.685286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:07.686202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:07.701704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.702215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.720145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:07.720145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.720145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.720145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:07.772559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:07.787792 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0d2f70ac-ba3f-443b-9455-e5da606dc78a tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1394 microversion: 2.1 time: 0.350777 Oct 27 09:17:07.789092 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1909/3758] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:07 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1394 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:07.798001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ee378d1-c024-4863-9a5d-544649d944a8 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a948cf70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:07.866103 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ee378d1-c024-4863-9a5d-544649d944a8 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.075901 Oct 27 09:17:07.867386 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1910/3759] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:07 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:07.879168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:07.879925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:07.902540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.903264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.903948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:07.904865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:07.905546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:07.906185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:08.100873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:08.115751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:08.122259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:08.123597 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb6ef67c-39cd-46bf-bb18-a9b07464092b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2954 microversion: 2.42 time: 0.443871 Oct 27 09:17:08.124163 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1850/3760] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:07 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2954 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:08.130658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8b1955cc-ef27-4008-9657-45fea3422097 req-dec58ac7-85cb-4bd1-a171-0ea9f3f6b11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a60576e-141a-41bf-9ab6-fce2f9edd488", "name": "network-vif-plugged", "status": "completed", "tag": "460a6647-8986-42e5-af32-7778fac89207"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:08.147635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:08.160860 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-691e4eb7-b16c-42f3-8a0b-8a8edb5145ba tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1325 microversion: 2.1 time: 0.283512 Oct 27 09:17:08.162856 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1911/3761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:07 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1325 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:08.166624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8b1955cc-ef27-4008-9657-45fea3422097 req-dec58ac7-85cb-4bd1-a171-0ea9f3f6b11a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:08.171168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3083149d-5219-4c72-b083-0dcb0bd0342d tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Calling method '.version_select at 0x7f31a93bae50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:08.172054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8b1955cc-ef27-4008-9657-45fea3422097 req-dec58ac7-85cb-4bd1-a171-0ea9f3f6b11a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:08.172659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8b1955cc-ef27-4008-9657-45fea3422097 req-dec58ac7-85cb-4bd1-a171-0ea9f3f6b11a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:08.204343 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8b1955cc-ef27-4008-9657-45fea3422097 req-dec58ac7-85cb-4bd1-a171-0ea9f3f6b11a service nova] Creating event network-vif-plugged:460a6647-8986-42e5-af32-7778fac89207 for instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 on n-h1-858383-16 Oct 27 09:17:08.210344 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8b1955cc-ef27-4008-9657-45fea3422097 req-dec58ac7-85cb-4bd1-a171-0ea9f3f6b11a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084732 Oct 27 09:17:08.211299 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1851/3762] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:08.814179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:08.816264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:08.826419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:08.827355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:08.828875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:08.830260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:08.830937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:08.831538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:09.102880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:09.114122 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33bc2cb6-b8ef-4f8c-8c68-1b84be983bb1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1394 microversion: 2.1 time: 0.305662 Oct 27 09:17:09.128097 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1852/3763] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:08 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1394 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:09.135544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b33853e7-08ba-4f70-bcc9-3028eb1087ee tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa2fb4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:09.197255 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b33853e7-08ba-4f70-bcc9-3028eb1087ee tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.068133 Oct 27 09:17:09.197867 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1853/3764] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:09 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:09.203753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:09.204569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:09.216082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:09.217181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:09.217785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:09.218790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:09.219612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:09.220196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:09.942458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:09.974163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:09.977941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:09.984014 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6ee0aae-0f04-4570-84c7-358e66c12af2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2954 microversion: 2.42 time: 0.780188 Oct 27 09:17:09.985617 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1854/3765] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:09 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2954 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:09.991141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:09.997618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:10.014881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:10.015340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:10.017291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:10.018056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:10.021382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:10.021851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:10.138611 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3083149d-5219-4c72-b083-0dcb0bd0342d tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/3031f5b0-fa6f-4c85-8544-36c39fcbd6f7" status: 202 len: 0 microversion: 2.1 time: 1.973914 Oct 27 09:17:10.140091 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1912/3766] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:17:08 2022] DELETE /compute/v2.1/os-floating-ips/3031f5b0-fa6f-4c85-8544-36c39fcbd6f7 => generated 0 bytes in 1976 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:17:10.149863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:10.151687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:10.165359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:10.165788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:10.166291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:10.169083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:10.170204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:10.170704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:10.310866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:10.319517 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc7e4886-b731-4d1c-ba73-692cdf112bd5 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1325 microversion: 2.1 time: 0.332766 Oct 27 09:17:10.321122 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1855/3767] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:09 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:10.351548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f900bb6e-3893-46d1-9adc-b057cf3086b3 tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Calling method '.version_select at 0x7f31a99790d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:10.677689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:10.690922 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e6f869fe-9893-4906-a55b-476693f6601c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1574 microversion: 2.1 time: 0.548764 Oct 27 09:17:10.691987 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1913/3768] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:10 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1574 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:10.704307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9da2e9ed-5c31-4fe0-ab12-d7d87ccc947e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94701f0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:10.783473 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9da2e9ed-5c31-4fe0-ab12-d7d87ccc947e tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.090118 Oct 27 09:17:10.785303 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1914/3769] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:10 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:10.797361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-619fa091-0081-4f7c-bf24-ab0a8ce80199 req-e6d4b363-da52-431f-b0ed-05ec14c28421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec29626-d7ee-4bcb-a3e1-aceee1921a84", "name": "network-vif-plugged", "status": "completed", "tag": "f5311ad7-b53f-43fe-b5fc-aa8bd701f9d0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:10.812595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-619fa091-0081-4f7c-bf24-ab0a8ce80199 req-e6d4b363-da52-431f-b0ed-05ec14c28421 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:10.813683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-619fa091-0081-4f7c-bf24-ab0a8ce80199 req-e6d4b363-da52-431f-b0ed-05ec14c28421 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:10.814336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-619fa091-0081-4f7c-bf24-ab0a8ce80199 req-e6d4b363-da52-431f-b0ed-05ec14c28421 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:10.829723 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-619fa091-0081-4f7c-bf24-ab0a8ce80199 req-e6d4b363-da52-431f-b0ed-05ec14c28421 service nova] Creating event network-vif-plugged:f5311ad7-b53f-43fe-b5fc-aa8bd701f9d0 for instance fec29626-d7ee-4bcb-a3e1-aceee1921a84 on n-h2-858383-16 Oct 27 09:17:10.837075 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-619fa091-0081-4f7c-bf24-ab0a8ce80199 req-e6d4b363-da52-431f-b0ed-05ec14c28421 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049573 Oct 27 09:17:10.844098 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1915/3770] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:10.851018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8acbd5ce-4bcd-4aa8-b1e3-c9a5d870207c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:10.852265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8acbd5ce-4bcd-4aa8-b1e3-c9a5d870207c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:10.861327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8acbd5ce-4bcd-4aa8-b1e3-c9a5d870207c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:10.862671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8acbd5ce-4bcd-4aa8-b1e3-c9a5d870207c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:10.863524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8acbd5ce-4bcd-4aa8-b1e3-c9a5d870207c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:10.864826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8acbd5ce-4bcd-4aa8-b1e3-c9a5d870207c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:10.865633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8acbd5ce-4bcd-4aa8-b1e3-c9a5d870207c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:10.866335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8acbd5ce-4bcd-4aa8-b1e3-c9a5d870207c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:11.075266 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8acbd5ce-4bcd-4aa8-b1e3-c9a5d870207c tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.229355 Oct 27 09:17:11.076111 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1916/3771] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:17:10 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:11.081034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:11.081867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:11.100911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:11.101665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:11.102321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:11.103230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:11.103917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:11.104522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:11.207079 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f900bb6e-3893-46d1-9adc-b057cf3086b3 tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.880824 Oct 27 09:17:11.207776 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1856/3772] 10.222.0.25 () {58 vars in 1164 bytes} [Thu Oct 27 09:17:10 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:17:11.233387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:11.233891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:11.240055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:11.240548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:11.240982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:11.241684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:11.242145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:11.242572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:11.270911 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] HTTP exception thrown: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Request method failure captured: Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 HTTP/1.1 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWknbVCYXTU8e_4wUYAFufT4tn843sHbUcCd6BDtkcqBSPMkKLRhyaW7Ns9hCK7D3XvSRwnVJ2CwjxZxWbDsggnO0LJbY-ij40d2Erqi5KnS4HbUpTh5VwarMRbu1dxgcJbTfAFcEao1B-S6JJ_4hGrjouNNJkh60d66VrV0VtkEJ-FU Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}] Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0e5cea258c34423e82b53d552b21239f Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '6f468cf4-43cf-4bba-bfcb-0f725bf735e3'} Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:17:11.282826 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Returning 404 to user: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:11.289201 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-527bbb43-4574-4290-8167-db8f50327896 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 404 len: 111 microversion: 2.20 time: 0.070224 Oct 27 09:17:11.290636 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1857/3773] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:17:11 2022] DELETE /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:17:11.299084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b450e998-bc24-4ef9-893d-14d9d84c5c2d tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Calling method '.version_select at 0x7f31a99790d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:11.872712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:11.883584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:11.885325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:11.886807 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77839c1c-2d4c-45f0-a31a-5fd0a78f95ce tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2954 microversion: 2.42 time: 0.809445 Oct 27 09:17:11.907404 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1917/3774] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:11 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2954 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:11.912722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:11.913620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 6f468cf4-43cf-4bba-bfcb-0f725bf735e3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:11.920867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:11.921627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:11.922235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:11.923163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:11.923829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:11.924413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:11.942148 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b450e998-bc24-4ef9-893d-14d9d84c5c2d tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.647095 Oct 27 09:17:11.944009 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1858/3775] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:17:11 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:11.950672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:11.951760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:11.958314 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] HTTP exception thrown: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Request method failure captured: Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 HTTP/1.1 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWknbVCYXTU8e_4wUYAFufT4tn843sHbUcCd6BDtkcqBSPMkKLRhyaW7Ns9hCK7D3XvSRwnVJ2CwjxZxWbDsggnO0LJbY-ij40d2Erqi5KnS4HbUpTh5VwarMRbu1dxgcJbTfAFcEao1B-S6JJ_4hGrjouNNJkh60d66VrV0VtkEJ-FU Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}] Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0e5cea258c34423e82b53d552b21239f Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '6f468cf4-43cf-4bba-bfcb-0f725bf735e3'} Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.959747 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Returning 404 to user: Instance 6f468cf4-43cf-4bba-bfcb-0f725bf735e3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-866e0930-f500-417a-ac53-8fd89cb524f5 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3" status: 404 len: 111 microversion: 2.20 time: 0.052395 Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1918/3776] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:11 2022] GET /compute/v2.1/servers/6f468cf4-43cf-4bba-bfcb-0f725bf735e3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:17:11.970794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a949f1ec-91d1-42f3-982f-d9ebfa4c7e28 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94f8e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:11.981033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:11.982313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:11.983017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:11.986106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:12.002391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:12.002835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:12.061977 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a949f1ec-91d1-42f3-982f-d9ebfa4c7e28 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.098994 Oct 27 09:17:12.062579 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1919/3777] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:11 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:12.081276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e6c0f2f-e667-4ed3-8165-4fba0d56162f tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Calling method '.version_select at 0x7f31a93ba9d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:12.645493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:12.660639 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44afd813-f2a2-4b22-84f6-185e6e013e76 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1325 microversion: 2.1 time: 0.711687 Oct 27 09:17:12.664755 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1859/3778] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:11 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1325 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:12.925011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:12.926697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:12.952690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:12.953607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:12.957233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:12.964783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:12.965843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:12.966566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:14.229194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:14.242327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:14.243845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:14.252524 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-afae3293-42c8-4f82-b402-7ca67c0b81e0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2954 microversion: 2.42 time: 1.341929 Oct 27 09:17:14.253294 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1860/3779] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:12 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2954 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:17:14.266165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c81fe15-447b-4cfe-a466-9c01a09924a3 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a991d160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:14.333084 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c81fe15-447b-4cfe-a466-9c01a09924a3 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.078338 Oct 27 09:17:14.337197 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1861/3780] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:14 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:14.349902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:14.352415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:14.374976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:14.378309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:14.379017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:14.379999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:14.383786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:14.384097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:14.944197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:14.960529 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0242d627-d541-4124-8214-34c77f24d91c tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1522 microversion: 2.1 time: 0.621971 Oct 27 09:17:14.962146 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1862/3781] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:14 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:14.969184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-4311a8c1-bac6-4793-860e-1974fe6a88c7 req-a24d27f1-12c2-437f-9fe2-ed07f5cf255b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-unplugged", "status": "completed", "tag": "544be81e-f783-47ec-8081-b057c946342d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:15.001416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4311a8c1-bac6-4793-860e-1974fe6a88c7 req-a24d27f1-12c2-437f-9fe2-ed07f5cf255b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:15.012454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4311a8c1-bac6-4793-860e-1974fe6a88c7 req-a24d27f1-12c2-437f-9fe2-ed07f5cf255b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:15.012903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4311a8c1-bac6-4793-860e-1974fe6a88c7 req-a24d27f1-12c2-437f-9fe2-ed07f5cf255b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:15.035818 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-4311a8c1-bac6-4793-860e-1974fe6a88c7 req-a24d27f1-12c2-437f-9fe2-ed07f5cf255b service nova] Creating event network-vif-unplugged:544be81e-f783-47ec-8081-b057c946342d for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:15.053439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-4311a8c1-bac6-4793-860e-1974fe6a88c7 req-a24d27f1-12c2-437f-9fe2-ed07f5cf255b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089187 Oct 27 09:17:15.054056 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1863/3782] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:15.060576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:15.061164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:15.079365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:15.079922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:15.081630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:15.081630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:15.081630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:15.081913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:15.130151 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] HTTP exception thrown: Instance is not a member of specified network Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Request method failure captured: Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84/ips/invalid HTTP/1.1 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkyCY-cBRPr3474v4O4CToTgFKOAyQxmDWVLZvIYdEruCLp_a0XlB9I6YNqEDGzNMg1TYRMUce9BparDEy22UaJ6ruZsHyiahvY6Nkdbm7yagkLKJW9BJc2TzeOKH2dU1EKhnmLvP2EcYT1_teoYHomQ5Z2faIBUo0kVfkV5ZPOIlQQ Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a33f53f152b549dbbe440ce0a71ee364 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-151045929 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a33f53f152b549dbbe440ce0a71ee364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a33f53f152b549dbbe440ce0a71ee364"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a33f53f152b549dbbe440ce0a71ee364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a33f53f152b549dbbe440ce0a71ee364"}]}] Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-151045929 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a33f53f152b549dbbe440ce0a71ee364 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-151045929 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerAddressesNegativeTestJSON-151045929-project Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d89aeac4dbfd497caa6fa3c322b44f74 Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-151045929-project Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance is not a member of specified network Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': 'fec29626-d7ee-4bcb-a3e1-aceee1921a84', 'id': 'invalid'} Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 27 09:17:15.138539 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:15.143921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:15.144981 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3f09ec1-454f-4312-9790-4e44806d7bc4 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.089663 Oct 27 09:17:15.145722 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1864/3783] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:17:15 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84/ips/invalid => generated 91 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:17:15.155176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8dd07420-d051-4dd1-9c27-7acad221f47b tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:15.156487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8dd07420-d051-4dd1-9c27-7acad221f47b tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Failed to fetch instance by id 999 {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 09:17:15.156791 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8dd07420-d051-4dd1-9c27-7acad221f47b tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] HTTP exception thrown: Instance 999 could not be found. Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8dd07420-d051-4dd1-9c27-7acad221f47b tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Request method failure captured: Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkyCY-cBRPr3474v4O4CToTgFKOAyQxmDWVLZvIYdEruCLp_a0XlB9I6YNqEDGzNMg1TYRMUce9BparDEy22UaJ6ruZsHyiahvY6Nkdbm7yagkLKJW9BJc2TzeOKH2dU1EKhnmLvP2EcYT1_teoYHomQ5Z2faIBUo0kVfkV5ZPOIlQQ Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a33f53f152b549dbbe440ce0a71ee364 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-151045929 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a33f53f152b549dbbe440ce0a71ee364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a33f53f152b549dbbe440ce0a71ee364"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a33f53f152b549dbbe440ce0a71ee364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a33f53f152b549dbbe440ce0a71ee364"}]}] Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-151045929 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a33f53f152b549dbbe440ce0a71ee364 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-151045929 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerAddressesNegativeTestJSON-151045929-project Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d89aeac4dbfd497caa6fa3c322b44f74 Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-151045929-project Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 999 could not be found. Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': '999'} Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 27 09:17:15.158467 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:15.164264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8dd07420-d051-4dd1-9c27-7acad221f47b tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:15.165844 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8dd07420-d051-4dd1-9c27-7acad221f47b tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.014197 Oct 27 09:17:15.165844 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1865/3784] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:17:15 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:17:15.196192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:15.197141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:15.223364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:15.226821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:15.229683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:15.233272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:15.234224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:15.238665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:15.251396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:15.314481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:17:15.498553 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f5f4368-df27-430b-8ad5-6361982a38d8 tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 204 len: 0 microversion: 2.1 time: 0.326815 Oct 27 09:17:15.499429 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1866/3785] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:17:15 2022] DELETE /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:17:15.504943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:15.505650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:15.517503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:15.526625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:15.527292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:15.530903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:15.531297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:15.535882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:15.598786 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e6c0f2f-e667-4ed3-8165-4fba0d56162f tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/5aeeddbd-bdc0-4a90-a518-698fb9ff211f" status: 202 len: 0 microversion: 2.1 time: 3.521600 Oct 27 09:17:15.599455 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1920/3786] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:17:12 2022] DELETE /compute/v2.1/os-floating-ips/5aeeddbd-bdc0-4a90-a518-698fb9ff211f => generated 0 bytes in 3536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:17:15.614398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-398c6256-031b-4975-b383-3b47ab928f69 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94f80d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:15.695837 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-398c6256-031b-4975-b383-3b47ab928f69 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.095124 Oct 27 09:17:15.699907 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1921/3787] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:15 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:15.714566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:15.715652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:15.728336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:15.729608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:15.731332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:15.732723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:15.748448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:15.750174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:16.060663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:16.079779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:16.082708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:16.084281 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc7b42cd-feb4-41b4-b650-0e18cbd4b77d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2933 microversion: 2.42 time: 0.583629 Oct 27 09:17:16.105121 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1867/3788] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:15 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2933 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:16.113101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:16.114560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:16.121514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:16.122271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:16.122972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:16.123871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:16.124992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:16.125586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:16.384392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:16.398515 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-45093d18-816e-4dcf-bca5-dc20f9f3297f tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1528 microversion: 2.1 time: 0.694751 Oct 27 09:17:16.402203 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1922/3789] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:15 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1528 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:16.417843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-dd2c1cfd-39a1-4979-8ac2-90d2b009e4a8 req-991a5ab9-b135-468e-a59f-9f069ccd7d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a60576e-141a-41bf-9ab6-fce2f9edd488", "tag": "460a6647-8986-42e5-af32-7778fac89207"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:16.452660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-dd2c1cfd-39a1-4979-8ac2-90d2b009e4a8 req-991a5ab9-b135-468e-a59f-9f069ccd7d1c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:16.453556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-dd2c1cfd-39a1-4979-8ac2-90d2b009e4a8 req-991a5ab9-b135-468e-a59f-9f069ccd7d1c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:16.454161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-dd2c1cfd-39a1-4979-8ac2-90d2b009e4a8 req-991a5ab9-b135-468e-a59f-9f069ccd7d1c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:16.475944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:16.489081 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ed6eb59-4d59-40b6-95ce-97561de2bcf9 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1574 microversion: 2.1 time: 0.382417 Oct 27 09:17:16.495955 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1868/3790] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:16 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1574 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:16.505171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-736c1bc9-17b7-42a7-ac9e-ffe615a1c2cf tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Calling method '.version_select at 0x7f31aa7303a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:16.535242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-dd2c1cfd-39a1-4979-8ac2-90d2b009e4a8 req-991a5ab9-b135-468e-a59f-9f069ccd7d1c service nova] Creating event network-changed:460a6647-8986-42e5-af32-7778fac89207 for instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 on n-h1-858383-16 Oct 27 09:17:16.553008 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-dd2c1cfd-39a1-4979-8ac2-90d2b009e4a8 req-991a5ab9-b135-468e-a59f-9f069ccd7d1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148147 Oct 27 09:17:16.558035 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1923/3791] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:16.668366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:16.672067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:16.688954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:16.689982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:16.690960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:16.692665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:16.693287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:16.694061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:16.717334 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] HTTP exception thrown: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Request method failure captured: Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a HTTP/1.1 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWknbVCYXTU8e_4wUYAFufT4tn843sHbUcCd6BDtkcqBSPMkKLRhyaW7Ns9hCK7D3XvSRwnVJ2CwjxZxWbDsggnO0LJbY-ij40d2Erqi5KnS4HbUpTh5VwarMRbu1dxgcJbTfAFcEao1B-S6JJ_4hGrjouNNJkh60d66VrV0VtkEJ-FU Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}] Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0e5cea258c34423e82b53d552b21239f Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '3d248926-b23e-472b-9a1e-4b10c924758a'} Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:17:16.720245 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.725510 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.728673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Returning 404 to user: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:16.731185 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e2bc9321-2c21-4942-9ca3-9830fa350790 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 404 len: 111 microversion: 2.20 time: 0.079104 Oct 27 09:17:16.732364 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1924/3792] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:17:16 2022] DELETE /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:17:16.739699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62c6d157-e29f-4e37-ad57-211c5b318a67 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa7d25e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:16.804594 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62c6d157-e29f-4e37-ad57-211c5b318a67 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.070938 Oct 27 09:17:16.805562 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1925/3793] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:16 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:16.810640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:16.811601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] [instance: 3d248926-b23e-472b-9a1e-4b10c924758a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:16.819103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:16.820101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:16.820967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:16.821997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:16.822818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:16.823407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:16.850503 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] HTTP exception thrown: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Request method failure captured: Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a HTTP/1.1 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWknbVCYXTU8e_4wUYAFufT4tn843sHbUcCd6BDtkcqBSPMkKLRhyaW7Ns9hCK7D3XvSRwnVJ2CwjxZxWbDsggnO0LJbY-ij40d2Erqi5KnS4HbUpTh5VwarMRbu1dxgcJbTfAFcEao1B-S6JJ_4hGrjouNNJkh60d66VrV0VtkEJ-FU Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1babaa8dc02a4a04b18cbe0fe7ef5377"}]}] Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1babaa8dc02a4a04b18cbe0fe7ef5377 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341730956 Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0e5cea258c34423e82b53d552b21239f Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341730956-project Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '3d248926-b23e-472b-9a1e-4b10c924758a'} Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.853519 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:16.860386 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.860386 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:16.860386 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:16.860386 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:16.860386 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:16.860386 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:16.860386 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. Oct 27 09:17:16.860386 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:16.863533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] Returning 404 to user: Instance 3d248926-b23e-472b-9a1e-4b10c924758a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:16.864621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db36b1fe-c53b-4308-920c-b90ca118cbb8 tempest-AttachVolumeShelveTestJSON-1341730956 tempest-AttachVolumeShelveTestJSON-1341730956-project] 10.222.0.25 "GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a" status: 404 len: 111 microversion: 2.20 time: 0.057953 Oct 27 09:17:16.865661 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1926/3794] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:16 2022] GET /compute/v2.1/servers/3d248926-b23e-472b-9a1e-4b10c924758a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:17:17.118709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:17.119462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:17.128279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:17.129823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:17.133117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:17.134635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:17.143742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:17.145400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:18.353430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:18.366805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:18.382938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:18.385440 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a3b8728e-30bb-44a4-a8e2-0472e252753d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2912 microversion: 2.42 time: 1.271071 Oct 27 09:17:18.401502 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1927/3795] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:17 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2912 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:17:18.401502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a0168a11-6a9e-4b1b-97d4-323be500f623 req-b90390fc-9ec8-4af5-81be-e097e177de8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-unplugged", "status": "completed", "tag": "11599d02-495f-4773-8d4b-4f4e7e5ef3bf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:18.435404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a0168a11-6a9e-4b1b-97d4-323be500f623 req-b90390fc-9ec8-4af5-81be-e097e177de8a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:18.436301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a0168a11-6a9e-4b1b-97d4-323be500f623 req-b90390fc-9ec8-4af5-81be-e097e177de8a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:18.437318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a0168a11-6a9e-4b1b-97d4-323be500f623 req-b90390fc-9ec8-4af5-81be-e097e177de8a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:18.452028 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a0168a11-6a9e-4b1b-97d4-323be500f623 req-b90390fc-9ec8-4af5-81be-e097e177de8a service nova] Creating event network-vif-unplugged:11599d02-495f-4773-8d4b-4f4e7e5ef3bf for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:18.459064 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a0168a11-6a9e-4b1b-97d4-323be500f623 req-b90390fc-9ec8-4af5-81be-e097e177de8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069869 Oct 27 09:17:18.459940 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1928/3796] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:18.467302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:18.468480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:18.477048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:18.477836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:18.478448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:18.479977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:18.480640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:18.482306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:19.175999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89aeac4dbfd497caa6fa3c322b44f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33f53f152b549dbbe440ce0a71ee364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:19.188213 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc05b996-15e7-4e28-98a4-6990f90168ee tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 200 len: 1528 microversion: 2.1 time: 0.726777 Oct 27 09:17:19.188811 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1929/3797] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:18 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 1528 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:19.213589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a3ffdff9-c082-4857-b272-3df3137bd188 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94f7790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:19.402272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a3ffdff9-c082-4857-b272-3df3137bd188 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.210842 Oct 27 09:17:19.403777 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1930/3798] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:19 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:19.429684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fc9710bf-69f0-489b-9e04-e165ee18f8e1 req-b147cc29-c1e6-4bf8-b76d-79b86c4e8f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-deleted", "tag": "544be81e-f783-47ec-8081-b057c946342d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:19.490781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fc9710bf-69f0-489b-9e04-e165ee18f8e1 req-b147cc29-c1e6-4bf8-b76d-79b86c4e8f85 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:19.491917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fc9710bf-69f0-489b-9e04-e165ee18f8e1 req-b147cc29-c1e6-4bf8-b76d-79b86c4e8f85 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:19.493578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fc9710bf-69f0-489b-9e04-e165ee18f8e1 req-b147cc29-c1e6-4bf8-b76d-79b86c4e8f85 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:19.518349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:19.555122 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fc9710bf-69f0-489b-9e04-e165ee18f8e1 req-b147cc29-c1e6-4bf8-b76d-79b86c4e8f85 service nova] Creating event network-vif-deleted:544be81e-f783-47ec-8081-b057c946342d for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:19.579895 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fc9710bf-69f0-489b-9e04-e165ee18f8e1 req-b147cc29-c1e6-4bf8-b76d-79b86c4e8f85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167561 Oct 27 09:17:19.582501 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1931/3799] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:19.629040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0b884cd7-4a68-4b37-adba-409b3ff821cc req-231bcec2-fc6e-4b60-8f43-db9ed7107689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec29626-d7ee-4bcb-a3e1-aceee1921a84", "name": "network-vif-deleted", "tag": "f5311ad7-b53f-43fe-b5fc-aa8bd701f9d0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:19.662815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0b884cd7-4a68-4b37-adba-409b3ff821cc req-231bcec2-fc6e-4b60-8f43-db9ed7107689 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:19.663621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0b884cd7-4a68-4b37-adba-409b3ff821cc req-231bcec2-fc6e-4b60-8f43-db9ed7107689 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:19.664846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0b884cd7-4a68-4b37-adba-409b3ff821cc req-231bcec2-fc6e-4b60-8f43-db9ed7107689 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:19.696141 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0b884cd7-4a68-4b37-adba-409b3ff821cc req-231bcec2-fc6e-4b60-8f43-db9ed7107689 service nova] Creating event network-vif-deleted:f5311ad7-b53f-43fe-b5fc-aa8bd701f9d0 for instance fec29626-d7ee-4bcb-a3e1-aceee1921a84 on n-h2-858383-16 Oct 27 09:17:19.708314 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0b884cd7-4a68-4b37-adba-409b3ff821cc req-231bcec2-fc6e-4b60-8f43-db9ed7107689 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122173 Oct 27 09:17:19.712920 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1932/3800] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:19.728573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:19.729929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:19.750043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:19.750607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:19.751221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:19.753128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:19.753624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:19.754065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:20.850529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:20.862830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:20.864321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:20.867434 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3fa9ce3-fda5-49bb-94a9-254eb5c3dbe6 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2752 microversion: 2.42 time: 1.152288 Oct 27 09:17:20.870489 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1933/3801] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:19 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2752 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:20.890725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:20.903293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] [instance: fec29626-d7ee-4bcb-a3e1-aceee1921a84] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:20.911082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:20.928833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:20.929619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:20.930592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:20.931255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:20.932030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:20.983237 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] HTTP exception thrown: Instance fec29626-d7ee-4bcb-a3e1-aceee1921a84 could not be found. Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Request method failure captured: Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 HTTP/1.1 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkyCY-cBRPr3474v4O4CToTgFKOAyQxmDWVLZvIYdEruCLp_a0XlB9I6YNqEDGzNMg1TYRMUce9BparDEy22UaJ6ruZsHyiahvY6Nkdbm7yagkLKJW9BJc2TzeOKH2dU1EKhnmLvP2EcYT1_teoYHomQ5Z2faIBUo0kVfkV5ZPOIlQQ Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a33f53f152b549dbbe440ce0a71ee364 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-151045929 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a33f53f152b549dbbe440ce0a71ee364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a33f53f152b549dbbe440ce0a71ee364"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a33f53f152b549dbbe440ce0a71ee364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a33f53f152b549dbbe440ce0a71ee364"}]}] Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-151045929 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a33f53f152b549dbbe440ce0a71ee364 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-151045929 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerAddressesNegativeTestJSON-151045929-project Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: d89aeac4dbfd497caa6fa3c322b44f74 Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-151045929-project Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance fec29626-d7ee-4bcb-a3e1-aceee1921a84 could not be found. Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'fec29626-d7ee-4bcb-a3e1-aceee1921a84'} Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec29626-d7ee-4bcb-a3e1-aceee1921a84 could not be found. Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec29626-d7ee-4bcb-a3e1-aceee1921a84 could not be found. Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:20.988493 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:20.994495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:20.994495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:20.994495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:20.994495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:20.994495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:20.994495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:20.994495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec29626-d7ee-4bcb-a3e1-aceee1921a84 could not be found. Oct 27 09:17:20.994495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:21.000609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] Returning 404 to user: Instance fec29626-d7ee-4bcb-a3e1-aceee1921a84 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:21.004037 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16101302-7bdb-42b5-b4ec-934d61b31bcd tempest-ServerAddressesNegativeTestJSON-151045929 tempest-ServerAddressesNegativeTestJSON-151045929-project] 10.222.0.25 "GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84" status: 404 len: 111 microversion: 2.1 time: 0.132202 Oct 27 09:17:21.006320 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1934/3802] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:20 2022] GET /compute/v2.1/servers/fec29626-d7ee-4bcb-a3e1-aceee1921a84 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:17:21.028116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66835b2b-f0a3-4708-be67-261c2d00d037 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a930a040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:21.111488 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66835b2b-f0a3-4708-be67-261c2d00d037 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.095511 Oct 27 09:17:21.114537 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1935/3803] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:21 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:21.127834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-145e866f-2ae6-40ba-9142-75229dd9c06a req-c780fd75-ce87-4f23-beae-74cdb78b45f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-unplugged", "status": "completed", "tag": "4757d336-0d53-4876-83cf-55f3b46f3a76"}, {"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-unplugged", "status": "completed", "tag": "7dc176e6-58b3-4ec1-9928-173ca4ea6e6d"}, {"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-unplugged", "status": "completed", "tag": "2cde9751-eb67-4cae-b058-60bba7fb3b65"}, {"server_uuid": "b47545e3-12d5-44d9-9d89-d99673b0dd60", "name": "network-vif-plugged", "status": "completed", "tag": "30117189-50cc-42e4-a2f8-1f7c1845b42a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:21.159382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-145e866f-2ae6-40ba-9142-75229dd9c06a req-c780fd75-ce87-4f23-beae-74cdb78b45f6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:21.160743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-145e866f-2ae6-40ba-9142-75229dd9c06a req-c780fd75-ce87-4f23-beae-74cdb78b45f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:21.170044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-145e866f-2ae6-40ba-9142-75229dd9c06a req-c780fd75-ce87-4f23-beae-74cdb78b45f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:21.236806 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-145e866f-2ae6-40ba-9142-75229dd9c06a req-c780fd75-ce87-4f23-beae-74cdb78b45f6 service nova] Creating event network-vif-unplugged:4757d336-0d53-4876-83cf-55f3b46f3a76 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:21.237829 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-145e866f-2ae6-40ba-9142-75229dd9c06a req-c780fd75-ce87-4f23-beae-74cdb78b45f6 service nova] Creating event network-vif-unplugged:7dc176e6-58b3-4ec1-9928-173ca4ea6e6d for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:21.240912 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-145e866f-2ae6-40ba-9142-75229dd9c06a req-c780fd75-ce87-4f23-beae-74cdb78b45f6 service nova] Creating event network-vif-unplugged:2cde9751-eb67-4cae-b058-60bba7fb3b65 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:21.243481 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-145e866f-2ae6-40ba-9142-75229dd9c06a req-c780fd75-ce87-4f23-beae-74cdb78b45f6 service nova] Creating event network-vif-plugged:30117189-50cc-42e4-a2f8-1f7c1845b42a for instance b47545e3-12d5-44d9-9d89-d99673b0dd60 on n-h2-858383-16 Oct 27 09:17:21.259847 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-145e866f-2ae6-40ba-9142-75229dd9c06a req-c780fd75-ce87-4f23-beae-74cdb78b45f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.142871 Oct 27 09:17:21.265471 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1936/3804] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:21.911810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:21.913471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:21.934877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:21.935389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:21.935848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:21.942578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:21.943349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:21.948344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:22.014128 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-736c1bc9-17b7-42a7-ac9e-ffe615a1c2cf tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/5ac0e0dc-dc28-4b23-9f9f-c4d938d51220" status: 202 len: 0 microversion: 2.1 time: 5.516625 Oct 27 09:17:22.022574 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1869/3805] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:17:16 2022] DELETE /compute/v2.1/os-floating-ips/5ac0e0dc-dc28-4b23-9f9f-c4d938d51220 => generated 0 bytes in 5526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:17:22.031615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8214b4ca-8eb6-452b-a683-1bf62a4fc736 tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] Calling method '.version_select at 0x7f31a98dc940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:22.892298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:22.908002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:22.909785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:22.911336 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3778b10d-440e-40a8-a35e-624741e6d7e7 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2752 microversion: 2.42 time: 1.011795 Oct 27 09:17:22.915970 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1937/3806] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:21 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2752 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:22.935735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4aaf05c4-aaf4-4ff6-976d-bbd1d03d875d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa0d4280>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:23.031731 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4aaf05c4-aaf4-4ff6-976d-bbd1d03d875d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.113205 Oct 27 09:17:23.037005 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1938/3807] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:22 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:23.044618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-dec10cfe-55b6-464e-97a6-edbc494b0dbb req-8773fa06-c066-4579-ba77-d8e900d581e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-deleted", "tag": "11599d02-495f-4773-8d4b-4f4e7e5ef3bf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:23.091278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-dec10cfe-55b6-464e-97a6-edbc494b0dbb req-8773fa06-c066-4579-ba77-d8e900d581e6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:23.092128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-dec10cfe-55b6-464e-97a6-edbc494b0dbb req-8773fa06-c066-4579-ba77-d8e900d581e6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:23.093266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-dec10cfe-55b6-464e-97a6-edbc494b0dbb req-8773fa06-c066-4579-ba77-d8e900d581e6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:23.119795 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-dec10cfe-55b6-464e-97a6-edbc494b0dbb req-8773fa06-c066-4579-ba77-d8e900d581e6 service nova] Creating event network-vif-deleted:11599d02-495f-4773-8d4b-4f4e7e5ef3bf for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:23.129222 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-dec10cfe-55b6-464e-97a6-edbc494b0dbb req-8773fa06-c066-4579-ba77-d8e900d581e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088897 Oct 27 09:17:23.130029 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1939/3808] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:23.945569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:23.946291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:23.978373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:23.983972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:23.984605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:23.991360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:23.992271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:23.995169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:25.210540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:25.243866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:25.247332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:25.262710 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd726f45-d6b7-49e7-94ac-42431591cc36 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2592 microversion: 2.42 time: 1.321712 Oct 27 09:17:25.264119 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1940/3809] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:23 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2592 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:25.273719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4c286ba-7de7-40be-80aa-2f807e78dd8a tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94f80d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:25.441056 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e4c286ba-7de7-40be-80aa-2f807e78dd8a tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.174278 Oct 27 09:17:25.453667 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1941/3810] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:25 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:26.121645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:26.204168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-491f4a76-fed9-4209-b648-c4eed3ed753d req-e9f3a107-f8a7-4002-a30e-499cbad220d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-deleted", "tag": "2cde9751-eb67-4cae-b058-60bba7fb3b65"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:26.226804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-491f4a76-fed9-4209-b648-c4eed3ed753d req-e9f3a107-f8a7-4002-a30e-499cbad220d5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:26.227417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-491f4a76-fed9-4209-b648-c4eed3ed753d req-e9f3a107-f8a7-4002-a30e-499cbad220d5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:26.227764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-491f4a76-fed9-4209-b648-c4eed3ed753d req-e9f3a107-f8a7-4002-a30e-499cbad220d5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:26.266767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-491f4a76-fed9-4209-b648-c4eed3ed753d req-e9f3a107-f8a7-4002-a30e-499cbad220d5 service nova] Creating event network-vif-deleted:2cde9751-eb67-4cae-b058-60bba7fb3b65 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:26.288873 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-491f4a76-fed9-4209-b648-c4eed3ed753d req-e9f3a107-f8a7-4002-a30e-499cbad220d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088914 Oct 27 09:17:26.289842 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1942/3811] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:26.324641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:26.325408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:26.355314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:26.355855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:26.356306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:26.357127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:26.357503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:26.357935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:26.481985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:27.147745 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8214b4ca-8eb6-452b-a683-1bf62a4fc736 tempest-FloatingIPDetailsTestJSON-2086338018 tempest-FloatingIPDetailsTestJSON-2086338018-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/99031291-3a45-486f-beef-a7876ced4b15" status: 202 len: 0 microversion: 2.1 time: 5.119935 Oct 27 09:17:27.157110 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1870/3812] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:17:22 2022] DELETE /compute/v2.1/os-floating-ips/99031291-3a45-486f-beef-a7876ced4b15 => generated 0 bytes in 5129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:17:27.167905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8de6e090-72ff-431c-956a-63052b5698c7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aaabe4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:27.259275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:27.263655 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8de6e090-72ff-431c-956a-63052b5698c7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.105095 Oct 27 09:17:27.280636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:27.282004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:27.283318 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-78f8d634-610e-4553-bff1-eb9cb7419e80 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2432 microversion: 2.42 time: 0.964073 Oct 27 09:17:27.287439 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1871/3813] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:27 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:27.301348 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1943/3814] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:26 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2432 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:17:28.288659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f28d74be-3f84-4d73-8a24-2c47e65517c9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa502700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:28.330118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:28.330745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:28.344074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:28.346120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:28.350218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:28.351386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:28.354861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:28.356034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:28.414088 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f28d74be-3f84-4d73-8a24-2c47e65517c9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.130916 Oct 27 09:17:28.418999 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1872/3815] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:28 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:29.430996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-befe5389-bfdd-4bd0-baad-86e9df744246 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a9fd3ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:29.548279 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-befe5389-bfdd-4bd0-baad-86e9df744246 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.121580 Oct 27 09:17:29.548883 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1873/3816] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:29 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:17:29.674101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:29.691354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:29.696880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:29.699364 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9499f030-fee6-4a01-9e4c-f42664fdb73d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2432 microversion: 2.42 time: 1.373364 Oct 27 09:17:29.708808 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1944/3817] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:28 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2432 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:30.566579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c69f68c0-69e8-489c-9fdb-4333700b533f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a97f3ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:30.680986 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c69f68c0-69e8-489c-9fdb-4333700b533f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.119143 Oct 27 09:17:30.683101 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1874/3818] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:30 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:30.740771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:30.741557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:30.748869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:30.763772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:30.768742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:30.775024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:30.776354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:30.776911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:31.696535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b00291b-776c-4124-b6e2-23989eaaae9c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa0ef040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:31.835422 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b00291b-776c-4124-b6e2-23989eaaae9c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.142885 Oct 27 09:17:31.844889 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1875/3819] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:31 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:17:31.875371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7901df0b-0ec3-4181-867a-b8601e018e90 req-f038b923-1fe0-4929-8e27-2f85e1dddf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-deleted", "tag": "4757d336-0d53-4876-83cf-55f3b46f3a76"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:31.921644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7901df0b-0ec3-4181-867a-b8601e018e90 req-f038b923-1fe0-4929-8e27-2f85e1dddf84 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:31.922136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7901df0b-0ec3-4181-867a-b8601e018e90 req-f038b923-1fe0-4929-8e27-2f85e1dddf84 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:31.922575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7901df0b-0ec3-4181-867a-b8601e018e90 req-f038b923-1fe0-4929-8e27-2f85e1dddf84 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:31.975851 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7901df0b-0ec3-4181-867a-b8601e018e90 req-f038b923-1fe0-4929-8e27-2f85e1dddf84 service nova] Creating event network-vif-deleted:4757d336-0d53-4876-83cf-55f3b46f3a76 for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:31.989279 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7901df0b-0ec3-4181-867a-b8601e018e90 req-f038b923-1fe0-4929-8e27-2f85e1dddf84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142098 Oct 27 09:17:31.997433 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1876/3820] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:32.379870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:32.394080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:32.398992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:32.409231 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6951023-b583-4045-a488-b6c57ce34840 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2386 microversion: 2.42 time: 1.672812 Oct 27 09:17:32.412686 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1945/3821] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:30 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2386 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:32.853717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08d5615b-dad8-4965-83e8-4f6b9759099f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a9979f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:32.942645 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08d5615b-dad8-4965-83e8-4f6b9759099f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.094747 Oct 27 09:17:32.943535 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1877/3822] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:32 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:33.453999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:33.454624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:33.458554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=63 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:33.476263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:33.476528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:33.478669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:33.479449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:33.485790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:33.486655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:33.959812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-772faa21-b41d-470b-8c74-e4d43e4b3cc7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aaabedc0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:34.030051 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-772faa21-b41d-470b-8c74-e4d43e4b3cc7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.074595 Oct 27 09:17:34.031447 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1878/3823] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:33 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:17:34.382054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:34.394577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:34.405164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:34.413470 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1e8894c-a006-4505-b1aa-b5ac7e960c78 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 2096 microversion: 2.42 time: 0.963370 Oct 27 09:17:34.417895 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1946/3824] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:33 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 2096 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:34.900464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6ae1844f-82b1-4797-ac49-c1e73d385763 req-1e7741f2-c36d-40dc-b20e-3c49f9597c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f", "name": "network-vif-deleted", "tag": "7dc176e6-58b3-4ec1-9928-173ca4ea6e6d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:34.961336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6ae1844f-82b1-4797-ac49-c1e73d385763 req-1e7741f2-c36d-40dc-b20e-3c49f9597c3b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:34.970250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6ae1844f-82b1-4797-ac49-c1e73d385763 req-1e7741f2-c36d-40dc-b20e-3c49f9597c3b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:34.970973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6ae1844f-82b1-4797-ac49-c1e73d385763 req-1e7741f2-c36d-40dc-b20e-3c49f9597c3b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:35.047125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c57f9420-7d4c-49c5-83d5-5a476c41e883 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31ae6a1e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:35.094618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6ae1844f-82b1-4797-ac49-c1e73d385763 req-1e7741f2-c36d-40dc-b20e-3c49f9597c3b service nova] Creating event network-vif-deleted:7dc176e6-58b3-4ec1-9928-173ca4ea6e6d for instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f on n-h2-858383-16 Oct 27 09:17:35.129189 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6ae1844f-82b1-4797-ac49-c1e73d385763 req-1e7741f2-c36d-40dc-b20e-3c49f9597c3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235591 Oct 27 09:17:35.130014 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1879/3825] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:35.206125 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c57f9420-7d4c-49c5-83d5-5a476c41e883 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.163306 Oct 27 09:17:35.207655 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1947/3826] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:35 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:17:35.455738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:35.456449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:35.471227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:35.472997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:35.475533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:35.476524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:35.479724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:35.495361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:35.823694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:35.878582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:35.901046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:35.915158 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2d4e6576-8517-4f90-9c4d-c2a4f0cd75e4 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.461756 Oct 27 09:17:35.950464 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1880/3827] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:35 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:36.226712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c66d8cce-3468-4fbf-a374-8fdbc304ed30 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a93db5e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:36.362137 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c66d8cce-3468-4fbf-a374-8fdbc304ed30 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.140109 Oct 27 09:17:36.367678 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1948/3828] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:36 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:36.954920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:36.955537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:36.971241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:36.978737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:36.981319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:36.984807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:36.992452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:36.995129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:37.413450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c05cd9c-7795-4b14-a441-d7fc690ecdfe tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31ae6a1c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:37.568636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c05cd9c-7795-4b14-a441-d7fc690ecdfe tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.181206 Oct 27 09:17:37.569214 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1949/3829] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:37 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:37.757083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:37.815389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:37.825998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:37.838928 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23e92493-4970-4e93-97aa-3f3b0a2dad27 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.880891 Oct 27 09:17:37.852926 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1881/3830] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:36 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:38.601049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c356d0f-8d60-49ff-91e5-0568aa0adfc6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a9e84a60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:38.781879 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c356d0f-8d60-49ff-91e5-0568aa0adfc6 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.200735 Oct 27 09:17:38.788759 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1950/3831] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:38 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:38.888028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:38.888808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:38.906609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:38.912084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:38.916720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:38.919900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:38.923245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:38.932175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:39.386216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:39.415223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:39.422082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:39.433631 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5779aae-a5a9-42d3-92e9-7c1ec98d847c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.550384 Oct 27 09:17:39.448342 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1882/3832] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:38 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:39.801102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c2da9a90-87bd-4b8d-b2e5-a563e3fd8e8c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa0d4310>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:39.929962 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c2da9a90-87bd-4b8d-b2e5-a563e3fd8e8c tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.135231 Oct 27 09:17:39.938944 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1951/3833] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:39 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:40.475261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:40.476558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:40.489949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:40.502006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:40.502720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:40.504407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:40.506405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:40.508436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:40.783114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:40.809328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:40.816604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:40.826049 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-06ad7b79-a9ce-47c1-98e7-4f0f5cd14d5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.352589 Oct 27 09:17:40.835742 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1883/3834] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:40 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:40.948804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9fb38d2d-51d2-4f8e-b142-f78d31aa34f9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a93baa60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:41.034996 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9fb38d2d-51d2-4f8e-b142-f78d31aa34f9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.092327 Oct 27 09:17:41.035617 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1952/3835] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:40 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:41.864593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:41.865973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:41.882185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:41.882717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:41.884363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:41.886290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:41.886808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:41.887250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:42.051833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1bb5de53-39c3-4e41-ab09-8cfc74cd8559 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31ae6a1c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:42.128305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:42.148361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:42.151222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:42.157129 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d885f74-c4aa-4422-8a59-8525f52ed98f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.302359 Oct 27 09:17:42.158547 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1884/3836] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:41 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:42.173068 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1bb5de53-39c3-4e41-ab09-8cfc74cd8559 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.125046 Oct 27 09:17:42.181699 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1953/3837] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:42 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:17:43.198627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:43.201105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:43.201705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e827b81-626f-4464-a7bc-3fbf1be0a3e9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a93bab80>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:43.229883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:43.233071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:43.233980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:43.235437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:43.238162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:43.241914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:43.315435 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e827b81-626f-4464-a7bc-3fbf1be0a3e9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.128529 Oct 27 09:17:43.316425 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1954/3838] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:43 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:43.474569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:43.511983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:43.523204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:43.532789 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e02d9c83-568a-4863-8f1d-624b5d6e7044 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.346781 Oct 27 09:17:43.543668 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1885/3839] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:43 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:44.333122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a848937c-7a30-431a-a232-02367ae80bc5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a9cba790>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:44.341124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:44.391895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=52 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:44.424199 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a848937c-7a30-431a-a232-02367ae80bc5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.094551 Oct 27 09:17:44.425439 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1955/3840] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:44 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:44.569175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:44.569820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:44.592091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:44.592593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:44.604439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:44.608634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:44.609441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:44.616440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:45.054843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:45.088568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:45.094067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:45.100426 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99a1e0d5-c21b-417f-ab84-1f9ed8cc3404 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.536870 Oct 27 09:17:45.115184 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1886/3841] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:44 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:17:45.441649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-31dc2244-d530-4b1d-a78e-63a5daee0e40 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a994e700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:45.541679 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-31dc2244-d530-4b1d-a78e-63a5daee0e40 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.104574 Oct 27 09:17:45.552422 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1887/3842] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:45 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:17:45.735736 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1e6b27d-46e8-45ea-b586-543e2030836f tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.387329 Oct 27 09:17:45.736609 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1956/3843] 10.222.0.25 () {58 vars in 1128 bytes} [Thu Oct 27 09:17:45 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 27 09:17:45.747205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72967ac2-ac83-430f-abe5-9f40c308b242 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Calling method '.version_select at 0x7f31aa2fbf70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:45.783945 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-72967ac2-ac83-430f-abe5-9f40c308b242 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] HTTP exception thrown: Image not found. Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72967ac2-ac83-430f-abe5-9f40c308b242 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Request method failure captured: Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWky5GIQSRzQEuDxW5bvKccUb8j4Jjr3krOwnPeescL5WXirLNCxjlPhMKQUZeILRmxieJyXXZxOEKrVCvQztPpAtega5mEaAuoVJasYHijF0waXsVdd7av1cDp2CHpzoyIAD7wX-lvvW-jZ8Aa4-G_29jnWGbM3EWqjsNRL4GL5V57M Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dff275aeb44b49db98213019f8db4359"}]}] Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c9397da62d0a48608dfb5d641337509c Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '-1'} Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.787022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:17:45.792466 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.796274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72967ac2-ac83-430f-abe5-9f40c308b242 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:45.797736 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72967ac2-ac83-430f-abe5-9f40c308b242 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.055374 Oct 27 09:17:45.798833 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1888/3844] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Oct 27 09:17:45 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:17:45.808829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f933f3a-0f2f-4581-8806-713258795919 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Calling method '.version_select at 0x7f31a9d72d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:45.857113 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8f933f3a-0f2f-4581-8806-713258795919 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] HTTP exception thrown: Image not found. Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f933f3a-0f2f-4581-8806-713258795919 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Request method failure captured: Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/images/3afc8946-2119-4bab-8979-01f063ac6dcj HTTP/1.1 Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWky5GIQSRzQEuDxW5bvKccUb8j4Jjr3krOwnPeescL5WXirLNCxjlPhMKQUZeILRmxieJyXXZxOEKrVCvQztPpAtega5mEaAuoVJasYHijF0waXsVdd7av1cDp2CHpzoyIAD7wX-lvvW-jZ8Aa4-G_29jnWGbM3EWqjsNRL4GL5V57M Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dff275aeb44b49db98213019f8db4359"}]}] Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c9397da62d0a48608dfb5d641337509c Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '3afc8946-2119-4bab-8979-01f063ac6dcj'} Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3afc8946-2119-4bab-8979-01f063ac6dcj to delete Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3afc8946-2119-4bab-8979-01f063ac6dcj could not be found. Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.859647 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f933f3a-0f2f-4581-8806-713258795919 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f933f3a-0f2f-4581-8806-713258795919 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] 10.222.0.25 "DELETE /compute/v2.1/images/3afc8946-2119-4bab-8979-01f063ac6dcj" status: 404 len: 62 microversion: 2.1 time: 0.059046 Oct 27 09:17:45.866465 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1957/3845] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:45 2022] DELETE /compute/v2.1/images/3afc8946-2119-4bab-8979-01f063ac6dcj => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:17:45.876499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-563cf081-0309-4d05-8e9d-bdad62702c53 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Calling method '.version_select at 0x7f31a991daf0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:45.895969 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-563cf081-0309-4d05-8e9d-bdad62702c53 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] HTTP exception thrown: Image not found. Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-563cf081-0309-4d05-8e9d-bdad62702c53 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Request method failure captured: Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/images/8f781a49-7a50-4715-b1cb-9efc5654be1c1 HTTP/1.1 Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWky5GIQSRzQEuDxW5bvKccUb8j4Jjr3krOwnPeescL5WXirLNCxjlPhMKQUZeILRmxieJyXXZxOEKrVCvQztPpAtega5mEaAuoVJasYHijF0waXsVdd7av1cDp2CHpzoyIAD7wX-lvvW-jZ8Aa4-G_29jnWGbM3EWqjsNRL4GL5V57M Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dff275aeb44b49db98213019f8db4359"}]}] Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c9397da62d0a48608dfb5d641337509c Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '8f781a49-7a50-4715-b1cb-9efc5654be1c1'} Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8f781a49-7a50-4715-b1cb-9efc5654be1c1 to delete Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f781a49-7a50-4715-b1cb-9efc5654be1c1 could not be found. Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.898037 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.904184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-563cf081-0309-4d05-8e9d-bdad62702c53 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:45.907763 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-563cf081-0309-4d05-8e9d-bdad62702c53 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] 10.222.0.25 "DELETE /compute/v2.1/images/8f781a49-7a50-4715-b1cb-9efc5654be1c1" status: 404 len: 62 microversion: 2.1 time: 0.034607 Oct 27 09:17:45.907763 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1889/3846] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:17:45 2022] DELETE /compute/v2.1/images/8f781a49-7a50-4715-b1cb-9efc5654be1c1 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:17:45.919723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c8921ce5-4696-4b68-90a6-ed977f07f526 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Calling method '.version_select at 0x7f31a948cf70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:45.965387 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c8921ce5-4696-4b68-90a6-ed977f07f526 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] HTTP exception thrown: Image not found. Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c8921ce5-4696-4b68-90a6-ed977f07f526 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Request method failure captured: Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/images/tempest-invalid-504272508 HTTP/1.1 Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWky5GIQSRzQEuDxW5bvKccUb8j4Jjr3krOwnPeescL5WXirLNCxjlPhMKQUZeILRmxieJyXXZxOEKrVCvQztPpAtega5mEaAuoVJasYHijF0waXsVdd7av1cDp2CHpzoyIAD7wX-lvvW-jZ8Aa4-G_29jnWGbM3EWqjsNRL4GL5V57M Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dff275aeb44b49db98213019f8db4359"}]}] Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c9397da62d0a48608dfb5d641337509c Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'tempest-invalid-504272508'} Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-504272508 to delete Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-504272508 could not be found. Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.967439 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c8921ce5-4696-4b68-90a6-ed977f07f526 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:45.973657 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c8921ce5-4696-4b68-90a6-ed977f07f526 tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-504272508" status: 404 len: 62 microversion: 2.1 time: 0.054705 Oct 27 09:17:45.975954 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1958/3847] 10.222.0.25 () {58 vars in 1203 bytes} [Thu Oct 27 09:17:45 2022] DELETE /compute/v2.1/images/tempest-invalid-504272508 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:17:45.981629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a997aeac-2d9e-42cb-ab2d-5cc45820e60c tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Calling method '.version_select at 0x7f31a994e160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:46.023530 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a997aeac-2d9e-42cb-ab2d-5cc45820e60c tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] HTTP exception thrown: Image not found. Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a997aeac-2d9e-42cb-ab2d-5cc45820e60c tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Request method failure captured: Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/images/f03e88bb-904f-4b6e-ac0e-390bccb16b08 HTTP/1.1 Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWky5GIQSRzQEuDxW5bvKccUb8j4Jjr3krOwnPeescL5WXirLNCxjlPhMKQUZeILRmxieJyXXZxOEKrVCvQztPpAtega5mEaAuoVJasYHijF0waXsVdd7av1cDp2CHpzoyIAD7wX-lvvW-jZ8Aa4-G_29jnWGbM3EWqjsNRL4GL5V57M Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dff275aeb44b49db98213019f8db4359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dff275aeb44b49db98213019f8db4359"}]}] Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: dff275aeb44b49db98213019f8db4359 Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-3006893 Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c9397da62d0a48608dfb5d641337509c Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-3006893-project Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f03e88bb-904f-4b6e-ac0e-390bccb16b08'} Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f03e88bb-904f-4b6e-ac0e-390bccb16b08 to delete Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f03e88bb-904f-4b6e-ac0e-390bccb16b08 could not be found. Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:46.025379 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a997aeac-2d9e-42cb-ab2d-5cc45820e60c tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:46.030769 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a997aeac-2d9e-42cb-ab2d-5cc45820e60c tempest-ImagesDeleteNegativeTestJSON-3006893 tempest-ImagesDeleteNegativeTestJSON-3006893-project] 10.222.0.25 "DELETE /compute/v2.1/images/f03e88bb-904f-4b6e-ac0e-390bccb16b08" status: 404 len: 62 microversion: 2.1 time: 0.049696 Oct 27 09:17:46.032865 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1890/3848] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:45 2022] DELETE /compute/v2.1/images/f03e88bb-904f-4b6e-ac0e-390bccb16b08 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:17:46.149091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:46.151611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:46.169944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:46.176527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:46.180485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:46.186369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:46.190650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:46.191340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:46.409620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:46.422526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:46.437586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:46.446079 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f96d71e-d0e4-41fc-bf8e-6d4bb02e6ac0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.301358 Oct 27 09:17:46.448240 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1959/3849] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:46 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:46.561581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4bf5fbad-6b82-4500-b272-54ba3c007c5a tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a994eee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:46.679665 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4bf5fbad-6b82-4500-b272-54ba3c007c5a tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.109390 Oct 27 09:17:46.680805 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1891/3850] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:46 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:47.480159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:47.480775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:47.507940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:47.509962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:47.510485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:47.511334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:47.512182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:47.513356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:47.699132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89daa55e-f06e-4b3d-84a7-bf9982747a24 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa2fbf70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:47.798219 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-89daa55e-f06e-4b3d-84a7-bf9982747a24 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.103527 Oct 27 09:17:47.799658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:47.800670 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1892/3851] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:47 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:17:47.861933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:47.874763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:47.878184 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23529967-9518-4738-be89-0cba81d84837 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.407157 Oct 27 09:17:47.907561 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1960/3852] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:47 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:48.818860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8892354-122c-4d54-9047-f6f12f44b4ed tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a98dcca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:48.915089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:48.916338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:48.939147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:48.940789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:48.941648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:48.943078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:48.943829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:48.945131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:48.951921 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8892354-122c-4d54-9047-f6f12f44b4ed tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.139887 Oct 27 09:17:48.952827 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1893/3853] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:48 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:49.152442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:49.198341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:49.210988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:49.215828 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6739e3c8-1ba0-4b6b-815f-ee8881fb74bd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.307510 Oct 27 09:17:49.221474 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1961/3854] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:48 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:49.969315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85d1fb0b-4a98-46b7-a9dd-8f79f8a9bf12 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa07ad30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:50.079882 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85d1fb0b-4a98-46b7-a9dd-8f79f8a9bf12 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.115513 Oct 27 09:17:50.088738 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1894/3855] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:49 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:50.253629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:50.254286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:50.276050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:50.277688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:50.281282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:50.283851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:50.285497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:50.286562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:50.678936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:50.699786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:50.714869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:50.726166 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a4190fbe-2932-4182-acb8-1c6d580c6360 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.469485 Oct 27 09:17:50.726845 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1962/3856] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:50 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:51.095873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b92d400-a97c-4066-ae89-0ddb5d038933 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a98dc1f0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:51.185859 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b92d400-a97c-4066-ae89-0ddb5d038933 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1429 microversion: 2.1 time: 0.093953 Oct 27 09:17:51.188572 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1895/3857] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:51 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:51.759365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:51.760753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:51.778874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:51.780240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:51.784530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:51.786268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:51.790744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:51.791148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:51.967189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:51.984532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:51.986519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:51.988426 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b29c3d86-9bd1-47e2-96ee-543ce475a8a8 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.236453 Oct 27 09:17:51.990861 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1963/3858] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:51 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:52.203478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f86d717-f259-45ba-8a49-eeb838f961c7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31aa2fb160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:52.277452 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f86d717-f259-45ba-8a49-eeb838f961c7 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1438 microversion: 2.1 time: 0.078329 Oct 27 09:17:52.282693 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1896/3859] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:52 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:52.295157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47a9342f-6ec3-4c34-bbd5-03de4e8e8b9d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94f7dc0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:52.364201 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47a9342f-6ec3-4c34-bbd5-03de4e8e8b9d tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 200 len: 1438 microversion: 2.1 time: 0.073446 Oct 27 09:17:52.369567 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1964/3860] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:17:52 2022] GET /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 1438 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:52.389026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:52.390465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:52.403688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:52.406707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:52.408576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:52.409715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:52.410481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:52.412820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:52.755756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:52.776109 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00273163-9c48-42be-b6d0-eedd20ccee13 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1465 microversion: 2.1 time: 0.394185 Oct 27 09:17:52.777984 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1897/3861] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:52 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1465 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:52.808887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-288a11de-867a-413b-91b2-8ad6e4f1fec9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31ae6a1160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:53.016921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:53.017844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:53.030052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:53.030854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:53.031464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:53.033613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:53.035682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:53.036987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:53.210159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:53.238520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:53.242157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:53.247840 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e30ebac-d329-4841-acf5-1536ce081c10 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.237126 Oct 27 09:17:53.259619 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1898/3862] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:53 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:17:54.281477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:54.282560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:54.304866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:54.305376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:54.319408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:54.320151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:54.320604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:54.321038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:54.751673 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-288a11de-867a-413b-91b2-8ad6e4f1fec9 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "DELETE /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba" status: 204 len: 0 microversion: 2.1 time: 1.948334 Oct 27 09:17:54.761280 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1965/3863] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:52 2022] DELETE /compute/v2.1/images/8069100c-dca1-406a-8754-ebb1750909ba => generated 0 bytes in 1954 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:17:54.762280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:54.786080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:54.789349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3304d553-9259-4cb4-a774-017ae318de80 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '.version_select at 0x7f31a94f7e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:54.792992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:54.794309 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b92d306-121e-4ede-9087-ecc444b51137 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.518966 Oct 27 09:17:54.802950 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1899/3864] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:54 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:54.832098 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-3304d553-9259-4cb4-a774-017ae318de80 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] HTTP exception thrown: Image not found. Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3304d553-9259-4cb4-a774-017ae318de80 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Request method failure captured: Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d HTTP/1.1 Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkxLGHyh3c0eiJxQnA52HYaCK2V63iQM5At1lMRKrxyXurEGfqFAxkE5EOsE8_Zh8EP91Y0OCY4XanMsNr2uGNnMolTZs6qy6sFTs0lJX2M05UiHlQdqQPW0OP0GxPe7dyjM98-Laks2i5D-gU0L_Ii0V_4S3C8exv99Iw1CGJjs0xk Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 03f1a443472e442e8d5fdd76e7caa469 Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesOneServerTestJSON-1918736899 Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03f1a443472e442e8d5fdd76e7caa469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03f1a443472e442e8d5fdd76e7caa469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03f1a443472e442e8d5fdd76e7caa469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03f1a443472e442e8d5fdd76e7caa469"}]}] Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesOneServerTestJSON-1918736899 Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 03f1a443472e442e8d5fdd76e7caa469 Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1918736899 Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesOneServerTestJSON-1918736899-project Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: efa9d44a698142dab4cd9d04e8afb20f Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesOneServerTestJSON-1918736899-project Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d'} Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d to delete Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d could not be found. Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:54.839641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:17:54.845072 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:17:54.853791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3304d553-9259-4cb4-a774-017ae318de80 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:17:54.854551 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3304d553-9259-4cb4-a774-017ae318de80 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "DELETE /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d" status: 404 len: 62 microversion: 2.1 time: 0.090950 Oct 27 09:17:54.863307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:54.864778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:54.866248 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1966/3865] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:54 2022] DELETE /compute/v2.1/images/4ff9323a-67dc-4a8c-8b59-5dbfa8fa8c3d => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:17:54.875767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:54.878326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:54.885715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:54.886751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:54.887471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:54.888166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:54.972039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:17:55.166979 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99ec4c11-f43b-4767-8f16-6f3b0dbb3e6b tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 204 len: 0 microversion: 2.1 time: 0.307020 Oct 27 09:17:55.167987 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1900/3866] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:17:54 2022] DELETE /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:17:55.177696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:55.178453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:55.198595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:55.200428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:55.200979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:55.203365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:55.203958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:55.207258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:55.506901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:55.530621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e009b28e-da39-4579-96c2-ddb57d1832db tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1471 microversion: 2.1 time: 0.357138 Oct 27 09:17:55.531202 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1967/3867] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:55 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:55.824819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:55.825437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:55.873078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:55.873595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:55.880628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:55.881440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:55.884953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:55.885614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:56.085668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:56.115823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:56.117234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:56.119082 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a815e749-db71-40e8-aff6-0675a66c7c35 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.298932 Oct 27 09:17:56.119699 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1968/3868] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:55 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:17:56.184863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1418773457", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:56.209740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:56.282039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] validate_networks() for [('f2e1d02f-47a9-4a0a-a43b-cf81524bbbe4', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:17:56.558463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:56.559763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:56.576736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:56.577261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:56.579415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:56.581437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:56.583315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:56.584985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:57.902168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:57.915748 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3e3ec86e-0e54-46a6-b7a3-a43a5e86fbd2 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1471 microversion: 2.1 time: 1.362210 Oct 27 09:17:57.933142 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1969/3869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:56 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1471 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:57.940393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-9230bd83-e73f-4c9d-b9e8-ec757b8480aa req-f18a1a2e-190a-49a2-9f46-a98326fb83b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47545e3-12d5-44d9-9d89-d99673b0dd60", "name": "network-vif-unplugged", "status": "completed", "tag": "30117189-50cc-42e4-a2f8-1f7c1845b42a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:57.952927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9230bd83-e73f-4c9d-b9e8-ec757b8480aa req-f18a1a2e-190a-49a2-9f46-a98326fb83b7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:57.953643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9230bd83-e73f-4c9d-b9e8-ec757b8480aa req-f18a1a2e-190a-49a2-9f46-a98326fb83b7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:57.954376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9230bd83-e73f-4c9d-b9e8-ec757b8480aa req-f18a1a2e-190a-49a2-9f46-a98326fb83b7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:57.967047 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-9230bd83-e73f-4c9d-b9e8-ec757b8480aa req-f18a1a2e-190a-49a2-9f46-a98326fb83b7 service nova] Creating event network-vif-unplugged:30117189-50cc-42e4-a2f8-1f7c1845b42a for instance b47545e3-12d5-44d9-9d89-d99673b0dd60 on n-h2-858383-16 Oct 27 09:17:57.977040 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-9230bd83-e73f-4c9d-b9e8-ec757b8480aa req-f18a1a2e-190a-49a2-9f46-a98326fb83b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040867 Oct 27 09:17:57.978881 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1970/3870] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:17:57.991363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:57.992821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:58.007114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:58.008532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:58.009645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:58.011653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:58.015232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:58.016702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:58.239482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:58.242778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:17:58.244591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:17:58.245240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:17:58.245840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:17:58.246552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:17:58.267101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:58.272749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:58.277681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:58.279782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:58.281081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:58.284287 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a9d829d-0727-47ce-9c75-9387c29468dd tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.302058 Oct 27 09:17:58.288376 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1971/3871] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:17:57 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:17:58.288791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:58.291088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:58.292651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:58.333095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:17:58.358743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Getting quotas for project e28707cf49b24806879ae5acd0e08cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:17:58.368021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Getting quotas for user c6165562b6e14ff18dc7d82b8c9a46b3 and project e28707cf49b24806879ae5acd0e08cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:17:58.386273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:17:58.389567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:17:58.519988 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-308ddd60-c055-43f9-aa19-1bd71207eafb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.964145 Oct 27 09:17:58.529746 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1901/3872] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:17:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:17:58.533755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5cdd16dc-bcb6-4d3d-86fa-96c76b22179d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:58.534602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5cdd16dc-bcb6-4d3d-86fa-96c76b22179d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:58.928999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5cdd16dc-bcb6-4d3d-86fa-96c76b22179d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:17:58.941747 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5cdd16dc-bcb6-4d3d-86fa-96c76b22179d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1222 microversion: 2.1 time: 0.412909 Oct 27 09:17:58.944256 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1972/3873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:58 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1222 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:17:58.969306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:17:58.969968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:17:58.982356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:58.982881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:58.983431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:58.984869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:17:58.985634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:17:58.986263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:17:59.213132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1157807259", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:17:59.329886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] validate_networks() for [('f2e1d02f-47a9-4a0a-a43b-cf81524bbbe4', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:18:00.358154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:00.440919 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-16cacc7b-2ebc-4d96-85a4-eda41355b5e5 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1471 microversion: 2.1 time: 1.500344 Oct 27 09:18:00.447319 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1902/3874] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:17:58 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1471 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:00.523023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:00.524942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:00.583305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:00.585112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:00.588233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:00.589913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:00.591928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:00.596834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:01.109265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:01.128193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:01.136139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:01.143788 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f324a6d4-e734-4d89-9831-d083c910c6e2 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.691420 Oct 27 09:18:01.147922 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1903/3875] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:18:00 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:18:01.389159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-537754b6-da92-48c0-a8d6-9292c970aa93 req-ee7e4102-da5a-4abf-becb-27fa12c8eb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47545e3-12d5-44d9-9d89-d99673b0dd60", "name": "network-vif-deleted", "tag": "30117189-50cc-42e4-a2f8-1f7c1845b42a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:01.414363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-537754b6-da92-48c0-a8d6-9292c970aa93 req-ee7e4102-da5a-4abf-becb-27fa12c8eb9c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:01.421625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-537754b6-da92-48c0-a8d6-9292c970aa93 req-ee7e4102-da5a-4abf-becb-27fa12c8eb9c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:01.425568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-537754b6-da92-48c0-a8d6-9292c970aa93 req-ee7e4102-da5a-4abf-becb-27fa12c8eb9c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:01.479107 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-537754b6-da92-48c0-a8d6-9292c970aa93 req-ee7e4102-da5a-4abf-becb-27fa12c8eb9c service nova] Creating event network-vif-deleted:30117189-50cc-42e4-a2f8-1f7c1845b42a for instance b47545e3-12d5-44d9-9d89-d99673b0dd60 on n-h2-858383-16 Oct 27 09:18:01.491901 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-537754b6-da92-48c0-a8d6-9292c970aa93 req-ee7e4102-da5a-4abf-becb-27fa12c8eb9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122327 Oct 27 09:18:01.495940 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1904/3876] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:01.524841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:01.527008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:01.545654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:01.546178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:01.546623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:01.547354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:01.550014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:01.551210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:01.983140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:02.006324 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4acfbf7f-69e3-4971-a961-612ed85f18da tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1301 microversion: 2.1 time: 0.505337 Oct 27 09:18:02.007385 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1905/3877] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:01 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1301 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:02.179503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:02.182817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:02.193569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:02.198832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:02.201634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:02.202911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:02.204849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:02.207265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:02.518269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:02.596636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:02.627268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:02.631412 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff971504-ea7f-4969-8448-a06592d07522 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.455988 Oct 27 09:18:02.633330 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1906/3878] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:18:02 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:18:03.034781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:03.035743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:03.047585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:03.058873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:03.060249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:03.061022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:03.061496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:03.062190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:03.192722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:03.193803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:03.195126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:03.200709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:18:03.201200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:18:03.202439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:18:03.203313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:18:03.203995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:18:03.210367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lazy-loading 'fault' on Instance uuid b47545e3-12d5-44d9-9d89-d99673b0dd60 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:18:03.235428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:03.236241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:03.241724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:03.247874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:03.249474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:03.250059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:03.327838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Getting quotas for project e28707cf49b24806879ae5acd0e08cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:18:03.352754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa9d44a698142dab4cd9d04e8afb20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f1a443472e442e8d5fdd76e7caa469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:03.353292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Getting quotas for user c6165562b6e14ff18dc7d82b8c9a46b3 and project e28707cf49b24806879ae5acd0e08cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:18:03.379015 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4bf5e845-2232-40b5-a614-9985055ea739 tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 200 len: 1306 microversion: 2.1 time: 0.346690 Oct 27 09:18:03.381501 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1907/3879] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:03 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 1306 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:03.422418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:18:03.431444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:18:03.613363 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7cceb67c-ce43-44f7-9260-2bc2acaac365 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.406338 Oct 27 09:18:03.614786 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1973/3880] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:17:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 4414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:18:03.628084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c620a374-799b-4093-a4a1-85dcef243e43 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:03.630466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c620a374-799b-4093-a4a1-85dcef243e43 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:03.663616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:03.664544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:03.677748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:03.679489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:03.680978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:03.689650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:03.693942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:03.694843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:04.232513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c620a374-799b-4093-a4a1-85dcef243e43 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:04.243908 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c620a374-799b-4093-a4a1-85dcef243e43 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1222 microversion: 2.1 time: 0.621209 Oct 27 09:18:04.245547 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1908/3881] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:03 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1222 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:04.262885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:04.272512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:04.274921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:04.285491 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4fee7145-2f96-4409-ba4f-f49573322b4b tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.624974 Oct 27 09:18:04.288649 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1974/3882] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:18:03 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:18:04.412173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:04.413494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] [instance: b47545e3-12d5-44d9-9d89-d99673b0dd60] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:04.428464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:04.428974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:04.429416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:04.433885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:04.434917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:04.435763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:04.465294 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] HTTP exception thrown: Instance b47545e3-12d5-44d9-9d89-d99673b0dd60 could not be found. Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Request method failure captured: Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 HTTP/1.1 Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkxLGHyh3c0eiJxQnA52HYaCK2V63iQM5At1lMRKrxyXurEGfqFAxkE5EOsE8_Zh8EP91Y0OCY4XanMsNr2uGNnMolTZs6qy6sFTs0lJX2M05UiHlQdqQPW0OP0GxPe7dyjM98-Laks2i5D-gU0L_Ii0V_4S3C8exv99Iw1CGJjs0xk Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 03f1a443472e442e8d5fdd76e7caa469 Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesOneServerTestJSON-1918736899 Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03f1a443472e442e8d5fdd76e7caa469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03f1a443472e442e8d5fdd76e7caa469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03f1a443472e442e8d5fdd76e7caa469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03f1a443472e442e8d5fdd76e7caa469"}]}] Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesOneServerTestJSON-1918736899 Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 03f1a443472e442e8d5fdd76e7caa469 Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1918736899 Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesOneServerTestJSON-1918736899-project Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: efa9d44a698142dab4cd9d04e8afb20f Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesOneServerTestJSON-1918736899-project Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance b47545e3-12d5-44d9-9d89-d99673b0dd60 could not be found. Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'b47545e3-12d5-44d9-9d89-d99673b0dd60'} Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47545e3-12d5-44d9-9d89-d99673b0dd60 could not be found. Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47545e3-12d5-44d9-9d89-d99673b0dd60 could not be found. Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:04.479441 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47545e3-12d5-44d9-9d89-d99673b0dd60 could not be found. Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] Returning 404 to user: Instance b47545e3-12d5-44d9-9d89-d99673b0dd60 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3e86155-cbc2-437f-935e-327b9a46bb9f tempest-ImagesOneServerTestJSON-1918736899 tempest-ImagesOneServerTestJSON-1918736899-project] 10.222.0.25 "GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60" status: 404 len: 111 microversion: 2.1 time: 0.075504 Oct 27 09:18:04.485414 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1909/3883] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:04 2022] GET /compute/v2.1/servers/b47545e3-12d5-44d9-9d89-d99673b0dd60 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:18:05.274596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:05.275272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:05.294403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:05.296337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:05.298395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:05.301592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:05.301592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:05.301949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:05.320245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:05.332245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:05.349454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:05.350178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:05.350812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:05.352040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:05.353243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:05.354056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:05.880143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:05.889849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:05.899175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:05.905062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:05.913206 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cee55864-a8a7-4e95-9761-38e68674d77f tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.596868 Oct 27 09:18:05.919327 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1910/3884] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:18:05 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:18:05.920341 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b1083403-ed4c-4e01-a98f-8904e49706d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1274 microversion: 2.1 time: 0.650740 Oct 27 09:18:05.922169 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1975/3885] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:05 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1274 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:06.957719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:06.959740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:06.961590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:06.962194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:06.978203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:06.979069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:06.979786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:06.980734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:06.982221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:06.987148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:06.987943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:06.988874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:06.989808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:06.990569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:06.991379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:06.996386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:07.211192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:07.224668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:07.227077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:07.229460 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a93d517e-d92f-4c4e-a942-5dc557090120 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.287625 Oct 27 09:18:07.230546 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1976/3886] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:18:06 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:18:07.289359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:07.297260 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d83ac2dc-0dfb-440b-8517-ff8715acf2f1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1280 microversion: 2.1 time: 0.354726 Oct 27 09:18:07.297852 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1911/3887] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:06 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1280 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:08.258901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:08.259539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:08.274227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:08.278694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:08.279195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:08.279991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:08.280466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:08.280902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:08.324569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:08.325794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:08.342176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:08.349388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:08.357047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:08.359476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:08.360245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:08.360768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:08.365320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:08.953755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:08.966202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:08.977762 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3408a9c-0255-4fb3-8a12-cd0f337e55ad tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1280 microversion: 2.1 time: 0.657056 Oct 27 09:18:08.977987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:08.991686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9999a6c576f74271b47cec5e1336ec80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0fac9489e34375b8ecc267d00cbebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:08.992407 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1912/3888] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:08 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1280 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:08.992546 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0eb36bdb-f4ec-4e79-b05d-a27fc9698c8d tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 200 len: 1604 microversion: 2.42 time: 0.732079 Oct 27 09:18:08.992546 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1977/3889] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:18:08 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 1604 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:18:09.518849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-589227514", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "90ebea8d-eac6-4b1a-b3d9-f6b05473f889"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:09.620006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] validate_networks() for [('90ebea8d-eac6-4b1a-b3d9-f6b05473f889', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:18:10.010165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:10.011014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:10.020460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:10.021248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:10.030978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:10.038194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:10.039039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:10.040504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:10.925696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:10.935826 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-891f3f90-5427-47d9-a24d-7e5a6d7a2161 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 0.931192 Oct 27 09:18:10.939911 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1978/3890] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:10 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:10.958761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:10.963268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:10.985488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:10.989205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:10.992690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:10.994220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:10.998037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:10.999610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:11.030238 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] HTTP exception thrown: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Request method failure captured: Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f HTTP/1.1 Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWksUrtUK4TheBs-85blZLRyFa4VdpYeehxemhFeC_QGFRdi1wamHwaxp0JLhKcWth9TL5k_rbNAHsXMsE7JMB4TpmOSQL1qL0M_96meTJaDi3gEVMt_eqdYfJQMP7Jg7zOQDuMqVMnXRoStS8sOrKFN9aV9bPWJB-dQG8gtLiIeakYc Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 4c0fac9489e34375b8ecc267d00cbebd Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1283830896 Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c0fac9489e34375b8ecc267d00cbebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c0fac9489e34375b8ecc267d00cbebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c0fac9489e34375b8ecc267d00cbebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c0fac9489e34375b8ecc267d00cbebd"}]}] Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1283830896 Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 4c0fac9489e34375b8ecc267d00cbebd Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1283830896 Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TaggedBootDevicesTest_v242-1283830896-project Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9999a6c576f74271b47cec5e1336ec80 Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1283830896-project Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f'} Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:11.033374 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:11.038163 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:11.038163 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:11.038163 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:11.038163 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:11.038163 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:11.038163 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:11.038163 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:11.038163 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:11.041015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Returning 404 to user: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:11.043154 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59418b4e-1869-4d30-9249-4fb3efb702f0 tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 404 len: 111 microversion: 2.42 time: 0.101660 Oct 27 09:18:11.047689 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1979/3891] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:18:10 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:18:11.054621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c4970ef-59e2-46a6-b45a-05be155ed22c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '.version_select at 0x7f31a9c909d0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:11.082607 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c4970ef-59e2-46a6-b45a-05be155ed22c tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468443101" status: 204 len: 0 microversion: 2.42 time: 0.033509 Oct 27 09:18:11.083825 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1980/3892] 10.222.0.25 () {60 vars in 1259 bytes} [Thu Oct 27 09:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468443101 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:18:11.962940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:11.964030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:11.983015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:11.983925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:11.984801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:11.985816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:11.988820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:11.989518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:13.053250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:13.077389 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b19a5b09-b6ea-434b-acdb-a33bf94f1937 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 1.118573 Oct 27 09:18:13.079685 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1981/3893] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:11 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:13.269165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:18:13.270368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:18:13.271394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:18:13.272454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:18:13.273131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:18:13.315657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:13.329051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:13.329640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:13.335938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:13.337669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:13.339929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:13.360041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8c684244-7548-4b49-945f-7b66010035e4 req-07108bac-7a9d-4b32-a6ad-7c1943faf823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c62c154-2d25-411b-9e5c-fc0195fed8f0", "tag": "10d32d18-dfe2-4f10-9b9a-84d2ab8bb20b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:13.397072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:13.400689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Getting quotas for project d38e74f279374bfa9616ccd9d4133d01. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:18:13.403989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8c684244-7548-4b49-945f-7b66010035e4 req-07108bac-7a9d-4b32-a6ad-7c1943faf823 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:13.405373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8c684244-7548-4b49-945f-7b66010035e4 req-07108bac-7a9d-4b32-a6ad-7c1943faf823 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:13.407426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8c684244-7548-4b49-945f-7b66010035e4 req-07108bac-7a9d-4b32-a6ad-7c1943faf823 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:13.417286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Getting quotas for user c056afdc50124f2aa2656b4b59fd8698 and project d38e74f279374bfa9616ccd9d4133d01. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:18:13.438804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:13.441333 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8c684244-7548-4b49-945f-7b66010035e4 req-07108bac-7a9d-4b32-a6ad-7c1943faf823 service nova] Creating event network-changed:10d32d18-dfe2-4f10-9b9a-84d2ab8bb20b for instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 on n-h1-858383-16 Oct 27 09:18:13.443764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:18:13.446174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:18:13.462975 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8c684244-7548-4b49-945f-7b66010035e4 req-07108bac-7a9d-4b32-a6ad-7c1943faf823 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101580 Oct 27 09:18:13.465022 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1982/3894] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:13.527888 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4265dbcd-71ff-4cc0-9a8b-048bb65c9d6e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.276015 Oct 27 09:18:13.528634 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1913/3895] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:18:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:18:13.544934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eddc7ec5-3ecd-408e-ae0b-8fa7ace01388 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:13.545961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eddc7ec5-3ecd-408e-ae0b-8fa7ace01388 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:13.902117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eddc7ec5-3ecd-408e-ae0b-8fa7ace01388 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:13.926118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eddc7ec5-3ecd-408e-ae0b-8fa7ace01388 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1215 microversion: 2.1 time: 0.388889 Oct 27 09:18:13.927467 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1983/3896] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:13 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:14.109318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:14.114673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:14.138866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:14.143617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:14.148730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:14.153033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:14.153763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:14.155175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:14.954879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:14.956341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:14.960426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:15.005766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:15.008133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:15.009614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:15.012484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:15.016130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:15.020507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:15.041680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:15.436053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:15.453714 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a982934d-2388-4ceb-974c-2541e4a283e3 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1219 microversion: 2.1 time: 0.503990 Oct 27 09:18:15.470786 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1984/3897] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:14 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1219 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:15.756504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:15.771225 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4dcb5abf-48ad-4d05-9f1c-bd72db8c9245 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 1.667978 Oct 27 09:18:15.776421 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1914/3898] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:14 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:15.832714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7708225c-f8ee-4f82-a71e-75825f466ce0 req-55200bec-dea8-4e98-bbae-e75ee1f6384e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c16fd28-a6c7-4c72-910f-088304530f41", "tag": "4e31cc7a-ff3f-4251-ad1b-73e40bd34df4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:15.854363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7708225c-f8ee-4f82-a71e-75825f466ce0 req-55200bec-dea8-4e98-bbae-e75ee1f6384e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:15.855810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7708225c-f8ee-4f82-a71e-75825f466ce0 req-55200bec-dea8-4e98-bbae-e75ee1f6384e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:15.856508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7708225c-f8ee-4f82-a71e-75825f466ce0 req-55200bec-dea8-4e98-bbae-e75ee1f6384e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:15.911399 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7708225c-f8ee-4f82-a71e-75825f466ce0 req-55200bec-dea8-4e98-bbae-e75ee1f6384e service nova] Creating event network-changed:4e31cc7a-ff3f-4251-ad1b-73e40bd34df4 for instance 3c16fd28-a6c7-4c72-910f-088304530f41 on n-h2-858383-16 Oct 27 09:18:15.918912 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7708225c-f8ee-4f82-a71e-75825f466ce0 req-55200bec-dea8-4e98-bbae-e75ee1f6384e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089827 Oct 27 09:18:15.923604 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1915/3899] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:16.206372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Calling method '.version_select at 0x7f31a9e24c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:16.208435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:16.209051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:16.209569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:16.253591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:16.254339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:16.255296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:16.297039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:16.298363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:16.299094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:16.310672 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-93344bf2-724e-4fb8-8561-bb9c680bb89c tempest-PortsAdminExtendedAttrsTestJSON-1748906892 tempest-PortsAdminExtendedAttrsTestJSON-1748906892-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.584155 Oct 27 09:18:16.312444 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1985/3900] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:18:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:16.483428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:16.484615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:16.504795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:16.510111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:16.512274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:16.517934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:16.518363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:16.518809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:16.796288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:16.798611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:16.799251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:16.805830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:16.806137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:16.806590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:16.807331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:16.807848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:16.808276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:16.816301 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40827385-affb-44a9-be66-9ebaee937c3a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1273 microversion: 2.1 time: 0.341164 Oct 27 09:18:16.819216 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1916/3901] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:16 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1273 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:17.277059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:17.298815 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-95a5cbf7-f6ce-4ea8-b01f-41927e465501 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 0.504229 Oct 27 09:18:17.302900 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1986/3902] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:16 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:17.846427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:17.847096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:17.862117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:17.862676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:17.867244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:17.870074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:17.874585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:17.879008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:18.348805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:18.350098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:18.376040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:18.376873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:18.378079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:18.380046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:18.380982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:18.381631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:18.393965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:18.411301 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8aaab3ec-7f80-481f-980d-b3914b0e97a1 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1273 microversion: 2.1 time: 0.567904 Oct 27 09:18:18.411972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1917/3903] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:17 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1273 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:18.967558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:18.977629 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-51a1d67a-7660-4d13-b0e5-647459cf4f5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 0.635185 Oct 27 09:18:18.978476 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1987/3904] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:18 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:19.356266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:19.365514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:19.368485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Searching by: {'deleted': False, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:18:19.389278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:19.389699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:19.390143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:19.390877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:19.391340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:19.391806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:19.420747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:18:19.438082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:19.439414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:19.456583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:19.457804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:19.460645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:19.461675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:19.464714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:19.465436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:19.501733 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce768e0c-96d0-49fb-ab80-8460e5c02a1e tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.148385 Oct 27 09:18:19.503383 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1918/3905] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:18:19 2022] GET /compute/v2.1/servers => generated 333 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:19.524179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:19.534026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:19.535032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Searching by: {'deleted': False, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:18:19.563275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:19.566150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:19.569612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:19.570648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:19.572718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:19.573323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:19.631032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:18:19.709320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:19.724781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:19.729261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:19.730029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:19.812821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:19.828127 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-13505218-aded-428c-b2f9-b90c02c8b217 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1273 microversion: 2.1 time: 0.394644 Oct 27 09:18:19.828726 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1988/3906] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:19 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1273 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:20.004906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:20.005840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:20.014913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:20.015738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:20.016411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:20.024763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:20.025865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:20.026751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:20.389833 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-32860aa2-bc75-48b6-9c98-22e1c4bc273b tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.876003 Oct 27 09:18:20.390444 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1919/3907] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 09:18:19 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:20.420510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6320880-f8d1-491f-a9be-7055601b1f54 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:20.433584 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6320880-f8d1-491f-a9be-7055601b1f54 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017470 Oct 27 09:18:20.440152 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1920/3908] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:18:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:18:20.698279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:20.713496 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf76a7b1-f74e-4abd-9747-35e4e49065ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 0.712261 Oct 27 09:18:20.715179 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1989/3909] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:19 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:20.856275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:20.857126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:20.876764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:20.878532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:20.880571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:20.883490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:20.886048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:20.886510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:20.918398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:20.918920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:20.928706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:20.929211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:20.929660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:20.933472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:20.934031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:20.937266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:21.010427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:18:21.099933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:21.103075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:21.131455 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5307f5d-53da-47b2-949a-6ec85080ec5d tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1273 microversion: 2.1 time: 0.278995 Oct 27 09:18:21.144263 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1921/3910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:20 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1273 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:21.354407 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99b5664c-1393-41cc-a70b-38122bb9fe02 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 204 len: 0 microversion: 2.1 time: 0.439620 Oct 27 09:18:21.355196 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1990/3911] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:18:20 2022] DELETE /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:18:21.366590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:21.368203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:21.381353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:21.383238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:21.388213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:21.389289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:21.389973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:21.391057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:21.741675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:21.743739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:21.757524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:21.758305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:21.758902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:21.759837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:21.764689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:21.765409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:23.279265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:23.288244 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7aac878e-464b-4645-a4bf-0009b7e827a1 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1699 microversion: 2.1 time: 1.928157 Oct 27 09:18:23.288838 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1922/3912] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:21 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1699 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:23.315751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:23.316389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:23.326279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:23.330832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:23.331582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:23.333097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:23.333725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:23.336095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:23.598944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:23.625439 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b73b5f6-7ab8-42ae-8c28-da631e225fa9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 1.883232 Oct 27 09:18:23.627407 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1991/3913] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:21 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:23.963112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:23.978529 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8b6ab96-52a5-4876-b4ab-3f9213b17f45 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1315 microversion: 2.1 time: 0.678803 Oct 27 09:18:23.988163 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1923/3914] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:23 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:24.315164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:24.315930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:24.330523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:24.337321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:24.338015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:24.338555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:24.339532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:24.343766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:24.344485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:24.661433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:24.662097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:24.675052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:24.675553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:24.680651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:24.681640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:24.686197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:24.688213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:25.915415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:25.952514 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c9c5b71-eb9f-4e17-a7b9-ffe292dd039f tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1699 microversion: 2.1 time: 1.638678 Oct 27 09:18:25.965076 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1992/3915] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:24 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1699 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:26.239871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:26.261556 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-461a7bd3-e546-4b20-b886-6932ad6c25f7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 1.606725 Oct 27 09:18:26.262145 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1924/3916] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:24 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:26.278734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:26.292089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:26.299984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:26.322215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:26.332843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:26.333741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:26.337170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:26.339711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:26.340538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:26.465347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03ec5314-bfe9-48a8-b3f7-b1957aa0f431 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Action: 'create', calling method: .version_select at 0x7f31a930a040>, body: {"keypair": {"name": "tempest-keypair-1525138912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUVm/nAlCvfMftFbKHBlLEzKONXmOQjo902qCUa1JsErFrsYlU+NKjZu5aXlIU4fMbzqG/H/MKAXxBLP8OOS9LxHDO5UiowX6MRzvrO/LhHdZt8aVyu9mEr4ENh/oDBxw=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:26.505036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-03ec5314-bfe9-48a8-b3f7-b1957aa0f431 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Getting quotas for project 0c92a1c6ae774bea968e8e28ef72ff28. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:18:26.516673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-03ec5314-bfe9-48a8-b3f7-b1957aa0f431 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Getting quotas for user af0d8bc085d444839ae0c21401bafec3 and project 0c92a1c6ae774bea968e8e28ef72ff28. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:18:26.572617 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-03ec5314-bfe9-48a8-b3f7-b1957aa0f431 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.606277 Oct 27 09:18:26.574586 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1993/3917] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:18:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:26.585778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-eb091f2e-d217-4df0-87cb-8c271d535ea8 req-7fc678d0-bd48-424f-8da5-5584809abd1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7ca7a8-f803-4e34-a131-74b9216278ae", "tag": "9b39ea60-381c-4e1f-9193-bcf057dea5a1"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:26.599133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eb091f2e-d217-4df0-87cb-8c271d535ea8 req-7fc678d0-bd48-424f-8da5-5584809abd1d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:26.599805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eb091f2e-d217-4df0-87cb-8c271d535ea8 req-7fc678d0-bd48-424f-8da5-5584809abd1d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:26.600259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eb091f2e-d217-4df0-87cb-8c271d535ea8 req-7fc678d0-bd48-424f-8da5-5584809abd1d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:26.615756 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-eb091f2e-d217-4df0-87cb-8c271d535ea8 req-7fc678d0-bd48-424f-8da5-5584809abd1d service nova] Creating event network-changed:9b39ea60-381c-4e1f-9193-bcf057dea5a1 for instance 7c7ca7a8-f803-4e34-a131-74b9216278ae on n-h2-858383-16 Oct 27 09:18:26.632999 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-eb091f2e-d217-4df0-87cb-8c271d535ea8 req-7fc678d0-bd48-424f-8da5-5584809abd1d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056384 Oct 27 09:18:26.638827 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1994/3918] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:26.650500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:26.676764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:26.705490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:26.706177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:26.714254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:26.715106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:26.715937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:26.716461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:26.757328 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] HTTP exception thrown: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Request method failure captured: Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f HTTP/1.1 Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWksUrtUK4TheBs-85blZLRyFa4VdpYeehxemhFeC_QGFRdi1wamHwaxp0JLhKcWth9TL5k_rbNAHsXMsE7JMB4TpmOSQL1qL0M_96meTJaDi3gEVMt_eqdYfJQMP7Jg7zOQDuMqVMnXRoStS8sOrKFN9aV9bPWJB-dQG8gtLiIeakYc Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 4c0fac9489e34375b8ecc267d00cbebd Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1283830896 Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c0fac9489e34375b8ecc267d00cbebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c0fac9489e34375b8ecc267d00cbebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c0fac9489e34375b8ecc267d00cbebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c0fac9489e34375b8ecc267d00cbebd"}]}] Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1283830896 Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 4c0fac9489e34375b8ecc267d00cbebd Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1283830896 Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TaggedBootDevicesTest_v242-1283830896-project Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9999a6c576f74271b47cec5e1336ec80 Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1283830896-project Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f'} Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:26.760508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Returning 404 to user: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-68545201-39cc-46be-b87d-c88b47fef77a tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 404 len: 111 microversion: 2.42 time: 0.121989 Oct 27 09:18:26.768474 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1995/3919] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:18:26 2022] DELETE /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:18:26.784300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:26.785062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] [instance: 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:26.806724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:26.807232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:26.811068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:26.811871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:26.816371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:26.817123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:26.852398 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] HTTP exception thrown: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Request method failure captured: Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f HTTP/1.1 Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWksUrtUK4TheBs-85blZLRyFa4VdpYeehxemhFeC_QGFRdi1wamHwaxp0JLhKcWth9TL5k_rbNAHsXMsE7JMB4TpmOSQL1qL0M_96meTJaDi3gEVMt_eqdYfJQMP7Jg7zOQDuMqVMnXRoStS8sOrKFN9aV9bPWJB-dQG8gtLiIeakYc Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.42 Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 4c0fac9489e34375b8ecc267d00cbebd Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1283830896 Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c0fac9489e34375b8ecc267d00cbebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c0fac9489e34375b8ecc267d00cbebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c0fac9489e34375b8ecc267d00cbebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c0fac9489e34375b8ecc267d00cbebd"}]}] Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1283830896 Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 4c0fac9489e34375b8ecc267d00cbebd Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1283830896 Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TaggedBootDevicesTest_v242-1283830896-project Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9999a6c576f74271b47cec5e1336ec80 Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1283830896-project Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f'} Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.857535 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:26.861292 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.861292 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:26.861292 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:26.861292 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:26.861292 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:26.861292 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:26.861292 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. Oct 27 09:18:26.861292 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:26.865825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] Returning 404 to user: Instance 4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:26.866931 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bde63f38-16d2-47d7-875f-9af37cd95f5e tempest-TaggedBootDevicesTest_v242-1283830896 tempest-TaggedBootDevicesTest_v242-1283830896-project] 10.222.0.25 "GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f" status: 404 len: 111 microversion: 2.42 time: 0.094307 Oct 27 09:18:26.878079 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1996/3920] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:18:26 2022] GET /compute/v2.1/servers/4a5f3c6d-be4a-4123-8d0f-b64c3a24c45f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:18:26.981357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:26.985582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:27.004052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:27.005141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:27.006200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:27.007150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:27.008014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:27.008667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:27.211746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:27.232555 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-571f5ca6-8076-47be-8c54-b230707d2031 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1632 microversion: 2.1 time: 0.254622 Oct 27 09:18:27.236177 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1997/3921] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:26 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1632 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:27.262936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:27.288377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:27.289061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:27.294335 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8291e03-9600-4d44-aa4f-8a7cf7170145 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1315 microversion: 2.1 time: 1.030638 Oct 27 09:18:27.299957 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1925/3922] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:26 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1315 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:27.325814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:27.326479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:27.326964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:27.329956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:27.330555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:27.331013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:27.723503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e38ff562-3f04-4655-bbf4-ecd513301019 req-5da7a7ff-e9c8-4bb7-96b2-4a1b84dfdeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c62c154-2d25-411b-9e5c-fc0195fed8f0", "name": "network-vif-plugged", "status": "completed", "tag": "10d32d18-dfe2-4f10-9b9a-84d2ab8bb20b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:27.823598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e38ff562-3f04-4655-bbf4-ecd513301019 req-5da7a7ff-e9c8-4bb7-96b2-4a1b84dfdeb4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:27.826842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e38ff562-3f04-4655-bbf4-ecd513301019 req-5da7a7ff-e9c8-4bb7-96b2-4a1b84dfdeb4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:27.831249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e38ff562-3f04-4655-bbf4-ecd513301019 req-5da7a7ff-e9c8-4bb7-96b2-4a1b84dfdeb4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:27.906899 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e38ff562-3f04-4655-bbf4-ecd513301019 req-5da7a7ff-e9c8-4bb7-96b2-4a1b84dfdeb4 service nova] Creating event network-vif-plugged:10d32d18-dfe2-4f10-9b9a-84d2ab8bb20b for instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 on n-h1-858383-16 Oct 27 09:18:27.952002 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e38ff562-3f04-4655-bbf4-ecd513301019 req-5da7a7ff-e9c8-4bb7-96b2-4a1b84dfdeb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238465 Oct 27 09:18:27.959699 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1926/3923] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:28.113584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6e4d2e67-0bf4-479a-84ef-8625266a2ab4 req-27a66bd9-01e7-4c91-ab38-8b34c60b749a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a60576e-141a-41bf-9ab6-fce2f9edd488", "name": "network-vif-deleted", "tag": "460a6647-8986-42e5-af32-7778fac89207"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:28.191541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6e4d2e67-0bf4-479a-84ef-8625266a2ab4 req-27a66bd9-01e7-4c91-ab38-8b34c60b749a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:28.192558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6e4d2e67-0bf4-479a-84ef-8625266a2ab4 req-27a66bd9-01e7-4c91-ab38-8b34c60b749a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:28.206014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6e4d2e67-0bf4-479a-84ef-8625266a2ab4 req-27a66bd9-01e7-4c91-ab38-8b34c60b749a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:28.261297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:28.283942 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08e6be28-432f-48b4-8d75-8c58a553c7be tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 0.994969 Oct 27 09:18:28.284918 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1998/3924] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:27 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:28.287781 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6e4d2e67-0bf4-479a-84ef-8625266a2ab4 req-27a66bd9-01e7-4c91-ab38-8b34c60b749a service nova] Creating event network-vif-deleted:460a6647-8986-42e5-af32-7778fac89207 for instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 on n-h1-858383-16 Oct 27 09:18:28.318660 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6e4d2e67-0bf4-479a-84ef-8625266a2ab4 req-27a66bd9-01e7-4c91-ab38-8b34c60b749a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224704 Oct 27 09:18:28.318899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:28.325749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:28.344194 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1927/3925] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:28.372061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:28.373282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:28.374545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:28.380928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:28.383996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:28.384910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:28.385425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:28.392268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:28.427661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:28.432553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:28.433463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:28.444252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:28.445535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:28.446925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:28.553111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:28.557718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:28.565576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:28.569808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lazy-loading 'fault' on Instance uuid 6a60576e-141a-41bf-9ab6-fce2f9edd488 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:18:28.784196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6df849894f45e2816c749e222d84ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d261b7e9ea4fd384b5598854df8e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:28.798323 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-034e340c-af05-489e-a1d9-b2ee7b03feed tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 200 len: 1359 microversion: 2.1 time: 0.509777 Oct 27 09:18:28.804551 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 1999/3926] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:28 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 1359 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:29.333736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:29.335416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:29.357315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:29.358324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:29.360190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:29.361244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:29.372307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:29.387645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:29.597955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:29.706966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=16 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:30.069711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:30.089697 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-31181564-1a56-47c7-baf3-abefad66f304 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1315 microversion: 2.1 time: 1.743558 Oct 27 09:18:30.091171 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1928/3927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:28 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1315 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:30.096888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:30.103809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] [instance: 6a60576e-141a-41bf-9ab6-fce2f9edd488] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:30.117647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:30.118326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:30.118967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:30.121086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:30.122016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:30.124350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:30.137857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:30.151632 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-299e6fd5-1301-42fc-9bd0-581bd762b0b2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 0.822199 Oct 27 09:18:30.155733 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2000/3928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:29 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:30.171756 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] HTTP exception thrown: Instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 could not be found. Oct 27 09:18:30.173044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b7fda1cb-a12b-402f-a2a8-fde06ffcb308 req-4decf5f2-6a54-4695-a6a0-7a821bc39aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c16fd28-a6c7-4c72-910f-088304530f41", "name": "network-vif-plugged", "status": "completed", "tag": "4e31cc7a-ff3f-4251-ad1b-73e40bd34df4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Request method failure captured: Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 HTTP/1.1 Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkxyZlaMVrf0hhUg19pu8pRzQWZRoNdXIzcYViC5YpDQP-EZeeETD2nbBpVmMwoeZ7O3E8xutvtW__dMJ19onR70oma9do0G3CdFnbrrV7Nbx-D6WUDkgFlzGndB3R0LOKUXUCxGlsImFdMnX8c9ECLnpRY-ZWittjqtKpMql6f2PG4 Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: e2d261b7e9ea4fd384b5598854df8e3f Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1046103152 Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2d261b7e9ea4fd384b5598854df8e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2d261b7e9ea4fd384b5598854df8e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2d261b7e9ea4fd384b5598854df8e3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2d261b7e9ea4fd384b5598854df8e3f"}]}] Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1046103152 Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: e2d261b7e9ea4fd384b5598854df8e3f Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1046103152 Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1046103152-project Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 7f6df849894f45e2816c749e222d84ed Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1046103152-project Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 could not be found. Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '6a60576e-141a-41bf-9ab6-fce2f9edd488'} Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 could not be found. Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 could not be found. Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:30.181192 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:30.184844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:30.184844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:30.184844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:30.184844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:30.184844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:30.184844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 could not be found. Oct 27 09:18:30.184844 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:30.186721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Returning 404 to user: Instance 6a60576e-141a-41bf-9ab6-fce2f9edd488 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:30.190755 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf0a7b07-2696-4dd3-902c-dbb4ff30c387 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488" status: 404 len: 111 microversion: 2.1 time: 0.096375 Oct 27 09:18:30.192789 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1929/3929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:30 2022] GET /compute/v2.1/servers/6a60576e-141a-41bf-9ab6-fce2f9edd488 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:18:30.203913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b7fda1cb-a12b-402f-a2a8-fde06ffcb308 req-4decf5f2-6a54-4695-a6a0-7a821bc39aab service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:30.204420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b7fda1cb-a12b-402f-a2a8-fde06ffcb308 req-4decf5f2-6a54-4695-a6a0-7a821bc39aab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:30.204868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b7fda1cb-a12b-402f-a2a8-fde06ffcb308 req-4decf5f2-6a54-4695-a6a0-7a821bc39aab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:30.207663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d8706e4-3fa9-4ed4-9fd5-e7d0bea85100 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] Calling method '.version_select at 0x7f31aa22d8b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:30.238846 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b7fda1cb-a12b-402f-a2a8-fde06ffcb308 req-4decf5f2-6a54-4695-a6a0-7a821bc39aab service nova] Creating event network-vif-plugged:4e31cc7a-ff3f-4251-ad1b-73e40bd34df4 for instance 3c16fd28-a6c7-4c72-910f-088304530f41 on n-h2-858383-16 Oct 27 09:18:30.250838 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b7fda1cb-a12b-402f-a2a8-fde06ffcb308 req-4decf5f2-6a54-4695-a6a0-7a821bc39aab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089568 Oct 27 09:18:30.256886 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2001/3930] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:30.263410 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d8706e4-3fa9-4ed4-9fd5-e7d0bea85100 tempest-ServersTestJSON-1046103152 tempest-ServersTestJSON-1046103152-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878637727" status: 202 len: 0 microversion: 2.1 time: 0.066435 Oct 27 09:18:30.265081 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1930/3931] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 09:18:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878637727 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:18:31.128491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:31.131223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:31.156642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:31.165847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:31.166950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:31.168408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:31.170217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:31.174465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:31.188318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:31.190242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:31.239832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:31.240897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:31.241829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:31.243869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:31.244883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:31.248686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:31.270785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:32.062300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:32.077406 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19bec893-015e-46b3-8268-2ae4dff85ff0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1315 microversion: 2.1 time: 0.960073 Oct 27 09:18:32.092423 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2002/3932] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:31 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:32.112501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b4e9b8e8-0566-40b7-a9d7-10c267229092 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Action: 'create', calling method: .version_select at 0x7f31a9ca2dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-658964101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDMGYVVHJ7FMLDQP1jLvDOfkB3cqLDk2yzaqFd8JkaKHKoPLGjiCEd67zXFKasEOtZzJu5K8lfNDriVyiGcylNk/SuOSwB+PdYoXoLPwpz5sRo+USn59pgBP1kwkE5UHg=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:32.203063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-b4e9b8e8-0566-40b7-a9d7-10c267229092 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:18:32.223559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-b4e9b8e8-0566-40b7-a9d7-10c267229092 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for user 203ed8cc61274041ae7a9bb1ac09fd1a and project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:18:32.243969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:32.280737 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b99af20d-11bf-46f5-ab74-a2815313fa03 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1322 microversion: 2.1 time: 1.099338 Oct 27 09:18:32.287231 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1931/3933] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:31 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1322 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:32.330240 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b4e9b8e8-0566-40b7-a9d7-10c267229092 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.235977 Oct 27 09:18:32.334621 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2003/3934] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:18:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:33.109132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:33.110657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:33.130964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:33.136939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:33.138548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:33.140088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:33.151961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:33.153145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:33.332946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:33.341840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:33.378549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:33.379421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:33.386200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:33.397627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:33.403300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:33.407080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:34.262234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:34.301234 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71dd90df-6ba0-4cfb-9aad-9bea9274e76a tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1315 microversion: 2.1 time: 1.199801 Oct 27 09:18:34.316025 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1932/3935] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:33 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1315 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:34.407368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:34.421644 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c210f14-2d8e-47f9-b359-b04ccec61917 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1515 microversion: 2.1 time: 1.098076 Oct 27 09:18:34.443628 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2004/3936] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:33 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1515 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:34.465641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:34.482398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:34.507013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:34.511986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:34.513849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:34.517166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:34.519342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:34.521401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:34.620561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lazy-loading 'flavor' on Instance uuid 3c16fd28-a6c7-4c72-910f-088304530f41 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:18:34.898976 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-701bb8cd-3543-460c-b96d-51a8878f5035 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41/action" status: 200 len: 32 microversion: 2.1 time: 0.450879 Oct 27 09:18:34.906484 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1933/3937] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:18:34 2022] POST /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41/action => generated 32 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:18:34.915126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:34.920227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:34.943463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:34.945315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:34.950049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:34.951910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:34.952558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:34.953164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:35.131012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8b77b680-9a43-403d-a405-587fa68d055b"}], "security_groups": [{"name": "tempest-securitygroup--313790324"}], "key_name": "tempest-keypair-1525138912", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:36.406062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] validate_networks() for [('8b77b680-9a43-403d-a405-587fa68d055b', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:18:36.805698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:36.892041 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be013b2d-f7e3-4ca5-b6a5-74b77e38aa56 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 1.980094 Oct 27 09:18:36.896760 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2005/3938] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:34 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:36.958372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:36.960133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:36.997647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:37.007952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:37.011538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:37.019232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:37.021745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:37.023871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:38.112193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:38.172508 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6225bb7a-09f4-44d8-9f96-ed9ba7fc3505 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1315 microversion: 2.1 time: 1.263297 Oct 27 09:18:38.174745 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2006/3939] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:36 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1315 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:38.219667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6f5088eb-7bbd-448a-92fc-443490f22cd7 req-d9cca5f9-73a5-4538-87fd-ca088b438499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7ca7a8-f803-4e34-a131-74b9216278ae", "name": "network-vif-plugged", "status": "completed", "tag": "9b39ea60-381c-4e1f-9193-bcf057dea5a1"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:38.269343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6f5088eb-7bbd-448a-92fc-443490f22cd7 req-d9cca5f9-73a5-4538-87fd-ca088b438499 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:38.270818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6f5088eb-7bbd-448a-92fc-443490f22cd7 req-d9cca5f9-73a5-4538-87fd-ca088b438499 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:38.272048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6f5088eb-7bbd-448a-92fc-443490f22cd7 req-d9cca5f9-73a5-4538-87fd-ca088b438499 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:38.316206 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6f5088eb-7bbd-448a-92fc-443490f22cd7 req-d9cca5f9-73a5-4538-87fd-ca088b438499 service nova] Creating event network-vif-plugged:9b39ea60-381c-4e1f-9193-bcf057dea5a1 for instance 7c7ca7a8-f803-4e34-a131-74b9216278ae on n-h2-858383-16 Oct 27 09:18:38.376661 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6f5088eb-7bbd-448a-92fc-443490f22cd7 req-d9cca5f9-73a5-4538-87fd-ca088b438499 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196555 Oct 27 09:18:38.382795 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2007/3940] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:38.396289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:38.398728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:38.424707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:38.426430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:38.428385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:38.436013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:38.438262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:38.445632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:38.512401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:18:38.513011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:18:38.513511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:18:38.513938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:18:38.514360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:18:38.544147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:38.544667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:38.547997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:38.551520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:38.552220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:38.552689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:38.619964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Getting quotas for project 0c92a1c6ae774bea968e8e28ef72ff28. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:18:38.631752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Getting quotas for user af0d8bc085d444839ae0c21401bafec3 and project 0c92a1c6ae774bea968e8e28ef72ff28. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:18:38.684991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:18:38.690492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:18:38.808630 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f44c38b4-61aa-4bb3-b882-56dcb99693c9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.683711 Oct 27 09:18:38.816552 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1934/3941] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:18:35 2022] POST /compute/v2.1/servers => generated 408 bytes in 3707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:18:38.822310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d0ed285-b7bc-411c-8e67-ce35c398201d tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:38.822938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d0ed285-b7bc-411c-8e67-ce35c398201d tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:39.084455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5d0ed285-b7bc-411c-8e67-ce35c398201d tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:39.092947 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d0ed285-b7bc-411c-8e67-ce35c398201d tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1226 microversion: 2.1 time: 0.275145 Oct 27 09:18:39.111972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1935/3942] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:38 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1226 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:39.196276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:39.197294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:39.207729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:39.208748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:39.216220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:39.217369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:39.218003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:39.218588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:39.339817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:39.369402 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3d09b99c-646d-4d46-af91-db4f50321fa4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 0.983380 Oct 27 09:18:39.371209 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2008/3943] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:38 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:40.119533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:40.120319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:40.135169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:40.136625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:40.139233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:40.141115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:40.141698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:40.143488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:40.209237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:40.223626 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-925d9493-c81f-4fee-8546-1fa5bf5a19a2 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1315 microversion: 2.1 time: 1.031484 Oct 27 09:18:40.241917 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1936/3944] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:39 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1315 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:40.397982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:40.399427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:40.413175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:40.416029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:40.416908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:40.417975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:40.435112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:40.438136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:40.501742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:40.516360 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1d4f13cb-01a4-43df-b033-12e21520cb70 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1222 microversion: 2.1 time: 0.401397 Oct 27 09:18:40.522477 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2009/3945] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:40 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1222 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:40.532729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-243335018", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7b059241-c9d5-4759-8e82-f636fab8ba37"}], "key_name": "tempest-TestNetworkBasicOps-658964101", "security_groups": [{"name": "tempest-secgroup-smoke-1453713990"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:40.855538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] validate_networks() for [('7b059241-c9d5-4759-8e82-f636fab8ba37', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:18:41.195737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:41.205500 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca8d2c06-cb91-48a6-bf5f-f2d7b8e5a23f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 0.812412 Oct 27 09:18:41.206733 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1937/3946] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:40 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:41.266445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:41.268657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:41.285718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:41.286656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:41.288361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:41.294657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:41.295175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:41.295746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:41.814161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:41.832649 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4435ce3-a57f-45b4-a09c-7d4b0db3e3c0 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1502 microversion: 2.1 time: 0.570341 Oct 27 09:18:41.833590 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1938/3947] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:41 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1502 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:41.844099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:41.845002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:41.873558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:41.874074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:41.874527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:41.875261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:41.875769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:41.876207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:42.000385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:42.009043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a77488fe-cdba-447e-8fae-75a8bfe98ad7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1284 microversion: 2.1 time: 0.174370 Oct 27 09:18:42.020001 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1939/3948] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:41 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:42.041329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:42.042203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:42.070312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:42.072592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:42.073385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:42.081110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:42.081985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:42.083373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:42.125069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:18:42.148015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:42.257379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:42.274691 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a5ff11f-c4a6-44d7-8677-61bcac6b7197 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 204 len: 0 microversion: 2.1 time: 0.246683 Oct 27 09:18:42.275738 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1940/3949] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:18:42 2022] DELETE /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:18:42.287005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:42.289784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:42.298473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:42.299057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:42.299584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:42.300502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:42.301149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:42.301761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:42.572247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:18:42.576381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:18:42.576898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:18:42.577319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:18:42.577740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:18:42.595101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:42.596385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:42.597516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:42.598377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:42.598851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:42.601728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:42.641815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:18:42.654217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for user 203ed8cc61274041ae7a9bb1ac09fd1a and project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:18:42.663163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:42.675247 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8f599ad-fde5-4a66-a042-4897ad2857ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 0.397677 Oct 27 09:18:42.681530 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1941/3950] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:42 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:42.690918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:18:42.694280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:42.695526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:42.696592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:18:42.707608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:42.708281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:42.708891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:42.709715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:42.712515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:42.713862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:42.795507 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ff4740ca-f05d-4405-9a0e-464c6f0eefc0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.271315 Oct 27 09:18:42.800063 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2010/3951] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:18:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:18:42.807531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-541ce9d8-357f-4a42-a019-2c928f706d18 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:42.819410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-541ce9d8-357f-4a42-a019-2c928f706d18 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:42.821726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:43.021262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-541ce9d8-357f-4a42-a019-2c928f706d18 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:43.029272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-541ce9d8-357f-4a42-a019-2c928f706d18 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1247 microversion: 2.1 time: 0.225670 Oct 27 09:18:43.029878 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2011/3952] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:42 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1247 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:43.056598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:43.056598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:43.070098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:43.070675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:43.071128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:43.074604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:43.075134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:43.075617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:43.172457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:43.184752 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef1c5a01-4ff9-4987-ae9f-e3f8391ca65e tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1508 microversion: 2.1 time: 0.502018 Oct 27 09:18:43.188463 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1942/3953] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:42 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:43.233539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:43.248242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61d38599-cbed-4aa9-b04c-6293d6b9ad39 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1284 microversion: 2.1 time: 0.217230 Oct 27 09:18:43.249747 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2012/3954] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:43 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:43.710033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:43.711898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:43.723963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:43.724443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:43.724889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:43.731635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:43.733604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:43.733604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:44.053475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:44.073258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:44.074643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:44.078353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-147e1799-47c7-4a1b-9ada-ec077759bce4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 0.366438 Oct 27 09:18:44.082535 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1943/3955] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:43 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:44.087527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:44.090552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:44.091362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:44.092430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:44.093340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:44.094028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:44.212468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:44.213083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:44.223906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:44.224322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:44.224770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:44.229930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:44.230426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:44.230872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:44.242810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:44.256359 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-52ba25f2-ff58-4a25-a947-684e3a916c25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1299 microversion: 2.1 time: 0.187347 Oct 27 09:18:44.256955 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2013/3956] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:44 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:44.275757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:44.276615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:44.296007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:44.296787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:44.297381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:44.298256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:44.298859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:44.299721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:44.493055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:44.504685 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2aa9f82a-84b9-40e0-b3b6-c08c4ad0e741 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1284 microversion: 2.1 time: 0.234890 Oct 27 09:18:44.520639 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2014/3957] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:44 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:44.838568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:44.862835 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f2e6915-47e8-4df9-a65e-2e18edbc13ee tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1508 microversion: 2.1 time: 0.653646 Oct 27 09:18:44.902707 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1944/3958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:44 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1508 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:45.107633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:45.108348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:45.115709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:45.116319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:45.117732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:45.118596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:45.119147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:45.120079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:45.287389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:45.289749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:45.306733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:45.310661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:45.312917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:45.313929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:45.317075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:45.317800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:45.945954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:45.967600 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3453c14-7792-499f-b827-8beaae1fc58b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1305 microversion: 2.1 time: 0.681737 Oct 27 09:18:45.970219 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1945/3959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:45 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1305 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:45.995400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:45.997626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:46.019180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:46.020037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:46.020830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:46.022195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:46.024057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:46.025024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:46.656025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:46.674265 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ad7beee-6046-4105-b4ed-9dc7cea648ac tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 1.570704 Oct 27 09:18:46.676385 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2015/3960] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:45 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:46.683228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:46.684314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:46.698213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:46.699006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:46.699694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:46.701121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:46.701905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:46.702607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:46.748275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:46.764455 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2620869c-d8a0-4397-961e-7df7e2ae678c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1351 microversion: 2.1 time: 0.790313 Oct 27 09:18:46.765305 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1946/3961] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:45 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1351 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:46.770278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cee6d3eb-0508-44fe-b6d6-208667eeaf36 req-f661f624-6808-4dcd-a4e6-ac12cfdd4b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7ca7a8-f803-4e34-a131-74b9216278ae", "name": "network-vif-deleted", "tag": "9b39ea60-381c-4e1f-9193-bcf057dea5a1"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:46.797645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cee6d3eb-0508-44fe-b6d6-208667eeaf36 req-f661f624-6808-4dcd-a4e6-ac12cfdd4b8d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:46.798514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cee6d3eb-0508-44fe-b6d6-208667eeaf36 req-f661f624-6808-4dcd-a4e6-ac12cfdd4b8d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:46.799114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cee6d3eb-0508-44fe-b6d6-208667eeaf36 req-f661f624-6808-4dcd-a4e6-ac12cfdd4b8d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:46.816521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:46.818842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:46.820094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:46.820729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lazy-loading 'fault' on Instance uuid 7c7ca7a8-f803-4e34-a131-74b9216278ae {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:18:46.836681 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cee6d3eb-0508-44fe-b6d6-208667eeaf36 req-f661f624-6808-4dcd-a4e6-ac12cfdd4b8d service nova] Creating event network-vif-deleted:9b39ea60-381c-4e1f-9193-bcf057dea5a1 for instance 7c7ca7a8-f803-4e34-a131-74b9216278ae on n-h2-858383-16 Oct 27 09:18:46.844961 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cee6d3eb-0508-44fe-b6d6-208667eeaf36 req-f661f624-6808-4dcd-a4e6-ac12cfdd4b8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077865 Oct 27 09:18:46.846046 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1947/3962] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:46.980210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c056afdc50124f2aa2656b4b59fd8698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38e74f279374bfa9616ccd9d4133d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:46.989148 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-65b7150c-61a6-4050-add9-5b6b4cd41e61 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 200 len: 1305 microversion: 2.1 time: 0.311468 Oct 27 09:18:46.989763 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2016/3963] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:46 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 1305 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:47.016671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:47.017998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:47.035386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:47.036020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:47.036471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:47.037453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:47.037991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:47.038596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:47.239812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:47.254029 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc7c7819-ffdf-48bc-b6f4-2a455ac81e42 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1305 microversion: 2.1 time: 0.241112 Oct 27 09:18:47.257075 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1948/3964] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:47 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1305 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:47.698869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:47.700378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:47.725170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:47.725911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:47.727336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:47.729024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:47.730480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:47.732838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:47.791902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:47.792849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:47.816704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:47.817225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:47.817680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:47.818406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:47.818872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:47.819307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.356731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:48.371162 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b67a82d-de61-4896-bb3d-7df148db407f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 0.677220 Oct 27 09:18:48.372008 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2017/3965] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:47 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:48.381268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:48.386053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:48.411047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.411981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.412663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.414067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.414759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.415442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.448546 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] HTTP exception thrown: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Request method failure captured: Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae HTTP/1.1 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkzQJyX8Disk4surrpx1oMSY_ydcRSr01kwXkUnXCHQDJV3vg4f1frgmlcjEQjTl3vGTo0g9WZC48YIBk-vUfd0M9T5N5hsJpxqETjt6WFO_-FLWXfotXYcOUSsDtZfCRXAQqwv6PNN61TBLxHUMMCYBRq3uQEivCRy9D6cCIBaA6hM Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d38e74f279374bfa9616ccd9d4133d01"}]}] Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c056afdc50124f2aa2656b4b59fd8698 Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7c7ca7a8-f803-4e34-a131-74b9216278ae'} Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.452080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.455894 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.455894 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.455894 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.455894 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:48.455894 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:48.455894 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.455894 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.455894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Returning 404 to user: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:48.461398 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e6b2ce3-4ae3-4427-841d-f12ac3873888 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 404 len: 111 microversion: 2.1 time: 0.080166 Oct 27 09:18:48.466914 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2018/3966] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:48 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:18:48.483661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:48.486909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:48.493647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:48.504836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.508666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.511065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.512911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.513733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.514651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.516206 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77ad8ff7-1f82-4c6d-9178-02ce1a08804b tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1351 microversion: 2.1 time: 0.718801 Oct 27 09:18:48.519005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1949/3967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:47 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1351 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:48.538735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1266685444", "metadata": {"image_type": "test"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:48.550437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:48.580114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.580622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.581074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.587462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.593411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.593928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.594571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:48.621176 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] HTTP exception thrown: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Request method failure captured: Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae/action HTTP/1.1 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 112 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzQJyX8Disk4surrpx1oMSY_ydcRSr01kwXkUnXCHQDJV3vg4f1frgmlcjEQjTl3vGTo0g9WZC48YIBk-vUfd0M9T5N5hsJpxqETjt6WFO_-FLWXfotXYcOUSsDtZfCRXAQqwv6PNN61TBLxHUMMCYBRq3uQEivCRy9D6cCIBaA6hM Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d38e74f279374bfa9616ccd9d4133d01"}]}] Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c056afdc50124f2aa2656b4b59fd8698 Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1266685444", "metadata": {"image_type": "test"}}} Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7c7ca7a8-f803-4e34-a131-74b9216278ae', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1266685444', 'metadata': {'image_type': 'test'}}}} Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 09:18:48.623542 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.627463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.655423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Returning 404 to user: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:48.657762 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-829a2f7f-a9aa-48ef-aefb-e97be65fcd24 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "POST /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae/action" status: 404 len: 111 microversion: 2.1 time: 0.137399 Oct 27 09:18:48.658870 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1950/3968] 10.222.0.25 () {60 vars in 1279 bytes} [Thu Oct 27 09:18:48 2022] POST /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae/action => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:18:48.671336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0e3116c-7e16-4620-a78d-a5f5580da085 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1769298826", "metadata": {"image_type": "test"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:48.674706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0e3116c-7e16-4620-a78d-a5f5580da085 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Failed to fetch instance by id tempest-invalid-918056375 {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 09:18:48.681364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d0e3116c-7e16-4620-a78d-a5f5580da085 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] HTTP exception thrown: Instance tempest-invalid-918056375 could not be found. Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0e3116c-7e16-4620-a78d-a5f5580da085 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Request method failure captured: Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/tempest-invalid-918056375/action HTTP/1.1 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 112 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzQJyX8Disk4surrpx1oMSY_ydcRSr01kwXkUnXCHQDJV3vg4f1frgmlcjEQjTl3vGTo0g9WZC48YIBk-vUfd0M9T5N5hsJpxqETjt6WFO_-FLWXfotXYcOUSsDtZfCRXAQqwv6PNN61TBLxHUMMCYBRq3uQEivCRy9D6cCIBaA6hM Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d38e74f279374bfa9616ccd9d4133d01"}]}] Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c056afdc50124f2aa2656b4b59fd8698 Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1769298826", "metadata": {"image_type": "test"}}} Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance tempest-invalid-918056375 could not be found. Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'tempest-invalid-918056375', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1769298826', 'metadata': {'image_type': 'test'}}}} Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-918056375 could not be found. Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:48.683353 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-918056375 could not be found. Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-918056375 could not be found. Oct 27 09:18:48.686852 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.689097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0e3116c-7e16-4620-a78d-a5f5580da085 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Returning 404 to user: Instance tempest-invalid-918056375 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:48.690110 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0e3116c-7e16-4620-a78d-a5f5580da085 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-918056375/action" status: 404 len: 100 microversion: 2.1 time: 0.023085 Oct 27 09:18:48.691496 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1951/3969] 10.222.0.25 () {60 vars in 1246 bytes} [Thu Oct 27 09:18:48 2022] POST /compute/v2.1/servers/tempest-invalid-918056375/action => generated 100 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:18:48.703637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1386e27-234f-4096-bcd5-851215e028dd tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1022320815"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:48.706195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1386e27-234f-4096-bcd5-851215e028dd tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 09:18:48.706719 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f1386e27-234f-4096-bcd5-851215e028dd tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1386e27-234f-4096-bcd5-851215e028dd tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Request method failure captured: Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 57 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzQJyX8Disk4surrpx1oMSY_ydcRSr01kwXkUnXCHQDJV3vg4f1frgmlcjEQjTl3vGTo0g9WZC48YIBk-vUfd0M9T5N5hsJpxqETjt6WFO_-FLWXfotXYcOUSsDtZfCRXAQqwv6PNN61TBLxHUMMCYBRq3uQEivCRy9D6cCIBaA6hM Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d38e74f279374bfa9616ccd9d4133d01"}]}] Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c056afdc50124f2aa2656b4b59fd8698 Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: {"createImage": {"name": "tempest-test-snap-1022320815"}} Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1022320815'}}} Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.708295 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.712241 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.712241 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.712241 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.712241 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.712241 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.712241 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:48.712241 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:48.712241 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.712241 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.714935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1386e27-234f-4096-bcd5-851215e028dd tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:48.716068 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1386e27-234f-4096-bcd5-851215e028dd tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.017469 Oct 27 09:18:48.716809 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1952/3970] 10.222.0.25 () {60 vars in 1275 bytes} [Thu Oct 27 09:18:48 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:18:48.733601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c616c8d-72ca-4625-a46c-df945cce4288 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1119469643"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:48.736331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c616c8d-72ca-4625-a46c-df945cce4288 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 09:18:48.737269 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-2c616c8d-72ca-4625-a46c-df945cce4288 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c616c8d-72ca-4625-a46c-df945cce4288 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Request method failure captured: Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 57 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzQJyX8Disk4surrpx1oMSY_ydcRSr01kwXkUnXCHQDJV3vg4f1frgmlcjEQjTl3vGTo0g9WZC48YIBk-vUfd0M9T5N5hsJpxqETjt6WFO_-FLWXfotXYcOUSsDtZfCRXAQqwv6PNN61TBLxHUMMCYBRq3uQEivCRy9D6cCIBaA6hM Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d38e74f279374bfa9616ccd9d4133d01"}]}] Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c056afdc50124f2aa2656b4b59fd8698 Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: {"createImage": {"name": "tempest-test-snap-1119469643"}} Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1119469643'}}} Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.740299 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.744236 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.744236 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.744236 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.744236 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.744236 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.744236 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:48.744236 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:48.744236 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 27 09:18:48.744236 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.747369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c616c8d-72ca-4625-a46c-df945cce4288 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:48.749070 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c616c8d-72ca-4625-a46c-df945cce4288 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.022889 Oct 27 09:18:48.750274 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1953/3971] 10.222.0.25 () {60 vars in 1281 bytes} [Thu Oct 27 09:18:48 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:18:48.761958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:48.765658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:48.783149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.786518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.787757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.792029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.795888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.796835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.842318 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] HTTP exception thrown: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Request method failure captured: Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae HTTP/1.1 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzQJyX8Disk4surrpx1oMSY_ydcRSr01kwXkUnXCHQDJV3vg4f1frgmlcjEQjTl3vGTo0g9WZC48YIBk-vUfd0M9T5N5hsJpxqETjt6WFO_-FLWXfotXYcOUSsDtZfCRXAQqwv6PNN61TBLxHUMMCYBRq3uQEivCRy9D6cCIBaA6hM Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d38e74f279374bfa9616ccd9d4133d01"}]}] Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c056afdc50124f2aa2656b4b59fd8698 Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7c7ca7a8-f803-4e34-a131-74b9216278ae'} Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:48.859669 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Returning 404 to user: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:48.867035 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e48352d0-c65e-4394-b3d5-f190078f3627 tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 404 len: 111 microversion: 2.1 time: 0.103075 Oct 27 09:18:48.874179 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1954/3972] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:18:48 2022] DELETE /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:18:48.886029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:48.886912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] [instance: 7c7ca7a8-f803-4e34-a131-74b9216278ae] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:48.901527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.902023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.905854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.906731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.907220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.908925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:48.959953 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] HTTP exception thrown: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Request method failure captured: Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae HTTP/1.1 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzQJyX8Disk4surrpx1oMSY_ydcRSr01kwXkUnXCHQDJV3vg4f1frgmlcjEQjTl3vGTo0g9WZC48YIBk-vUfd0M9T5N5hsJpxqETjt6WFO_-FLWXfotXYcOUSsDtZfCRXAQqwv6PNN61TBLxHUMMCYBRq3uQEivCRy9D6cCIBaA6hM Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d38e74f279374bfa9616ccd9d4133d01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d38e74f279374bfa9616ccd9d4133d01"}]}] Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d38e74f279374bfa9616ccd9d4133d01 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1349241826 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c056afdc50124f2aa2656b4b59fd8698 Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesNegativeTestJSON-1349241826-project Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7c7ca7a8-f803-4e34-a131-74b9216278ae'} Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:48.961587 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.966710 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:48.966710 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:48.966710 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:48.966710 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:48.966710 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:48.966710 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. Oct 27 09:18:48.966710 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:18:48.966710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] Returning 404 to user: Instance 7c7ca7a8-f803-4e34-a131-74b9216278ae could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:48.966710 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a0d622e-b101-4fff-96bb-6d0621ae215c tempest-ImagesNegativeTestJSON-1349241826 tempest-ImagesNegativeTestJSON-1349241826-project] 10.222.0.25 "GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae" status: 404 len: 111 microversion: 2.1 time: 0.087841 Oct 27 09:18:48.968003 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1955/3973] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:48 2022] GET /compute/v2.1/servers/7c7ca7a8-f803-4e34-a131-74b9216278ae => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:18:48.973380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ed313e69-4b85-4d27-a46c-030f54929f21 req-eedf8f2d-a93b-44b7-afa5-00d993fa3628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7793923e-d34b-4c64-93fb-e6c613e415f8", "tag": "03066d75-6d26-4720-8434-0925e64350a3"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:48.984519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ed313e69-4b85-4d27-a46c-030f54929f21 req-eedf8f2d-a93b-44b7-afa5-00d993fa3628 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:48.985191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ed313e69-4b85-4d27-a46c-030f54929f21 req-eedf8f2d-a93b-44b7-afa5-00d993fa3628 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:48.985770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ed313e69-4b85-4d27-a46c-030f54929f21 req-eedf8f2d-a93b-44b7-afa5-00d993fa3628 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:49.000487 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ed313e69-4b85-4d27-a46c-030f54929f21 req-eedf8f2d-a93b-44b7-afa5-00d993fa3628 service nova] Creating event network-changed:03066d75-6d26-4720-8434-0925e64350a3 for instance 7793923e-d34b-4c64-93fb-e6c613e415f8 on n-h1-858383-16 Oct 27 09:18:49.007507 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ed313e69-4b85-4d27-a46c-030f54929f21 req-eedf8f2d-a93b-44b7-afa5-00d993fa3628 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037017 Oct 27 09:18:49.008497 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1956/3974] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:49.130171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:49.139053 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a6fb5ac-112a-4b88-b57d-cefb73aa26c0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 0.670776 Oct 27 09:18:49.155885 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2019/3975] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:48 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:49.445540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:49.446341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:49.456054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:49.461065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:49.464406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:49.464893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:49.465649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:49.466121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:49.466553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:49.561180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:49.561875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:49.569149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:49.569715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:49.570169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:49.572520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:49.572997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:49.573431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:50.046926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:50.056887 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ebfbf10-fbde-4beb-8040-ae3d8c98e5d1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1351 microversion: 2.1 time: 0.499861 Oct 27 09:18:50.058369 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2020/3976] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:49 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1351 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:50.092866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:50.110985 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-836e3273-5c1b-4344-bd54-fd622064f39a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 0.667158 Oct 27 09:18:50.113422 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1957/3977] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:49 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:50.163484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:50.164790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:50.181623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:50.182393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:50.183000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:50.184235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:50.184900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:50.185523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:50.684040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:50.718312 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-594e9e13-a518-4831-a681-14fc1d2396d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 0.558957 Oct 27 09:18:50.718915 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2021/3978] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:50 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:51.101467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:51.102087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:51.110903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:51.111844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:51.113228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:51.114180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:51.118538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:51.119281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:51.150876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:51.151734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:51.172340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:51.173287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:51.173287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:51.173903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:51.174367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:51.174908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:52.058381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:52.073537 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6e9f644-b447-486f-ac39-b06f839d0dcc tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1351 microversion: 2.1 time: 0.975901 Oct 27 09:18:52.074463 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1958/3979] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:51 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1351 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:52.081568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:52.088827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:52.098872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:52.101865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:52.105415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:52.106419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:52.107120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:52.113330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:52.137773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:52.140401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:52.150442 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43759eaa-4a97-4c6c-92d9-41567eaa60e5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 1.004189 Oct 27 09:18:52.153148 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2022/3980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:51 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:52.486137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:52.506006 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d82eaec4-c697-4001-8193-f4f5aa044cc9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 0.423797 Oct 27 09:18:52.508334 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1959/3981] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:52 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:53.109194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:53.109825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:53.115880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:53.121102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:53.146626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:53.147175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:53.150273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:53.154385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:53.156332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:53.157255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:53.177597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:53.179490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:53.197413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:53.198283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:53.202058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:53.203171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:53.204053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:53.204703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:54.253924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:54.266903 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-737cab8a-6754-4de3-80bd-dbe025b86586 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1351 microversion: 2.1 time: 1.161844 Oct 27 09:18:54.274067 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2023/3982] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:53 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1351 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:54.306363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0ad77705-3759-494a-a21d-9bdf8ec789c8 req-56f4197b-6282-45bf-8933-4cca4ce18d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4e9885-d7af-4bea-be6f-bc3195d71fca", "tag": "2f5a9bc2-a844-477b-9146-0ff99bef10a8"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:54.311906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:54.331370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c50cb439-858f-4c7e-8bb1-9782446cad95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 1.157760 Oct 27 09:18:54.338067 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1960/3983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:53 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:54.363177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:54.370918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0ad77705-3759-494a-a21d-9bdf8ec789c8 req-56f4197b-6282-45bf-8933-4cca4ce18d88 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:54.374856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:54.379651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0ad77705-3759-494a-a21d-9bdf8ec789c8 req-56f4197b-6282-45bf-8933-4cca4ce18d88 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:54.381856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0ad77705-3759-494a-a21d-9bdf8ec789c8 req-56f4197b-6282-45bf-8933-4cca4ce18d88 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:54.398039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:54.398889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:54.404331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:54.406024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:54.407868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:54.411071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:54.419532 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0ad77705-3759-494a-a21d-9bdf8ec789c8 req-56f4197b-6282-45bf-8933-4cca4ce18d88 service nova] Creating event network-changed:2f5a9bc2-a844-477b-9146-0ff99bef10a8 for instance fa4e9885-d7af-4bea-be6f-bc3195d71fca on n-h1-858383-16 Oct 27 09:18:54.427010 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0ad77705-3759-494a-a21d-9bdf8ec789c8 req-56f4197b-6282-45bf-8933-4cca4ce18d88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150998 Oct 27 09:18:54.427965 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2024/3984] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:55.301540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:55.302734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:55.335499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:55.337000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:55.337959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:55.339399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:55.340351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:55.341276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:55.464350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:55.475052 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f58eda50-d0a5-4cf9-933e-73d259a6fb4b tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 1.135459 Oct 27 09:18:55.476845 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1961/3985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:54 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:55.482394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:55.483444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:55.491536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:55.507418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:55.516434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:55.518829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:55.526374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:55.527188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:55.583661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:56.212660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:56.226834 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f58437ee-7ca9-413d-a622-52fa48dc42a1 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1351 microversion: 2.1 time: 0.931129 Oct 27 09:18:56.227758 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2025/3986] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:55 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1351 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:56.236253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-35fb7b56-489c-48a8-b7cb-ad7b2ff188db req-c0677567-8037-4c5b-abb0-b6e0d62986a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7793923e-d34b-4c64-93fb-e6c613e415f8", "name": "network-vif-plugged", "status": "completed", "tag": "03066d75-6d26-4720-8434-0925e64350a3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:56.251540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-35fb7b56-489c-48a8-b7cb-ad7b2ff188db req-c0677567-8037-4c5b-abb0-b6e0d62986a7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:56.257710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-35fb7b56-489c-48a8-b7cb-ad7b2ff188db req-c0677567-8037-4c5b-abb0-b6e0d62986a7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:56.258513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-35fb7b56-489c-48a8-b7cb-ad7b2ff188db req-c0677567-8037-4c5b-abb0-b6e0d62986a7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:56.282782 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-35fb7b56-489c-48a8-b7cb-ad7b2ff188db req-c0677567-8037-4c5b-abb0-b6e0d62986a7 service nova] Creating event network-vif-plugged:03066d75-6d26-4720-8434-0925e64350a3 for instance 7793923e-d34b-4c64-93fb-e6c613e415f8 on n-h1-858383-16 Oct 27 09:18:56.290247 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-35fb7b56-489c-48a8-b7cb-ad7b2ff188db req-c0677567-8037-4c5b-abb0-b6e0d62986a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060794 Oct 27 09:18:56.295162 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2026/3987] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:18:56.451722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:56.464394 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6332b3b2-5907-4fbb-8ded-b024a8b5d44f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1521 microversion: 2.1 time: 0.986458 Oct 27 09:18:56.468709 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1962/3988] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:55 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1521 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:56.506306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:56.507585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:56.525392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:56.526149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:56.527021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:56.528176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:56.528945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:56.529525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:57.052070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:57.080211 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5aa29c72-a9fe-437a-9650-f6bb3ce12e02 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 0.578424 Oct 27 09:18:57.083289 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2027/3989] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:56 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:57.252661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:57.253296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:57.256433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:18:57.263537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:57.264447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:57.265108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:57.266107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:57.266794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:57.267461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:57.489391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:57.490216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:57.498412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:57.499700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:57.500412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:57.501401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:57.502133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:57.502787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:57.993926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:58.005270 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-707b6593-82cd-4b2e-8f7a-0c5668ce0bfe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1501 microversion: 2.1 time: 0.519652 Oct 27 09:18:58.020661 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2028/3990] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:57 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1501 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:18:58.032017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:58.033716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:58.042677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:58.043365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:58.044232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:58.045353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:58.045977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:58.046891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:58.091771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:58.110639 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-061b31a7-5187-4f2a-b315-76a680a627e8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1351 microversion: 2.1 time: 0.857507 Oct 27 09:18:58.114232 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1963/3991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:57 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1351 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:58.132509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:58.132509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:58.148285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:58.149890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:58.152369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:58.154859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:58.156748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:58.158678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:58.969946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:58.981553 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9bb6abc6-07cb-4505-b535-2c941112b5a1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1516 microversion: 2.1 time: 0.955698 Oct 27 09:18:58.999801 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2029/3992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:58 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1516 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:59.011445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2dbaa737-a1b1-436b-8625-7dd7410a3994 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:59.012796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:18:59.015193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2dbaa737-a1b1-436b-8625-7dd7410a3994 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 71e96d3f-6318-4f3d-ada8-431a6357db92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:59.022600 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-2dbaa737-a1b1-436b-8625-7dd7410a3994 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] HTTP exception thrown: Instance 71e96d3f-6318-4f3d-ada8-431a6357db92 could not be found. Oct 27 09:18:59.022794 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-75230748-6ae4-4d30-95dc-0ff618455c6f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 0.903656 Oct 27 09:18:59.026032 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1964/3993] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:58 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2dbaa737-a1b1-436b-8625-7dd7410a3994 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Request method failure captured: Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/71e96d3f-6318-4f3d-ada8-431a6357db92/action HTTP/1.1 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 14 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkzDycu2zrvEyACIIrQoHV06Jd0It45Rv0F2xQOPM2wSnWHcd2-qrADZYvnaOYh5v8cskDBIeRUmgZuL2fU3btGeQcZ_Q6fTjrMtyd25Sz9aShgYNBtDFz-Hs50Qjx2g1J9zbfldbysO0umRvOL_OrzT1jkVjcfTyFj5P-3m0Jht0Qc Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e28707cf49b24806879ae5acd0e08cf3"}]}] Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c6165562b6e14ff18dc7d82b8c9a46b3 Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: {"rescue": {}} Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 71e96d3f-6318-4f3d-ada8-431a6357db92 could not be found. Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '71e96d3f-6318-4f3d-ada8-431a6357db92', 'body': {'rescue': {}}} Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e96d3f-6318-4f3d-ada8-431a6357db92 could not be found. Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e96d3f-6318-4f3d-ada8-431a6357db92 could not be found. Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:59.039692 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:18:59.044034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:18:59.044034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:18:59.044034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:18:59.044034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:18:59.044034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e96d3f-6318-4f3d-ada8-431a6357db92 could not be found. Oct 27 09:18:59.044034 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:18:59.044034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2dbaa737-a1b1-436b-8625-7dd7410a3994 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Returning 404 to user: Instance 71e96d3f-6318-4f3d-ada8-431a6357db92 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:18:59.049875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2dbaa737-a1b1-436b-8625-7dd7410a3994 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/71e96d3f-6318-4f3d-ada8-431a6357db92/action" status: 404 len: 111 microversion: 2.1 time: 0.039800 Oct 27 09:18:59.053213 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2030/3994] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:18:59 2022] POST /compute/v2.1/servers/71e96d3f-6318-4f3d-ada8-431a6357db92/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:18:59.063104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11fc21c0-cf19-4770-a8ef-beff4ccfbc59 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:18:59.063889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11fc21c0-cf19-4770-a8ef-beff4ccfbc59 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:59.071463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11fc21c0-cf19-4770-a8ef-beff4ccfbc59 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:59.071990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11fc21c0-cf19-4770-a8ef-beff4ccfbc59 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:59.072437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11fc21c0-cf19-4770-a8ef-beff4ccfbc59 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:59.073288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11fc21c0-cf19-4770-a8ef-beff4ccfbc59 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:59.073750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11fc21c0-cf19-4770-a8ef-beff4ccfbc59 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:59.074172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11fc21c0-cf19-4770-a8ef-beff4ccfbc59 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:59.140129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:59.140762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:59.158286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:59.159448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:59.160158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:59.164275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:59.166115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:59.167120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:59.176282 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11fc21c0-cf19-4770-a8ef-beff4ccfbc59 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action" status: 202 len: 0 microversion: 2.1 time: 0.117060 Oct 27 09:18:59.180215 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1965/3995] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:18:59 2022] POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:18:59.187984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:18:59.188696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:18:59.207708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:59.209386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:59.211598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:18:59.212591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:18:59.214702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:18:59.215368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:00.255049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:00.272058 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80b91eb0-b17d-49d2-879c-394be1db70cd tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1351 microversion: 2.1 time: 1.135540 Oct 27 09:19:00.274082 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2031/3996] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:59 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1351 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:00.283689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:00.284680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:00.297404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:00.306241 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc4ad83e-74a5-48f5-9bc0-b0c6f35d51cf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1521 microversion: 2.1 time: 1.124691 Oct 27 09:19:00.309024 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1966/3997] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:18:59 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1521 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:00.310764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:00.311346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:00.311898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:00.313136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:00.313675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:00.314353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:00.748126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:00.758898 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7e48d494-4b93-4568-aae5-4a90ec616cfc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 0.483411 Oct 27 09:19:00.771597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2032/3998] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:00 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:01.304666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:01.317366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:01.348558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:01.349173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:01.352370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:01.353474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:01.354514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:01.355987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:01.357758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:01.358549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:01.361427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:01.361966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:01.362427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:01.363186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:01.363722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:01.364162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:02.707395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:02.718013 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-321ab32a-82f2-4e98-ac76-2d4c5511dae1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1501 microversion: 2.1 time: 1.383872 Oct 27 09:19:02.722820 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2033/3999] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:01 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1501 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:02.739676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:02.740550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:02.750189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:02.750953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:02.751605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:02.752532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:02.753181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:02.754043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:02.934638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:02.948466 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbf298c8-1152-4800-aec1-c7432858d8b7 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1542 microversion: 2.1 time: 1.653417 Oct 27 09:19:02.949179 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1967/4000] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:01 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1542 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:02.965186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:02.968266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:02.980464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:02.986242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:02.986834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:02.987761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:02.988403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:02.989017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:03.045049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lazy-loading 'flavor' on Instance uuid 7c62c154-2d25-411b-9e5c-fc0195fed8f0 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:19:03.066325 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] HTTP exception thrown: Cannot 'rescue' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state paused Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Request method failure captured: Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action HTTP/1.1 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 14 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzDycu2zrvEyACIIrQoHV06Jd0It45Rv0F2xQOPM2wSnWHcd2-qrADZYvnaOYh5v8cskDBIeRUmgZuL2fU3btGeQcZ_Q6fTjrMtyd25Sz9aShgYNBtDFz-Hs50Qjx2g1J9zbfldbysO0umRvOL_OrzT1jkVjcfTyFj5P-3m0Jht0Qc Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e28707cf49b24806879ae5acd0e08cf3"}]}] Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c6165562b6e14ff18dc7d82b8c9a46b3 Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: {"rescue": {}} Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: exception: Cannot 'rescue' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state paused Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7c62c154-2d25-411b-9e5c-fc0195fed8f0', 'body': {'rescue': {}}} Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 in vm_state paused. Cannot rescue while the instance is in this state. Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state paused Oct 27 09:19:03.074915 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state paused Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Returning 409 to user: Cannot 'rescue' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state paused {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:19:03.079868 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0853383-b2c9-4313-a5f2-393dcf18997f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action" status: 409 len: 144 microversion: 2.1 time: 0.126421 Oct 27 09:19:03.082452 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1968/4001] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:19:02 2022] POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action => generated 144 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:19:03.100047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-242c836f-55b6-46d4-b47f-f627f3167d0f tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:03.100746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-242c836f-55b6-46d4-b47f-f627f3167d0f tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:03.117342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-242c836f-55b6-46d4-b47f-f627f3167d0f tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:03.121080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-242c836f-55b6-46d4-b47f-f627f3167d0f tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:03.123107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-242c836f-55b6-46d4-b47f-f627f3167d0f tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:03.124043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-242c836f-55b6-46d4-b47f-f627f3167d0f tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:03.126862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-242c836f-55b6-46d4-b47f-f627f3167d0f tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:03.128344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-242c836f-55b6-46d4-b47f-f627f3167d0f tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:03.425585 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-242c836f-55b6-46d4-b47f-f627f3167d0f tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.340250 Oct 27 09:19:03.426995 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1969/4002] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:19:03 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8/os-interface => generated 285 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:03.433133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97d5fb4c-f906-4f77-8c62-7b650cfbe7aa tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:03.433967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97d5fb4c-f906-4f77-8c62-7b650cfbe7aa tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:03.447160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97d5fb4c-f906-4f77-8c62-7b650cfbe7aa tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:03.447769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97d5fb4c-f906-4f77-8c62-7b650cfbe7aa tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:03.448220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97d5fb4c-f906-4f77-8c62-7b650cfbe7aa tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:03.449041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97d5fb4c-f906-4f77-8c62-7b650cfbe7aa tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:03.449603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97d5fb4c-f906-4f77-8c62-7b650cfbe7aa tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:03.450312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97d5fb4c-f906-4f77-8c62-7b650cfbe7aa tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:03.539829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:03.563133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0236b4a0-b87e-4a4a-98cf-734fef655bc8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 0.838859 Oct 27 09:19:03.565884 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2034/4003] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:02 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:03.618247 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97d5fb4c-f906-4f77-8c62-7b650cfbe7aa tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action" status: 202 len: 0 microversion: 2.1 time: 0.189259 Oct 27 09:19:03.622022 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1970/4004] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:19:03 2022] POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:19:03.630608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:03.631374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:03.650222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:03.657139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:03.657608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:03.658389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:03.658865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:03.659304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:04.422133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:04.435477 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f30a652-0501-4cbb-b342-ede9ec686b28 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1508 microversion: 2.1 time: 0.809012 Oct 27 09:19:04.436126 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2035/4005] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:03 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1508 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:04.606736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:04.614616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:04.644585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:04.647843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:04.650460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:04.655441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:04.658988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:04.660976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:05.365384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-451fa951-5c8e-4984-bbe4-bc07d02b5b0b req-a3d113ff-11d4-4c70-a18a-b13f81c712e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4e9885-d7af-4bea-be6f-bc3195d71fca", "name": "network-vif-plugged", "status": "completed", "tag": "2f5a9bc2-a844-477b-9146-0ff99bef10a8"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:05.386729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-451fa951-5c8e-4984-bbe4-bc07d02b5b0b req-a3d113ff-11d4-4c70-a18a-b13f81c712e4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:05.388483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-451fa951-5c8e-4984-bbe4-bc07d02b5b0b req-a3d113ff-11d4-4c70-a18a-b13f81c712e4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:05.391478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-451fa951-5c8e-4984-bbe4-bc07d02b5b0b req-a3d113ff-11d4-4c70-a18a-b13f81c712e4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:05.418263 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-451fa951-5c8e-4984-bbe4-bc07d02b5b0b req-a3d113ff-11d4-4c70-a18a-b13f81c712e4 service nova] Creating event network-vif-plugged:2f5a9bc2-a844-477b-9146-0ff99bef10a8 for instance fa4e9885-d7af-4bea-be6f-bc3195d71fca on n-h1-858383-16 Oct 27 09:19:05.436699 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-451fa951-5c8e-4984-bbe4-bc07d02b5b0b req-a3d113ff-11d4-4c70-a18a-b13f81c712e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076105 Oct 27 09:19:05.438845 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2036/4006] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:19:05.466566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:05.467526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:05.480751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:05.481534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:05.482134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:05.484488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:05.485131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:05.486765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:06.018449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:06.037356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1b280e1-e904-4f02-aee8-f79085de3ddd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 1.451374 Oct 27 09:19:06.039080 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1971/4007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:04 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:06.252842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:06.275131 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e877a220-b5da-4a37-abb0-2599bf31b8b5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1516 microversion: 2.1 time: 0.815726 Oct 27 09:19:06.276278 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2037/4008] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:05 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1516 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:07.076261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:07.077497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:07.089881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:07.093176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:07.093925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:07.101751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:07.103881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:07.104678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:07.642415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:07.655849 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-628cf0a9-6fc2-44aa-800a-f1b66b68c501 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1373 microversion: 2.1 time: 0.579791 Oct 27 09:19:07.657250 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1972/4009] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:07 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1373 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:07.753311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-922ce576-e6ba-43c6-ba56-5af7823a9739 req-6b7316cf-e69f-4e3b-b1e0-fe734bf36cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7793923e-d34b-4c64-93fb-e6c613e415f8", "tag": "03066d75-6d26-4720-8434-0925e64350a3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:07.778629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-922ce576-e6ba-43c6-ba56-5af7823a9739 req-6b7316cf-e69f-4e3b-b1e0-fe734bf36cf1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:07.780987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-922ce576-e6ba-43c6-ba56-5af7823a9739 req-6b7316cf-e69f-4e3b-b1e0-fe734bf36cf1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:07.782278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-922ce576-e6ba-43c6-ba56-5af7823a9739 req-6b7316cf-e69f-4e3b-b1e0-fe734bf36cf1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:07.835872 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-922ce576-e6ba-43c6-ba56-5af7823a9739 req-6b7316cf-e69f-4e3b-b1e0-fe734bf36cf1 service nova] Creating event network-changed:03066d75-6d26-4720-8434-0925e64350a3 for instance 7793923e-d34b-4c64-93fb-e6c613e415f8 on n-h1-858383-16 Oct 27 09:19:07.875027 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-922ce576-e6ba-43c6-ba56-5af7823a9739 req-6b7316cf-e69f-4e3b-b1e0-fe734bf36cf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109929 Oct 27 09:19:07.878519 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2038/4010] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:08.690552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:08.691936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:08.711487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:08.713124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:08.713842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:08.714827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:08.717368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:08.718037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:09.286201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:09.298884 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a404be3e-1e11-41e0-aadf-0bba45653eda tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1546 microversion: 2.1 time: 0.609941 Oct 27 09:19:09.315819 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1973/4011] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:08 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1546 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:09.327673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:09.329290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:09.344562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:09.349407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:09.351717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:09.354870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:09.354870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:09.357008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:09.505773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:09.513950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:09.530829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:09.534222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:09.534806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:09.538450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:09.540952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:09.541625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:09.629884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lazy-loading 'flavor' on Instance uuid 7c62c154-2d25-411b-9e5c-fc0195fed8f0 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:19:09.891594 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2dc5bdc-d4ef-4e78-bcfd-2409b9306810 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action" status: 200 len: 32 microversion: 2.1 time: 0.389423 Oct 27 09:19:09.895057 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1974/4012] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:19:09 2022] POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action => generated 32 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:19:09.916881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:09.918120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:09.947077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:09.947912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:09.948487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:09.949443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:09.950707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:09.951371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:10.006766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:10.382650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:10.397695 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3250404-245c-47c6-af5f-d2551213ed99 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1546 microversion: 2.1 time: 1.075832 Oct 27 09:19:10.398803 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2039/4013] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:09 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1546 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:10.959059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:10.973781 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e501626-8085-43ff-90e5-8aea8e15a7d2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 1.070786 Oct 27 09:19:10.974815 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1975/4014] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:09 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:12.001455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:12.004235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:12.028967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:12.032690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:12.033640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:12.039903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:12.041002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:12.043175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:12.451781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:12.485135 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a30fe370-91df-400d-aa30-91f96252bd5d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 0.486722 Oct 27 09:19:12.485930 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2040/4015] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:11 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:13.509467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:13.510069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:13.517824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:13.518557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:13.519155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:13.520049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:13.520661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:13.521272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:13.758783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:13.766901 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53d48a50-9f06-4af0-9d05-a0e48e0165a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 0.262317 Oct 27 09:19:13.800756 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1976/4016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:13 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:14.794893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:14.798718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:14.804473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=64 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:14.813292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:14.813890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:14.814588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:14.816056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:14.816762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:14.817325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:14.990125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:15.006331 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c5f74b0e-1096-459c-a145-01a1ae05bcdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 0.216862 Oct 27 09:19:15.007895 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2041/4017] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:14 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:16.037257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:16.040288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:16.054899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:16.056617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:16.059200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:16.060066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:16.061000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:16.061574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:16.198467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-310437912", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "b4d8757a-1c64-4f0e-be9e-b898d26726c7"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:16.286388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:16.295483 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-904f07cf-22f7-4841-a6b9-8589d2aa1b0e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 0.264284 Oct 27 09:19:16.302918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] validate_networks() for [('b4d8757a-1c64-4f0e-be9e-b898d26726c7', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:19:16.303460 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2042/4018] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:16 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:17.087223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:19:17.087933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:19:17.088720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:19:17.089728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:19:17.090897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:19:17.117705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:17.119220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:17.119963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:17.124012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:17.125243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:17.125944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:17.169793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Getting quotas for project d0c09108136b4a139f54ab6b962ab3fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:19:17.180036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Getting quotas for user 4fb74165830e493ebec31c7a9edb1d88 and project d0c09108136b4a139f54ab6b962ab3fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:19:17.196040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:19:17.198795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:19:17.263379 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d2e0aaa-eadd-49a0-ac08-539630a75965 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349509 Oct 27 09:19:17.272074 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1977/4019] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:19:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:19:17.276659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ddff458a-f821-490a-be32-1ce3b85cf4ce tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:17.277856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ddff458a-f821-490a-be32-1ce3b85cf4ce tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:17.326202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:17.326986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:17.343773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:17.346524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:17.347279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:17.348838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:17.351437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:17.352186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:17.391874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ddff458a-f821-490a-be32-1ce3b85cf4ce tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:17.403964 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ddff458a-f821-490a-be32-1ce3b85cf4ce tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1216 microversion: 2.1 time: 0.131039 Oct 27 09:19:17.408636 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2043/4020] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:17 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1216 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:17.762396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:17.802024 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37241a88-fa1c-4168-a952-88b127d2564d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 0.478738 Oct 27 09:19:17.804871 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1978/4021] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:17 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:18.434681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:18.436056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:18.445859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:18.446728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:18.448327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:18.449421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:18.450120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:18.450752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:18.456552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:18.550581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:18.561252 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43591bf6-56f7-43b4-824a-86d7f27c81c7 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1268 microversion: 2.1 time: 0.130662 Oct 27 09:19:18.562797 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2044/4022] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:18 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:18.828207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:18.828928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:18.851303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:18.862581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:18.864076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:18.872770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:18.876717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:18.880479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:19.313662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:19.332485 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f29e7ca-88ac-4dab-8162-062bca4cc8bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 0.509796 Oct 27 09:19:19.343441 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1979/4023] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:18 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:19.586133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:19.587673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:19.602691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:19.612826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:19.613661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:19.615937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:19.617091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:19.618642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:19.766615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:19.792896 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-17a1d7c3-bfe0-4257-8bd9-724e70432534 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1274 microversion: 2.1 time: 0.202769 Oct 27 09:19:19.800119 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2045/4024] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:19 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:20.365810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:20.366895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:20.383199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:20.384987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:20.386027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:20.388303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:20.389037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:20.389884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:20.400585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1350868010", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "9d86e802-a9a7-4669-970c-b155c0dd14a5"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:20.585222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] validate_networks() for [('9d86e802-a9a7-4669-970c-b155c0dd14a5', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:19:21.003327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:21.029007 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10c194cc-fe9b-4b06-9f8d-bc51a58fcd4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 0.672763 Oct 27 09:19:21.030240 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2046/4025] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:20 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:21.042295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:21.043777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:21.059403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:21.060710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:21.061706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:21.063796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:21.064850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:21.065817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:21.275648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:21.289174 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-75b42510-f2b4-4b13-80fa-a37450129662 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1274 microversion: 2.1 time: 0.252642 Oct 27 09:19:21.293813 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2047/4026] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:21 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:21.955629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1e58acf7-6b34-4e9d-b7b9-37bded2b33a3 req-407fca5c-ba6b-4959-bece-0223fae6116e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4e9885-d7af-4bea-be6f-bc3195d71fca", "tag": "2f5a9bc2-a844-477b-9146-0ff99bef10a8"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:21.982930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1e58acf7-6b34-4e9d-b7b9-37bded2b33a3 req-407fca5c-ba6b-4959-bece-0223fae6116e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:21.984861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1e58acf7-6b34-4e9d-b7b9-37bded2b33a3 req-407fca5c-ba6b-4959-bece-0223fae6116e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:21.987324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1e58acf7-6b34-4e9d-b7b9-37bded2b33a3 req-407fca5c-ba6b-4959-bece-0223fae6116e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:22.019673 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1e58acf7-6b34-4e9d-b7b9-37bded2b33a3 req-407fca5c-ba6b-4959-bece-0223fae6116e service nova] Creating event network-changed:2f5a9bc2-a844-477b-9146-0ff99bef10a8 for instance fa4e9885-d7af-4bea-be6f-bc3195d71fca on n-h1-858383-16 Oct 27 09:19:22.035808 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1e58acf7-6b34-4e9d-b7b9-37bded2b33a3 req-407fca5c-ba6b-4959-bece-0223fae6116e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081495 Oct 27 09:19:22.037126 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2048/4027] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:19:22.074569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:22.076140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:22.084704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:22.085562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:22.086350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:22.087317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:22.088032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:22.088786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:22.166969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:19:22.168316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:19:22.168959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:19:22.169561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:19:22.170144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:19:22.194740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:22.200394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:22.201220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:22.202664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:22.203431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:22.204181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:22.246773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Getting quotas for project b4f37ec78b0c4015812d9ccb67992c35. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:19:22.259513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Getting quotas for user 9cf86af347d545c79ccb2fdef888e23d and project b4f37ec78b0c4015812d9ccb67992c35. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:19:22.295978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:19:22.301278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:19:22.404786 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-542b1d2b-8f43-442b-8582-1eddcb81cbe4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.136763 Oct 27 09:19:22.407280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1980/4028] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:19:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:19:22.413721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:22.414743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:22.425400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:22.427335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:22.428566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:22.429826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:22.431016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:22.431743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:22.596173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:22.602496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:22.607444 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72375c1b-2926-43ac-90c8-ef71daca46d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 0.537452 Oct 27 09:19:22.609732 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2049/4029] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:22 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:22.616526 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3df82787-c444-4e5c-b164-5f5d003b4e43 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1274 microversion: 2.1 time: 0.207530 Oct 27 09:19:22.617271 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1981/4030] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:22 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1274 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:22.621891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-985f5d86-5892-4900-b471-681a387d31f8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:22.624289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-985f5d86-5892-4900-b471-681a387d31f8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:22.763035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-985f5d86-5892-4900-b471-681a387d31f8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:22.772281 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-985f5d86-5892-4900-b471-681a387d31f8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1225 microversion: 2.1 time: 0.156919 Oct 27 09:19:22.772809 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2050/4031] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:22 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1225 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:23.633776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:23.634388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:23.646089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:23.647312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:23.662139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:23.666852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:23.667380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:23.667868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:23.668626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:23.669097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:23.669535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:23.669749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:23.670449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:23.673339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:23.674452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:23.676821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:25.045997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:25.065877 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e033eebf-c5b2-4cda-b6c3-295654294bb0 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1316 microversion: 2.1 time: 1.424001 Oct 27 09:19:25.079912 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2051/4032] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:23 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1316 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:25.089839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:25.091000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:25.105769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:25.106644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:25.107689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:25.134040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:25.136472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:25.138063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:25.238329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:25.248487 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2572dfa0-0061-4dc5-b791-e913e1b2c17d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 1.619052 Oct 27 09:19:25.269614 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1982/4033] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:23 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:25.420730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:25.439014 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1764f03-a654-4706-8ac3-05b374567a47 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1283 microversion: 2.1 time: 0.353869 Oct 27 09:19:25.440041 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2052/4034] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:25 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1283 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:26.110008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:26.110951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:26.119841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:26.120606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:26.122109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:26.123029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:26.123689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:26.124274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:26.276736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:26.277540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:26.296674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:26.297318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:26.298041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:26.302207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:26.303078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:26.303788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.127031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:27.142319 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11e19e3a-145f-431a-985e-137cdce5ac23 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1316 microversion: 2.1 time: 1.038637 Oct 27 09:19:27.156435 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1983/4035] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:26 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1316 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:27.169490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:27.173968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:27.190352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:27.192825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:27.195745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.198564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:27.199407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:27.201524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.318636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:27.355037 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f15ec971-7c63-4058-9b2b-f9ab41256af7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1502 microversion: 2.1 time: 1.083316 Oct 27 09:19:27.361409 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2053/4036] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:26 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1502 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:27.379098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd7cd825-61c1-4c90-893d-82f7f32b847d"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:27.382520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:27.401186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:27.401701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:27.402148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.402877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:27.403354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:27.403847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.461529 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] HTTP exception thrown: Cannot 'attach_volume' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state rescued Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Request method failure captured: Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/os-volume_attachments HTTP/1.1 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 74 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkzDycu2zrvEyACIIrQoHV06Jd0It45Rv0F2xQOPM2wSnWHcd2-qrADZYvnaOYh5v8cskDBIeRUmgZuL2fU3btGeQcZ_Q6fTjrMtyd25Sz9aShgYNBtDFz-Hs50Qjx2g1J9zbfldbysO0umRvOL_OrzT1jkVjcfTyFj5P-3m0Jht0Qc Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e28707cf49b24806879ae5acd0e08cf3"}]}] Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c6165562b6e14ff18dc7d82b8c9a46b3 Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: {"volumeAttachment": {"volumeId": "bd7cd825-61c1-4c90-893d-82f7f32b847d"}} Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: exception: Cannot 'attach_volume' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state rescued Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'server_id': '7c62c154-2d25-411b-9e5c-fc0195fed8f0', 'body': {'volumeAttachment': {'volumeId': 'bd7cd825-61c1-4c90-893d-82f7f32b847d'}}} Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 27 09:19:27.472048 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state rescued Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state rescued Oct 27 09:19:27.477080 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:27.480404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Returning 409 to user: Cannot 'attach_volume' instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 while it is in vm_state rescued {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:19:27.482739 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3ba508ba-07de-43a9-a93e-b809a44587ab tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.107866 Oct 27 09:19:27.485921 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2054/4037] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:19:27 2022] POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/os-volume_attachments => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:19:27.506184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ecd86708-6e51-4d07-b339-adb8c55b926e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:27.506729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ecd86708-6e51-4d07-b339-adb8c55b926e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:27.524993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecd86708-6e51-4d07-b339-adb8c55b926e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:27.525493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecd86708-6e51-4d07-b339-adb8c55b926e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:27.525942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecd86708-6e51-4d07-b339-adb8c55b926e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.526669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecd86708-6e51-4d07-b339-adb8c55b926e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:27.527134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecd86708-6e51-4d07-b339-adb8c55b926e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:27.527590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ecd86708-6e51-4d07-b339-adb8c55b926e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.681429 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ecd86708-6e51-4d07-b339-adb8c55b926e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action" status: 202 len: 0 microversion: 2.1 time: 0.183839 Oct 27 09:19:27.682610 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2055/4038] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:19:27 2022] POST /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:19:27.692184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-9e8df54f-4b26-49e1-a6be-df1f495fd041 req-a2ac2015-3327-4f50-b5b8-1923ec4388bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1f6ffe-76bb-46ff-a6a8-e15acd41635b", "tag": "d0ebb7f4-ed59-448e-a0c6-58415d4411b2"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:27.696207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:27.711696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9e8df54f-4b26-49e1-a6be-df1f495fd041 req-a2ac2015-3327-4f50-b5b8-1923ec4388bd service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:27.712836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9e8df54f-4b26-49e1-a6be-df1f495fd041 req-a2ac2015-3327-4f50-b5b8-1923ec4388bd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:27.713849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9e8df54f-4b26-49e1-a6be-df1f495fd041 req-a2ac2015-3327-4f50-b5b8-1923ec4388bd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.719348 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ead7f785-4779-481a-9ed9-a651503f31e8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1283 microversion: 2.1 time: 0.558245 Oct 27 09:19:27.726903 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1984/4039] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:27 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1283 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:27.738799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:27.744042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:27.753211 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-9e8df54f-4b26-49e1-a6be-df1f495fd041 req-a2ac2015-3327-4f50-b5b8-1923ec4388bd service nova] Creating event network-changed:d0ebb7f4-ed59-448e-a0c6-58415d4411b2 for instance 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b on n-h2-858383-16 Oct 27 09:19:27.761878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:27.765220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:27.768309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:27.769127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.770199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:27.772379 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-9e8df54f-4b26-49e1-a6be-df1f495fd041 req-a2ac2015-3327-4f50-b5b8-1923ec4388bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083532 Oct 27 09:19:27.773304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:27.774254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:27.774783 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2056/4040] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:28.186551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:28.188990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:28.204400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:28.205140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:28.207854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:28.209426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:28.212438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:28.213162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:28.313050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:28.357990 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5dca7709-c4b4-42b5-9af5-134fbfdf676f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1510 microversion: 2.1 time: 0.629153 Oct 27 09:19:28.359516 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1985/4041] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:27 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1510 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:28.748568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:28.759826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:28.760900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:28.769535 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40b67e4f-324e-4eff-8bac-a4a7e32cf798 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1316 microversion: 2.1 time: 0.590598 Oct 27 09:19:28.770747 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2057/4042] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:28 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:28.780546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:28.781678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:28.782329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:28.785811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:28.788090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:28.788759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:29.384595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:29.385210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:29.409307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:29.411399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:29.412689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:29.413605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:29.414401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:29.415001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:29.827440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:29.858225 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-316a9767-2c4b-471a-8799-c138188950bb tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1325 microversion: 2.1 time: 1.107924 Oct 27 09:19:29.862537 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1986/4043] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:28 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1325 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:29.881587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:29.886285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:29.900436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:29.904130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:29.904688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:29.906323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:29.906915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:29.913014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:30.089248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:30.102312 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a545c98a-d30c-401c-948d-68b6dafc5c63 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1510 microversion: 2.1 time: 0.723446 Oct 27 09:19:30.110200 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2058/4044] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:29 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1510 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:30.397862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:30.416410 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0827b7ae-52c7-4ee4-b5ac-6b3a2b368746 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1316 microversion: 2.1 time: 0.551654 Oct 27 09:19:30.417327 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1987/4045] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:29 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:30.680760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-945317849", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "9914aac8-c667-44be-b989-588b71f7eb42"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:30.802148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] validate_networks() for [('9914aac8-c667-44be-b989-588b71f7eb42', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:19:30.884756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:30.886469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:30.893453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:30.894240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:30.894960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:30.898765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:30.899471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:30.900154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:31.334789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:31.352395 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4b9854f-786d-4b0b-8ab6-42a8eb230135 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1325 microversion: 2.1 time: 0.471520 Oct 27 09:19:31.358581 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1988/4046] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:30 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1325 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:31.386104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:31.389344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:31.405374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:31.410730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:31.412101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:31.413513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:31.415497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:31.417287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:32.232009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:32.276343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:32.326385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:32.338681 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61cfe7c7-09aa-403a-b728-3d3f684d6761 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1516 microversion: 2.1 time: 0.978756 Oct 27 09:19:32.340187 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1989/4047] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:31 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1516 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:32.347436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:32.348492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:32.356188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:32.357656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:32.359763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:32.360842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:32.361524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:32.362321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:32.496845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:19:32.497305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:19:32.497721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:19:32.498111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:19:32.498677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:19:32.509187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:32.509959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:32.510557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:32.511445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:32.512136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:32.512731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:32.535908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Getting quotas for project 5d99cb5c593e458cbac6e6815ce71379. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:19:32.542344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Getting quotas for user d685f5e9ad4342ed997d45e8111103c4 and project 5d99cb5c593e458cbac6e6815ce71379. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:19:32.557351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:19:32.560233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:19:32.662768 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dff7ca84-f7f9-415f-a8ea-62783f049f24 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.115337 Oct 27 09:19:32.665021 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2059/4048] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:19:32.671211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:32.671546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:32.717910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:32.718457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:32.718909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:32.732863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:32.733530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:32.733985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:32.738496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:32.750819 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2016587-3457-4acf-8a3f-1f1698e4e6aa tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1316 microversion: 2.1 time: 0.408716 Oct 27 09:19:32.751545 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1990/4049] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:32 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:32.769752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e14ccea-d968-4289-8fdb-325f0884cb6d tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:32.770461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e14ccea-d968-4289-8fdb-325f0884cb6d tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:32.966900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e14ccea-d968-4289-8fdb-325f0884cb6d tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:32.975121 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e14ccea-d968-4289-8fdb-325f0884cb6d tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1215 microversion: 2.1 time: 0.219569 Oct 27 09:19:32.977859 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1991/4050] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:32 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:33.273766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:33.307650 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f024a3d-7273-4f10-a37c-85d3fc51fcef tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1325 microversion: 2.1 time: 0.638139 Oct 27 09:19:33.331699 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2060/4051] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:32 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1325 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:33.704364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-52fda8df-1d69-4c56-bc66-734af6f8df83 req-a0905dc9-0a14-4e19-8329-a3b8c17fd407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5146b080-63f9-4084-839b-ee9fa3c6c6c4", "tag": "29c45fd9-1bf6-464d-bab1-8a1811278bd5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:33.754782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-52fda8df-1d69-4c56-bc66-734af6f8df83 req-a0905dc9-0a14-4e19-8329-a3b8c17fd407 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:33.755485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-52fda8df-1d69-4c56-bc66-734af6f8df83 req-a0905dc9-0a14-4e19-8329-a3b8c17fd407 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:33.756552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-52fda8df-1d69-4c56-bc66-734af6f8df83 req-a0905dc9-0a14-4e19-8329-a3b8c17fd407 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:33.781190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:33.781814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:33.792904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:33.799392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:33.804961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:33.820781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:33.821498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:33.825466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:33.827204 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-52fda8df-1d69-4c56-bc66-734af6f8df83 req-a0905dc9-0a14-4e19-8329-a3b8c17fd407 service nova] Creating event network-changed:29c45fd9-1bf6-464d-bab1-8a1811278bd5 for instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 on n-h2-858383-16 Oct 27 09:19:33.860097 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-52fda8df-1d69-4c56-bc66-734af6f8df83 req-a0905dc9-0a14-4e19-8329-a3b8c17fd407 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166918 Oct 27 09:19:33.871259 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1992/4052] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:34.003400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:34.004325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:34.021568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:34.024017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:34.031296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:34.032321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:34.032959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:34.033810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:34.348669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:34.366058 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea8edb40-b530-4611-8886-692aba57ded0 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1211 microversion: 2.1 time: 0.368021 Oct 27 09:19:34.367030 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1993/4053] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:33 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1211 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:34.374191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:34.374828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:34.420623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:34.421138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:34.423311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:34.426682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:34.429221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:34.431680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:34.557127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:34.565964 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7aa1c30-420d-4da6-ae51-a61dc029ae5e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1316 microversion: 2.1 time: 0.790527 Oct 27 09:19:34.567122 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2061/4054] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:33 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1316 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:34.885557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:34.910451 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8a23328-0459-44ae-997b-4a8e3241852b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1325 microversion: 2.1 time: 0.542045 Oct 27 09:19:34.913837 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1994/4055] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:34 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:35.226247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-41de553b-6ab0-429d-9f6d-862e395e27b3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'create', calling method: .version_select at 0x7f31a9fdb790>, body: {"keypair": {"name": "tempest-keypair-923000103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9Ii+c/0WoI6HAKrSgfadeEcPjAcOXzZLPEEkW0zw5469P+o8KU3uB3P663AtS8tlSAb8S645py4u9Vitj3NHNBRH6sQ4oTFR0iZ2sWf02L6HftgP/OGbaVPEQSPLYBsQ=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:35.278203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-41de553b-6ab0-429d-9f6d-862e395e27b3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Getting quotas for project e28707cf49b24806879ae5acd0e08cf3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:19:35.301290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-41de553b-6ab0-429d-9f6d-862e395e27b3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Getting quotas for user c6165562b6e14ff18dc7d82b8c9a46b3 and project e28707cf49b24806879ae5acd0e08cf3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:19:35.342843 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-41de553b-6ab0-429d-9f6d-862e395e27b3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121582 Oct 27 09:19:35.344254 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2062/4056] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:19:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:35.390793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:35.391753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:35.406392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:35.407850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:35.409805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:35.414688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:35.415152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:35.417023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:35.427246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:35.584399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:35.593254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:35.594087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:35.595003 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e8284de-756f-469e-807c-b8d4a0161e9b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1273 microversion: 2.1 time: 0.208746 Oct 27 09:19:35.596973 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1995/4057] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:35 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:35.603174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:35.603950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:35.604542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:35.605467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:35.606092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:35.606673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:35.939896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:35.941331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:35.954337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:35.957262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:35.958097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:35.960286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:35.962347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:35.963813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:36.045790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:36.068441 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fdf4c7af-fe52-4ebb-acef-1dc8ed2c4b6c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1316 microversion: 2.1 time: 0.476554 Oct 27 09:19:36.069806 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2063/4058] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:35 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:36.292043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:36.309020 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc4de5ae-a6ed-4481-97c3-3dc33f72973c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1325 microversion: 2.1 time: 0.369836 Oct 27 09:19:36.309424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1996/4059] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:35 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1325 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:36.620821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:36.621493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:36.653837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:36.654631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:36.655265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:36.656464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:36.657032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:36.657492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:36.729065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:36.948642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-28b2c017-cc2c-4b2e-9ace-c61e921d636f req-6530a3b9-4689-44e2-9d32-f02947cd7377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1f6ffe-76bb-46ff-a6a8-e15acd41635b", "name": "network-vif-plugged", "status": "completed", "tag": "d0ebb7f4-ed59-448e-a0c6-58415d4411b2"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:36.986403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-28b2c017-cc2c-4b2e-9ace-c61e921d636f req-6530a3b9-4689-44e2-9d32-f02947cd7377 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:36.986865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-28b2c017-cc2c-4b2e-9ace-c61e921d636f req-6530a3b9-4689-44e2-9d32-f02947cd7377 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:36.989735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-28b2c017-cc2c-4b2e-9ace-c61e921d636f req-6530a3b9-4689-44e2-9d32-f02947cd7377 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:37.014978 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-28b2c017-cc2c-4b2e-9ace-c61e921d636f req-6530a3b9-4689-44e2-9d32-f02947cd7377 service nova] Creating event network-vif-plugged:d0ebb7f4-ed59-448e-a0c6-58415d4411b2 for instance 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b on n-h2-858383-16 Oct 27 09:19:37.024674 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-28b2c017-cc2c-4b2e-9ace-c61e921d636f req-6530a3b9-4689-44e2-9d32-f02947cd7377 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079877 Oct 27 09:19:37.025317 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1997/4060] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:19:37.094782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:37.107049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:37.111266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:37.125829 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2637763c-657b-411a-9e1c-1ab0f23db042 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1315 microversion: 2.1 time: 0.508868 Oct 27 09:19:37.134942 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2064/4061] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:36 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:37.137671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:37.138364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:37.139013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:37.142219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:37.142880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:37.143460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:37.336695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:37.338783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:37.361714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:37.366558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:37.367613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:37.369483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:37.371162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:37.371620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:37.558022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:37.570969 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae1ccf7c-6113-4296-acb8-7563387cf38d tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1316 microversion: 2.1 time: 0.482110 Oct 27 09:19:37.571558 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1998/4062] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:37 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:37.701917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:37.715066 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-81c2b612-095f-4044-ada8-a30a4b350456 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1325 microversion: 2.1 time: 0.386191 Oct 27 09:19:37.717497 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2065/4063] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:37 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1325 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:38.162246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:38.163552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:38.175167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:38.175971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:38.180522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:38.181555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:38.182261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:38.182876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:38.467086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:38.483163 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b3c53bba-486c-4687-8121-447f622bc579 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1315 microversion: 2.1 time: 0.324758 Oct 27 09:19:38.484136 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1999/4064] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:38 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:38.594564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:38.594822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:38.601028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:38.601596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:38.602050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:38.602744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:38.603204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:38.603655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:38.741684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:38.742329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:38.757929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:38.758537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:38.759049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:38.759818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:38.763592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:38.764114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:38.819932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:38.833939 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e41f9e6c-3ae0-41c9-ab88-61f5b3ea533e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1316 microversion: 2.1 time: 0.241525 Oct 27 09:19:38.835654 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2066/4065] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:38 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:38.942975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2049424006", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2e1d02f-47a9-4a0a-a43b-cf81524bbbe4"}], "security_groups": [{"name": "tempest-securitygroup--219848898"}], "key_name": "tempest-keypair-923000103", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:39.102443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:39.116387 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1440df1-2a75-4ce8-8061-179b70e11e0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1325 microversion: 2.1 time: 0.379625 Oct 27 09:19:39.117230 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2000/4066] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:38 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1325 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:39.172012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] validate_networks() for [('f2e1d02f-47a9-4a0a-a43b-cf81524bbbe4', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:19:39.477112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-389bf319-f418-4ed1-a2fc-e317d13ceca9 req-2ce86650-aeb9-4123-ad22-9246702a1462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cefe2a4d-8098-4295-a5f5-d7f2ca61fec8", "tag": "db418740-a0ad-464a-af1a-8a90f4b6be9c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:39.488677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-389bf319-f418-4ed1-a2fc-e317d13ceca9 req-2ce86650-aeb9-4123-ad22-9246702a1462 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:39.489223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-389bf319-f418-4ed1-a2fc-e317d13ceca9 req-2ce86650-aeb9-4123-ad22-9246702a1462 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:39.490163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-389bf319-f418-4ed1-a2fc-e317d13ceca9 req-2ce86650-aeb9-4123-ad22-9246702a1462 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:39.505921 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-389bf319-f418-4ed1-a2fc-e317d13ceca9 req-2ce86650-aeb9-4123-ad22-9246702a1462 service nova] Creating event network-changed:db418740-a0ad-464a-af1a-8a90f4b6be9c for instance cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 on n-h1-858383-16 Oct 27 09:19:39.511283 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-389bf319-f418-4ed1-a2fc-e317d13ceca9 req-2ce86650-aeb9-4123-ad22-9246702a1462 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040236 Oct 27 09:19:39.512713 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2001/4067] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:19:39.518710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:39.520111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:39.528688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:39.529523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:39.530232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:39.531178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:39.531738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:39.532381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:39.834346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:39.866023 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38ec747a-a293-4fd7-9ca5-e144bf344010 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1315 microversion: 2.1 time: 0.351701 Oct 27 09:19:39.889151 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2002/4068] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:39 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:39.914251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:39.915334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:39.924473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:39.925316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:39.926070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:39.927850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:39.928792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:39.929446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.047686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:19:40.048741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:19:40.049516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:19:40.050140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:19:40.051081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:19:40.062511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.068192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.070043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.071987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.073158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.075022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.102642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Getting quotas for project e28707cf49b24806879ae5acd0e08cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:19:40.111977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Getting quotas for user c6165562b6e14ff18dc7d82b8c9a46b3 and project e28707cf49b24806879ae5acd0e08cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:19:40.127990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:40.145206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:19:40.145540 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a18616ae-6f98-459f-974f-49ba79e0b2c8 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1506 microversion: 2.1 time: 0.246332 Oct 27 09:19:40.146294 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2003/4069] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:39 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:40.148703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:19:40.165691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:40.167847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:40.191437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.193456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.195546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.197280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.197949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.198513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.233472 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ddf940c-63fa-4d73-8edf-7db669927702 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.294914 Oct 27 09:19:40.234156 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2067/4070] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:19:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:19:40.248556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:40.249447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:40.281396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.282245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.282917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.284116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.284812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.288833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.347879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:40.350532 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f2ab7ba-4fe1-41b5-aea8-706593c1b352 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b/os-instance-actions/req-5d2e0aaa-eadd-49a0-ac08-539630a75965" status: 200 len: 313 microversion: 2.1 time: 0.109058 Oct 27 09:19:40.352008 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2068/4071] 10.222.0.25 () {58 vars in 1419 bytes} [Thu Oct 27 09:19:40 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b/os-instance-actions/req-5d2e0aaa-eadd-49a0-ac08-539630a75965 => generated 313 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:40.364169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0fd8ef01-6967-4c90-bb39-7fcbf0bd3d45 req-d0395170-e5f2-46dd-ae66-3936a9436fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5146b080-63f9-4084-839b-ee9fa3c6c6c4", "name": "network-vif-plugged", "status": "completed", "tag": "29c45fd9-1bf6-464d-bab1-8a1811278bd5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:40.385720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:40.393010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0fd8ef01-6967-4c90-bb39-7fcbf0bd3d45 req-d0395170-e5f2-46dd-ae66-3936a9436fbd service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.394463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0fd8ef01-6967-4c90-bb39-7fcbf0bd3d45 req-d0395170-e5f2-46dd-ae66-3936a9436fbd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.397514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0fd8ef01-6967-4c90-bb39-7fcbf0bd3d45 req-d0395170-e5f2-46dd-ae66-3936a9436fbd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.415672 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0fd8ef01-6967-4c90-bb39-7fcbf0bd3d45 req-d0395170-e5f2-46dd-ae66-3936a9436fbd service nova] Creating event network-vif-plugged:29c45fd9-1bf6-464d-bab1-8a1811278bd5 for instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 on n-h2-858383-16 Oct 27 09:19:40.422960 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0fd8ef01-6967-4c90-bb39-7fcbf0bd3d45 req-d0395170-e5f2-46dd-ae66-3936a9436fbd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069527 Oct 27 09:19:40.424153 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2069/4072] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:40.430522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a65f2c85-765b-4658-ac17-0c1f9e917b74 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:40.431379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a65f2c85-765b-4658-ac17-0c1f9e917b74 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:40.461364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:40.507072 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6af6e2ee-2c2f-44e6-bb0f-7d03a5d3f5b8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1325 microversion: 2.1 time: 0.341482 Oct 27 09:19:40.510232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a65f2c85-765b-4658-ac17-0c1f9e917b74 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:40.527537 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2004/4073] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:40 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1325 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:40.531700 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a65f2c85-765b-4658-ac17-0c1f9e917b74 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1245 microversion: 2.1 time: 0.106031 Oct 27 09:19:40.532982 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2070/4074] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:40 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:40.537015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d894fad6-881a-41b8-9c6d-d0d74f81fd56 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:40.539998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d894fad6-881a-41b8-9c6d-d0d74f81fd56 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:40.557332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d894fad6-881a-41b8-9c6d-d0d74f81fd56 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.558220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d894fad6-881a-41b8-9c6d-d0d74f81fd56 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.558220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d894fad6-881a-41b8-9c6d-d0d74f81fd56 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.558938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d894fad6-881a-41b8-9c6d-d0d74f81fd56 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.559700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d894fad6-881a-41b8-9c6d-d0d74f81fd56 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.560108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d894fad6-881a-41b8-9c6d-d0d74f81fd56 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.673367 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d894fad6-881a-41b8-9c6d-d0d74f81fd56 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "POST /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b/action" status: 202 len: 0 microversion: 2.1 time: 0.144252 Oct 27 09:19:40.677021 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2005/4075] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:19:40 2022] POST /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:19:40.695152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:40.696266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:40.707399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.707926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.715554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.717350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.718033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.718949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.904132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:40.904893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:40.916444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.916951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.917388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.919990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:40.923786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:40.926451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:40.949929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:40.966927 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8eabec7c-3de1-487b-83ba-4c87e4d3bc09 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1508 microversion: 2.1 time: 0.286479 Oct 27 09:19:40.969727 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2071/4076] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:40 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:41.223468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:41.236441 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0263239-ee30-4385-aaab-9eca637e7e3b tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1315 microversion: 2.1 time: 0.341156 Oct 27 09:19:41.237406 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2006/4077] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:40 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:41.533843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:41.534460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:41.541393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:41.541887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:41.542564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:41.543429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:41.544074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:41.544504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:41.559921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:41.560359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:41.573369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:41.573866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:41.574825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:41.576341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:41.577582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:41.578930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:41.758004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:41.774572 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff4edc64-e05c-4615-acbb-752a3fb7ba29 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1241 microversion: 2.1 time: 0.218707 Oct 27 09:19:41.775387 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2007/4078] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:41 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1241 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:41.994163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:41.994774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:42.008180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:42.010475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:42.011265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:42.012064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:42.012542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:42.012977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:42.344628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:42.355257 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d82da2f6-4d4e-4e52-b1c9-e673711cff13 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1325 microversion: 2.1 time: 0.825332 Oct 27 09:19:42.356087 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2072/4079] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:41 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1325 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:42.366916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:42.368526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:42.376289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:42.377026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:42.377769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:42.379149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:42.380150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:42.381212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:42.470136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:42.485904 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5b960a9-7847-4c6e-bdcc-d20e9ff698c9 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1508 microversion: 2.1 time: 0.496387 Oct 27 09:19:42.487364 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2008/4080] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:41 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1508 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:42.802739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:42.803513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:42.814935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:42.815455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:42.816486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:42.817424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:42.818725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:42.819345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:42.875629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:42.891625 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97f3cad0-cefc-4c4d-9dfb-363b9cc1d185 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1315 microversion: 2.1 time: 0.533991 Oct 27 09:19:42.892394 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2073/4081] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:42 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:42.910348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:42.921903 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a458c93e-cb16-426b-bdb3-6110919c54bf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1241 microversion: 2.1 time: 0.124150 Oct 27 09:19:42.922825 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2009/4082] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:42 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1241 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:43.381110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:43.382032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:43.388917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:43.389418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:43.389864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:43.390591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:43.391063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:43.401157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:43.515793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:43.516827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:43.519520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:43.539966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:43.543527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:43.545720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:43.548614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:43.550258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:43.552971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:43.849340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:43.867012 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f6145f5d-222b-4a90-b21e-558b6062a3f2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1520 microversion: 2.1 time: 0.491719 Oct 27 09:19:43.868094 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2074/4083] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:43 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1520 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:43.891989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:43.893805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:43.902867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:43.903964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:43.904836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:43.905619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:43.906096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:43.906577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:43.935991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:43.948894 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9800ea21-96b2-44db-8185-12f0cb378989 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1506 microversion: 2.1 time: 0.439582 Oct 27 09:19:43.954299 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2010/4084] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:43 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:43.965063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:43.965960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:43.980158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:43.983100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:43.984816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:43.985628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:43.990087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:43.990623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:44.538778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:44.549836 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d887139-87b8-44f3-a2b5-0610b44d777e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1520 microversion: 2.1 time: 0.662808 Oct 27 09:19:44.550384 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2075/4085] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:43 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1520 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:44.572819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:44.573443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:44.586451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:44.587012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:44.587474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:44.588235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:44.589646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:44.590094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:44.909110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:44.919173 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c62bfa90-aabf-4b56-a318-d62485c9f0d7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1303 microversion: 2.1 time: 0.364681 Oct 27 09:19:44.924109 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2076/4086] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:44 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1303 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:44.937141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bca5dcf8-e61a-43f6-b17a-a7f042b4001e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '.version_select at 0x7f31aa60ef70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:44.938232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bca5dcf8-e61a-43f6-b17a-a7f042b4001e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:44.958302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bca5dcf8-e61a-43f6-b17a-a7f042b4001e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:44.958799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bca5dcf8-e61a-43f6-b17a-a7f042b4001e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:44.959242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bca5dcf8-e61a-43f6-b17a-a7f042b4001e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:44.964968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bca5dcf8-e61a-43f6-b17a-a7f042b4001e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:44.965478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bca5dcf8-e61a-43f6-b17a-a7f042b4001e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:44.965929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bca5dcf8-e61a-43f6-b17a-a7f042b4001e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.030618 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bca5dcf8-e61a-43f6-b17a-a7f042b4001e tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.103805 Oct 27 09:19:45.041050 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2077/4087] 10.222.0.25 () {58 vars in 1296 bytes} [Thu Oct 27 09:19:44 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b/os-instance-actions => generated 611 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:45.049015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ab810ae-dde1-4579-8718-1187425d8552 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1161013438", "metadata": {"": ""}}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ab810ae-dde1-4579-8718-1187425d8552 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action HTTP/1.1 Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 107 Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1161013438", "metadata": {"": ""}}} Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5146b080-63f9-4084-839b-ee9fa3c6c6c4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1161013438', 'metadata': {'': ''}}}} Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'': ''} Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:19:45.054815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:19:45.059336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:45.062457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ab810ae-dde1-4579-8718-1187425d8552 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:19:45.063528 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ab810ae-dde1-4579-8718-1187425d8552 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action" status: 400 len: 170 microversion: 2.1 time: 0.021357 Oct 27 09:19:45.064298 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2078/4088] 10.222.0.25 () {60 vars in 1279 bytes} [Thu Oct 27 09:19:45 2022] POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action => generated 170 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:19:45.075904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:45.076744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:45.092686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.093398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.093993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.094884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.095534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.096182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.134911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:19:45.137596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:45.150082 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53271c50-f1ed-4918-a9c5-6e1613995727 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1315 microversion: 2.1 time: 1.191253 Oct 27 09:19:45.166051 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2011/4089] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:43 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1315 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:45.172095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:45.172095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:45.185475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.190036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.190717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.191673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.192463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.194442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.201659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:45.289410 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-223d12ed-4d88-4e4c-b7f4-23a066999f5c tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 204 len: 0 microversion: 2.1 time: 0.217970 Oct 27 09:19:45.294375 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2079/4090] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:19:45 2022] DELETE /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:19:45.315754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:45.316484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:45.342060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.342575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.349570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.350463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.350954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.357434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.797642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:45.808765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:45.817778 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99293074-739e-4e5f-b519-d4a293a4867d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1520 microversion: 2.1 time: 0.665395 Oct 27 09:19:45.820081 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-63f40bb6-1317-4d32-b4e0-7ddda3642a63 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1512 microversion: 2.1 time: 0.522179 Oct 27 09:19:45.820934 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2080/4091] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:45 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:45.837074 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2012/4092] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:45 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1520 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:45.857552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:45.858181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:45.869288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.869288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.869288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.869747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.870255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.870492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.948776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:45.949659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:45.960673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.961639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.962323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:45.963280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:45.966641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:45.968463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:46.105858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:46.120138 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ed586ab3-5f73-4e77-8579-4e4bd1a497df tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1303 microversion: 2.1 time: 0.175369 Oct 27 09:19:46.121055 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2013/4093] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:45 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:46.161087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:46.173902 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b419ff2-6958-4974-8af9-ffeb85f52717 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1520 microversion: 2.1 time: 0.320163 Oct 27 09:19:46.177226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:46.178908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:46.188605 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2081/4094] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:45 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:46.191893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:46.195843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:46.197860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:46.199496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:46.201741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:46.204009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:46.211497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29ce778c-0703-4ed2-9868-3a7fadaec2b5 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-728455667", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29ce778c-0703-4ed2-9868-3a7fadaec2b5 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action HTTP/1.1 Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 618 Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-728455667", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5146b080-63f9-4084-839b-ee9fa3c6c6c4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-728455667', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:19:46.217997 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 27 09:19:46.221495 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:46.231837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29ce778c-0703-4ed2-9868-3a7fadaec2b5 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:19:46.232139 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-29ce778c-0703-4ed2-9868-3a7fadaec2b5 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action" status: 400 len: 938 microversion: 2.1 time: 0.026020 Oct 27 09:19:46.238121 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2082/4095] 10.222.0.25 () {60 vars in 1279 bytes} [Thu Oct 27 09:19:46 2022] POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action => generated 938 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:19:46.248471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:46.250005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:46.263651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:46.264968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:46.266068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:46.267689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:46.268833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:46.269902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:46.318793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:46.639932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:46.651867 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5df9abd-cdfa-490d-9487-78aeeb9646f3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1315 microversion: 2.1 time: 0.478461 Oct 27 09:19:46.652882 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2014/4096] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:46 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:46.681655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:46.692114 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e4f11f80-7e5c-48c9-980c-a1566a4add0d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1520 microversion: 2.1 time: 0.451816 Oct 27 09:19:46.694659 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2083/4097] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:46 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:46.720030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:46.720943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:46.727929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:46.728405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:46.728850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:46.729566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:46.730252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:46.730685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:46.860077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:46.860692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:46.868396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:46.869171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:46.869756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:46.870628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:46.871383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:46.872187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:47.221017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:47.235492 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-557c441b-9602-4a53-a43e-6ddabcc15785 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1520 microversion: 2.1 time: 0.519108 Oct 27 09:19:47.247920 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2015/4098] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:46 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1520 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:47.258898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:47.260671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:47.273250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:47.274078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:47.274710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:47.275686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:47.276499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:47.277086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:47.690540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:47.690656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:47.694362 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a2d5bc3b-0258-4693-aad9-a9945697a9c1 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1512 microversion: 2.1 time: 0.838120 Oct 27 09:19:47.697478 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-738c326d-5ae3-42b1-8561-d8396617a14b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 0.448115 Oct 27 09:19:47.708891 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2084/4099] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:46 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1512 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:47.709512 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2016/4100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:47 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:47.717693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:47.718713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:47.728899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a67f0ad0-f287-45c1-b5e9-d53f6ac6e006 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a67f0ad0-f287-45c1-b5e9-d53f6ac6e006 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action HTTP/1.1 Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 285 Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5146b080-63f9-4084-839b-ee9fa3c6c6c4', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:47.733493 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:19:47.736614 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:47.740438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a67f0ad0-f287-45c1-b5e9-d53f6ac6e006 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:19:47.741538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:47.741909 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a67f0ad0-f287-45c1-b5e9-d53f6ac6e006 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action" status: 400 len: 619 microversion: 2.1 time: 0.029137 Oct 27 09:19:47.742085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:47.742496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:47.746215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:47.746215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:47.746887 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2017/4101] 10.222.0.25 () {60 vars in 1279 bytes} [Thu Oct 27 09:19:47 2022] POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:19:47.748914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:47.752261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-777f2968-e2ac-4cc2-8a0f-840094ba1a26 req-504122ce-7482-402f-8d1e-20070582fd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefe2a4d-8098-4295-a5f5-d7f2ca61fec8", "name": "network-vif-plugged", "status": "completed", "tag": "db418740-a0ad-464a-af1a-8a90f4b6be9c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:47.764741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-777f2968-e2ac-4cc2-8a0f-840094ba1a26 req-504122ce-7482-402f-8d1e-20070582fd04 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:47.765598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-777f2968-e2ac-4cc2-8a0f-840094ba1a26 req-504122ce-7482-402f-8d1e-20070582fd04 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:47.766260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-777f2968-e2ac-4cc2-8a0f-840094ba1a26 req-504122ce-7482-402f-8d1e-20070582fd04 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:47.779472 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-777f2968-e2ac-4cc2-8a0f-840094ba1a26 req-504122ce-7482-402f-8d1e-20070582fd04 service nova] Creating event network-vif-plugged:db418740-a0ad-464a-af1a-8a90f4b6be9c for instance cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 on n-h1-858383-16 Oct 27 09:19:47.786627 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-777f2968-e2ac-4cc2-8a0f-840094ba1a26 req-504122ce-7482-402f-8d1e-20070582fd04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038103 Oct 27 09:19:47.787615 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2018/4102] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:47.799027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:47.800161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:47.808874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:47.809710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:47.810809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:47.812639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:47.813478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:47.814143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:48.754806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:48.759759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:48.773523 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b4f4be6-def1-4a82-b0f2-fb575d021829 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1520 microversion: 2.1 time: 0.983658 Oct 27 09:19:48.774137 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2019/4103] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:47 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1520 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:48.781527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:48.782314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:48.783518 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57050e8c-cc62-4dcb-a2c6-f3a441ffbc4c tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1315 microversion: 2.1 time: 1.072191 Oct 27 09:19:48.784142 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2085/4104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:47 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:48.791462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:48.792549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:48.793189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:48.796914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:48.797874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:48.798822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:48.807037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:48.807946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:48.820410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:48.820924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:48.821412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:48.823546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:48.824245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:48.824684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:49.293774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:49.309670 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59f17e79-ca35-4fd8-8847-9020d1385896 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1512 microversion: 2.1 time: 0.524178 Oct 27 09:19:49.311497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:49.325940 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2086/4105] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:48 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1512 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:49.353776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:49.355047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:49.368458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:49.369328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:49.370103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:49.371366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:49.372236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:49.373227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:49.384985 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ba4ad36-2111-4ab7-87f9-b5694e7f2ca3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 0.609192 Oct 27 09:19:49.386076 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2020/4106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:48 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:49.559654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8c43d34b-fb34-449f-8266-70f931bc4f65 req-d701116b-e6b0-4d9c-994c-03db45598a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1f6ffe-76bb-46ff-a6a8-e15acd41635b", "name": "network-vif-deleted", "tag": "d0ebb7f4-ed59-448e-a0c6-58415d4411b2"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:49.585363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8c43d34b-fb34-449f-8266-70f931bc4f65 req-d701116b-e6b0-4d9c-994c-03db45598a45 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:49.586055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8c43d34b-fb34-449f-8266-70f931bc4f65 req-d701116b-e6b0-4d9c-994c-03db45598a45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:49.586488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8c43d34b-fb34-449f-8266-70f931bc4f65 req-d701116b-e6b0-4d9c-994c-03db45598a45 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:49.617349 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8c43d34b-fb34-449f-8266-70f931bc4f65 req-d701116b-e6b0-4d9c-994c-03db45598a45 service nova] Creating event network-vif-deleted:d0ebb7f4-ed59-448e-a0c6-58415d4411b2 for instance 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b on n-h2-858383-16 Oct 27 09:19:49.623084 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8c43d34b-fb34-449f-8266-70f931bc4f65 req-d701116b-e6b0-4d9c-994c-03db45598a45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067284 Oct 27 09:19:49.623826 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2021/4107] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:19:49.813748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:49.815541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:49.828242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:49.829210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:49.829903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:49.836454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:49.841535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:49.849015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:49.849979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:49.852554 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d938a24-b197-46df-9082-29fcd535a370 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1520 microversion: 2.1 time: 0.520565 Oct 27 09:19:49.854587 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2087/4108] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:49 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1520 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:49.868289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fdae34cb-6a62-44fe-b766-1db3eafe04a1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:49.871169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fdae34cb-6a62-44fe-b766-1db3eafe04a1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:49.891869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdae34cb-6a62-44fe-b766-1db3eafe04a1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:49.897029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdae34cb-6a62-44fe-b766-1db3eafe04a1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:49.897491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdae34cb-6a62-44fe-b766-1db3eafe04a1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:49.898258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdae34cb-6a62-44fe-b766-1db3eafe04a1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:49.898985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdae34cb-6a62-44fe-b766-1db3eafe04a1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:49.899371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdae34cb-6a62-44fe-b766-1db3eafe04a1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:49.988777 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fdae34cb-6a62-44fe-b766-1db3eafe04a1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "POST /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca/action" status: 200 len: 24572 microversion: 2.1 time: 0.132530 Oct 27 09:19:49.989945 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2088/4109] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:19:49 2022] POST /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca/action => generated 24572 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:19:49.998347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b77a72f5-a86b-4945-a199-0b6bc128e2fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1399604063"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:50.005843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b77a72f5-a86b-4945-a199-0b6bc128e2fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:50.026782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a72f5-a86b-4945-a199-0b6bc128e2fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:50.030148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a72f5-a86b-4945-a199-0b6bc128e2fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:50.032514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a72f5-a86b-4945-a199-0b6bc128e2fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:50.035513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a72f5-a86b-4945-a199-0b6bc128e2fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:50.038416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a72f5-a86b-4945-a199-0b6bc128e2fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:50.039681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b77a72f5-a86b-4945-a199-0b6bc128e2fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:50.135088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:50.206398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:50.231312 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-24f6f4e5-47d7-45a7-95ad-f3df1a7dec90 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1315 microversion: 2.1 time: 0.424016 Oct 27 09:19:50.235888 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2022/4110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:49 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:50.348277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:50.349281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:50.359200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:50.360431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:50.362784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:50.363935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:50.368114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:50.368851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:50.439695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:50.440491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:50.441298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:50.442135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lazy-loading 'fault' on Instance uuid 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:19:50.523635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=22 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:50.570456 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b77a72f5-a86b-4945-a199-0b6bc128e2fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action" status: 202 len: 0 microversion: 2.1 time: 0.578883 Oct 27 09:19:50.579234 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2089/4111] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:19:49 2022] POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:19:50.587036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:50.588040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:50.597645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:50.599057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:50.600108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:50.600955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:50.603959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:50.605216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:50.625291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb74165830e493ebec31c7a9edb1d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c09108136b4a139f54ab6b962ab3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:50.652170 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bc54447-958a-40f5-aa5c-613e79406704 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 200 len: 1306 microversion: 2.1 time: 0.307824 Oct 27 09:19:50.653978 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2023/4112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:50 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 1306 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:50.686508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-453407300"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:50.691000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:50.714183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:50.714924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:50.715763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:50.717064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:50.717920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:50.752704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:50.819974 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Cannot 'createImage' instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 while it is in task_state image_snapshot Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action HTTP/1.1 Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 84 Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-453407300"}} Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: exception: Cannot 'createImage' instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 while it is in task_state image_snapshot Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5146b080-63f9-4084-839b-ee9fa3c6c6c4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-453407300'}}} Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:19:50.824574 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 while it is in task_state image_snapshot Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 while it is in task_state image_snapshot Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 409 to user: Cannot 'createImage' instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 while it is in task_state image_snapshot {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:19:50.828609 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e02ab20-31a8-48f2-b809-3e55bb9a19ad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action" status: 409 len: 159 microversion: 2.1 time: 0.171695 Oct 27 09:19:50.830473 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2024/4113] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:19:50 2022] POST /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4/action => generated 159 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:19:50.843975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6344070f-baab-48db-b66a-b94861213bb7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '.version_select at 0x7f31aaabe790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:51.176999 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6344070f-baab-48db-b66a-b94861213bb7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/images/6f7fe102-27a1-4652-a916-c476471cbd80" status: 204 len: 0 microversion: 2.1 time: 0.340182 Oct 27 09:19:51.181739 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2025/4114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:50 2022] DELETE /compute/v2.1/images/6f7fe102-27a1-4652-a916-c476471cbd80 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:19:51.190764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:51.192030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:51.203500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:51.204792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:51.205602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:51.207112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:51.208806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:51.209812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:51.387823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:51.398839 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64788ef2-846b-4bfc-b6a6-dea6f518dfd6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 0.817849 Oct 27 09:19:51.399711 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2090/4115] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:50 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:51.422130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:51.423097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:51.430523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:51.431324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:51.431982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:51.432907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:51.433567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:51.434372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:51.786885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:51.834948 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c282525-0591-40d1-8ce8-2cab048637c2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1532 microversion: 2.1 time: 0.648802 Oct 27 09:19:51.851605 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2026/4116] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:51 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1532 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:51.853355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d407bc3b-9fa4-4301-945f-ca6cfb07ec71 req-0aa2fec2-45b5-45be-a6db-c0cf219cb0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e", "tag": "b6c0099e-113e-4920-b290-fd730dcf9be5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:51.920167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d407bc3b-9fa4-4301-945f-ca6cfb07ec71 req-0aa2fec2-45b5-45be-a6db-c0cf219cb0b0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:51.921079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d407bc3b-9fa4-4301-945f-ca6cfb07ec71 req-0aa2fec2-45b5-45be-a6db-c0cf219cb0b0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:51.921898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d407bc3b-9fa4-4301-945f-ca6cfb07ec71 req-0aa2fec2-45b5-45be-a6db-c0cf219cb0b0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:51.935332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:51.973282 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00349f33-5d2c-4101-a81a-5cd55e125f11 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1503 microversion: 2.1 time: 0.571804 Oct 27 09:19:51.988075 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2091/4117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:51 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1503 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:51.994039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:51.994956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] [instance: 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:52.007918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.008808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.009515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.010451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.011076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.011714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.037105 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d407bc3b-9fa4-4301-945f-ca6cfb07ec71 req-0aa2fec2-45b5-45be-a6db-c0cf219cb0b0 service nova] Creating event network-changed:b6c0099e-113e-4920-b290-fd730dcf9be5 for instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e on n-h1-858383-16 Oct 27 09:19:52.050450 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d407bc3b-9fa4-4301-945f-ca6cfb07ec71 req-0aa2fec2-45b5-45be-a6db-c0cf219cb0b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208252 Oct 27 09:19:52.052702 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2027/4118] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:52.057569 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] HTTP exception thrown: Instance 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b could not be found. Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Request method failure captured: Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b HTTP/1.1 Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk0T881H75-d03hqIiqD0IkAfVSoTnflWL3KSmx3fjJ98JRToXCixtlFao4wQk7gp-_YxGXcM_KQFTs2hX6fzjQ1ZS4S90T7FHbbr7MegfZNKFEJsyuQKhrQgAEGeFOsYC4x4JbU9we1_43PISFdwSKlxuQHT6ys085s9pNvqV_Sz8Q Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: d0c09108136b4a139f54ab6b962ab3fe Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-InstanceActionsTestJSON-1125295005 Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0c09108136b4a139f54ab6b962ab3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d0c09108136b4a139f54ab6b962ab3fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0c09108136b4a139f54ab6b962ab3fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d0c09108136b4a139f54ab6b962ab3fe"}]}] Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-InstanceActionsTestJSON-1125295005 Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: d0c09108136b4a139f54ab6b962ab3fe Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1125295005 Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-InstanceActionsTestJSON-1125295005-project Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4fb74165830e493ebec31c7a9edb1d88 Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-InstanceActionsTestJSON-1125295005-project Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b could not be found. Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4c1f6ffe-76bb-46ff-a6a8-e15acd41635b'} Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b could not be found. Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b could not be found. Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:19:52.060402 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:52.065934 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:19:52.065934 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:19:52.065934 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:19:52.065934 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:19:52.065934 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:19:52.065934 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b could not be found. Oct 27 09:19:52.065934 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:19:52.067870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] Returning 404 to user: Instance 4c1f6ffe-76bb-46ff-a6a8-e15acd41635b could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:19:52.068174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-772e5939-678b-48d7-8c4d-2d4750933112 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:52.069179 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e06fc35-0a4b-4297-8b49-7f7fa4041606 tempest-InstanceActionsTestJSON-1125295005 tempest-InstanceActionsTestJSON-1125295005-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b" status: 404 len: 111 microversion: 2.1 time: 0.079811 Oct 27 09:19:52.070031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-772e5939-678b-48d7-8c4d-2d4750933112 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:52.074049 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2092/4119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:51 2022] GET /compute/v2.1/servers/4c1f6ffe-76bb-46ff-a6a8-e15acd41635b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:19:52.088787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-772e5939-678b-48d7-8c4d-2d4750933112 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.090183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-772e5939-678b-48d7-8c4d-2d4750933112 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.091195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-772e5939-678b-48d7-8c4d-2d4750933112 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.093086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-772e5939-678b-48d7-8c4d-2d4750933112 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.094294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-772e5939-678b-48d7-8c4d-2d4750933112 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.095506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-772e5939-678b-48d7-8c4d-2d4750933112 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.244846 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-772e5939-678b-48d7-8c4d-2d4750933112 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.188342 Oct 27 09:19:52.246540 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2028/4120] 10.222.0.25 () {58 vars in 1296 bytes} [Thu Oct 27 09:19:52 2022] DELETE /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8/os-server-password => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:19:52.260186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a445b02-a128-4ce7-90d8-6911ee314574 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:52.261092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4a445b02-a128-4ce7-90d8-6911ee314574 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:52.272021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a445b02-a128-4ce7-90d8-6911ee314574 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.275244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a445b02-a128-4ce7-90d8-6911ee314574 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.276199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a445b02-a128-4ce7-90d8-6911ee314574 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.277464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a445b02-a128-4ce7-90d8-6911ee314574 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.278718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a445b02-a128-4ce7-90d8-6911ee314574 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.279515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a445b02-a128-4ce7-90d8-6911ee314574 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.318957 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4a445b02-a128-4ce7-90d8-6911ee314574 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.061723 Oct 27 09:19:52.320212 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2093/4121] 10.222.0.25 () {58 vars in 1293 bytes} [Thu Oct 27 09:19:52 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8/os-server-password => generated 16 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:19:52.357281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:52.358164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:52.370237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.371432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.372498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.374005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.375096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.376138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.427861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:52.428763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:52.439899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.441288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.442962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.443957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.445708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:19:52.448356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.448858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.559992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:52.651810 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cafed395-5afc-4a87-9eb7-a840c7717ffd tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 204 len: 0 microversion: 2.1 time: 0.315673 Oct 27 09:19:52.658548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2029/4122] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:19:52 2022] DELETE /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:19:52.670465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:52.671851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:52.684017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.684612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.685204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.688023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.688524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.688964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.689339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:52.707156 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fefa2920-4267-4ebb-8f02-4fc329312708 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 0.283395 Oct 27 09:19:52.709422 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2094/4123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:52 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:52.888785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:52.889896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:52.906524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.910079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.911293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.914936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:52.918966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:52.919896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:52.992339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:53.011017 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9a245ac-1faa-4a34-88c5-a53ae376c200 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1509 microversion: 2.1 time: 0.350169 Oct 27 09:19:53.012115 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2030/4124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:52 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:53.445571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:53.458763 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a98d52d8-2b82-45e7-80e1-779774216aad tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1532 microversion: 2.1 time: 0.576571 Oct 27 09:19:53.461128 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2095/4125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:52 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1532 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:53.733895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:53.734873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:53.743304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:53.744093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:53.744705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:53.745599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:53.746209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:53.746776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:54.041950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:54.042896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:54.054893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:54.055683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:54.057386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:54.058341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:54.064464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:54.065183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:54.169773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:54.179186 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd2c9bb3-a530-47b7-a20d-04efe7bdb62b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 0.449252 Oct 27 09:19:54.194161 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2031/4126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:53 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:54.363515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:54.380151 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b0d2d02e-77ad-4232-987e-578c29787fdc tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1509 microversion: 2.1 time: 0.340571 Oct 27 09:19:54.384890 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2096/4127] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:54 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:54.487635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:54.488544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:54.494885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:54.497006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:54.498823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:54.519470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:54.522044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:54.534600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:54.535873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:54.985518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:54.999971 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb9cb360-303a-47bd-9d89-cd519183b865 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1538 microversion: 2.1 time: 0.516640 Oct 27 09:19:55.005904 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2032/4128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:54 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1538 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:55.214273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:55.215065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:55.233621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:55.234343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:55.237332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:55.240692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:55.248604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:55.249648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:55.422085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:55.423708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:55.433811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:55.436265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:55.440095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:55.441128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:55.441847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:55.442596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:55.611419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:55.643938 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82d45a8e-bab3-476f-924e-4b88d0087b2d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 0.432025 Oct 27 09:19:55.656033 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2097/4129] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:55 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:55.834222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:55.867243 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-55c382e5-7244-41bb-9d45-1abf2bf481c3 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1509 microversion: 2.1 time: 0.453119 Oct 27 09:19:55.872324 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2033/4130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:55 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:56.042400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:56.043642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:56.055774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:56.056699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:56.059173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:56.060779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:56.065254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:56.066123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:56.151904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b548e1a7-ae58-4d40-a570-bd07066ceda1 req-0a1939a2-a400-4eb5-bf5e-426a4a8a383d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5146b080-63f9-4084-839b-ee9fa3c6c6c4", "name": "network-vif-plugged", "status": "completed", "tag": "29c45fd9-1bf6-464d-bab1-8a1811278bd5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:56.173769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b548e1a7-ae58-4d40-a570-bd07066ceda1 req-0a1939a2-a400-4eb5-bf5e-426a4a8a383d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:56.174439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b548e1a7-ae58-4d40-a570-bd07066ceda1 req-0a1939a2-a400-4eb5-bf5e-426a4a8a383d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:56.176920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b548e1a7-ae58-4d40-a570-bd07066ceda1 req-0a1939a2-a400-4eb5-bf5e-426a4a8a383d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:56.210352 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b548e1a7-ae58-4d40-a570-bd07066ceda1 req-0a1939a2-a400-4eb5-bf5e-426a4a8a383d service nova] Creating event network-vif-plugged:29c45fd9-1bf6-464d-bab1-8a1811278bd5 for instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 on n-h2-858383-16 Oct 27 09:19:56.226908 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b548e1a7-ae58-4d40-a570-bd07066ceda1 req-0a1939a2-a400-4eb5-bf5e-426a4a8a383d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079826 Oct 27 09:19:56.230111 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2034/4131] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:56.679448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:56.681194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:56.688416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:56.689267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:56.689963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:56.690861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:56.691487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:56.692196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:57.282362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:57.291181 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4a626c44-ca4f-454f-a65d-cbbaee41b335 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1538 microversion: 2.1 time: 1.254120 Oct 27 09:19:57.292155 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2098/4132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:56 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1538 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:57.310976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:57.312659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:57.322846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:57.343766 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9bcdf7be-217f-432c-acea-d2a9c528ee2c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 0.659451 Oct 27 09:19:57.356720 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2035/4133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:56 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:57.381673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:57.382538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:57.383253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:57.384253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:57.384834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:57.385359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:57.886136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:57.896453 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8401a02e-5bf0-414a-b336-a9db10c29359 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1509 microversion: 2.1 time: 0.593192 Oct 27 09:19:57.915405 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2099/4134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:57 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1509 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:58.314600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:58.315860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:58.348649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:58.349168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:58.349609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:58.350510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:58.351120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:58.351766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:58.371511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:58.372144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:58.386404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:58.391116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:58.391631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:58.392476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:58.393166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:58.397161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:58.407642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:19:58.869430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:58.878955 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d7b8c00-3a79-4647-8882-0fbe9c91679c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1520 microversion: 2.1 time: 0.568394 Oct 27 09:19:58.879540 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2036/4135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:58 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1520 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:58.887146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-21566b7c-d34b-4367-8622-6ab79a350c4c req-d43a7a23-4ca1-44d5-8847-af425dea3c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefe2a4d-8098-4295-a5f5-d7f2ca61fec8", "name": "network-vif-deleted", "tag": "db418740-a0ad-464a-af1a-8a90f4b6be9c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:19:58.900235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:58.909960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-21566b7c-d34b-4367-8622-6ab79a350c4c req-d43a7a23-4ca1-44d5-8847-af425dea3c2c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:58.911597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-21566b7c-d34b-4367-8622-6ab79a350c4c req-d43a7a23-4ca1-44d5-8847-af425dea3c2c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:58.914171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-21566b7c-d34b-4367-8622-6ab79a350c4c req-d43a7a23-4ca1-44d5-8847-af425dea3c2c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:58.915724 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-747bc67a-1b9c-4045-8ef0-11124e41c0d8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 0.548824 Oct 27 09:19:58.916451 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2100/4136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:58 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:19:58.931078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:58.931735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:58.936067 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-21566b7c-d34b-4367-8622-6ab79a350c4c req-d43a7a23-4ca1-44d5-8847-af425dea3c2c service nova] Creating event network-vif-deleted:db418740-a0ad-464a-af1a-8a90f4b6be9c for instance cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 on n-h1-858383-16 Oct 27 09:19:58.940651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:58.941372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:58.941844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:58.942261 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-21566b7c-d34b-4367-8622-6ab79a350c4c req-d43a7a23-4ca1-44d5-8847-af425dea3c2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058557 Oct 27 09:19:58.943119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:58.943600 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2037/4137] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:19:58.945400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:58.946058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:58.950147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:58.951064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:58.960492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:58.961226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:58.961838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:58.962705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:58.963319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:58.964289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:58.993109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:19:59.006430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:59.006922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:59.007363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:59.007839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lazy-loading 'fault' on Instance uuid cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:19:59.068305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd685f5e9ad4342ed997d45e8111103c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d99cb5c593e458cbac6e6815ce71379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:59.082026 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96afaebb-cec9-46f2-9dfd-5faa4a4b6966 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 200 len: 1305 microversion: 2.1 time: 0.136813 Oct 27 09:19:59.084348 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2038/4138] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:58 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 1305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:59.142440 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f472de9-5f26-4f51-a8d4-0a6ef45393d4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 204 len: 0 microversion: 2.1 time: 0.224521 Oct 27 09:19:59.143054 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2101/4139] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:19:58 2022] DELETE /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:19:59.154450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:59.155630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:59.176526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:59.177051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:59.177528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:59.178278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:59.178747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:59.179183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:59.568255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:19:59.586055 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1d80b120-f472-4c30-be7c-00bd01237f08 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1526 microversion: 2.1 time: 0.437684 Oct 27 09:19:59.600684 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2039/4140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:59 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1526 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:19:59.947056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:19:59.949045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:19:59.965743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:59.970223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:59.971553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:19:59.973214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:19:59.973950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:19:59.974645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:00.109602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:00.110549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] [instance: cefe2a4d-8098-4295-a5f5-d7f2ca61fec8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:00.125217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:00.128993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:00.130275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:00.134104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:00.144676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:00.148322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:00.191407 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] HTTP exception thrown: Instance cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 could not be found. Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Request method failure captured: Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 HTTP/1.1 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk0ilNZy47q34cCI0tl4qPCPyhcCa49K5zT44Wn0QKmMitL2Rc71c9YlBbI1FlvJelC5-9-DsNelB0eX82mBTgOSi3sdL-SxxvO8Omwc_qBC6Oec9swUFKxd-v7RW7HJQA6VZqoERP3fP6DmO2EwaS-omWz9jVsCuPd0YdFYbBYKwYA Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 5d99cb5c593e458cbac6e6815ce71379 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerPasswordTestJSON-413892526 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d99cb5c593e458cbac6e6815ce71379"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5d99cb5c593e458cbac6e6815ce71379"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5d99cb5c593e458cbac6e6815ce71379"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5d99cb5c593e458cbac6e6815ce71379"}]}] Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerPasswordTestJSON-413892526 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 5d99cb5c593e458cbac6e6815ce71379 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerPasswordTestJSON-413892526 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerPasswordTestJSON-413892526-project Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d685f5e9ad4342ed997d45e8111103c4 Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerPasswordTestJSON-413892526-project Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 could not be found. Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'cefe2a4d-8098-4295-a5f5-d7f2ca61fec8'} Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 could not be found. Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 could not be found. Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:00.205110 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:00.209554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:00.209554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:00.209554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:00.209554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:20:00.209554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:20:00.209554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 could not be found. Oct 27 09:20:00.209554 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:00.212136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] Returning 404 to user: Instance cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:20:00.213543 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee4a27b3-46bf-4e0f-b8cc-677724a6a141 tempest-ServerPasswordTestJSON-413892526 tempest-ServerPasswordTestJSON-413892526-project] 10.222.0.25 "GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8" status: 404 len: 111 microversion: 2.1 time: 0.108354 Oct 27 09:20:00.214876 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2040/4141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:00 2022] GET /compute/v2.1/servers/cefe2a4d-8098-4295-a5f5-d7f2ca61fec8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:20:00.612592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:00.619292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:00.627562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:00.641350 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a2514de7-a69b-4bde-bdb2-4e8d2e5fbaba tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 0.697354 Oct 27 09:20:00.661643 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2102/4142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:19:59 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:00.665190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:00.666022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:00.666857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:00.668066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:00.668776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:00.669427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:00.696297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ad88d5e9-843a-46db-bbcd-439325f78afe req-d8511667-9876-4d36-9c93-8abaa3932d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e", "name": "network-vif-plugged", "status": "completed", "tag": "b6c0099e-113e-4920-b290-fd730dcf9be5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:00.733572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ad88d5e9-843a-46db-bbcd-439325f78afe req-d8511667-9876-4d36-9c93-8abaa3932d6e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:00.737067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ad88d5e9-843a-46db-bbcd-439325f78afe req-d8511667-9876-4d36-9c93-8abaa3932d6e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:00.738619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ad88d5e9-843a-46db-bbcd-439325f78afe req-d8511667-9876-4d36-9c93-8abaa3932d6e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:00.775417 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ad88d5e9-843a-46db-bbcd-439325f78afe req-d8511667-9876-4d36-9c93-8abaa3932d6e service nova] Creating event network-vif-plugged:b6c0099e-113e-4920-b290-fd730dcf9be5 for instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e on n-h1-858383-16 Oct 27 09:20:00.785299 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ad88d5e9-843a-46db-bbcd-439325f78afe req-d8511667-9876-4d36-9c93-8abaa3932d6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093944 Oct 27 09:20:00.788496 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2103/4143] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:01.667830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:01.669294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:01.679351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:01.680271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:01.680725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:01.681558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:01.682082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:01.682512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:02.361210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:02.381755 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-279f6152-bfee-4970-ab14-862e725d032e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1526 microversion: 2.1 time: 1.774745 Oct 27 09:20:02.398238 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2041/4144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:00 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1526 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:02.869780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0bf04b40-c791-4c16-8eee-c5afec3cdff3 req-ccc6554b-d81a-4d1a-b132-cc52e8ccdecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5146b080-63f9-4084-839b-ee9fa3c6c6c4", "name": "network-vif-unplugged", "status": "completed", "tag": "29c45fd9-1bf6-464d-bab1-8a1811278bd5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:02.883006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0bf04b40-c791-4c16-8eee-c5afec3cdff3 req-ccc6554b-d81a-4d1a-b132-cc52e8ccdecd service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:02.885439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0bf04b40-c791-4c16-8eee-c5afec3cdff3 req-ccc6554b-d81a-4d1a-b132-cc52e8ccdecd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:02.886499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0bf04b40-c791-4c16-8eee-c5afec3cdff3 req-ccc6554b-d81a-4d1a-b132-cc52e8ccdecd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:02.902561 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0bf04b40-c791-4c16-8eee-c5afec3cdff3 req-ccc6554b-d81a-4d1a-b132-cc52e8ccdecd service nova] Creating event network-vif-unplugged:29c45fd9-1bf6-464d-bab1-8a1811278bd5 for instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 on n-h2-858383-16 Oct 27 09:20:02.908596 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0bf04b40-c791-4c16-8eee-c5afec3cdff3 req-ccc6554b-d81a-4d1a-b132-cc52e8ccdecd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042602 Oct 27 09:20:02.909895 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2042/4145] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:20:03.020814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:03.046175 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d07a4c77-5699-4b9e-ab48-d00b4c8ebfdd tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1370 microversion: 2.1 time: 1.382279 Oct 27 09:20:03.058128 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2104/4146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:01 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1370 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:03.414116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:03.414950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:03.429289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:03.440039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:03.440973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:03.442153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:03.443038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:03.443848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:03.636861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:03.653857 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cde7fb16-7808-42a3-8dcf-962efb74b748 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1484 microversion: 2.1 time: 0.245029 Oct 27 09:20:03.654693 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2043/4147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:03 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1484 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:03.783495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-34706fc6-3199-45c2-966a-36f075328f2d req-7ce8becb-c788-4082-bb83-911d7de190ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5146b080-63f9-4084-839b-ee9fa3c6c6c4", "name": "network-vif-deleted", "tag": "29c45fd9-1bf6-464d-bab1-8a1811278bd5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:03.818250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-34706fc6-3199-45c2-966a-36f075328f2d req-7ce8becb-c788-4082-bb83-911d7de190ff service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:03.819256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-34706fc6-3199-45c2-966a-36f075328f2d req-7ce8becb-c788-4082-bb83-911d7de190ff service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:03.820291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-34706fc6-3199-45c2-966a-36f075328f2d req-7ce8becb-c788-4082-bb83-911d7de190ff service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:03.838714 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-34706fc6-3199-45c2-966a-36f075328f2d req-7ce8becb-c788-4082-bb83-911d7de190ff service nova] Creating event network-vif-deleted:29c45fd9-1bf6-464d-bab1-8a1811278bd5 for instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 on n-h2-858383-16 Oct 27 09:20:03.846881 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-34706fc6-3199-45c2-966a-36f075328f2d req-7ce8becb-c788-4082-bb83-911d7de190ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068364 Oct 27 09:20:03.849219 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2105/4148] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:20:04.090806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:04.091511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:04.103629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:04.104115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:04.105509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:04.108627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:04.109317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:04.109910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:04.513983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:04.543315 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f08fafe1-f91a-449c-9ae7-9e8c956e2f5b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1564 microversion: 2.1 time: 0.456778 Oct 27 09:20:04.545838 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2044/4149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:04 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1564 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:04.571612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5ffbf0c3-f91b-401c-bdff-b3fc9e87ba0f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:04.572612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5ffbf0c3-f91b-401c-bdff-b3fc9e87ba0f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:04.586607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ffbf0c3-f91b-401c-bdff-b3fc9e87ba0f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:04.587299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ffbf0c3-f91b-401c-bdff-b3fc9e87ba0f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:04.587785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ffbf0c3-f91b-401c-bdff-b3fc9e87ba0f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:04.588520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ffbf0c3-f91b-401c-bdff-b3fc9e87ba0f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:04.589015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ffbf0c3-f91b-401c-bdff-b3fc9e87ba0f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:04.589471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ffbf0c3-f91b-401c-bdff-b3fc9e87ba0f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:04.679399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:04.680071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:04.688981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:04.689484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:04.690145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:04.691413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:04.692164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:04.695824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:04.776322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:04.776817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:04.777373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:04.777701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lazy-loading 'fault' on Instance uuid 5146b080-63f9-4084-839b-ee9fa3c6c6c4 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:20:04.905246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:04.931673 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5ffbf0c3-f91b-401c-bdff-b3fc9e87ba0f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.365275 Oct 27 09:20:04.932439 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2106/4150] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:20:04 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-interface => generated 285 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:20:04.944497 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8280556e-a150-4cd7-9696-189af4870c87 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 200 len: 1315 microversion: 2.1 time: 0.268976 Oct 27 09:20:04.946180 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2045/4151] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:04 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:05.992738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:05.994066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:06.002191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:06.003166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:06.003874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:06.004917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:06.005614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:06.006269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:06.025479 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 HTTP/1.1 Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5146b080-63f9-4084-839b-ee9fa3c6c6c4'} Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:06.027772 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:06.031351 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:06.031351 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:06.031351 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:06.031351 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:06.031351 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:20:06.031351 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:20:06.031351 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:20:06.031351 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:06.033504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:20:06.034698 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82bef628-96c4-4c2d-b189-912885c4dbcf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 404 len: 111 microversion: 2.1 time: 0.047121 Oct 27 09:20:06.036724 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2107/4152] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:05 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:20:06.050878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e154a3ad-6305-4655-95eb-4dd13f3bacdf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'create', calling method: .version_select at 0x7f31a8ff0d30>, body: {"keypair": {"name": "tempest-keypair-2131355798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUnF0UWzKg9WrGWXb2Srg0y7QS7iCh6bFLt2QiqrxVA+GVEHHwyHsXaK8zezNf9SxZuEme8aBJfRAoHrmdvXTlIK4Tkb1IBhQegrD8pVzh00J9Byt/Zf22i9PgBVwe2Gg=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:06.072193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-e154a3ad-6305-4655-95eb-4dd13f3bacdf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Getting quotas for project b4f37ec78b0c4015812d9ccb67992c35. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:20:06.080588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-e154a3ad-6305-4655-95eb-4dd13f3bacdf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Getting quotas for user 9cf86af347d545c79ccb2fdef888e23d and project b4f37ec78b0c4015812d9ccb67992c35. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:20:06.137309 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e154a3ad-6305-4655-95eb-4dd13f3bacdf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090789 Oct 27 09:20:06.146118 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2046/4153] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:20:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:20:09.562744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-32422fc7-9f2b-4970-b630-8dda42baccae req-644c0bd4-44bc-4878-99b1-bc07bbc42157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e", "tag": "b6c0099e-113e-4920-b290-fd730dcf9be5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:09.585482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-32422fc7-9f2b-4970-b630-8dda42baccae req-644c0bd4-44bc-4878-99b1-bc07bbc42157 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:09.585964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-32422fc7-9f2b-4970-b630-8dda42baccae req-644c0bd4-44bc-4878-99b1-bc07bbc42157 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:09.588218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-32422fc7-9f2b-4970-b630-8dda42baccae req-644c0bd4-44bc-4878-99b1-bc07bbc42157 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:09.615489 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-32422fc7-9f2b-4970-b630-8dda42baccae req-644c0bd4-44bc-4878-99b1-bc07bbc42157 service nova] Creating event network-changed:b6c0099e-113e-4920-b290-fd730dcf9be5 for instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e on n-h1-858383-16 Oct 27 09:20:09.630031 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-32422fc7-9f2b-4970-b630-8dda42baccae req-644c0bd4-44bc-4878-99b1-bc07bbc42157 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071515 Oct 27 09:20:09.631054 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2108/4154] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:20:13.784127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1738688448", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:13.833347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:13.908105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] validate_networks() for [('9d86e802-a9a7-4669-970c-b155c0dd14a5', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:20:14.069294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c2042401-b2ef-4c74-b2d2-3260e26ae84b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'create', calling method: .version_select at 0x7f31aa20d550>, body: {"keypair": {"name": "tempest-keypair-110512966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuuwoNzPR+lPo4EVMFr+uI9BAjp247VSzQ4SYfbtxI8822GfGB6Znj8S8KwrODWG5r6uK3LibQzRgbAPSlCW9rDlcCgRie0C3sFOx1yW5bedl4AVIyFpdL/e+YfxkvZJw=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:14.102182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-c2042401-b2ef-4c74-b2d2-3260e26ae84b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for project b4c5d43a28c24b63b960932c678d0858. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:20:14.115505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-c2042401-b2ef-4c74-b2d2-3260e26ae84b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for user 9301fb54a8734e1ab31e496add7e9446 and project b4c5d43a28c24b63b960932c678d0858. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:20:14.179356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c2042401-b2ef-4c74-b2d2-3260e26ae84b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.522399 Oct 27 09:20:14.180465 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2047/4155] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:20:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:15.550443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:20:15.551560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:20:15.552225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:20:15.552805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:20:15.553370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:20:15.574792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:15.575652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:15.576255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:15.577199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:15.577824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:15.578435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:15.627957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Getting quotas for project b4f37ec78b0c4015812d9ccb67992c35. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:20:15.643654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Getting quotas for user 9cf86af347d545c79ccb2fdef888e23d and project b4f37ec78b0c4015812d9ccb67992c35. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:20:15.678080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:20:15.680777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:20:15.769999 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a3cd3df-ad0b-47c2-80c4-91e1f5822995 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.992735 Oct 27 09:20:15.777539 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2109/4156] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:20:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:20:15.780005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:15.788083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4b41a4c-981a-40a9-87b0-20739e5777b3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:15.788629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4b41a4c-981a-40a9-87b0-20739e5777b3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:16.112493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c4b41a4c-981a-40a9-87b0-20739e5777b3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:16.128570 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4b41a4c-981a-40a9-87b0-20739e5777b3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1225 microversion: 2.1 time: 0.349204 Oct 27 09:20:16.130146 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2048/4157] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:15 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1225 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:17.166838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:17.168373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:17.205831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:17.211726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:17.212913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:17.214723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:17.215582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:17.216812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:17.350205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:17.358942 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7eb81e26-d1db-4742-aa96-b327087abaaf tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1277 microversion: 2.1 time: 0.197173 Oct 27 09:20:17.364534 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2110/4158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:17 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:18.383536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:18.384184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:18.401467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:18.402214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:18.402846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:18.403978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:18.404621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:18.408365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:18.572393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:18.586925 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-711e5b86-9b84-444f-9ed6-fd92df4eba06 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1283 microversion: 2.1 time: 0.206823 Oct 27 09:20:18.604818 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2049/4159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:18 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1283 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:19.062050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-380450974", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cad971b-61f2-43dd-8137-4ee7400ac93f"}], "security_groups": [{"name": "tempest-securitygroup--1121399164"}], "key_name": "tempest-keypair-110512966", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:19.430566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] validate_networks() for [('9cad971b-61f2-43dd-8137-4ee7400ac93f', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:20:19.623936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:19.625553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:19.633887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:19.635140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:19.636170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:19.637357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:19.638071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:19.638780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:19.883041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:19.904660 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8fea4c2-25c3-4086-9ce6-482c1fbd07ca tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1283 microversion: 2.1 time: 0.285854 Oct 27 09:20:19.924950 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2050/4160] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:19 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1283 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:20.942396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:20.943452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:20.953436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:20.953952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:20.954411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:20.955324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:20.955825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:20.956267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:21.828926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:20:21.828926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:20:21.828926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:20:21.828926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:20:21.830032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:20:21.841171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:21.841978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:21.842602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:21.843587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:21.844265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:21.844880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:21.866671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:20:21.873624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for user 9301fb54a8734e1ab31e496add7e9446 and project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:20:21.904088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:20:21.910536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:20:22.008175 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa131aa1-874c-4b20-97fe-f9aefc7bee35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.950465 Oct 27 09:20:22.019887 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2111/4161] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:20:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 2963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:20:22.025682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:22.026447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:22.035330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:22.037628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:22.038498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:22.039738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:22.040391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:22.041305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:22.074089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:20:22.138274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:22.152313 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49831d6f-8779-4c0a-8063-14b1d911da8c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1325 microversion: 2.1 time: 1.221656 Oct 27 09:20:22.168893 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2051/4162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:20 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1325 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:22.178417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-43f595a4-32c6-4faf-9ddd-446d52145161 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:22.181889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-43f595a4-32c6-4faf-9ddd-446d52145161 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:22.282396 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e48863c8-af82-4462-80b4-cfbe36c20cf2 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 204 len: 0 microversion: 2.1 time: 0.260000 Oct 27 09:20:22.290856 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2112/4163] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:20:22 2022] DELETE /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:20:22.311156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:22.313132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:22.336885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-43f595a4-32c6-4faf-9ddd-446d52145161 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:22.338586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:22.339526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:22.340678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:22.342433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:22.343978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:22.345228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:22.367080 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-43f595a4-32c6-4faf-9ddd-446d52145161 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1237 microversion: 2.1 time: 0.184444 Oct 27 09:20:22.368308 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2052/4164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:22 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1237 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:23.187664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:23.190117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:23.210909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:23.212351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:23.213481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:23.215337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:23.216557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:23.217687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:23.233566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:23.246594 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a003c711-354e-4e74-a6e4-0ac6e9b7cfc8 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1665 microversion: 2.1 time: 0.950791 Oct 27 09:20:23.246976 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2113/4165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:22 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1665 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:23.403597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:23.404382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:23.419317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:23.419844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:23.420438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:23.421365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:23.421668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:23.422255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:23.611812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:23.624259 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a54d2e6-bc35-420f-bf58-a53def70708f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1289 microversion: 2.1 time: 0.224429 Oct 27 09:20:23.624950 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2114/4166] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:23 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1289 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:23.794887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:23.816949 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d45e11a-5b65-4b18-8421-04ab4f83bb52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1325 microversion: 2.1 time: 0.634123 Oct 27 09:20:23.820679 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2053/4167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:23 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1325 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:24.299787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:24.301079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:24.312926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:24.313973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:24.314593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:24.317424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:24.318416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:24.319147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:24.665889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:24.667359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:24.671370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:24.679357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:24.680590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:24.681211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:24.682305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:24.682884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:24.683556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:24.844385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:24.857667 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46cd7307-4816-4294-854a-511fe6764966 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1295 microversion: 2.1 time: 0.198329 Oct 27 09:20:24.859422 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2054/4168] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:24 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1295 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:24.886568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:24.887163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:24.894855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:24.895380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:24.895825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:24.896813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:24.897260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:24.897863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:24.952294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:24.969236 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57b0aecf-ab80-42d1-80e1-24e7c99dffe9 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1665 microversion: 2.1 time: 0.675953 Oct 27 09:20:24.984752 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2115/4169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:24 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1665 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:25.796361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b9b3fb16-e10a-4193-aa44-20cd71d9e201 req-0d7ff9d3-6bb3-4b1b-abf6-c13a9aa945e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a30a71-9684-40d4-956c-89720806bff3", "tag": "106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:25.825421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b9b3fb16-e10a-4193-aa44-20cd71d9e201 req-0d7ff9d3-6bb3-4b1b-abf6-c13a9aa945e2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:25.827253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b9b3fb16-e10a-4193-aa44-20cd71d9e201 req-0d7ff9d3-6bb3-4b1b-abf6-c13a9aa945e2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:25.829639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b9b3fb16-e10a-4193-aa44-20cd71d9e201 req-0d7ff9d3-6bb3-4b1b-abf6-c13a9aa945e2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:25.857200 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b9b3fb16-e10a-4193-aa44-20cd71d9e201 req-0d7ff9d3-6bb3-4b1b-abf6-c13a9aa945e2 service nova] Creating event network-changed:106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c for instance 86a30a71-9684-40d4-956c-89720806bff3 on n-h2-858383-16 Oct 27 09:20:25.870243 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b9b3fb16-e10a-4193-aa44-20cd71d9e201 req-0d7ff9d3-6bb3-4b1b-abf6-c13a9aa945e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093437 Oct 27 09:20:25.872148 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2116/4170] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:20:25.897814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:25.900641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:25.910997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:25.915917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:25.917245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:25.918802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:25.920767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:25.921909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:25.923368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:25.928489 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85174aed-e1ef-48a1-9fa6-fc8f010ec0c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1325 microversion: 2.1 time: 1.053472 Oct 27 09:20:25.929089 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2055/4171] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:24 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1325 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:26.027311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:26.028878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:26.037487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:26.037994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:26.038451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:26.039217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:26.039768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:26.040452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:26.108891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:26.118966 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4145e85c-e4ce-4657-9999-52b9b6c7afcc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1295 microversion: 2.1 time: 0.232292 Oct 27 09:20:26.119980 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2117/4172] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:25 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1295 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:26.695842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:26.742638 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80e73cb4-685b-44b6-be3a-ace1d223855c tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1665 microversion: 2.1 time: 0.716746 Oct 27 09:20:26.747914 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2056/4173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:26 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1665 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:26.960098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:26.961400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:26.990333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:26.991945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:26.993065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:26.998559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:27.000723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:27.001794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:27.065522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:27.163097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:27.164460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:27.185086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:27.185994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:27.187059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:27.189436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:27.190668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:27.193475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:27.805027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:27.844471 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19f898dc-2307-4129-8cc0-4d1e532c9974 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1325 microversion: 2.1 time: 0.895509 Oct 27 09:20:27.848174 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2118/4174] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:26 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1325 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:27.880360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:27.882873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:27.921038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:27.922023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:27.933180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:27.936056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:27.937851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:27.939171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:28.211304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:28.240702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6238eb25-caec-4579-8680-43c4dbaf8dd8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1363 microversion: 2.1 time: 1.089578 Oct 27 09:20:28.242421 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2057/4175] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:27 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1363 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:28.282692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:28.312748 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2cf3dbda-91d8-4841-8eb8-e22cd11b7498 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1598 microversion: 2.1 time: 0.459495 Oct 27 09:20:28.332523 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2119/4176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:27 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1598 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:28.404196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a3976c86-7dc2-44f8-8828-5902d8d04316 req-d22a3e8d-d791-4619-b21a-7f2d69d5d200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:28.449504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a3976c86-7dc2-44f8-8828-5902d8d04316 req-d22a3e8d-d791-4619-b21a-7f2d69d5d200 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:28.450385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a3976c86-7dc2-44f8-8828-5902d8d04316 req-d22a3e8d-d791-4619-b21a-7f2d69d5d200 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:28.459990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a3976c86-7dc2-44f8-8828-5902d8d04316 req-d22a3e8d-d791-4619-b21a-7f2d69d5d200 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:28.499772 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a3976c86-7dc2-44f8-8828-5902d8d04316 req-d22a3e8d-d791-4619-b21a-7f2d69d5d200 service nova] Creating event network-changed:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:20:28.520991 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a3976c86-7dc2-44f8-8828-5902d8d04316 req-d22a3e8d-d791-4619-b21a-7f2d69d5d200 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123649 Oct 27 09:20:28.528193 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2058/4177] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:28.876261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:28.877543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:28.899078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:28.899923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:28.900567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:28.901485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:28.903375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:28.905036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:29.283597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:29.285683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:29.321530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:29.322401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:29.336173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:29.337503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:29.338356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:29.339176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:30.021553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:30.037117 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-657acbac-ed8e-4cd3-b957-751f9ecf8d52 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1325 microversion: 2.1 time: 1.169466 Oct 27 09:20:30.037976 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2120/4178] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:28 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1325 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:30.051921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:30.057653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:30.077256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:30.078038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:30.079925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:30.081079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:30.082919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:30.087091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:30.173019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:30.174668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:30.176182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:30.178221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lazy-loading 'fault' on Instance uuid 7793923e-d34b-4c64-93fb-e6c613e415f8 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:20:30.402467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0d8bc085d444839ae0c21401bafec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c92a1c6ae774bea968e8e28ef72ff28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:30.421130 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8cc5ca62-323f-4db5-a4e1-16c7a8838a61 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 200 len: 1316 microversion: 2.1 time: 0.380344 Oct 27 09:20:30.441669 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2121/4179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:30 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:30.448015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b1e859c1-dd28-4acf-8b6c-c2e701cecb2b req-845d7081-87ab-44e1-8387-5f457e61f44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7793923e-d34b-4c64-93fb-e6c613e415f8", "name": "network-vif-deleted", "tag": "03066d75-6d26-4720-8434-0925e64350a3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:30.461095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b1e859c1-dd28-4acf-8b6c-c2e701cecb2b req-845d7081-87ab-44e1-8387-5f457e61f44b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:30.466194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b1e859c1-dd28-4acf-8b6c-c2e701cecb2b req-845d7081-87ab-44e1-8387-5f457e61f44b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:30.469318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b1e859c1-dd28-4acf-8b6c-c2e701cecb2b req-845d7081-87ab-44e1-8387-5f457e61f44b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:30.491287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:30.502794 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e1f67e3e-90c7-4979-93a1-49db20d4e319 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1363 microversion: 2.1 time: 1.238990 Oct 27 09:20:30.513763 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2059/4180] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:29 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1363 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:30.514636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b1e859c1-dd28-4acf-8b6c-c2e701cecb2b req-845d7081-87ab-44e1-8387-5f457e61f44b service nova] Creating event network-vif-deleted:03066d75-6d26-4720-8434-0925e64350a3 for instance 7793923e-d34b-4c64-93fb-e6c613e415f8 on n-h1-858383-16 Oct 27 09:20:30.521323 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b1e859c1-dd28-4acf-8b6c-c2e701cecb2b req-845d7081-87ab-44e1-8387-5f457e61f44b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077420 Oct 27 09:20:30.526850 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2122/4181] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:31.096490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:31.097258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:31.116690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:31.121737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:31.122497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:31.127469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:31.128935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:31.142915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:31.458746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:31.459715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] [instance: 7793923e-d34b-4c64-93fb-e6c613e415f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:31.480393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:31.481781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:31.483000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:31.484375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:31.485336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:31.486339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:31.592044 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] HTTP exception thrown: Instance 7793923e-d34b-4c64-93fb-e6c613e415f8 could not be found. Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Request method failure captured: Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 HTTP/1.1 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkzgm96l6ZCwRm9M5OnjLyojWVoiPSDaKGFEgVyhm5vCKKU2oukmSFjFF0-s8N5xMyzV8FGG1oKzImwxvAiZjT9vNveh8haUtwuQ30Nv0kQjcSOwncqPJnCZx0hNzJ_iRwkdZBH1gLowrl8H2HyZtUtyfXQr8vHOR-5wEpAbjYa2fBk Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0c92a1c6ae774bea968e8e28ef72ff28 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestFqdnHostnames-1495752579 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c92a1c6ae774bea968e8e28ef72ff28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c92a1c6ae774bea968e8e28ef72ff28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c92a1c6ae774bea968e8e28ef72ff28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c92a1c6ae774bea968e8e28ef72ff28"}]}] Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestFqdnHostnames-1495752579 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0c92a1c6ae774bea968e8e28ef72ff28 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1495752579 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestFqdnHostnames-1495752579-project Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: af0d8bc085d444839ae0c21401bafec3 Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestFqdnHostnames-1495752579-project Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 7793923e-d34b-4c64-93fb-e6c613e415f8 could not be found. Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7793923e-d34b-4c64-93fb-e6c613e415f8'} Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7793923e-d34b-4c64-93fb-e6c613e415f8 could not be found. Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7793923e-d34b-4c64-93fb-e6c613e415f8 could not be found. Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:31.597818 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:31.608325 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:31.608325 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:31.608325 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:31.608325 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:20:31.608325 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:20:31.608325 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7793923e-d34b-4c64-93fb-e6c613e415f8 could not be found. Oct 27 09:20:31.608325 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:20:31.634246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Returning 404 to user: Instance 7793923e-d34b-4c64-93fb-e6c613e415f8 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:20:31.634246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4e37cc09-261b-4203-8584-2a42a4c3e499 tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8" status: 404 len: 111 microversion: 2.1 time: 0.188985 Oct 27 09:20:31.634871 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2123/4182] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:31 2022] GET /compute/v2.1/servers/7793923e-d34b-4c64-93fb-e6c613e415f8 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:20:31.656121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:31.657482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:31.685233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:31.685821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:31.686613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:31.689485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:31.690856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:31.695095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:31.745707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:31.770197 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f60a646-319b-4d79-a0ee-2129080e18b7 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1325 microversion: 2.1 time: 0.682790 Oct 27 09:20:31.770813 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2060/4183] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:31 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1325 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:31.808640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9cad179-5f60-4aa1-953b-a18828d0a9ab tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] Calling method '.version_select at 0x7f31a8f9e310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:31.855459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:31.885829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:31.886043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9cad179-5f60-4aa1-953b-a18828d0a9ab tempest-ServersTestFqdnHostnames-1495752579 tempest-ServersTestFqdnHostnames-1495752579-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525138912" status: 202 len: 0 microversion: 2.1 time: 0.082872 Oct 27 09:20:31.893444 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2061/4184] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 09:20:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525138912 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:20:32.470929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:32.484093 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84272b7c-bab4-411b-b2d5-e216b72e81f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1363 microversion: 2.1 time: 0.837548 Oct 27 09:20:32.486333 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2124/4185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:31 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1363 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:32.800949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:32.805774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:32.806420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:32.828954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:32.829643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:32.830096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:32.831012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:32.831719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:32.833463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:33.515632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:33.516319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:33.536584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:33.536584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:33.536750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:33.540715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:33.543738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:33.550547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:34.014536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:34.031766 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e105c34-3397-4228-811a-021294d2fcb0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1325 microversion: 2.1 time: 1.232938 Oct 27 09:20:34.033018 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2062/4186] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:32 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1325 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:34.688767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:34.704989 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-077bebf4-4e3f-451d-ab4a-a1d842ad5b36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1363 microversion: 2.1 time: 1.195093 Oct 27 09:20:34.707196 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2125/4187] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:33 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1363 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:34.921205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3c62fb0f-1413-4557-b36d-62a6d55762c5 req-7aba15cd-d352-43a8-a1bf-29c5aece1ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a30a71-9684-40d4-956c-89720806bff3", "name": "network-vif-plugged", "status": "completed", "tag": "106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:34.933685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3c62fb0f-1413-4557-b36d-62a6d55762c5 req-7aba15cd-d352-43a8-a1bf-29c5aece1ffc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:34.934343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3c62fb0f-1413-4557-b36d-62a6d55762c5 req-7aba15cd-d352-43a8-a1bf-29c5aece1ffc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:34.934988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3c62fb0f-1413-4557-b36d-62a6d55762c5 req-7aba15cd-d352-43a8-a1bf-29c5aece1ffc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:34.951805 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3c62fb0f-1413-4557-b36d-62a6d55762c5 req-7aba15cd-d352-43a8-a1bf-29c5aece1ffc service nova] Creating event network-vif-plugged:106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c for instance 86a30a71-9684-40d4-956c-89720806bff3 on n-h2-858383-16 Oct 27 09:20:34.959083 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3c62fb0f-1413-4557-b36d-62a6d55762c5 req-7aba15cd-d352-43a8-a1bf-29c5aece1ffc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.458506 Oct 27 09:20:34.960478 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2063/4188] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:35.060252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:35.066933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:35.083081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:35.084530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:35.086338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:35.087403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:35.088143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:35.088811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:35.745736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:35.746594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:35.757165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:35.760072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:35.762303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:35.763344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:35.765128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:35.767623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:35.940223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:35.994920 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10fbca87-846f-44aa-977e-046aca255162 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1325 microversion: 2.1 time: 0.940149 Oct 27 09:20:36.035048 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2126/4189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:35 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1325 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:36.692100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:36.703901 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62618c82-bcc2-40f2-88f8-1484775cfa36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1363 microversion: 2.1 time: 0.962084 Oct 27 09:20:36.705125 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2064/4190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:35 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1363 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:37.042250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:37.043298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:37.056346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:37.058136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:37.059221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:37.060954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:37.061828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:37.062680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:37.532722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:37.547156 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b8139c1-c7df-424a-8698-6c6fff781217 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1325 microversion: 2.1 time: 0.508517 Oct 27 09:20:37.551645 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2127/4191] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:37 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:37.749243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:37.751798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:37.770502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:37.771521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:37.772213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:37.773478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:37.774478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:37.775473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:38.048982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97618c2e-83ce-4fc8-8227-1e5edd67df56 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Action: 'create', calling method: .version_select at 0x7f31aa57a160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-47130268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo515mgcHR9HTT1yVGEoabnKsuydAf3GtnF0yqTd807g3wHVEM6PRkjWZMNyBJzubA6B5t6X+S2avLrBj8j19J/jwwvPu+J3Bk/M4VO2/80YNa/5lkQMQCqZUb/sdQIug=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:38.093270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-97618c2e-83ce-4fc8-8227-1e5edd67df56 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:20:38.121648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-97618c2e-83ce-4fc8-8227-1e5edd67df56 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for user 203ed8cc61274041ae7a9bb1ac09fd1a and project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:20:38.214382 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97618c2e-83ce-4fc8-8227-1e5edd67df56 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.174861 Oct 27 09:20:38.215941 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2128/4192] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:20:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:38.391131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:38.416251 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e95e49c6-c4a7-48f2-b527-50e36d08743c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1363 microversion: 2.1 time: 0.676254 Oct 27 09:20:38.417601 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2065/4193] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:37 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1363 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:38.572983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:38.573735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:38.581111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:38.582484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:38.583198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:38.584739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:38.585515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:38.586380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:39.375063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:39.398723 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6e674b4e-704b-44f6-9ccf-f319f02cc2ce tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1521 microversion: 2.1 time: 0.829345 Oct 27 09:20:39.406864 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2129/4194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:38 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1521 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:39.477382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:39.478239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:39.478897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:39.480332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:39.502342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:39.502490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:39.503495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:39.503975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:39.505532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:39.508706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:39.508985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:39.509268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:39.509720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:39.511011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:39.512683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:39.514037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:40.633150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:40.702366 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8ff2a8b-aec7-402e-ba21-cd642cfe13a6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1521 microversion: 2.1 time: 1.246409 Oct 27 09:20:40.703488 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2130/4195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:39 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1521 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:40.814950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1961901786", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:40.830788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:40.840767 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0aee6c8f-2957-4536-b76b-6e4ef66b18d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1363 microversion: 2.1 time: 1.386994 Oct 27 09:20:40.843957 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2066/4196] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:39 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1363 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:40.860034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a712a4b5-3007-41cb-847b-ae11b538caf4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1627635650"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:40.863694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a712a4b5-3007-41cb-847b-ae11b538caf4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:40.875621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a712a4b5-3007-41cb-847b-ae11b538caf4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:40.877228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a712a4b5-3007-41cb-847b-ae11b538caf4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:40.878999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a712a4b5-3007-41cb-847b-ae11b538caf4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:40.880183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a712a4b5-3007-41cb-847b-ae11b538caf4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:40.880880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a712a4b5-3007-41cb-847b-ae11b538caf4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:40.881517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a712a4b5-3007-41cb-847b-ae11b538caf4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:40.928262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] validate_networks() for [('a6cfd113-0f98-4e57-b7a4-b86be21d6bde', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:20:41.312964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:41.384789 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a712a4b5-3007-41cb-847b-ae11b538caf4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3/action" status: 202 len: 0 microversion: 2.1 time: 0.539216 Oct 27 09:20:41.385470 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2067/4197] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:20:40 2022] POST /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:20:41.411419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d033bc1-fc3a-41ab-9b98-04f310439f61 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '.version_select at 0x7f31aa0ef940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:41.798932 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d033bc1-fc3a-41ab-9b98-04f310439f61 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/images/e31b0728-a012-473e-b94c-b7dbdfb23e00" status: 204 len: 0 microversion: 2.1 time: 0.394904 Oct 27 09:20:41.805358 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2068/4198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:41 2022] DELETE /compute/v2.1/images/e31b0728-a012-473e-b94c-b7dbdfb23e00 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:20:41.814866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9114ceaa-5f64-4dab-9e6d-437be1936b85 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '.version_select at 0x7f31a8f14700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:41.845800 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-9114ceaa-5f64-4dab-9e6d-437be1936b85 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Image not found. Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9114ceaa-5f64-4dab-9e6d-437be1936b85 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/images/e31b0728-a012-473e-b94c-b7dbdfb23e00 HTTP/1.1 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'e31b0728-a012-473e-b94c-b7dbdfb23e00'} Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e31b0728-a012-473e-b94c-b7dbdfb23e00 Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 27 09:20:41.850161 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e31b0728-a012-473e-b94c-b7dbdfb23e00 could not be found. Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:20:41.856714 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:41.870244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9114ceaa-5f64-4dab-9e6d-437be1936b85 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:20:41.872810 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9114ceaa-5f64-4dab-9e6d-437be1936b85 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/images/e31b0728-a012-473e-b94c-b7dbdfb23e00" status: 404 len: 62 microversion: 2.1 time: 0.065534 Oct 27 09:20:41.878967 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2069/4199] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 27 09:20:41 2022] GET /compute/v2.1/images/e31b0728-a012-473e-b94c-b7dbdfb23e00 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:20:41.889200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:41.890689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:41.905134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:41.906375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:41.907094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:41.908690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:41.909785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:41.910909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:42.591147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:42.617741 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b40cb683-93d4-49d1-82d8-16e0895b9da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1363 microversion: 2.1 time: 0.735526 Oct 27 09:20:42.644395 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2070/4200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:41 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1363 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:42.660522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:42.667105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:42.689290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:42.690954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:42.694163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:42.696452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:42.698727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:42.701172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:43.736293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:20:43.742648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:20:43.744655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:20:43.749007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:20:43.752464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:20:43.776432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:43.777339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:43.777977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:43.779608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:43.781362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:43.781842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:43.807061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Getting quotas for project e5b63428955b4c559e8ef364dffe0468. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:20:43.814374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Getting quotas for user 797473ddfd5b416a91ef60b8c8da778a and project e5b63428955b4c559e8ef364dffe0468. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:20:43.819683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:43.836023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:20:43.839406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:20:43.936633 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-41cbc7b6-7b73-405c-937d-85f35d461cd4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.231604 Oct 27 09:20:43.938352 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2131/4201] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:20:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 3234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:20:43.969493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-504751777", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "60a36ff8-2e05-41dc-8b81-4972d77ad9d7"}], "key_name": "tempest-TestNetworkBasicOps-47130268", "security_groups": [{"name": "tempest-secgroup-smoke-1770541766"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:44.127307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:44.139671 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e3e57776-6a13-4dcc-816b-cb01616260df tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1533 microversion: 2.1 time: 1.492602 Oct 27 09:20:44.140962 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2071/4202] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:42 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1533 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:44.146606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1f96e72d-bec5-45db-b757-96de7de49988 req-0c9f2352-f99e-4212-8d68-6d4f908e21b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "name": "network-vif-plugged", "status": "completed", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:44.176808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1f96e72d-bec5-45db-b757-96de7de49988 req-0c9f2352-f99e-4212-8d68-6d4f908e21b0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:44.177686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1f96e72d-bec5-45db-b757-96de7de49988 req-0c9f2352-f99e-4212-8d68-6d4f908e21b0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:44.178368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1f96e72d-bec5-45db-b757-96de7de49988 req-0c9f2352-f99e-4212-8d68-6d4f908e21b0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:44.193449 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1f96e72d-bec5-45db-b757-96de7de49988 req-0c9f2352-f99e-4212-8d68-6d4f908e21b0 service nova] Creating event network-vif-plugged:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:20:44.200099 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1f96e72d-bec5-45db-b757-96de7de49988 req-0c9f2352-f99e-4212-8d68-6d4f908e21b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057630 Oct 27 09:20:44.201652 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2072/4203] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:44.209255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:44.210250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:44.220588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:44.226002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:44.231417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:44.232638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:44.233485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:44.234163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:45.684009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] validate_networks() for [('60a36ff8-2e05-41dc-8b81-4972d77ad9d7', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:20:45.965698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:46.011047 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb978fc3-f2ac-4808-aa06-ac4d0a507601 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1363 microversion: 2.1 time: 1.807309 Oct 27 09:20:46.044341 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2073/4204] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:44 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1363 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:46.053952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:46.055370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:46.076175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:46.077410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:46.078604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:46.085306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:46.086399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:46.087488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:46.450636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:46.468043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d464e5e1-f2aa-4630-bf56-6859084ef1de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1275 microversion: 2.1 time: 0.420478 Oct 27 09:20:46.468705 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2074/4205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:46 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1275 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:46.490482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:46.492365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:46.500230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:46.501426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:46.502097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:46.503983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:46.504660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:46.505260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:47.767157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:47.792251 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-064a8372-d1bb-422e-8a34-5c48ea5f1a6f tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1539 microversion: 2.1 time: 1.321888 Oct 27 09:20:47.802448 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2075/4206] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:46 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1539 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:47.820994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:47.824472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:47.832980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:47.833607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:47.834118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:47.835099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:47.836170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:47.836918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:48.634434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:48.645529 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48e4f1fd-1dca-44ec-86d8-f6d5cc48f579 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1550 microversion: 2.1 time: 0.840641 Oct 27 09:20:48.647321 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2076/4207] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:47 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1550 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:48.666238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:48.668473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:48.685729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:48.688365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:48.690149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:48.691796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:48.693044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:48.694029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:49.225112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:49.239095 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2879ae4c-93ea-4663-ad07-d5dd9a4b6625 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1281 microversion: 2.1 time: 0.588293 Oct 27 09:20:49.255241 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2077/4208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:48 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1281 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:49.255241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c19e4229-3c11-4ead-8ebd-77286259e7b2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:49.255241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c19e4229-3c11-4ead-8ebd-77286259e7b2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:49.263934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19e4229-3c11-4ead-8ebd-77286259e7b2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:49.265579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19e4229-3c11-4ead-8ebd-77286259e7b2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:49.267159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19e4229-3c11-4ead-8ebd-77286259e7b2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:49.268726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19e4229-3c11-4ead-8ebd-77286259e7b2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:49.269954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19e4229-3c11-4ead-8ebd-77286259e7b2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:49.270616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c19e4229-3c11-4ead-8ebd-77286259e7b2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:49.341134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:20:49.341770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:20:49.342577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:20:49.343207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:20:49.343885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:20:49.373578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:49.374654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:49.376575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:49.383316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:49.384500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:49.387714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:49.440581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:20:49.455084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for user 203ed8cc61274041ae7a9bb1ac09fd1a and project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:20:49.490668 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c19e4229-3c11-4ead-8ebd-77286259e7b2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.249675 Oct 27 09:20:49.491304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:20:49.491540 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2078/4209] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:20:49 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:49.496121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:20:49.496644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:49.497272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:49.524943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:49.526424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:49.528403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:49.535917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:49.537044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:49.538072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:49.635493 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea67a88c-47dd-4a11-b145-f6fd7bf83807 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 5.695754 Oct 27 09:20:49.636840 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2132/4210] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:20:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 5697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:20:49.656515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-499b1bd2-83f2-496a-8db4-95be8fe158f5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:49.657144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-499b1bd2-83f2-496a-8db4-95be8fe158f5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:49.836945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-499b1bd2-83f2-496a-8db4-95be8fe158f5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:49.853454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-499b1bd2-83f2-496a-8db4-95be8fe158f5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1246 microversion: 2.1 time: 0.200766 Oct 27 09:20:49.854070 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2133/4211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:49 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1246 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:50.055049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:50.072570 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5831ca4a-dc00-4617-b5d3-047825f116f4 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1521 microversion: 2.1 time: 0.574919 Oct 27 09:20:50.088950 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2079/4212] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:49 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:50.125958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:50.126481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:50.144078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:50.144588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:50.145038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:50.145808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:50.146284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:50.146726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:50.214368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:20:50.276630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:50.277493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:50.286377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:50.286893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:50.287408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:50.304486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:50.304992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:50.305440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:50.454528 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-200ef84f-e215-4346-b2b7-4088f347e2da tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 204 len: 0 microversion: 2.1 time: 0.332362 Oct 27 09:20:50.457750 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2134/4213] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:20:50 2022] DELETE /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:20:50.474063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:50.482482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:50.501244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:50.506459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:50.507414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:50.507862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:50.508643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:50.509125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:50.514758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:50.523309 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-06c956ef-1008-4fff-a1c7-abf9414df5d2 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1281 microversion: 2.1 time: 0.249322 Oct 27 09:20:50.545333 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2080/4214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:50 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1281 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:50.635726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8d1576a0-71a3-482a-aabd-a22fc1c6df2e req-52d07f88-cd70-4a25-a5b7-4107aced39a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a30a71-9684-40d4-956c-89720806bff3", "name": "network-vif-plugged", "status": "completed", "tag": "106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:50.649338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8d1576a0-71a3-482a-aabd-a22fc1c6df2e req-52d07f88-cd70-4a25-a5b7-4107aced39a3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:50.665137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8d1576a0-71a3-482a-aabd-a22fc1c6df2e req-52d07f88-cd70-4a25-a5b7-4107aced39a3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:50.666344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8d1576a0-71a3-482a-aabd-a22fc1c6df2e req-52d07f88-cd70-4a25-a5b7-4107aced39a3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:50.715222 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8d1576a0-71a3-482a-aabd-a22fc1c6df2e req-52d07f88-cd70-4a25-a5b7-4107aced39a3 service nova] Creating event network-vif-plugged:106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c for instance 86a30a71-9684-40d4-956c-89720806bff3 on n-h2-858383-16 Oct 27 09:20:50.735110 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8d1576a0-71a3-482a-aabd-a22fc1c6df2e req-52d07f88-cd70-4a25-a5b7-4107aced39a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105120 Oct 27 09:20:50.738886 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2081/4215] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:20:50.896855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7fc24f9d-242b-4313-bd73-c240d88464ed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:50.898967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7fc24f9d-242b-4313-bd73-c240d88464ed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:51.015128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:51.024524 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1f6a091-d4c4-4f4f-ba69-e0c38e36e8fc tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1527 microversion: 2.1 time: 0.559218 Oct 27 09:20:51.036404 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2135/4216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:50 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1527 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:51.070250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7fc24f9d-242b-4313-bd73-c240d88464ed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:51.077872 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7fc24f9d-242b-4313-bd73-c240d88464ed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1246 microversion: 2.1 time: 0.186249 Oct 27 09:20:51.081742 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2082/4217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:50 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1246 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:51.553915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:51.554674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:51.561415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:51.562593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:51.563289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:51.564278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:51.565785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:51.566454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:52.063718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:52.064461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:52.079458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:52.084714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:52.085211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:52.086114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:52.086667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:52.087112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:52.180829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:52.210575 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9599726c-902a-4b31-b7e4-b2ba8716d37e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1323 microversion: 2.1 time: 0.660599 Oct 27 09:20:52.235784 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2136/4218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:51 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1323 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:52.257980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:52.259707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:52.273283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:52.275237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:52.276434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:52.281195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:52.282439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:52.283447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:52.657972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:52.666537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:52.683207 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bff99857-ded6-49ea-b188-c0cbfa374f53 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1316 microversion: 2.1 time: 0.444471 Oct 27 09:20:52.684323 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2137/4219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:52 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:52.778704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-71c50a4d-a664-4d43-b99f-7c6b6d7f5aa3 req-baa6e945-a2ca-4af8-97e4-85a78c2838ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a30a71-9684-40d4-956c-89720806bff3", "name": "network-vif-unplugged", "status": "completed", "tag": "106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:52.796011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-71c50a4d-a664-4d43-b99f-7c6b6d7f5aa3 req-baa6e945-a2ca-4af8-97e4-85a78c2838ca service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:52.797862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-71c50a4d-a664-4d43-b99f-7c6b6d7f5aa3 req-baa6e945-a2ca-4af8-97e4-85a78c2838ca service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:52.798917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-71c50a4d-a664-4d43-b99f-7c6b6d7f5aa3 req-baa6e945-a2ca-4af8-97e4-85a78c2838ca service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:52.832107 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-71c50a4d-a664-4d43-b99f-7c6b6d7f5aa3 req-baa6e945-a2ca-4af8-97e4-85a78c2838ca service nova] Creating event network-vif-unplugged:106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c for instance 86a30a71-9684-40d4-956c-89720806bff3 on n-h2-858383-16 Oct 27 09:20:52.844863 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-71c50a4d-a664-4d43-b99f-7c6b6d7f5aa3 req-baa6e945-a2ca-4af8-97e4-85a78c2838ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080230 Oct 27 09:20:52.854057 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2138/4220] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:20:53.256068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-cc276cbc-79b6-47a2-89d6-c757f9206f68 req-c0cbd841-8185-4a45-a5a1-32d5b549b610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:53.295886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cc276cbc-79b6-47a2-89d6-c757f9206f68 req-c0cbd841-8185-4a45-a5a1-32d5b549b610 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:53.296534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cc276cbc-79b6-47a2-89d6-c757f9206f68 req-c0cbd841-8185-4a45-a5a1-32d5b549b610 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:53.296986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cc276cbc-79b6-47a2-89d6-c757f9206f68 req-c0cbd841-8185-4a45-a5a1-32d5b549b610 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:53.312569 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-cc276cbc-79b6-47a2-89d6-c757f9206f68 req-c0cbd841-8185-4a45-a5a1-32d5b549b610 service nova] Creating event network-changed:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:20:53.323153 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-cc276cbc-79b6-47a2-89d6-c757f9206f68 req-c0cbd841-8185-4a45-a5a1-32d5b549b610 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.466165 Oct 27 09:20:53.326232 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2139/4221] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:53.338675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:53.340751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:53.368185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:53.370860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:53.372603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:53.376509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:53.378029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:53.379893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:53.489031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:53.510080 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1748bc2d-0b21-4c67-ba23-2090c073557e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1527 microversion: 2.1 time: 1.450700 Oct 27 09:20:53.511000 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2083/4222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:52 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1527 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:53.723929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:53.724739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:53.733542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:53.740510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:53.741143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:53.742036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:53.742820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:53.743502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:54.083797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:54.093116 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ffa9f1fe-e7e4-4785-a8be-162ebbbaf76f tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1304 microversion: 2.1 time: 0.373614 Oct 27 09:20:54.093924 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2084/4223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:53 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1304 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:20:54.323810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:54.361499 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-baaacc7b-12b3-44d2-a65f-3c052472f9d5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1323 microversion: 2.1 time: 1.032638 Oct 27 09:20:54.382718 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2140/4224] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:53 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1323 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:54.569430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:54.579912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:54.648593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:54.651460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:54.653531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:54.655902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:54.658096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:54.661272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:55.126110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:55.130391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:55.148263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:55.165314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:55.167916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:55.174851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:55.176170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:55.177210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:55.347164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:55.400089 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-507150f0-8871-4e9a-aaab-3488bae82a0c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1527 microversion: 2.1 time: 0.862595 Oct 27 09:20:55.425051 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2085/4225] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:54 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1527 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:55.435918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:55.437595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:55.449152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:55.452377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:55.453751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:55.454610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:55.458023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:55.460064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:55.469920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:55.544104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:55.560847 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56fda89b-d68c-4251-8014-862d3d8563cd tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1304 microversion: 2.1 time: 0.443986 Oct 27 09:20:55.561590 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2141/4226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:55 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1304 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:55.636424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fbe54d2e-befe-4197-bdd2-acf2fb83677e req-b90b93b6-268b-49cc-984a-a6a1de48dded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5633b711-da7a-440c-8a7e-e88b38c51f17", "tag": "317c79ff-f5cf-45ff-ac91-1f2159115cb7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:55.680913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fbe54d2e-befe-4197-bdd2-acf2fb83677e req-b90b93b6-268b-49cc-984a-a6a1de48dded service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:55.682808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fbe54d2e-befe-4197-bdd2-acf2fb83677e req-b90b93b6-268b-49cc-984a-a6a1de48dded service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:55.684043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fbe54d2e-befe-4197-bdd2-acf2fb83677e req-b90b93b6-268b-49cc-984a-a6a1de48dded service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:55.722870 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fbe54d2e-befe-4197-bdd2-acf2fb83677e req-b90b93b6-268b-49cc-984a-a6a1de48dded service nova] Creating event network-changed:317c79ff-f5cf-45ff-ac91-1f2159115cb7 for instance 5633b711-da7a-440c-8a7e-e88b38c51f17 on n-h1-858383-16 Oct 27 09:20:55.740856 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fbe54d2e-befe-4197-bdd2-acf2fb83677e req-b90b93b6-268b-49cc-984a-a6a1de48dded service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108228 Oct 27 09:20:55.752448 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2142/4227] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:20:56.436304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:56.437617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:56.450416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:56.454600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:56.458190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:56.459185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:56.463508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:56.464530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:56.614357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:56.632577 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3021beb2-3f16-43de-ab3c-b8b458e03d12 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1323 microversion: 2.1 time: 1.203514 Oct 27 09:20:56.648692 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2086/4228] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:55 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1323 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:56.655340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:56.656290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:56.679957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:56.679957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:56.679957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:56.683474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:56.684548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:56.685197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:56.834181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:56.853029 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-498df95c-be39-4d9b-baf6-1a333b25bd6b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 200 len: 1310 microversion: 2.1 time: 0.422016 Oct 27 09:20:56.858245 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2143/4229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:56 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 1310 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:56.897186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:56.911361 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fbe66168-1675-40ed-8e03-1f7c57e8cbed tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1304 microversion: 2.1 time: 0.261335 Oct 27 09:20:56.912091 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2087/4230] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:56 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1304 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:57.698436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:57.699695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:57.714087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:57.721552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:57.729315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:57.730934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:57.731838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:57.732538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:57.827301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5edc6e88-8e79-4a6c-a832-c85038debd2c req-13460452-719c-4e61-b49f-1b7c0f02df09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a30a71-9684-40d4-956c-89720806bff3", "name": "network-vif-deleted", "tag": "106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:57.859112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5edc6e88-8e79-4a6c-a832-c85038debd2c req-13460452-719c-4e61-b49f-1b7c0f02df09 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:57.859879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5edc6e88-8e79-4a6c-a832-c85038debd2c req-13460452-719c-4e61-b49f-1b7c0f02df09 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:57.860459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5edc6e88-8e79-4a6c-a832-c85038debd2c req-13460452-719c-4e61-b49f-1b7c0f02df09 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:57.884929 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5edc6e88-8e79-4a6c-a832-c85038debd2c req-13460452-719c-4e61-b49f-1b7c0f02df09 service nova] Creating event network-vif-deleted:106250ae-b731-4c5c-a0d9-f0fc8b7ecf2c for instance 86a30a71-9684-40d4-956c-89720806bff3 on n-h2-858383-16 Oct 27 09:20:57.892175 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5edc6e88-8e79-4a6c-a832-c85038debd2c req-13460452-719c-4e61-b49f-1b7c0f02df09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071342 Oct 27 09:20:57.894468 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2088/4231] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:20:57.908400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:57.909635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:57.919305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:57.920162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:57.921609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:57.922986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:57.923707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:57.926152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:57.947553 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 HTTP/1.1 Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '86a30a71-9684-40d4-956c-89720806bff3'} Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:57.949617 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:20:57.955151 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:57.955151 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:20:57.955151 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:20:57.955151 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:20:57.955151 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:20:57.955151 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:20:57.955151 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:20:57.955151 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:20:57.958241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:20:57.959835 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85a64c7f-2d37-494b-8f05-623ae6e44b79 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 404 len: 111 microversion: 2.1 time: 0.064053 Oct 27 09:20:57.960583 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2089/4232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:57 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:20:57.976667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:57.977271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:57.984670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:57.986198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:57.987453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:57.988371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:57.989012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:57.989722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:57.994957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:58.187636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:58.199243 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f24c13a6-99ad-4e12-98e2-1a1c8c8206e5 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1323 microversion: 2.1 time: 0.504879 Oct 27 09:20:58.206925 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2144/4233] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:57 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1323 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:58.215758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1093875119", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:20:58.291762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] validate_networks() for [('9d86e802-a9a7-4669-970c-b155c0dd14a5', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:20:58.577173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:20:58.600799 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc39aacf-9d5c-4839-a351-bdf0ea52a347 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1372 microversion: 2.1 time: 0.623356 Oct 27 09:20:58.607754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2090/4234] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:57 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1372 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:20:59.227036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:20:59.231268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:20:59.274548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:59.276771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:59.277580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:59.285002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:59.286533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:59.287329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:59.421604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:59.842035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=18 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:20:59.894843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:20:59.895632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:20:59.896442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:20:59.897165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:20:59.898062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:20:59.928716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:59.929540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:59.931924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:59.933300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:20:59.934092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:20:59.934828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:20:59.971812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Getting quotas for project b4f37ec78b0c4015812d9ccb67992c35. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:20:59.982854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Getting quotas for user 9cf86af347d545c79ccb2fdef888e23d and project b4f37ec78b0c4015812d9ccb67992c35. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:21:00.007730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:21:00.012574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:21:00.037835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:00.081125 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e07f0d4d-0257-4b1e-bef6-386fa3588efc tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1323 microversion: 2.1 time: 0.859690 Oct 27 09:21:00.092297 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2091/4235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:20:59 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1323 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:00.111155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:00.120544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:00.161343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:00.162773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:00.164935 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b2a0376-cfba-409b-a3b6-439a931adbae tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.956153 Oct 27 09:21:00.165512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:00.167511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:00.168853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:00.170082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:00.172344 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2145/4236] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:20:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:21:00.192986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e87b2ef-a405-4522-92b6-8520b174d4e2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:00.199131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9e87b2ef-a405-4522-92b6-8520b174d4e2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:00.467919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9e87b2ef-a405-4522-92b6-8520b174d4e2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:00.497191 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9e87b2ef-a405-4522-92b6-8520b174d4e2 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1225 microversion: 2.1 time: 0.312530 Oct 27 09:21:00.505536 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2146/4237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:00 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1225 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:01.077627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:01.170819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:01.192584 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e0c4e22-09fc-4fa9-b76d-f1fb39a1a1e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1372 microversion: 2.1 time: 1.095847 Oct 27 09:21:01.196962 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2092/4238] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:00 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1372 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:01.218915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:01.247015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:01.272089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:01.290840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:01.297010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:01.300787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:01.302395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:01.307535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:01.854894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c5d31312-edf5-40cb-8deb-67e95de34d29 req-ad53f89d-5834-45d8-99d0-04efe0c4c735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7e8877-ee82-40d8-b642-3819fd16f408", "tag": "6dc4a1cb-7da3-4777-bab4-543323d6ffbf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:01.882257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c5d31312-edf5-40cb-8deb-67e95de34d29 req-ad53f89d-5834-45d8-99d0-04efe0c4c735 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:01.883855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c5d31312-edf5-40cb-8deb-67e95de34d29 req-ad53f89d-5834-45d8-99d0-04efe0c4c735 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:01.884968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c5d31312-edf5-40cb-8deb-67e95de34d29 req-ad53f89d-5834-45d8-99d0-04efe0c4c735 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:01.931929 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c5d31312-edf5-40cb-8deb-67e95de34d29 req-ad53f89d-5834-45d8-99d0-04efe0c4c735 service nova] Creating event network-changed:6dc4a1cb-7da3-4777-bab4-543323d6ffbf for instance ad7e8877-ee82-40d8-b642-3819fd16f408 on n-h1-858383-16 Oct 27 09:21:01.943466 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c5d31312-edf5-40cb-8deb-67e95de34d29 req-ad53f89d-5834-45d8-99d0-04efe0c4c735 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.969728 Oct 27 09:21:01.952302 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2147/4239] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:21:01.975003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:01.976619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:02.011860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:02.015612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:02.022286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:02.024108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:02.025249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:02.026279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:02.921295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:02.952765 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-afd51983-a33a-4c9c-8fe4-1f8ada38a46d tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1221 microversion: 2.1 time: 0.996524 Oct 27 09:21:02.961042 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2148/4240] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:01 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1221 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:03.036914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:03.038129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:03.074508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:03.078672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:03.079497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:03.080956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:03.081759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:03.086642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:03.121030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:03.209604 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e699b3af-85a0-409e-b1f8-62db8539367b tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1323 microversion: 2.1 time: 1.994382 Oct 27 09:21:03.220139 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2093/4241] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:01 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1323 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:03.824771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:03.848454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c2ac6e81-37ff-4d72-af80-850da29d75e9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1372 microversion: 2.1 time: 0.884404 Oct 27 09:21:03.849560 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2149/4242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:02 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1372 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:03.987598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:03.988244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:03.996435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:03.997851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:03.998545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:03.999532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:04.000245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:04.000886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:04.186649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:04.198750 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19cbcc40-fb8e-46ec-b57a-50414df25509 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1283 microversion: 2.1 time: 0.217080 Oct 27 09:21:04.199813 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2094/4243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:03 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1283 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:04.243526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:04.245074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:04.259889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:04.264945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:04.266442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:04.267496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:04.268838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:04.269509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:04.570993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1032240804", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "3527ca6b-4f14-40c0-86a3-873f2fef222c"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:04.597688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:04.621639 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ebe9076f-68b7-4ccc-80b9-257015c14f5a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1323 microversion: 2.1 time: 0.374063 Oct 27 09:21:04.622441 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2150/4244] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:04 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:04.708666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] validate_networks() for [('3527ca6b-4f14-40c0-86a3-873f2fef222c', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:21:04.824640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-688fb70c-996a-40c4-9aff-10b62adb5e19 req-e7edb5b9-3c9b-4d11-9aef-3118d2469d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5633b711-da7a-440c-8a7e-e88b38c51f17", "name": "network-vif-plugged", "status": "completed", "tag": "317c79ff-f5cf-45ff-ac91-1f2159115cb7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:04.845477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-688fb70c-996a-40c4-9aff-10b62adb5e19 req-e7edb5b9-3c9b-4d11-9aef-3118d2469d89 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:04.849074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-688fb70c-996a-40c4-9aff-10b62adb5e19 req-e7edb5b9-3c9b-4d11-9aef-3118d2469d89 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:04.849592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-688fb70c-996a-40c4-9aff-10b62adb5e19 req-e7edb5b9-3c9b-4d11-9aef-3118d2469d89 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:04.920694 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-688fb70c-996a-40c4-9aff-10b62adb5e19 req-e7edb5b9-3c9b-4d11-9aef-3118d2469d89 service nova] Creating event network-vif-plugged:317c79ff-f5cf-45ff-ac91-1f2159115cb7 for instance 5633b711-da7a-440c-8a7e-e88b38c51f17 on n-h1-858383-16 Oct 27 09:21:04.930271 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-688fb70c-996a-40c4-9aff-10b62adb5e19 req-e7edb5b9-3c9b-4d11-9aef-3118d2469d89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111839 Oct 27 09:21:04.939484 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2151/4245] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:21:04.946165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:04.949729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:04.963455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:04.964275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:04.964920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:04.968030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:04.968543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:04.968990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:05.571339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:05.597456 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d6fc3db-355e-44b1-bbf5-2e1f8507e8d6 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1372 microversion: 2.1 time: 0.655944 Oct 27 09:21:05.604564 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2152/4246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:04 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1372 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:05.617774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:05.619354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:05.668355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:05.669212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:05.669872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:05.671085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:05.672086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:05.673105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:07.168075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:07.190937 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23586a6e-6c94-4327-b973-805f40188851 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1325 microversion: 2.1 time: 1.577468 Oct 27 09:21:07.210663 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2153/4247] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:05 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1325 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:07.225689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:07.226576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:07.249023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:07.258549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:07.259317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:07.260317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:07.260995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:07.261613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:07.796720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:21:07.797226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:21:07.797849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:21:07.798270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:21:07.798691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:21:07.814308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:07.815373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:07.815848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:07.816893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:07.817367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:07.817716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:07.847177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:21:07.854033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for user 0a9243ea430b4d2ba18c2a1e54e7c6aa and project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:21:07.871048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:21:07.873819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:21:07.894196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:07.903318 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2dd47265-84da-433e-8da0-f45dd22f419e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1323 microversion: 2.1 time: 0.691201 Oct 27 09:21:07.910761 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2154/4248] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:07 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1323 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:07.930105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:07.933353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:07.962251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:07.965676 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1fbff749-718e-4e43-9ff7-cfd26b3bda4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.553471 Oct 27 09:21:07.967388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:07.968115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:07.969534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:07.971143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:07.971736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:07.980579 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2095/4249] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:21:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:21:07.997703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-295b7f0c-9447-4937-b739-ae62f086c6f6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:07.999461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-295b7f0c-9447-4937-b739-ae62f086c6f6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:08.149425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-295b7f0c-9447-4937-b739-ae62f086c6f6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:08.161840 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-295b7f0c-9447-4937-b739-ae62f086c6f6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1215 microversion: 2.1 time: 0.180021 Oct 27 09:21:08.164915 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2096/4250] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:07 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:08.217740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:08.219000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:08.233455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:08.234890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:08.237043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:08.237908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:08.238379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:08.240302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.011638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:09.027267 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e57aed10-8c89-46df-9472-7b8935f5f256 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1372 microversion: 2.1 time: 1.113555 Oct 27 09:21:09.027982 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2155/4251] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:07 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1372 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:09.053839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:09.054466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:09.074754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:09.075251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:09.075741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.076469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:09.076926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:09.077348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.125895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:09.140346 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3bf1a81-e7f4-4b61-8a1c-d63ca767dcfd tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1325 microversion: 2.1 time: 0.926674 Oct 27 09:21:09.140949 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2097/4252] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:08 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1325 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:09.191364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:09.192347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:09.203881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:09.204651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:09.205827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.206730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:09.209565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:09.210240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.426226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:09.441617 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f2dd7ba5-2072-4710-92da-afa9a6ecff19 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1211 microversion: 2.1 time: 0.259251 Oct 27 09:21:09.456848 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2098/4253] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:09 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1211 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:09.553036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:09.566738 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a088c58a-b218-47c3-a0b0-7a47ec695e20 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1517 microversion: 2.1 time: 0.534403 Oct 27 09:21:09.568558 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2156/4254] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:09 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1517 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:09.618703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:09.621643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:09.642659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:09.643181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:09.646966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.657535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:09.661457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:09.663777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.730852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lazy-loading 'flavor' on Instance uuid 5633b711-da7a-440c-8a7e-e88b38c51f17 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:21:09.858641 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f11d4105-9c95-44da-938c-db62e808ed7e tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action" status: 200 len: 32 microversion: 2.1 time: 0.248397 Oct 27 09:21:09.866860 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2099/4255] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:21:09 2022] POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action => generated 32 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:21:09.884968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:09.888324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:09.911657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:09.913037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:09.913733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.914379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-241f1a30-61b6-4783-8817-5f03d5a2fb4f req-3e7e4d48-64cc-489a-9b09-ceff0e63e5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aef4542-c55e-4a83-aecf-106170c46d08", "tag": "065d20a7-c5a5-4795-9bd5-36fd24b6ddb4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:09.915303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:09.919988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:09.921228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.930926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-241f1a30-61b6-4783-8817-5f03d5a2fb4f req-3e7e4d48-64cc-489a-9b09-ceff0e63e5be service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:09.931410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-241f1a30-61b6-4783-8817-5f03d5a2fb4f req-3e7e4d48-64cc-489a-9b09-ceff0e63e5be service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:09.936197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-241f1a30-61b6-4783-8817-5f03d5a2fb4f req-3e7e4d48-64cc-489a-9b09-ceff0e63e5be service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:09.959340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:09.960301 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-241f1a30-61b6-4783-8817-5f03d5a2fb4f req-3e7e4d48-64cc-489a-9b09-ceff0e63e5be service nova] Creating event network-changed:065d20a7-c5a5-4795-9bd5-36fd24b6ddb4 for instance 9aef4542-c55e-4a83-aecf-106170c46d08 on n-h2-858383-16 Oct 27 09:21:09.976027 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-241f1a30-61b6-4783-8817-5f03d5a2fb4f req-3e7e4d48-64cc-489a-9b09-ceff0e63e5be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066152 Oct 27 09:21:09.978165 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2100/4256] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:21:10.059404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:10.060709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:10.073716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:10.077456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:10.078319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:10.082138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:10.083123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:10.083833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:10.496753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:10.557283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:10.565400 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac3b7e26-e2f8-4630-8a4a-d814a012df1c tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1372 microversion: 2.1 time: 0.511783 Oct 27 09:21:10.566648 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2101/4257] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:10 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1372 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:10.571705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:10.572636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:10.579823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:10.581175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:10.581870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:10.582808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:10.583506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:10.584181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:10.709409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:10.728914 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16b1f38b-c6c7-4239-a114-cec03d3867c6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.856143 Oct 27 09:21:10.743958 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2157/4258] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:09 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:10.748397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:10.749172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:10.759017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:10.761307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:10.763522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:10.764172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:10.765184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:10.765976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:10.766536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:10.980449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:11.009391 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e54d6841-098a-48f4-9e62-8ea08c01f42d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1273 microversion: 2.1 time: 0.275541 Oct 27 09:21:11.012084 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2158/4259] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:10 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:11.113966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:11.128325 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c13be592-6009-4bb1-93b4-f3e93b6ca2d0 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1325 microversion: 2.1 time: 0.559828 Oct 27 09:21:11.145175 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2102/4260] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:10 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1325 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:11.597874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:11.599008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:11.609768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:11.610495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:11.611185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:11.612063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:11.613122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:11.613579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:11.636937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:11.760802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:11.761991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:11.772802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:11.773760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:11.774474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:11.775966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:11.777224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:11.778283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:11.930707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:11.959194 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-955fcd12-c539-47ff-bd9b-a8b2559c5bba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1372 microversion: 2.1 time: 0.367741 Oct 27 09:21:11.972012 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2159/4261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:11 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:12.024614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:12.037227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:12.038184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:12.045608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:12.046423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:12.046971 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b0334bd-c380-441d-b971-f8e6b3a1f9e6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.295094 Oct 27 09:21:12.047177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:12.048096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:12.048778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:12.049349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:12.053796 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2103/4262] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:11 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:12.172214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:12.173699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:12.195375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:12.200718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:12.201635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:12.205890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:12.208589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:12.210504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:12.432527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:12.462582 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd5634c4-be43-4ac5-bbd5-475aaaa25ebd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1315 microversion: 2.1 time: 0.431547 Oct 27 09:21:12.464127 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2160/4263] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:12 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:12.544882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:12.574047 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aab5ac2f-28f1-4e76-91f2-8706a47238c8 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1325 microversion: 2.1 time: 0.408705 Oct 27 09:21:12.575759 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2104/4264] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:12 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1325 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:12.771152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-63ffd1da-937f-49c3-8736-30bbad95fe0a req-fd022111-6382-4d7f-8198-6c11f1db3498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7e8877-ee82-40d8-b642-3819fd16f408", "name": "network-vif-plugged", "status": "completed", "tag": "6dc4a1cb-7da3-4777-bab4-543323d6ffbf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:12.796543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-63ffd1da-937f-49c3-8736-30bbad95fe0a req-fd022111-6382-4d7f-8198-6c11f1db3498 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:12.797413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-63ffd1da-937f-49c3-8736-30bbad95fe0a req-fd022111-6382-4d7f-8198-6c11f1db3498 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:12.798109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-63ffd1da-937f-49c3-8736-30bbad95fe0a req-fd022111-6382-4d7f-8198-6c11f1db3498 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:12.813700 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-63ffd1da-937f-49c3-8736-30bbad95fe0a req-fd022111-6382-4d7f-8198-6c11f1db3498 service nova] Creating event network-vif-plugged:6dc4a1cb-7da3-4777-bab4-543323d6ffbf for instance ad7e8877-ee82-40d8-b642-3819fd16f408 on n-h1-858383-16 Oct 27 09:21:12.820593 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-63ffd1da-937f-49c3-8736-30bbad95fe0a req-fd022111-6382-4d7f-8198-6c11f1db3498 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061282 Oct 27 09:21:12.822357 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2161/4265] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:21:12.999937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:13.000966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:13.011085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:13.011919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:13.012501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:13.013504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:13.014180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:13.014745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:13.089445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:13.091410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:13.101257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:13.101982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:13.102576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:13.103474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:13.104381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:13.105033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:13.786417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:13.796572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:13.804974 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-57589008-2afe-4a16-b423-566c96a42abf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1372 microversion: 2.1 time: 0.809761 Oct 27 09:21:13.806399 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2105/4266] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:12 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1372 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:13.815154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:13.816337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:13.826896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:13.827229 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-067a6e7e-9228-40ea-aa48-2830d8e524cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.742686 Oct 27 09:21:13.828428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:13.829248 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2162/4267] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:13 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:13.836064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:13.841797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:13.842536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:13.843066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:13.847815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:13.849652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:13.862715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:13.864581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:13.865904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:13.867228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:13.870023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:13.871441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:14.263347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:14.276159 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-56deb79b-1c84-4994-8b88-954c407a2454 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1315 microversion: 2.1 time: 0.467569 Oct 27 09:21:14.277574 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2106/4268] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:13 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:14.313576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:14.330752 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1217aaaf-adc3-4c49-b42e-b5b51454c959 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1325 microversion: 2.1 time: 0.497359 Oct 27 09:21:14.331899 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2163/4269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:13 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1325 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:14.833109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:14.834062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:14.841891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:14.842687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:14.843379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:14.844333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:14.845306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:14.848453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:14.857149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:14.878235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:14.884956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:14.915600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:14.916424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:14.917167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:14.919220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:14.922283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:14.923065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:15.203900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:15.280238 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f207aa3-0fb6-4d56-ab00-1d5601b69022 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1372 microversion: 2.1 time: 0.446811 Oct 27 09:21:15.285817 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2107/4270] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:14 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1372 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:15.315614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:15.317920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:15.346336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:15.348550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:15.349818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:15.351745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:15.353790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:15.356310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:15.401327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:15.422520 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e8210c1-cf10-4033-a098-4c8fcc7dc829 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.554129 Oct 27 09:21:15.424627 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2164/4271] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:14 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:15.433779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:15.435344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:15.466331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:15.469545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:15.472873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:15.474491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:15.475690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:15.476706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:15.786659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:15.802386 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6940475-335d-4f3c-ae5c-9763624942c0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1315 microversion: 2.1 time: 0.503668 Oct 27 09:21:15.803000 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2108/4272] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:15 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:15.805416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:15.822959 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c3b8ef7c-4456-4d56-aaa5-2e1d04b983c3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1325 microversion: 2.1 time: 0.395860 Oct 27 09:21:15.836764 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2165/4273] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:15 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:16.226896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-df45684a-fb6e-468e-8ecf-08ab00ca5e0d req-dd376724-7253-4d1f-ad69-0ea09f869039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33172046-c141-45cb-9fe0-7d14e946adde", "tag": "99f95fd7-aca0-4eba-9752-8b35a8dba430"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:16.239015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df45684a-fb6e-468e-8ecf-08ab00ca5e0d req-dd376724-7253-4d1f-ad69-0ea09f869039 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:16.239907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df45684a-fb6e-468e-8ecf-08ab00ca5e0d req-dd376724-7253-4d1f-ad69-0ea09f869039 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:16.240527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df45684a-fb6e-468e-8ecf-08ab00ca5e0d req-dd376724-7253-4d1f-ad69-0ea09f869039 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:16.261618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-df45684a-fb6e-468e-8ecf-08ab00ca5e0d req-dd376724-7253-4d1f-ad69-0ea09f869039 service nova] Creating event network-changed:99f95fd7-aca0-4eba-9752-8b35a8dba430 for instance 33172046-c141-45cb-9fe0-7d14e946adde on n-h2-858383-16 Oct 27 09:21:16.269536 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-df45684a-fb6e-468e-8ecf-08ab00ca5e0d req-dd376724-7253-4d1f-ad69-0ea09f869039 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046974 Oct 27 09:21:16.270939 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2109/4274] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:21:16.334907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:16.337039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:16.353899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:16.355618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:16.356783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:16.358584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:16.359969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:16.361976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:16.470132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:16.471785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:16.510599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:16.513436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:16.514158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:16.517921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:16.520983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:16.522510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:16.694817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:16.710270 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-362de139-d291-4d88-9b1f-ee6ffd2afefc tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1545 microversion: 2.1 time: 0.384214 Oct 27 09:21:16.733067 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2166/4275] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:16 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1545 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:16.761960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:16.762693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:16.793143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:16.793651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:16.794107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:16.796858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:16.797360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:16.797811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:16.922535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:16.939962 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc447f5b-de0d-48ee-89fd-52ac49d09f1c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.483971 Oct 27 09:21:16.941056 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2110/4276] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:16 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:16.954228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:16.955457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:16.972650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:16.973592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:16.974511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:16.978473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:16.981704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:16.982526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:17.283673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:17.314082 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72cb50c7-beaf-455f-869c-fe14b6599ba8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1545 microversion: 2.1 time: 0.555970 Oct 27 09:21:17.318716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2167/4277] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:16 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1545 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:17.351024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:17.354977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:17.380845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:17.381422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:17.386259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:17.387064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:17.388399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:17.393363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:17.394257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:17.398236 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99f873bc-02d9-4c42-b78d-b6c3a4e33b0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1315 microversion: 2.1 time: 0.455594 Oct 27 09:21:17.411352 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2111/4278] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:16 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:17.621428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:17.646987 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-13d45f43-01b6-46a9-ac5c-5ac94300f891 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1325 microversion: 2.1 time: 0.326119 Oct 27 09:21:17.648102 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2168/4279] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:17 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:17.984321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:17.985209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:17.987473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:17.993612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:17.994311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:17.995122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:17.996037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:17.996630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:17.997169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:18.165965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:18.201451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:18.210966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95d5116b-7a9b-4872-9d58-8b38d7a415b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.230627 Oct 27 09:21:18.223658 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2112/4280] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:17 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:18.439766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:18.441054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:18.447436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:18.448210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:18.448827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:18.449690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:18.450293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:18.450878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:18.637843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:18.649930 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-513d5025-ea84-4c78-b7cd-2bb837a322d1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1315 microversion: 2.1 time: 0.215617 Oct 27 09:21:18.675847 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2169/4281] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:18 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:18.681869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:18.683056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:18.697185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:18.701501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:18.702309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:18.703554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:18.704310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:18.705122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:19.089688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c8195340-66fd-4018-8976-4caf925a9727 req-01cc778c-272b-4292-aa99-0ee898034022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aef4542-c55e-4a83-aecf-106170c46d08", "name": "network-vif-plugged", "status": "completed", "tag": "065d20a7-c5a5-4795-9bd5-36fd24b6ddb4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:19.118408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c8195340-66fd-4018-8976-4caf925a9727 req-01cc778c-272b-4292-aa99-0ee898034022 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:19.119453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c8195340-66fd-4018-8976-4caf925a9727 req-01cc778c-272b-4292-aa99-0ee898034022 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:19.120646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c8195340-66fd-4018-8976-4caf925a9727 req-01cc778c-272b-4292-aa99-0ee898034022 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:19.152838 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c8195340-66fd-4018-8976-4caf925a9727 req-01cc778c-272b-4292-aa99-0ee898034022 service nova] Creating event network-vif-plugged:065d20a7-c5a5-4795-9bd5-36fd24b6ddb4 for instance 9aef4542-c55e-4a83-aecf-106170c46d08 on n-h2-858383-16 Oct 27 09:21:19.160136 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c8195340-66fd-4018-8976-4caf925a9727 req-01cc778c-272b-4292-aa99-0ee898034022 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077739 Oct 27 09:21:19.161507 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2170/4282] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:21:19.251974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:19.254579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:19.262041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:19.262692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:19.263275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:19.264247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:19.264735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:19.265893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:19.292200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:19.304622 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9714af5-992a-4f69-8b03-e8b725391ae3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1325 microversion: 2.1 time: 0.630892 Oct 27 09:21:19.304957 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2113/4283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:18 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1325 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:19.683097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:19.683832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:19.690793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:19.691625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:19.692056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:19.692776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:19.693221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:19.693834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:20.011198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:20.027184 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e4ce23e-58ce-4420-a4df-523a85f32088 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.792449 Oct 27 09:21:20.033408 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2171/4284] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:19 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:20.290679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:20.303770 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b4d34f7d-fcff-4ffe-ac53-ae9f719363ce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1315 microversion: 2.1 time: 0.624452 Oct 27 09:21:20.304468 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2114/4285] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:19 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:20.334144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:20.334954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:20.342782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:20.343509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:20.344327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:20.345389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:20.359289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:20.359998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:20.970739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:20.980493 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ed9806f-e72c-4129-a4b4-e09397160f77 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1325 microversion: 2.1 time: 0.650593 Oct 27 09:21:20.995597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2172/4286] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:20 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1325 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:21.071036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:21.072861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:21.088180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:21.089676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:21.090881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:21.092413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:21.093278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:21.094308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:21.343112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:21.343992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:21.359038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:21.360244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:21.361283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:21.362746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:21.363820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:21.364834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:22.052063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:22.065465 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbe292a2-287c-4f0d-9c20-01e69db75830 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 1.002522 Oct 27 09:21:22.083320 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2115/4287] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:21 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:22.096667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:22.097544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:22.107159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:22.110007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:22.111536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:22.112632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:22.113348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:22.114066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:22.366846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:22.377646 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-047ab82b-1482-4f78-824d-c84dd7570cd4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1315 microversion: 2.1 time: 1.038511 Oct 27 09:21:22.378581 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2173/4288] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:21 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:22.463642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:22.480604 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-24ef4ab7-97f0-49bd-8c51-ebce60d74be6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1520 microversion: 2.1 time: 0.389708 Oct 27 09:21:22.481383 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2116/4289] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:22 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:22.513016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:22.513583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:22.522850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:22.523349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:22.523899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:22.524648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:22.525119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:22.525545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:22.578921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:21:22.776191 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94463f2d-ab89-425c-9591-2b5c440dd97c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 204 len: 0 microversion: 2.1 time: 0.266754 Oct 27 09:21:22.777068 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2174/4290] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:21:22 2022] DELETE /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:21:22.786801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:22.787426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:22.801367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:22.801888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:22.802354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:22.803067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:22.803527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:22.804574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:22.895421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d773060b-1e78-46f4-a1c4-58af37eab74d req-d2644b0e-bd1a-4531-89cb-d40fcb9f0b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33172046-c141-45cb-9fe0-7d14e946adde", "name": "network-vif-plugged", "status": "completed", "tag": "99f95fd7-aca0-4eba-9752-8b35a8dba430"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:22.916001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d773060b-1e78-46f4-a1c4-58af37eab74d req-d2644b0e-bd1a-4531-89cb-d40fcb9f0b77 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:22.919504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d773060b-1e78-46f4-a1c4-58af37eab74d req-d2644b0e-bd1a-4531-89cb-d40fcb9f0b77 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:22.920958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d773060b-1e78-46f4-a1c4-58af37eab74d req-d2644b0e-bd1a-4531-89cb-d40fcb9f0b77 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:22.948683 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d773060b-1e78-46f4-a1c4-58af37eab74d req-d2644b0e-bd1a-4531-89cb-d40fcb9f0b77 service nova] Creating event network-vif-plugged:99f95fd7-aca0-4eba-9752-8b35a8dba430 for instance 33172046-c141-45cb-9fe0-7d14e946adde on n-h2-858383-16 Oct 27 09:21:22.964056 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d773060b-1e78-46f4-a1c4-58af37eab74d req-d2644b0e-bd1a-4531-89cb-d40fcb9f0b77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073599 Oct 27 09:21:22.965999 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2175/4291] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:21:23.102709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:23.105335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:23.133442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:23.134236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:23.134691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:23.135690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:23.136355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:23.137017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:23.178135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:23.185152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:23.218422 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38210839-a267-4078-828e-641ccbf3905e tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1526 microversion: 2.1 time: 0.434948 Oct 27 09:21:23.223229 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2117/4292] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:22 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1526 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:23.426120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:23.428439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:23.442894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:23.445189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:23.446619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:23.448866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:23.450005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:23.451400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:23.459520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:23.481649 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cea2979f-7c61-4110-b1de-b48ccbdac288 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.387878 Oct 27 09:21:23.495914 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2176/4293] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:23 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:23.574291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3e028f89-e688-4794-8c68-87464c45cae6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed6a992a-bb3b-4003-a15a-a5b430ed6563"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:23.578950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3e028f89-e688-4794-8c68-87464c45cae6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:23.598654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e028f89-e688-4794-8c68-87464c45cae6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:23.598654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e028f89-e688-4794-8c68-87464c45cae6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:23.599430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e028f89-e688-4794-8c68-87464c45cae6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:23.600821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e028f89-e688-4794-8c68-87464c45cae6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:23.601662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e028f89-e688-4794-8c68-87464c45cae6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:23.602417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e028f89-e688-4794-8c68-87464c45cae6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:23.957070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:23.973588 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af7b770f-ee01-4250-b053-820e3c039853 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1315 microversion: 2.1 time: 0.561390 Oct 27 09:21:23.977306 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2118/4294] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:23 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:24.189833 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3e028f89-e688-4794-8c68-87464c45cae6 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.628484 Oct 27 09:21:24.191300 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2177/4295] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:21:23 2022] POST /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:21:24.263698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:24.264564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:24.291740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:24.292478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:24.293097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:24.293873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:24.294349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:24.294786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:24.524303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:24.530391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:24.575860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:24.584891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:24.585909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:24.590880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:24.591923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:24.595868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:25.305608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:25.321132 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fdc1c5e-6307-47de-810a-1374f22a9949 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1526 microversion: 2.1 time: 1.063092 Oct 27 09:21:25.322552 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2119/4296] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:24 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1526 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:25.330150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:25.337422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:25.347547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:25.349199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:25.351151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:25.352125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:25.354394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:25.355041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:25.600006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:25.635138 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19667194-bb9e-4a48-81e3-fe42fdb120cb tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 1.124202 Oct 27 09:21:25.656162 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2178/4297] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:24 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:26.021208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:26.054866 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1072b9e2-b90e-459c-88da-af8cb9b9134e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1315 microversion: 2.1 time: 0.729286 Oct 27 09:21:26.060868 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2120/4298] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:25 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:26.368823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:26.377657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:26.408519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:26.418582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:26.419356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:26.420936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:26.421661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:26.423388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:26.554735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c78d3109-a703-4d82-8c50-0309c741c291 req-e6f443a4-5f3e-4a5e-98c5-66808f91423b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aef4542-c55e-4a83-aecf-106170c46d08", "name": "network-vif-deleted", "tag": "065d20a7-c5a5-4795-9bd5-36fd24b6ddb4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:26.577671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:26.582531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c78d3109-a703-4d82-8c50-0309c741c291 req-e6f443a4-5f3e-4a5e-98c5-66808f91423b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:26.588306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c78d3109-a703-4d82-8c50-0309c741c291 req-e6f443a4-5f3e-4a5e-98c5-66808f91423b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:26.589236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c78d3109-a703-4d82-8c50-0309c741c291 req-e6f443a4-5f3e-4a5e-98c5-66808f91423b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:26.623845 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c78d3109-a703-4d82-8c50-0309c741c291 req-e6f443a4-5f3e-4a5e-98c5-66808f91423b service nova] Creating event network-vif-deleted:065d20a7-c5a5-4795-9bd5-36fd24b6ddb4 for instance 9aef4542-c55e-4a83-aecf-106170c46d08 on n-h2-858383-16 Oct 27 09:21:26.632769 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c78d3109-a703-4d82-8c50-0309c741c291 req-e6f443a4-5f3e-4a5e-98c5-66808f91423b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083978 Oct 27 09:21:26.634100 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2121/4299] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:21:26.707746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:26.709030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:26.771268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:26.773583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:26.777324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:26.793950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:26.797383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:26.815320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:26.844260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:26.862572 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e61fe62-93d9-4707-a13f-dd9d69a9e5d3 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1484 microversion: 2.1 time: 0.495084 Oct 27 09:21:26.868903 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2179/4300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:26 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1484 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:27.101410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:27.103628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:27.120265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:27.121132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:27.121804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:27.123732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:27.124454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:27.125999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:27.229482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:27.241720 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6600967-7ccb-4de8-a5fc-01c2f22446cf tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.554645 Oct 27 09:21:27.256571 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2122/4301] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:26 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:27.484865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:27.505637 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf8ff898-9f6c-4a2c-86a5-0c5c74b87791 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1502 microversion: 2.1 time: 0.407726 Oct 27 09:21:27.507853 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2180/4302] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:27 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:27.550976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:27.551610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:27.559017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:27.560087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:27.560087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:27.560719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:27.561245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:27.561607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:27.591839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:21:27.719238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:27.791041 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1978a93-46a3-43d4-9c97-96c92e091e5f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 204 len: 0 microversion: 2.1 time: 0.244106 Oct 27 09:21:27.793254 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2123/4303] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:21:27 2022] DELETE /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:21:27.813367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:27.815070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:27.831078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:27.832213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:27.833193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:27.834763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:27.835770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:27.838929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:27.917800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:27.927727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:27.945634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:27.950168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:27.951139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:27.953131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:27.953990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:27.956163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:28.054223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:28.054952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:28.055409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:28.055938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lazy-loading 'fault' on Instance uuid 9aef4542-c55e-4a83-aecf-106170c46d08 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:21:28.234140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf86af347d545c79ccb2fdef888e23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f37ec78b0c4015812d9ccb67992c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:28.258593 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1789cf92-11d7-4452-9325-ded86eef8875 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 200 len: 1315 microversion: 2.1 time: 0.348877 Oct 27 09:21:28.261284 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2124/4304] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:27 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:28.272860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:28.273522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:28.292051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:28.305988 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b09fe49a-37f1-4de9-82ff-60225dfe6cd0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1508 microversion: 2.1 time: 0.507667 Oct 27 09:21:28.306606 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2181/4305] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:27 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1508 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:28.309718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:28.312642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:28.314400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:28.315396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:28.320628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:28.321090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:28.656779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:28.679947 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7ba71fe-b1ff-47e8-92da-6925d1dd3e47 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.416893 Oct 27 09:21:28.681894 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2125/4306] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:28 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:29.300788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:29.301688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 9aef4542-c55e-4a83-aecf-106170c46d08] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:29.325065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.325633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.326100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:29.329107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.329721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.330186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:29.356956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:29.357820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:29.370824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.371355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.371835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:29.372613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.373085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.383689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:29.392539 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Instance 9aef4542-c55e-4a83-aecf-106170c46d08 could not be found. Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 HTTP/1.1 Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 9aef4542-c55e-4a83-aecf-106170c46d08 could not be found. Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '9aef4542-c55e-4a83-aecf-106170c46d08'} Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aef4542-c55e-4a83-aecf-106170c46d08 could not be found. Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aef4542-c55e-4a83-aecf-106170c46d08 could not be found. Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.396260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:29.400482 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.400482 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.400482 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:29.400482 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:29.400482 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:21:29.400482 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:21:29.400482 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aef4542-c55e-4a83-aecf-106170c46d08 could not be found. Oct 27 09:21:29.400482 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.404683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Instance 9aef4542-c55e-4a83-aecf-106170c46d08 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:21:29.405826 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e15b84a-b165-440c-94d5-0a9a5c0f283c tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08" status: 404 len: 111 microversion: 2.1 time: 0.109934 Oct 27 09:21:29.412763 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2182/4307] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:29 2022] GET /compute/v2.1/servers/9aef4542-c55e-4a83-aecf-106170c46d08 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:21:29.423484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8703fb13-cfda-435c-8ced-889d0ad7bc03 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '.version_select at 0x7f31aa0e1ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:29.470676 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8703fb13-cfda-435c-8ced-889d0ad7bc03 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Image not found. Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8703fb13-cfda-435c-8ced-889d0ad7bc03 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/images/e31b0728-a012-473e-b94c-b7dbdfb23e00 HTTP/1.1 Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: exception: Image not found. Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'e31b0728-a012-473e-b94c-b7dbdfb23e00'} Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e31b0728-a012-473e-b94c-b7dbdfb23e00 to delete Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e31b0728-a012-473e-b94c-b7dbdfb23e00 could not be found. Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:29.472973 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8703fb13-cfda-435c-8ced-889d0ad7bc03 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Image not found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8703fb13-cfda-435c-8ced-889d0ad7bc03 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/images/e31b0728-a012-473e-b94c-b7dbdfb23e00" status: 404 len: 62 microversion: 2.1 time: 0.056615 Oct 27 09:21:29.480554 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2183/4308] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:29 2022] DELETE /compute/v2.1/images/e31b0728-a012-473e-b94c-b7dbdfb23e00 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:21:29.492229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:29.492229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:29.507419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.508006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.508454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:29.509177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.509644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.510086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:29.550081 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 HTTP/1.1 Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '86a30a71-9684-40d4-956c-89720806bff3'} Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:21:29.552024 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0d432150-cdad-4385-af07-b4f50511eff6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 404 len: 111 microversion: 2.1 time: 0.073801 Oct 27 09:21:29.559017 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2184/4309] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:21:29 2022] DELETE /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:21:29.566591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:29.566591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 86a30a71-9684-40d4-956c-89720806bff3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:29.570139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.570761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.571317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:29.572177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.572914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.573470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:29.609257 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 HTTP/1.1 Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '86a30a71-9684-40d4-956c-89720806bff3'} Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.611656 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Instance 86a30a71-9684-40d4-956c-89720806bff3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:21:29.619587 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6cfa9985-b37e-42fc-bc67-7c6bfd5d0f50 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3" status: 404 len: 111 microversion: 2.1 time: 0.056339 Oct 27 09:21:29.622338 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2185/4310] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:29 2022] GET /compute/v2.1/servers/86a30a71-9684-40d4-956c-89720806bff3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:21:29.627152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e46424e7-f2dc-4f5a-b5d7-6e84f83dd1fa tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '.version_select at 0x7f31ae6c44c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:29.652971 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e46424e7-f2dc-4f5a-b5d7-6e84f83dd1fa tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131355798" status: 202 len: 0 microversion: 2.1 time: 0.029902 Oct 27 09:21:29.658167 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2186/4311] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 09:21:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131355798 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:21:29.705998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:29.706579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:29.716844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.718735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.722004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:29.722984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:29.723780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:29.724522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:30.034480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:30.075055 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-763918a7-096f-479a-aa0d-c8fe9778a5de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1508 microversion: 2.1 time: 0.730398 Oct 27 09:21:30.076872 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2126/4312] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:29 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1508 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:30.414914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:30.448298 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c21029d4-e46f-46e8-b9c4-a4655b5b4091 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.745679 Oct 27 09:21:30.454892 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2187/4313] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:29 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:31.131987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:31.133108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:31.158086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:31.163324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:31.164956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:31.166592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:31.167850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:31.168922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:31.484613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:31.487679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:31.519925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:31.520744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:31.521469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:31.522740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:31.523600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:31.524387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:32.270967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:32.321348 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0cc89444-3996-4495-91de-91d53bd0b207 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1508 microversion: 2.1 time: 1.177146 Oct 27 09:21:32.328827 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2127/4314] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:31 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1508 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:32.353261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10e2b0e5-5077-4e07-96b7-daf6913aef39 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '.version_select at 0x7f31a8f6b940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:32.416798 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-10e2b0e5-5077-4e07-96b7-daf6913aef39 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Image not found. Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10e2b0e5-5077-4e07-96b7-daf6913aef39 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/images/6f7fe102-27a1-4652-a916-c476471cbd80 HTTP/1.1 Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: exception: Image not found. Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '6f7fe102-27a1-4652-a916-c476471cbd80'} Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6f7fe102-27a1-4652-a916-c476471cbd80 to delete Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6f7fe102-27a1-4652-a916-c476471cbd80 could not be found. Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:32.418893 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10e2b0e5-5077-4e07-96b7-daf6913aef39 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Image not found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10e2b0e5-5077-4e07-96b7-daf6913aef39 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/images/6f7fe102-27a1-4652-a916-c476471cbd80" status: 404 len: 62 microversion: 2.1 time: 0.089458 Oct 27 09:21:32.422877 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2128/4315] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:32 2022] DELETE /compute/v2.1/images/6f7fe102-27a1-4652-a916-c476471cbd80 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:21:32.433398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:32.433909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:32.454866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:32.455379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:32.455864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:32.456884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:32.457160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:32.472835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:32.496085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:32.514376 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 HTTP/1.1 Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5146b080-63f9-4084-839b-ee9fa3c6c6c4'} Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:21:32.518982 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.523854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.524685 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6dbdb7ad-e71d-4db3-b75d-b2a063caa5b4 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 1.048323 Oct 27 09:21:32.526350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:21:32.527496 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e61a411c-a105-4893-a3f7-b9d1ba39685b tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 404 len: 111 microversion: 2.1 time: 0.098487 Oct 27 09:21:32.527877 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2188/4316] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:31 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:32.528893 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2129/4317] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:21:32 2022] DELETE /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:21:32.533050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-555bb19a-7a0c-48c5-b917-b46e07275dd1 req-0fdaa2bc-f6f4-49f0-aff9-e5811290f1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33172046-c141-45cb-9fe0-7d14e946adde", "name": "network-vif-deleted", "tag": "99f95fd7-aca0-4eba-9752-8b35a8dba430"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:32.548082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:32.549124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] [instance: 5146b080-63f9-4084-839b-ee9fa3c6c6c4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:32.557357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:32.558301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:32.558982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:32.560159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:32.561180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:32.561894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:32.562854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-555bb19a-7a0c-48c5-b917-b46e07275dd1 req-0fdaa2bc-f6f4-49f0-aff9-e5811290f1ef service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:32.564794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-555bb19a-7a0c-48c5-b917-b46e07275dd1 req-0fdaa2bc-f6f4-49f0-aff9-e5811290f1ef service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:32.565309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-555bb19a-7a0c-48c5-b917-b46e07275dd1 req-0fdaa2bc-f6f4-49f0-aff9-e5811290f1ef service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:32.593660 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] HTTP exception thrown: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Request method failure captured: Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 HTTP/1.1 Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk0Y4bQdJLzU0_OML7ZL9FHyaQ2tDKM39G3w5WJ2h11Ur3dMjxYvY288nH1080ra7T_e_9E3ZidjQrHtyTSDWFNo37xtHs99v-v1ZU52HyKqe3Lkj8lhZ8N7ys0tl0cMMWWmIq48Al0alsA-POA8FjKIr2gWhqwotwgFHopEmZjxTMg Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4f37ec78b0c4015812d9ccb67992c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4f37ec78b0c4015812d9ccb67992c35"}]}] Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b4f37ec78b0c4015812d9ccb67992c35 Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269 Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9cf86af347d545c79ccb2fdef888e23d Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2013739269-project Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5146b080-63f9-4084-839b-ee9fa3c6c6c4'} Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.597212 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:32.601156 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.601156 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:32.601156 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:32.601156 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:32.601156 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:21:32.601156 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:21:32.601156 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. Oct 27 09:21:32.601156 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:32.602069 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-555bb19a-7a0c-48c5-b917-b46e07275dd1 req-0fdaa2bc-f6f4-49f0-aff9-e5811290f1ef service nova] Creating event network-vif-deleted:99f95fd7-aca0-4eba-9752-8b35a8dba430 for instance 33172046-c141-45cb-9fe0-7d14e946adde on n-h2-858383-16 Oct 27 09:21:32.603039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] Returning 404 to user: Instance 5146b080-63f9-4084-839b-ee9fa3c6c6c4 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:21:32.604235 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-75de94c5-4bb3-4a70-86d8-9b1a3936e9e6 tempest-ImagesOneServerNegativeTestJSON-2013739269 tempest-ImagesOneServerNegativeTestJSON-2013739269-project] 10.222.0.25 "GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4" status: 404 len: 111 microversion: 2.1 time: 0.070805 Oct 27 09:21:32.604910 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-555bb19a-7a0c-48c5-b917-b46e07275dd1 req-0fdaa2bc-f6f4-49f0-aff9-e5811290f1ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075657 Oct 27 09:21:32.606268 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2130/4318] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:32 2022] GET /compute/v2.1/servers/5146b080-63f9-4084-839b-ee9fa3c6c6c4 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:21:32.610970 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2189/4319] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:21:33.356368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:33.363079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:33.391972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:33.395514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:33.397425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:33.401138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:33.406110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:33.408565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:33.530591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:33.531713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:33.533125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:33.534259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lazy-loading 'fault' on Instance uuid 33172046-c141-45cb-9fe0-7d14e946adde {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:21:33.552712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:33.555148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:33.569295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:33.571049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:33.572110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:33.575697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:33.579050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:33.579986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:33.624555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:33.650941 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3da8948e-d959-42fa-aeab-1ed8433c8484 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 200 len: 1305 microversion: 2.1 time: 0.302120 Oct 27 09:21:33.653549 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2131/4320] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:33 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 1305 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:33.942362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:33.957407 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-48190dfb-baa0-4ca2-bf2d-c1451142a6ce tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.409844 Oct 27 09:21:33.959923 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2190/4321] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:33 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:34.686674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:34.689544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:34.729250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:34.729857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:34.732311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:34.741394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:34.741689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:34.745155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:34.784409 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde HTTP/1.1 Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '33172046-c141-45cb-9fe0-7d14e946adde'} Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:21:34.788281 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:34.792417 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:21:34.792417 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:21:34.792417 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:21:34.792417 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:21:34.792417 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:21:34.792417 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:21:34.792417 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:21:34.792417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:21:34.792417 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd23588a-7f72-4efd-84f0-2a9b976f169d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 404 len: 111 microversion: 2.1 time: 0.113482 Oct 27 09:21:34.811097 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2132/4322] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:34 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:21:35.009501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:35.010653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:35.016377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1022824631", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "3527ca6b-4f14-40c0-86a3-873f2fef222c"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:35.032700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:35.033208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:35.033652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:35.034380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:35.034836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:35.035265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:35.084371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] validate_networks() for [('3527ca6b-4f14-40c0-86a3-873f2fef222c', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:21:35.612688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:35.641527 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9a1d8b38-1242-4d8e-967a-59f3adde7ad6 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.637350 Oct 27 09:21:35.645227 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2191/4323] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:34 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:36.681658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:36.687860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:36.721805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:36.722581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:36.723351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:36.730671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:36.731814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:36.736968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:36.816342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:21:36.817497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:21:36.818210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:21:36.818846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:21:36.819690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:21:36.836039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:36.836913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:36.837684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:36.838770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:36.839639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:36.840335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:36.881136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:21:36.889212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for user 0a9243ea430b4d2ba18c2a1e54e7c6aa and project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:21:36.924410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:21:36.927678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:21:37.047342 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-22a9b75e-a153-4ae0-9f55-2a638e7dd2a3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.034749 Oct 27 09:21:37.049637 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2133/4324] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:21:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:21:37.072186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:37.073866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c099ce78-2445-4677-94ef-28eac93640f2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:37.076772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c099ce78-2445-4677-94ef-28eac93640f2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:37.107291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f4d02757-6ba0-43f3-b97c-a00094c5cc08 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.438111 Oct 27 09:21:37.116379 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2192/4325] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:36 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:37.221257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c099ce78-2445-4677-94ef-28eac93640f2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:37.237071 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c099ce78-2445-4677-94ef-28eac93640f2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1215 microversion: 2.1 time: 0.179333 Oct 27 09:21:37.239263 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2134/4326] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:37 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:38.151491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:38.153934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:38.198691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:38.204447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:38.205458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:38.211475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:38.213066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:38.217568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:38.268227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:38.271793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:38.319590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:38.326153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:38.332007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:38.335020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:38.340411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:38.341859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:38.663316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:38.699392 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-adc8245d-9552-41ea-b057-5d3c447fa1dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1211 microversion: 2.1 time: 0.441009 Oct 27 09:21:38.705035 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2135/4327] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:38 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1211 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:38.817972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:38.836915 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-691eeac9-a468-42d8-afcd-0f368a4edc38 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.692134 Oct 27 09:21:38.877565 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2193/4328] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:38 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:39.755547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:39.761708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:39.802027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:39.808102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:39.809357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:39.813784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:39.814702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:39.816559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:39.883817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:39.884880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:39.911736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:39.912581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:39.917549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:39.918247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:39.918749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:39.919202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:39.983003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:40.017794 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5fb3a48-b8db-4820-ba16-91006d9d765c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1273 microversion: 2.1 time: 0.275201 Oct 27 09:21:40.019894 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2136/4329] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:39 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:40.326092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:40.348693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e39dcde-df63-4bc9-832b-67bd0315473a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.469702 Oct 27 09:21:40.364685 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2194/4330] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:39 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:41.069006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:41.080353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:41.142840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:41.148601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:41.150156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:41.160384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:41.161606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:41.168900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:41.380855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:41.386742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:41.397989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:41.402490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:41.404534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:41.405567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:41.420322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:41.421997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:41.422136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:41.528029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lazy-loading 'flavor' on Instance uuid 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:21:41.767528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:41.833458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:41.858464 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd2def00-ae6c-475e-90f5-a227cb98ddbd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1315 microversion: 2.1 time: 0.802738 Oct 27 09:21:41.876168 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2137/4331] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:41 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:41.876168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:41.876168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:41.891041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:41.891041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:41.891041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:41.894484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:41.894974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:41.896539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:41.945416 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a39625fc-391a-4d6c-848a-8d7414e9aca0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/action" status: 200 len: 32 microversion: 2.1 time: 0.573713 Oct 27 09:21:41.957010 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2195/4332] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:21:41 2022] POST /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/action => generated 32 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:21:41.978294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:41.983870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:42.001647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:42.004243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:42.005090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:42.005989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:42.006675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:42.012371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:42.371680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:42.382713 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-76880416-55f2-437c-9a02-c98a0df59df4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1735 microversion: 2.1 time: 0.422782 Oct 27 09:21:42.396386 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2196/4333] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:41 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1735 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:42.422105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:42.440556 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13217fd7-cfe0-4441-82f9-073fd2778dd0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 0.576509 Oct 27 09:21:42.441298 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2138/4334] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:41 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:42.906769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:42.919798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:42.935741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:42.936790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:42.940691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:42.942258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:42.945236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:42.946283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:43.233883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0ebfc22f-3940-4710-b410-2d52e81324d4 req-d3dc34bb-5359-410e-8353-ad40d2a96a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b636e1b0-c610-4b0c-a3b2-8ff5992647c6", "tag": "2006621a-da0a-4f2d-a465-79304511fd28"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:43.259262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0ebfc22f-3940-4710-b410-2d52e81324d4 req-d3dc34bb-5359-410e-8353-ad40d2a96a98 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:43.260376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0ebfc22f-3940-4710-b410-2d52e81324d4 req-d3dc34bb-5359-410e-8353-ad40d2a96a98 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:43.261626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0ebfc22f-3940-4710-b410-2d52e81324d4 req-d3dc34bb-5359-410e-8353-ad40d2a96a98 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:43.275389 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0ebfc22f-3940-4710-b410-2d52e81324d4 req-d3dc34bb-5359-410e-8353-ad40d2a96a98 service nova] Creating event network-changed:2006621a-da0a-4f2d-a465-79304511fd28 for instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 on n-h2-858383-16 Oct 27 09:21:43.289273 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0ebfc22f-3940-4710-b410-2d52e81324d4 req-d3dc34bb-5359-410e-8353-ad40d2a96a98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060439 Oct 27 09:21:43.294199 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2139/4335] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:21:43.425402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:43.431375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:43.446009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:43.446233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:43.446689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:43.447923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:43.448552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:43.449153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:43.732055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:43.754536 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9fb38884-fa55-4881-96c0-2807b1910e88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1315 microversion: 2.1 time: 0.855687 Oct 27 09:21:43.755824 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2197/4336] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:42 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:43.763130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:43.764144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:43.777005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:43.784209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:43.787449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:43.792736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:43.793501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:43.794250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:44.437087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:44.454905 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e43319ac-2f10-4824-bbcc-fc9cbdf8e1d9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1735 microversion: 2.1 time: 1.038073 Oct 27 09:21:44.467613 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2140/4337] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:43 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1735 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:44.789234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:44.805224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:44.808777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:44.820764 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57ee5661-4e53-417a-8679-9de66169fd01 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 1.061612 Oct 27 09:21:44.821417 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2198/4338] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:43 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:44.866573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:44.880354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:44.883985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:44.889554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:44.892984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:44.896659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:45.490607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:45.494307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:45.495757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:45.509828 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59fc22a7-f6d9-47e8-8646-4120365eabce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1315 microversion: 2.1 time: 0.715823 Oct 27 09:21:45.510698 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2141/4339] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:44 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:45.532065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:45.535943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:45.538975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:45.542911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:45.543887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:45.547883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:45.870544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:45.871291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:45.888739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:45.889240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:45.889922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:45.890848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:45.891588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:45.892257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:46.851160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:46.873934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:46.888522 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-26f10e29-ea47-41de-9e02-adbb71ecc7f5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1735 microversion: 2.1 time: 1.410968 Oct 27 09:21:46.890894 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2199/4340] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:45 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1735 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:46.895623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:46.904254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:46.905742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:46.913988 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12f29537-5e33-404f-9bbf-36513958e04c tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1523 microversion: 2.1 time: 1.047137 Oct 27 09:21:46.916507 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2142/4341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:45 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1523 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:46.918459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:46.919671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:46.920807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:46.922466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:46.923670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:46.924691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:47.279176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:47.295112 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9cb49590-017d-42bf-9e8e-4872997fa6fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1315 microversion: 2.1 time: 0.401541 Oct 27 09:21:47.301651 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2200/4342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:46 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:47.943429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:47.947126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:47.964362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:47.970358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:47.980019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:47.999268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:48.003953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:48.004388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:48.006956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:48.008143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:48.009322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:48.012219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:48.014440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:48.018127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:48.018744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:48.019752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:48.021452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:48.681344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:48.697451 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce66bb7c-9c7e-4252-8a26-8a063c47b3ef tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1735 microversion: 2.1 time: 0.765940 Oct 27 09:21:48.720561 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2143/4343] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:47 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1735 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:48.724688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:48.725698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:48.733545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:48.735627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:48.737833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:48.739418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:48.741202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:48.742015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:49.047055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:49.067338 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0eaf5c8-a718-42ec-b422-3bab2aa802b0 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1503 microversion: 2.1 time: 1.112031 Oct 27 09:21:49.068303 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2201/4344] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:47 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1503 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:49.093670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-88369595-c3e5-45d8-83a3-69e4725cceca tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Action: 'create', calling method: .version_select at 0x7f31aa3dfb80>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-26683117", "description": "tempest-description-285428776"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:49.351003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:49.361824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:49.384055 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0cdfcc1c-2808-4893-9062-fb097c66c5d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1315 microversion: 2.1 time: 0.681441 Oct 27 09:21:49.385136 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2144/4345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:48 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:49.735694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:49.739331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:49.768150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:49.775767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:49.779382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:49.780861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:49.781721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:49.782348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:49.823357 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-88369595-c3e5-45d8-83a3-69e4725cceca tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.729241 Oct 27 09:21:49.825553 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2202/4346] 10.222.0.25 () {60 vars in 1180 bytes} [Thu Oct 27 09:21:49 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:21:49.855812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-26683117"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:49.856890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:49.870194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:49.872817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:49.874467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:49.876486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:49.877912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:49.879262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:50.408139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:50.420673 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-761bc1c7-0078-47c7-a1ef-f59790b2c2a5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1735 microversion: 2.1 time: 0.694746 Oct 27 09:21:50.426974 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2145/4347] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:49 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1735 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:21:50.434238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:50.441517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:50.456630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.network.security_group_api [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Adding security group 91d8c5f5-13fc-4d3a-9c47-5aebb458a73f to port 317c79ff-f5cf-45ff-ac91-1f2159115cb7 Oct 27 09:21:50.468490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:50.469878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:50.473464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:50.479407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:50.480339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:50.481103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:51.517237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:51.529390 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bfd476d-26f4-4abd-bfab-0faffd5b6a7c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1315 microversion: 2.1 time: 1.098975 Oct 27 09:21:51.529907 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2146/4348] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:50 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1315 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:51.548700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:51.553508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:51.577707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:51.578242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:51.579723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:51.583020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:51.583749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:51.584220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:51.746720 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f6524f9-b15d-4fc1-902e-f7b9f808e18a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action" status: 202 len: 0 microversion: 2.1 time: 1.899450 Oct 27 09:21:51.747839 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2203/4349] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:21:49 2022] POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action => generated 0 bytes in 1902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:21:51.760535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-26683117"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:51.761623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:51.781859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:51.784284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:51.786686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:51.788352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:51.789043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:51.792229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:52.586421 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.network.security_group_api [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Removing security group 91d8c5f5-13fc-4d3a-9c47-5aebb458a73f from port 317c79ff-f5cf-45ff-ac91-1f2159115cb7 Oct 27 09:21:52.677733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:52.712120 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a627800-db38-4dda-9f4d-1ece613da41c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1735 microversion: 2.1 time: 1.180714 Oct 27 09:21:52.718782 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2147/4350] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:51 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1735 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:52.729115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-4960571f-45f0-4e04-a776-e1122c247c09 req-208876ba-ea9e-432f-b394-b267ae443707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5633b711-da7a-440c-8a7e-e88b38c51f17", "tag": "317c79ff-f5cf-45ff-ac91-1f2159115cb7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:52.765343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4960571f-45f0-4e04-a776-e1122c247c09 req-208876ba-ea9e-432f-b394-b267ae443707 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:52.770833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4960571f-45f0-4e04-a776-e1122c247c09 req-208876ba-ea9e-432f-b394-b267ae443707 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:52.772777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4960571f-45f0-4e04-a776-e1122c247c09 req-208876ba-ea9e-432f-b394-b267ae443707 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:52.814985 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-4960571f-45f0-4e04-a776-e1122c247c09 req-208876ba-ea9e-432f-b394-b267ae443707 service nova] Creating event network-changed:317c79ff-f5cf-45ff-ac91-1f2159115cb7 for instance 5633b711-da7a-440c-8a7e-e88b38c51f17 on n-h1-858383-16 Oct 27 09:21:52.871372 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-4960571f-45f0-4e04-a776-e1122c247c09 req-208876ba-ea9e-432f-b394-b267ae443707 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149541 Oct 27 09:21:52.884626 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2148/4351] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:21:52.892602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:52.893680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:52.901346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:52.902192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:52.903005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:52.904027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:52.904714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:52.905405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:54.435878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:54.461844 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5076e7b-936f-48f8-897b-97bd1fe4e1d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1315 microversion: 2.1 time: 1.574099 Oct 27 09:21:54.475628 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2149/4352] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:52 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1315 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:54.483165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:54.503386 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-692048a3-a039-4426-b7fe-667e6bb594de tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action" status: 202 len: 0 microversion: 2.1 time: 2.750221 Oct 27 09:21:54.506196 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2204/4353] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:21:51 2022] POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action => generated 0 bytes in 2754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:21:54.511877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:54.527866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f997be7-c131-4989-ab81-0a81957dd8fa tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Action: 'create', calling method: .version_select at 0x7f31aa331a60>, body: {"pool": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:54.548320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:54.549765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:54.550919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:54.555724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:54.556997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:54.558135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:57.115032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:57.125525 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce7aba7e-a977-47ff-90fd-868deb6a07d3 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1735 microversion: 2.1 time: 2.660951 Oct 27 09:21:57.127476 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2150/4354] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:54 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1735 bytes in 2664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:57.132534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-338a2768-c5a6-4d74-94c8-0dc6381433cf req-29d4e42a-b968-41a8-8585-cbf8ca546440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5633b711-da7a-440c-8a7e-e88b38c51f17", "tag": "317c79ff-f5cf-45ff-ac91-1f2159115cb7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:57.147396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:21:57.151428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-338a2768-c5a6-4d74-94c8-0dc6381433cf req-29d4e42a-b968-41a8-8585-cbf8ca546440 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:57.152381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-338a2768-c5a6-4d74-94c8-0dc6381433cf req-29d4e42a-b968-41a8-8585-cbf8ca546440 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:57.153026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-338a2768-c5a6-4d74-94c8-0dc6381433cf req-29d4e42a-b968-41a8-8585-cbf8ca546440 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:57.169628 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-338a2768-c5a6-4d74-94c8-0dc6381433cf req-29d4e42a-b968-41a8-8585-cbf8ca546440 service nova] Creating event network-changed:317c79ff-f5cf-45ff-ac91-1f2159115cb7 for instance 5633b711-da7a-440c-8a7e-e88b38c51f17 on n-h1-858383-16 Oct 27 09:21:57.179261 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-338a2768-c5a6-4d74-94c8-0dc6381433cf req-29d4e42a-b968-41a8-8585-cbf8ca546440 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050147 Oct 27 09:21:57.180282 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2151/4355] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:21:57.191457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:21:57.193976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:21:57.207535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:57.208281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:57.208949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:57.209765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:57.210690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:57.211145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:58.445250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:21:58.483526 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-026972b2-b0f9-4c24-9bf5-e1ba2538ba00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1315 microversion: 2.1 time: 1.301158 Oct 27 09:21:58.490995 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2152/4356] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:21:57 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1315 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:21:58.514179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a6d6a189-8667-495d-bae1-cc76d4fb4b3d req-87ca31de-1685-408a-b73c-c01c9894ca2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b636e1b0-c610-4b0c-a3b2-8ff5992647c6", "name": "network-vif-plugged", "status": "completed", "tag": "2006621a-da0a-4f2d-a465-79304511fd28"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:58.556120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6d6a189-8667-495d-bae1-cc76d4fb4b3d req-87ca31de-1685-408a-b73c-c01c9894ca2d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:21:58.558421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6d6a189-8667-495d-bae1-cc76d4fb4b3d req-87ca31de-1685-408a-b73c-c01c9894ca2d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:21:58.561916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6d6a189-8667-495d-bae1-cc76d4fb4b3d req-87ca31de-1685-408a-b73c-c01c9894ca2d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:21:58.592472 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a6d6a189-8667-495d-bae1-cc76d4fb4b3d req-87ca31de-1685-408a-b73c-c01c9894ca2d service nova] Creating event network-vif-plugged:2006621a-da0a-4f2d-a465-79304511fd28 for instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 on n-h2-858383-16 Oct 27 09:21:58.607687 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a6d6a189-8667-495d-bae1-cc76d4fb4b3d req-87ca31de-1685-408a-b73c-c01c9894ca2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112471 Oct 27 09:21:58.609494 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2153/4357] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:21:59.497759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-46997435", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "c5da854f-cbaa-4e78-8c2f-21455c4b1fb2"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:21:59.659992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] validate_networks() for [('c5da854f-cbaa-4e78-8c2f-21455c4b1fb2', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:22:01.784474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=17 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:01.857879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:02.544106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:22:02.544942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:22:02.545476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:22:02.546210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:22:02.547498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:22:02.564081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:02.564784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:02.565516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:02.566683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:02.567783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:02.568705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:02.611206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Getting quotas for project 9e6eea8863b94452be5efddaa8a3320f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:22:02.621154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Getting quotas for user 127a3c646e1145c8be4a10d1608c1277 and project 9e6eea8863b94452be5efddaa8a3320f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:22:02.646520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:22:02.651268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:22:02.742851 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59908615-8105-47ce-8dda-de4afbcbe999 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.129828 Oct 27 09:22:02.743999 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2154/4358] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:22:02.751913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:02.753568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:02.766073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:02.766973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:02.767795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:02.769820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:02.770687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:02.771473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:03.928431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:03.939932 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f7782ad-786b-4c16-a477-b38649b0d69e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1735 microversion: 2.1 time: 1.194236 Oct 27 09:22:03.944873 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2155/4359] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:02 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1735 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:03.950062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:03.951009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:03.959247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:03.960820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:03.961461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:03.962504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:03.963142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:03.963758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:04.497513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:04.505671 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e6f621d-1111-42ea-96a8-bfa64a9110e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.559462 Oct 27 09:22:04.506252 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2156/4360] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:03 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:04.516404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:04.519071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:04.535523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:04.538417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:04.539704 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f997be7-c131-4989-ab81-0a81957dd8fa tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 10.021952 Oct 27 09:22:04.540842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:04.542118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:04.544485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:04.546349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:04.554768 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2205/4361] 10.222.0.25 () {60 vars in 1170 bytes} [Thu Oct 27 09:21:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 10040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:22:04.572179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:04.602654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:04.650072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:04.652196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:04.653042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:04.656923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:04.657832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:04.658714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:04.930393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:04.949082 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6fa5a4d9-790f-482a-a607-41d9ba781961 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1267 microversion: 2.1 time: 0.392566 Oct 27 09:22:04.951741 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2206/4362] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:04 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1267 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:04.965661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:04.968101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:04.989615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:04.991069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:04.992264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:04.994737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:04.995762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:04.996387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:05.231858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:05.247855 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f043f7b1-962d-4111-96b4-e2c7999d5409 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1503 microversion: 2.1 time: 0.736762 Oct 27 09:22:05.250302 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2157/4363] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:04 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1503 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:05.258112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.62"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:05.262091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:05.272382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:05.272898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:05.273638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:05.274815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:05.275442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:05.276071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:05.525530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:05.542008 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b9974c5f-a5c1-4418-ada0-e27af651ec07 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.583893 Oct 27 09:22:05.575677 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2207/4364] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:04 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:05.595623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:05.603958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:05.635276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:05.635854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:05.636546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:05.653306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:05.654201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:05.654782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:06.440568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "refresh_cache-5633b711-da7a-440c-8a7e-e88b38c51f17" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:22:06.452898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquired lock "refresh_cache-5633b711-da7a-440c-8a7e-e88b38c51f17" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:22:06.685095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:06.741039 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47e31be0-4872-42c7-980e-948137d51ff5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1735 microversion: 2.1 time: 1.159113 Oct 27 09:22:06.742272 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2208/4365] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:05 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1735 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:06.781999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:06.789553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:06.819933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:06.826521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:06.829256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:06.831923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:06.845526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:06.846498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:07.711222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:07.747912 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7253fb86-4c50-4d56-9976-3eb3b2a87151 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.999346 Oct 27 09:22:07.767818 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2209/4366] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:06 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:07.797886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:07.801774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:07.834979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:07.835710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:07.836177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:07.840677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:07.842379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:07.842849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:08.466457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:08.492375 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c78a4cb3-1966-4334-a217-eee2d187f279 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1315 microversion: 2.1 time: 0.735403 Oct 27 09:22:08.524263 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2210/4367] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:07 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:08.541174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:08.544681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:08.571551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:08.572892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:08.573943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:08.575447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:08.576547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:08.577575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:08.678426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:22:08.949262 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ac74d95c-35eb-4d7e-9cf0-cb47c008b0fa tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 204 len: 0 microversion: 2.1 time: 0.423222 Oct 27 09:22:08.954461 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2211/4368] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:22:08 2022] DELETE /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:22:08.960488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:08.961223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:08.980755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:08.981437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:08.981899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:08.982654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:08.983208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:08.983541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:09.790185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:09.841227 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b9fa53c-028e-4902-8b74-8d317e8d0287 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1715 microversion: 2.1 time: 0.885014 Oct 27 09:22:09.846022 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2212/4369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:08 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1715 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:09.858059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-097d0281-58eb-4fe6-a408-0d292c30d2a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1689740279"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:09.867547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-097d0281-58eb-4fe6-a408-0d292c30d2a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:09.882793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097d0281-58eb-4fe6-a408-0d292c30d2a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:09.884811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097d0281-58eb-4fe6-a408-0d292c30d2a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:09.888525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097d0281-58eb-4fe6-a408-0d292c30d2a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:09.889775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097d0281-58eb-4fe6-a408-0d292c30d2a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:09.892923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097d0281-58eb-4fe6-a408-0d292c30d2a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:09.893980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-097d0281-58eb-4fe6-a408-0d292c30d2a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:10.256541 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-097d0281-58eb-4fe6-a408-0d292c30d2a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.408395 Oct 27 09:22:10.259905 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2213/4370] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:22:09 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 27 09:22:10.271745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26304f2b-e7e6-4672-97ba-b324d692eeeb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdfbf88c-039a-4428-9c5a-8061572800c5"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:10.275031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-26304f2b-e7e6-4672-97ba-b324d692eeeb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:10.289766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26304f2b-e7e6-4672-97ba-b324d692eeeb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:10.290844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26304f2b-e7e6-4672-97ba-b324d692eeeb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:10.291511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26304f2b-e7e6-4672-97ba-b324d692eeeb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:10.292583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26304f2b-e7e6-4672-97ba-b324d692eeeb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:10.293222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26304f2b-e7e6-4672-97ba-b324d692eeeb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:10.293848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26304f2b-e7e6-4672-97ba-b324d692eeeb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:10.778462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Building network info cache for instance {{(pid=120603) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:22:10.891205 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-26304f2b-e7e6-4672-97ba-b324d692eeeb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.628655 Oct 27 09:22:10.896017 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2214/4371] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:22:10 2022] POST /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:10.902990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:10.904057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:10.912561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:10.913627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:10.914291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:10.916054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:10.916868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:10.917509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:11.571092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:11.608286 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-abcabf23-66cc-4073-b3d5-4e31bfc67c9a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1551 microversion: 2.1 time: 0.710502 Oct 27 09:22:11.608966 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2215/4372] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:10 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1551 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:11.633376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:11.634006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:11.650734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:11.651245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:11.651729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:11.652518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:11.652989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:11.653426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:12.158182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:12.178296 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-441507ad-4ea4-44cc-a611-aef607699ea9 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1315 microversion: 2.1 time: 0.548980 Oct 27 09:22:12.184860 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2216/4373] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:11 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:12.223347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:12.226258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:12.242263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:12.252414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:12.254498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:12.255502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:12.261552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:12.263110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:12.528483 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] HTTP exception thrown: Cannot 'detach_volume' instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e while it is in vm_state rescued Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Request method failure captured: Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments/ed6a992a-bb3b-4003-a15a-a5b430ed6563 HTTP/1.1 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkzDycu2zrvEyACIIrQoHV06Jd0It45Rv0F2xQOPM2wSnWHcd2-qrADZYvnaOYh5v8cskDBIeRUmgZuL2fU3btGeQcZ_Q6fTjrMtyd25Sz9aShgYNBtDFz-Hs50Qjx2g1J9zbfldbysO0umRvOL_OrzT1jkVjcfTyFj5P-3m0Jht0Qc Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e28707cf49b24806879ae5acd0e08cf3"}]}] Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c6165562b6e14ff18dc7d82b8c9a46b3 Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: exception: Cannot 'detach_volume' instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e while it is in vm_state rescued Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'server_id': '9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e', 'id': 'ed6a992a-bb3b-4003-a15a-a5b430ed6563'} Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e while it is in vm_state rescued Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:12.531663 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:12.536269 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:12.536269 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:12.536269 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:22:12.536269 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:22:12.536269 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e while it is in vm_state rescued Oct 27 09:22:12.536269 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:12.539692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Returning 409 to user: Cannot 'detach_volume' instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e while it is in vm_state rescued {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:22:12.540916 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c488a419-fca3-4bd8-9bae-763a2eaee67a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments/ed6a992a-bb3b-4003-a15a-a5b430ed6563" status: 409 len: 152 microversion: 2.1 time: 0.351484 Oct 27 09:22:12.547966 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2217/4374] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:22:12 2022] DELETE /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments/ed6a992a-bb3b-4003-a15a-a5b430ed6563 => generated 152 bytes in 362 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:22:12.559876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1c1200cd-4d88-438c-9c18-cfc9a74cc3b7 req-634c58ca-1452-4efc-beee-5f9b3d4c60eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cf1e6a-e4ad-446e-87f3-86469294ed83", "tag": "0ae575a9-44ec-4e0e-81de-8a8d84e5a728"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:12.581720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1c1200cd-4d88-438c-9c18-cfc9a74cc3b7 req-634c58ca-1452-4efc-beee-5f9b3d4c60eb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:12.582249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1c1200cd-4d88-438c-9c18-cfc9a74cc3b7 req-634c58ca-1452-4efc-beee-5f9b3d4c60eb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:12.582624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1c1200cd-4d88-438c-9c18-cfc9a74cc3b7 req-634c58ca-1452-4efc-beee-5f9b3d4c60eb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:12.586127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:12.599646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:12.628841 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1c1200cd-4d88-438c-9c18-cfc9a74cc3b7 req-634c58ca-1452-4efc-beee-5f9b3d4c60eb service nova] Creating event network-changed:0ae575a9-44ec-4e0e-81de-8a8d84e5a728 for instance 84cf1e6a-e4ad-446e-87f3-86469294ed83 on n-h2-858383-16 Oct 27 09:22:12.636574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:12.639360 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1c1200cd-4d88-438c-9c18-cfc9a74cc3b7 req-634c58ca-1452-4efc-beee-5f9b3d4c60eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089455 Oct 27 09:22:12.643892 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2218/4375] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:12.658602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f47f82ab-ccd1-432f-8cff-7ccef8767c47 req-95978f18-7fde-4464-859e-4e215d48e442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5633b711-da7a-440c-8a7e-e88b38c51f17", "tag": "317c79ff-f5cf-45ff-ac91-1f2159115cb7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:12.681723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f47f82ab-ccd1-432f-8cff-7ccef8767c47 req-95978f18-7fde-4464-859e-4e215d48e442 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:12.682791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f47f82ab-ccd1-432f-8cff-7ccef8767c47 req-95978f18-7fde-4464-859e-4e215d48e442 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:12.684040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f47f82ab-ccd1-432f-8cff-7ccef8767c47 req-95978f18-7fde-4464-859e-4e215d48e442 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:12.719661 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f47f82ab-ccd1-432f-8cff-7ccef8767c47 req-95978f18-7fde-4464-859e-4e215d48e442 service nova] Creating event network-changed:317c79ff-f5cf-45ff-ac91-1f2159115cb7 for instance 5633b711-da7a-440c-8a7e-e88b38c51f17 on n-h1-858383-16 Oct 27 09:22:12.729867 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f47f82ab-ccd1-432f-8cff-7ccef8767c47 req-95978f18-7fde-4464-859e-4e215d48e442 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084259 Oct 27 09:22:12.732810 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2219/4376] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:12.748417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77d761ee-1a49-46da-8ff4-33ff90c5be8a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:12.749600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-77d761ee-1a49-46da-8ff4-33ff90c5be8a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:12.762915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d761ee-1a49-46da-8ff4-33ff90c5be8a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:12.764434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d761ee-1a49-46da-8ff4-33ff90c5be8a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:12.766132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d761ee-1a49-46da-8ff4-33ff90c5be8a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:12.767031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d761ee-1a49-46da-8ff4-33ff90c5be8a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:12.767491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d761ee-1a49-46da-8ff4-33ff90c5be8a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:12.767944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d761ee-1a49-46da-8ff4-33ff90c5be8a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:12.880735 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77d761ee-1a49-46da-8ff4-33ff90c5be8a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/action" status: 202 len: 0 microversion: 2.1 time: 0.145785 Oct 27 09:22:12.886516 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2220/4377] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:22:12 2022] POST /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:22:12.903476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:12.904795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:12.919608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:12.923400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:12.923955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:12.924715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:12.925678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:12.925678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:13.809347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:13.824380 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a2eae4fa-c9b7-4df6-9553-84264e5a6672 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 200 len: 1551 microversion: 2.1 time: 0.935740 Oct 27 09:22:13.832064 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2221/4378] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:12 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 1551 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:13.848117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:13.849060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:13.871967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:13.873697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:13.877478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:13.879397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:13.884015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:13.885130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:14.787065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Updating instance_info_cache with network_info: [{"id": "317c79ff-f5cf-45ff-ac91-1f2159115cb7", "address": "fa:16:3e:60:fc:ca", "network": {"id": "a6cfd113-0f98-4e57-b7a4-b86be21d6bde", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-845890511-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e5b63428955b4c559e8ef364dffe0468", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap317c79ff-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120603) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:22:14.801862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Releasing lock "refresh_cache-5633b711-da7a-440c-8a7e-e88b38c51f17" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:22:14.802731 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fdc35b33-fa98-4150-99bf-a77e4b9819c3 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action" status: 202 len: 0 microversion: 2.1 time: 9.551070 Oct 27 09:22:14.805368 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2158/4379] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:22:05 2022] POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action => generated 0 bytes in 9554 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 09:22:14.818524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:14.819431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:14.840442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:14.841257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:14.844368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:14.845460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:14.846181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:14.848298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:15.773151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:15.819357 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9bea53ab-864b-449c-ad56-c674a213ecd0 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1723 microversion: 2.1 time: 1.984939 Oct 27 09:22:15.819986 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2222/4380] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:13 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1723 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:15.840238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.62"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:16.179470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:16.238548 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f945fd4f-3a14-4a76-ae26-77193d2a3e3d tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1315 microversion: 2.1 time: 1.431752 Oct 27 09:22:16.239750 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2159/4381] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:14 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1315 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:16.245291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:16.246278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: ad7e8877-ee82-40d8-b642-3819fd16f408] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:16.255358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:16.256414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:16.257092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:16.258107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:16.258811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:16.259463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:16.298666 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] HTTP exception thrown: Instance ad7e8877-ee82-40d8-b642-3819fd16f408 could not be found. Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Request method failure captured: Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 HTTP/1.1 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzHqeKdIEpMSXWOZdUtXXt_9NFMVS_ISr4dTPLT49pEghhN81i_huWqp51hTg5fqwtXMM0GKiiJPkIcBaWHbK4Jw4on218eNQQpCU-pF88LRyaXgJtNRTxnBgaX_g-I9LAlrYb0DHMYF7K16fJuMHAv_lipNTZkQg1ly31j27RJ9j0 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: f0630c5386744d07a21ac826f4d0d2b3 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestNetworkBasicOps-1842739308 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0630c5386744d07a21ac826f4d0d2b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0630c5386744d07a21ac826f4d0d2b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0630c5386744d07a21ac826f4d0d2b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0630c5386744d07a21ac826f4d0d2b3"}]}] Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestNetworkBasicOps-1842739308 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: f0630c5386744d07a21ac826f4d0d2b3 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestNetworkBasicOps-1842739308 Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestNetworkBasicOps-1842739308-project Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 203ed8cc61274041ae7a9bb1ac09fd1a Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestNetworkBasicOps-1842739308-project Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance ad7e8877-ee82-40d8-b642-3819fd16f408 could not be found. Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'ad7e8877-ee82-40d8-b642-3819fd16f408'} Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7e8877-ee82-40d8-b642-3819fd16f408 could not be found. Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7e8877-ee82-40d8-b642-3819fd16f408 could not be found. Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:16.300421 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:16.304990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:16.304990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:16.304990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:16.304990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:22:16.304990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:22:16.304990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7e8877-ee82-40d8-b642-3819fd16f408 could not be found. Oct 27 09:22:16.304990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:16.311535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Returning 404 to user: Instance ad7e8877-ee82-40d8-b642-3819fd16f408 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:22:16.313786 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8f5d9cf-d918-4a9f-ae12-a21843fc13d5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408" status: 404 len: 111 microversion: 2.1 time: 0.072503 Oct 27 09:22:16.319889 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2160/4382] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:16 2022] GET /compute/v2.1/servers/ad7e8877-ee82-40d8-b642-3819fd16f408 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:22:16.346356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3fea8c93-8e49-40d3-bb01-1ffadf9d24a7 req-908015cb-43b7-425a-9efb-e58046211a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7e8877-ee82-40d8-b642-3819fd16f408", "name": "network-vif-deleted", "tag": "6dc4a1cb-7da3-4777-bab4-543323d6ffbf"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:16.356986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3fea8c93-8e49-40d3-bb01-1ffadf9d24a7 req-908015cb-43b7-425a-9efb-e58046211a95 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:16.357480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3fea8c93-8e49-40d3-bb01-1ffadf9d24a7 req-908015cb-43b7-425a-9efb-e58046211a95 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:16.357921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3fea8c93-8e49-40d3-bb01-1ffadf9d24a7 req-908015cb-43b7-425a-9efb-e58046211a95 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:16.378551 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3fea8c93-8e49-40d3-bb01-1ffadf9d24a7 req-908015cb-43b7-425a-9efb-e58046211a95 service nova] Creating event network-vif-deleted:6dc4a1cb-7da3-4777-bab4-543323d6ffbf for instance ad7e8877-ee82-40d8-b642-3819fd16f408 on n-h1-858383-16 Oct 27 09:22:16.393483 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3fea8c93-8e49-40d3-bb01-1ffadf9d24a7 req-908015cb-43b7-425a-9efb-e58046211a95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059497 Oct 27 09:22:16.396758 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2161/4383] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:16.475439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:16.488590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:16.489420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:16.490167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:16.491156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:16.492111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:16.493174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:16.849396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:16.850109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:16.868483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:16.868996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:16.869448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:16.870175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:16.870639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:16.876210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:17.504018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "refresh_cache-5633b711-da7a-440c-8a7e-e88b38c51f17" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:22:17.504756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquired lock "refresh_cache-5633b711-da7a-440c-8a7e-e88b38c51f17" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:22:17.798869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:17.825843 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0532621a-49d3-4665-881b-7dd4af45ab07 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1723 microversion: 2.1 time: 0.982313 Oct 27 09:22:17.841776 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2162/4384] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:16 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1723 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:22:17.854505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:17.855380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:17.865406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:17.866185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:17.867472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:17.868443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:17.869080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:17.869672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:18.399956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:18.411585 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fdfa19eb-4119-4888-be31-6d0312d35c07 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1315 microversion: 2.1 time: 0.563829 Oct 27 09:22:18.416216 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2163/4385] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:17 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:18.424254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d87f4a3-0a24-4e5b-9a10-e7c2210ed1f0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '.version_select at 0x7f31a8f79160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:18.461054 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d87f4a3-0a24-4e5b-9a10-e7c2210ed1f0 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-47130268" status: 202 len: 0 microversion: 2.1 time: 0.043016 Oct 27 09:22:18.462236 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2164/4386] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:22:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-47130268 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:22:18.856363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:18.857990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:18.871929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:18.875550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:18.876493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:18.881061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:18.881926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:18.884405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:19.279749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Building network info cache for instance {{(pid=120602) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 27 09:22:19.535460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:19.549060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:19.590987 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3231d48b-4ac6-4485-a107-d7c23eeefef2 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1723 microversion: 2.1 time: 0.741405 Oct 27 09:22:19.594433 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2165/4387] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:18 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1723 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:19.630712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7024caea-b2e1-4f0d-930b-ba9369b686c5 req-d695022f-2f77-480d-954d-b999b71c9f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5633b711-da7a-440c-8a7e-e88b38c51f17", "tag": "317c79ff-f5cf-45ff-ac91-1f2159115cb7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:19.656234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7024caea-b2e1-4f0d-930b-ba9369b686c5 req-d695022f-2f77-480d-954d-b999b71c9f17 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:19.659132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7024caea-b2e1-4f0d-930b-ba9369b686c5 req-d695022f-2f77-480d-954d-b999b71c9f17 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:19.659752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7024caea-b2e1-4f0d-930b-ba9369b686c5 req-d695022f-2f77-480d-954d-b999b71c9f17 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:19.710751 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7024caea-b2e1-4f0d-930b-ba9369b686c5 req-d695022f-2f77-480d-954d-b999b71c9f17 service nova] Creating event network-changed:317c79ff-f5cf-45ff-ac91-1f2159115cb7 for instance 5633b711-da7a-440c-8a7e-e88b38c51f17 on n-h1-858383-16 Oct 27 09:22:19.727193 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7024caea-b2e1-4f0d-930b-ba9369b686c5 req-d695022f-2f77-480d-954d-b999b71c9f17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116798 Oct 27 09:22:19.731535 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2166/4388] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:19.746262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:19.747557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:19.763843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:19.766031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:19.766834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:19.769159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:19.771356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:19.773852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:20.346027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:20.366343 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a2b0c88-3da2-44e3-a039-8228adc685e7 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1315 microversion: 2.1 time: 0.630511 Oct 27 09:22:20.369053 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2167/4389] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:19 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:20.394909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-38e102e1-b30d-4a2f-b37d-53f1ca175613 req-e1717641-6a46-4e75-b33b-8779d13653e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "name": "network-vif-plugged", "status": "completed", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:20.434789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-38e102e1-b30d-4a2f-b37d-53f1ca175613 req-e1717641-6a46-4e75-b33b-8779d13653e0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:20.435326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-38e102e1-b30d-4a2f-b37d-53f1ca175613 req-e1717641-6a46-4e75-b33b-8779d13653e0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:20.443763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-38e102e1-b30d-4a2f-b37d-53f1ca175613 req-e1717641-6a46-4e75-b33b-8779d13653e0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:20.492618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-38e102e1-b30d-4a2f-b37d-53f1ca175613 req-e1717641-6a46-4e75-b33b-8779d13653e0 service nova] Creating event network-vif-plugged:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:22:20.522609 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-38e102e1-b30d-4a2f-b37d-53f1ca175613 req-e1717641-6a46-4e75-b33b-8779d13653e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151718 Oct 27 09:22:20.524799 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2168/4390] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:20.622471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:20.623631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:20.637809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:20.638855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:20.640602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:20.644761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:20.645557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:20.649228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:21.276899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:21.294232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77b9a126-c7be-4b83-9b3b-03a7096a05c5 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1729 microversion: 2.1 time: 0.672020 Oct 27 09:22:21.294920 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2169/4391] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:20 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1729 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:21.318275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1efa7868-6f0c-4557-965a-18f49b63a6d1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:21.318779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1efa7868-6f0c-4557-965a-18f49b63a6d1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:21.339897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1efa7868-6f0c-4557-965a-18f49b63a6d1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:21.340223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1efa7868-6f0c-4557-965a-18f49b63a6d1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:21.340683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1efa7868-6f0c-4557-965a-18f49b63a6d1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:21.341435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1efa7868-6f0c-4557-965a-18f49b63a6d1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:21.341905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1efa7868-6f0c-4557-965a-18f49b63a6d1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:21.342342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1efa7868-6f0c-4557-965a-18f49b63a6d1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:22.501799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Updating instance_info_cache with network_info: [{"id": "317c79ff-f5cf-45ff-ac91-1f2159115cb7", "address": "fa:16:3e:60:fc:ca", "network": {"id": "a6cfd113-0f98-4e57-b7a4-b86be21d6bde", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-845890511-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e5b63428955b4c559e8ef364dffe0468", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap317c79ff-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120602) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:22:22.523655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Releasing lock "refresh_cache-5633b711-da7a-440c-8a7e-e88b38c51f17" {{(pid=120602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:22:22.524544 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bdc524fe-078a-4637-a212-06faae98d921 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action" status: 202 len: 0 microversion: 2.1 time: 6.703561 Oct 27 09:22:22.525164 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2223/4392] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:22:15 2022] POST /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17/action => generated 0 bytes in 6705 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 27 09:22:22.540473 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1efa7868-6f0c-4557-965a-18f49b63a6d1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.226732 Oct 27 09:22:22.541847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:22.542345 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2170/4393] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:22:21 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-interface => generated 285 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:22:22.542476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:22.555348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d43d418b-7f85-4c1a-8277-f7a85351db04 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '.version_select at 0x7f31a91e30d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:22.578501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:22.579397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:22.580105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:22.581173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:22.584283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:22.585092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:23.537517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:23.554421 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7382f6bf-8494-4bb6-be14-f6b64bf49c3a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1315 microversion: 2.1 time: 1.025112 Oct 27 09:22:23.555115 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2224/4394] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:22 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1315 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:23.578053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:23.578641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:23.600816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:23.601325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:23.601938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:23.619818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:23.620400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:23.620860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:23.753797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:22:23.955537 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1df686e-af2b-478d-a22b-63acc32d5d1e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 204 len: 0 microversion: 2.1 time: 0.398867 Oct 27 09:22:23.965421 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2225/4395] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:22:23 2022] DELETE /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:22:23.971014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6dbe1513-45db-42af-9ccf-ad5c2577d5d1 req-5f3230b7-64de-4234-8c9a-7c660fa0314d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4e9885-d7af-4bea-be6f-bc3195d71fca", "tag": "2f5a9bc2-a844-477b-9146-0ff99bef10a8"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:23.983182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6dbe1513-45db-42af-9ccf-ad5c2577d5d1 req-5f3230b7-64de-4234-8c9a-7c660fa0314d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:23.984600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6dbe1513-45db-42af-9ccf-ad5c2577d5d1 req-5f3230b7-64de-4234-8c9a-7c660fa0314d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:23.985632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6dbe1513-45db-42af-9ccf-ad5c2577d5d1 req-5f3230b7-64de-4234-8c9a-7c660fa0314d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:24.001400 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6dbe1513-45db-42af-9ccf-ad5c2577d5d1 req-5f3230b7-64de-4234-8c9a-7c660fa0314d service nova] Creating event network-changed:2f5a9bc2-a844-477b-9146-0ff99bef10a8 for instance fa4e9885-d7af-4bea-be6f-bc3195d71fca on n-h1-858383-16 Oct 27 09:22:24.007388 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6dbe1513-45db-42af-9ccf-ad5c2577d5d1 req-5f3230b7-64de-4234-8c9a-7c660fa0314d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040440 Oct 27 09:22:24.008666 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2226/4396] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:24.016612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-db550a55-8682-410b-9a8a-58cc5fde6126 req-49134806-6e39-43c6-9603-4dfe810c06d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cf1e6a-e4ad-446e-87f3-86469294ed83", "name": "network-vif-plugged", "status": "completed", "tag": "0ae575a9-44ec-4e0e-81de-8a8d84e5a728"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:24.035171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-db550a55-8682-410b-9a8a-58cc5fde6126 req-49134806-6e39-43c6-9603-4dfe810c06d2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:24.035980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-db550a55-8682-410b-9a8a-58cc5fde6126 req-49134806-6e39-43c6-9603-4dfe810c06d2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:24.037250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-db550a55-8682-410b-9a8a-58cc5fde6126 req-49134806-6e39-43c6-9603-4dfe810c06d2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:24.056325 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-db550a55-8682-410b-9a8a-58cc5fde6126 req-49134806-6e39-43c6-9603-4dfe810c06d2 service nova] Creating event network-vif-plugged:0ae575a9-44ec-4e0e-81de-8a8d84e5a728 for instance 84cf1e6a-e4ad-446e-87f3-86469294ed83 on n-h2-858383-16 Oct 27 09:22:24.063103 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-db550a55-8682-410b-9a8a-58cc5fde6126 req-49134806-6e39-43c6-9603-4dfe810c06d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052444 Oct 27 09:22:24.064432 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2227/4397] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:24.070628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:24.071644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:24.080065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:24.080797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:24.081415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:24.082304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:24.082917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:24.083493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:25.746545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:25.759848 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e52a01c7-cb24-4b2f-8cee-cee93ec75023 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1670 microversion: 2.1 time: 1.693862 Oct 27 09:22:25.760445 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2228/4398] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:24 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1670 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:25.765179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:25.765813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:25.785665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:25.786173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:25.786622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:25.787347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:25.787832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:25.788256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:27.631790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:27.653706 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49f478b6-eb86-4864-aea2-b796ca6743db tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1315 microversion: 2.1 time: 1.887522 Oct 27 09:22:27.658111 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2229/4399] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:25 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1315 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:27.682221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:27.683286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:27.708703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:27.710868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:27.713297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:27.715042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:27.715910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:27.717902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:27.801028 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d43d418b-7f85-4c1a-8277-f7a85351db04 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/ecf0dee2-cc7b-4e57-98c8-3396f967278d" status: 202 len: 0 microversion: 2.1 time: 5.257101 Oct 27 09:22:27.801632 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2171/4400] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:22:22 2022] DELETE /compute/v2.1/os-floating-ips/ecf0dee2-cc7b-4e57-98c8-3396f967278d => generated 0 bytes in 5258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:22:27.813608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4bb30586-9097-4cf9-b826-b1fbc529f954 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '.version_select at 0x7f31a8e49670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:28.010464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:28.046631 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-10afb0e6-02c3-4f05-82ff-be92448b85b5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1602 microversion: 2.1 time: 0.382050 Oct 27 09:22:28.048163 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2230/4401] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:27 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1602 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:28.120129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-44ec3bef-23d9-434b-ac99-8aa98f3e6c56 req-f0677c48-4279-4873-812f-e045e371eb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4e9885-d7af-4bea-be6f-bc3195d71fca", "name": "network-vif-deleted", "tag": "2f5a9bc2-a844-477b-9146-0ff99bef10a8"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:28.187491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-44ec3bef-23d9-434b-ac99-8aa98f3e6c56 req-f0677c48-4279-4873-812f-e045e371eb12 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:28.193399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-44ec3bef-23d9-434b-ac99-8aa98f3e6c56 req-f0677c48-4279-4873-812f-e045e371eb12 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:28.193951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-44ec3bef-23d9-434b-ac99-8aa98f3e6c56 req-f0677c48-4279-4873-812f-e045e371eb12 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:28.266966 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-44ec3bef-23d9-434b-ac99-8aa98f3e6c56 req-f0677c48-4279-4873-812f-e045e371eb12 service nova] Creating event network-vif-deleted:2f5a9bc2-a844-477b-9146-0ff99bef10a8 for instance fa4e9885-d7af-4bea-be6f-bc3195d71fca on n-h1-858383-16 Oct 27 09:22:28.292656 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-44ec3bef-23d9-434b-ac99-8aa98f3e6c56 req-f0677c48-4279-4873-812f-e045e371eb12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173124 Oct 27 09:22:28.293239 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2231/4402] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:28.688610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:28.689310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:28.711704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:28.712147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:28.712593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:28.713306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:28.713764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:28.719434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:28.975523 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4bb30586-9097-4cf9-b826-b1fbc529f954 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/91d8c5f5-13fc-4d3a-9c47-5aebb458a73f" status: 202 len: 0 microversion: 2.1 time: 1.166541 Oct 27 09:22:28.980695 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2172/4403] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 09:22:27 2022] DELETE /compute/v2.1/os-security-groups/91d8c5f5-13fc-4d3a-9c47-5aebb458a73f => generated 0 bytes in 1173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:22:28.989062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:28.989990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:29.006865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:29.009123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.009953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.010665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.011735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.012965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.013906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.059638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:22:29.224477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:29.235681 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ddd08bac-adb4-422d-be07-2ca8f0d3203a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1503 microversion: 2.1 time: 0.554348 Oct 27 09:22:29.243643 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2232/4404] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:28 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1503 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:29.263379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:29.264185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:29.279108 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0564e8af-a7c1-4062-985c-be83e793c747 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 204 len: 0 microversion: 2.1 time: 0.293707 Oct 27 09:22:29.284161 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2173/4405] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:22:28 2022] DELETE /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:22:29.288070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.288637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.289120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.293823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.297851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.298548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.302483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0b89ccf-ceef-4fcd-9d2f-171fcf0be3b1 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:29.305182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0b89ccf-ceef-4fcd-9d2f-171fcf0be3b1 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:29.324198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b89ccf-ceef-4fcd-9d2f-171fcf0be3b1 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.324832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b89ccf-ceef-4fcd-9d2f-171fcf0be3b1 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.326345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b89ccf-ceef-4fcd-9d2f-171fcf0be3b1 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.330055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b89ccf-ceef-4fcd-9d2f-171fcf0be3b1 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.334013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b89ccf-ceef-4fcd-9d2f-171fcf0be3b1 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.335659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0b89ccf-ceef-4fcd-9d2f-171fcf0be3b1 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.414398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.415136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.415790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.416671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lazy-loading 'fault' on Instance uuid fa4e9885-d7af-4bea-be6f-bc3195d71fca {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:22:29.422344 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0b89ccf-ceef-4fcd-9d2f-171fcf0be3b1 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83/ips" status: 200 len: 108 microversion: 2.1 time: 0.134940 Oct 27 09:22:29.427289 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2174/4406] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:22:29 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83/ips => generated 108 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:29.446112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:29.449858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:29.474045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.474571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.474996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.475874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.476186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.476616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.547535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:29.558677 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d12fca9c-e7bf-402c-82ec-2763976a8313 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 200 len: 1489 microversion: 2.1 time: 0.308025 Oct 27 09:22:29.563053 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2233/4407] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:29 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 1489 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:29.568301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c111c360-2c68-4f18-aaeb-fd01da7164ca tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:29.573378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c111c360-2c68-4f18-aaeb-fd01da7164ca tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:29.582066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c111c360-2c68-4f18-aaeb-fd01da7164ca tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.589719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c111c360-2c68-4f18-aaeb-fd01da7164ca tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.590469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c111c360-2c68-4f18-aaeb-fd01da7164ca tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.591400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c111c360-2c68-4f18-aaeb-fd01da7164ca tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.592300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c111c360-2c68-4f18-aaeb-fd01da7164ca tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.593058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c111c360-2c68-4f18-aaeb-fd01da7164ca tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.642277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:29.660556 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c111c360-2c68-4f18-aaeb-fd01da7164ca tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83/ips" status: 200 len: 108 microversion: 2.1 time: 0.095829 Oct 27 09:22:29.666950 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2234/4408] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:22:29 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83/ips => generated 108 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:29.675378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:29.676346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:29.693859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.694563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.694785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.695496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.696013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.696437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.717561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:29.731792 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13c86cf6-5f60-4339-9d25-d2281f4a2e1d tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1509 microversion: 2.1 time: 0.303114 Oct 27 09:22:29.732606 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2175/4409] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:29 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:29.753340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-075dd8e2-d391-4f17-a516-766a6baa4219 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:29.754874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-075dd8e2-d391-4f17-a516-766a6baa4219 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:29.770811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075dd8e2-d391-4f17-a516-766a6baa4219 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.771686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075dd8e2-d391-4f17-a516-766a6baa4219 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.772322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075dd8e2-d391-4f17-a516-766a6baa4219 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.773288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075dd8e2-d391-4f17-a516-766a6baa4219 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.773623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:22:29.774198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075dd8e2-d391-4f17-a516-766a6baa4219 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.774998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-075dd8e2-d391-4f17-a516-766a6baa4219 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.805642 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-075dd8e2-d391-4f17-a516-766a6baa4219 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83/ips/tempest-ServerAddressesTestJSON-789196351-network" status: 200 len: 93 microversion: 2.1 time: 0.071373 Oct 27 09:22:29.806931 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2176/4410] 10.222.0.25 () {58 vars in 1398 bytes} [Thu Oct 27 09:22:29 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83/ips/tempest-ServerAddressesTestJSON-789196351-network => generated 93 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:22:29.824394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:29.825289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:29.842145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.843137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.843801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.844685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:29.845444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:29.846045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:29.886460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:22:29.986857 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4704dff2-64c6-40e4-b16f-479453540112 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 204 len: 0 microversion: 2.1 time: 0.318038 Oct 27 09:22:29.990534 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2235/4411] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:22:29 2022] DELETE /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:22:29.996818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:29.997526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:30.004563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:30.005335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:30.006009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:30.006891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:30.007495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:30.008088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:30.060313 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5fdc8bc6-9213-4ac8-b082-88cd39fb3db2 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 204 len: 0 microversion: 2.1 time: 0.244293 Oct 27 09:22:30.061421 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2177/4412] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:22:29 2022] DELETE /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:22:30.070564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:30.072354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:30.098883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:30.099418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:30.101538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:30.101760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:30.107003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:30.107496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:30.434505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:30.451156 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-822c3378-e361-433c-b6b6-22ffb85ae527 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1555 microversion: 2.1 time: 0.458848 Oct 27 09:22:30.460488 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2236/4413] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:29 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1555 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:30.472242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e678ae6b-2301-491c-af5c-bf5c9a6e94ad req-17ddacb6-4fd7-4517-8b32-1be328808ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e", "tag": "b6c0099e-113e-4920-b290-fd730dcf9be5"}, {"name": "network-changed", "server_uuid": "9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e", "tag": "b6c0099e-113e-4920-b290-fd730dcf9be5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:30.514992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e678ae6b-2301-491c-af5c-bf5c9a6e94ad req-17ddacb6-4fd7-4517-8b32-1be328808ff2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:30.515505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e678ae6b-2301-491c-af5c-bf5c9a6e94ad req-17ddacb6-4fd7-4517-8b32-1be328808ff2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:30.523626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e678ae6b-2301-491c-af5c-bf5c9a6e94ad req-17ddacb6-4fd7-4517-8b32-1be328808ff2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:30.556632 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e678ae6b-2301-491c-af5c-bf5c9a6e94ad req-17ddacb6-4fd7-4517-8b32-1be328808ff2 service nova] Creating event network-changed:b6c0099e-113e-4920-b290-fd730dcf9be5 for instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e on n-h1-858383-16 Oct 27 09:22:30.560480 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e678ae6b-2301-491c-af5c-bf5c9a6e94ad req-17ddacb6-4fd7-4517-8b32-1be328808ff2 service nova] Creating event network-changed:b6c0099e-113e-4920-b290-fd730dcf9be5 for instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e on n-h1-858383-16 Oct 27 09:22:30.571539 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e678ae6b-2301-491c-af5c-bf5c9a6e94ad req-17ddacb6-4fd7-4517-8b32-1be328808ff2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109659 Oct 27 09:22:30.573997 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2237/4414] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:30.590163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:30.591196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: fa4e9885-d7af-4bea-be6f-bc3195d71fca] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:30.606111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:30.617460 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c237cfc8-4cd5-4642-b576-a5ae9c98d184 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1509 microversion: 2.1 time: 0.551444 Oct 27 09:22:30.619521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:30.620851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:30.621476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:30.623265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:30.623779 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2178/4415] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:30 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1509 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:22:30.624997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:30.625605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:30.673671 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] HTTP exception thrown: Instance fa4e9885-d7af-4bea-be6f-bc3195d71fca could not be found. Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Request method failure captured: Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca HTTP/1.1 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkzHqeKdIEpMSXWOZdUtXXt_9NFMVS_ISr4dTPLT49pEghhN81i_huWqp51hTg5fqwtXMM0GKiiJPkIcBaWHbK4Jw4on218eNQQpCU-pF88LRyaXgJtNRTxnBgaX_g-I9LAlrYb0DHMYF7K16fJuMHAv_lipNTZkQg1ly31j27RJ9j0 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: f0630c5386744d07a21ac826f4d0d2b3 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestNetworkBasicOps-1842739308 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0630c5386744d07a21ac826f4d0d2b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0630c5386744d07a21ac826f4d0d2b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0630c5386744d07a21ac826f4d0d2b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0630c5386744d07a21ac826f4d0d2b3"}]}] Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestNetworkBasicOps-1842739308 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: f0630c5386744d07a21ac826f4d0d2b3 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestNetworkBasicOps-1842739308 Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestNetworkBasicOps-1842739308-project Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 203ed8cc61274041ae7a9bb1ac09fd1a Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestNetworkBasicOps-1842739308-project Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance fa4e9885-d7af-4bea-be6f-bc3195d71fca could not be found. Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'fa4e9885-d7af-4bea-be6f-bc3195d71fca'} Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4e9885-d7af-4bea-be6f-bc3195d71fca could not be found. Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4e9885-d7af-4bea-be6f-bc3195d71fca could not be found. Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:30.680054 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:30.684707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:30.684707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:30.684707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:30.684707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:22:30.684707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:22:30.684707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4e9885-d7af-4bea-be6f-bc3195d71fca could not be found. Oct 27 09:22:30.684707 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:30.689728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Returning 404 to user: Instance fa4e9885-d7af-4bea-be6f-bc3195d71fca could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:22:30.691075 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-314be7e3-3652-478c-b014-32109b3c56bf tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca" status: 404 len: 111 microversion: 2.1 time: 0.105649 Oct 27 09:22:30.692272 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2238/4416] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:30 2022] GET /compute/v2.1/servers/fa4e9885-d7af-4bea-be6f-bc3195d71fca => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:22:30.760584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:30.761537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:30.772745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:30.773608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:30.776282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:30.779988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:30.787961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:30.789062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:31.095291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9bd316f-0183-4917-8329-29b97a132a4d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '.version_select at 0x7f31ae694f70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:31.153655 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9bd316f-0183-4917-8329-29b97a132a4d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-658964101" status: 202 len: 0 microversion: 2.1 time: 0.062661 Oct 27 09:22:31.156186 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2239/4417] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Oct 27 09:22:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-658964101 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:22:31.483655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:31.484544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:31.501108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:31.502988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:31.503765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:31.508202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:31.509064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:31.510510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:32.100406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:32.114374 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-765000ab-660d-4286-aa49-9aeaf71181b7 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1509 microversion: 2.1 time: 1.357940 Oct 27 09:22:32.115106 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2179/4418] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:30 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1509 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:32.126049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:32.128085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:32.148804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:32.153312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:32.153960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:32.163679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:32.166756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:32.167559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:33.312903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:33.324822 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9bf3d267-ba34-429a-909d-9b35653dafa7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1555 microversion: 2.1 time: 1.845940 Oct 27 09:22:33.327621 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2240/4419] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:31 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1555 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:22:33.345668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:33.353297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:33.355457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:33.363791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:33.364528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:33.370305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:33.371252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:33.371921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:33.372518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:33.648623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:33.658545 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c219257-6431-4bd3-939d-79f3fea0172a tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1509 microversion: 2.1 time: 1.536275 Oct 27 09:22:33.659361 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2180/4420] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:32 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1509 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:34.239258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:34.252718 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c06bcd7-d964-4117-9e87-f0d05760ab84 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1509 microversion: 2.1 time: 0.923748 Oct 27 09:22:34.255642 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2241/4421] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:33 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1509 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:34.355517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:34.356012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:34.373563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:34.374084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:34.374538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:34.375286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:34.375990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:34.376609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:34.551492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:34.569677 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1415e5a2-877c-4a3c-a871-c0b256d0e949 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1513 microversion: 2.1 time: 0.218519 Oct 27 09:22:34.570550 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2181/4422] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:34 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:34.686088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:34.686716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:34.705160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:34.706070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:34.706684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:34.707582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:34.708200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:34.715266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:34.748112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-55d8f3f3-7adc-4976-bcfd-3796e515c0e7 req-44cb6f87-b181-4f9e-8841-4f01e865cd3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b636e1b0-c610-4b0c-a3b2-8ff5992647c6", "name": "network-vif-deleted", "tag": "2006621a-da0a-4f2d-a465-79304511fd28"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:34.775071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-55d8f3f3-7adc-4976-bcfd-3796e515c0e7 req-44cb6f87-b181-4f9e-8841-4f01e865cd3e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:34.775880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-55d8f3f3-7adc-4976-bcfd-3796e515c0e7 req-44cb6f87-b181-4f9e-8841-4f01e865cd3e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:34.778679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-55d8f3f3-7adc-4976-bcfd-3796e515c0e7 req-44cb6f87-b181-4f9e-8841-4f01e865cd3e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:34.813782 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-55d8f3f3-7adc-4976-bcfd-3796e515c0e7 req-44cb6f87-b181-4f9e-8841-4f01e865cd3e service nova] Creating event network-vif-deleted:2006621a-da0a-4f2d-a465-79304511fd28 for instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 on n-h2-858383-16 Oct 27 09:22:34.827474 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-55d8f3f3-7adc-4976-bcfd-3796e515c0e7 req-44cb6f87-b181-4f9e-8841-4f01e865cd3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082340 Oct 27 09:22:34.830332 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2182/4423] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:22:35.279389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:35.280516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:35.291070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:35.294159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:35.296384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:35.297329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:35.297957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:35.304356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:35.433859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:35.448495 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e164e06c-50ac-4832-a7a0-27fd2c32ea78 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1509 microversion: 2.1 time: 0.766533 Oct 27 09:22:35.449287 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2242/4424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:34 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1509 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:35.504344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:35.512938 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5bbca88-b0fc-45d9-bf90-c58b0a7e5550 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1467 microversion: 2.1 time: 0.238219 Oct 27 09:22:35.519692 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2183/4425] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:35 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1467 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:35.597471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:35.598368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:35.610812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:35.611634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:35.612253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:35.613133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:35.618567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:35.619219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:36.176635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3913475a-4333-431b-bb3b-5f63279ed425 req-91c66602-0a85-4afb-916f-280ccc0e9dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5633b711-da7a-440c-8a7e-e88b38c51f17", "name": "network-vif-deleted", "tag": "317c79ff-f5cf-45ff-ac91-1f2159115cb7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:36.200128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3913475a-4333-431b-bb3b-5f63279ed425 req-91c66602-0a85-4afb-916f-280ccc0e9dae service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:36.200889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3913475a-4333-431b-bb3b-5f63279ed425 req-91c66602-0a85-4afb-916f-280ccc0e9dae service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:36.201512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3913475a-4333-431b-bb3b-5f63279ed425 req-91c66602-0a85-4afb-916f-280ccc0e9dae service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:36.225765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:36.238078 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3913475a-4333-431b-bb3b-5f63279ed425 req-91c66602-0a85-4afb-916f-280ccc0e9dae service nova] Creating event network-vif-deleted:317c79ff-f5cf-45ff-ac91-1f2159115cb7 for instance 5633b711-da7a-440c-8a7e-e88b38c51f17 on n-h1-858383-16 Oct 27 09:22:36.250086 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3913475a-4333-431b-bb3b-5f63279ed425 req-91c66602-0a85-4afb-916f-280ccc0e9dae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077494 Oct 27 09:22:36.251263 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2184/4426] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:22:36.390304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:36.412825 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c8d7b6f-242e-4f10-bc39-47762cfdaf98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1346 microversion: 2.1 time: 0.820059 Oct 27 09:22:36.416795 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2243/4427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:35 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1346 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:36.490147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:36.491900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:36.528079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:36.528602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:36.529036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:36.529889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:36.530366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:36.530803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:36.553813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:36.554476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:36.573711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:36.574373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:36.574841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:36.575612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:36.576086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:36.576578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:36.727694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:36.728497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:36.730196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:36.734299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lazy-loading 'fault' on Instance uuid 5633b711-da7a-440c-8a7e-e88b38c51f17 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:22:36.804237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:36.813112 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-513ad0fc-aaa4-486f-922f-a223c6e7a622 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1467 microversion: 2.1 time: 0.339473 Oct 27 09:22:36.813716 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2185/4428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:36 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1467 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:37.034439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797473ddfd5b416a91ef60b8c8da778a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b63428955b4c559e8ef364dffe0468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:37.053857 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-30d62cde-156a-416e-b966-b434eb95b11a tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 200 len: 1313 microversion: 2.1 time: 0.502666 Oct 27 09:22:37.077437 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2244/4429] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:36 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:22:37.441402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:37.443788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:37.455897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:37.456873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:37.457499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:37.458428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:37.459094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:37.459831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:37.700034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:37.719132 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e80d8074-4925-47ec-b71b-a860efafce1e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1346 microversion: 2.1 time: 0.279365 Oct 27 09:22:37.723999 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2186/4430] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:37 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1346 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:37.840389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:37.840389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:37.860795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:37.861744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:37.865298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:37.868778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:37.869854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:37.870544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:38.046191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:38.050253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:38.050957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:38.054622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lazy-loading 'fault' on Instance uuid 84cf1e6a-e4ad-446e-87f3-86469294ed83 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:22:38.087904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:38.089774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] [instance: 5633b711-da7a-440c-8a7e-e88b38c51f17] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:38.105871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:38.111657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:38.112935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:38.117619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:38.118464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:38.119960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:38.162908 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] HTTP exception thrown: Instance 5633b711-da7a-440c-8a7e-e88b38c51f17 could not be found. Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Request method failure captured: Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 HTTP/1.1 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk1njVjhOP0d7hFcAntvzn2XK4g8kkRIenh8E9-RYNCK_F0maes45R6lfJYeDs6zA-OH7TeYDufycVm7YfBkUxfRUa0oW_aYD81a4HIlsEdL1m5aXUCWWkKWT1y9d7FvpUvGkjyTWs8zbgHbCA2CYytHtZ-D8aywuYRURofrcVatrz4 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: e5b63428955b4c559e8ef364dffe0468 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-327843050 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5b63428955b4c559e8ef364dffe0468"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5b63428955b4c559e8ef364dffe0468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5b63428955b4c559e8ef364dffe0468"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5b63428955b4c559e8ef364dffe0468"}]}] Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-327843050 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: e5b63428955b4c559e8ef364dffe0468 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-327843050 Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerRescueTestJSONUnderV235-327843050-project Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 797473ddfd5b416a91ef60b8c8da778a Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-327843050-project Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 5633b711-da7a-440c-8a7e-e88b38c51f17 could not be found. Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '5633b711-da7a-440c-8a7e-e88b38c51f17'} Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5633b711-da7a-440c-8a7e-e88b38c51f17 could not be found. Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5633b711-da7a-440c-8a7e-e88b38c51f17 could not be found. Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:38.170594 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:38.175362 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:38.175362 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:38.175362 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:38.175362 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:38.175362 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:22:38.175362 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:22:38.175362 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5633b711-da7a-440c-8a7e-e88b38c51f17 could not be found. Oct 27 09:22:38.175362 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:38.179709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127a3c646e1145c8be4a10d1608c1277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6eea8863b94452be5efddaa8a3320f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:38.181875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] Returning 404 to user: Instance 5633b711-da7a-440c-8a7e-e88b38c51f17 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:22:38.187686 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80ad8219-9da9-4e0b-9a03-2593562d4246 tempest-ServerRescueTestJSONUnderV235-327843050 tempest-ServerRescueTestJSONUnderV235-327843050-project] 10.222.0.25 "GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17" status: 404 len: 111 microversion: 2.1 time: 0.103453 Oct 27 09:22:38.198106 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2187/4431] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:38 2022] GET /compute/v2.1/servers/5633b711-da7a-440c-8a7e-e88b38c51f17 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:22:38.207453 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f4e47717-18a9-44e1-97bf-db96b9d21757 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 200 len: 1305 microversion: 2.1 time: 0.374435 Oct 27 09:22:38.208147 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2245/4432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:37 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 1305 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:38.390497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9f53af8a-4fd1-48b6-bba2-37f126e5af71 req-c572d6f6-5c27-4dba-95b3-3adfe9932033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cf1e6a-e4ad-446e-87f3-86469294ed83", "name": "network-vif-deleted", "tag": "0ae575a9-44ec-4e0e-81de-8a8d84e5a728"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:38.419238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9f53af8a-4fd1-48b6-bba2-37f126e5af71 req-c572d6f6-5c27-4dba-95b3-3adfe9932033 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:38.424407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9f53af8a-4fd1-48b6-bba2-37f126e5af71 req-c572d6f6-5c27-4dba-95b3-3adfe9932033 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:38.429560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9f53af8a-4fd1-48b6-bba2-37f126e5af71 req-c572d6f6-5c27-4dba-95b3-3adfe9932033 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:38.480644 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9f53af8a-4fd1-48b6-bba2-37f126e5af71 req-c572d6f6-5c27-4dba-95b3-3adfe9932033 service nova] Creating event network-vif-deleted:0ae575a9-44ec-4e0e-81de-8a8d84e5a728 for instance 84cf1e6a-e4ad-446e-87f3-86469294ed83 on n-h2-858383-16 Oct 27 09:22:38.492186 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9f53af8a-4fd1-48b6-bba2-37f126e5af71 req-c572d6f6-5c27-4dba-95b3-3adfe9932033 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108544 Oct 27 09:22:38.493188 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2188/4433] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:38.752592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:38.753600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:38.781494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:38.786581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:38.787295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:38.790458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:38.793576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:38.794495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:38.989394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:39.006767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-387302c7-8dc0-4e54-ad32-ff7c92f9c5cb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1346 microversion: 2.1 time: 0.262237 Oct 27 09:22:39.007938 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2246/4434] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:38 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1346 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:39.239464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:39.240564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] [instance: 84cf1e6a-e4ad-446e-87f3-86469294ed83] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:39.264255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:39.265743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:39.266459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:39.269444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:39.273536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:39.274484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:39.333089 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] HTTP exception thrown: Instance 84cf1e6a-e4ad-446e-87f3-86469294ed83 could not be found. Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Request method failure captured: Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 HTTP/1.1 Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk20UzuPoMAOxuDnhmRpAhp38YSnxY07_AOGLZ6FJMPxDxqOUFRBLl_2U8ly0fWpAA9SH_782vbvWJQ1s8NqepnFmCc-y_avRQ-3YdwougDKvTG9606OqwW-dr704LSJ_-p4fiY5NCmIAry3B4UQsJs-whZf5u2jiXGHMebWNv5h8ek Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 9e6eea8863b94452be5efddaa8a3320f Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerAddressesTestJSON-275997201 Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6eea8863b94452be5efddaa8a3320f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e6eea8863b94452be5efddaa8a3320f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e6eea8863b94452be5efddaa8a3320f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e6eea8863b94452be5efddaa8a3320f"}]}] Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerAddressesTestJSON-275997201 Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 9e6eea8863b94452be5efddaa8a3320f Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerAddressesTestJSON-275997201 Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerAddressesTestJSON-275997201-project Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 127a3c646e1145c8be4a10d1608c1277 Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerAddressesTestJSON-275997201-project Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 84cf1e6a-e4ad-446e-87f3-86469294ed83 could not be found. Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '84cf1e6a-e4ad-446e-87f3-86469294ed83'} Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84cf1e6a-e4ad-446e-87f3-86469294ed83 could not be found. Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cf1e6a-e4ad-446e-87f3-86469294ed83 could not be found. Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:39.336383 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:39.342802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:39.342802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:39.342802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:39.342802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:22:39.342802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:22:39.342802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cf1e6a-e4ad-446e-87f3-86469294ed83 could not be found. Oct 27 09:22:39.342802 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:39.344954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] Returning 404 to user: Instance 84cf1e6a-e4ad-446e-87f3-86469294ed83 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:22:39.346078 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff2ed823-4ca2-4144-aee5-1adf2e639164 tempest-ServerAddressesTestJSON-275997201 tempest-ServerAddressesTestJSON-275997201-project] 10.222.0.25 "GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83" status: 404 len: 111 microversion: 2.1 time: 0.111921 Oct 27 09:22:39.348171 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2189/4435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:39 2022] GET /compute/v2.1/servers/84cf1e6a-e4ad-446e-87f3-86469294ed83 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:22:40.034775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:40.036280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:40.052857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:40.058681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:40.060170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:40.063968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:40.064861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:40.066239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:40.197822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:40.215251 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-02142129-fea4-4708-80d5-16a8da5caf4c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1346 microversion: 2.1 time: 0.186752 Oct 27 09:22:40.216561 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2247/4436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:40 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1346 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:41.245914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:41.247273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:41.261828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:41.265463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:41.266236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:41.268750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:41.270213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:41.270865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:42.676805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:42.691819 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b0a2b5d-041b-4487-af71-fc489d279a27 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1346 microversion: 2.1 time: 1.452156 Oct 27 09:22:42.700346 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2190/4437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:41 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1346 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:43.730880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:43.731478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:43.747542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:43.748067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:43.749057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:43.749779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:43.761884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:43.764752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:43.983685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:43.992354 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3c79456-c2df-4f1f-8b2b-3e146bc05fb7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1346 microversion: 2.1 time: 0.265863 Oct 27 09:22:43.999736 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2248/4438] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:43 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1346 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:45.020839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:45.021397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:45.042321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:45.045118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:45.045850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:45.049410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:45.052385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:45.057171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:45.236138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:45.254939 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-603787d4-9b9f-4c20-9434-8beaf33a9fae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 200 len: 1346 microversion: 2.1 time: 0.236390 Oct 27 09:22:45.257648 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2191/4439] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:45 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 1346 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:46.283305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:46.284749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:46.309132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:46.310448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:46.330661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:46.343909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:46.364781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:46.365246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:46.451018 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 HTTP/1.1 Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b636e1b0-c610-4b0c-a3b2-8ff5992647c6'} Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:46.457379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.463211 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:46.463211 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:46.463211 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:46.463211 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:22:46.463211 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:22:46.463211 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.463211 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.468227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:22:46.472830 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9b3fb4c9-1b57-4132-ac0a-ce66489ff86d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 404 len: 111 microversion: 2.1 time: 0.192769 Oct 27 09:22:46.479767 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2249/4440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:46 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:22:46.695439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:46.698559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:46.719901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:46.720533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:46.720997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:46.721749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:46.722211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:46.732668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:46.797577 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6/os-volume_attachments HTTP/1.1 Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': 'b636e1b0-c610-4b0c-a3b2-8ff5992647c6'} Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:22:46.799314 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:22:46.806435 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:22:46.809711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:22:46.811678 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ffc3ebb6-efef-483b-adb8-f52e58c515dc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.121983 Oct 27 09:22:46.816673 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2192/4441] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:22:46 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6/os-volume_attachments => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:22:47.250411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1042221582", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "3527ca6b-4f14-40c0-86a3-873f2fef222c"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:50.494809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:50.495775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:50.503303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:50.516012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:50.516797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:50.517805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:50.527505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:50.528405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:50.560942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] validate_networks() for [('3527ca6b-4f14-40c0-86a3-873f2fef222c', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:22:51.338198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:51.360938 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0afaf9c6-d3b5-499d-bcb3-fbb16c3c3cf4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.869127 Oct 27 09:22:51.375688 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2193/4442] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:50 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:51.935136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:22:51.935749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:22:51.936276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:22:51.936999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:22:51.938171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:22:51.954334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:51.954995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:51.955535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:51.956399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:51.956948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:51.957457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:51.986225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:22:51.994047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for user 0a9243ea430b4d2ba18c2a1e54e7c6aa and project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:22:52.011402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:22:52.015166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b4a56315-a394-4a58-b151-8f24e650455a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:22:52.077581 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e8d63e1-b32d-43c3-82e4-364d88cf33ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.836650 Oct 27 09:22:52.078761 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2250/4443] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:22:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:22:52.090716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42a83a80-3261-48cd-975f-4b8206d8959a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:52.092094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42a83a80-3261-48cd-975f-4b8206d8959a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b4a56315-a394-4a58-b151-8f24e650455a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:52.222297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-42a83a80-3261-48cd-975f-4b8206d8959a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:52.247387 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42a83a80-3261-48cd-975f-4b8206d8959a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a" status: 200 len: 1215 microversion: 2.1 time: 0.151413 Oct 27 09:22:52.247387 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2194/4444] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:52 2022] GET /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:52.284998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e0e2dc42-d62f-473b-ad34-1e7e80ba94f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:52.285504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e0e2dc42-d62f-473b-ad34-1e7e80ba94f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b4a56315-a394-4a58-b151-8f24e650455a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:52.343063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e0e2dc42-d62f-473b-ad34-1e7e80ba94f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b4a56315-a394-4a58-b151-8f24e650455a] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:22:52.388294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:52.389072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:52.413971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:52.414514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:52.414972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:52.415783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:52.416249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:52.416688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:52.796468 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e0e2dc42-d62f-473b-ad34-1e7e80ba94f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a" status: 204 len: 0 microversion: 2.1 time: 0.512221 Oct 27 09:22:52.797145 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2251/4445] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:22:52 2022] DELETE /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:22:52.816516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-871439dc-b072-4841-b88f-2a205d988f6f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:52.817147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-871439dc-b072-4841-b88f-2a205d988f6f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b4a56315-a394-4a58-b151-8f24e650455a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:52.916093 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-871439dc-b072-4841-b88f-2a205d988f6f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-871439dc-b072-4841-b88f-2a205d988f6f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a HTTP/1.1 Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b4a56315-a394-4a58-b151-8f24e650455a'} Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance b4a56315-a394-4a58-b151-8f24e650455a Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:52.946341 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-871439dc-b072-4841-b88f-2a205d988f6f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:22:52.952883 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-871439dc-b072-4841-b88f-2a205d988f6f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a" status: 404 len: 111 microversion: 2.1 time: 0.141899 Oct 27 09:22:52.960115 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2252/4446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:52 2022] GET /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:22:53.077585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2121301482", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "3527ca6b-4f14-40c0-86a3-873f2fef222c"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:53.142632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:53.158344 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa6669a5-aed1-4e21-8cd3-b834cdf3ac9d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.777420 Oct 27 09:22:53.180706 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2195/4447] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:52 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:53.199320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-913d3860-f6c2-443f-ac96-8a8f8bd0bfbf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1677575635"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:53.203722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-913d3860-f6c2-443f-ac96-8a8f8bd0bfbf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:53.215355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913d3860-f6c2-443f-ac96-8a8f8bd0bfbf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:53.215989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913d3860-f6c2-443f-ac96-8a8f8bd0bfbf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:53.217839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913d3860-f6c2-443f-ac96-8a8f8bd0bfbf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:53.224586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913d3860-f6c2-443f-ac96-8a8f8bd0bfbf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:53.226006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913d3860-f6c2-443f-ac96-8a8f8bd0bfbf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:53.228503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913d3860-f6c2-443f-ac96-8a8f8bd0bfbf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:53.244744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] validate_networks() for [('3527ca6b-4f14-40c0-86a3-873f2fef222c', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:22:53.719289 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-913d3860-f6c2-443f-ac96-8a8f8bd0bfbf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.524105 Oct 27 09:22:53.725101 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2196/4448] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:22:53 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 27 09:22:54.412997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:22:54.414521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:22:54.415230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:22:54.416292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:22:54.416972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:22:54.441541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:54.443165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:54.445384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:54.458577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:54.459473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:54.463312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:54.531404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:22:54.550957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for user 0a9243ea430b4d2ba18c2a1e54e7c6aa and project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:22:54.586502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:22:54.588737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:22:54.708107 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ec6b1388-1547-4a71-a488-43076e884255 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.635328 Oct 27 09:22:54.714703 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2253/4449] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:22:54.722525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f88a4e09-b575-4cb3-b43c-6da35a7c6283 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:54.723235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f88a4e09-b575-4cb3-b43c-6da35a7c6283 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:54.864350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f88a4e09-b575-4cb3-b43c-6da35a7c6283 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:54.880724 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f88a4e09-b575-4cb3-b43c-6da35a7c6283 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1215 microversion: 2.1 time: 0.163453 Oct 27 09:22:54.882152 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2197/4450] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:54 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:55.907647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4156d0c-7111-4f31-8bc6-5cbeb5265795 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:55.909494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c4156d0c-7111-4f31-8bc6-5cbeb5265795 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:56.098562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c4156d0c-7111-4f31-8bc6-5cbeb5265795 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:56.105930 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c4156d0c-7111-4f31-8bc6-5cbeb5265795 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1215 microversion: 2.1 time: 0.204584 Oct 27 09:22:56.117669 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2254/4451] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:55 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:22:56.412479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b95891b1-7c93-46d5-af78-04318a577084 req-59a60c7d-16da-41dc-80f4-c909c5812f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "name": "network-vif-unplugged", "status": "completed", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:22:56.454994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b95891b1-7c93-46d5-af78-04318a577084 req-59a60c7d-16da-41dc-80f4-c909c5812f58 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:56.455479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b95891b1-7c93-46d5-af78-04318a577084 req-59a60c7d-16da-41dc-80f4-c909c5812f58 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:56.455948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b95891b1-7c93-46d5-af78-04318a577084 req-59a60c7d-16da-41dc-80f4-c909c5812f58 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:56.493127 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b95891b1-7c93-46d5-af78-04318a577084 req-59a60c7d-16da-41dc-80f4-c909c5812f58 service nova] Creating event network-vif-unplugged:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:22:56.512603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b95891b1-7c93-46d5-af78-04318a577084 req-59a60c7d-16da-41dc-80f4-c909c5812f58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104488 Oct 27 09:22:56.513376 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2198/4452] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:57.137750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:57.138560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:57.157161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:57.157730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:57.168446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:57.176665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:57.177440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:57.177880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:57.412723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:57.433499 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea1c204e-27b9-4fea-96dc-ca7c100da382 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1275 microversion: 2.1 time: 0.288820 Oct 27 09:22:57.448049 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2199/4453] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:57 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1275 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:22:57.592621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e079edb1-375a-4be7-8b31-4c32a492f976 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] Calling method '.version_select at 0x7f31a939f160>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:57.892855 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e079edb1-375a-4be7-8b31-4c32a492f976 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255/defaults" status: 200 len: 371 microversion: 2.1 time: 1.204116 Oct 27 09:22:57.907945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ec2e237-e574-4ae0-aa21-6f1de336dbe7 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] Calling method '.version_select at 0x7f31aa286670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:57.923741 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2255/4454] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:22:56 2022] GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255/defaults => generated 371 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:22:58.293984 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ec2e237-e574-4ae0-aa21-6f1de336dbe7 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255" status: 200 len: 371 microversion: 2.1 time: 0.391912 Oct 27 09:22:58.294646 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2200/4455] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 09:22:57 2022] GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255 => generated 371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:58.312910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b780c600-a28b-4fb9-a816-ef8f4b024153 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] Calling method '.version_select at 0x7f31a9e16430>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:58.464357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:58.464998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:58.508011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:58.523959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:58.525258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:58.530345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:58.532187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:58.534282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:58.754982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:22:58.765779 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f4b92397-937e-4bdb-9232-a11853a02b0b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1273 microversion: 2.1 time: 0.307172 Oct 27 09:22:58.771067 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2201/4456] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:58 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:22:58.800242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b780c600-a28b-4fb9-a816-ef8f4b024153 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255/defaults" status: 200 len: 371 microversion: 2.1 time: 0.492309 Oct 27 09:22:58.811943 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2256/4457] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:22:58 2022] GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255/defaults => generated 371 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:58.818638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6cc8255-a2da-4166-af7a-580a317da167 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] Calling method '.version_select at 0x7f31a97f1940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:59.017795 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6cc8255-a2da-4166-af7a-580a317da167 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255" status: 200 len: 371 microversion: 2.1 time: 0.204530 Oct 27 09:22:59.019033 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2202/4458] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 09:22:58 2022] GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255 => generated 371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:22:59.034503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31f8c21f-12fb-44e9-b31b-aee6765bf547 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] Calling method '.version_select at 0x7f31a937e670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:59.782603 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31f8c21f-12fb-44e9-b31b-aee6765bf547 tempest-QuotasTestJSON-1508376218 tempest-QuotasTestJSON-1508376218-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255?user_id=d8338fab140a428babd185b133a25805" status: 200 len: 371 microversion: 2.1 time: 0.755796 Oct 27 09:22:59.806888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:22:59.807636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:22:59.810868 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2257/4459] 10.222.0.25 () {58 vars in 1323 bytes} [Thu Oct 27 09:22:59 2022] GET /compute/v2.1/os-quota-sets/17194d60ebe94ae697f13e23ff773255?user_id=d8338fab140a428babd185b133a25805 => generated 371 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:22:59.843908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:22:59.849001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:59.859585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:59.862622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:22:59.871460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:22:59.874343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:22:59.874833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:01.362703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:01.385307 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ba54936e-54f7-42f5-a12e-58a32a83a45a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 1.593262 Oct 27 09:23:01.386401 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2203/4460] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:22:59 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:02.409193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:02.409888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:02.428054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:02.431872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:02.432519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:02.435164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:02.435823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:02.437418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:02.451700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:02.550801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-062a2b49-d77c-4d47-b69f-548d3b8eb4c3 req-2b3ce2b6-67ce-41ca-a54b-e34800d8cbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "name": "network-vif-plugged", "status": "completed", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:02.572570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-062a2b49-d77c-4d47-b69f-548d3b8eb4c3 req-2b3ce2b6-67ce-41ca-a54b-e34800d8cbd9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:02.573487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-062a2b49-d77c-4d47-b69f-548d3b8eb4c3 req-2b3ce2b6-67ce-41ca-a54b-e34800d8cbd9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:02.578289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-062a2b49-d77c-4d47-b69f-548d3b8eb4c3 req-2b3ce2b6-67ce-41ca-a54b-e34800d8cbd9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:02.598762 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-062a2b49-d77c-4d47-b69f-548d3b8eb4c3 req-2b3ce2b6-67ce-41ca-a54b-e34800d8cbd9 service nova] Creating event network-vif-plugged:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:23:02.619407 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-062a2b49-d77c-4d47-b69f-548d3b8eb4c3 req-2b3ce2b6-67ce-41ca-a54b-e34800d8cbd9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072663 Oct 27 09:23:02.620776 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2204/4461] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:03.968581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:03.984758 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-223718f8-7f33-41ad-9061-fbb8c44fe8fb tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 1.573517 Oct 27 09:23:03.988364 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2258/4462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:02 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:04.186822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9a41b50-d587-4bfb-b23b-f2c84f6a5126 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Action: 'create', calling method: .version_select at 0x7f31a98dc8b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1486594101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAru4i6XHq7PTS76cFvdGFO3raqMSIIZ5PkKEZHDeGQ+ZnY4gfvfv+5870JO689hB71egwLHRJf25H6+DoLrU1/WMxw5FHzPWX/TfHjHBQusGukOCbRI0MaKVFm3fl6E4w=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:04.354245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b9a41b50-d587-4bfb-b23b-f2c84f6a5126 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:23:04.373819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b9a41b50-d587-4bfb-b23b-f2c84f6a5126 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for user 203ed8cc61274041ae7a9bb1ac09fd1a and project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:23:04.458521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9a41b50-d587-4bfb-b23b-f2c84f6a5126 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.701030 Oct 27 09:23:04.469540 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2205/4463] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:23:03 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:23:05.013156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:05.013785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:05.032231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:05.036101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:05.042983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:05.052880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:05.053157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:05.062410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:05.062985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:05.063740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:05.113469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-026d9c1c-4af8-49f9-8350-4147ad742723 req-fa94f69a-033d-4629-9c5a-89233e2b1d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e", "tag": "9bec2cf8-a6f4-4ff3-8026-8a78e677874d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:05.160138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-026d9c1c-4af8-49f9-8350-4147ad742723 req-fa94f69a-033d-4629-9c5a-89233e2b1d3f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:05.160734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-026d9c1c-4af8-49f9-8350-4147ad742723 req-fa94f69a-033d-4629-9c5a-89233e2b1d3f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:05.161194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-026d9c1c-4af8-49f9-8350-4147ad742723 req-fa94f69a-033d-4629-9c5a-89233e2b1d3f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:05.184919 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-026d9c1c-4af8-49f9-8350-4147ad742723 req-fa94f69a-033d-4629-9c5a-89233e2b1d3f service nova] Creating event network-changed:9bec2cf8-a6f4-4ff3-8026-8a78e677874d for instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e on n-h1-858383-16 Oct 27 09:23:05.198682 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-026d9c1c-4af8-49f9-8350-4147ad742723 req-fa94f69a-033d-4629-9c5a-89233e2b1d3f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096303 Oct 27 09:23:05.201107 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2206/4464] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:05.762512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:05.773945 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aa544e4f-f032-436d-a06b-3c3f8b1354fc tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 0.765187 Oct 27 09:23:05.777503 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2259/4465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:05 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:06.806688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:06.808125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:06.817247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:06.823700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:06.824431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:06.826824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:06.827527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:06.829748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:06.847537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:07.219783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:07.233212 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3a40e61-e225-4792-a4e3-9954769e0bbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 0.431822 Oct 27 09:23:07.241785 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2207/4466] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:06 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:08.272936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:08.274465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:08.288690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:08.289614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:08.290383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:08.291889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:08.292673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:08.295062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:08.737113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:08.748037 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4487fb30-4ce5-4379-a0c2-03bb6c8dcae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 0.478639 Oct 27 09:23:08.750026 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2260/4467] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:08 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:09.027723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-400238309", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "5962a736-b7b4-4825-a266-a27822fd3071"}], "key_name": "tempest-TestNetworkBasicOps-1486594101", "security_groups": [{"name": "tempest-secgroup-smoke-1581294782"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:09.367285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] validate_networks() for [('5962a736-b7b4-4825-a266-a27822fd3071', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:23:09.772860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:09.773478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:09.787046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=20 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:09.789413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:09.792802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:09.793395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:09.794032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:09.794501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:09.799814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:11.034089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:11.049670 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-574fe8e2-8f78-45bd-a6db-b509c3e482b3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 1.280850 Oct 27 09:23:11.050629 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2261/4468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:09 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:11.739141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:23:11.739681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:23:11.740550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:23:11.740974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:23:11.741399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:23:11.758906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:11.759435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:11.759904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:11.763971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:11.767069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:11.768722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:11.828589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:23:11.843987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Getting quotas for user 203ed8cc61274041ae7a9bb1ac09fd1a and project f0630c5386744d07a21ac826f4d0d2b3. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:23:11.887931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:23:11.893231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:23:12.024494 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d0900e7-b724-433f-95dc-5621960d621a tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.002791 Oct 27 09:23:12.028828 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2208/4469] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:23:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 3008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:23:12.046379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-927dd6fc-3a90-4a65-b9c9-66cc4ba8b333 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:12.049873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-927dd6fc-3a90-4a65-b9c9-66cc4ba8b333 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:12.085139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:12.087103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:12.152152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:12.161548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:12.162835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:12.170472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:12.179483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:12.186557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:12.527665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-927dd6fc-3a90-4a65-b9c9-66cc4ba8b333 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:12.550595 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-927dd6fc-3a90-4a65-b9c9-66cc4ba8b333 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1248 microversion: 2.1 time: 0.508804 Oct 27 09:23:12.556944 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2262/4470] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:12 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1248 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:12.787545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:12.801042 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f89e85fd-8f33-4640-9ba4-512c0ff59ce3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 0.726247 Oct 27 09:23:12.801677 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2209/4471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:12 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:13.577071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:13.578440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:13.592894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:13.601176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:13.602159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:13.603150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:13.604888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:13.607124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:13.830325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:13.831887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:13.856043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:13.875115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:13.875976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:13.876968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:13.877684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:13.878325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:13.953535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:13.964839 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aa6d73b7-27aa-4249-9d7b-d75562da6551 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1244 microversion: 2.1 time: 0.393642 Oct 27 09:23:13.976375 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2263/4472] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:13 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1244 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:14.708932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:14.721589 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-56ab1d5e-74ec-474d-894b-6cf3bdae3d4e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 0.897777 Oct 27 09:23:14.757234 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2210/4473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:13 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:15.008570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:15.011433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:15.056713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:15.057812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:15.063722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:15.064640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:15.065136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:15.065582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:15.391034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:15.404338 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5e13af6-e939-489b-a0b6-9fef45135155 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1300 microversion: 2.1 time: 0.399914 Oct 27 09:23:15.417778 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2211/4474] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:15 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1300 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:15.750281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:15.751014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:15.783908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:15.784488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:15.785124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:15.785985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:15.786485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:15.786989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:15.938051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-412099172", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:16.097110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] validate_networks() for [('cac8cbb1-5a77-4d45-8703-8379a207158b', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:23:17.207447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:17.225085 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70010cce-66d4-4296-84c9-019de7a330c4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 1.482166 Oct 27 09:23:17.226425 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2212/4475] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:15 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:17.237472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e8db2eeb-cd66-4331-8155-1b3679d7096c req-fa702ce2-4593-4f72-b7dd-05351166b0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e", "name": "network-vif-plugged", "status": "completed", "tag": "9bec2cf8-a6f4-4ff3-8026-8a78e677874d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:17.258921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e8db2eeb-cd66-4331-8155-1b3679d7096c req-fa702ce2-4593-4f72-b7dd-05351166b0f2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:17.260134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e8db2eeb-cd66-4331-8155-1b3679d7096c req-fa702ce2-4593-4f72-b7dd-05351166b0f2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:17.260991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e8db2eeb-cd66-4331-8155-1b3679d7096c req-fa702ce2-4593-4f72-b7dd-05351166b0f2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:17.279516 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e8db2eeb-cd66-4331-8155-1b3679d7096c req-fa702ce2-4593-4f72-b7dd-05351166b0f2 service nova] Creating event network-vif-plugged:9bec2cf8-a6f4-4ff3-8026-8a78e677874d for instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e on n-h1-858383-16 Oct 27 09:23:17.287131 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e8db2eeb-cd66-4331-8155-1b3679d7096c req-fa702ce2-4593-4f72-b7dd-05351166b0f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058175 Oct 27 09:23:17.288254 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2213/4476] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:17.295688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:17.298214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:17.306349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:17.307451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:17.308156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:17.309145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:17.309935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:17.311352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:17.683445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:17.699269 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12e9ef44-a272-4eca-b72d-91be61ef8d0e tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1306 microversion: 2.1 time: 0.409168 Oct 27 09:23:17.712377 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2214/4477] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:17 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1306 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:18.008566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:23:18.009783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:23:18.010468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:23:18.011050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:23:18.011788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:23:18.034950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:18.035812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:18.036443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:18.037448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:18.037889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:18.038324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:18.121676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Getting quotas for project 66e0305f59424209ba883e5c0d6a832b. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:23:18.139182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Getting quotas for user dd48e1cf5d1542cd9688c13aa2d9ef0d and project 66e0305f59424209ba883e5c0d6a832b. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:23:18.202223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:23:18.204629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:23:18.256696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:18.257303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:18.278823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:18.281762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:18.282237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:18.283034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:18.288078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:18.288549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:18.428179 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-910313a2-1094-4141-a7eb-9d76c5b87407 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.585092 Oct 27 09:23:18.433867 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2264/4478] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:23:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:23:18.448587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1faed9b7-c456-4f8a-b5e8-0ec4160e19cb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:18.452199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1faed9b7-c456-4f8a-b5e8-0ec4160e19cb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:18.678858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1faed9b7-c456-4f8a-b5e8-0ec4160e19cb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:18.711010 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1faed9b7-c456-4f8a-b5e8-0ec4160e19cb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1213 microversion: 2.1 time: 0.270458 Oct 27 09:23:18.731848 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2265/4479] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:18 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1213 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:18.743426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:18.744352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:18.754340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:18.755841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:18.756632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:18.758717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:18.759524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:18.762042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:20.094414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:20.097767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:20.115359 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1dee3b47-e0aa-4744-ae8b-0219ac0b786d tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1374 microversion: 2.1 time: 1.375573 Oct 27 09:23:20.119595 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2266/4480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:18 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1374 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:20.120350 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65d76d2b-4f13-46f8-aab5-e857b771baf6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1315 microversion: 2.1 time: 1.865438 Oct 27 09:23:20.127048 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2215/4481] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:18 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1315 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:20.144986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:20.147973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:20.175479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:20.176142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:20.176608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:20.188301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:20.190430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:20.191409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:21.058646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:21.076710 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7cfd3bd-a4af-4451-be4f-3d42f646a203 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1217 microversion: 2.1 time: 0.948116 Oct 27 09:23:21.078084 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2267/4482] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:20 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1217 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:21.169474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:21.170058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:21.171043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:21.171396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:21.191909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:21.195114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:21.198813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:21.206366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:21.208140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:21.208963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:21.215988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:21.219465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:21.219925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:21.224901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:21.230688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:21.232125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:21.800774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:21.879285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=18 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:24.012173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:24.031599 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0813f81a-626e-4201-9692-1c2406e16a4b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1502 microversion: 2.1 time: 2.868283 Oct 27 09:23:24.038030 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2216/4483] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:21 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1502 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:24.051143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:24.064495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:24.085207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:24.088732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:24.089154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:24.090764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:24.091259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:24.091730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:24.404442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:24.416522 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ce99b63-0891-41ea-bca7-a05cb848c305 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1271 microversion: 2.1 time: 0.377055 Oct 27 09:23:24.433966 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2217/4484] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:24 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1271 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:24.459365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:24.460895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:24.500499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:24.501291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:24.501887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:24.502649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:24.503123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:24.503881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:24.768333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lazy-loading 'services' on Instance uuid 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:23:24.989435 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-143e762e-b1a5-48c7-9cd5-2fc25d7f6fe8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments/ed6a992a-bb3b-4003-a15a-a5b430ed6563" status: 202 len: 0 microversion: 2.1 time: 0.553262 Oct 27 09:23:24.990786 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2218/4485] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:23:24 2022] DELETE /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments/ed6a992a-bb3b-4003-a15a-a5b430ed6563 => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:23:24.997954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d9e9a15f-9206-45da-a16f-350a911a9dd5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:24.998929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d9e9a15f-9206-45da-a16f-350a911a9dd5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:25.010163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-9206-45da-a16f-350a911a9dd5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:25.011018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-9206-45da-a16f-350a911a9dd5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:25.012012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-9206-45da-a16f-350a911a9dd5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:25.014250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-9206-45da-a16f-350a911a9dd5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:25.015521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-9206-45da-a16f-350a911a9dd5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:25.016562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9e9a15f-9206-45da-a16f-350a911a9dd5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:25.196778 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d9e9a15f-9206-45da-a16f-350a911a9dd5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e/action" status: 202 len: 0 microversion: 2.1 time: 0.203524 Oct 27 09:23:25.200780 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2219/4486] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:23:24 2022] POST /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:23:25.229381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c6989014-32ed-4d5b-bce3-9eca2dc7e64f req-98d63ac1-a26e-4303-beb4-f0952176fe85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4462107f-9d4a-45b1-9080-8622fcef51d5", "tag": "a4bef84f-f781-4b55-9641-ab7e808a856e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:25.254274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c6989014-32ed-4d5b-bce3-9eca2dc7e64f req-98d63ac1-a26e-4303-beb4-f0952176fe85 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:25.255088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c6989014-32ed-4d5b-bce3-9eca2dc7e64f req-98d63ac1-a26e-4303-beb4-f0952176fe85 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:25.255838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c6989014-32ed-4d5b-bce3-9eca2dc7e64f req-98d63ac1-a26e-4303-beb4-f0952176fe85 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:25.284477 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c6989014-32ed-4d5b-bce3-9eca2dc7e64f req-98d63ac1-a26e-4303-beb4-f0952176fe85 service nova] Creating event network-changed:a4bef84f-f781-4b55-9641-ab7e808a856e for instance 4462107f-9d4a-45b1-9080-8622fcef51d5 on n-h2-858383-16 Oct 27 09:23:25.291330 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c6989014-32ed-4d5b-bce3-9eca2dc7e64f req-98d63ac1-a26e-4303-beb4-f0952176fe85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075299 Oct 27 09:23:25.292723 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2220/4487] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:25.300476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-081a13ec-d13c-42cf-ad93-1897ad4808f9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:25.305459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-081a13ec-d13c-42cf-ad93-1897ad4808f9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:25.315050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-081a13ec-d13c-42cf-ad93-1897ad4808f9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:25.315937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-081a13ec-d13c-42cf-ad93-1897ad4808f9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:25.316592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-081a13ec-d13c-42cf-ad93-1897ad4808f9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:25.320834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-081a13ec-d13c-42cf-ad93-1897ad4808f9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:25.321521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-081a13ec-d13c-42cf-ad93-1897ad4808f9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:25.322279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-081a13ec-d13c-42cf-ad93-1897ad4808f9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:25.401265 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-081a13ec-d13c-42cf-ad93-1897ad4808f9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106389 Oct 27 09:23:25.407037 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2221/4488] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:23:25 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:25.413652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:25.415037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:25.423023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:25.423821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:25.424429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:25.425481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:25.426166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:25.426763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:25.565112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:25.599624 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5ab21582-5018-4678-a539-02899b960c82 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1374 microversion: 2.1 time: 4.435696 Oct 27 09:23:25.603443 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2268/4489] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:21 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1374 bytes in 4440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:25.616737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:25.617610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:25.641653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:25.643115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:25.643599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:25.646435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:25.647524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:25.649813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:26.159227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:26.184896 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7fcb7f8-cfca-4fce-a925-bd55b953d999 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1507 microversion: 2.1 time: 0.775339 Oct 27 09:23:26.190517 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2222/4490] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:25 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1507 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:26.353909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:26.366513 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb92181e-6acd-4d19-8a44-ea26dcaf230d tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 0.761730 Oct 27 09:23:26.371510 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2269/4491] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:25 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:26.416158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-335090a3-be1e-4e8a-9057-e5ac1a56b53e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:26.418512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-335090a3-be1e-4e8a-9057-e5ac1a56b53e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:26.462010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-335090a3-be1e-4e8a-9057-e5ac1a56b53e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:26.471265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-335090a3-be1e-4e8a-9057-e5ac1a56b53e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:26.475447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-335090a3-be1e-4e8a-9057-e5ac1a56b53e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:26.478663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-335090a3-be1e-4e8a-9057-e5ac1a56b53e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:26.479328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-335090a3-be1e-4e8a-9057-e5ac1a56b53e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:26.484163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-335090a3-be1e-4e8a-9057-e5ac1a56b53e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:26.575939 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-335090a3-be1e-4e8a-9057-e5ac1a56b53e tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165245 Oct 27 09:23:26.583862 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2223/4492] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:23:26 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:26.627750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:26.629126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:26.640420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:26.643137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:26.644611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:26.646628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:26.649500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:26.650764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:27.217312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:27.219501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:27.237977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:27.243107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:27.246527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:27.248089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:27.251834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:27.253438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:27.363064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:27.496963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:27.509857 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-06375935-61f7-479d-801f-7baea5814b83 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1374 microversion: 2.1 time: 0.886752 Oct 27 09:23:27.519702 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2270/4493] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:26 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1374 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:27.548836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:27.553595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:27.583188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:27.588403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:27.593508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:27.599470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:27.604245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:27.607806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:28.057595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:28.071700 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-932cd79a-5755-421b-a40e-b29baea8d476 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1487 microversion: 2.1 time: 0.861199 Oct 27 09:23:28.081342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:28.083291 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2224/4494] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:27 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1487 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:28.099595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-caf24e02-c824-4b25-b363-1b96940f0d4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:28.111272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-caf24e02-c824-4b25-b363-1b96940f0d4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:28.118801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf24e02-c824-4b25-b363-1b96940f0d4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:28.121962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf24e02-c824-4b25-b363-1b96940f0d4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:28.125457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf24e02-c824-4b25-b363-1b96940f0d4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:28.127284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf24e02-c824-4b25-b363-1b96940f0d4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:28.128172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf24e02-c824-4b25-b363-1b96940f0d4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:28.134721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf24e02-c824-4b25-b363-1b96940f0d4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:28.206421 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-caf24e02-c824-4b25-b363-1b96940f0d4b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121651 Oct 27 09:23:28.207670 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2225/4495] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:23:28 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:28.218745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:28.220114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:28.233345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:28.235843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:28.236658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:28.239139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:28.240142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:28.240845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:28.297428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:23:28.302968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:28.324277 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f81fd0dd-59e7-404c-857d-f8868a88976f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 0.800223 Oct 27 09:23:28.326957 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2271/4496] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:27 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:28.521754 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3468191b-ee27-4935-b647-67084ab1c3e9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 204 len: 0 microversion: 2.1 time: 0.312477 Oct 27 09:23:28.522952 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2226/4497] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:23:28 2022] DELETE /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:23:28.533589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:28.534266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:28.539334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:28.540516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:28.553618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:28.554272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:28.554569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:28.555046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:28.555371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:28.556071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:28.556329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:28.561287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:28.565416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:28.566254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:28.572622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:28.573246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:28.712145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=10 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:29.315387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:29.324097 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a21f856c-5252-4d5b-ae1a-97b1a020bce7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1374 microversion: 2.1 time: 0.790925 Oct 27 09:23:29.345399 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2227/4498] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:28 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1374 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:29.357628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8add36ef-661d-49eb-8bfe-7ddc5a7ab98d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:29.363475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8add36ef-661d-49eb-8bfe-7ddc5a7ab98d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:29.374378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8add36ef-661d-49eb-8bfe-7ddc5a7ab98d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:29.386309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8add36ef-661d-49eb-8bfe-7ddc5a7ab98d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:29.386781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8add36ef-661d-49eb-8bfe-7ddc5a7ab98d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:29.388148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8add36ef-661d-49eb-8bfe-7ddc5a7ab98d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:29.388632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8add36ef-661d-49eb-8bfe-7ddc5a7ab98d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:29.389066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8add36ef-661d-49eb-8bfe-7ddc5a7ab98d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:29.469610 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8add36ef-661d-49eb-8bfe-7ddc5a7ab98d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123043 Oct 27 09:23:29.470754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2228/4499] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:23:29 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:29.476448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:29.480308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:29.497584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:29.498276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:29.498896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:29.499804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:29.509162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:29.509812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:29.593116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:29.604780 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ceb9b8e-a0a0-49b4-9055-ad2238dff5e5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1493 microversion: 2.1 time: 1.077696 Oct 27 09:23:29.614023 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2272/4500] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:28 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1493 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:29.993467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:30.004883 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8c45c0f-c259-40ac-9159-a67eebdb49e0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 0.532796 Oct 27 09:23:30.011380 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2229/4501] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:29 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:30.358055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:30.358839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:30.376337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:30.380220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:30.381919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:30.385472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:30.387981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:30.391053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:30.484252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12eaa351-8e38-49cd-a8f3-26a54dd3106d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:30.487898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12eaa351-8e38-49cd-a8f3-26a54dd3106d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:30.496246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:30.549458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12eaa351-8e38-49cd-a8f3-26a54dd3106d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:30.553519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12eaa351-8e38-49cd-a8f3-26a54dd3106d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:30.560032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12eaa351-8e38-49cd-a8f3-26a54dd3106d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:30.562642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12eaa351-8e38-49cd-a8f3-26a54dd3106d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:30.567169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12eaa351-8e38-49cd-a8f3-26a54dd3106d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:30.570751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12eaa351-8e38-49cd-a8f3-26a54dd3106d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:30.867506 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12eaa351-8e38-49cd-a8f3-26a54dd3106d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.376817 Oct 27 09:23:30.874582 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2230/4502] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:23:30 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 197 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:30.896580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:30.908331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:30.928807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:30.932713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:30.935780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:30.939141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:30.944272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:30.948542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:32.188479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:32.205213 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1cf96570-bb30-499c-be9a-95317797d952 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1374 microversion: 2.1 time: 1.852223 Oct 27 09:23:32.212426 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2273/4503] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:30 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1374 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:32.227274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:32.230013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:32.252980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:32.269714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:32.272197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:32.278907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:32.281179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:32.282339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:32.691042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:32.693540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=84 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:32.722291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e79ce0ea-e67b-45cc-a2b4-3c2885151b17 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 0.507585 Oct 27 09:23:32.723722 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2274/4504] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:32 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:32.729606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8c67d66c-7f55-4912-81b4-68a480f5eb2d req-10d04144-3d7c-44a4-a973-5e3a9af84192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974227c6-3f96-4c8b-870b-caa84bf8a44c", "tag": "6f292a2c-5fea-4293-a711-5fca4fbbb619"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:32.767839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8c67d66c-7f55-4912-81b4-68a480f5eb2d req-10d04144-3d7c-44a4-a973-5e3a9af84192 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:32.768319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8c67d66c-7f55-4912-81b4-68a480f5eb2d req-10d04144-3d7c-44a4-a973-5e3a9af84192 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:32.768946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8c67d66c-7f55-4912-81b4-68a480f5eb2d req-10d04144-3d7c-44a4-a973-5e3a9af84192 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:32.805838 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8c67d66c-7f55-4912-81b4-68a480f5eb2d req-10d04144-3d7c-44a4-a973-5e3a9af84192 service nova] Creating event network-changed:6f292a2c-5fea-4293-a711-5fca4fbbb619 for instance 974227c6-3f96-4c8b-870b-caa84bf8a44c on n-h1-858383-16 Oct 27 09:23:32.812938 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8c67d66c-7f55-4912-81b4-68a480f5eb2d req-10d04144-3d7c-44a4-a973-5e3a9af84192 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086778 Oct 27 09:23:32.814116 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2275/4505] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:32.819790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d236bb57-358b-4d0e-982d-0c747732d81d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:32.822685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d236bb57-358b-4d0e-982d-0c747732d81d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:32.830627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d236bb57-358b-4d0e-982d-0c747732d81d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:32.831645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d236bb57-358b-4d0e-982d-0c747732d81d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:32.832253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d236bb57-358b-4d0e-982d-0c747732d81d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:32.833179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d236bb57-358b-4d0e-982d-0c747732d81d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:32.833792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d236bb57-358b-4d0e-982d-0c747732d81d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:32.836928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d236bb57-358b-4d0e-982d-0c747732d81d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:32.935128 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d236bb57-358b-4d0e-982d-0c747732d81d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119520 Oct 27 09:23:32.937811 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2276/4506] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:23:32 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:33.239849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:33.240920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:33.257283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:33.267337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:33.269481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:33.273724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:33.275800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:33.277031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:33.523779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:33.542597 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49aa9b97-7b4d-4b4c-b3b2-b3e1aa47be82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1493 microversion: 2.1 time: 2.656736 Oct 27 09:23:33.543934 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2231/4507] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:30 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1493 bytes in 2669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:33.747059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:33.747700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:33.761513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:33.762766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:33.764871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:33.766617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:33.767376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:33.768008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:34.789958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:34.810125 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c2c0db6d-1ddc-42fd-af97-8e2e33f40d2b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 1.067743 Oct 27 09:23:34.829372 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2232/4508] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:33 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:34.863184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9266c6fe-8fe4-4d22-bda2-c78e1afd6402 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:34.880292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9266c6fe-8fe4-4d22-bda2-c78e1afd6402 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:34.894334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:34.908174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9266c6fe-8fe4-4d22-bda2-c78e1afd6402 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:34.908719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9266c6fe-8fe4-4d22-bda2-c78e1afd6402 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:34.909169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9266c6fe-8fe4-4d22-bda2-c78e1afd6402 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:34.909410 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4568bf32-abf7-47a9-a1e1-9678ce25eff1 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1374 microversion: 2.1 time: 1.668976 Oct 27 09:23:34.909902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9266c6fe-8fe4-4d22-bda2-c78e1afd6402 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:34.913932 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2277/4509] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:33 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1374 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:34.916667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9266c6fe-8fe4-4d22-bda2-c78e1afd6402 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:34.917178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9266c6fe-8fe4-4d22-bda2-c78e1afd6402 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:34.931037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:34.933468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:34.960668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:34.962548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:34.963291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:34.969419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:34.971243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:34.976733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:35.038447 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9266c6fe-8fe4-4d22-bda2-c78e1afd6402 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207395 Oct 27 09:23:35.039634 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2233/4510] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:23:34 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:35.109660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:35.113534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:35.117660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:35.118490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lazy-loading 'fault' on Instance uuid 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:23:35.255745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:35.266541 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3111ad9e-784e-4db9-b274-4389e1c6ad1d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 200 len: 1305 microversion: 2.1 time: 0.351204 Oct 27 09:23:35.270235 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2278/4511] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:34 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 1305 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:35.589495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a1fca6ab-1462-4373-8c0c-efb03af723da req-ccf809ae-3617-4441-a2e4-c15bd952290c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e", "name": "network-vif-deleted", "tag": "9bec2cf8-a6f4-4ff3-8026-8a78e677874d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:35.614947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a1fca6ab-1462-4373-8c0c-efb03af723da req-ccf809ae-3617-4441-a2e4-c15bd952290c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:35.616055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a1fca6ab-1462-4373-8c0c-efb03af723da req-ccf809ae-3617-4441-a2e4-c15bd952290c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:35.618413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a1fca6ab-1462-4373-8c0c-efb03af723da req-ccf809ae-3617-4441-a2e4-c15bd952290c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:35.649647 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a1fca6ab-1462-4373-8c0c-efb03af723da req-ccf809ae-3617-4441-a2e4-c15bd952290c service nova] Creating event network-vif-deleted:9bec2cf8-a6f4-4ff3-8026-8a78e677874d for instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e on n-h1-858383-16 Oct 27 09:23:35.664472 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a1fca6ab-1462-4373-8c0c-efb03af723da req-ccf809ae-3617-4441-a2e4-c15bd952290c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078608 Oct 27 09:23:35.667514 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2234/4512] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:35.850118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:35.850898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:35.861663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:35.879200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:35.880208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:35.880837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:35.881748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:35.882517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:35.883111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:35.951179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:35.953152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:35.977504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:35.978020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:35.978473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:35.979193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:35.979683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:35.980118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:36.296071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:36.304939 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ffa1a81-043d-4e79-908b-76ef768c24ce tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1374 microversion: 2.1 time: 0.367730 Oct 27 09:23:36.309454 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2235/4513] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:35 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1374 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:36.310444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:36.319450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-54179dc4-5147-4a69-8f08-7f5f07aea90a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 0.476126 Oct 27 09:23:36.334772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bb8cd3e-307f-4c5b-beb1-f96a1c4e9ccb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:36.337650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1bb8cd3e-307f-4c5b-beb1-f96a1c4e9ccb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:36.347668 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2279/4514] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:35 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:36.350949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:36.351909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:36.359456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb8cd3e-307f-4c5b-beb1-f96a1c4e9ccb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:36.360428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb8cd3e-307f-4c5b-beb1-f96a1c4e9ccb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:36.360845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:36.361511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:36.361716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb8cd3e-307f-4c5b-beb1-f96a1c4e9ccb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:36.362100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:36.362915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:36.363600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:36.363752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb8cd3e-307f-4c5b-beb1-f96a1c4e9ccb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:36.364212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:36.364842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb8cd3e-307f-4c5b-beb1-f96a1c4e9ccb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:36.365490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bb8cd3e-307f-4c5b-beb1-f96a1c4e9ccb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:36.383124 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e HTTP/1.1 Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e'} Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:23:36.385199 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:36.389465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:36.389465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:23:36.389465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:23:36.389465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:23:36.389465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:23:36.389465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:23:36.389465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:36.394365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:23:36.396393 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d206a3a3-63fa-4239-9c00-6a031ac001f1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 404 len: 111 microversion: 2.1 time: 0.051585 Oct 27 09:23:36.399875 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2280/4515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:36 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:23:36.455327 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1bb8cd3e-307f-4c5b-beb1-f96a1c4e9ccb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143944 Oct 27 09:23:36.464739 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2236/4516] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:23:36 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:36.581875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-46768596", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "3527ca6b-4f14-40c0-86a3-873f2fef222c"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:36.663708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] validate_networks() for [('3527ca6b-4f14-40c0-86a3-873f2fef222c', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:23:37.193933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:37.194631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:37.206329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.208386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.210066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:37.211386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.213315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.213925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:37.376387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:23:37.376960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:23:37.377737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:23:37.378149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:23:37.378560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:23:37.397395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.397888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.398325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:37.399044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.399499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.399958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:37.449576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:23:37.459013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:37.463157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for user 0a9243ea430b4d2ba18c2a1e54e7c6aa and project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:23:37.478189 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7043e574-8dac-496d-8de3-5a61f8208f28 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.285186 Oct 27 09:23:37.479501 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2237/4517] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:37 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:37.498671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:37.499538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:37.507320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.508211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.508875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:37.509960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.514571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.515637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:37.548742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:23:37.552030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:23:37.663074 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ab85f21-2a1a-490c-afee-74656b87b2e0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084072 Oct 27 09:23:37.664741 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2281/4518] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:23:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:23:37.677380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:37.680553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:37.696753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.697502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.698756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:37.700815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.701445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.702097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:37.946152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:37.957676 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4696ccb-f48e-4cd4-b5b1-70087b70cab8 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1374 microversion: 2.1 time: 0.476041 Oct 27 09:23:37.972011 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2238/4519] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:37 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1374 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:37.979474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82f65ac8-fa85-4217-b1a0-e3c9bd9db88d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:37.982375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82f65ac8-fa85-4217-b1a0-e3c9bd9db88d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:37.989025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f65ac8-fa85-4217-b1a0-e3c9bd9db88d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.989631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f65ac8-fa85-4217-b1a0-e3c9bd9db88d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.989968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f65ac8-fa85-4217-b1a0-e3c9bd9db88d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:37.990704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f65ac8-fa85-4217-b1a0-e3c9bd9db88d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:37.991170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f65ac8-fa85-4217-b1a0-e3c9bd9db88d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:37.991624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f65ac8-fa85-4217-b1a0-e3c9bd9db88d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.033177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:38.039839 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82f65ac8-fa85-4217-b1a0-e3c9bd9db88d tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066549 Oct 27 09:23:38.040988 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2239/4520] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:23:37 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:23:38.058517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0d89f7e9-b1bc-48ba-8dfb-4a02ed5e1405 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:38.059145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0d89f7e9-b1bc-48ba-8dfb-4a02ed5e1405 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:38.192755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0d89f7e9-b1bc-48ba-8dfb-4a02ed5e1405 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:38.205410 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0d89f7e9-b1bc-48ba-8dfb-4a02ed5e1405 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1213 microversion: 2.1 time: 0.163181 Oct 27 09:23:38.206644 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2240/4521] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:38 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:38.216882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2d7215d9-16a0-49b8-9b62-0a031279d26f req-29643541-0ccd-4978-8ded-6f29714e7f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4462107f-9d4a-45b1-9080-8622fcef51d5", "name": "network-vif-plugged", "status": "completed", "tag": "a4bef84f-f781-4b55-9641-ab7e808a856e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:38.231558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2d7215d9-16a0-49b8-9b62-0a031279d26f req-29643541-0ccd-4978-8ded-6f29714e7f23 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.232409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2d7215d9-16a0-49b8-9b62-0a031279d26f req-29643541-0ccd-4978-8ded-6f29714e7f23 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.233176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2d7215d9-16a0-49b8-9b62-0a031279d26f req-29643541-0ccd-4978-8ded-6f29714e7f23 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.245397 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2d7215d9-16a0-49b8-9b62-0a031279d26f req-29643541-0ccd-4978-8ded-6f29714e7f23 service nova] Creating event network-vif-plugged:a4bef84f-f781-4b55-9641-ab7e808a856e for instance 4462107f-9d4a-45b1-9080-8622fcef51d5 on n-h2-858383-16 Oct 27 09:23:38.255512 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2d7215d9-16a0-49b8-9b62-0a031279d26f req-29643541-0ccd-4978-8ded-6f29714e7f23 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047159 Oct 27 09:23:38.256306 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2241/4522] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:38.262945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:38.265536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:38.272453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.272952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.273396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.274384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.274852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.275294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.306592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:38.316849 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] HTTP exception thrown: Cannot 'reboot' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Request method failure captured: Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41/action HTTP/1.1 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 28 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzDycu2zrvEyACIIrQoHV06Jd0It45Rv0F2xQOPM2wSnWHcd2-qrADZYvnaOYh5v8cskDBIeRUmgZuL2fU3btGeQcZ_Q6fTjrMtyd25Sz9aShgYNBtDFz-Hs50Qjx2g1J9zbfldbysO0umRvOL_OrzT1jkVjcfTyFj5P-3m0Jht0Qc Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e28707cf49b24806879ae5acd0e08cf3"}]}] Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c6165562b6e14ff18dc7d82b8c9a46b3 Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: {"reboot": {"type": "HARD"}} Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: exception: Cannot 'reboot' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '3c16fd28-a6c7-4c72-910f-088304530f41', 'body': {'reboot': {'type': 'HARD'}}} Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3c16fd28-a6c7-4c72-910f-088304530f41 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:23:38.318950 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued Oct 27 09:23:38.323398 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.324869 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f95fcdf-334c-4f75-accf-26ece9659781 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 0.652495 Oct 27 09:23:38.333701 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2282/4523] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:37 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:38.345633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Returning 409 to user: Cannot 'reboot' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:23:38.346714 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-56755a59-054f-4ded-b0c4-9148b8b45e35 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41/action" status: 409 len: 145 microversion: 2.1 time: 0.089266 Oct 27 09:23:38.353498 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2242/4524] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:23:38 2022] POST /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41/action => generated 145 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:23:38.359004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:38.362445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:38.375463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.376108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.376839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.377596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.378042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.378481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.412043 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] HTTP exception thrown: Cannot 'rebuild' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Request method failure captured: Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41/action HTTP/1.1 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 65 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkzDycu2zrvEyACIIrQoHV06Jd0It45Rv0F2xQOPM2wSnWHcd2-qrADZYvnaOYh5v8cskDBIeRUmgZuL2fU3btGeQcZ_Q6fTjrMtyd25Sz9aShgYNBtDFz-Hs50Qjx2g1J9zbfldbysO0umRvOL_OrzT1jkVjcfTyFj5P-3m0Jht0Qc Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e28707cf49b24806879ae5acd0e08cf3"}]}] Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c6165562b6e14ff18dc7d82b8c9a46b3 Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: exception: Cannot 'rebuild' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '3c16fd28-a6c7-4c72-910f-088304530f41', 'body': {'rebuild': {'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1'}}} Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3c16fd28-a6c7-4c72-910f-088304530f41 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:23:38.414748 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued Oct 27 09:23:38.419304 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:38.422052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Returning 409 to user: Cannot 'rebuild' instance 3c16fd28-a6c7-4c72-910f-088304530f41 while it is in vm_state rescued {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:23:38.423204 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5693ee9-8c9b-4a47-b976-231a25f7fdc9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "POST /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41/action" status: 409 len: 146 microversion: 2.1 time: 0.069285 Oct 27 09:23:38.424553 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2283/4525] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:23:38 2022] POST /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41/action => generated 146 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:23:38.433418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:38.434585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:38.441383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.441725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.442166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.443347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.443347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.443784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.485101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:23:38.504018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:38.504833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:38.513562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.514907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.515596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.516776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.517564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.519259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.645029 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65156eb1-18db-4a87-86c8-bb96525d12f8 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 204 len: 0 microversion: 2.1 time: 0.215132 Oct 27 09:23:38.651982 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2243/4526] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:23:38 2022] DELETE /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:23:38.658728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:38.659925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:38.672124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.673347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.673945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.674751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.675550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.676276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.893987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:38.904582 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-20c46845-89a0-4d30-a773-d24b62f0e3df tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.405904 Oct 27 09:23:38.905548 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2284/4527] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:38 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:38.929001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da6d8e2f-02c4-4b9f-980a-26fc1138394c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-426601611"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:38.931785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da6d8e2f-02c4-4b9f-980a-26fc1138394c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:38.941997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6d8e2f-02c4-4b9f-980a-26fc1138394c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.942693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6d8e2f-02c4-4b9f-980a-26fc1138394c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.943305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6d8e2f-02c4-4b9f-980a-26fc1138394c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.944597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6d8e2f-02c4-4b9f-980a-26fc1138394c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:38.945275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6d8e2f-02c4-4b9f-980a-26fc1138394c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:38.945852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da6d8e2f-02c4-4b9f-980a-26fc1138394c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:38.992478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:39.038353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25a06419-14df-4533-83db-e35a0ddd5daf tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1689 microversion: 2.1 time: 0.385261 Oct 27 09:23:39.039159 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2244/4528] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:38 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1689 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:39.052853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:39.053473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:39.066870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:39.067381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:39.067846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:39.069264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:39.069646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:39.071095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:39.339540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:39.349049 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb8dc438-5fd0-40f6-aec6-3ddd2d8fd8f9 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1374 microversion: 2.1 time: 0.304134 Oct 27 09:23:39.352514 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2245/4529] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:39 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1374 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:39.373642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:39.374281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:39.381494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:39.382194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:39.382808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:39.383716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:39.386361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:39.389794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:39.391745 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da6d8e2f-02c4-4b9f-980a-26fc1138394c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.467111 Oct 27 09:23:39.397599 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2285/4530] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:23:38 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 27 09:23:39.407027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:39.408025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:39.415285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:39.416041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:39.416559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:39.417348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:39.418089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:39.418686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:39.587734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:39.632956 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-392feb98-b6ce-4583-8f7b-e0c3ca633285 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1265 microversion: 2.1 time: 0.278107 Oct 27 09:23:39.636414 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2246/4531] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:39 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:39.651430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:39.654305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:39.670418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:39.673185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:39.675606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:39.677171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:39.677820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:39.679649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:39.686892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:39.695212 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-606fdd03-64cc-4c51-9ee2-fdf27aeb8c5e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 0.294855 Oct 27 09:23:39.697597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2286/4532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:39 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:39.952935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:39.962387 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-acc8be4d-2589-469c-82a4-e236b98f1c9b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.320510 Oct 27 09:23:39.963950 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2247/4533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:39 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:40.063297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:40.064035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:40.074444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.075165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.075864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:40.076783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.077424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.078028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:40.343947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:40.361754 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fea213c8-cfda-4771-85ca-1e181596dcf9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1689 microversion: 2.1 time: 0.303962 Oct 27 09:23:40.362349 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2287/4534] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:40 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1689 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:40.381973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:40.382599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:40.392655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.393303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.393609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:40.394347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.394795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.395496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:40.658961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:40.659853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:40.672488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.673144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.673978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:40.674896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.675700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.678035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:40.785912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:40.797156 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0a50929-945b-409e-9738-61a1967d6541 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1545 microversion: 2.1 time: 0.420125 Oct 27 09:23:40.797765 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2248/4535] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:40 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1545 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:40.828644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:40.831544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:40.846241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.847890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.849057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:40.849819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.850294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.850728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:40.939197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:40.948384 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aa9c1637-92db-4781-94da-3284406182ac tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1265 microversion: 2.1 time: 0.293374 Oct 27 09:23:40.950135 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2288/4536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:40 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:40.955472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:40.956397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:40.962945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.964056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.964763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:40.965852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:40.966547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:40.967207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:41.261039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:41.273933 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-226222d3-9f4a-472f-952b-e9e60ff05a82 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 0.456647 Oct 27 09:23:41.275929 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2249/4537] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:40 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:41.288294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:41.289790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:41.317146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:41.317927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:41.318595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:41.319585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:41.320273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:41.320942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:41.324224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:41.334821 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-53d8773b-7e84-4830-b39d-b38eede77145 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1545 microversion: 2.1 time: 0.383381 Oct 27 09:23:41.338072 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2289/4538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:40 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1545 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:41.386686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:41.387511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:41.406473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:41.407094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:41.407973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:41.410592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:41.411180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:41.415535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:41.930395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:41.941740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-099631ca-2ca6-47e6-bfce-83bba6ddd598 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.662697 Oct 27 09:23:41.946006 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2250/4539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:41 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:41.976997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:41.977961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:41.990130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:41.993458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:41.994166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:41.995108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:41.998923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:42.010090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:42.011028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:42.023280 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-45f8d0cd-7816-4222-89d9-8f6ab73b9f15 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1689 microversion: 2.1 time: 0.627178 Oct 27 09:23:42.024286 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2290/4540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:41 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1689 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:42.267737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:42.279942 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6ec050e3-554b-44aa-b7f0-397df379acd6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1265 microversion: 2.1 time: 0.306916 Oct 27 09:23:42.284236 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2251/4541] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:41 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:42.305584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:42.306646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:42.325061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:42.327150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:42.327954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:42.329576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:42.331641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:42.334980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:42.359951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-354e8a7f-05b4-43c3-a3a6-a997c1084e0a req-86226a14-313f-4534-ae89-597a8c2f89d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974227c6-3f96-4c8b-870b-caa84bf8a44c", "name": "network-vif-plugged", "status": "completed", "tag": "6f292a2c-5fea-4293-a711-5fca4fbbb619"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:42.392227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-354e8a7f-05b4-43c3-a3a6-a997c1084e0a req-86226a14-313f-4534-ae89-597a8c2f89d7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:42.392733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-354e8a7f-05b4-43c3-a3a6-a997c1084e0a req-86226a14-313f-4534-ae89-597a8c2f89d7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:42.399142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-354e8a7f-05b4-43c3-a3a6-a997c1084e0a req-86226a14-313f-4534-ae89-597a8c2f89d7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:42.472583 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-354e8a7f-05b4-43c3-a3a6-a997c1084e0a req-86226a14-313f-4534-ae89-597a8c2f89d7 service nova] Creating event network-vif-plugged:6f292a2c-5fea-4293-a711-5fca4fbbb619 for instance 974227c6-3f96-4c8b-870b-caa84bf8a44c on n-h1-858383-16 Oct 27 09:23:42.482829 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-354e8a7f-05b4-43c3-a3a6-a997c1084e0a req-86226a14-313f-4534-ae89-597a8c2f89d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126678 Oct 27 09:23:42.486237 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2252/4542] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:23:42.977102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:42.978874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:43.012699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:43.013584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:43.014487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:43.017062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:43.017888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:43.018808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:43.871032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:43.899502 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-467453be-fbd7-4955-917c-6fc0cabe2142 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1313 microversion: 2.1 time: 1.599885 Oct 27 09:23:43.903391 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2291/4543] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:42 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1313 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:43.915469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:43.919097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:43.936623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:43.937909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:43.938932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:43.940829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:43.941322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:43.945945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:43.966819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:43.972018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:43.982498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4babb13-4684-4a79-badf-6da7f9ad2fba tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1685 microversion: 2.1 time: 1.010388 Oct 27 09:23:43.988666 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2253/4544] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:42 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1685 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:44.000578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:44.001430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:44.027800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:44.028939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:44.029213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:44.029982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:44.030516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:44.030885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:44.375233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:44.383992 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9e9cb7f0-c2bc-4cd1-b9d0-0f6c5521cc70 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1271 microversion: 2.1 time: 0.393934 Oct 27 09:23:44.388285 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2254/4545] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:43 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1271 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:44.647432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-db3d2ca9-b3d2-4e6e-8251-aca526848260 req-0349f3d1-709e-4165-9a67-78e1f5dc189d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "name": "network-vif-unplugged", "status": "completed", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:44.687666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-db3d2ca9-b3d2-4e6e-8251-aca526848260 req-0349f3d1-709e-4165-9a67-78e1f5dc189d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:44.691642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-db3d2ca9-b3d2-4e6e-8251-aca526848260 req-0349f3d1-709e-4165-9a67-78e1f5dc189d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:44.693941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-db3d2ca9-b3d2-4e6e-8251-aca526848260 req-0349f3d1-709e-4165-9a67-78e1f5dc189d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:44.724501 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-db3d2ca9-b3d2-4e6e-8251-aca526848260 req-0349f3d1-709e-4165-9a67-78e1f5dc189d service nova] Creating event network-vif-unplugged:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:23:44.758734 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-db3d2ca9-b3d2-4e6e-8251-aca526848260 req-0349f3d1-709e-4165-9a67-78e1f5dc189d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115321 Oct 27 09:23:44.765679 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2255/4546] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:23:44.938620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:44.940173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:44.965291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:44.968062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:44.968772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:44.974774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:44.975710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:44.985153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:45.043835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:45.063934 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-438b7411-716b-49f7-8665-c5d273c823d4 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1689 microversion: 2.1 time: 1.153858 Oct 27 09:23:45.080511 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2292/4547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:43 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1689 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:45.092645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:45.093263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:45.125576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:45.128226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:45.128729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:45.133840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:45.134425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:45.135438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:46.512669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:46.524488 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2cc17fd-57b2-4e3b-a738-be4146e6f28e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1498 microversion: 2.1 time: 1.597743 Oct 27 09:23:46.549668 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2256/4548] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:44 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1498 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:46.555301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:46.561623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:46.569144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:46.569874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:46.570756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:46.571875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:46.572556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:46.573167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:46.660411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:46.675249 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-235305e5-846d-49d8-9889-902dded9ea87 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1685 microversion: 2.1 time: 1.593484 Oct 27 09:23:46.678659 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2293/4549] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:45 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1685 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:46.698026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:46.700301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:46.728200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:46.728872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:46.736123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:46.737146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:46.740424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:46.743915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:47.003254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:47.014650 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1bc29772-6aae-4d2f-984b-ec8f2147213a tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1622 microversion: 2.1 time: 0.331171 Oct 27 09:23:47.017630 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2294/4550] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:46 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1622 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:47.038568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:47.042984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:47.061729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:47.063692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:47.064156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:47.064902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:47.065372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:47.065808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:47.137685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lazy-loading 'flavor' on Instance uuid 974227c6-3f96-4c8b-870b-caa84bf8a44c {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:23:47.274847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:47.292031 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6a265ef-4a92-4ebe-8acf-787a7472c562 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1313 microversion: 2.1 time: 0.740543 Oct 27 09:23:47.295682 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2257/4551] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:46 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:47.322045 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed9c8bb0-cb19-4ab5-b586-cdfc8d87edcb tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "POST /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c/action" status: 200 len: 32 microversion: 2.1 time: 0.297900 Oct 27 09:23:47.323056 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2295/4552] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:23:47 2022] POST /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c/action => generated 32 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:23:47.338390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:47.339027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:47.359702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:47.362149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:47.363858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:47.364967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:47.373634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:47.374371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:47.385852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:47.703847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:47.704645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:47.710246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:47.710969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:47.745602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:47.750642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:47.751419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:47.752428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:47.753099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:47.753726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:48.203537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:48.850944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:48.853942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:48.868160 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e0d8e4fb-3790-40b6-8452-d970843c60dd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1685 microversion: 2.1 time: 1.164669 Oct 27 09:23:48.869229 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97ec9e58-431c-4f2d-b81c-91da11cdf0ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 1.534828 Oct 27 09:23:48.874979 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2258/4553] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:47 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:48.884194 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2296/4554] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:47 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1685 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:48.895241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:48.908024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:48.911112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-9cd3fd3f-db43-4232-8c54-92967c181186 req-3a9f6717-9f9c-4f58-b450-b6ee93f327ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "name": "network-vif-plugged", "status": "completed", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:48.924033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:48.933732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:48.940999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:48.941165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9cd3fd3f-db43-4232-8c54-92967c181186 req-3a9f6717-9f9c-4f58-b450-b6ee93f327ba service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:48.941605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9cd3fd3f-db43-4232-8c54-92967c181186 req-3a9f6717-9f9c-4f58-b450-b6ee93f327ba service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:48.943979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9cd3fd3f-db43-4232-8c54-92967c181186 req-3a9f6717-9f9c-4f58-b450-b6ee93f327ba service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:48.945257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:48.945756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:48.946202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:48.972516 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-9cd3fd3f-db43-4232-8c54-92967c181186 req-3a9f6717-9f9c-4f58-b450-b6ee93f327ba service nova] Creating event network-vif-plugged:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:23:48.983186 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-9cd3fd3f-db43-4232-8c54-92967c181186 req-3a9f6717-9f9c-4f58-b450-b6ee93f327ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097007 Oct 27 09:23:48.985495 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2297/4555] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:48.997001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:48.997909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:49.015008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:49.016491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:49.017385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:49.018442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:49.019415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:49.020112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:49.068984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:49.069486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:49.069941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:49.085186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lazy-loading 'fault' on Instance uuid 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:23:49.257449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:49.294207 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8a7fbc15-4943-4548-a2f3-1405d667cad7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 200 len: 1335 microversion: 2.1 time: 0.414892 Oct 27 09:23:49.298195 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2259/4556] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:48 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 1335 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:49.319183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-24214395-a219-40c7-9d51-317cb73a0b1d req-14ac617b-5e92-4685-a3b9-ba475c6c4462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e", "name": "network-vif-deleted", "tag": "b6c0099e-113e-4920-b290-fd730dcf9be5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:49.369350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-24214395-a219-40c7-9d51-317cb73a0b1d req-14ac617b-5e92-4685-a3b9-ba475c6c4462 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:49.370253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-24214395-a219-40c7-9d51-317cb73a0b1d req-14ac617b-5e92-4685-a3b9-ba475c6c4462 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:49.373306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-24214395-a219-40c7-9d51-317cb73a0b1d req-14ac617b-5e92-4685-a3b9-ba475c6c4462 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:49.409104 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-24214395-a219-40c7-9d51-317cb73a0b1d req-14ac617b-5e92-4685-a3b9-ba475c6c4462 service nova] Creating event network-vif-deleted:b6c0099e-113e-4920-b290-fd730dcf9be5 for instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e on n-h1-858383-16 Oct 27 09:23:49.433133 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-24214395-a219-40c7-9d51-317cb73a0b1d req-14ac617b-5e92-4685-a3b9-ba475c6c4462 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129596 Oct 27 09:23:49.434192 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2260/4557] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:49.657188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ceb54305-c9a4-48cf-987c-6f37234d963e req-9a2c528f-83ce-43c9-833a-831a49136507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "389f74c5-88ab-43cb-86d5-0ea1b4309ef4", "tag": "c3a450aa-996e-4b42-8fbe-1c665c19e69b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:49.720162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ceb54305-c9a4-48cf-987c-6f37234d963e req-9a2c528f-83ce-43c9-833a-831a49136507 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:49.720700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ceb54305-c9a4-48cf-987c-6f37234d963e req-9a2c528f-83ce-43c9-833a-831a49136507 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:49.729081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ceb54305-c9a4-48cf-987c-6f37234d963e req-9a2c528f-83ce-43c9-833a-831a49136507 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:49.793187 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ceb54305-c9a4-48cf-987c-6f37234d963e req-9a2c528f-83ce-43c9-833a-831a49136507 service nova] Creating event network-changed:c3a450aa-996e-4b42-8fbe-1c665c19e69b for instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 on n-h1-858383-16 Oct 27 09:23:49.806617 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ceb54305-c9a4-48cf-987c-6f37234d963e req-9a2c528f-83ce-43c9-833a-831a49136507 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159181 Oct 27 09:23:49.814631 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2261/4558] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:49.909553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:49.910831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:49.924071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:49.934708 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b325c3a8-7b3a-46a3-8708-bd0976291498 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1313 microversion: 2.1 time: 0.947626 Oct 27 09:23:49.943431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:49.946235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:49.947879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:49.949503 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2298/4559] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:48 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1313 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:49.953721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:49.954475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:49.958561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:49.959341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:49.967804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:49.989672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:49.990334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:49.990619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:50.000993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:50.003517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:50.004801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:50.730488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:50.740705 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-630c31a6-9c92-49f7-aff1-f5b24d35a952 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.789850 Oct 27 09:23:50.741793 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2299/4560] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:49 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:50.748240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:50.749166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:50.772908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:50.774576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:50.775246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:50.776392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:50.777613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:50.778251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:50.784856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:50.794784 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c2fbcf47-3832-4524-a883-65d62f098819 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 0.889947 Oct 27 09:23:50.801376 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2262/4561] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:49 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:50.808116 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] HTTP exception thrown: Instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e could not be found. Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Request method failure captured: Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e HTTP/1.1 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkzDycu2zrvEyACIIrQoHV06Jd0It45Rv0F2xQOPM2wSnWHcd2-qrADZYvnaOYh5v8cskDBIeRUmgZuL2fU3btGeQcZ_Q6fTjrMtyd25Sz9aShgYNBtDFz-Hs50Qjx2g1J9zbfldbysO0umRvOL_OrzT1jkVjcfTyFj5P-3m0Jht0Qc Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e28707cf49b24806879ae5acd0e08cf3"}]}] Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c6165562b6e14ff18dc7d82b8c9a46b3 Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e could not be found. Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e'} Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e could not be found. Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e could not be found. Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:50.811208 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e could not be found. Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Returning 404 to user: Instance 9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:23:50.816662 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f584e834-2ef1-4dd5-81f4-7b4f43a304c1 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e" status: 404 len: 111 microversion: 2.1 time: 0.072835 Oct 27 09:23:50.819725 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2300/4562] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:50 2022] GET /compute/v2.1/servers/9f951bc9-b563-4e3d-a3e8-0b6c88d95c1e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:23:50.833961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04bc4540-3c00-4e32-b159-a63d0888274b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '.version_select at 0x7f31a992c790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:50.890750 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04bc4540-3c00-4e32-b159-a63d0888274b tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-923000103" status: 202 len: 0 microversion: 2.1 time: 0.064406 Oct 27 09:23:50.894602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2263/4563] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:23:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-923000103 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:23:50.972089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:50.972783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:50.984057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:50.988586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:50.993854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:50.997734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:51.001134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:51.003207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:51.652278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:51.668890 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1e01883-376b-4086-9c5f-db3906e560bd tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1313 microversion: 2.1 time: 0.701115 Oct 27 09:23:51.669676 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2301/4564] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:50 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:51.768258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:51.769290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:51.785346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:51.786568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:51.787707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:51.789670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:51.792797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:51.794769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:51.825306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:51.825919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:51.858474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:51.864039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:51.865021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:51.865792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:51.866947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:51.868158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:52.643534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:52.654771 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b589c44d-e337-4377-a6b6-2e480036d642 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.891449 Oct 27 09:23:52.655355 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2264/4565] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:51 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:52.697696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:52.698148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:52.713719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:52.714210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:52.716932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:52.720151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:52.721408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:52.724281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:52.867737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:52.877757 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f75c0e3a-558f-4def-b864-eee647871d29 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 1.056949 Oct 27 09:23:52.885900 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2302/4566] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:51 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:53.144115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-998f2f19-87db-46ef-af22-09d39df2bbea req-1391e321-2635-49cf-b991-006531d1728f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4462107f-9d4a-45b1-9080-8622fcef51d5", "tag": "a4bef84f-f781-4b55-9641-ab7e808a856e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:53.157751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-998f2f19-87db-46ef-af22-09d39df2bbea req-1391e321-2635-49cf-b991-006531d1728f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:53.159691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-998f2f19-87db-46ef-af22-09d39df2bbea req-1391e321-2635-49cf-b991-006531d1728f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:53.164243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-998f2f19-87db-46ef-af22-09d39df2bbea req-1391e321-2635-49cf-b991-006531d1728f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:53.222550 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-998f2f19-87db-46ef-af22-09d39df2bbea req-1391e321-2635-49cf-b991-006531d1728f service nova] Creating event network-changed:a4bef84f-f781-4b55-9641-ab7e808a856e for instance 4462107f-9d4a-45b1-9080-8622fcef51d5 on n-h2-858383-16 Oct 27 09:23:53.242865 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-998f2f19-87db-46ef-af22-09d39df2bbea req-1391e321-2635-49cf-b991-006531d1728f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108326 Oct 27 09:23:53.246772 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2303/4567] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:53.682688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:53.683438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:53.701682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:53.706748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:53.707473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:53.708406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:53.709036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:53.709634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:53.864698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:53.875990 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc12c999-c28c-4754-a43c-55e847161262 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1313 microversion: 2.1 time: 1.182839 Oct 27 09:23:53.904325 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2265/4568] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:52 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1313 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:53.916148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:53.917160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:53.923884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:53.924912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:53.934288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:53.935370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:53.936407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:53.937317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:54.442767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:54.469214 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2284b8de-805f-4e85-a88f-b680c903070d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.790605 Oct 27 09:23:54.491602 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2304/4569] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:53 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:54.843133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:54.862212 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6784eca5-c0aa-4b67-94ae-37762fe333aa tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 0.954548 Oct 27 09:23:54.863446 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2266/4570] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:53 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:54.919251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:54.920028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:54.934202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:54.940243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:54.943335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:54.950096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:54.951488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:54.955649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:55.457037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:55.490424 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e95a0d56-50c9-4d16-afdc-98c0f8a24912 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1313 microversion: 2.1 time: 0.575614 Oct 27 09:23:55.495155 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2305/4571] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:54 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:55.518980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:55.519625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:55.527682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:55.528184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:55.528631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:55.529356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:55.529820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:55.530253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:55.906601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:55.908723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:55.928840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:55.930967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:55.931679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:55.935505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:55.937561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:55.939619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:56.544718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:56.546050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:56.554793 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1fe96aec-88f2-47e4-aab0-1b78fde486a8 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 0.662531 Oct 27 09:23:56.555754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2306/4572] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:55 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:56.561506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:56.562561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:56.569026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:56.569888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:56.570523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:56.571412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:56.572069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:56.572246 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4c868171-c21a-480a-b1ce-d448d1b69c8b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 1.062747 Oct 27 09:23:56.572797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:56.588469 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2267/4573] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:55 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:57.392491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:57.409730 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f19be320-3d80-4183-bd0d-aa1899524b67 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1313 microversion: 2.1 time: 0.850838 Oct 27 09:23:57.417512 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2307/4574] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:56 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1313 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:57.584863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:57.586114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:57.602463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:57.604218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:57.618847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:57.633154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:57.638530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:57.638767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:57.638767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:57.641410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:57.642439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:57.643650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:57.646097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:57.652652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:57.656058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:57.656528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:58.201699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:58.217341 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1476f07-58f7-4f8d-88ff-be62707ce1f3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 0.637269 Oct 27 09:23:58.219879 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2268/4575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:57 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:58.396760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:58.400051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:23:58.413763 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d6ef9c2f-f783-420a-bbeb-93e0a955836f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.814504 Oct 27 09:23:58.417589 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2308/4576] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:57 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:23:58.442943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:58.444079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:58.470267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:58.473515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:58.475697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:58.480651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:58.482088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:58.483519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:58.969134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:58.986389 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2da8bbf-1b7e-451c-91ae-75bbe2984dd9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1313 microversion: 2.1 time: 0.549944 Oct 27 09:23:58.989650 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2269/4577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:58 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:59.247541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:59.248926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:59.266103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:59.267221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:59.268157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:59.269154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:59.272158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:59.272870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:59.444151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:23:59.445140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:23:59.458493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:59.459407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:59.460123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:59.461871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:59.466129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:59.469365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:59.585130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:59.620613 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ece67276-8866-4777-a1f7-9c794782f50a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 0.371407 Oct 27 09:23:59.623399 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2309/4578] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:59 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:23:59.720798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e816a99d-d8cb-401c-94b9-621ff848b216 req-0ce01e9a-eb7b-4acd-8ca3-36ff4af20fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389f74c5-88ab-43cb-86d5-0ea1b4309ef4", "name": "network-vif-plugged", "status": "completed", "tag": "c3a450aa-996e-4b42-8fbe-1c665c19e69b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:23:59.736762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e816a99d-d8cb-401c-94b9-621ff848b216 req-0ce01e9a-eb7b-4acd-8ca3-36ff4af20fe8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:23:59.737453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e816a99d-d8cb-401c-94b9-621ff848b216 req-0ce01e9a-eb7b-4acd-8ca3-36ff4af20fe8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:23:59.738180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e816a99d-d8cb-401c-94b9-621ff848b216 req-0ce01e9a-eb7b-4acd-8ca3-36ff4af20fe8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:23:59.760538 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e816a99d-d8cb-401c-94b9-621ff848b216 req-0ce01e9a-eb7b-4acd-8ca3-36ff4af20fe8 service nova] Creating event network-vif-plugged:c3a450aa-996e-4b42-8fbe-1c665c19e69b for instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 on n-h1-858383-16 Oct 27 09:23:59.768330 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e816a99d-d8cb-401c-94b9-621ff848b216 req-0ce01e9a-eb7b-4acd-8ca3-36ff4af20fe8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055338 Oct 27 09:23:59.770664 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2310/4579] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:23:59.897505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:23:59.912013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46e852da-8887-4e40-877d-daefdf4524c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.471581 Oct 27 09:23:59.938174 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2270/4580] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:23:59 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:00.017087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:00.018778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:00.034321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:00.035338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:00.037721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:00.040047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:00.042490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:00.043836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:00.456882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:00.474556 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4163aa42-22f4-4955-ae9d-fa3d66d449a5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1313 microversion: 2.1 time: 0.463543 Oct 27 09:24:00.476323 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2311/4581] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:00 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:00.650145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:00.650773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:00.670395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:00.672143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:00.718564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:00.719347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:00.719856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:00.731854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:00.949070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:00.949916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:00.960650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:00.963541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:00.964759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:00.965775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:00.967862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:00.971422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:02.474673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:02.486737 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7894aec1-73b9-4ab8-b2b2-94c090dc34ea tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 1.841250 Oct 27 09:24:02.506635 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2271/4582] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:00 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:02.511691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:02.512322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:02.514328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:02.538658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:02.539406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:02.540120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:02.541058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:02.541694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:02.542864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:02.548988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:02.558252 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4986f2bf-8724-44b8-9776-bf26f33f2344 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 1.614010 Oct 27 09:24:02.570997 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2312/4583] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:00 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:03.039555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:03.053718 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9b2359d-5703-4d4b-95e3-e9f765257c59 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1501 microversion: 2.1 time: 0.542052 Oct 27 09:24:03.054594 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2272/4584] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:02 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1501 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:03.081812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:03.083194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:03.090730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:03.091624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:03.092293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:03.093489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:03.094202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:03.094862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:03.137509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lazy-loading 'flavor' on Instance uuid 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:24:03.477104 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db67f633-2af6-4b49-a81f-5ff3afc6004f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4/action" status: 202 len: 0 microversion: 2.1 time: 0.400621 Oct 27 09:24:03.478404 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2313/4585] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:24:03 2022] POST /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:24:03.492654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:03.498493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:03.506957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:03.524238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:03.525273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:03.530379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:03.542635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:03.544473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:03.549964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:03.550585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:03.562298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:03.565081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:03.568823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:03.572736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:03.581221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:03.581982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:04.402650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:04.419111 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6558a74-f0a0-4d59-b04e-565f90b3cd2f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.933406 Oct 27 09:24:04.422080 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2273/4586] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:03 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:04.430592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:04.436082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:04.451717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:04.455195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:04.456106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:04.457128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:04.458228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:04.463178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:04.464956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:04.477760 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-36d02450-1a3b-4032-a13d-bf4d2d752903 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 0.966405 Oct 27 09:24:04.478364 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2314/4587] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:03 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:04.768739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:04.778162 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8aa432a-fdcb-4b35-bfcc-3ec44301db16 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.354537 Oct 27 09:24:04.782332 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2274/4588] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:04 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:05.455325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:05.456015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:05.487354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:05.489417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:05.491131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:05.492124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:05.496104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:05.498340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:05.505069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:05.506356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:05.534027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:05.534993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:05.538056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:05.548155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:05.556638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:05.557502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:06.036356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:06.047810 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f6e9aa8-2605-4cd0-a7d4-5b806c428219 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.600475 Oct 27 09:24:06.048427 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2315/4589] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:05 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:06.110948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:06.120251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:06.127442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:06.134786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:06.140111 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6c1de7d-2b59-4bb2-8261-555102d84ed4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 0.638956 Oct 27 09:24:06.140720 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2275/4590] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:05 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:06.165501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:06.170792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:06.172930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:06.173712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:06.174178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:06.174601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:06.622886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:06.624354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:06.643460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:06.648989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:06.649479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:06.650299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:06.650779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:06.651318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:06.665998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:06.696587 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-708b9955-f0ae-431a-a694-c15986c59817 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.623954 Oct 27 09:24:06.701130 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2316/4591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:06 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:06.743153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:24:06.760845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:07.040601 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b21a6ad-19dc-41a4-9d8e-3c024598a25c tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 204 len: 0 microversion: 2.1 time: 0.420676 Oct 27 09:24:07.048759 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2276/4592] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:24:06 2022] DELETE /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:24:07.058668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:07.060360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:07.087049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:07.087863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:07.093706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:07.094096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:07.094649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:07.095409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:07.108687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:07.109207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:07.110742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:07.111256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:07.117264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:07.118219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:07.118723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:07.119174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:08.228923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:08.257720 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7d3422d-ccd1-4a6d-81b5-e9bd8afc73c7 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1507 microversion: 2.1 time: 1.208424 Oct 27 09:24:08.272594 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2317/4593] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:07 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1507 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:08.302386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:08.304092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:08.352574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:08.353469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:08.354762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:08.356005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:08.356728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:08.357830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:08.661885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:08.699799 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77be57cd-759b-47cc-955d-009c32e48c00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 1.616777 Oct 27 09:24:08.721338 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2277/4594] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:07 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:08.729895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:08.749588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:08.783607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:08.784465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:08.814996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:08.816029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:08.819843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:08.820588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:09.381036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:09.400407 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-156fa99b-47e1-4b34-ae6d-05cda82acc7d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.683271 Oct 27 09:24:09.402008 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2278/4595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:08 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:09.426084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:09.440819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:09.482375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:09.493235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:09.495719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:09.498828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:09.500475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:09.503191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:09.967209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:09.983514 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aad9d5c2-4805-41a2-8e5e-7fa2a76eb770 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 1.709163 Oct 27 09:24:10.005993 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2318/4596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:08 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:10.023453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:10.024558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:10.041917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:10.042905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:10.043667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:10.046139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:10.047307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:10.048083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:10.148775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:10.169392 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ac3a1f5-28f2-472e-a458-d21246ad5382 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1507 microversion: 2.1 time: 0.763413 Oct 27 09:24:10.170548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2279/4597] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:09 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1507 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:10.325894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:10.344118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8bc357a5-a218-48d2-a5de-1c169da3d289 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.329449 Oct 27 09:24:10.348233 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2319/4598] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:10 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:10.456481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:10.457642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:10.504766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:10.509332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:10.509332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:10.513552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:10.515430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:10.519186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:10.919954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f9810b2f-4ec9-4020-962a-b7a3715a84b2 req-a20ed88a-1415-4dcc-a377-e7d26c0a989d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c16fd28-a6c7-4c72-910f-088304530f41", "name": "network-vif-deleted", "tag": "4e31cc7a-ff3f-4251-ad1b-73e40bd34df4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:10.988799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f9810b2f-4ec9-4020-962a-b7a3715a84b2 req-a20ed88a-1415-4dcc-a377-e7d26c0a989d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:10.992743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f9810b2f-4ec9-4020-962a-b7a3715a84b2 req-a20ed88a-1415-4dcc-a377-e7d26c0a989d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:10.992743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f9810b2f-4ec9-4020-962a-b7a3715a84b2 req-a20ed88a-1415-4dcc-a377-e7d26c0a989d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:11.090121 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f9810b2f-4ec9-4020-962a-b7a3715a84b2 req-a20ed88a-1415-4dcc-a377-e7d26c0a989d service nova] Creating event network-vif-deleted:4e31cc7a-ff3f-4251-ad1b-73e40bd34df4 for instance 3c16fd28-a6c7-4c72-910f-088304530f41 on n-h2-858383-16 Oct 27 09:24:11.121003 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f9810b2f-4ec9-4020-962a-b7a3715a84b2 req-a20ed88a-1415-4dcc-a377-e7d26c0a989d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215008 Oct 27 09:24:11.129343 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2320/4599] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:24:11.167513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:11.168279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:11.193070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:11.199443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:11.201154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:11.204882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:11.205369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:11.216956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:11.231102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:11.248426 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f1b7c38-9df9-45d8-8794-a10cc9807917 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.802232 Oct 27 09:24:11.249342 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2280/4600] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:10 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:11.258632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:11.261129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:11.280640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:11.282339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:11.283349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:11.286842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:11.287976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:11.290234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:11.421251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:11.425416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:11.427269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:11.431231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lazy-loading 'fault' on Instance uuid 3c16fd28-a6c7-4c72-910f-088304530f41 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:24:11.601350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:11.615498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b89031b-5f8f-48aa-9332-9e810207f9a9 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 200 len: 1312 microversion: 2.1 time: 0.363222 Oct 27 09:24:11.617344 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2281/4601] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:11 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:11.634736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:11.636065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:11.653782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:11.654364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:11.660369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:11.661171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:11.661662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:11.662332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:11.784483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:11.807120 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d7ef857-1261-44d0-807d-70b8a5bf6c94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1504 microversion: 2.1 time: 0.658527 Oct 27 09:24:11.814392 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2321/4602] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:11 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1504 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:12.206198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:12.219670 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f2edb3d-880a-422f-848b-f81ae89fd3ef tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.597084 Oct 27 09:24:12.240981 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2282/4603] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:11 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:12.276478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:12.277820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:12.302546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:12.303417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:12.304237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:12.305249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:12.305999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:12.306689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:12.597314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:12.606913 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43c8f2a4-e183-4852-b08e-db0e3355db17 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.334825 Oct 27 09:24:12.607861 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2322/4604] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:12 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:12.646809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:12.647665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 3c16fd28-a6c7-4c72-910f-088304530f41] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:12.665125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:12.667925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:12.669540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:12.672212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:12.672970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:12.674376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:12.721795 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] HTTP exception thrown: Instance 3c16fd28-a6c7-4c72-910f-088304530f41 could not be found. Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Request method failure captured: Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 HTTP/1.1 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzDycu2zrvEyACIIrQoHV06Jd0It45Rv0F2xQOPM2wSnWHcd2-qrADZYvnaOYh5v8cskDBIeRUmgZuL2fU3btGeQcZ_Q6fTjrMtyd25Sz9aShgYNBtDFz-Hs50Qjx2g1J9zbfldbysO0umRvOL_OrzT1jkVjcfTyFj5P-3m0Jht0Qc Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e28707cf49b24806879ae5acd0e08cf3"}]}] Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c6165562b6e14ff18dc7d82b8c9a46b3 Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 3c16fd28-a6c7-4c72-910f-088304530f41 could not be found. Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '3c16fd28-a6c7-4c72-910f-088304530f41'} Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c16fd28-a6c7-4c72-910f-088304530f41 could not be found. Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c16fd28-a6c7-4c72-910f-088304530f41 could not be found. Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:12.724413 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:24:12.729917 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:12.729917 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:24:12.729917 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:24:12.729917 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:24:12.729917 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:24:12.729917 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:24:12.729917 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c16fd28-a6c7-4c72-910f-088304530f41 could not be found. Oct 27 09:24:12.729917 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:12.735682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Returning 404 to user: Instance 3c16fd28-a6c7-4c72-910f-088304530f41 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:24:12.737052 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cca05d4a-a7fb-436e-bd63-a82dfe0f67bb tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41" status: 404 len: 111 microversion: 2.1 time: 0.097197 Oct 27 09:24:12.740403 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2283/4605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:12 2022] GET /compute/v2.1/servers/3c16fd28-a6c7-4c72-910f-088304530f41 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:24:12.747829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:12.748290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:12.758838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:12.759357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:12.759825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:12.760619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:12.767957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:12.768146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:12.825607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:24:12.838639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:12.839842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:12.851289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:12.852258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:12.852945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:12.859854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:12.860908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:12.861602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:12.909732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:12.988398 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2756e070-91f1-464d-b684-1625fd2b7d95 tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 204 len: 0 microversion: 2.1 time: 0.245708 Oct 27 09:24:12.989575 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2323/4606] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:24:12 2022] DELETE /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:24:13.002739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:13.004117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:13.012164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:13.013734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:13.014503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:13.015551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:13.017197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:13.018103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:13.286969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:13.366224 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ba0c9614-721a-4e30-85aa-eb955f321876 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1484 microversion: 2.1 time: 0.524542 Oct 27 09:24:13.368025 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2284/4607] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:12 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1484 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:13.397379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:13.402914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:13.430569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:13.433412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:13.440744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:13.451840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:13.453809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:13.455345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:13.517631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:13.550320 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1f37a22b-16a7-43dd-ae48-eab13f0f36fe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 0.548671 Oct 27 09:24:13.551416 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2324/4608] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:12 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:13.637704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:13.638713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:13.697060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:13.697568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:13.698050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:13.698836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:13.699308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:13.727813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:14.000021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:14.015910 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-804b49bb-3b06-4603-b8cc-8f6286ccf735 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.638512 Oct 27 09:24:14.016515 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2285/4609] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:13 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:14.029175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1730280192", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:14.032391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:14.041260 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bb98f0eb-0a5d-4743-bcfe-f82f523a3a36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.408664 Oct 27 09:24:14.054634 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2325/4610] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:13 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:14.128603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] validate_networks() for [('cac8cbb1-5a77-4d45-8703-8379a207158b', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:24:14.579065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:14.579709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:14.593284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:14.594218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:14.594967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:14.595987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:14.601084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:14.601850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:15.740234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:15.768848 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f29ffebb-f5b2-439e-8e4c-ba320c1787ed tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 1.193615 Oct 27 09:24:15.770084 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2326/4611] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:14 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:15.775084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:15.776540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:15.792746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:15.793543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:15.794281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:15.795238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:15.797202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:15.797875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:16.623885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:24:16.624696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:24:16.625331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:24:16.626546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:24:16.627728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:24:16.659205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:16.661685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:16.662533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:16.663980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:16.664853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:16.665920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:16.739994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Getting quotas for project 66e0305f59424209ba883e5c0d6a832b. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:24:16.766345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Getting quotas for user dd48e1cf5d1542cd9688c13aa2d9ef0d and project 66e0305f59424209ba883e5c0d6a832b. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:24:16.800314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:24:16.806475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:24:16.921002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:16.924292 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82f4d4f1-29ee-4853-a92a-ee7f2efb9943 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.898956 Oct 27 09:24:16.926134 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2286/4612] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:24:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:24:16.936813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:16.938570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:16.947024 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb791bdb-fc07-45e8-b5d3-f449ea76e5f7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 1.175492 Oct 27 09:24:16.948701 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2327/4613] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:15 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:16.958922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:16.959261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:16.961049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:16.966141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:16.966975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:16.968339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:16.969138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:16.969871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:16.989528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:16.994639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:16.995402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:16.996708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:16.997486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:17.010782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:17.557766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:17.573014 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd4851fa-2a2c-4923-9508-921896b2844b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 0.643612 Oct 27 09:24:17.575969 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2287/4614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:16 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:17.585925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74a2ebca-13cf-4b45-9739-98d09f920710 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:17.586905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-74a2ebca-13cf-4b45-9739-98d09f920710 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:17.887403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-74a2ebca-13cf-4b45-9739-98d09f920710 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:17.905861 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-74a2ebca-13cf-4b45-9739-98d09f920710 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1214 microversion: 2.1 time: 0.325796 Oct 27 09:24:17.908738 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2288/4615] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:17 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1214 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:17.918438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-046fe351-66b0-4b3f-b1c7-a8bbad12f5ba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:17.939930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-046fe351-66b0-4b3f-b1c7-a8bbad12f5ba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:17.957714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-046fe351-66b0-4b3f-b1c7-a8bbad12f5ba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:17.958631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-046fe351-66b0-4b3f-b1c7-a8bbad12f5ba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:17.959323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-046fe351-66b0-4b3f-b1c7-a8bbad12f5ba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:17.960368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-046fe351-66b0-4b3f-b1c7-a8bbad12f5ba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:17.961140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-046fe351-66b0-4b3f-b1c7-a8bbad12f5ba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:17.964152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-046fe351-66b0-4b3f-b1c7-a8bbad12f5ba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:18.067660 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-046fe351-66b0-4b3f-b1c7-a8bbad12f5ba tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "POST /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5/action" status: 200 len: 24569 microversion: 2.1 time: 0.157173 Oct 27 09:24:18.067840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6165562b6e14ff18dc7d82b8c9a46b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28707cf49b24806879ae5acd0e08cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:18.068519 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2289/4616] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:24:17 2022] POST /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5/action => generated 24569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:24:18.078699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:18.083693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:18.102216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:18.105058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:18.108821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:18.110798 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e3f6bf6-07b9-4abf-9e81-fdda69e85d8f tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 200 len: 1522 microversion: 2.1 time: 1.159512 Oct 27 09:24:18.111961 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2328/4617] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:16 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 1522 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:18.112561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:18.113774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:18.116276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:18.544547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-17ab5ca9-ae6c-4231-982d-bd5b7e94bfcc req-513fdc38-fbff-4e8a-8412-b4ed93b2bcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c62c154-2d25-411b-9e5c-fc0195fed8f0", "name": "network-vif-deleted", "tag": "10d32d18-dfe2-4f10-9b9a-84d2ab8bb20b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:18.617277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-17ab5ca9-ae6c-4231-982d-bd5b7e94bfcc req-513fdc38-fbff-4e8a-8412-b4ed93b2bcb9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:18.622988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-17ab5ca9-ae6c-4231-982d-bd5b7e94bfcc req-513fdc38-fbff-4e8a-8412-b4ed93b2bcb9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:18.623878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-17ab5ca9-ae6c-4231-982d-bd5b7e94bfcc req-513fdc38-fbff-4e8a-8412-b4ed93b2bcb9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:18.714751 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-17ab5ca9-ae6c-4231-982d-bd5b7e94bfcc req-513fdc38-fbff-4e8a-8412-b4ed93b2bcb9 service nova] Creating event network-vif-deleted:10d32d18-dfe2-4f10-9b9a-84d2ab8bb20b for instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 on n-h1-858383-16 Oct 27 09:24:18.751006 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-17ab5ca9-ae6c-4231-982d-bd5b7e94bfcc req-513fdc38-fbff-4e8a-8412-b4ed93b2bcb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220888 Oct 27 09:24:18.754211 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2329/4618] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:24:18.800280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:18.812701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:18.844578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:18.845071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:18.845537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:18.846470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:18.847051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:18.847534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:18.860349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:18.931881 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-baa826c0-80f1-4ea9-9f66-e5df9fc4873a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.859888 Oct 27 09:24:18.951630 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2290/4619] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:18 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:18.972804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:18.981554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:19.019683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:19.022026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:19.028267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:19.032494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:19.033316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:19.036225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:19.913308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:19.927009 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60d11e8b-282c-47d2-9d3b-232d62b94db3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1266 microversion: 2.1 time: 0.982474 Oct 27 09:24:19.928925 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2291/4620] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:18 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1266 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:19.947510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:19.955988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] [instance: 7c62c154-2d25-411b-9e5c-fc0195fed8f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:19.976517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:19.977927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:19.978414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:19.980487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:19.980899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:19.983687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:20.032919 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] HTTP exception thrown: Instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 could not be found. Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Request method failure captured: Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 HTTP/1.1 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWkzDycu2zrvEyACIIrQoHV06Jd0It45Rv0F2xQOPM2wSnWHcd2-qrADZYvnaOYh5v8cskDBIeRUmgZuL2fU3btGeQcZ_Q6fTjrMtyd25Sz9aShgYNBtDFz-Hs50Qjx2g1J9zbfldbysO0umRvOL_OrzT1jkVjcfTyFj5P-3m0Jht0Qc Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e28707cf49b24806879ae5acd0e08cf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e28707cf49b24806879ae5acd0e08cf3"}]}] Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: e28707cf49b24806879ae5acd0e08cf3 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1215208339 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c6165562b6e14ff18dc7d82b8c9a46b3 Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1215208339-project Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 could not be found. Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7c62c154-2d25-411b-9e5c-fc0195fed8f0'} Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 could not be found. Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 could not be found. Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:20.037830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:24:20.042629 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:20.042629 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:24:20.042629 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:24:20.042629 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:24:20.042629 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:24:20.042629 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:24:20.042629 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 could not be found. Oct 27 09:24:20.042629 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:24:20.042629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] Returning 404 to user: Instance 7c62c154-2d25-411b-9e5c-fc0195fed8f0 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:24:20.043785 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51177840-bc7d-4e1e-8c35-bdf4f2926dbe tempest-ServerRescueNegativeTestJSON-1215208339 tempest-ServerRescueNegativeTestJSON-1215208339-project] 10.222.0.25 "GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0" status: 404 len: 111 microversion: 2.1 time: 0.105222 Oct 27 09:24:20.050443 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2292/4621] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:19 2022] GET /compute/v2.1/servers/7c62c154-2d25-411b-9e5c-fc0195fed8f0 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:24:20.067187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:20.069721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:20.079128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:20.080114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:20.080821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:20.082460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:20.083145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:20.083904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:20.482428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:20.524105 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4075d6ed-2ef1-4efa-9c3f-40e6f803842a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 1.762397 Oct 27 09:24:20.539602 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2330/4622] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:18 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:20.966567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:20.967609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:20.990183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:20.993734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:20.997138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:21.000792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:21.005638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:21.007677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:21.413447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:21.463654 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5947606d-20e9-4b76-adc1-22937fe86666 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 1.408632 Oct 27 09:24:21.467281 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2293/4623] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:20 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:21.563035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:21.565282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:21.591210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:21.596832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:21.599007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:21.605509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:21.609174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:21.611619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:21.695798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:21.717266 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-20fdaa6f-3713-4e1d-9039-3166c74e5b89 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1272 microversion: 2.1 time: 0.750511 Oct 27 09:24:21.727708 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2331/4624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:20 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1272 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:22.490334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:22.491480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:22.499346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:22.500169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:22.500811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:22.502723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:22.506686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:22.507509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:22.877710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:22.890053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:22.893946 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ed9afd0b-6bfa-4f46-89c6-5ea152b1e091 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1680 microversion: 2.1 time: 1.343888 Oct 27 09:24:22.899543 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2294/4625] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:21 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1680 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:22.904685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:22.905350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:22.926253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:22.926759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:22.929421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:22.930554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:22.935428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:22.936444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:23.161516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:23.175352 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a679896-4455-4822-9264-835694aec6e9 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1272 microversion: 2.1 time: 0.272394 Oct 27 09:24:23.178167 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2295/4626] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:22 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:23.201514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:23.218001 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9116bc9d-c0d6-44fc-9fe5-d5b494a4066c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.731766 Oct 27 09:24:23.235744 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2332/4627] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:22 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:23.938770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:23.939807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:23.967671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:23.971948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:23.972904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:23.976436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:23.977549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:23.979137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:24.213703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:24.214340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:24.227741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:24.228018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:24.228513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:24.238390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:24.239108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:24.239719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:24.772041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:24.803596 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-84042b6f-625d-4ff0-b648-97e2b2b52d59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.868495 Oct 27 09:24:24.810315 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2296/4628] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:23 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:24.831876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:24.833223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:24.857941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:24.860885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:24.864598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:24.868675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:24.891438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:24.896454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:24.912998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:24.942759 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-121e23e4-8d8c-4fd9-aacc-290724d23d75 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1314 microversion: 2.1 time: 0.736168 Oct 27 09:24:24.946731 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2333/4629] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:24 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:25.032878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:25.033861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:25.040948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:25.041780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:25.042500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:25.043428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:25.044092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:25.044734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:25.570766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:25.588490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:25.590995 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-179b13a6-e7e0-452d-ae91-2221e801de00 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.775796 Oct 27 09:24:25.591720 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2297/4630] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:24 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:25.624075 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d909a26-0ee2-4482-834e-b4f8a0167cf7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.595956 Oct 27 09:24:25.647127 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2334/4631] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:25 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:25.992431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:25.993052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:26.003431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:26.008945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:26.010007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:26.011412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:26.012106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:26.012736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:26.617788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:26.618433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:26.636710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:26.637247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:26.637690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:26.638412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:26.638870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:26.639287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:26.702708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:27.594762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:27.602917 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54b4018b-5b78-43bf-8834-c0dd503fc561 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1314 microversion: 2.1 time: 1.614965 Oct 27 09:24:27.621418 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2298/4632] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:25 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1314 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:27.680128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:27.701937 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83c3534a-110a-4fff-b0af-91c70004cf1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 1.088102 Oct 27 09:24:27.702607 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2335/4633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:26 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:28.116452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:28.118074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:28.122200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:28.138976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:28.139481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:28.142285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:28.143142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:28.143738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:28.144075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:28.211617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b26e6268-1055-4cb8-902b-4891e3cbe902 req-4a94c509-da58-4fa9-b8a8-f6762f539ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b108df-4352-4265-a2cf-d1c1320c7323", "tag": "bd9e92af-96e6-478c-8c6d-9713d08b0d9b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:28.246743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b26e6268-1055-4cb8-902b-4891e3cbe902 req-4a94c509-da58-4fa9-b8a8-f6762f539ad6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:28.246743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b26e6268-1055-4cb8-902b-4891e3cbe902 req-4a94c509-da58-4fa9-b8a8-f6762f539ad6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:28.246743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b26e6268-1055-4cb8-902b-4891e3cbe902 req-4a94c509-da58-4fa9-b8a8-f6762f539ad6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:28.269810 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b26e6268-1055-4cb8-902b-4891e3cbe902 req-4a94c509-da58-4fa9-b8a8-f6762f539ad6 service nova] Creating event network-changed:bd9e92af-96e6-478c-8c6d-9713d08b0d9b for instance d1b108df-4352-4265-a2cf-d1c1320c7323 on n-h2-858383-16 Oct 27 09:24:28.285250 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b26e6268-1055-4cb8-902b-4891e3cbe902 req-4a94c509-da58-4fa9-b8a8-f6762f539ad6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075952 Oct 27 09:24:28.285908 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2336/4634] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:24:28.563892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8d3db11e-22d0-46a1-b32a-5b94f7d15f39 req-642cf3bc-ccdd-4f5f-9fbd-9dffe2782c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "name": "network-vif-unplugged", "status": "completed", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:28.606822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d3db11e-22d0-46a1-b32a-5b94f7d15f39 req-642cf3bc-ccdd-4f5f-9fbd-9dffe2782c37 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:28.608732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d3db11e-22d0-46a1-b32a-5b94f7d15f39 req-642cf3bc-ccdd-4f5f-9fbd-9dffe2782c37 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:28.609053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d3db11e-22d0-46a1-b32a-5b94f7d15f39 req-642cf3bc-ccdd-4f5f-9fbd-9dffe2782c37 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:28.644438 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8d3db11e-22d0-46a1-b32a-5b94f7d15f39 req-642cf3bc-ccdd-4f5f-9fbd-9dffe2782c37 service nova] Creating event network-vif-unplugged:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:24:28.659504 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8d3db11e-22d0-46a1-b32a-5b94f7d15f39 req-642cf3bc-ccdd-4f5f-9fbd-9dffe2782c37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100841 Oct 27 09:24:28.662973 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2337/4635] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:24:28.685993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:28.688662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:28.720097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:28.721805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:28.722138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:28.724006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:28.727669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:28.728929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:29.177772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:29.192547 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a41a19e-44c1-4846-8fbd-aecdf26b0b30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 1.082176 Oct 27 09:24:29.194712 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2299/4636] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:28 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:29.205619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:29.206847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:29.225844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:29.229230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:29.229922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:29.232403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:29.234771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:29.236499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:29.382486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:29.395377 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3862b4e4-04eb-4a9a-98a1-a8096eafb0a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1314 microversion: 2.1 time: 0.729336 Oct 27 09:24:29.399018 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2338/4637] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:28 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1314 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:29.410588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:29.411261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:29.428537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:29.428537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:29.428537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:29.428537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:29.428537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:29.428537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:29.921520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:29.930998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:29.938621 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2399af0b-b156-4ef5-b863-16e62571bd68 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.740781 Oct 27 09:24:29.951635 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2300/4638] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:29 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:29.967010 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-282457ed-577c-410e-8865-139005e02279 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.566413 Oct 27 09:24:29.986250 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2339/4639] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:29 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:29.991277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:29.991988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:30.004854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:30.005866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:30.006319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:30.010714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:30.011619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:30.012367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:30.419998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:30.427337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:30.428571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:30.432710 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c92db263-2b0e-40ad-9b31-277644ed7015 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.445885 Oct 27 09:24:30.434617 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2301/4640] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:29 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:30.465709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:30.467267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:30.469940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:30.474231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:30.475732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:30.479340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:30.483282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-612324d5-04e1-4049-8e7d-df6ba8a62e8f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:30.491727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-612324d5-04e1-4049-8e7d-df6ba8a62e8f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:30.531057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-612324d5-04e1-4049-8e7d-df6ba8a62e8f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:30.531436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-612324d5-04e1-4049-8e7d-df6ba8a62e8f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:30.532139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-612324d5-04e1-4049-8e7d-df6ba8a62e8f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:30.532930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-612324d5-04e1-4049-8e7d-df6ba8a62e8f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:30.533564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-612324d5-04e1-4049-8e7d-df6ba8a62e8f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:30.534357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-612324d5-04e1-4049-8e7d-df6ba8a62e8f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:30.746160 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-612324d5-04e1-4049-8e7d-df6ba8a62e8f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.284429 Oct 27 09:24:30.748906 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2302/4641] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:24:30 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:24:30.769538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:30.771246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:30.792924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:30.793572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:30.794221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:30.795000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:30.795767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:30.796442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:31.173318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:31.190489 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3c0da528-754c-45ab-bd68-a28a493256b4 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1314 microversion: 2.1 time: 0.768600 Oct 27 09:24:31.192707 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2340/4642] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:30 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:31.201162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:31.201899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:31.210923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:31.211560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:31.213497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:31.215091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:31.215737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:31.216284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:31.480427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:31.490342 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb53b1f1-3aa3-4435-a60b-6b1014369b19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1669 microversion: 2.1 time: 0.734398 Oct 27 09:24:31.502540 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2303/4643] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:30 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1669 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:31.908358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:31.923396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:31.938442 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-080dd6e0-1ab0-4170-811a-0a4adf9f1dea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.741571 Oct 27 09:24:31.942450 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2341/4644] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:31 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:32.224267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:32.226020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:32.239470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:32.240434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:32.241181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:32.242181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:32.242908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:32.243608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:32.516649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:32.517438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:32.534478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:32.534976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:32.535419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:32.538552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:32.541843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:32.543411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:33.130263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:33.139409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:33.152656 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3fb54114-c966-4dbe-b062-aa868858238c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1669 microversion: 2.1 time: 0.636847 Oct 27 09:24:33.155162 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2342/4645] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:32 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1669 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:33.159862 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c3ae10cb-a0cf-46ce-a1d7-3e97ea21a687 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1314 microversion: 2.1 time: 0.944401 Oct 27 09:24:33.161509 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2304/4646] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:32 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1314 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:33.163905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:33.165845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:33.179434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:33.181011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:33.182287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:33.184371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:33.186031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:33.187707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:33.555219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:33.577455 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a3cc140-8ff6-4fde-9496-b04018dbb16b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.419985 Oct 27 09:24:33.578890 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2343/4647] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:33 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:34.182470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:34.184041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:34.189223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:34.190233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:34.190967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:34.205981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:34.210173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:34.211161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:34.213589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:34.216360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:34.216598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:34.216822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:34.217420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:34.217957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:34.218088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:34.218696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:34.219311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:34.632068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:34.644573 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8767c876-b50b-4414-bfca-ea16a1d4667e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1669 microversion: 2.1 time: 0.468904 Oct 27 09:24:34.655983 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2305/4648] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:34 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1669 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:34.666422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:34.667323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:34.673818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:34.674660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:34.675313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:34.676288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:34.676999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:34.677596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:34.682233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:34.698232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5af69403-1579-466f-a68f-ad0aacd88163 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1314 microversion: 2.1 time: 0.512496 Oct 27 09:24:34.699163 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2344/4649] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:34 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:35.313283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:35.325578 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a4bf3c1-05f5-4f44-b711-40bce99703a7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1507 microversion: 2.1 time: 0.668370 Oct 27 09:24:35.342033 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2306/4650] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:34 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1507 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:35.671925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:35.672934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:35.702808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:35.706847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:35.707640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:35.711859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:35.713207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:35.714031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:35.731090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:35.731904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:35.746635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:35.748793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:35.751237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:35.756508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:35.766736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:35.767930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:36.429402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:36.444299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:36.449174 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6cc55205-1ec1-48f5-8a3f-0be93b475333 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.781365 Oct 27 09:24:36.452125 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2345/4651] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:35 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:36.463712 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b490ce6f-4a58-4d6a-ade3-9cc51a95aa36 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1314 microversion: 2.1 time: 0.736771 Oct 27 09:24:36.468634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:36.469262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:36.475167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:36.479468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:36.480028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:36.480468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:36.481282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:36.481868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:36.483054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:36.487727 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2307/4652] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:35 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:36.493510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dac205fa-68a8-4d72-b96b-2f59eded6657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:36.496696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dac205fa-68a8-4d72-b96b-2f59eded6657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:36.503931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dac205fa-68a8-4d72-b96b-2f59eded6657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:36.504994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dac205fa-68a8-4d72-b96b-2f59eded6657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:36.505715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dac205fa-68a8-4d72-b96b-2f59eded6657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:36.506826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dac205fa-68a8-4d72-b96b-2f59eded6657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:36.507471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dac205fa-68a8-4d72-b96b-2f59eded6657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:36.508170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dac205fa-68a8-4d72-b96b-2f59eded6657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:36.583334 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dac205fa-68a8-4d72-b96b-2f59eded6657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 200 len: 324 microversion: 2.1 time: 0.093995 Oct 27 09:24:36.584465 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2308/4653] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:24:36 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 324 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:24:36.599514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:36.600699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:36.621175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:36.621695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:36.622141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:36.622872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:36.623332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:36.624008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:36.834688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:36.844386 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c3840cb-884f-425f-a0c1-e4069ce03f82 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1528 microversion: 2.1 time: 0.390440 Oct 27 09:24:36.845219 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2346/4654] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:36 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1528 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:36.950122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:36.964064 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94d79274-07fb-4c7e-89bc-b7c19514a8d0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.371973 Oct 27 09:24:36.965012 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2309/4655] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:36 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:36.989012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:36.989948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:36.997254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:36.998264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:36.998817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:36.999935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:37.000722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:37.001160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:37.211186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:37.226443 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-75ed9021-7f0f-42f2-b120-de7edde183e4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.241049 Oct 27 09:24:37.227900 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2347/4656] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:36 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:37.252211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:37.253007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:37.262320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:37.262990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:37.263889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:37.264694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:37.265418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:37.265950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:37.439268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:37.442610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:37.456835 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e88cc43-5545-4a83-8135-dc344c7ce26a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.208812 Oct 27 09:24:37.458009 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2310/4657] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:37 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:37.481331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:37.481942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:37.488503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:37.496646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:37.497194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:37.497834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:37.499785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:37.500567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:37.501233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:37.501666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:37.511855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:37.512366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:37.512818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:37.513546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:37.514013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:37.514452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:37.777204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:37.792071 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e16baa57-b683-47b6-b43f-e28565ca42f0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.313460 Oct 27 09:24:37.795271 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2348/4658] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:37 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:37.813166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:37.822667 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40bf8fbd-d691-4a1e-b999-1d9a23637f76 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1314 microversion: 2.1 time: 0.332466 Oct 27 09:24:37.825490 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2311/4659] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:37 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:37.891263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:37.892376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:37.902962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:37.903490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:37.903980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:37.905819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:37.906967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:37.907759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:38.026037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-232844952", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "9cad971b-61f2-43dd-8137-4ee7400ac93f"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:38.128805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] validate_networks() for [('9cad971b-61f2-43dd-8137-4ee7400ac93f', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:24:38.330799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:38.342379 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43d3f362-bb2c-4f89-8ecb-3e934bf03453 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1528 microversion: 2.1 time: 0.459395 Oct 27 09:24:38.346687 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2349/4660] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:37 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1528 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:38.365276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6fb543e0-5ec6-4f36-8d71-6524d2d82494 req-a1ccb88a-4719-4953-9a28-889304e4f553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b108df-4352-4265-a2cf-d1c1320c7323", "name": "network-vif-plugged", "status": "completed", "tag": "bd9e92af-96e6-478c-8c6d-9713d08b0d9b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:38.394014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6fb543e0-5ec6-4f36-8d71-6524d2d82494 req-a1ccb88a-4719-4953-9a28-889304e4f553 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:38.394507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6fb543e0-5ec6-4f36-8d71-6524d2d82494 req-a1ccb88a-4719-4953-9a28-889304e4f553 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:38.395381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6fb543e0-5ec6-4f36-8d71-6524d2d82494 req-a1ccb88a-4719-4953-9a28-889304e4f553 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:38.421241 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6fb543e0-5ec6-4f36-8d71-6524d2d82494 req-a1ccb88a-4719-4953-9a28-889304e4f553 service nova] Creating event network-vif-plugged:bd9e92af-96e6-478c-8c6d-9713d08b0d9b for instance d1b108df-4352-4265-a2cf-d1c1320c7323 on n-h2-858383-16 Oct 27 09:24:38.432674 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6fb543e0-5ec6-4f36-8d71-6524d2d82494 req-a1ccb88a-4719-4953-9a28-889304e4f553 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081756 Oct 27 09:24:38.438178 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2350/4661] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:24:38.828377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:24:38.829499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:24:38.830141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:24:38.830651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1933342989", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "462a5795-35eb-49f5-aa2a-c5822300ae38"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:38.830902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:24:38.831554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:24:38.846766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:38.847642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:38.848285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:38.849422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:38.851192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:38.852089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:38.877599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:24:38.885387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for user 9301fb54a8734e1ab31e496add7e9446 and project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:24:38.906650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:24:38.909893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:24:38.942117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] validate_networks() for [('462a5795-35eb-49f5-aa2a-c5822300ae38', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:24:38.997330 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2597612a-408c-4b6a-951b-3e67d4e6e49f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975906 Oct 27 09:24:39.009740 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2312/4662] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:24:39.025442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:39.027173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:39.045635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:39.046167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:39.046601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:39.050698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:39.051527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:39.052196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:39.551362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:39.563154 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99045628-0e78-470f-83fd-753d9e66a08e tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1314 microversion: 2.1 time: 0.551863 Oct 27 09:24:39.564095 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2313/4663] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:39 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:39.576329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1e9644f8-1ca9-432d-bd87-b6023664cae0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:39.577224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1e9644f8-1ca9-432d-bd87-b6023664cae0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:39.779034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1e9644f8-1ca9-432d-bd87-b6023664cae0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:39.787255 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1e9644f8-1ca9-432d-bd87-b6023664cae0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1214 microversion: 2.1 time: 0.221869 Oct 27 09:24:39.804028 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2314/4664] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:39 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:40.002187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:24:40.003960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:24:40.006410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:24:40.006932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:24:40.007400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:24:40.040486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.040979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.041416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:40.048429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.049818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.050272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:40.098630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Getting quotas for project 94d04be7f44f4c78970ff8549a75de9e. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:24:40.112796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Getting quotas for user f23d35c82d354dbcbddfd74248baf624 and project 94d04be7f44f4c78970ff8549a75de9e. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:24:40.143452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:24:40.149748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:24:40.268743 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da662eec-c5f4-41ae-bcc1-71f0257124a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.808634 Oct 27 09:24:40.272659 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2351/4665] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:24:40.283009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:40.284015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:40.302474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.303631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.304352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:40.308150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.310739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.311889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:40.357488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1483622536", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": "none"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:40.537859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:24:40.541536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:24:40.544296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:24:40.547605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:24:40.549629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:24:40.586002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.586477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.589393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:40.593772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.594511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.597539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:40.606300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:40.616597 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8fca735a-4d02-4f55-bfa9-25e64b2a6215 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1528 microversion: 2.1 time: 0.337692 Oct 27 09:24:40.617230 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2352/4666] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:40 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1528 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:40.628271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4d189e78-556d-433c-9106-46844710f841 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:40.628892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4d189e78-556d-433c-9106-46844710f841 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:40.675498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Getting quotas for project e99e90f26af9436fac755c5bcb080363. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:24:40.711426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Getting quotas for user 4a9e9ca3f61d4fda964a390545cda87a and project e99e90f26af9436fac755c5bcb080363. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:24:40.750836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d189e78-556d-433c-9106-46844710f841 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:40.759608 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4d189e78-556d-433c-9106-46844710f841 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1215 microversion: 2.1 time: 0.138243 Oct 27 09:24:40.764146 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2353/4667] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:40 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:40.772694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:40.778404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:40.794652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:24:40.796941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:24:40.798193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.798700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.799147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:40.811846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.816465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.816929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:40.864318 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df54bfa9-af06-4730-b409-c92c358fbad5 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.060469 Oct 27 09:24:40.865698 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2315/4668] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:24:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:24:40.881408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:40.884315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:40.921287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.924836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.926907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:40.935351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:40.936369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:40.937330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:41.100094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:41.115202 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8450d248-d295-4719-9c16-16bbc7f3045f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1266 microversion: 2.1 time: 0.247901 Oct 27 09:24:41.119307 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2316/4669] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:40 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:41.132958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-962555a5-bf85-40a4-b74d-c1ab423fd065 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:41.135423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-962555a5-bf85-40a4-b74d-c1ab423fd065 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:41.318504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-962555a5-bf85-40a4-b74d-c1ab423fd065 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:41.332168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-962555a5-bf85-40a4-b74d-c1ab423fd065 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:41.362774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-962555a5-bf85-40a4-b74d-c1ab423fd065 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:41.367308 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-962555a5-bf85-40a4-b74d-c1ab423fd065 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1278 microversion: 2.57 time: 0.244331 Oct 27 09:24:41.368164 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2317/4670] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:41 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:41.383849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:41.383849 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-539693e5-e342-488d-889e-e516de0faf91 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1499 microversion: 2.1 time: 0.615530 Oct 27 09:24:41.383849 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2354/4671] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:40 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1499 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:41.406171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:41.408832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:41.419265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:41.419863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:41.420549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:41.421622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:41.422392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:41.423520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:41.457986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lazy-loading 'flavor' on Instance uuid d1b108df-4352-4265-a2cf-d1c1320c7323 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:24:41.645634 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-533b64c5-b341-4235-9a4f-d1c7fdcf6936 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "POST /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323/action" status: 200 len: 32 microversion: 2.1 time: 0.243344 Oct 27 09:24:41.648193 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2355/4672] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:24:41 2022] POST /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:24:41.664092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:41.666742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:41.702683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:41.703980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:41.710980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:41.713079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:41.716219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:41.716916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:41.718209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:41.720066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:41.750538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:41.752255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:41.756791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:41.760406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:41.761574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:41.764823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:42.339232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:42.353397 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3eb6c909-e5c3-4dc8-8959-13f2c6826f9f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.694064 Oct 27 09:24:42.354378 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2318/4673] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:41 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:42.374265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:42.382725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:42.393748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:42.407160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:42.410949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:42.411927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:42.412597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:42.414911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:42.541478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:42.574072 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-898d04cb-ab9f-4adf-9c8f-dd2d6d99d943 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1267 microversion: 2.1 time: 0.209084 Oct 27 09:24:42.576415 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2319/4674] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:42 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:42.601177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8b6daebb-734c-4b76-a512-74737cd6eaff req-bfddabf8-f262-42c5-934c-406a772bca5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389f74c5-88ab-43cb-86d5-0ea1b4309ef4", "name": "network-vif-plugged", "status": "completed", "tag": "c3a450aa-996e-4b42-8fbe-1c665c19e69b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:42.664925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8b6daebb-734c-4b76-a512-74737cd6eaff req-bfddabf8-f262-42c5-934c-406a772bca5f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:42.666441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8b6daebb-734c-4b76-a512-74737cd6eaff req-bfddabf8-f262-42c5-934c-406a772bca5f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:42.667483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8b6daebb-734c-4b76-a512-74737cd6eaff req-bfddabf8-f262-42c5-934c-406a772bca5f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:42.698662 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8b6daebb-734c-4b76-a512-74737cd6eaff req-bfddabf8-f262-42c5-934c-406a772bca5f service nova] Creating event network-vif-plugged:c3a450aa-996e-4b42-8fbe-1c665c19e69b for instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 on n-h1-858383-16 Oct 27 09:24:42.716851 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8b6daebb-734c-4b76-a512-74737cd6eaff req-bfddabf8-f262-42c5-934c-406a772bca5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137842 Oct 27 09:24:42.721405 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2320/4675] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:24:42.741669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:42.756119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:42.779091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:42.780121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:42.782263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:42.789711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:42.790781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:42.791549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:42.933537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:42.945297 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd07497f-b260-4223-94b8-1e790a00cd30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1528 microversion: 2.1 time: 1.256769 Oct 27 09:24:42.946853 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2356/4676] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:41 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1528 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:43.006738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:43.009586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:43.027342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:43.031216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:43.033874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:43.036376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:43.037422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:43.046222 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b191b24-e6a7-455a-ab31-f5edfe8ace9f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1272 microversion: 2.1 time: 0.309052 Oct 27 09:24:43.049574 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2321/4677] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:42 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1272 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:43.050073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:43.056412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:43.359098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:43.380331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:43.381199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:43.381811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:43.386811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:43.390170 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-55fc6cac-9f3b-4a93-96ef-b2bb565dae2b tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1330 microversion: 2.57 time: 0.427797 Oct 27 09:24:43.396309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:43.397173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:43.397806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:43.398690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:43.401791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:43.402431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:43.412093 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2357/4678] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:42 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1330 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:43.604629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:43.605760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:43.627250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:43.634634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:43.636037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:43.642652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:43.644927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:43.645778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:43.839350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:43.848494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:43.862171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dbb86970-0822-4bab-b8be-a1fca0a53f95 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1273 microversion: 2.1 time: 0.262930 Oct 27 09:24:43.871249 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2358/4679] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:43 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:43.972733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:43.974227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:43.999676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:44.000628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:44.001406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:44.002410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:44.003112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:44.003856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:44.860460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:44.874663 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ad35ed7-19e2-4611-8466-96464be70041 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 1.498061 Oct 27 09:24:44.892977 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2322/4680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:43 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:44.901058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:44.902151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:44.910241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:44.910982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:44.911698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:44.916707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:44.925418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:44.926992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:44.929095 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d0347c98-5a81-4bd5-a833-d0b8b49d8c91 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.960880 Oct 27 09:24:44.929848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:44.950154 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2359/4681] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:43 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:44.963206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:44.963875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:44.980277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:44.980955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:44.981196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:44.984224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:44.987173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:44.987878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:45.202363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:45.242694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:45.247617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:45.249121 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c12b2c1-63c2-49eb-b49b-83b698ed3738 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1336 microversion: 2.57 time: 0.297929 Oct 27 09:24:45.253977 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2360/4682] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:44 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1336 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:45.268745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:45.273302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:45.291951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:45.292765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:45.297986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:45.301460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:45.304772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:45.307130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:45.516567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:45.529637 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5abb19a4-3652-4101-8723-4228688f5dc6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1273 microversion: 2.1 time: 0.273910 Oct 27 09:24:45.531291 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2361/4683] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:45 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:45.788129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:45.797869 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c60a65f8-c906-4b3d-aa0f-14bdcc431725 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1314 microversion: 2.1 time: 0.903214 Oct 27 09:24:45.812152 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2323/4684] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:44 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:45.908715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:45.910680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:45.934227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:45.936249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:45.938531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:45.939670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:45.942978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:45.944083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:45.959411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:45.960780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:45.991374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:45.992560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:45.998958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:46.001879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:46.003823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:46.008779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:46.754782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:46.764138 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f41f84a4-28d8-4ce0-8376-980313850311 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.810115 Oct 27 09:24:46.779080 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2324/4685] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:45 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:46.798848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:46.800051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:46.817388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:46.818316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:46.819053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:46.820071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:46.820779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:46.821476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:46.913136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:46.930841 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf8b9f1a-6c10-433e-b614-eba794908abf tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 1.029843 Oct 27 09:24:46.948071 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2362/4686] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:45 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:46.960916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:46.961846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:46.979489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:46.981611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:46.984413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:46.989090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:46.989827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:46.990863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:47.057189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:47.067760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:47.082105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:47.090284 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14b1773e-d792-4da4-a344-e32af2dca338 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1336 microversion: 2.57 time: 0.295054 Oct 27 09:24:47.093965 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2325/4687] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:46 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1336 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:47.099059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-98c6b132-53c5-441c-b6ee-32f2a0850a74 req-624d3f63-db46-4f79-9579-86ced01f6e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "229acc83-2e36-452f-a088-78560d42493e", "tag": "1532eda3-7b97-4b5d-a7a5-5dc7177de918"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:47.125631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-98c6b132-53c5-441c-b6ee-32f2a0850a74 req-624d3f63-db46-4f79-9579-86ced01f6e78 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:47.129378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-98c6b132-53c5-441c-b6ee-32f2a0850a74 req-624d3f63-db46-4f79-9579-86ced01f6e78 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:47.130234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-98c6b132-53c5-441c-b6ee-32f2a0850a74 req-624d3f63-db46-4f79-9579-86ced01f6e78 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:47.159810 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-98c6b132-53c5-441c-b6ee-32f2a0850a74 req-624d3f63-db46-4f79-9579-86ced01f6e78 service nova] Creating event network-changed:1532eda3-7b97-4b5d-a7a5-5dc7177de918 for instance 229acc83-2e36-452f-a088-78560d42493e on n-h2-858383-16 Oct 27 09:24:47.176016 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-98c6b132-53c5-441c-b6ee-32f2a0850a74 req-624d3f63-db46-4f79-9579-86ced01f6e78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080389 Oct 27 09:24:47.177338 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2326/4688] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:24:47.189320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:47.190248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:47.200154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:47.200959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:47.201563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:47.202622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:47.203267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:47.203972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:47.237354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:47.252225 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97516516-673d-4165-98ff-c6069942e6a6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1273 microversion: 2.1 time: 0.299652 Oct 27 09:24:47.253549 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2363/4689] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:46 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:47.807455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:47.808195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:47.822884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:47.825024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:47.826767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:47.827536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:47.830839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:47.834456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:48.139652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:48.155408 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6ea3b0f-a097-4d0e-8134-a8151cc2f43f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1314 microversion: 2.1 time: 0.975053 Oct 27 09:24:48.158395 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2327/4690] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:47 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1314 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:48.190144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:48.190888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:48.199492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:48.200549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:48.201323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:48.202958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:48.203855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:48.204581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:48.658008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:48.670847 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d4b0fc2-6240-417d-984f-7182abb08f41 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.495266 Oct 27 09:24:48.672335 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2328/4691] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:48 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:48.690797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:48.690797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:48.701877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:48.702384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:48.702858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:48.703615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:48.704220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:48.704506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:48.716051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:48.738605 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-996dc7fa-d0cd-460c-ae34-5c79d9aeca9a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.934009 Oct 27 09:24:48.741317 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2364/4692] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:47 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:48.763922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:48.767999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:48.786390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:48.786882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:48.787331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:48.792978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:48.793402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:48.793871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:49.107581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:49.123803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:49.125348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:49.131002 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efd202d1-27e9-4269-890f-7a07cf15bd32 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1336 microversion: 2.57 time: 0.454731 Oct 27 09:24:49.150824 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2329/4693] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:48 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1336 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:49.182615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:49.184025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:49.198782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:49.199640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:49.200241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:49.202393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:49.204042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:49.205096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:49.266814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:49.294997 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e40787a-ed27-45ae-a5ad-c56853f77fa5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 0.548555 Oct 27 09:24:49.298138 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2365/4694] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:48 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:49.620661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:49.635480 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d1f8d73-6c92-4791-859c-d1ed77ca5a19 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1314 microversion: 2.1 time: 0.457123 Oct 27 09:24:49.654263 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2330/4695] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:49 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:49.700170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:49.701281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:49.713011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:49.713875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:49.714609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:49.715629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:49.716691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:49.718480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:49.770309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:49.771688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:49.784888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:49.786266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:49.786942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:49.789124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:49.793294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:49.794326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:50.075348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:50.244736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:50.259727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:50.265511 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25309320-bd2b-4ac9-8811-0a22e7db2381 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.500164 Oct 27 09:24:50.270827 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c13cdb0-2f95-4c3a-9696-16ff6a7745a7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.576073 Oct 27 09:24:50.271415 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2366/4696] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:49 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:50.271908 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2331/4697] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:49 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:50.282361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:50.286109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:50.298343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:50.299666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:50.300174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:50.304159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:50.304722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:50.305294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:50.308789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:50.324750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:50.325367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:50.337945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:50.342028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:50.342803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:50.346175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:50.346992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:50.347677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:50.502174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:50.528185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:50.530532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:50.531348 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66d0dec2-5054-4ccf-9809-888925d0d1fb tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1357 microversion: 2.57 time: 0.257802 Oct 27 09:24:50.531604 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2332/4698] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:50 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:50.574131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:50.578303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:50.594407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:50.596821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:50.597501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:50.598561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:50.601164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:50.601821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:50.637119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:50.756043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:50.795325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:24:50.795957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:24:50.796590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:24:50.798315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:24:50.798907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:24:50.957813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:51.021441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.021955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.022406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.031371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.032162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.034724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.064718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:51.085918 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-abba898d-5179-4fe3-a98a-ec2211451187 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 0.763412 Oct 27 09:24:51.088425 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2367/4699] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:50 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:51.108347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:51.110002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:51.131944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.136393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.138208 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f0bc05f-c561-4468-a825-f54e0fd1fe46 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "POST /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d/action" status: 202 len: 1138 microversion: 2.57 time: 0.568841 Oct 27 09:24:51.139439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.140240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.140717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.142463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.144948 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2333/4700] 10.222.0.25 () {62 vars in 1320 bytes} [Thu Oct 27 09:24:50 2022] POST /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d/action => generated 1138 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 09:24:51.166418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:51.170523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:51.188033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.191129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.191654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.192398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.193658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.194264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.324237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=16 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:51.409427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:51.443528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:51.445060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:51.455738 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5fa5593c-3db0-4cdd-a62e-7d5e800b5b41 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.297517 Oct 27 09:24:51.459259 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2334/4701] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:51 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:51.467291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:51.470543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:51.487394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.488224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.493157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.497986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.498839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.499480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.640947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:51.653228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4700f3fa-bbdd-49dd-9264-2b68ce75e10f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1314 microversion: 2.1 time: 0.561871 Oct 27 09:24:51.681512 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2368/4702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:51 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:51.687838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:51.688701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:51.696966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.698762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.699598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.700607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:51.701877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:51.702477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:51.940285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:51.959206 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b0c71c1-9288-4efd-bdf6-d2989088154b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.498423 Oct 27 09:24:51.979750 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2335/4703] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:51 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:52.099517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:52.112118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08c163dd-d646-4819-a875-d51bbeadd360 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.428781 Oct 27 09:24:52.112727 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2369/4704] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:51 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:52.127762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:52.127762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:52.144735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:52.145561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:52.146218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:52.147059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:52.148539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:52.148539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:52.489390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:52.490429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:52.511285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:52.512116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:52.512723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:52.513626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:52.514245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:52.514841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:52.950232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:52.961013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-58cbbde3-caad-42e0-b67e-ebc0c9ccc28f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 0.852257 Oct 27 09:24:52.981624 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2336/4705] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:52 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:52.998123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:52.998966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:52.999223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:53.008211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:53.016954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:53.037146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:53.037826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:53.042026 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2b403b7e-96d3-41f6-8fc0-1c434194d992 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.556576 Oct 27 09:24:53.043458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:53.044169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:53.046546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:53.050175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:53.050713 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2370/4706] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:52 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:24:53.051399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:53.084668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:53.085664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:53.096414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:53.097343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:53.097969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:53.099263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:53.099941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:53.101037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:53.579858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:53.602355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:53.609094 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-39c2a791-5f31-4350-babf-d9d995862322 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.546722 Oct 27 09:24:53.609796 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2371/4707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:53 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:53.612626 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b557ec44-87db-40e0-bb0e-48d47347056a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1314 microversion: 2.1 time: 0.627158 Oct 27 09:24:53.616995 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2337/4708] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:52 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:53.634556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:53.637395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-45a3cd30-ee85-49db-aee7-cd3820912a5d req-6a026fa6-8f0e-40a4-9882-c6621213057b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a151c8b1-fd00-4cff-9a2d-355d1a8b29f4", "tag": "ca2a75e9-d4b5-48ad-af78-7e40a902a8c4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:53.655210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:53.676675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:53.677502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:53.678105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:53.679030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:53.679693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:53.680300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:53.684010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-45a3cd30-ee85-49db-aee7-cd3820912a5d req-6a026fa6-8f0e-40a4-9882-c6621213057b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:53.687447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-45a3cd30-ee85-49db-aee7-cd3820912a5d req-6a026fa6-8f0e-40a4-9882-c6621213057b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:53.688485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-45a3cd30-ee85-49db-aee7-cd3820912a5d req-6a026fa6-8f0e-40a4-9882-c6621213057b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:53.724660 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-45a3cd30-ee85-49db-aee7-cd3820912a5d req-6a026fa6-8f0e-40a4-9882-c6621213057b service nova] Creating event network-changed:ca2a75e9-d4b5-48ad-af78-7e40a902a8c4 for instance a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 on n-h2-858383-16 Oct 27 09:24:53.736637 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-45a3cd30-ee85-49db-aee7-cd3820912a5d req-6a026fa6-8f0e-40a4-9882-c6621213057b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118146 Oct 27 09:24:53.740098 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2338/4709] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:24:53.990595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:54.000682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:54.001325 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e8aff5c7-1f94-4a7a-a6cd-1db1ef76393a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.375937 Oct 27 09:24:54.002568 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2372/4710] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:53 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:54.004683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:54.020769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:54.021642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:54.022292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:54.027458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:54.027990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:54.028654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:54.076680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:54.077336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:54.101488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:54.102067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:54.103210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:54.113177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:54.114541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:54.120840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:54.382161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:54.397180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:54.401429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:54.414809 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ded51784-9a9e-499b-912d-b68da268d4c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.331510 Oct 27 09:24:54.415911 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2373/4711] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:54 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:54.510313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:54.544113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fc1f5d25-d8e2-4578-9815-7a8761535716 req-df2ef975-242a-49ec-9d70-aa225f7573c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "229acc83-2e36-452f-a088-78560d42493e", "name": "network-vif-plugged", "status": "completed", "tag": "1532eda3-7b97-4b5d-a7a5-5dc7177de918"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:54.575928 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1572249-ebf7-4e03-9bb3-3ad0353df3db tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 0.580065 Oct 27 09:24:54.582252 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2339/4712] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:53 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:24:54.589379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fc1f5d25-d8e2-4578-9815-7a8761535716 req-df2ef975-242a-49ec-9d70-aa225f7573c3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:54.590727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fc1f5d25-d8e2-4578-9815-7a8761535716 req-df2ef975-242a-49ec-9d70-aa225f7573c3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:54.592081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fc1f5d25-d8e2-4578-9815-7a8761535716 req-df2ef975-242a-49ec-9d70-aa225f7573c3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:54.624155 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fc1f5d25-d8e2-4578-9815-7a8761535716 req-df2ef975-242a-49ec-9d70-aa225f7573c3 service nova] Creating event network-vif-plugged:1532eda3-7b97-4b5d-a7a5-5dc7177de918 for instance 229acc83-2e36-452f-a088-78560d42493e on n-h2-858383-16 Oct 27 09:24:54.640102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:54.641196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:54.650906 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fc1f5d25-d8e2-4578-9815-7a8761535716 req-df2ef975-242a-49ec-9d70-aa225f7573c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135453 Oct 27 09:24:54.655232 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2374/4713] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:24:54.659144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:54.664330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:54.665553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:54.667490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:54.668350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:54.669788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:54.670962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:54.674021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:54.696571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:54.697657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:54.698356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:54.699345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:54.700105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:54.701103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:55.125728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:55.144869 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-044dde73-5e3d-4f86-bdef-4c2fed7bf660 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.514322 Oct 27 09:24:55.148373 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2340/4714] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:54 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:55.160482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:55.164977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:55.186268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:55.189562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:55.190534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:55.195308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:55.196935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:55.199088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:55.260642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:55.274411 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91c78846-8894-4dfa-ab5d-456ab74ef10e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1314 microversion: 2.1 time: 0.617224 Oct 27 09:24:55.302415 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2375/4715] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:54 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:55.449469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:55.450677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:55.468369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:55.469555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:55.470673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:55.472016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:55.476255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:55.487075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:55.491470 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8e4e861-dc1a-45a4-b21e-dd347dda1af2 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.340841 Oct 27 09:24:55.493686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:55.500432 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2341/4716] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:55 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:55.503340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:24:55.607961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:55.608589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:55.629168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:55.629971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:55.630669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:55.631826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:55.632567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:55.633239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:55.717075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:55.736023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:55.737602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:55.739105 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e35330b-979f-43e2-9797-693d37bc8c3c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.296961 Oct 27 09:24:55.755921 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2376/4717] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:55 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:55.927906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:55.941088 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c88cd11-823f-4520-93b3-eecc43485524 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 0.337344 Oct 27 09:24:55.958202 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2342/4718] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:55 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:56.176859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:56.178086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:56.203724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:56.204629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:56.206224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:56.208170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:56.213673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:56.214726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:56.314414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:56.315951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:56.340862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:56.341730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:56.356555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:56.357850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:56.358700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:56.380409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:56.621662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:56.640678 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23a63761-7947-48eb-8e1c-563c3ae166b6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.470101 Oct 27 09:24:56.642326 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2377/4719] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:56 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:56.653927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:56.655665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:56.671246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:56.671786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:56.672237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:56.672969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:56.673435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:56.673876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:56.869026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:56.880309 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fcdfe223-72bf-4ccd-86ee-bf3e9697bf23 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.234629 Oct 27 09:24:56.897507 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2378/4720] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:56 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:56.906339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:56.907912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:56.947891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:56.954984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:56.957266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:56.962222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:56.965254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:56.968519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:56.971552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:56.974139 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60619ecb-7ab3-464d-bbdc-7d1b6002bf57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1314 microversion: 2.1 time: 0.668103 Oct 27 09:24:56.978839 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2343/4721] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:56 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:56.982861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:56.983240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:57.017276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:57.018669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:57.020586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:57.026599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:57.032908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:57.033983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:57.426610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:57.488530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:57.491916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:57.499776 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-75c8da4a-deab-4fce-90c3-f1b3a2fe7fd8 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.596354 Oct 27 09:24:57.509776 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2379/4722] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:56 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:57.526060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-454f3a5b-5ed8-4be1-b2f8-150993d6ce76 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:24:57.530993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-454f3a5b-5ed8-4be1-b2f8-150993d6ce76 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:57.542042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454f3a5b-5ed8-4be1-b2f8-150993d6ce76 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:57.542948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454f3a5b-5ed8-4be1-b2f8-150993d6ce76 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:57.543660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454f3a5b-5ed8-4be1-b2f8-150993d6ce76 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:57.544629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454f3a5b-5ed8-4be1-b2f8-150993d6ce76 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:57.545330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454f3a5b-5ed8-4be1-b2f8-150993d6ce76 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:57.545989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-454f3a5b-5ed8-4be1-b2f8-150993d6ce76 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:57.750550 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-454f3a5b-5ed8-4be1-b2f8-150993d6ce76 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "POST /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5/action" status: 200 len: 32640 microversion: 2.1 time: 0.238191 Oct 27 09:24:57.751210 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2380/4723] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:24:57 2022] POST /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5/action => generated 32640 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:24:57.761247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:57.762691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:57.788370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:57.789400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:57.790792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:57.791854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:57.792558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:57.794473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:58.603893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:58.626297 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f7bd0a7d-2f16-4f8d-a647-564acd5b8b24 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 1.648910 Oct 27 09:24:58.627746 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2344/4724] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:56 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:58.646954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:58.648580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:58.652999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:58.663475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:58.665372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:58.666682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:58.668799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:58.669899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:58.670908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:58.671131 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-70f0c192-6ae0-41fb-a311-f1102cef3e8c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.918144 Oct 27 09:24:58.675858 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2381/4725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:57 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:58.695146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:58.696033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:58.721534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:58.722122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:58.722619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:58.724806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:58.725520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:58.729444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:59.079139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:59.130603 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-304f03c8-5c71-4a79-ab03-6c271a087399 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1314 microversion: 2.1 time: 0.445368 Oct 27 09:24:59.131209 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2382/4726] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:58 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:59.164576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:59.167230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:59.178191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:59.197550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:59.198099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:59.202262 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53cac4fb-212e-4d54-82cc-6a33b905ccd0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.569993 Oct 27 09:24:59.203035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:59.205229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:59.218540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:59.221670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:59.226605 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2345/4727] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:58 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:24:59.473910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:59.501268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:59.516103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:24:59.518526 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-74a9d1d7-fb7f-4881-8189-9a5c9eee09fc tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.370982 Oct 27 09:24:59.519550 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2383/4728] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:24:59 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:24:59.653841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:59.656415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:59.671556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:59.674448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:59.675188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:59.676434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:59.681886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:59.682540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:59.726880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:24:59.728816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:24:59.750590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:59.751421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:59.752065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:24:59.757401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:24:59.758107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:24:59.758815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:00.263254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:00.275915 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12060111-59bf-4606-a9d4-ccabb36aad2b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 0.627084 Oct 27 09:25:00.282789 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2346/4729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:59 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:00.295045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:00.296573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:00.312613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:00.315090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:00.319148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:00.320288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:00.321626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:00.322311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:00.421087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:00.433072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:00.456964 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1422d33e-7014-462c-be59-1b0f04cb8366 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.736979 Oct 27 09:25:00.458310 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2384/4730] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:24:59 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:00.471439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:00.473175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:00.495263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:00.496327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:00.497015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:00.498043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:00.503637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:00.504498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:01.108965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:01.126886 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9bb161a-a89c-4651-97d5-6e20d21a07cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1502 microversion: 2.1 time: 0.838628 Oct 27 09:25:01.129852 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2347/4731] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:00 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1502 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:01.141694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:01.142789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:01.161160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:01.163393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:01.165481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:01.167882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:01.168855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:01.172245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:01.211243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:01.228742 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cea74060-120d-489b-b599-84254527e209 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.768843 Oct 27 09:25:01.250466 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2385/4732] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:00 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:01.262925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9712eb5d-6f2f-4475-ae1c-3fd3b66e108f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:01.280397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9712eb5d-6f2f-4475-ae1c-3fd3b66e108f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:01.282148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9712eb5d-6f2f-4475-ae1c-3fd3b66e108f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:01.282984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9712eb5d-6f2f-4475-ae1c-3fd3b66e108f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:01.369323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9712eb5d-6f2f-4475-ae1c-3fd3b66e108f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Going to try to stop instance {{(pid=120602) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:25:01.381024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:01.435945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:01.450402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:01.455412 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a60841fe-8d5c-4ce5-835d-10b584536b68 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.318626 Oct 27 09:25:01.461228 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2348/4733] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:01 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:01.494990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:01.499133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:01.527127 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9712eb5d-6f2f-4475-ae1c-3fd3b66e108f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e/action" status: 202 len: 0 microversion: 2.1 time: 0.275087 Oct 27 09:25:01.527871 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2386/4734] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:25:01 2022] POST /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:25:01.540425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:01.550522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:01.552494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:01.553569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:01.554483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:01.574089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:01.575033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:01.575792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:01.576735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:01.580560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:01.581276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:01.582957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:01.585856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:01.593659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:02.474241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:02.490542 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8254e6ae-a1d1-443f-b68f-bdf1a415529a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.950935 Oct 27 09:25:02.491681 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2387/4735] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:01 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:02.522256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:02.525328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:02.558461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:02.561132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:02.567245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:02.567830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:02.572879 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96121412-78fb-4e3f-ace3-6b93ccd8b834 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 1.109656 Oct 27 09:25:02.573839 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2349/4736] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:01 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:02.574395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:02.576365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:02.577759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:02.578313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:02.580251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:02.581143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:02.588265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:02.589127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:02.590566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:02.591632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:02.592489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:02.593158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:03.381557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:03.435045 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-07658ef7-1781-48eb-bb71-9624b876974f tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.857876 Oct 27 09:25:03.459420 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2350/4737] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:02 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:03.460572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:03.485896 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-75e87c50-1a9f-49f8-92fe-ae644199cf6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.971959 Oct 27 09:25:03.488049 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2388/4738] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:02 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:03.504176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:03.505377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:03.515192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:03.516325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:03.519281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:03.520328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:03.521243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:03.522522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:03.523894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:03.524919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:03.537299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:03.540111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:03.540990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:03.549467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:03.551458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:03.552539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:03.637129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:25:03.952899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:03.975230 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1a3659c3-9277-4620-b886-77c975d16936 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 204 len: 0 microversion: 2.1 time: 0.483212 Oct 27 09:25:03.981522 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2389/4739] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:25:03 2022] DELETE /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:25:03.997876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d49da149-7612-4496-9dd8-bda2633efce2 req-4a72f714-fd24-42e3-a1ee-8e55d05cb28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4462107f-9d4a-45b1-9080-8622fcef51d5", "tag": "a4bef84f-f781-4b55-9641-ab7e808a856e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:04.012609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:04.018838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d49da149-7612-4496-9dd8-bda2633efce2 req-4a72f714-fd24-42e3-a1ee-8e55d05cb28a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:04.026690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d49da149-7612-4496-9dd8-bda2633efce2 req-4a72f714-fd24-42e3-a1ee-8e55d05cb28a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:04.027478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d49da149-7612-4496-9dd8-bda2633efce2 req-4a72f714-fd24-42e3-a1ee-8e55d05cb28a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:04.029219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:04.031356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5afd2d1a-4dc8-4b12-bfc8-ce04f390d1ee tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.552626 Oct 27 09:25:04.032449 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2351/4740] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:03 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:04.053245 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d49da149-7612-4496-9dd8-bda2633efce2 req-4a72f714-fd24-42e3-a1ee-8e55d05cb28a service nova] Creating event network-changed:a4bef84f-f781-4b55-9641-ab7e808a856e for instance 4462107f-9d4a-45b1-9080-8622fcef51d5 on n-h2-858383-16 Oct 27 09:25:04.065433 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d49da149-7612-4496-9dd8-bda2633efce2 req-4a72f714-fd24-42e3-a1ee-8e55d05cb28a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082019 Oct 27 09:25:04.068009 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2390/4741] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:25:04.073680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:04.074496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:04.082632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:04.083776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:04.099360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:04.103105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:04.103953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:04.104953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:04.108196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:04.108941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:04.118695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:04.127119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:04.127972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:04.129166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:04.139237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:04.140609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:04.166717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:04.621378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:04.633317 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c51f3af5-fb37-4c42-ab45-7e631e7d3bc2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 0.562337 Oct 27 09:25:04.636348 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2391/4742] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:04 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:04.657199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:04.660491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:04.684166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:04.685475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:04.688992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:04.694746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:04.695935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:04.697247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:04.782214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:04.817924 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0882a3f7-5ff2-4250-8759-b0c18ef245f8 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.783625 Oct 27 09:25:04.830678 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2352/4743] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:04 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:04.857161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:04.861180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:04.875833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:04.877158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:04.877963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:04.880013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:04.880950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:04.881834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:05.404855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:05.416210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:05.422683 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3efcfe2a-d119-4ab5-a5b5-4786459fda31 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.588337 Oct 27 09:25:05.425779 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de3e517e-26f2-421b-a4d3-7459a8d5d6b7 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1669 microversion: 2.1 time: 0.787970 Oct 27 09:25:05.432117 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2353/4745] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:04 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:05.441631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:05.443629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:05.444104 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2392/4745] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:04 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1669 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:05.455389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d8df65ee-356a-4d50-904e-3320a275e2e9 req-de8c019d-b37c-46d5-9caf-54e6cd7c3a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a151c8b1-fd00-4cff-9a2d-355d1a8b29f4", "name": "network-vif-plugged", "status": "completed", "tag": "ca2a75e9-d4b5-48ad-af78-7e40a902a8c4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:05.460937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:05.462119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:05.462590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:05.463398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:05.463902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:05.464360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:05.467879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d8df65ee-356a-4d50-904e-3320a275e2e9 req-de8c019d-b37c-46d5-9caf-54e6cd7c3a68 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:05.468683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d8df65ee-356a-4d50-904e-3320a275e2e9 req-de8c019d-b37c-46d5-9caf-54e6cd7c3a68 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:05.470869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d8df65ee-356a-4d50-904e-3320a275e2e9 req-de8c019d-b37c-46d5-9caf-54e6cd7c3a68 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:05.486665 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d8df65ee-356a-4d50-904e-3320a275e2e9 req-de8c019d-b37c-46d5-9caf-54e6cd7c3a68 service nova] Creating event network-vif-plugged:ca2a75e9-d4b5-48ad-af78-7e40a902a8c4 for instance a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 on n-h2-858383-16 Oct 27 09:25:05.493673 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d8df65ee-356a-4d50-904e-3320a275e2e9 req-de8c019d-b37c-46d5-9caf-54e6cd7c3a68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047313 Oct 27 09:25:05.495330 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2393/4746] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:25:05.503394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:05.504530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:05.513616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:05.514720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:05.515664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:05.516688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:05.517386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:05.518072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:05.682650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:05.699795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:05.705373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:05.706706 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-63bccc5b-16e9-4337-8ca9-966de9cbbd4c tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.209897 Oct 27 09:25:05.707273 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2394/4747] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:05 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:05.719256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:05.728800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:05.746253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:05.746253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:05.746253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:05.746253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:05.746902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:05.747170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:06.497638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:06.506497 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a52a9ed8-0395-49bc-a713-3c683ced1637 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 1.072341 Oct 27 09:25:06.528765 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2354/4748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:05 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:06.534977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:06.535974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:06.543278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:06.544132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:06.544763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:06.545709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:06.546403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:06.547042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:06.556354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:06.577242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd0e64f3-ffde-4ada-9993-f0a3d4f4dcb4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 0.862262 Oct 27 09:25:06.578313 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2395/4749] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:05 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:06.599646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:06.600584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:06.613030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:06.615513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:06.616886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:06.618555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:06.623670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:06.625160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:07.059400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:07.069347 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4b6fe283-5269-47c8-b013-7f84f96745a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.489601 Oct 27 09:25:07.079990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:07.087990 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2396/4750] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:06 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:07.093660 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62d665c8-efd1-4de3-ad7f-0fdcc721ba55 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1523 microversion: 2.1 time: 0.562392 Oct 27 09:25:07.094993 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2355/4751] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:06 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1523 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:07.098247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:07.099406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:07.106199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:07.107727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:07.110203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:07.110985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:07.112374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:07.113413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:07.114275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:07.115060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:07.124349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:07.125246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:07.126112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:07.127795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:07.128673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:07.129470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:07.309310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:07.322154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:07.324114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:07.330670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:07.332426 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c54cc820-8114-463f-a787-37e15c99ac87 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.235976 Oct 27 09:25:07.343628 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2356/4752] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:07 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:07.355918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-cce1c93d-12a6-42be-b056-0d2d7e00cefc req-28356eca-89c7-421e-a945-fcfbba5f8f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4462107f-9d4a-45b1-9080-8622fcef51d5", "name": "network-vif-deleted", "tag": "a4bef84f-f781-4b55-9641-ab7e808a856e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:07.358303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cce1c93d-12a6-42be-b056-0d2d7e00cefc req-28356eca-89c7-421e-a945-fcfbba5f8f82 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:07.359225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cce1c93d-12a6-42be-b056-0d2d7e00cefc req-28356eca-89c7-421e-a945-fcfbba5f8f82 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:07.360011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-cce1c93d-12a6-42be-b056-0d2d7e00cefc req-28356eca-89c7-421e-a945-fcfbba5f8f82 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:07.387687 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-cce1c93d-12a6-42be-b056-0d2d7e00cefc req-28356eca-89c7-421e-a945-fcfbba5f8f82 service nova] Creating event network-vif-deleted:a4bef84f-f781-4b55-9641-ab7e808a856e for instance 4462107f-9d4a-45b1-9080-8622fcef51d5 on n-h2-858383-16 Oct 27 09:25:07.389944 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1281fa1-afe4-4453-87dc-5adcb57d14e5 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1601 microversion: 2.1 time: 0.300107 Oct 27 09:25:07.392876 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2397/4753] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:07 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1601 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:07.394791 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-cce1c93d-12a6-42be-b056-0d2d7e00cefc req-28356eca-89c7-421e-a945-fcfbba5f8f82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060089 Oct 27 09:25:07.400561 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2357/4754] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:25:07.548634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:07.551147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:07.576129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:07.577529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:07.578642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:07.580360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:07.581553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:07.582674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:07.627042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:07.630493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:07.645863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:07.648228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:07.650179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:07.652081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:07.654331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:07.656174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.103960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:08.120625 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc7d2a50-9304-4b74-80ed-184e9a3db2e2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.580058 Oct 27 09:25:08.121945 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2398/4755] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:07 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:08.128921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:08.129825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:08.145488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:08.146222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:08.146838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.147852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:08.148412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:08.150170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.183066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:08.215293 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6408017b-e2f7-4114-9af4-19d6977e0c8c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1315 microversion: 2.1 time: 0.598052 Oct 27 09:25:08.223961 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2358/4756] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:07 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:08.234822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:08.248534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:08.259753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:08.260467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:08.264344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.265134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:08.271740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:08.272364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.812317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:08.827621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba07d085-1125-4c6d-9490-39e2772a31d6 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.704226 Oct 27 09:25:08.845577 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2399/4757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:08 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:08.854979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:08.856002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:08.863471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:08.864175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:08.864989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.866105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:08.867194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:08.868886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:08.870429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.883046 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fcf9ce5-2bb0-47bf-baad-4a903179476c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1505 microversion: 2.1 time: 0.661773 Oct 27 09:25:08.894774 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2359/4758] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:08 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1505 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:08.900409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:08.902886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:08.910103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:08.910935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:08.911751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.912754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:08.913464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:08.914717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.967385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:08.968178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:08.968789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:08.969415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lazy-loading 'fault' on Instance uuid 4462107f-9d4a-45b1-9080-8622fcef51d5 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:25:09.501762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:09.502700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203ed8cc61274041ae7a9bb1ac09fd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0630c5386744d07a21ac826f4d0d2b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:09.517023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:09.521452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:09.522729 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b91b96fa-2772-4046-a469-d69211eade25 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 200 len: 1488 microversion: 2.1 time: 0.626490 Oct 27 09:25:09.522935 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-edc70408-acdc-46c3-8c15-aaef70b4097e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.674959 Oct 27 09:25:09.526668 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2360/4760] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:08 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 1488 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:09.526899 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2400/4760] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:08 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:09.537445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:09.538951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:09.543457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:09.543968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:09.551212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:09.551882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:09.552582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:09.553618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:09.554165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:09.554674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:09.567631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:09.574817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:09.575423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:09.577103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:09.577979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:09.578755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:09.977532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:09.999961 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f646e6ae-8c53-4450-a1d7-f2ad1c76932e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1501 microversion: 2.1 time: 0.469095 Oct 27 09:25:10.002032 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2361/4761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:09 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1501 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:10.010686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:10.013689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:10.023300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.025944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.026744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.027744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.028369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.029092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.044596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:10.061047 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-059d6f5c-9021-4c97-acbe-473020c1a275 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.529984 Oct 27 09:25:10.062392 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2401/4762] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:09 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:10.069649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:10.079811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:10.095147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.095777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.096787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.097594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.098223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.098673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.376077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:10.376582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:10.389837 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27b297b8-1466-47a4-92f9-5f9f290edea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1505 microversion: 2.1 time: 0.324115 Oct 27 09:25:10.403902 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-27dbcea6-6885-4753-8987-af010d3b369c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.391907 Oct 27 09:25:10.403902 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2362/4763] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:10 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:10.405720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:10.407480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:10.419707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.420756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.421509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.423017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.423946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.424647 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2402/4764] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:10 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:10.424955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.554276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:10.556910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] [instance: 4462107f-9d4a-45b1-9080-8622fcef51d5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:10.570806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.572373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.573109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.574544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.575888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.576674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.596509 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] HTTP exception thrown: Instance 4462107f-9d4a-45b1-9080-8622fcef51d5 could not be found. Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Request method failure captured: Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 HTTP/1.1 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWkzHqeKdIEpMSXWOZdUtXXt_9NFMVS_ISr4dTPLT49pEghhN81i_huWqp51hTg5fqwtXMM0GKiiJPkIcBaWHbK4Jw4on218eNQQpCU-pF88LRyaXgJtNRTxnBgaX_g-I9LAlrYb0DHMYF7K16fJuMHAv_lipNTZkQg1ly31j27RJ9j0 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: f0630c5386744d07a21ac826f4d0d2b3 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestNetworkBasicOps-1842739308 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0630c5386744d07a21ac826f4d0d2b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0630c5386744d07a21ac826f4d0d2b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0630c5386744d07a21ac826f4d0d2b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0630c5386744d07a21ac826f4d0d2b3"}]}] Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestNetworkBasicOps-1842739308 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: f0630c5386744d07a21ac826f4d0d2b3 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestNetworkBasicOps-1842739308 Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestNetworkBasicOps-1842739308-project Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 203ed8cc61274041ae7a9bb1ac09fd1a Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestNetworkBasicOps-1842739308-project Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4462107f-9d4a-45b1-9080-8622fcef51d5 could not be found. Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4462107f-9d4a-45b1-9080-8622fcef51d5'} Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4462107f-9d4a-45b1-9080-8622fcef51d5 could not be found. Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4462107f-9d4a-45b1-9080-8622fcef51d5 could not be found. Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:10.598842 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:10.605026 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:10.605026 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:10.605026 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:10.605026 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:25:10.605026 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:25:10.605026 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4462107f-9d4a-45b1-9080-8622fcef51d5 could not be found. Oct 27 09:25:10.605026 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:10.606766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Returning 404 to user: Instance 4462107f-9d4a-45b1-9080-8622fcef51d5 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:25:10.607941 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40cb66a7-d262-4bf7-8e0c-1662a3d35538 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5" status: 404 len: 111 microversion: 2.1 time: 0.061460 Oct 27 09:25:10.612580 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2403/4765] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:10 2022] GET /compute/v2.1/servers/4462107f-9d4a-45b1-9080-8622fcef51d5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:25:10.618756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:10.619383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:10.628001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.628707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.629325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.630110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.630611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.631237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.649382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:10.659143 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35a81e65-064c-4a14-942d-204a76690a0e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1501 microversion: 2.1 time: 0.259640 Oct 27 09:25:10.660728 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2363/4766] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:10 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1501 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:10.707968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:10.709991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:10.721017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.721791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.722664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.723673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.724439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.725353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.748125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:10.763487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:10.769622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lazy-loading 'flavor' on Instance uuid a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:25:10.775295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:10.778128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:10.780368 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-399ccc51-adb9-4984-992f-f49c073c00e7 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.165982 Oct 27 09:25:10.781434 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2404/4767] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:10 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:10.895064 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f067e2ca-2183-442b-8974-7a77325e9ae6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "POST /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4/action" status: 202 len: 0 microversion: 2.1 time: 0.196080 Oct 27 09:25:10.895721 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2364/4768] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:25:10 2022] POST /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:25:10.906135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:10.906800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:10.920923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.921866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.923495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.931089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:10.931089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:10.935961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:10.941837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d5a1e0d-4d85-426a-b7ed-1d38dd6a07b3 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] Calling method '.version_select at 0x7f31ae5f7ee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:10.981736 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d5a1e0d-4d85-426a-b7ed-1d38dd6a07b3 tempest-TestNetworkBasicOps-1842739308 tempest-TestNetworkBasicOps-1842739308-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1486594101" status: 202 len: 0 microversion: 2.1 time: 0.046351 Oct 27 09:25:10.986546 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2365/4769] 10.222.0.25 () {58 vars in 1257 bytes} [Thu Oct 27 09:25:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1486594101 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:25:11.089594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:11.090461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:11.098302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:11.098882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:11.099401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:11.100213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:11.100772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:11.101271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:11.323327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:11.334847 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bade31a8-d61f-4b3d-aca2-c2b4cb3c8178 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1509 microversion: 2.1 time: 0.432445 Oct 27 09:25:11.335820 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2405/4770] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:10 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1509 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:11.428979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:11.431342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:11.442970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:11.448166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:11.449077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:11.451166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:11.452068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:11.454274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:11.456480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:11.457933 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ddba13c0-2e84-4dc8-ac80-597db7812f2d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.372859 Oct 27 09:25:11.469211 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2366/4771] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:11 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:11.479585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:11.481732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:11.489007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:11.489835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:11.490727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:11.491447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:11.491934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:11.493036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:11.874566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:11.884777 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2a03f628-a84f-4727-8d9b-b19d7e5d24c3 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.459669 Oct 27 09:25:11.886232 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2406/4772] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:11 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:11.892571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:11.893607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:11.902871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:11.903822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:11.904606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:11.905741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:11.906493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:11.907284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:11.971145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:11.987732 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8800b271-138e-47d3-9bb6-8ef8dbd31413 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1505 microversion: 2.1 time: 0.527498 Oct 27 09:25:11.999978 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2367/4773] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:11 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:12.013440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-bfca85e3-cb2b-494a-b0f3-bb1c8e297369 req-341d7255-413a-4365-b95e-777118a32cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389f74c5-88ab-43cb-86d5-0ea1b4309ef4", "name": "network-vif-unplugged", "status": "completed", "tag": "c3a450aa-996e-4b42-8fbe-1c665c19e69b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:12.043085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bfca85e3-cb2b-494a-b0f3-bb1c8e297369 req-341d7255-413a-4365-b95e-777118a32cbb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:12.046439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bfca85e3-cb2b-494a-b0f3-bb1c8e297369 req-341d7255-413a-4365-b95e-777118a32cbb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:12.047137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bfca85e3-cb2b-494a-b0f3-bb1c8e297369 req-341d7255-413a-4365-b95e-777118a32cbb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:12.071808 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-bfca85e3-cb2b-494a-b0f3-bb1c8e297369 req-341d7255-413a-4365-b95e-777118a32cbb service nova] Creating event network-vif-unplugged:c3a450aa-996e-4b42-8fbe-1c665c19e69b for instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 on n-h1-858383-16 Oct 27 09:25:12.085490 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-bfca85e3-cb2b-494a-b0f3-bb1c8e297369 req-341d7255-413a-4365-b95e-777118a32cbb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083898 Oct 27 09:25:12.089087 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2368/4774] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:25:12.149640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:12.164949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:12.168142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:12.173239 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-190966c9-9f9e-41f2-9ed7-de0d3bd1ed99 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.284134 Oct 27 09:25:12.199430 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2407/4775] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:11 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:12.360551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:12.361560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:12.374521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:12.375027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:12.375780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:12.376721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:12.377441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:12.379939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:12.483873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:12.484951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:12.492020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:12.492542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:12.493160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:12.494062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:12.494679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:12.495261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:12.834188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:12.854828 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2dbfb33a-4908-4bfe-b83c-f44057129794 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1509 microversion: 2.1 time: 0.495303 Oct 27 09:25:12.859779 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2369/4776] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:12 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:12.921348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:12.921976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:12.924086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:12.933773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:12.939080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:12.939886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:12.940572 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ea3a6fb-561c-4077-a5c9-c97e70f2367a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.461303 Oct 27 09:25:12.941113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:12.941584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:12.955601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:12.956954 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2408/4777] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:12 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:13.017538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:13.018487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:13.027798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:13.028593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:13.029291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:13.030271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:13.031106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:13.031808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:13.038589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:13.343151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:13.357357 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f21e5510-bece-43cb-a245-d89b3c7642ce tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.440678 Oct 27 09:25:13.359159 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2370/4778] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:12 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:13.374291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:13.375477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:13.387701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:13.388793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:13.389488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:13.390439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:13.391117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:13.392301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:13.443435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:13.456843 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e30ebdb-c6cb-424f-b535-624a2a5c1683 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 200 len: 1448 microversion: 2.1 time: 0.444880 Oct 27 09:25:13.459520 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2409/4779] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:13 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 1448 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:13.488547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:13.488988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:13.516581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:13.525818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:13.526569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:13.528003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:13.528644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:13.529249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:13.561134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:13.586790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:13.588505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:13.589753 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50da6e3f-970d-4559-940c-428ee04a8776 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.227777 Oct 27 09:25:13.591048 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2371/4780] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:13 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:13.594145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:25:13.604319 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.api [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Working on deleting snapshot 4b5c04dd-2493-43b7-b81e-ca26a1f44207 from shelved instance... Oct 27 09:25:13.891508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:13.892541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:13.904742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:13.906760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:13.907321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:13.909256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:13.911438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:13.911876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:14.717822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:14.731171 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eef16f8b-375f-4a34-bea0-212a2011ac4a tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1492 microversion: 2.1 time: 0.843161 Oct 27 09:25:14.732026 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2372/4781] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:13 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1492 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:15.039934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:15.042100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:15.053281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:15.055370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:15.056224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:15.057360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:15.058362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:15.059080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:15.158573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Doing local delete in cell ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) {{(pid=120602) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 27 09:25:15.159322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:15.159850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:15.160300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:15.160734 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.api [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 27 09:25:15.171437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] deallocate_for_instance() {{(pid=120602) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 27 09:25:15.931074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:15.954877 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37febe70-9295-4920-b471-404aeea40da2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 1.217786 Oct 27 09:25:15.955814 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2373/4782] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:14 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:15.972664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:15.981904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:15.988680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:15.989891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:15.992239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:16.000676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:16.002183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:16.002867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:16.348587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:16.358811 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3871d428-740e-413b-8cf0-80363e239f94 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1485 microversion: 2.1 time: 0.398321 Oct 27 09:25:16.365293 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2374/4783] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:15 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1485 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:16.373027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:16.373898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:16.383631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:16.385348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:16.386159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:16.387875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:16.388870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:16.394453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:16.606846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:16.625156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:16.627022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:16.628460 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2dde7bc6-e408-488d-84d9-07c6d11fc0c9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.261758 Oct 27 09:25:16.629199 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2375/4784] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:16 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:16.634490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ea2c13c-e86e-41e0-9c3f-801685e8f52c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:16.641958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ea2c13c-e86e-41e0-9c3f-801685e8f52c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:16.652975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea2c13c-e86e-41e0-9c3f-801685e8f52c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:16.653478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea2c13c-e86e-41e0-9c3f-801685e8f52c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:16.653920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea2c13c-e86e-41e0-9c3f-801685e8f52c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:16.654620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea2c13c-e86e-41e0-9c3f-801685e8f52c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:16.655074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea2c13c-e86e-41e0-9c3f-801685e8f52c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:16.665691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ea2c13c-e86e-41e0-9c3f-801685e8f52c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:16.816442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Updating instance_info_cache with network_info: [] {{(pid=120602) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:25:16.843676 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ea2c13c-e86e-41e0-9c3f-801685e8f52c tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "POST /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4/action" status: 202 len: 0 microversion: 2.1 time: 0.212990 Oct 27 09:25:16.846792 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2376/4785] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:25:16 2022] POST /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:25:16.860160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffb2fe30-689e-46c7-a4ed-b535ebb59095 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:16.869767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ffb2fe30-689e-46c7-a4ed-b535ebb59095 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:16.886285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2fe30-689e-46c7-a4ed-b535ebb59095 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:16.889044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2fe30-689e-46c7-a4ed-b535ebb59095 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:16.889499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2fe30-689e-46c7-a4ed-b535ebb59095 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:16.890275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2fe30-689e-46c7-a4ed-b535ebb59095 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:16.890684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2fe30-689e-46c7-a4ed-b535ebb59095 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:16.891119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ffb2fe30-689e-46c7-a4ed-b535ebb59095 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:17.141296 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ffb2fe30-689e-46c7-a4ed-b535ebb59095 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "POST /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323/action" status: 202 len: 0 microversion: 2.1 time: 0.287827 Oct 27 09:25:17.142036 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2377/4786] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:25:16 2022] POST /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:25:17.172975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-04f669f5-6d9c-4826-95ef-ae07ba521124 req-4c7c936b-e381-4c97-b553-440b7cfcbdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389f74c5-88ab-43cb-86d5-0ea1b4309ef4", "name": "network-vif-deleted", "tag": "c3a450aa-996e-4b42-8fbe-1c665c19e69b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:17.230627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-04f669f5-6d9c-4826-95ef-ae07ba521124 req-4c7c936b-e381-4c97-b553-440b7cfcbdc9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:17.231506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-04f669f5-6d9c-4826-95ef-ae07ba521124 req-4c7c936b-e381-4c97-b553-440b7cfcbdc9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:17.232233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-04f669f5-6d9c-4826-95ef-ae07ba521124 req-4c7c936b-e381-4c97-b553-440b7cfcbdc9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:17.269972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.server_external_events [req-04f669f5-6d9c-4826-95ef-ae07ba521124 req-4c7c936b-e381-4c97-b553-440b7cfcbdc9 service nova] Unable to find a host for instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4. Dropping event network-vif-deleted {{(pid=120603) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 09:25:17.271252 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-04f669f5-6d9c-4826-95ef-ae07ba521124 req-4c7c936b-e381-4c97-b553-440b7cfcbdc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.106428 Oct 27 09:25:17.274793 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2378/4787] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 127 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 09:25:17.285921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:17.287235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:17.301803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:17.303064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:17.306716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:17.307984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:17.308908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:17.310631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:17.380974 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-902eaa76-88d3-4f36-a9c3-155363f79a66 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 204 len: 0 microversion: 2.1 time: 3.897897 Oct 27 09:25:17.381930 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2410/4788] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:25:13 2022] DELETE /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 0 bytes in 3900 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:25:17.390735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:17.391878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:17.404522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:17.405028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:17.405711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:17.406809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:17.407627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:17.412099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:18.014927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:18.018943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:18.036064 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ac7682b-829f-4a6c-b42c-ea763bec79a4 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1498 microversion: 2.1 time: 0.754583 Oct 27 09:25:18.036865 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2379/4789] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:17 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1498 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:18.042810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:18.044494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:18.052856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:18.053760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:18.055707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:18.056786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:18.057510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:18.058186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:18.224100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:18.237854 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f6e7aa5-765f-45a9-80d1-0ce1c67b9a3d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.854057 Oct 27 09:25:18.239050 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2411/4790] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:17 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:18.245943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:18.247103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:18.261139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:18.262086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:18.262797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:18.264383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:18.265598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:18.266990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:18.299767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 HTTP/1.1 Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '389f74c5-88ab-43cb-86d5-0ea1b4309ef4'} Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:18.301364 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:18.313506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:18.313506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:18.313506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:18.313506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:25:18.313506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:25:18.313506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:25:18.313506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:18.313506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:25:18.313506 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f748d739-3be1-4cf1-b709-9b6ce3bbbea1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 404 len: 111 microversion: 2.1 time: 0.062430 Oct 27 09:25:18.318805 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2412/4791] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:18 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:25:18.337710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:18.338021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:18.347965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:18.348556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:18.349000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:18.350461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:18.350952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:18.351418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:18.597895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:18.611480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:18.613407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:18.615013 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e17e644-e54a-48f2-b3ca-10c3d3151276 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.298431 Oct 27 09:25:18.615781 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2413/4792] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:18 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:18.621527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-4060251", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "3527ca6b-4f14-40c0-86a3-873f2fef222c"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:18.695734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] validate_networks() for [('3527ca6b-4f14-40c0-86a3-873f2fef222c', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:25:19.302310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:19.315782 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a7aef37-db58-45e8-83f1-14d0b9414b12 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1493 microversion: 2.1 time: 1.274687 Oct 27 09:25:19.316190 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2380/4793] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:18 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1493 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:19.330335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:19.330977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:19.343783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:19.345865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:19.346611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:19.348955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:19.352067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:19.353862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:19.663807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:19.678823 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc07b652-1a0c-4453-b2a0-c53438534468 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1498 microversion: 2.1 time: 0.360434 Oct 27 09:25:19.691599 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2381/4794] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:19 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1498 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:19.691599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:19.691599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:19.695475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:19.698571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:19.699419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:19.700580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:19.701291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:19.701953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:20.072164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:20.084597 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99d523d5-7ac9-4f44-a8e3-098d9dbce170 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.403361 Oct 27 09:25:20.085113 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2382/4795] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:19 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:20.088047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:25:20.088820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:25:20.088992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:25:20.089341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:25:20.089761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:25:20.091084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:20.092352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:20.099878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:20.100035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:20.100376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:20.100919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:20.101711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:20.102168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:20.102835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:20.103235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:20.103658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:20.103947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:20.104443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:20.104569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:20.125322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:25:20.131636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for user 0a9243ea430b4d2ba18c2a1e54e7c6aa and project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:25:20.146179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:25:20.148934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:25:20.204314 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e6c98417-bdd2-4d7e-8924-6ee35080f54a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.587183 Oct 27 09:25:20.211397 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2414/4796] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:25:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:25:20.216728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f61694aa-5256-44bb-ba03-d006c8718678 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:20.217365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f61694aa-5256-44bb-ba03-d006c8718678 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:20.222655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:20.247423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:20.252929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:20.255598 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cafa3b90-7153-471a-b13e-471eab9bf918 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.168844 Oct 27 09:25:20.268493 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2383/4797] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:20 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:20.334987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f61694aa-5256-44bb-ba03-d006c8718678 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:20.337629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:20.339148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:20.342401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f61694aa-5256-44bb-ba03-d006c8718678 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1212 microversion: 2.1 time: 0.129572 Oct 27 09:25:20.344472 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2415/4798] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:20 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1212 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:20.352928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:20.356922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:20.357484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:20.358328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:20.359137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:20.359680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:20.709638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:20.710264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:20.736956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:20.738229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:20.738935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:20.740966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:20.741867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:20.744443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:21.050688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:21.068605 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d12c4cf-7517-492c-bb0c-dcf256ac6a74 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1498 microversion: 2.1 time: 0.358073 Oct 27 09:25:21.069567 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2416/4799] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:20 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1498 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:21.087989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:21.111161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:21.112073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:21.127313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:21.134989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:21.137395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:21.141198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:21.142842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:21.146338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:21.148938 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7071fd87-8bca-494e-924b-e92210b5d2f0 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1493 microversion: 2.1 time: 0.783977 Oct 27 09:25:21.153530 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2384/4800] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:20 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1493 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:21.300293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:21.301002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:21.302897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:21.325913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:21.330111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:21.331911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:21.334652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:21.335223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:21.341583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:21.514231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:21.533975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:21.542336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:21.547469 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-841a857c-4c7d-48fc-b936-ae00e37103c3 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.248977 Oct 27 09:25:21.549269 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2385/4801] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:21 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:25:21.564284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:21.567128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:21.572625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:21.581406 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99667cad-ca45-43f0-b13b-428aa96adf47 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.474449 Oct 27 09:25:21.582751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:21.584666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:21.587297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:21.587719 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2417/4802] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:21 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:21.588337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:21.590304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:21.590868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:21.755259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:21.767519 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1bc0c76c-ec9d-4d9f-89bb-cd2359b74469 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1264 microversion: 2.1 time: 0.215731 Oct 27 09:25:21.768852 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2386/4803] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:21 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:22.092742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:22.094210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:22.103541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.105739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.109671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.111477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.112907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.115101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.182777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:22.183994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:22.192553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.193051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.193737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.194637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.195855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.196442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.532230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:22.542687 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0d7645c-7931-4acc-9b17-a34be5067173 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1499 microversion: 2.1 time: 0.369145 Oct 27 09:25:22.551940 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2387/4804] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:22 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1499 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:22.558290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:22.569121 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08fbff98-5d09-4820-a665-726533963562 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1498 microversion: 2.1 time: 0.480131 Oct 27 09:25:22.571423 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2418/4805] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:22 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1498 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:22.576302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:22.576903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:22.589660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:22.590434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:22.590562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.591629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.592278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.593205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.594541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.595181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.605766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.607486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.607486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.608306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.608780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.609219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.657382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:25:22.747589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:22.760482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:22.765367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:22.766627 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4786bc46-b3d1-4f27-af34-f8e98e48e46e tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1366 microversion: 2.57 time: 0.186737 Oct 27 09:25:22.767199 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2419/4806] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:22 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:25:22.777770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:22.778423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:22.794938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.795466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.795963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.796702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.797171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.797598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.824331 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e37906b0-a223-4429-a906-90207b6b6599 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 204 len: 0 microversion: 2.1 time: 0.256496 Oct 27 09:25:22.829346 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2388/4807] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:25:22 2022] DELETE /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:25:22.836892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:22.837944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:22.850577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.851552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.852369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:22.854530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:22.855261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:22.855916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:23.059440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:23.098767 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3af9928a-d57b-4fb1-8f55-35e78c9925d6 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1264 microversion: 2.1 time: 0.245923 Oct 27 09:25:23.099621 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2389/4808] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:22 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1264 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:23.107721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:23.114929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:23.135292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:23.135968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:23.136348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:23.137093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:23.137557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:23.137973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:23.612431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:23.659201 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cc4f3b4a-5350-4b22-97b6-c38e3dc46e27 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.887367 Oct 27 09:25:23.662132 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2420/4809] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:22 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:23.694005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:23.699128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:23.742141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:23.743825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:23.758904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:23.789758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:23.791323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:23.792902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:23.925986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:23.948484 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5db49469-3639-4376-b42b-ed537138651b tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.841976 Oct 27 09:25:23.950658 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2390/4810] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:23 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:23.965456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:23.969773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:24.004857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.005815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.006996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:24.009444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.010572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.011636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:24.161979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:24.172934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:24.180261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:24.183870 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6e3dedf-ee0c-4ab5-b71d-9fa6b902ffe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1372 microversion: 2.57 time: 0.230499 Oct 27 09:25:24.184489 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2391/4811] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:23 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:24.216211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:24.217479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:24.233742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.235359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.236750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:24.237617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.238094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.238529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:24.364336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:24.373460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:24.375697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:24.376910 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f711115f-fc85-4565-a445-94d171bc814a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1270 microversion: 2.1 time: 0.171686 Oct 27 09:25:24.383495 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6073ac8c-825d-4169-9aa0-bf29acfd689d tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1501 microversion: 2.1 time: 0.719519 Oct 27 09:25:24.392051 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2421/4812] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:23 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1501 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:24.395355 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2392/4813] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:24 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:24.440485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:24.442460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:24.452369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.453143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.453757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:24.455419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.456095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.456956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:24.503611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lazy-loading 'flavor' on Instance uuid a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:25:24.625852 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f655341-641e-4fa2-948d-327a4f7666c6 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "POST /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4/action" status: 202 len: 0 microversion: 2.1 time: 0.211694 Oct 27 09:25:24.628190 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2422/4814] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:25:24 2022] POST /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:25:24.642764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:24.643590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:24.667310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.667976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.668683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:24.669390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.676435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.676906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:24.698544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:24.700546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:24.708175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:24.729129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.732151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.736333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:24.738986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:24.740363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:24.743023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:25.175555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:25.197111 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f7fae91-cfbd-4740-9091-5265466b103f tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1509 microversion: 2.1 time: 0.564381 Oct 27 09:25:25.199297 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2393/4815] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:24 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1509 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:25.205378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:25.206252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:25.213221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:25.218756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:25.219858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:25.227368 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a351306c-f67a-47cb-80d3-49cd6664d978 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.541586 Oct 27 09:25:25.233097 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2423/4816] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:24 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:25.238633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:25.241253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:25.243262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:25.246028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:25.246629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:25.247073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:25.266843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:25.275255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:25.280089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:25.285095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:25.287341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:25.289828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:25.532416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:25.548222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:25.551363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:25.553449 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-431f3bcb-0609-43c9-b689-b75b885d46dd tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1372 microversion: 2.57 time: 0.318401 Oct 27 09:25:25.568582 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2424/4817] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:25 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1372 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:25.579916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:25.584169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:25.592411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:25.593138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:25.593828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:25.594616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:25.595160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:25.595690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:25.637386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:25.640517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:25.655647 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2229828b-2ae6-4903-912d-c8bb5428ed54 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 0.454561 Oct 27 09:25:25.662073 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2394/4818] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:25 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:25.712505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:25.727553 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49ec6879-27c3-4557-b422-3690d5eec2c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1270 microversion: 2.1 time: 0.157482 Oct 27 09:25:25.731409 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2425/4819] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:25 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:26.224447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:26.225706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:26.244447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:26.245513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:26.246268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:26.247131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:26.249309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:26.250956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:26.260922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:26.261614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:26.280120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:26.281031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:26.281494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:26.283943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:26.287614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:26.291431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:26.980755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:26.990071 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7845a77a-ac61-4748-bb27-2b564f81eef3 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1509 microversion: 2.1 time: 0.770097 Oct 27 09:25:27.004283 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2395/4820] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:26 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1509 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:27.012974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:27.014356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:27.022714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:27.024642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:27.025337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:27.026123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:27.026759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:27.027359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:27.059771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:27.075908 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba96e6bb-99fa-40d6-826b-9c850e8bf645 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.819835 Oct 27 09:25:27.079207 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2426/4821] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:26 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:27.093674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:27.094732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:27.108806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:27.109343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:27.109790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:27.110555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:27.111280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:27.111920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:27.393837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:27.408498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:27.410018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:27.411278 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5e844ab-b24d-45da-bcdd-21d1c4554fe9 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1372 microversion: 2.57 time: 0.405643 Oct 27 09:25:27.424585 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2396/4822] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:27 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1372 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:27.443628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:27.445293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:27.453926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:27.459099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:27.459969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:27.461035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:27.461771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:27.465722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:28.236172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:28.260606 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa29040a-298a-4467-843d-960aa38b79c3 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1270 microversion: 2.1 time: 0.834557 Oct 27 09:25:28.261359 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2397/4823] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:27 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1270 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:28.276535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:28.277826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:28.286588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:28.287438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:28.287935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:28.288423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:28.289151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:28.289618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:28.290050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:28.295785 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea7f9f36-7981-40e9-a854-9268ada2675c tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1505 microversion: 2.1 time: 1.213447 Oct 27 09:25:28.308403 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2427/4824] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:27 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1505 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:28.330413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:28.331321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:28.349572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:28.360310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:28.360951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:28.361854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:28.362476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:28.363028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:28.963030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:28.985254 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1f3bf98-c2e1-43a7-b810-6d05508615f9 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1492 microversion: 2.1 time: 0.722538 Oct 27 09:25:28.996953 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2398/4825] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:28 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1492 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:29.011766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:29.012795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:29.042519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.043515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.044164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.046706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.047535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.048430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.194156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:29.211386 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b893de34-671a-46a1-8583-5f5dd691d927 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.889220 Oct 27 09:25:29.227632 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2428/4826] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:28 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:29.234456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2bc8cbfb-41b9-479e-9ee6-4df040ea00f5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:29.235397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2bc8cbfb-41b9-479e-9ee6-4df040ea00f5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:29.265671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bc8cbfb-41b9-479e-9ee6-4df040ea00f5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.267031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bc8cbfb-41b9-479e-9ee6-4df040ea00f5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.268819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bc8cbfb-41b9-479e-9ee6-4df040ea00f5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.270035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bc8cbfb-41b9-479e-9ee6-4df040ea00f5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.270780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bc8cbfb-41b9-479e-9ee6-4df040ea00f5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.271461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bc8cbfb-41b9-479e-9ee6-4df040ea00f5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.379892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:29.425121 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2bc8cbfb-41b9-479e-9ee6-4df040ea00f5 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "POST /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4/action" status: 202 len: 0 microversion: 2.1 time: 0.195691 Oct 27 09:25:29.426400 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2429/4827] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:25:29 2022] POST /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:25:29.430721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:29.438666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-34c2baec-bc99-4590-a704-8ec4a874fb2f req-7161c848-44ee-4ebe-a039-13e903c3b235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b108df-4352-4265-a2cf-d1c1320c7323", "name": "network-vif-deleted", "tag": "bd9e92af-96e6-478c-8c6d-9713d08b0d9b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:29.440546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:29.449354 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7da6a0b-1dcf-4254-b5c6-646690853fe4 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1357 microversion: 2.57 time: 0.448231 Oct 27 09:25:29.451016 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2399/4828] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:28 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1357 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:29.458753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:29.461976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-34c2baec-bc99-4590-a704-8ec4a874fb2f req-7161c848-44ee-4ebe-a039-13e903c3b235 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.462416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:29.471052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-34c2baec-bc99-4590-a704-8ec4a874fb2f req-7161c848-44ee-4ebe-a039-13e903c3b235 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.471614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-34c2baec-bc99-4590-a704-8ec4a874fb2f req-7161c848-44ee-4ebe-a039-13e903c3b235 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.494529 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-34c2baec-bc99-4590-a704-8ec4a874fb2f req-7161c848-44ee-4ebe-a039-13e903c3b235 service nova] Creating event network-vif-deleted:bd9e92af-96e6-478c-8c6d-9713d08b0d9b for instance d1b108df-4352-4265-a2cf-d1c1320c7323 on n-h2-858383-16 Oct 27 09:25:29.515224 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-34c2baec-bc99-4590-a704-8ec4a874fb2f req-7161c848-44ee-4ebe-a039-13e903c3b235 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074593 Oct 27 09:25:29.516570 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2430/4829] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:25:29.522386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:29.526065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:29.549133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.551347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.560494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.561363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.562639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.563356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.564203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.564359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.572863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.576620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.580926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.582341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.722143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:29.726631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:29.727716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:29.729263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lazy-loading 'fault' on Instance uuid d1b108df-4352-4265-a2cf-d1c1320c7323 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:25:30.117340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:30.212796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:30.229021 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b968d9c7-199c-4361-b2ca-ad93d7282c44 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 200 len: 1304 microversion: 2.1 time: 0.704007 Oct 27 09:25:30.244097 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2431/4830] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:29 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 1304 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:30.249759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:30.253004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:30.261281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:30.262075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:30.262758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:30.263776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:30.264463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:30.265114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:30.343154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:31.262218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:31.271346 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3bde252b-c07e-4441-8361-14a37a209128 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 1.818771 Oct 27 09:25:31.290731 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2400/4831] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:29 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:31.296044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:31.296840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:31.303533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:31.304924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:31.305612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:31.306541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:31.307229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:31.307908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:31.361653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:25:31.510011 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-979a6e93-b9ed-42c4-8fd3-22cf96cb28f1 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 204 len: 0 microversion: 2.57 time: 0.217414 Oct 27 09:25:31.518489 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2401/4832] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:25:31 2022] DELETE /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:25:31.526367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:31.527435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:31.534208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:31.535128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:31.535981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:31.539705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:31.542513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:31.543313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:31.638597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:31.652062 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd670029-4937-4a9a-a5c3-401a36faae9b tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1498 microversion: 2.1 time: 1.406318 Oct 27 09:25:31.653841 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2432/4833] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:30 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1498 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:31.664447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:31.665582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: d1b108df-4352-4265-a2cf-d1c1320c7323] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:31.673868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:31.675610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:31.676382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:31.677594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:31.678663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:31.680010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:31.698074 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] HTTP exception thrown: Instance d1b108df-4352-4265-a2cf-d1c1320c7323 could not be found. Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Request method failure captured: Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 HTTP/1.1 Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk4C7fo4371ADGa2Uz2br1KM_oRBv3Fr7Ykyh81Qb-KJvSfYD9eFhI17iIFltgGmGOUceF5zXV5h8OjgaY7yT4ZY0-LZ_tqfRVogZMsqX7SVYbeOqwmyHaCVIES9iPsj1kiXETDdboeJuqHyWIENb0faxmRWHTGuoF5gfD5UhDCcR-I Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 66e0305f59424209ba883e5c0d6a832b Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerRescueTestJSON-1856219980 Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66e0305f59424209ba883e5c0d6a832b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66e0305f59424209ba883e5c0d6a832b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66e0305f59424209ba883e5c0d6a832b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66e0305f59424209ba883e5c0d6a832b"}]}] Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerRescueTestJSON-1856219980 Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 66e0305f59424209ba883e5c0d6a832b Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerRescueTestJSON-1856219980 Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerRescueTestJSON-1856219980-project Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: dd48e1cf5d1542cd9688c13aa2d9ef0d Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerRescueTestJSON-1856219980-project Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance d1b108df-4352-4265-a2cf-d1c1320c7323 could not be found. Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd1b108df-4352-4265-a2cf-d1c1320c7323'} Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1b108df-4352-4265-a2cf-d1c1320c7323 could not be found. Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1b108df-4352-4265-a2cf-d1c1320c7323 could not be found. Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:31.702821 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:31.711255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:31.711255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:31.711255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:31.711255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:25:31.711255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:25:31.711255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1b108df-4352-4265-a2cf-d1c1320c7323 could not be found. Oct 27 09:25:31.711255 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:31.715230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Returning 404 to user: Instance d1b108df-4352-4265-a2cf-d1c1320c7323 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:25:31.716450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5bfc49ae-b0f0-4f0b-9153-914024ec9c68 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323" status: 404 len: 111 microversion: 2.1 time: 0.061256 Oct 27 09:25:31.717276 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2433/4834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:31 2022] GET /compute/v2.1/servers/d1b108df-4352-4265-a2cf-d1c1320c7323 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:25:31.722502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:31.724299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:31.735620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:31.736495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:31.737160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:31.739047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:31.740069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:31.741458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:32.025702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:32.057274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:32.059418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:32.061075 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16c98f03-b41d-4e04-8a44-f8e2c881fb81 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1363 microversion: 2.57 time: 0.342452 Oct 27 09:25:32.062570 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2434/4835] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:31 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:32.071350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:32.072753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:32.083036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:32.083742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:32.084813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:32.087328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:32.087963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:32.088493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:32.152479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:25:32.260853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:32.292343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:32.307053 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1722261-642a-46ce-915d-c89a4f6bff13 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1512 microversion: 2.1 time: 0.786498 Oct 27 09:25:32.314812 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2402/4836] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:31 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1512 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:32.320866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:32.332424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:32.363239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:32.366457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:32.369327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:32.372859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:32.374698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:32.378431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:32.378708 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aed18339-4b8e-48d7-846a-963cab4a05a1 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "DELETE /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 204 len: 0 microversion: 2.1 time: 0.313273 Oct 27 09:25:32.383831 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2435/4837] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:25:32 2022] DELETE /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:25:32.395370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:32.403885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:32.422435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:32.424299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:32.425163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:32.426243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:32.427194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:32.427937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:33.681069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:33.692272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1ad77e1-e7f1-48b8-b724-c0a8c1964dc7 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1490 microversion: 2.1 time: 1.304765 Oct 27 09:25:33.692790 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2436/4838] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:32 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1490 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:33.720422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:33.723054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:33.730544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:33.731424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:33.732092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:33.733142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:33.733788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:33.734391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:33.939434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:33.949780 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5aa6bb6-3893-43f4-b655-32b991d0e698 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 1.633667 Oct 27 09:25:33.954726 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2403/4839] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:32 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:33.969880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:33.979185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:34.005174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:34.006930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:34.008153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:34.009242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:34.009938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:34.010587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:34.302322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:34.320503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:34.322431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a9e9ca3f61d4fda964a390545cda87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99e90f26af9436fac755c5bcb080363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:34.326420 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1cd9a388-982b-4e6b-8577-18924a12b2ea tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 200 len: 1363 microversion: 2.57 time: 0.368972 Oct 27 09:25:34.331960 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2404/4840] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:33 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:25:34.337757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:34.342512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:34.360611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:34.360948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:34.362214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:34.363453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:34.364160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:34.364788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:34.586713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:34.602679 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e0eac101-6f01-4cbc-87cf-9aa8c8a27639 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1498 microversion: 2.1 time: 0.899247 Oct 27 09:25:34.603345 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2437/4841] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:33 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1498 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:34.609871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1a956fe4-adc9-4b65-aed6-cc50867fdc93 req-ae3c03be-e2ca-457c-8bb3-64ee6a1daaec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28211658-ab52-4f84-8437-e68fd64c3693", "tag": "889f7bae-7a66-4b86-9f30-bb3ae20162a7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:34.631760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1a956fe4-adc9-4b65-aed6-cc50867fdc93 req-ae3c03be-e2ca-457c-8bb3-64ee6a1daaec service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:34.632592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1a956fe4-adc9-4b65-aed6-cc50867fdc93 req-ae3c03be-e2ca-457c-8bb3-64ee6a1daaec service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:34.633236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1a956fe4-adc9-4b65-aed6-cc50867fdc93 req-ae3c03be-e2ca-457c-8bb3-64ee6a1daaec service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:34.657431 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1a956fe4-adc9-4b65-aed6-cc50867fdc93 req-ae3c03be-e2ca-457c-8bb3-64ee6a1daaec service nova] Creating event network-changed:889f7bae-7a66-4b86-9f30-bb3ae20162a7 for instance 28211658-ab52-4f84-8437-e68fd64c3693 on n-h1-858383-16 Oct 27 09:25:34.670451 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1a956fe4-adc9-4b65-aed6-cc50867fdc93 req-ae3c03be-e2ca-457c-8bb3-64ee6a1daaec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063893 Oct 27 09:25:34.671622 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2438/4842] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:25:34.721184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:34.728502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:34.739945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:34.746544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:34.747229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:34.748478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:34.749155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:34.749785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:35.073092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:35.092702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af94f1aa-30e6-40f9-bd84-bcc1f6fe78d2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1489 microversion: 2.1 time: 0.757158 Oct 27 09:25:35.098420 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2405/4843] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:34 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1489 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:35.111199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:35.117337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:35.126523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:35.127308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:35.127996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:35.128956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:35.129603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:35.130242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:35.737991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:35.771438 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1efe6842-9be4-450a-bb82-18adf2d62782 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1490 microversion: 2.1 time: 1.052233 Oct 27 09:25:35.779049 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2439/4844] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:34 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1490 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:35.803826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c63bddb1-4e1e-4af7-a5a3-42f95c2973c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:35.817202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c63bddb1-4e1e-4af7-a5a3-42f95c2973c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:35.838223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c63bddb1-4e1e-4af7-a5a3-42f95c2973c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:35.838974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c63bddb1-4e1e-4af7-a5a3-42f95c2973c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:35.839796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c63bddb1-4e1e-4af7-a5a3-42f95c2973c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:35.840705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c63bddb1-4e1e-4af7-a5a3-42f95c2973c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:35.841335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c63bddb1-4e1e-4af7-a5a3-42f95c2973c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:35.841928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c63bddb1-4e1e-4af7-a5a3-42f95c2973c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:35.914753 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c63bddb1-4e1e-4af7-a5a3-42f95c2973c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 200 len: 143 microversion: 2.1 time: 0.133448 Oct 27 09:25:35.915547 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2440/4845] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:25:35 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 143 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:25:35.924600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:35.929845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] [instance: 4ee01e6e-1bf5-4427-89fd-be02492d6d8d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:35.946543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:35.947041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:35.947496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:35.954539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:35.955050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:35.955602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:35.963045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:35.981747 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1a91b17-9f46-468e-bba8-5743fdd389b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 0.881137 Oct 27 09:25:35.986967 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] HTTP exception thrown: Instance 4ee01e6e-1bf5-4427-89fd-be02492d6d8d could not be found. Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Request method failure captured: Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d HTTP/1.1 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk5WVaXPdfld25yUwkVpSdk1t0-ZX9SqS4UnM7J7LZaVHREzlI32a4BpGUh2tpRbz1wM2wuJwxlI1RnVaEWafDanCCPV7KmxYzUqy7whjM8HX-jbICyw2W3ySUNvc3FCYaFa6hSIjFlPYrIQkmHOXTtkk1Qk4Kaxbf5C06gWILESMdo Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.57 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e99e90f26af9436fac755c5bcb080363 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerShowV257Test-405600813 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e99e90f26af9436fac755c5bcb080363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e99e90f26af9436fac755c5bcb080363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e99e90f26af9436fac755c5bcb080363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e99e90f26af9436fac755c5bcb080363"}]}] Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerShowV257Test-405600813 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e99e90f26af9436fac755c5bcb080363 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerShowV257Test-405600813 Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerShowV257Test-405600813-project Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 4a9e9ca3f61d4fda964a390545cda87a Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerShowV257Test-405600813-project Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4ee01e6e-1bf5-4427-89fd-be02492d6d8d could not be found. Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4ee01e6e-1bf5-4427-89fd-be02492d6d8d'} Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee01e6e-1bf5-4427-89fd-be02492d6d8d could not be found. Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee01e6e-1bf5-4427-89fd-be02492d6d8d could not be found. Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:35.989103 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:35.995716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:35.995716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:35.995716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:35.995716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:25:35.995716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:25:35.995716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee01e6e-1bf5-4427-89fd-be02492d6d8d could not be found. Oct 27 09:25:35.995716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:25:35.997762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] Returning 404 to user: Instance 4ee01e6e-1bf5-4427-89fd-be02492d6d8d could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:25:35.998881 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f676a121-09b4-4f3a-a7f7-313f3362d788 tempest-ServerShowV257Test-405600813 tempest-ServerShowV257Test-405600813-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d" status: 404 len: 111 microversion: 2.57 time: 0.080993 Oct 27 09:25:36.003005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2406/4847] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:35 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:36.003299 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2441/4847] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:25:35 2022] GET /compute/v2.1/servers/4ee01e6e-1bf5-4427-89fd-be02492d6d8d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:25:36.010014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:36.010890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:36.014412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:36.014962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:36.019186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:36.020011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:36.020674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:36.021606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:36.022264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:36.023451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:36.053963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:36.054737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:36.055455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:36.059351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:36.060212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:36.060880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:36.860549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:36.885095 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-836eb2e7-1e6c-4f1e-9f32-b7bbcd76bdce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.879851 Oct 27 09:25:36.889576 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2442/4848] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:36 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:36.908908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:36.909885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:36.917009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:36.920787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:36.921450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:36.923231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:36.925307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:36.925955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:37.759189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:37.776866 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0def36b2-0c18-4939-b0d5-1a8556793ff2 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1501 microversion: 2.1 time: 1.772538 Oct 27 09:25:37.778178 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2407/4849] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:36 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1501 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:37.787717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:37.789160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:37.821154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:37.822724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:37.823282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:37.831388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:37.831963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:37.832607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:38.627137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd48e1cf5d1542cd9688c13aa2d9ef0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e0305f59424209ba883e5c0d6a832b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:38.637371 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fe3a88f3-9518-482a-a48e-eb0d97ce792a tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 200 len: 1490 microversion: 2.1 time: 1.746388 Oct 27 09:25:38.651890 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2443/4850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:36 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 1490 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:38.657115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:38.658141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:38.671592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:38.672622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:38.673297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:38.674451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:38.675875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:38.676573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:39.162365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:39.173313 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00bcab2e-5b6d-4fd6-aaab-e2007c753c8c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 1.393594 Oct 27 09:25:39.174090 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2408/4851] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:37 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:39.181126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-284c427c-200c-4bb7-ab26-b278b39786dc req-04e9796a-7cfd-46ba-8ac1-45a997ab2159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974227c6-3f96-4c8b-870b-caa84bf8a44c", "name": "network-vif-deleted", "tag": "6f292a2c-5fea-4293-a711-5fca4fbbb619"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:39.192702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-284c427c-200c-4bb7-ab26-b278b39786dc req-04e9796a-7cfd-46ba-8ac1-45a997ab2159 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:39.193600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-284c427c-200c-4bb7-ab26-b278b39786dc req-04e9796a-7cfd-46ba-8ac1-45a997ab2159 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:39.194727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-284c427c-200c-4bb7-ab26-b278b39786dc req-04e9796a-7cfd-46ba-8ac1-45a997ab2159 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:39.208787 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-284c427c-200c-4bb7-ab26-b278b39786dc req-04e9796a-7cfd-46ba-8ac1-45a997ab2159 service nova] Creating event network-vif-deleted:6f292a2c-5fea-4293-a711-5fca4fbbb619 for instance 974227c6-3f96-4c8b-870b-caa84bf8a44c on n-h1-858383-16 Oct 27 09:25:39.215749 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-284c427c-200c-4bb7-ab26-b278b39786dc req-04e9796a-7cfd-46ba-8ac1-45a997ab2159 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040072 Oct 27 09:25:39.216842 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2409/4852] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:25:39.223727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:39.224676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:39.231239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:39.231838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:39.232530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:39.233434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:39.234164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:39.234666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:39.251550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:39.267234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:25:39.381159 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f05a828d-8d6d-4c50-a4c9-c4cb11e24f66 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 204 len: 0 microversion: 2.1 time: 0.162138 Oct 27 09:25:39.383462 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2410/4853] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:25:39 2022] DELETE /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:25:39.390772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:39.391950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:39.402490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:39.403702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:39.404398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:39.405749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:39.406398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:39.407031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:39.407696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:39.419847 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4450d0f4-e6d4-43f2-81d0-4ae6fa6127d4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 0.778805 Oct 27 09:25:39.424230 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2444/4854] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:38 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:39.441695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:39.442646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:39.463440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:39.464260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:39.464886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:39.466492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:39.467150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:39.468617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:40.037144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:40.051234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:40.053317 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63adb4b5-f42c-42e4-b9de-e105c02f5944 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.667662 Oct 27 09:25:40.054360 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2411/4855] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:39 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:40.061145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:40.062042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] [instance: 974227c6-3f96-4c8b-870b-caa84bf8a44c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:40.071291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc1c832c-a315-4916-b932-bc80243b977e tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1507 microversion: 2.1 time: 0.637348 Oct 27 09:25:40.076356 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2445/4856] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:39 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1507 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:40.076356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:40.076356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:40.097406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:40.098028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:40.099783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:40.101662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:40.106151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:40.106669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:40.107719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:40.108298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:40.110411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:40.113310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:40.116245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:40.116924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:40.142275 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] HTTP exception thrown: Instance 974227c6-3f96-4c8b-870b-caa84bf8a44c could not be found. Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Request method failure captured: Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c HTTP/1.1 Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk4C7fo4371ADGa2Uz2br1KM_oRBv3Fr7Ykyh81Qb-KJvSfYD9eFhI17iIFltgGmGOUceF5zXV5h8OjgaY7yT4ZY0-LZ_tqfRVogZMsqX7SVYbeOqwmyHaCVIES9iPsj1kiXETDdboeJuqHyWIENb0faxmRWHTGuoF5gfD5UhDCcR-I Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 66e0305f59424209ba883e5c0d6a832b Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueTestJSON-1856219980 Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66e0305f59424209ba883e5c0d6a832b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_66e0305f59424209ba883e5c0d6a832b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/66e0305f59424209ba883e5c0d6a832b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/66e0305f59424209ba883e5c0d6a832b"}]}] Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueTestJSON-1856219980 Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 66e0305f59424209ba883e5c0d6a832b Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueTestJSON-1856219980 Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerRescueTestJSON-1856219980-project Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: dd48e1cf5d1542cd9688c13aa2d9ef0d Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueTestJSON-1856219980-project Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 974227c6-3f96-4c8b-870b-caa84bf8a44c could not be found. Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '974227c6-3f96-4c8b-870b-caa84bf8a44c'} Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974227c6-3f96-4c8b-870b-caa84bf8a44c could not be found. Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974227c6-3f96-4c8b-870b-caa84bf8a44c could not be found. Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:40.144391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:40.150226 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:40.150226 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:40.150226 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:40.150226 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:25:40.150226 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:25:40.150226 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974227c6-3f96-4c8b-870b-caa84bf8a44c could not be found. Oct 27 09:25:40.150226 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:40.154661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] Returning 404 to user: Instance 974227c6-3f96-4c8b-870b-caa84bf8a44c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:25:40.156277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8099f6de-081b-47a4-b8d8-db897b065a10 tempest-ServerRescueTestJSON-1856219980 tempest-ServerRescueTestJSON-1856219980-project] 10.222.0.25 "GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c" status: 404 len: 111 microversion: 2.1 time: 0.100410 Oct 27 09:25:40.159514 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2412/4857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:40 2022] GET /compute/v2.1/servers/974227c6-3f96-4c8b-870b-caa84bf8a44c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:25:40.450681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:40.451863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:40.467577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:40.471248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:40.472200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:40.474467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:40.476951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:40.477733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:40.503380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:40.518670 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4323bb29-3e86-4434-8286-e975bd3f6205 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.440577 Oct 27 09:25:40.519495 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2446/4858] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:40 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:40.785146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-832701567", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "9cad971b-61f2-43dd-8137-4ee7400ac93f"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:40.863266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:40.881218 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e4c7cb0-ad51-4b3d-bc64-aa5eb8424701 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 0.434511 Oct 27 09:25:40.885179 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2413/4859] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:40 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:40.918241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] validate_networks() for [('9cad971b-61f2-43dd-8137-4ee7400ac93f', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:25:41.102900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:41.103805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:41.130171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:41.133194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:41.134745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:41.136031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:41.138045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:41.145251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:41.935294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:41.952514 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ccdd1405-04ee-4b7b-8a5a-9df87dc99e76 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1507 microversion: 2.1 time: 0.852448 Oct 27 09:25:41.956160 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2414/4860] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:41 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1507 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:41.964707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:41.966217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:41.976083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:41.976707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:41.977238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:41.978322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:41.978792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:41.979230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:42.439909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:42.459866 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aef39bd7-19dc-461e-9b32-0e388dad2d9d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 0.500319 Oct 27 09:25:42.463367 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2415/4861] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:41 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:42.795143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:25:42.795745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:25:42.796319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:25:42.796790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:25:42.797210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:25:42.819972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:42.820475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:42.820925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:42.821733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:42.827361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:42.828120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:42.876288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:25:42.903724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for user 9301fb54a8734e1ab31e496add7e9446 and project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:25:42.952344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:25:42.954748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:25:42.989239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:42.990525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:43.004980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:43.005419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:43.005873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:43.010673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:43.011622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:43.019661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:43.030134 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba9dc2cc-b747-46ee-b435-551fb9802ea1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.247792 Oct 27 09:25:43.033419 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2447/4862] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:25:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:25:43.046236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcde2e2b-9e0b-4e71-a820-661c6d3d0b42 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:43.047363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bcde2e2b-9e0b-4e71-a820-661c6d3d0b42 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:43.327314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:43.342498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc5c9567-22b9-495d-9fe7-e4fb41dc2793 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1465 microversion: 2.1 time: 0.365391 Oct 27 09:25:43.343239 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2416/4863] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:42 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1465 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:43.363632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bcde2e2b-9e0b-4e71-a820-661c6d3d0b42 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:43.374303 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bcde2e2b-9e0b-4e71-a820-661c6d3d0b42 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1214 microversion: 2.1 time: 0.333364 Oct 27 09:25:43.376146 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2448/4864] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:43 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:43.486583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:43.487230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:43.505264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:43.505953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:43.507009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:43.509689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:43.510196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:43.510684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:44.021278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3043c07d-74d7-48cf-a01e-db8ca9cce0f6 req-f98c79b4-0cf6-40d6-8f29-4e14b76a49f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a151c8b1-fd00-4cff-9a2d-355d1a8b29f4", "name": "network-vif-deleted", "tag": "ca2a75e9-d4b5-48ad-af78-7e40a902a8c4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:44.066198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3043c07d-74d7-48cf-a01e-db8ca9cce0f6 req-f98c79b4-0cf6-40d6-8f29-4e14b76a49f0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:44.067083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3043c07d-74d7-48cf-a01e-db8ca9cce0f6 req-f98c79b4-0cf6-40d6-8f29-4e14b76a49f0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:44.068728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3043c07d-74d7-48cf-a01e-db8ca9cce0f6 req-f98c79b4-0cf6-40d6-8f29-4e14b76a49f0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:44.081852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:44.090744 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-471fbfea-dab0-4c52-b519-48e9a361cfb4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 0.609005 Oct 27 09:25:44.113875 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2417/4865] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:43 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:44.116247 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3043c07d-74d7-48cf-a01e-db8ca9cce0f6 req-f98c79b4-0cf6-40d6-8f29-4e14b76a49f0 service nova] Creating event network-vif-deleted:ca2a75e9-d4b5-48ad-af78-7e40a902a8c4 for instance a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 on n-h2-858383-16 Oct 27 09:25:44.132855 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3043c07d-74d7-48cf-a01e-db8ca9cce0f6 req-f98c79b4-0cf6-40d6-8f29-4e14b76a49f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116439 Oct 27 09:25:44.133806 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2449/4866] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:25:44.372094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:44.372990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:44.388421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:44.390578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:44.392263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:44.394956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:44.396616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:44.398113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:44.404483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:44.405230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:44.419320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:44.419874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:44.420343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:44.425059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:44.425801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:44.426428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:44.583692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:44.586668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:44.587169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:44.588932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lazy-loading 'fault' on Instance uuid a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:25:44.651045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:44.669260 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19a55ed7-3e93-4e62-9d0e-97c3c1e08334 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1210 microversion: 2.1 time: 0.266830 Oct 27 09:25:44.672526 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2450/4867] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:44 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1210 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:44.797655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23d35c82d354dbcbddfd74248baf624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d04be7f44f4c78970ff8549a75de9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:44.807231 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3ccb7de-4d57-423f-8c24-1fbd7fe2e1d7 tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 200 len: 1305 microversion: 2.1 time: 0.440828 Oct 27 09:25:44.809098 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2418/4868] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:44 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 1305 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:45.122932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:45.123736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:45.139455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:45.140418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:45.143791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:45.144756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:45.145506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:45.146214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:45.698578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:45.699206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:45.706855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:45.717841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:45.718292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:45.719055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:45.719522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:45.720015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:46.005714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:46.017215 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b6a2c82-349a-4024-8bde-bd0379e2bfee tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1272 microversion: 2.1 time: 0.322403 Oct 27 09:25:46.039870 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2419/4869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:45 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1272 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:46.054710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:46.055343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] [instance: a151c8b1-fd00-4cff-9a2d-355d1a8b29f4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:46.077609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:46.082666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:46.083677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:46.086471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:46.087170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:46.088873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:46.123315 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] HTTP exception thrown: Instance a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 could not be found. Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Request method failure captured: Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 HTTP/1.1 Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk5RF2EXFPRw_SJineGYupi8wxiTW89r57t3GsH9wnSiZKr7fUlmOouU_TJKzvV8EMXxja38RYhGX-18fMR6HTVPvSL3se0Z4AAl8CAKx2oTH-v_YXjCa2y5tqeWhqQKxNE7tH3Iw5C_UmMA4NHFEX4VSEXvRi0AiW3LlBqtcuFXPno Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 94d04be7f44f4c78970ff8549a75de9e Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestServerAdvancedOps-982216629 Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94d04be7f44f4c78970ff8549a75de9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94d04be7f44f4c78970ff8549a75de9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94d04be7f44f4c78970ff8549a75de9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94d04be7f44f4c78970ff8549a75de9e"}]}] Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestServerAdvancedOps-982216629 Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 94d04be7f44f4c78970ff8549a75de9e Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestServerAdvancedOps-982216629 Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestServerAdvancedOps-982216629-project Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: f23d35c82d354dbcbddfd74248baf624 Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestServerAdvancedOps-982216629-project Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 could not be found. Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'a151c8b1-fd00-4cff-9a2d-355d1a8b29f4'} Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 could not be found. Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 could not be found. Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:25:46.128007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:46.135018 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:25:46.135018 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:25:46.135018 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:25:46.135018 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:25:46.135018 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:25:46.135018 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 could not be found. Oct 27 09:25:46.135018 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:25:46.142342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] Returning 404 to user: Instance a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:25:46.143625 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc19d6da-f734-471e-923f-99fd04dbbeea tempest-TestServerAdvancedOps-982216629 tempest-TestServerAdvancedOps-982216629-project] 10.222.0.25 "GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4" status: 404 len: 111 microversion: 2.1 time: 0.102627 Oct 27 09:25:46.145490 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2420/4870] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:46 2022] GET /compute/v2.1/servers/a151c8b1-fd00-4cff-9a2d-355d1a8b29f4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:25:46.826511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:46.836385 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61a3b04a-04e3-4c0e-9967-72b525a89dbf tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 1.718391 Oct 27 09:25:46.841381 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2451/4871] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:45 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:47.047442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:47.048929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:47.064887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:47.065725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:47.069579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:47.070636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:47.071362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:47.072668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:47.854662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:47.871755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:47.874723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:47.890117 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c2127e5-e0b4-4e9b-84da-64bc5a58297f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1314 microversion: 2.1 time: 0.843661 Oct 27 09:25:47.910264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:47.911672 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2421/4872] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:47 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1314 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:47.913143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:47.913986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:47.915382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:47.916089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:47.916715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:48.556801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:48.570153 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1132930b-b0e8-4046-8fe5-25aeaba5ce77 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 0.706187 Oct 27 09:25:48.573504 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2452/4873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:47 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:48.893131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3f1427f3-83e4-4df9-97af-239d61593d58 req-aeb31d4a-b382-45ce-86c8-ad17e3a23b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28211658-ab52-4f84-8437-e68fd64c3693", "name": "network-vif-plugged", "status": "completed", "tag": "889f7bae-7a66-4b86-9f30-bb3ae20162a7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:48.918232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:48.918865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:48.950764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3f1427f3-83e4-4df9-97af-239d61593d58 req-aeb31d4a-b382-45ce-86c8-ad17e3a23b46 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:48.951139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3f1427f3-83e4-4df9-97af-239d61593d58 req-aeb31d4a-b382-45ce-86c8-ad17e3a23b46 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:48.951596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3f1427f3-83e4-4df9-97af-239d61593d58 req-aeb31d4a-b382-45ce-86c8-ad17e3a23b46 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:48.960388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:48.960951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:48.961416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:48.962184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:48.962641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:48.970787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:48.997203 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3f1427f3-83e4-4df9-97af-239d61593d58 req-aeb31d4a-b382-45ce-86c8-ad17e3a23b46 service nova] Creating event network-vif-plugged:889f7bae-7a66-4b86-9f30-bb3ae20162a7 for instance 28211658-ab52-4f84-8437-e68fd64c3693 on n-h1-858383-16 Oct 27 09:25:49.012619 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3f1427f3-83e4-4df9-97af-239d61593d58 req-aeb31d4a-b382-45ce-86c8-ad17e3a23b46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365091 Oct 27 09:25:49.013833 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2422/4874] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:25:49.604191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:49.605243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:49.618800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:49.628793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:49.629957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:49.636179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:49.636991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:49.637646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:50.324464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:50.346802 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9ceca4d5-65b7-41e1-a6e9-7c8e7e023b84 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1314 microversion: 2.1 time: 1.430092 Oct 27 09:25:50.347806 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2453/4875] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:48 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1314 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:50.664839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:50.679775 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5806fa8-9fe6-41ee-8e08-78fa2761133a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1312 microversion: 2.1 time: 1.079609 Oct 27 09:25:50.680395 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2423/4876] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:49 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1312 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:51.372730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:51.373482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:51.384249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:51.385027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:51.385988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:51.387295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:51.387793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:51.388413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:51.716498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:51.718150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:51.729727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:51.732115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:51.732842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:51.733387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:51.734271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:51.734835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:51.738413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:51.930941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:51.941718 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ca4b46f6-acf7-45ce-8b84-1f315e6671b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1314 microversion: 2.1 time: 0.574004 Oct 27 09:25:51.942997 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2454/4877] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:51 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:52.127000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-33881921-38d8-4e31-b9b6-118109a855c1 req-e2b7169f-cd6f-4839-8eaf-e66b782021dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab076d0-2bc7-41aa-aa63-c3c351810229", "tag": "6bf65e73-b72e-4706-9d24-1fdf324db41f"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:52.145866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-33881921-38d8-4e31-b9b6-118109a855c1 req-e2b7169f-cd6f-4839-8eaf-e66b782021dc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:52.146548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-33881921-38d8-4e31-b9b6-118109a855c1 req-e2b7169f-cd6f-4839-8eaf-e66b782021dc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:52.148416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-33881921-38d8-4e31-b9b6-118109a855c1 req-e2b7169f-cd6f-4839-8eaf-e66b782021dc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:52.171066 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-33881921-38d8-4e31-b9b6-118109a855c1 req-e2b7169f-cd6f-4839-8eaf-e66b782021dc service nova] Creating event network-changed:6bf65e73-b72e-4706-9d24-1fdf324db41f for instance 4ab076d0-2bc7-41aa-aa63-c3c351810229 on n-h1-858383-16 Oct 27 09:25:52.177197 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-33881921-38d8-4e31-b9b6-118109a855c1 req-e2b7169f-cd6f-4839-8eaf-e66b782021dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055198 Oct 27 09:25:52.179401 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2455/4878] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:25:52.272638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:52.288520 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd536474-efad-4e12-8b53-f30681109d20 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1500 microversion: 2.1 time: 0.585235 Oct 27 09:25:52.306400 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2424/4879] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:51 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1500 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:52.316435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b207aae-77c6-41bb-bee3-b07c401a3e1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:52.324232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b207aae-77c6-41bb-bee3-b07c401a3e1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:52.324799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b207aae-77c6-41bb-bee3-b07c401a3e1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:52.325250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b207aae-77c6-41bb-bee3-b07c401a3e1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:52.355911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:52.370914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b207aae-77c6-41bb-bee3-b07c401a3e1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Going to try to stop instance {{(pid=120602) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:25:52.447414 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b207aae-77c6-41bb-bee3-b07c401a3e1a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693/action" status: 202 len: 0 microversion: 2.1 time: 0.136103 Oct 27 09:25:52.449588 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2456/4880] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:25:52 2022] POST /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:25:52.463279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:52.466846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:52.479096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:52.479759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:52.480319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:52.481345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:52.482086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:52.482733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:52.802272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:52.818194 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3146a6cd-66bd-4fbf-abec-ee1a2d98ad4d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 0.360353 Oct 27 09:25:52.820192 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2425/4881] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:52 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:52.970064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:52.970787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:52.992807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:53.004874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:53.005433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:53.005885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:53.007539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:53.008327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:53.008958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:53.370084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:53.753935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:53.776450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62425bc7-08c1-4797-b307-3a12f2b35cc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1314 microversion: 2.1 time: 0.807489 Oct 27 09:25:53.778482 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2457/4882] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:52 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:53.856295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:53.856939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:53.879955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:53.881294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:53.881294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:53.885097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:53.886794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:53.888378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:54.804083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:54.805875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:54.814826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:54.825142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:54.833038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:54.833811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:54.835445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:54.836227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:54.837442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:55.130655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:55.147053 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e9e3e9d-bd4a-4836-9dfd-8a867064410c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 1.298482 Oct 27 09:25:55.148787 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2426/4883] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:53 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:55.547047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:55.564075 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-76565c17-4631-4cfa-a635-3dca49c4e207 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1314 microversion: 2.1 time: 0.763315 Oct 27 09:25:55.566327 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2458/4884] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:54 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:56.182112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:56.183847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-30e73ca3-b2ee-4d4b-97a4-a54bc706c51d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:56.185038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:56.192587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e73ca3-b2ee-4d4b-97a4-a54bc706c51d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:56.194915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e73ca3-b2ee-4d4b-97a4-a54bc706c51d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:56.196206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e73ca3-b2ee-4d4b-97a4-a54bc706c51d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:56.199656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e73ca3-b2ee-4d4b-97a4-a54bc706c51d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:56.203214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e73ca3-b2ee-4d4b-97a4-a54bc706c51d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:56.204747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30e73ca3-b2ee-4d4b-97a4-a54bc706c51d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:56.212247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:56.215497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:56.217261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:56.221432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:56.222279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:56.223978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:56.254451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:25:56.293629 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-30e73ca3-b2ee-4d4b-97a4-a54bc706c51d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.729829 Oct 27 09:25:56.297044 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2427/4885] 10.222.0.25 () {58 vars in 1185 bytes} [Thu Oct 27 09:25:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:25:56.561898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-715936560", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "availability_zone": "nova:n-h2-858383-16", "networks": [{"uuid": "88bdd59f-4979-432a-b28e-4286d08e7f84"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:25:56.691418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] validate_networks() for [('88bdd59f-4979-432a-b28e-4286d08e7f84', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:25:57.659587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:57.676247 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9da2de1f-1301-4024-854b-a074a5dfdae9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 1.507542 Oct 27 09:25:57.681473 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2459/4886] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:56 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:25:57.687617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:57.688433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:57.706527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:57.707351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:57.708043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:57.710091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:57.710846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:57.711596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:58.625933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:58.661074 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-118d24c5-2317-4fc6-9756-822ce2af9e5e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1314 microversion: 2.1 time: 0.977742 Oct 27 09:25:58.672750 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2460/4887] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:57 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:58.710842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:58.711464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:58.728355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:58.728795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:58.729213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:58.729937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:58.730398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:58.730824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:59.413058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:25:59.414774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:25:59.415586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:25:59.416212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:25:59.416958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:25:59.435802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:25:59.447072 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31cee6b6-1c8b-41a2-8d7c-1e2ceb1071b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 0.743000 Oct 27 09:25:59.467270 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2461/4888] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:58 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:25:59.475511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:59.476462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:59.477218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:59.478533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:59.479336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:59.479941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:59.549950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Getting quotas for project e3d4527580694ac4a5a0f4d0ac00b173. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:25:59.571111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Getting quotas for user 33f5f0d58d974dd4999f1ff92452117d and project e3d4527580694ac4a5a0f4d0ac00b173. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:25:59.629706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:25:59.634935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:25:59.692611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:59.694128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:25:59.723309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:59.727484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:59.729744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:59.736094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:25:59.738670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:25:59.744107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:25:59.792903 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2d4efdbd-5c87-4d11-8fb0-ec6010848f56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.241417 Oct 27 09:25:59.804935 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2428/4889] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:25:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:25:59.817760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-771af16b-8f93-4e6c-9b8f-a1a49ba88d60 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:25:59.819861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-771af16b-8f93-4e6c-9b8f-a1a49ba88d60 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:00.099216 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-771af16b-8f93-4e6c-9b8f-a1a49ba88d60 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1328 microversion: 2.1 time: 0.286998 Oct 27 09:26:00.107238 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2429/4890] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:59 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:00.477923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:00.484357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:00.525596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:00.534491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:00.535452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:00.536944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:00.538020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:00.541236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:01.664135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:01.715800 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b94a9cd-18b1-4566-b1eb-d6755159490a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1314 microversion: 2.1 time: 2.025613 Oct 27 09:26:01.718549 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2462/4891] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:25:59 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1314 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:01.744430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:01.752706 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec34dd2d-fdd8-485b-a1b4-d7084c4aa5b0 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 1.282785 Oct 27 09:26:01.753320 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2430/4892] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:00 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:01.763866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b46789a5-2aaf-455b-9643-e0dfb3692ed2 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:01.764914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b46789a5-2aaf-455b-9643-e0dfb3692ed2 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:01.772356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b46789a5-2aaf-455b-9643-e0dfb3692ed2 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:01.776096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b46789a5-2aaf-455b-9643-e0dfb3692ed2 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:01.776697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b46789a5-2aaf-455b-9643-e0dfb3692ed2 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:01.779906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b46789a5-2aaf-455b-9643-e0dfb3692ed2 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:01.780526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b46789a5-2aaf-455b-9643-e0dfb3692ed2 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:01.781058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b46789a5-2aaf-455b-9643-e0dfb3692ed2 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:01.890577 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b46789a5-2aaf-455b-9643-e0dfb3692ed2 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1345 microversion: 2.1 time: 0.167839 Oct 27 09:26:01.893723 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2463/4893] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:01 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:02.089843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-127645430", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:02.207158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1243736920", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": "none"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:02.266022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] validate_networks() for [('50c6db4e-db8b-44ab-b99d-c1c74e5a0258', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:26:02.351181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:26:02.354708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:26:02.355486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:26:02.360056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:26:02.360763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:26:02.382184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:02.382687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:02.383243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:02.384064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:02.384545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:02.384986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:02.433186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Getting quotas for project 33cf106de6424278bf2d278203028332. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:26:02.450052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Getting quotas for user 7f08f02f7bcd4a598227a654fbcc4f8b and project 33cf106de6424278bf2d278203028332. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:26:02.481440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:26:02.492208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: 8a03cd75-f39a-4970-81a8-f591686b16cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:26:02.617968 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f51e7276-227d-480b-9a7a-fe853d0614a5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.722621 Oct 27 09:26:02.618922 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2464/4894] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:26:02.635390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd290c3e-37e3-42a9-ad30-01e1f34fd626 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:02.638456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd290c3e-37e3-42a9-ad30-01e1f34fd626 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: 8a03cd75-f39a-4970-81a8-f591686b16cd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:02.801538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd290c3e-37e3-42a9-ad30-01e1f34fd626 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:02.846029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd290c3e-37e3-42a9-ad30-01e1f34fd626 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:02.849288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd290c3e-37e3-42a9-ad30-01e1f34fd626 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:02.852204 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd290c3e-37e3-42a9-ad30-01e1f34fd626 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd" status: 200 len: 1278 microversion: 2.47 time: 0.224970 Oct 27 09:26:02.868010 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2465/4895] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:02 2022] GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:02.907160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:02.923520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:02.940711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:02.941760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:02.942731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:02.944884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:02.946322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:02.947481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:03.846868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:03.855201 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-464f99a4-c030-4bb0-adce-d20db8eebc37 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1314 microversion: 2.1 time: 0.985142 Oct 27 09:26:03.855898 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2466/4896] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:02 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:04.227851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:04.230111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:04.243057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:04.244191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:04.245789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:04.246888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:04.252446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:04.253284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:04.632308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:26:04.633462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:26:04.633966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:26:04.634506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:26:04.634904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:26:04.657516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:04.658521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:04.659475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:04.660578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:04.661300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:04.662684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:04.689648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Getting quotas for project 91b12f02b2d745179ce7300489278d6e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:26:04.696857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Getting quotas for user 57dce47ed98f48d5ba1c8dd744fdbead and project 91b12f02b2d745179ce7300489278d6e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:26:04.722755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:26:04.727410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:26:04.817767 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-813e0398-d26a-4b69-8d79-53dff445c3ec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.063313 Oct 27 09:26:04.821508 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2431/4897] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:26:04.831141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78361b9a-dd3a-43b8-9409-57df1cb19a79 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:04.860086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78361b9a-dd3a-43b8-9409-57df1cb19a79 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:04.868960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78361b9a-dd3a-43b8-9409-57df1cb19a79 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:04.869477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78361b9a-dd3a-43b8-9409-57df1cb19a79 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:04.870110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78361b9a-dd3a-43b8-9409-57df1cb19a79 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:04.872632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78361b9a-dd3a-43b8-9409-57df1cb19a79 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:04.873630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78361b9a-dd3a-43b8-9409-57df1cb19a79 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:04.874253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78361b9a-dd3a-43b8-9409-57df1cb19a79 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:05.212125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:05.218373 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78361b9a-dd3a-43b8-9409-57df1cb19a79 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1423 microversion: 2.1 time: 0.391810 Oct 27 09:26:05.220031 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2432/4898] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:04 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1423 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:05.232897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-400ae9fd-329b-45bc-8919-ce9c61071585 req-5d4adeaa-3387-40bf-ac5d-ce3c9d8fb288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab076d0-2bc7-41aa-aa63-c3c351810229", "name": "network-vif-plugged", "status": "completed", "tag": "6bf65e73-b72e-4706-9d24-1fdf324db41f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:05.245559 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ab97174a-ccf0-4551-b8c2-52e46613590b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 1.369621 Oct 27 09:26:05.250263 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2467/4899] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:03 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:05.262495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-505133205", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": "none"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:05.276458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-400ae9fd-329b-45bc-8919-ce9c61071585 req-5d4adeaa-3387-40bf-ac5d-ce3c9d8fb288 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:05.277308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-400ae9fd-329b-45bc-8919-ce9c61071585 req-5d4adeaa-3387-40bf-ac5d-ce3c9d8fb288 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:05.280631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-400ae9fd-329b-45bc-8919-ce9c61071585 req-5d4adeaa-3387-40bf-ac5d-ce3c9d8fb288 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:05.355960 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-400ae9fd-329b-45bc-8919-ce9c61071585 req-5d4adeaa-3387-40bf-ac5d-ce3c9d8fb288 service nova] Creating event network-vif-plugged:6bf65e73-b72e-4706-9d24-1fdf324db41f for instance 4ab076d0-2bc7-41aa-aa63-c3c351810229 on n-h1-858383-16 Oct 27 09:26:05.373075 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-400ae9fd-329b-45bc-8919-ce9c61071585 req-5d4adeaa-3387-40bf-ac5d-ce3c9d8fb288 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145867 Oct 27 09:26:05.390257 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2433/4900] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:26:05.392608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:26:05.393162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:26:05.393670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:26:05.394091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:26:05.397099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:26:05.404288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f247154-e6a6-4644-b020-7417d6d182c0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:05.406840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f247154-e6a6-4644-b020-7417d6d182c0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:05.435436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:05.437220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:05.438206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:05.439513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:05.440367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:05.441025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:05.510754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Getting quotas for project 33cf106de6424278bf2d278203028332. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:26:05.522803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Getting quotas for user 7f08f02f7bcd4a598227a654fbcc4f8b and project 33cf106de6424278bf2d278203028332. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:26:05.543870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:26:05.546362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:26:05.701475 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-033d205e-cac7-4bd4-8819-246107ca700c tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.448994 Oct 27 09:26:05.706301 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2468/4901] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Oct 27 09:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:26:05.722605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:05.723543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:05.749832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:05.750807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:05.751479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:05.752307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:05.752998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:05.753834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:05.962483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f247154-e6a6-4644-b020-7417d6d182c0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:05.987452 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f247154-e6a6-4644-b020-7417d6d182c0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1216 microversion: 2.1 time: 0.595535 Oct 27 09:26:05.998605 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2434/4902] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:05 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1216 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:06.016541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abd4543e-146b-4283-b173-1b661bc05a2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:06.030407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abd4543e-146b-4283-b173-1b661bc05a2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:06.140543 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abd4543e-146b-4283-b173-1b661bc05a2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "PUT /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 991 microversion: 2.47 time: 0.138788 Oct 27 09:26:06.157800 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2435/4903] 10.222.0.25 () {62 vars in 1297 bytes} [Thu Oct 27 09:26:05 2022] PUT /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 991 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:26:06.172516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d61368f0-1c37-44a7-b8fb-37f8793a96ae tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:06.173308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d61368f0-1c37-44a7-b8fb-37f8793a96ae tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:06.490154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d61368f0-1c37-44a7-b8fb-37f8793a96ae tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:06.514218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d61368f0-1c37-44a7-b8fb-37f8793a96ae tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:06.530830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d61368f0-1c37-44a7-b8fb-37f8793a96ae tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:06.541399 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d61368f0-1c37-44a7-b8fb-37f8793a96ae tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1277 microversion: 2.47 time: 0.380193 Oct 27 09:26:06.548768 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2436/4904] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:06 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1277 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:26:06.578794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4987ddfc-49ea-49ae-bcdf-6fcc42289e5d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:06.586792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4987ddfc-49ea-49ae-bcdf-6fcc42289e5d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:06.653469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4987ddfc-49ea-49ae-bcdf-6fcc42289e5d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:06.661187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4987ddfc-49ea-49ae-bcdf-6fcc42289e5d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:06.664027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4987ddfc-49ea-49ae-bcdf-6fcc42289e5d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:06.669210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4987ddfc-49ea-49ae-bcdf-6fcc42289e5d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:06.670133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4987ddfc-49ea-49ae-bcdf-6fcc42289e5d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:06.676059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4987ddfc-49ea-49ae-bcdf-6fcc42289e5d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:06.774279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:06.792834 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bbf454e5-4e19-4840-b94d-68d7ed5b8e32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1314 microversion: 2.1 time: 1.080906 Oct 27 09:26:06.794057 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2469/4905] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:05 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:06.800210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:06.801130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:06.817616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:06.819818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:06.820535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:06.821518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:06.822190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:06.822812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:07.498953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:07.501249 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4987ddfc-49ea-49ae-bcdf-6fcc42289e5d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.945066 Oct 27 09:26:07.503418 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2437/4906] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:06 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:07.514990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:07.515730 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9389da03-19cb-40d9-8bf5-3c463fb76d30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 0.720175 Oct 27 09:26:07.516829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:07.539117 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2470/4907] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:06 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:07.539632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:07.541030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:07.541749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:07.543301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:07.544034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:07.546839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:07.571472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:07.572181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:07.578778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:07.589475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:07.590225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:07.592038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:07.594966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:07.595769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:07.940463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:07.975458 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10846533-87cb-4528-989b-6dd238e12075 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1268 microversion: 2.1 time: 0.469133 Oct 27 09:26:07.977584 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2438/4908] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:07 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1268 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:08.003370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:08.005057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:08.047543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:08.049082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:08.050240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:08.051947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:08.053401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:08.054553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:08.313653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:08.331153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:08.333579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:08.336891 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6d5c4a0-9974-4027-9fe4-e230f7efa21e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1273 microversion: 2.47 time: 0.769591 Oct 27 09:26:08.338501 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2471/4909] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:07 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1273 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:08.528622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7611f2f-f44f-436d-9515-a17f2db56472 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:08.529281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7611f2f-f44f-436d-9515-a17f2db56472 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:08.548317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7611f2f-f44f-436d-9515-a17f2db56472 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:08.549188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7611f2f-f44f-436d-9515-a17f2db56472 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:08.549964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7611f2f-f44f-436d-9515-a17f2db56472 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:08.550608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7611f2f-f44f-436d-9515-a17f2db56472 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:08.551077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7611f2f-f44f-436d-9515-a17f2db56472 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:08.551504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7611f2f-f44f-436d-9515-a17f2db56472 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:09.327786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:09.375168 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ad32b6c-dc0b-4657-b2ff-082a1d8ae461 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1501 microversion: 2.1 time: 1.395158 Oct 27 09:26:09.379907 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2439/4910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:07 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1501 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:09.398694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:09.402324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:09.422058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:09.429880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:09.430667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:09.431600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:09.435756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:09.437057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:09.480188 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7611f2f-f44f-436d-9515-a17f2db56472 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.955710 Oct 27 09:26:09.481493 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2472/4911] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:08 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:09.490786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:09.496072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:09.509052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:09.510064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:09.510563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:09.511497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:09.512231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:09.512781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:09.980344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:10.004092 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ea9eb9b-faae-48b2-888b-bcb87af6db2c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1274 microversion: 2.1 time: 0.515805 Oct 27 09:26:10.004895 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2473/4912] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:09 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1274 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:10.017037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:10.018199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:10.040918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:10.041756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:10.042443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:10.043414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:10.050899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:10.051659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:10.102333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:11.055405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:11.076718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:11.081151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:11.084603 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f988e105-dacb-421e-87a7-b8b938cfff29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1335 microversion: 2.47 time: 1.076956 Oct 27 09:26:11.092489 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2474/4913] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:10 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1335 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:11.104923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9b59a1a5-4390-4bf2-89c6-f2df5116fb0b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:11.113108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9b59a1a5-4390-4bf2-89c6-f2df5116fb0b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:11.124315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b59a1a5-4390-4bf2-89c6-f2df5116fb0b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:11.128133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:11.130066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b59a1a5-4390-4bf2-89c6-f2df5116fb0b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:11.134736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b59a1a5-4390-4bf2-89c6-f2df5116fb0b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:11.137943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b59a1a5-4390-4bf2-89c6-f2df5116fb0b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:11.138163 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9045d6ea-f30a-445b-8f5b-d85be86a7512 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 1.754646 Oct 27 09:26:11.141611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b59a1a5-4390-4bf2-89c6-f2df5116fb0b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:11.142435 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2440/4914] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:09 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:11.142690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b59a1a5-4390-4bf2-89c6-f2df5116fb0b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:11.154663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-518746bb-5b20-4e0e-b89e-205563987914 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:11.160695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-518746bb-5b20-4e0e-b89e-205563987914 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:11.176759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-518746bb-5b20-4e0e-b89e-205563987914 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:11.180897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-518746bb-5b20-4e0e-b89e-205563987914 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:11.181655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-518746bb-5b20-4e0e-b89e-205563987914 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:11.182587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-518746bb-5b20-4e0e-b89e-205563987914 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:11.185815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-518746bb-5b20-4e0e-b89e-205563987914 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:11.195087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-518746bb-5b20-4e0e-b89e-205563987914 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:11.721442 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9b59a1a5-4390-4bf2-89c6-f2df5116fb0b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action" status: 200 len: 14 microversion: 2.1 time: 0.626992 Oct 27 09:26:11.722616 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2475/4915] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:11 2022] POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action => generated 14 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:26:11.741976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:11.748916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:11.789398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:11.790178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:11.790664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:11.791479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:11.791999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:11.792443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:12.238335 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-518746bb-5b20-4e0e-b89e-205563987914 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 1.089919 Oct 27 09:26:12.265433 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2441/4916] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:11 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:12.272720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:12.273934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:12.283415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:12.284940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:12.286278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:12.288070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:12.288903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:12.289649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:12.993009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:13.024619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:13.031163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:13.033308 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be9a65ae-68c6-4e16-9785-1d3a19413dc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1316 microversion: 2.1 time: 1.309175 Oct 27 09:26:13.033905 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2476/4917] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:11 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1316 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:13.035128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:13.040727 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fceb60d7-bdf0-45f2-921f-bb1ae1fc733a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1335 microversion: 2.47 time: 0.771478 Oct 27 09:26:13.060552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:13.064936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:13.088570 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2442/4918] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:12 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1335 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:13.092535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:13.093372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:13.097216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:13.103705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:13.103918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5618a51c-c8fc-46db-b853-5a1c24e1baf6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:13.106920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:13.107609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:13.122362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5618a51c-c8fc-46db-b853-5a1c24e1baf6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:13.141258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5618a51c-c8fc-46db-b853-5a1c24e1baf6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:13.141755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5618a51c-c8fc-46db-b853-5a1c24e1baf6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:13.142406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5618a51c-c8fc-46db-b853-5a1c24e1baf6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:13.143318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5618a51c-c8fc-46db-b853-5a1c24e1baf6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:13.145294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5618a51c-c8fc-46db-b853-5a1c24e1baf6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:13.146727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5618a51c-c8fc-46db-b853-5a1c24e1baf6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:13.238665 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5618a51c-c8fc-46db-b853-5a1c24e1baf6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action" status: 200 len: 14 microversion: 2.1 time: 0.148587 Oct 27 09:26:13.240256 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2443/4919] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:13 2022] POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:26:13.270493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-765df3fe-f940-42f5-b177-b3b9769bc69d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:13.271269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-765df3fe-f940-42f5-b177-b3b9769bc69d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:13.303296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765df3fe-f940-42f5-b177-b3b9769bc69d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:13.304184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765df3fe-f940-42f5-b177-b3b9769bc69d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:13.304845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765df3fe-f940-42f5-b177-b3b9769bc69d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:13.305788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765df3fe-f940-42f5-b177-b3b9769bc69d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:13.309344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765df3fe-f940-42f5-b177-b3b9769bc69d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:13.310218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-765df3fe-f940-42f5-b177-b3b9769bc69d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:14.252088 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-765df3fe-f940-42f5-b177-b3b9769bc69d tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.989722 Oct 27 09:26:14.268798 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2444/4920] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:13 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:14.334173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:14.345178 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4a8d0098-2bbf-46b6-9635-6e52afffa59d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 1.302818 Oct 27 09:26:14.346381 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2477/4921] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:13 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:14.353447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:14.354309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:14.363168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:14.363986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:14.364652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:14.365873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:14.366554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:14.368474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:14.447042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a6a67934-245e-4f1c-97d1-c8a424b2998a req-ae58e33f-3f60-4adb-bd41-fa7336a99235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d69b0c-245f-49f3-82a8-97337afb18de", "tag": "55769c6d-541b-4d04-bbb3-7ceda852ab9c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:14.461167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6a67934-245e-4f1c-97d1-c8a424b2998a req-ae58e33f-3f60-4adb-bd41-fa7336a99235 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:14.462101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6a67934-245e-4f1c-97d1-c8a424b2998a req-ae58e33f-3f60-4adb-bd41-fa7336a99235 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:14.462711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6a67934-245e-4f1c-97d1-c8a424b2998a req-ae58e33f-3f60-4adb-bd41-fa7336a99235 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:14.475787 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a6a67934-245e-4f1c-97d1-c8a424b2998a req-ae58e33f-3f60-4adb-bd41-fa7336a99235 service nova] Creating event network-changed:55769c6d-541b-4d04-bbb3-7ceda852ab9c for instance 18d69b0c-245f-49f3-82a8-97337afb18de on n-h2-858383-16 Oct 27 09:26:14.481796 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a6a67934-245e-4f1c-97d1-c8a424b2998a req-ae58e33f-3f60-4adb-bd41-fa7336a99235 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211477 Oct 27 09:26:14.483905 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2445/4922] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:26:14.491617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:14.492805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:14.501968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:14.502466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:14.503944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:14.506454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:14.507462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:14.508541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:14.676892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:14.753470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:14.772332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:14.777448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:14.778973 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3299f02a-87f6-4d01-abe9-b62dbdf1d5e0 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1356 microversion: 2.47 time: 0.293881 Oct 27 09:26:14.781778 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2446/4923] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:14 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1356 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:14.790635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0db64591-8ced-431e-aa65-eede337a786c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:14.792899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0db64591-8ced-431e-aa65-eede337a786c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:14.821646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db64591-8ced-431e-aa65-eede337a786c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:14.822161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db64591-8ced-431e-aa65-eede337a786c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:14.822609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db64591-8ced-431e-aa65-eede337a786c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:14.823337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db64591-8ced-431e-aa65-eede337a786c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:14.828601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db64591-8ced-431e-aa65-eede337a786c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:14.829757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db64591-8ced-431e-aa65-eede337a786c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:14.907556 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0db64591-8ced-431e-aa65-eede337a786c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action" status: 200 len: 14 microversion: 2.1 time: 0.124051 Oct 27 09:26:14.908638 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2447/4924] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:14 2022] POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:26:14.938296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:14.943773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:14.952453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:14.953259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:14.953879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:14.954831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:14.955450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:14.956126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.116536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:26:15.117508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:26:15.118222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:26:15.118849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:26:15.119453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:26:15.219387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:15.238425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:15.247443 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2c365c6a-91cd-464b-a456-595185f49d75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1316 microversion: 2.1 time: 0.897858 Oct 27 09:26:15.252362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.253222 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2478/4925] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:14 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1316 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:15.254065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.254741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.255680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.256293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.256868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.283233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2df6213-7dfd-492c-ae39-e964d98df512 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:15.284222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e2df6213-7dfd-492c-ae39-e964d98df512 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:15.298442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2df6213-7dfd-492c-ae39-e964d98df512 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.300203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2df6213-7dfd-492c-ae39-e964d98df512 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.301860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2df6213-7dfd-492c-ae39-e964d98df512 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.310286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2df6213-7dfd-492c-ae39-e964d98df512 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.315074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2df6213-7dfd-492c-ae39-e964d98df512 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.318620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2df6213-7dfd-492c-ae39-e964d98df512 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.374552 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6380b0bb-0349-4d61-ac1e-21126aabacef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "POST /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965/action" status: 202 len: 1078 microversion: 2.47 time: 0.450000 Oct 27 09:26:15.389733 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2448/4926] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Oct 27 09:26:14 2022] POST /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965/action => generated 1078 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 27 09:26:15.406586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:15.407234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:15.427319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.427837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.428286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.429008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.429468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.429892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.495098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:15.533712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=14 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:15.886418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:15.888842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:15.895035 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e2df6213-7dfd-492c-ae39-e964d98df512 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.615949 Oct 27 09:26:15.897761 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2479/4927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:15 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:15.899354 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a864789e-1721-41c1-9dd8-f7ba994029d2 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 0.503338 Oct 27 09:26:15.909362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:15.913432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:15.920281 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2449/4928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:15 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:15.926917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.931641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.932395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.932883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-575f3c68-eb78-420b-8b86-3d17a7ce9418 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:15.933905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.935727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-575f3c68-eb78-420b-8b86-3d17a7ce9418 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:15.936478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.937244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.944586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:15.946547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575f3c68-eb78-420b-8b86-3d17a7ce9418 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.947291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575f3c68-eb78-420b-8b86-3d17a7ce9418 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.948015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575f3c68-eb78-420b-8b86-3d17a7ce9418 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:15.948824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575f3c68-eb78-420b-8b86-3d17a7ce9418 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:15.949354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575f3c68-eb78-420b-8b86-3d17a7ce9418 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:15.950009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-575f3c68-eb78-420b-8b86-3d17a7ce9418 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:16.030656 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-575f3c68-eb78-420b-8b86-3d17a7ce9418 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action" status: 200 len: 14 microversion: 2.1 time: 0.104957 Oct 27 09:26:16.032395 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2450/4929] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:15 2022] POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:26:16.093766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:16.131107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:16.148017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:16.149406 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1123e077-95ea-4af1-b2bf-ded84434ebfb tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.248163 Oct 27 09:26:16.150005 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2480/4930] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:15 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:16.279501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:16.282765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:16.301865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:16.312527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:16.317018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:16.319496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:16.320233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:16.343546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:16.499752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=18 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:16.527178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-56ce5761-752c-4c15-b9b5-d72540d411b0 req-91d71b2a-01cc-430e-823b-ee1cbf61239b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f35f23-0b67-4a55-8c3e-3950fac6b97a", "tag": "fe701430-2ee5-4174-b187-9c3bbd60c9e6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:16.541400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-56ce5761-752c-4c15-b9b5-d72540d411b0 req-91d71b2a-01cc-430e-823b-ee1cbf61239b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:16.541878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-56ce5761-752c-4c15-b9b5-d72540d411b0 req-91d71b2a-01cc-430e-823b-ee1cbf61239b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:16.542307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-56ce5761-752c-4c15-b9b5-d72540d411b0 req-91d71b2a-01cc-430e-823b-ee1cbf61239b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:16.554833 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-56ce5761-752c-4c15-b9b5-d72540d411b0 req-91d71b2a-01cc-430e-823b-ee1cbf61239b service nova] Creating event network-changed:fe701430-2ee5-4174-b187-9c3bbd60c9e6 for instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a on n-h1-858383-16 Oct 27 09:26:16.564839 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-56ce5761-752c-4c15-b9b5-d72540d411b0 req-91d71b2a-01cc-430e-823b-ee1cbf61239b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038359 Oct 27 09:26:16.565715 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2481/4931] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:26:16.637204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:16.652064 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94143a4e-7811-4bbb-95a2-de71d58e5d29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1316 microversion: 2.1 time: 0.381548 Oct 27 09:26:16.653240 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2451/4932] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:16 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:16.936299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:16.937648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:16.946370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:16.947369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:16.948087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:16.949146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:16.949866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:16.950567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:16.952955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af239f81-77d0-420c-bfc9-a3bc12725972 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:16.955735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af239f81-77d0-420c-bfc9-a3bc12725972 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:16.965071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af239f81-77d0-420c-bfc9-a3bc12725972 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:16.971805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af239f81-77d0-420c-bfc9-a3bc12725972 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:16.972918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af239f81-77d0-420c-bfc9-a3bc12725972 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:16.977729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af239f81-77d0-420c-bfc9-a3bc12725972 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:16.978971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af239f81-77d0-420c-bfc9-a3bc12725972 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:16.979729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af239f81-77d0-420c-bfc9-a3bc12725972 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:17.274580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:17.283732 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af239f81-77d0-420c-bfc9-a3bc12725972 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.335973 Oct 27 09:26:17.284292 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-318d9275-ec58-4a19-9cc1-9ac511d4365b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 0.353501 Oct 27 09:26:17.286803 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2452/4933] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:16 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:17.293466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9be6a48b-07a8-441b-ad69-a0248e27b93e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:17.297144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9be6a48b-07a8-441b-ad69-a0248e27b93e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:17.305635 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2482/4934] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:16 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:17.308426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be6a48b-07a8-441b-ad69-a0248e27b93e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:17.309178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be6a48b-07a8-441b-ad69-a0248e27b93e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:17.310778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be6a48b-07a8-441b-ad69-a0248e27b93e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:17.312247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be6a48b-07a8-441b-ad69-a0248e27b93e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:17.313326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be6a48b-07a8-441b-ad69-a0248e27b93e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:17.313770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:17.314192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9be6a48b-07a8-441b-ad69-a0248e27b93e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:17.314390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:17.328369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:17.332517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:17.334753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:17.337585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:17.339281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:17.339988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:17.465240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:17.490735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:17.493083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:17.494753 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a9f3e2a-8988-49d3-aec5-e586af74918d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.187953 Oct 27 09:26:17.511668 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2483/4935] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:17 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:17.674270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:17.674980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:17.681452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:17.687065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:17.688081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:17.688739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:17.689186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:17.690225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:18.711784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:18.727249 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9be6a48b-07a8-441b-ad69-a0248e27b93e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action" status: 200 len: 14 microversion: 2.1 time: 1.438567 Oct 27 09:26:18.727993 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fe08f28b-94ed-4932-9012-36a90b33b1b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1316 microversion: 2.1 time: 1.057421 Oct 27 09:26:18.738875 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2453/4936] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:17 2022] POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action => generated 14 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:26:18.746258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2484/4937] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:17 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1316 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:18.751224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:18.751907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:18.772631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:18.778746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:18.779208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:18.780298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:18.780456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:18.781075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:18.782323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ad6b239-ece6-418d-8c6a-84691b4e5781 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:18.783040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ad6b239-ece6-418d-8c6a-84691b4e5781 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:18.815470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad6b239-ece6-418d-8c6a-84691b4e5781 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:18.816486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad6b239-ece6-418d-8c6a-84691b4e5781 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:18.817164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad6b239-ece6-418d-8c6a-84691b4e5781 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:18.822818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad6b239-ece6-418d-8c6a-84691b4e5781 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:18.824375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad6b239-ece6-418d-8c6a-84691b4e5781 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:18.825508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad6b239-ece6-418d-8c6a-84691b4e5781 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:19.392401 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ad6b239-ece6-418d-8c6a-84691b4e5781 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.648299 Oct 27 09:26:19.393061 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2454/4938] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:18 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:19.416573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:19.417519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:19.426324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:19.427848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:19.428583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:19.429919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:19.432829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:19.433509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:19.737375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:19.748753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:19.751183 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-533b2698-1bc3-498e-af6b-9336e1aa4955 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1510 microversion: 2.1 time: 1.003678 Oct 27 09:26:19.756277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2485/4939] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:18 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1510 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:19.775981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:19.779032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:19.781252 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00c7af9b-edb9-4c7a-9466-7e564816aeef tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.370862 Oct 27 09:26:19.782281 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2455/4940] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:19 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:19.793387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d560f46-5e0a-4b8c-adb7-77025e033720 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:19.803419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8d560f46-5e0a-4b8c-adb7-77025e033720 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:19.803894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:19.806893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:19.825716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d560f46-5e0a-4b8c-adb7-77025e033720 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:19.831289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:19.831946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d560f46-5e0a-4b8c-adb7-77025e033720 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:19.839427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d560f46-5e0a-4b8c-adb7-77025e033720 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:19.840301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:19.841870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d560f46-5e0a-4b8c-adb7-77025e033720 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:19.842412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:19.843267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:19.843958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d560f46-5e0a-4b8c-adb7-77025e033720 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:19.844430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:19.844957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d560f46-5e0a-4b8c-adb7-77025e033720 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:19.845506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:19.914313 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d560f46-5e0a-4b8c-adb7-77025e033720 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action" status: 200 len: 14 microversion: 2.1 time: 0.156409 Oct 27 09:26:19.915334 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2486/4941] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:19 2022] POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:26:20.271418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:20.290916 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9814ea85-f05f-44de-a166-a3b26f008066 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1316 microversion: 2.1 time: 0.506720 Oct 27 09:26:20.292250 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2456/4942] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:19 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:20.423197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f52ca17e-6546-4771-931b-7db045f6e7bb tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:20.424578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f52ca17e-6546-4771-931b-7db045f6e7bb tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:20.447351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f52ca17e-6546-4771-931b-7db045f6e7bb tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:20.449675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f52ca17e-6546-4771-931b-7db045f6e7bb tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:20.451983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f52ca17e-6546-4771-931b-7db045f6e7bb tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:20.455361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f52ca17e-6546-4771-931b-7db045f6e7bb tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:20.456955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f52ca17e-6546-4771-931b-7db045f6e7bb tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:20.459392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f52ca17e-6546-4771-931b-7db045f6e7bb tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:20.780267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:20.781008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:20.795236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:20.795774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:20.796225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:20.796962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:20.797433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:20.797874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:21.252800 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f52ca17e-6546-4771-931b-7db045f6e7bb tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.835754 Oct 27 09:26:21.267917 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2487/4943] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:20 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:21.272134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:21.273236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:21.284296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:21.288787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:21.289461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:21.293974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:21.294740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:21.295357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:21.715326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:21.731931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:21.736436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:21.737752 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64cb69fe-638b-4268-a17d-49eb23bf963d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.480310 Oct 27 09:26:21.751595 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2488/4944] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:21 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:21.751595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c87777a-85a2-4874-82b1-f305723612e3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:21.762797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c87777a-85a2-4874-82b1-f305723612e3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:21.780509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c87777a-85a2-4874-82b1-f305723612e3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:21.781026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c87777a-85a2-4874-82b1-f305723612e3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:21.781479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c87777a-85a2-4874-82b1-f305723612e3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:21.785717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c87777a-85a2-4874-82b1-f305723612e3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:21.786817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c87777a-85a2-4874-82b1-f305723612e3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:21.787276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c87777a-85a2-4874-82b1-f305723612e3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:21.876223 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c87777a-85a2-4874-82b1-f305723612e3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action" status: 200 len: 8178 microversion: 2.1 time: 0.132550 Oct 27 09:26:21.878278 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2489/4945] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:21 2022] POST /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229/action => generated 8178 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:21.884292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:21.888034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:21.906157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:21.906666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:21.907109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:21.907876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:21.908338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:21.908772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:21.958953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:21.973061 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1935a299-0cab-46c9-ae12-a906c0f3d536 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1487 microversion: 2.1 time: 1.194898 Oct 27 09:26:21.979889 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2457/4946] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:20 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1487 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:21.985181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:21.998863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:22.062048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:22.077495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:22.078237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:22.089049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:22.091173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:22.094371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.075099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:23.092076 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-30d745a9-9f19-4938-b089-e4130fb71277 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 1.110181 Oct 27 09:26:23.115958 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2458/4947] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:21 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:23.143059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:23.143869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:23.147870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:23.156873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.157585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.158306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.161090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.161925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.162622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.187274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f2e44de5-a505-40c4-a56e-19ad61a7a59c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1316 microversion: 2.1 time: 1.303720 Oct 27 09:26:23.188188 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2490/4948] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:21 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1316 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:23.206285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:26:23.207032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7e109d8f-50b8-459c-ab4f-f63ac14db4aa tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:23.207698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7e109d8f-50b8-459c-ab4f-f63ac14db4aa tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:23.240900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e109d8f-50b8-459c-ab4f-f63ac14db4aa tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.242753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e109d8f-50b8-459c-ab4f-f63ac14db4aa tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.243426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e109d8f-50b8-459c-ab4f-f63ac14db4aa tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.246452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e109d8f-50b8-459c-ab4f-f63ac14db4aa tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.247028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e109d8f-50b8-459c-ab4f-f63ac14db4aa tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.249654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e109d8f-50b8-459c-ab4f-f63ac14db4aa tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.358740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92d86d6a-b4b0-4205-bdee-668899286a73 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 204 len: 0 microversion: 2.1 time: 0.229166 Oct 27 09:26:23.359683 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2459/4949] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:26:23 2022] DELETE /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:26:23.366323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:23.367496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:23.377102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.378065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.379448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.381171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.381809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.382452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.508568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:23.529996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:23.532181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:23.533899 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-90c1972d-2255-4dbd-b176-fdb0e8af4353 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.172632 Oct 27 09:26:23.535439 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2460/4950] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:23 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:23.546852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:23.548057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:23.555516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.556363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.557160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.558136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.558772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.559479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.759021 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7e109d8f-50b8-459c-ab4f-f63ac14db4aa tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.564740 Oct 27 09:26:23.760085 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2491/4951] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:23 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:23.785843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:23.787115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:23.795540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.797198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.797873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:23.798805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:23.799446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:23.800463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:24.172625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:24.209420 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a51d818-5603-493c-9f45-3bb88e5e6ef5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.668524 Oct 27 09:26:24.223608 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2461/4952] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:23 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:24.223608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:24.223608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:24.243457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:24.244090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:24.244592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:24.245419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:24.245882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:24.246353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:24.627822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:24.631890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:24.640615 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d57b0d7a-8fae-4d26-a76e-f135af887c78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1493 microversion: 2.1 time: 0.863720 Oct 27 09:26:24.641864 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2492/4953] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:23 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1493 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:24.649229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:24.651188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:24.661953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:24.664671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:24.665411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:24.666032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:24.667323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:24.668938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:24.669707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:25.026896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:25.040671 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9da45e0b-33db-42f5-b8a8-4ff52ba989d4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1316 microversion: 2.1 time: 0.826655 Oct 27 09:26:25.052221 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2462/4954] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:24 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1316 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:25.057394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:25.061049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:25.079557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:25.080074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:25.080513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:25.081246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:25.081707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:25.082634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:25.325614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:25.344545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:25.347523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:25.354131 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-86dbebc3-4b8a-4abe-94dc-fb73804ee42f tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.309308 Oct 27 09:26:25.391368 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2463/4955] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:25 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:25.404654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:25.405550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5faf852d-043c-442d-8037-ea2e7cee2f05 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:25.406949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5faf852d-043c-442d-8037-ea2e7cee2f05 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:25.420904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5faf852d-043c-442d-8037-ea2e7cee2f05 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:25.421496 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f4226bdb-82fa-43d9-b8de-5271cec5dd7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.778118 Oct 27 09:26:25.422766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5faf852d-043c-442d-8037-ea2e7cee2f05 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:25.423295 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2493/4956] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:24 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:25.424027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5faf852d-043c-442d-8037-ea2e7cee2f05 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:25.425133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5faf852d-043c-442d-8037-ea2e7cee2f05 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:25.426323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5faf852d-043c-442d-8037-ea2e7cee2f05 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:25.428185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5faf852d-043c-442d-8037-ea2e7cee2f05 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:25.446531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:25.447459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:25.460337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:25.463784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:25.465384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:25.466212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:25.469470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:25.475950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:26.197679 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5faf852d-043c-442d-8037-ea2e7cee2f05 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.799284 Oct 27 09:26:26.198759 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2464/4957] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:25 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:26.244078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:26.244708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:26.260962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:26.261825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:26.262731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:26.264382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:26.265137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:26.265955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:26.295644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:26.421809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:26.446402 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f6bb047-0276-4ab0-be71-b60ea8b922b1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 1.004684 Oct 27 09:26:26.447948 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2494/4958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:25 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:26.461882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:26.465743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:26.472574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:26.473328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:26.474515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:26.475728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:26.478745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:26.479482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:27.362170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:27.374356 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-12bad0f9-a188-44d1-b1db-540f0df2e29c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1316 microversion: 2.1 time: 0.920792 Oct 27 09:26:27.375873 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2495/4959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:26 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1316 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:27.399883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:27.400972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:27.408353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:27.409256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:27.409939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:27.410944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:27.413188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:27.414551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:27.544261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:27.566756 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04a34022-3beb-438e-a86c-63c626aece30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1493 microversion: 2.1 time: 1.330099 Oct 27 09:26:27.569619 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2465/4960] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:26 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1493 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:27.577994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:27.579006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:27.589942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:27.590731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:27.591432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:27.592444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:27.593156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:27.594023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:27.700534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:27.701168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Locking {{(pid=120603) lock /opt/stack/nova/nova/compute/api.py:4846}} Oct 27 09:26:27.761484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:27.775833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:27.780975 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c9f0ef23-68d8-42df-9a61-6c66e7418f54 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.383179 Oct 27 09:26:27.806140 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2496/4961] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:27 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:27.822863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19c1458a-5694-45f0-98fe-0a33d3ec0231 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:27.826485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19c1458a-5694-45f0-98fe-0a33d3ec0231 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:27.839547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19c1458a-5694-45f0-98fe-0a33d3ec0231 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:27.840397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19c1458a-5694-45f0-98fe-0a33d3ec0231 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:27.841046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19c1458a-5694-45f0-98fe-0a33d3ec0231 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:27.843285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19c1458a-5694-45f0-98fe-0a33d3ec0231 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:27.844021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19c1458a-5694-45f0-98fe-0a33d3ec0231 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:27.844468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19c1458a-5694-45f0-98fe-0a33d3ec0231 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:27.860892 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13154999-c1ab-4a29-9072-524741b58a4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.289348 Oct 27 09:26:27.861705 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2466/4962] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:27 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:26:27.874434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-23914049-2b70-4cb7-9655-f9d2a0647a8b req-2e574b32-b0cb-4c23-9611-0640d1bb7d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f35f23-0b67-4a55-8c3e-3950fac6b97a", "name": "network-vif-plugged", "status": "completed", "tag": "fe701430-2ee5-4174-b187-9c3bbd60c9e6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:27.917211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-23914049-2b70-4cb7-9655-f9d2a0647a8b req-2e574b32-b0cb-4c23-9611-0640d1bb7d7a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:27.917211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-23914049-2b70-4cb7-9655-f9d2a0647a8b req-2e574b32-b0cb-4c23-9611-0640d1bb7d7a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:27.917211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-23914049-2b70-4cb7-9655-f9d2a0647a8b req-2e574b32-b0cb-4c23-9611-0640d1bb7d7a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:27.962818 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-23914049-2b70-4cb7-9655-f9d2a0647a8b req-2e574b32-b0cb-4c23-9611-0640d1bb7d7a service nova] Creating event network-vif-plugged:fe701430-2ee5-4174-b187-9c3bbd60c9e6 for instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a on n-h1-858383-16 Oct 27 09:26:27.977337 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-23914049-2b70-4cb7-9655-f9d2a0647a8b req-2e574b32-b0cb-4c23-9611-0640d1bb7d7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114181 Oct 27 09:26:27.988345 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2467/4963] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:26:28.012191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:28.012910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:28.028107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:28.028634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:28.029083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:28.029820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:28.030300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:28.030728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:28.699816 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19c1458a-5694-45f0-98fe-0a33d3ec0231 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.891129 Oct 27 09:26:28.711375 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2497/4964] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:27 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:28.725923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-24e4bb51-ddd6-4543-aa07-545e31ad5242 req-d8751650-17c6-412a-9eb2-98bb6dcbabad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28211658-ab52-4f84-8437-e68fd64c3693", "name": "network-vif-deleted", "tag": "889f7bae-7a66-4b86-9f30-bb3ae20162a7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:28.751688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-24e4bb51-ddd6-4543-aa07-545e31ad5242 req-d8751650-17c6-412a-9eb2-98bb6dcbabad service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:28.755638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-24e4bb51-ddd6-4543-aa07-545e31ad5242 req-d8751650-17c6-412a-9eb2-98bb6dcbabad service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:28.756709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-24e4bb51-ddd6-4543-aa07-545e31ad5242 req-d8751650-17c6-412a-9eb2-98bb6dcbabad service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:28.758964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:28.773877 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-24e4bb51-ddd6-4543-aa07-545e31ad5242 req-d8751650-17c6-412a-9eb2-98bb6dcbabad service nova] Creating event network-vif-deleted:889f7bae-7a66-4b86-9f30-bb3ae20162a7 for instance 28211658-ab52-4f84-8437-e68fd64c3693 on n-h1-858383-16 Oct 27 09:26:28.777175 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87eea1b1-6259-4089-b039-4874c69dfe57 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.782130 Oct 27 09:26:28.780597 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2468/4965] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:27 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:28.788520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:28.789658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:28.798745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:28.799542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:28.800340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:28.803675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:28.804665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:28.805766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:28.805967 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-24e4bb51-ddd6-4543-aa07-545e31ad5242 req-d8751650-17c6-412a-9eb2-98bb6dcbabad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092315 Oct 27 09:26:28.808755 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2498/4966] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:26:28.821220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:28.822224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:28.838769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:28.842560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:28.843300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:28.845269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:28.845918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:28.849324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:28.903840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:28.904589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:28.906103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:28.908695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lazy-loading 'fault' on Instance uuid 28211658-ab52-4f84-8437-e68fd64c3693 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:26:29.112358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:29.125041 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-21e95a34-45f1-46e9-8bc5-fa08168a5ee4 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 200 len: 1302 microversion: 2.1 time: 0.314728 Oct 27 09:26:29.126699 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2499/4967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:28 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 1302 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:29.134826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d9721589-915f-4de5-aa02-677d561fbca8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:29.153505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9721589-915f-4de5-aa02-677d561fbca8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.155554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9721589-915f-4de5-aa02-677d561fbca8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.158803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9721589-915f-4de5-aa02-677d561fbca8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:29.209221 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d9721589-915f-4de5-aa02-677d561fbca8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] HTTP exception thrown: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 is locked Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d9721589-915f-4de5-aa02-677d561fbca8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Request method failure captured: Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action HTTP/1.1 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 15 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk1NW1iFAG-q3IJ54oZWfKh3CNO_EF5jnXqA5GerkUeJ0txazj2zZzKz-nqsGtjcUfQhqSuw6yfredcMS8g-HG6ROlJPAHneL3NK_xneNortyFwBSnbXAd0hTWoUi0UNK79Omwrb2gPcxkPGuECxlTUoaG3jfeC-ZD9oWt5dtdc8Pbk Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4c5d43a28c24b63b960932c678d0858"}]}] Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-666323554 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9301fb54a8734e1ab31e496add7e9446 Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: {"os-stop": {}} Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 is locked Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985', 'body': {'os-stop': {}}} Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 is locked Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 is locked Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 is locked Oct 27 09:26:29.210862 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:26:29.217143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d9721589-915f-4de5-aa02-677d561fbca8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Returning 409 to user: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 is locked {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:26:29.220434 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d9721589-915f-4de5-aa02-677d561fbca8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 409 len: 107 microversion: 2.1 time: 0.090615 Oct 27 09:26:29.224488 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2500/4968] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:29 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 107 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:26:29.268293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:29.269722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:29.300396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.304721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.305526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:29.310307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.311938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.324361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:29.373949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:29.388554 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b33b8982-f280-429e-bc8e-3436b82509ef tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1316 microversion: 2.1 time: 0.606652 Oct 27 09:26:29.389151 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2469/4969] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:28 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:29.407881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:29.408439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:29.419319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.419859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.420307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:29.421039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.421513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.421974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:29.510707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:29.515865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Unlocking {{(pid=120603) unlock /opt/stack/nova/nova/compute/api.py:4875}} Oct 27 09:26:29.535730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:29.543955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:29.548907 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1d7e9c1d-f5e8-4185-b485-ff50b44f9d29 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.318256 Oct 27 09:26:29.550833 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2501/4970] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:29 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:29.641993 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e16041ec-d043-4141-8f06-ccd069657537 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.249722 Oct 27 09:26:29.653512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c1539b6-d16d-4cbf-9b65-77779ae9a8ce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:29.658538 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2470/4971] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:29 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:26:29.665471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c1539b6-d16d-4cbf-9b65-77779ae9a8ce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.666668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c1539b6-d16d-4cbf-9b65-77779ae9a8ce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.668977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c1539b6-d16d-4cbf-9b65-77779ae9a8ce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:29.702668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7c1539b6-d16d-4cbf-9b65-77779ae9a8ce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Going to try to stop instance {{(pid=120602) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:26:29.730265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea244cff-e44e-40bc-b0c5-2d0f43c55726 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:29.730891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea244cff-e44e-40bc-b0c5-2d0f43c55726 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:29.746225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea244cff-e44e-40bc-b0c5-2d0f43c55726 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.746728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea244cff-e44e-40bc-b0c5-2d0f43c55726 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.748444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea244cff-e44e-40bc-b0c5-2d0f43c55726 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:29.751135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea244cff-e44e-40bc-b0c5-2d0f43c55726 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.751889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea244cff-e44e-40bc-b0c5-2d0f43c55726 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.760456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea244cff-e44e-40bc-b0c5-2d0f43c55726 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:29.787371 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c1539b6-d16d-4cbf-9b65-77779ae9a8ce tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.137594 Oct 27 09:26:29.809980 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2502/4972] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:29 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:26:29.871821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:29.873218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:29.887853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.890342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.891191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:29.892168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:29.892650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:29.893083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:30.366382 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea244cff-e44e-40bc-b0c5-2d0f43c55726 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.640564 Oct 27 09:26:30.371991 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2471/4973] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:29 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:30.380542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6558288f-80ac-45ad-bc83-8ec3f5dd80fb req-1e5c8991-44ef-4730-8f87-142c36770b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d69b0c-245f-49f3-82a8-97337afb18de", "name": "network-vif-plugged", "status": "completed", "tag": "55769c6d-541b-4d04-bbb3-7ceda852ab9c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:30.411773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6558288f-80ac-45ad-bc83-8ec3f5dd80fb req-1e5c8991-44ef-4730-8f87-142c36770b98 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:30.412274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6558288f-80ac-45ad-bc83-8ec3f5dd80fb req-1e5c8991-44ef-4730-8f87-142c36770b98 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:30.416306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6558288f-80ac-45ad-bc83-8ec3f5dd80fb req-1e5c8991-44ef-4730-8f87-142c36770b98 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:30.444622 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6558288f-80ac-45ad-bc83-8ec3f5dd80fb req-1e5c8991-44ef-4730-8f87-142c36770b98 service nova] Creating event network-vif-plugged:55769c6d-541b-4d04-bbb3-7ceda852ab9c for instance 18d69b0c-245f-49f3-82a8-97337afb18de on n-h2-858383-16 Oct 27 09:26:30.454194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:30.457464 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6558288f-80ac-45ad-bc83-8ec3f5dd80fb req-1e5c8991-44ef-4730-8f87-142c36770b98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084048 Oct 27 09:26:30.459173 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2472/4974] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:26:30.465505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:30.469930 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e126522d-527b-4e5f-a79e-3da991631fcb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.654699 Oct 27 09:26:30.471407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:30.480090 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2503/4975] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:29 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:30.498127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:30.500470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:30.502416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:30.503306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:30.505751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:30.506417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:30.514786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:30.515701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:30.527413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:30.528002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:30.548450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:30.556726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:30.557203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:30.557661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:30.587754 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 HTTP/1.1 Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '28211658-ab52-4f84-8437-e68fd64c3693'} Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:26:30.589792 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:26:30.595102 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:26:30.595102 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:26:30.595102 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:26:30.595102 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:26:30.595102 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:26:30.595102 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:26:30.595102 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:26:30.596757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:26:30.597832 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f261b84f-6adf-48a0-b3be-e9cb902966de tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 404 len: 111 microversion: 2.1 time: 0.136950 Oct 27 09:26:30.607053 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2473/4976] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:30 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:26:30.625219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:30.626246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:30.635879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:30.643602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:30.644377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:30.645370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:30.646081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:30.646881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:30.894556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:30.903533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:30.904981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:30.906232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2420b7f0-89a5-498c-8e85-ab876bbd75aa tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.297719 Oct 27 09:26:30.919598 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2474/4977] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:30 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:30.919598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-654760805", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "3527ca6b-4f14-40c0-86a3-873f2fef222c"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:31.022725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] validate_networks() for [('3527ca6b-4f14-40c0-86a3-873f2fef222c', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:26:31.237675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:31.255600 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34fa9b45-4c25-4823-9f9d-2403f6c13598 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.772872 Oct 27 09:26:31.268110 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2504/4978] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:30 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:31.396492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ffda7ad1-c9c7-43ae-9e25-90e876e38503 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:31.399223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ffda7ad1-c9c7-43ae-9e25-90e876e38503 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:31.421074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffda7ad1-c9c7-43ae-9e25-90e876e38503 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:31.422366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffda7ad1-c9c7-43ae-9e25-90e876e38503 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:31.423400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffda7ad1-c9c7-43ae-9e25-90e876e38503 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:31.425378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffda7ad1-c9c7-43ae-9e25-90e876e38503 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:31.427111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffda7ad1-c9c7-43ae-9e25-90e876e38503 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:31.428267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffda7ad1-c9c7-43ae-9e25-90e876e38503 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:32.381494 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ffda7ad1-c9c7-43ae-9e25-90e876e38503 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1465 microversion: 2.1 time: 0.989769 Oct 27 09:26:32.397113 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2505/4979] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:31 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1465 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:32.413036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:32.417823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:32.436807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:32.437733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:32.439029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:32.440076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:32.440894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:32.441593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:33.689090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:33.699187 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c9f8a65e-3fe0-4a84-b4c4-6ca5a7e9be7c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 1.300117 Oct 27 09:26:33.712412 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2506/4980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:32 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:33.718017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2121585492", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:33.819314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] validate_networks() for [('50c6db4e-db8b-44ab-b99d-c1c74e5a0258', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:26:34.085260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:26:34.085795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:26:34.086365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:26:34.087019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:26:34.087698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:26:34.098892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:34.099823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:34.100878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:34.101877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:34.102558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:34.103224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:34.173725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:26:34.188922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Getting quotas for user 0a9243ea430b4d2ba18c2a1e54e7c6aa and project 42bd45cbfc8b4fb38afebbf40eb09a12. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:26:34.222712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:26:34.228439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:26:34.399633 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8bcb29b3-9b0b-4062-ba90-45c1b75a995b tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.490899 Oct 27 09:26:34.401602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2475/4981] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:26:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:26:34.409396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:34.410396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:34.418692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:34.419552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:34.421201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:34.422517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:34.423259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:34.424135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:34.807962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:34.819499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:34.822260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:34.825976 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6553f3f-be6d-4c46-97c4-695542b15b32 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.422684 Oct 27 09:26:34.840095 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2476/4982] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:34 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:34.856247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd3aef0f-d83c-42d3-ae57-120b3e7591be tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:34.858034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd3aef0f-d83c-42d3-ae57-120b3e7591be tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:34.874662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3aef0f-d83c-42d3-ae57-120b3e7591be tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:34.875169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3aef0f-d83c-42d3-ae57-120b3e7591be tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:34.875668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3aef0f-d83c-42d3-ae57-120b3e7591be tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:34.877540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3aef0f-d83c-42d3-ae57-120b3e7591be tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:34.878544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3aef0f-d83c-42d3-ae57-120b3e7591be tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:34.879530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3aef0f-d83c-42d3-ae57-120b3e7591be tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:35.159884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:26:35.161400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:26:35.162254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:26:35.162988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:26:35.164075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:26:35.187774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:35.189595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:35.190085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:35.204562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:35.204562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:35.204562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:35.275436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Getting quotas for project 91b12f02b2d745179ce7300489278d6e. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:26:35.290929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Getting quotas for user 57dce47ed98f48d5ba1c8dd744fdbead and project 91b12f02b2d745179ce7300489278d6e. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:26:35.301042 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd3aef0f-d83c-42d3-ae57-120b3e7591be tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1650 microversion: 2.1 time: 0.456795 Oct 27 09:26:35.302739 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2477/4983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:34 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1650 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:35.307860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:35.310974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:35.341094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:35.342832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:35.344123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:35.346050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:35.346731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:35.348149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:35.370158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:26:35.377504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:26:35.450375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:35.464867 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94f97d42-58f1-4501-9e3e-3a7c4a052700 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1218 microversion: 2.1 time: 0.160733 Oct 27 09:26:35.466908 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2478/4984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:35 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:35.480648 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-093e2757-215f-41e7-9661-7d08f8e44e7c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.766732 Oct 27 09:26:35.482247 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2507/4985] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:26:35.488428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-661229db-6253-4b9a-a17d-a60cf6362cf7 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:35.490393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-661229db-6253-4b9a-a17d-a60cf6362cf7 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:35.499390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-661229db-6253-4b9a-a17d-a60cf6362cf7 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:35.500545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-661229db-6253-4b9a-a17d-a60cf6362cf7 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:35.501376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-661229db-6253-4b9a-a17d-a60cf6362cf7 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:35.503107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-661229db-6253-4b9a-a17d-a60cf6362cf7 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:35.503865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-661229db-6253-4b9a-a17d-a60cf6362cf7 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:35.505099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-661229db-6253-4b9a-a17d-a60cf6362cf7 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:35.511204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:35.518235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:35.540271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:35.540794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:35.541259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:35.542408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:35.542508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:35.544383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:36.176979 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-661229db-6253-4b9a-a17d-a60cf6362cf7 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1650 microversion: 2.1 time: 0.692699 Oct 27 09:26:36.182984 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2508/4986] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:35 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1650 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:36.188582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-159134ee-b036-492d-b33b-48d79032574f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:36.191979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-159134ee-b036-492d-b33b-48d79032574f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:36.218009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:36.222216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:36.244204 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-02e6adbb-60ba-4bf7-981d-41a1461cf158 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.772693 Oct 27 09:26:36.248310 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2479/4987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:35 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:36.258848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:36.260191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:36.274382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:36.275531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:36.276806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-159134ee-b036-492d-b33b-48d79032574f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:36.277588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:36.279127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:36.280545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:36.281929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:36.288058 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-159134ee-b036-492d-b33b-48d79032574f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1217 microversion: 2.1 time: 0.103056 Oct 27 09:26:36.294214 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2509/4988] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:36 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:36.300314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ccf84ea3-066d-44ed-8759-91f872db5285 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:36.301953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ccf84ea3-066d-44ed-8759-91f872db5285 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:36.310335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccf84ea3-066d-44ed-8759-91f872db5285 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:36.311153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccf84ea3-066d-44ed-8759-91f872db5285 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:36.312236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccf84ea3-066d-44ed-8759-91f872db5285 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:36.313413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccf84ea3-066d-44ed-8759-91f872db5285 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:36.314076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccf84ea3-066d-44ed-8759-91f872db5285 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:36.314857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ccf84ea3-066d-44ed-8759-91f872db5285 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:36.385758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:36.396707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:36.398309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:36.399584 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5541d79-9b3e-4d67-9757-24d6d8b03c3a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.148763 Oct 27 09:26:36.401249 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2480/4989] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:36 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:36.497914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:36.498609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:36.508701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:36.509212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:36.509652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:36.510380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:36.510841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:36.511267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:36.740934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:36.762764 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f2ac7002-04e9-4cfc-a17e-284053e8ac88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1266 microversion: 2.1 time: 0.268472 Oct 27 09:26:36.763711 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2481/4990] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:36 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:36.905376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:36.940692 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ccf84ea3-066d-44ed-8759-91f872db5285 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1650 microversion: 2.1 time: 0.644223 Oct 27 09:26:36.948819 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2510/4991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:36 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1650 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:37.191454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-228334458", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "availability_zone": "nova:n-h1-858383-16", "networks": [{"uuid": "88bdd59f-4979-432a-b28e-4286d08e7f84"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:37.271973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:37.272614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:37.295113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:37.295642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:37.301675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:37.302626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:37.303132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:37.303604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:37.370310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] validate_networks() for [('88bdd59f-4979-432a-b28e-4286d08e7f84', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:26:38.517999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:38.529975 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-147a2923-a7f9-4d4f-98c1-30defdea3650 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 1.262736 Oct 27 09:26:38.531226 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2511/4992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:37 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:38.537423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:38.538295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:38.544981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:38.545743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:38.546357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:38.547245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:38.547892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:38.548482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:38.750861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:38.764974 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-639aab23-2f6d-41a2-93a9-a24a34afc3d0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1275 microversion: 2.1 time: 0.231956 Oct 27 09:26:38.766809 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2512/4993] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:38 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:38.772722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:38.774253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:38.785436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:38.787262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:38.787990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:38.788993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:38.789668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:38.790195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:38.989671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:39.003275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:39.006943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:39.011307 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fe40f8b0-2675-4c53-9500-431e2cac247e tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.242415 Oct 27 09:26:39.012759 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2513/4994] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:38 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:39.019066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:39.020693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:39.029235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:39.030220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:39.030897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:39.031886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:39.032754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:39.033407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:39.235673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:39.246413 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0a25726-d47a-4f36-83da-0f4df597e674 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1272 microversion: 2.1 time: 0.231778 Oct 27 09:26:39.247429 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2514/4995] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:39 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:39.561916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:39.562845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:39.586275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:39.587133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:39.587602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:39.589402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:39.590097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:39.591685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:39.870744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:26:39.871910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:26:39.873096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:26:39.876477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:26:39.877550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:26:39.894507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:39.895049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:39.896044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:39.896975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:39.897616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:39.898232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:39.924145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Getting quotas for project e3d4527580694ac4a5a0f4d0ac00b173. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:26:39.930814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Getting quotas for user 33f5f0d58d974dd4999f1ff92452117d and project e3d4527580694ac4a5a0f4d0ac00b173. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:26:39.945981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:26:39.948258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:26:40.015674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:40.048123 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3334e2e9-f313-499b-87d9-1bdfe976f85e tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.861129 Oct 27 09:26:40.050554 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2482/4996] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:26:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:26:40.056593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:40.057730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:40.067899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:40.069423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:40.070189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:40.071116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:40.071905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:40.072692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:40.382954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:40.393393 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a24f2710-dd72-475d-a21f-f97046fb775e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1275 microversion: 2.1 time: 0.339108 Oct 27 09:26:40.404117 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2483/4997] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:40 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1275 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:40.409184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:40.409801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:40.427130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:40.427892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:40.428103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:40.439730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:40.440348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:40.441024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:40.461603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:40.470133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ffaed508-1310-4976-b552-108b1ef454da tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.916144 Oct 27 09:26:40.470725 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2515/4998] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:39 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:40.500676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bab58a63-ebef-4863-b98d-9836e620b88f tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:40.502715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bab58a63-ebef-4863-b98d-9836e620b88f tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:40.691061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:40.704594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:40.710253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:40.715258 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fbd6e109-a95f-4c0e-acf1-631602ec2fa5 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.309897 Oct 27 09:26:40.728779 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2484/4999] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:40 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:40.748165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:40.748797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:40.769024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:40.769531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:40.770008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:40.770727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:40.777789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:40.778266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:40.815288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bab58a63-ebef-4863-b98d-9836e620b88f tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1328 microversion: 2.1 time: 0.327080 Oct 27 09:26:40.819239 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2516/5000] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:40 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1328 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:41.430536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:41.431157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:41.459999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:41.460539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:41.460998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:41.464034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:41.465952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:41.468170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:42.037441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:42.062520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:42.078911 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-133bc57c-fc91-4fa0-a0dd-e3ffc7189556 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1314 microversion: 2.1 time: 1.341898 Oct 27 09:26:42.082206 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2485/5001] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:40 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1314 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:42.093763 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-201ecc25-d6a8-4597-9cd8-1ae3ec1a1908 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 0.667717 Oct 27 09:26:42.094701 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2517/5002] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:41 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:42.097467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:42.105981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:42.116565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:42.123470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:42.134229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:42.138737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:42.141115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:42.142157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:42.143657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:42.145536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:42.145991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:42.146701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:42.148149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:42.150356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:42.150810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:42.151773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:42.609068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:42.626871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:42.628694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:42.630808 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8187cab7-5e88-41e8-9b17-7525e6476312 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.531934 Oct 27 09:26:42.639854 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2518/5003] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:42 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:42.645886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e54d9d69-607d-4a4a-82ab-4a90368ec274 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:42.647420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e54d9d69-607d-4a4a-82ab-4a90368ec274 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:42.667827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d9d69-607d-4a4a-82ab-4a90368ec274 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:42.668579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d9d69-607d-4a4a-82ab-4a90368ec274 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:42.673243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d9d69-607d-4a4a-82ab-4a90368ec274 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:42.674494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d9d69-607d-4a4a-82ab-4a90368ec274 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:42.675168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d9d69-607d-4a4a-82ab-4a90368ec274 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:42.675914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e54d9d69-607d-4a4a-82ab-4a90368ec274 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:43.358571 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e54d9d69-607d-4a4a-82ab-4a90368ec274 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1423 microversion: 2.1 time: 0.713002 Oct 27 09:26:43.372140 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2519/5004] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:42 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1423 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:43.382490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:43.383285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:43.389876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:43.391253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:43.391947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:43.392831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:43.393481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:43.394081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:43.923473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:43.943618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8891b5a2-c861-407d-b3c6-969b49d2407c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1654 microversion: 2.1 time: 1.858616 Oct 27 09:26:43.945180 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2486/5005] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:42 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1654 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:43.956857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:43.959125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:43.992895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:43.996483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:43.997798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:44.006210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:44.008103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:44.008844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:44.353586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:44.371072 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d169656c-8b43-48f5-ac8b-7f93c7b09e98 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1314 microversion: 2.1 time: 0.997353 Oct 27 09:26:44.376636 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2520/5006] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:43 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1314 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:44.384674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:44.407330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:44.435417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:44.435942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:44.436387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:44.437388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:44.437851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:44.438279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:44.874543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:44.890621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:44.892687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:44.895547 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b2e47a97-bbd7-45ac-b780-3959d03822a9 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.517108 Oct 27 09:26:44.897337 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2521/5007] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:44 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:44.917125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80b31f4f-35d5-42e5-a90c-971a92ce751f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:44.935692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80b31f4f-35d5-42e5-a90c-971a92ce751f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:44.936768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80b31f4f-35d5-42e5-a90c-971a92ce751f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:44.937397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80b31f4f-35d5-42e5-a90c-971a92ce751f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:45.032167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80b31f4f-35d5-42e5-a90c-971a92ce751f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Going to try to start instance {{(pid=120602) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 09:26:45.135204 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80b31f4f-35d5-42e5-a90c-971a92ce751f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.233636 Oct 27 09:26:45.141563 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2522/5008] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:44 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:26:45.150056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea605b07-e177-40fa-9c3b-54fb30a49836 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:45.151951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea605b07-e177-40fa-9c3b-54fb30a49836 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:45.162462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea605b07-e177-40fa-9c3b-54fb30a49836 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:45.164310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea605b07-e177-40fa-9c3b-54fb30a49836 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:45.167477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea605b07-e177-40fa-9c3b-54fb30a49836 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:45.168574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea605b07-e177-40fa-9c3b-54fb30a49836 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:45.169278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea605b07-e177-40fa-9c3b-54fb30a49836 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:45.169881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea605b07-e177-40fa-9c3b-54fb30a49836 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:45.231371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:45.259439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:45.275433 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-16f55f42-cdb6-4484-b42c-a331c80cacce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 1.317079 Oct 27 09:26:45.288274 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2487/5009] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:43 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:45.308119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:45.308757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:45.368400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:45.369211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:45.369847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:45.372615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:45.373336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:45.374621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:46.354106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:46.364502 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-353a10f0-e089-4c79-95ea-5250b674c827 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1663 microversion: 2.1 time: 1.075051 Oct 27 09:26:46.365482 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2488/5010] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:45 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1663 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:46.371043 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea605b07-e177-40fa-9c3b-54fb30a49836 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 1.216234 Oct 27 09:26:46.373556 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2523/5011] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:45 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:46.385123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:46.393251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:46.396563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:46.420493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:46.421884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:46.423312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:46.427769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:46.428353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:46.428875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:46.429134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:46.429618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:46.430927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:46.431945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:46.434176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:46.435035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:46.436370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:46.693994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:46.705564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:46.710688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:46.716349 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f873715-f0fa-46e6-8e1f-5a2dcc31f420 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1365 microversion: 2.47 time: 0.338672 Oct 27 09:26:46.719165 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2524/5012] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:46 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:46.730042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:46.735659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:46.778694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:46.780097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:46.782581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:46.787169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:46.792018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:46.794199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:47.059106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:47.071271 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b24f3225-926b-43b0-aaa0-bc0815007c96 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1314 microversion: 2.1 time: 0.700977 Oct 27 09:26:47.078645 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2489/5013] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:46 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:47.396810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:47.396810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:47.405189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:47.411905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:47.416513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:47.421666 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a4de69be-d3fe-4452-ad71-0043af70cdd5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 0.701310 Oct 27 09:26:47.422688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:47.423664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:47.424301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:47.424902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:47.428832 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2525/5014] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:46 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:47.433698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-92b93c6f-198f-40c7-b327-6915373cc711 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:47.434308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-92b93c6f-198f-40c7-b327-6915373cc711 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:47.453332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92b93c6f-198f-40c7-b327-6915373cc711 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:47.454198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92b93c6f-198f-40c7-b327-6915373cc711 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:47.454871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92b93c6f-198f-40c7-b327-6915373cc711 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:47.455826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92b93c6f-198f-40c7-b327-6915373cc711 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:47.456450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92b93c6f-198f-40c7-b327-6915373cc711 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:47.459107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92b93c6f-198f-40c7-b327-6915373cc711 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:48.320018 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-92b93c6f-198f-40c7-b327-6915373cc711 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.889752 Oct 27 09:26:48.332639 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2526/5015] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:47 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:48.349009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:48.352567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:48.364461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:48.365417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:48.366055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:48.367033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:48.367736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:48.368552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:48.388850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:49.069802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:49.088483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:49.090628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:49.093303 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66314e16-dacf-4c86-a60a-532ad3418f5d tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1371 microversion: 2.47 time: 0.759254 Oct 27 09:26:49.112663 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2527/5016] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:48 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1371 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:49.120723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-bfc84ddd-ef58-492f-820f-f343b91d8a17 req-1de889d1-e909-4576-beb0-73f9ffdc87f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b896a809-0fa3-4871-8de8-f0adfce00a53", "tag": "2bc5f327-c98c-435c-aa48-d15e94536ca5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:49.136670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bfc84ddd-ef58-492f-820f-f343b91d8a17 req-1de889d1-e909-4576-beb0-73f9ffdc87f0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:49.137476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bfc84ddd-ef58-492f-820f-f343b91d8a17 req-1de889d1-e909-4576-beb0-73f9ffdc87f0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:49.138146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-bfc84ddd-ef58-492f-820f-f343b91d8a17 req-1de889d1-e909-4576-beb0-73f9ffdc87f0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:49.156250 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-bfc84ddd-ef58-492f-820f-f343b91d8a17 req-1de889d1-e909-4576-beb0-73f9ffdc87f0 service nova] Creating event network-changed:2bc5f327-c98c-435c-aa48-d15e94536ca5 for instance b896a809-0fa3-4871-8de8-f0adfce00a53 on n-h1-858383-16 Oct 27 09:26:49.164201 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-bfc84ddd-ef58-492f-820f-f343b91d8a17 req-1de889d1-e909-4576-beb0-73f9ffdc87f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049346 Oct 27 09:26:49.165566 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2528/5017] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:26:49.172502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:49.172663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:49.174427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:49.191229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:49.191780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:49.192233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:49.194838 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3e19209-3d61-4cd2-b9b9-ea950af8e9d5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1663 microversion: 2.1 time: 1.806206 Oct 27 09:26:49.197281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:49.198106 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2490/5018] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:47 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1663 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:49.204506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:49.205074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:49.214772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:49.220427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:49.229720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:49.230953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:49.232041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:49.235309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:49.237017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:49.238533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:49.909502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:49.939384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:50.011606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:50.022169 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8eef5c08-de0e-4703-80ee-42bc7a9c9875 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1314 microversion: 2.1 time: 0.855111 Oct 27 09:26:50.031956 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2529/5019] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:49 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:50.195700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:50.212505 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-58f57769-dcd5-4236-b8d9-2119ecacfc65 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 1.012416 Oct 27 09:26:50.213115 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2491/5020] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:49 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:50.223936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-816b9d1a-0ab5-4f62-a8f9-cbe3cc089020 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:50.228549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-816b9d1a-0ab5-4f62-a8f9-cbe3cc089020 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:50.244059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-816b9d1a-0ab5-4f62-a8f9-cbe3cc089020 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:50.244926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-816b9d1a-0ab5-4f62-a8f9-cbe3cc089020 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:50.245606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-816b9d1a-0ab5-4f62-a8f9-cbe3cc089020 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:50.247142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-816b9d1a-0ab5-4f62-a8f9-cbe3cc089020 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:50.247749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-816b9d1a-0ab5-4f62-a8f9-cbe3cc089020 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:50.248265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-816b9d1a-0ab5-4f62-a8f9-cbe3cc089020 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:50.515347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-fd405318-4d42-4269-b32d-6357631a4997 req-807c076a-a4d8-48fa-b821-ed8b5ac501ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29a5085-e650-4be6-8422-59ac2e59e5a5", "tag": "405fdcfd-5bc9-4163-8d14-984aab1200d4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:50.567312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fd405318-4d42-4269-b32d-6357631a4997 req-807c076a-a4d8-48fa-b821-ed8b5ac501ea service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:50.568539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fd405318-4d42-4269-b32d-6357631a4997 req-807c076a-a4d8-48fa-b821-ed8b5ac501ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:50.569189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-fd405318-4d42-4269-b32d-6357631a4997 req-807c076a-a4d8-48fa-b821-ed8b5ac501ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:50.601769 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-fd405318-4d42-4269-b32d-6357631a4997 req-807c076a-a4d8-48fa-b821-ed8b5ac501ea service nova] Creating event network-changed:405fdcfd-5bc9-4163-8d14-984aab1200d4 for instance f29a5085-e650-4be6-8422-59ac2e59e5a5 on n-h1-858383-16 Oct 27 09:26:50.617040 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-fd405318-4d42-4269-b32d-6357631a4997 req-807c076a-a4d8-48fa-b821-ed8b5ac501ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.583634 Oct 27 09:26:50.617995 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2530/5021] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:26:50.624228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:50.624788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:50.653500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:50.654452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:50.655124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:50.656084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:50.656748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:50.657364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:50.812589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=10 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:50.995624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:51.010391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:51.012289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:51.016231 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5782f855-3d9e-47f0-ace0-618ef4184318 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1371 microversion: 2.47 time: 0.395952 Oct 27 09:26:51.017260 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2531/5022] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:50 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1371 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:51.024898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:51.025969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:51.041099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:51.045081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:51.047299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:51.048308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:51.048912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:51.049466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:51.084386 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-816b9d1a-0ab5-4f62-a8f9-cbe3cc089020 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.866329 Oct 27 09:26:51.100323 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2492/5023] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:50 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:51.100323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:51.100323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:51.121192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:51.121697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:51.122142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:51.130077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:51.130679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:51.133238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:51.834552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:51.845147 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f4cc2ab-b81e-49de-8aba-b099214cef78 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1314 microversion: 2.1 time: 0.754562 Oct 27 09:26:51.863920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:51.873669 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98d2f9d1-008f-402a-bd3c-e41dc8e530fe tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.854120 Oct 27 09:26:51.874321 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2493/5024] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:51 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:51.880409 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2532/5025] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:51 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:51.888780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:51.890403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f4f36dba-3dd0-46ce-8fb0-79baffa0441e req-8ef36f81-5b1d-4a49-87d8-27179564b974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6af5ba-499b-40ef-9ddb-ce476a959c81", "tag": "fe14672c-662e-4b62-ad9b-78c12cec9d0b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:51.896437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:51.906095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:51.911928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:51.913604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f4f36dba-3dd0-46ce-8fb0-79baffa0441e req-8ef36f81-5b1d-4a49-87d8-27179564b974 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:51.914374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f4f36dba-3dd0-46ce-8fb0-79baffa0441e req-8ef36f81-5b1d-4a49-87d8-27179564b974 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:51.915212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:51.915930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f4f36dba-3dd0-46ce-8fb0-79baffa0441e req-8ef36f81-5b1d-4a49-87d8-27179564b974 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:51.916616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:51.919478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:51.921780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:51.922477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:51.945107 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f4f36dba-3dd0-46ce-8fb0-79baffa0441e req-8ef36f81-5b1d-4a49-87d8-27179564b974 service nova] Creating event network-changed:fe14672c-662e-4b62-ad9b-78c12cec9d0b for instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 on n-h2-858383-16 Oct 27 09:26:51.962457 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f4f36dba-3dd0-46ce-8fb0-79baffa0441e req-8ef36f81-5b1d-4a49-87d8-27179564b974 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086352 Oct 27 09:26:51.963916 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2494/5026] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:26:51.970750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:51.972094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:51.979208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:51.979873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:51.985349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:51.986145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:51.986642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:51.987086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:52.347996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:52.358941 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-249515b5-9ba4-4e3b-b046-82cca35b4c9d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 0.477132 Oct 27 09:26:52.360286 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2533/5027] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:51 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:52.369844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:52.370451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:52.377472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:52.377962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:52.378613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:52.379507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:52.380150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:52.380742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:52.412863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:52.427510 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b93608ce-1392-430d-94d5-57b1ecd59dd6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.461792 Oct 27 09:26:52.433810 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2495/5028] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:51 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:52.440494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71ccca63-1f0e-4232-9683-3c108bd72595 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:52.441485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71ccca63-1f0e-4232-9683-3c108bd72595 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:52.452640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71ccca63-1f0e-4232-9683-3c108bd72595 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:52.453141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71ccca63-1f0e-4232-9683-3c108bd72595 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:52.453581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71ccca63-1f0e-4232-9683-3c108bd72595 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:52.454302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71ccca63-1f0e-4232-9683-3c108bd72595 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:52.454763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71ccca63-1f0e-4232-9683-3c108bd72595 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:52.455450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71ccca63-1f0e-4232-9683-3c108bd72595 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:52.643210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:52.653528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:52.655012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:52.656725 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4fa4d609-5d50-461b-ab7f-6046447bd884 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1356 microversion: 2.47 time: 0.290832 Oct 27 09:26:52.669842 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2534/5029] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:52 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1356 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:52.669842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:52.669842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:52.678695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:52.678695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:52.678695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:52.678695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:52.678695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:52.678695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:52.733458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Unlocking {{(pid=120602) unlock /opt/stack/nova/nova/compute/api.py:4875}} Oct 27 09:26:52.836126 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae631c62-1746-477c-a301-cc2851297303 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.176477 Oct 27 09:26:52.839710 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2535/5030] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:52 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:26:52.851889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:52.862375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:52.864208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Searching by: {'deleted': False, 'project_id': '33cf106de6424278bf2d278203028332'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:26:52.874300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:52.875080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:52.876049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:52.877352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:52.878100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:52.878849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:53.053624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:26:53.155309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:53.163043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:53.163527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:53.164000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:53.176499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:53.177985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:53.292259 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dfd292f7-1770-4ba4-84a3-bf54895c7dd2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.453273 Oct 27 09:26:53.293987 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2536/5031] 10.222.0.25 () {60 vars in 1187 bytes} [Thu Oct 27 09:26:52 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:53.300146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:53.301477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:53.309484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:53.310418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:53.310575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:53.311247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:53.312057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:53.312485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:53.368192 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71ccca63-1f0e-4232-9683-3c108bd72595 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.932938 Oct 27 09:26:53.372069 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2496/5032] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:52 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:53.386958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:53.387495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:53.406078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:53.407993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:53.412644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:53.413596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:53.414113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:53.414642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:53.901197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:53.911177 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f085aa7-e77c-48aa-a66e-dab0a4b09b43 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.616077 Oct 27 09:26:53.924025 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2537/5033] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:53 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:53.935160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:53.936009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:53.945836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:53.946344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:53.947004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:53.947960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:53.948593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:53.949199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:54.004995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:26:54.131477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:54.134908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:54.145111 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-525077f2-e296-4db9-8bf9-1b6cb19110ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1314 microversion: 2.1 time: 0.769521 Oct 27 09:26:54.147134 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2497/5034] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:53 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:54.174228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:54.178720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:54.195221 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a17d41b6-beed-4761-a363-a3a9dcc97ab6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 204 len: 0 microversion: 2.47 time: 0.268893 Oct 27 09:26:54.197699 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2538/5035] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:26:53 2022] DELETE /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:26:54.209642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:54.212425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:54.214362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:54.214804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:54.215509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:54.216698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:54.218195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:54.219367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:54.228473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:54.230840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:54.231753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:54.239372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:54.240421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:54.241205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:54.997718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:55.000964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:55.014494 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a67e6852-b8b8-417f-9dad-53d5d9d44a97 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.813803 Oct 27 09:26:55.016174 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2539/5036] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:54 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:55.017589 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be89d874-73e2-4384-a8e6-1e030ff6023e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 0.864977 Oct 27 09:26:55.032651 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2498/5037] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:54 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:55.040294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91037a19-3afa-42d5-a38b-043524e4c449 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:55.040943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91037a19-3afa-42d5-a38b-043524e4c449 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:55.048622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91037a19-3afa-42d5-a38b-043524e4c449 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:55.049146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91037a19-3afa-42d5-a38b-043524e4c449 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:55.049581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91037a19-3afa-42d5-a38b-043524e4c449 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:55.050873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91037a19-3afa-42d5-a38b-043524e4c449 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:55.051367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91037a19-3afa-42d5-a38b-043524e4c449 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:55.051931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91037a19-3afa-42d5-a38b-043524e4c449 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:55.054588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:55.060863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:55.096968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:55.097859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:55.098590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:55.102576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:55.103411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:55.104322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:55.156322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:26:55.258556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:55.281225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:55.286051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:55.288004 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8daa0f85-fb4f-4b96-8d6c-21cbd2fef9c4 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1362 microversion: 2.47 time: 0.261415 Oct 27 09:26:55.289545 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2540/5038] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:55 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:55.299214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:55.301258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:55.319515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:55.320569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:55.321581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:55.326223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:55.330163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:55.330819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:55.500976 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91037a19-3afa-42d5-a38b-043524e4c449 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.465344 Oct 27 09:26:55.518069 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2499/5039] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:55 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:55.524221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:55.525211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:55.546141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:55.547254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:55.548142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:55.549257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:55.551118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:55.556954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.257660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:56.296486 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cfbf85cd-1b44-410c-b45b-041dfb1f7ef8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 1.004227 Oct 27 09:26:56.300044 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2541/5040] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:55 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:56.312021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:56.370328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:56.378040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:56.389856 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5b71e76-4987-4930-8a72-cbdd549555e1 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1314 microversion: 2.1 time: 0.869418 Oct 27 09:26:56.394870 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2500/5041] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:55 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:56.410587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.411239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.411554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.412324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.412789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.413224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.419415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:56.420378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:56.428626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.429444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.430351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.431496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.432384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.433396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.554810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:56.572259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:56.574271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:56.576456 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a657935-1344-45ac-9bdf-70ea8adc8ec6 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1362 microversion: 2.47 time: 0.179423 Oct 27 09:26:56.577861 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2501/5042] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:56 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:56.586632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3966c729-00fc-426c-8ef9-3dd00be36ccb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:56.587558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3966c729-00fc-426c-8ef9-3dd00be36ccb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:56.603976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3966c729-00fc-426c-8ef9-3dd00be36ccb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.605311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3966c729-00fc-426c-8ef9-3dd00be36ccb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.606473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3966c729-00fc-426c-8ef9-3dd00be36ccb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.609719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3966c729-00fc-426c-8ef9-3dd00be36ccb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.611310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3966c729-00fc-426c-8ef9-3dd00be36ccb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.612081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3966c729-00fc-426c-8ef9-3dd00be36ccb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.623499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:56.634439 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b2d05292-588c-4268-aa27-895b1afc473d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 0.332471 Oct 27 09:26:56.648242 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2542/5043] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:56 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:56.656112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f49a266f-b185-4ad7-ad2d-46ef63752d90 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:56.657031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f49a266f-b185-4ad7-ad2d-46ef63752d90 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:56.664227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49a266f-b185-4ad7-ad2d-46ef63752d90 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.665085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49a266f-b185-4ad7-ad2d-46ef63752d90 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.665717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49a266f-b185-4ad7-ad2d-46ef63752d90 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.666628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49a266f-b185-4ad7-ad2d-46ef63752d90 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.667265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49a266f-b185-4ad7-ad2d-46ef63752d90 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.668234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f49a266f-b185-4ad7-ad2d-46ef63752d90 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.756343 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3966c729-00fc-426c-8ef9-3dd00be36ccb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.176406 Oct 27 09:26:56.757648 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2502/5044] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:56 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:26:56.769480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:56.770702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:56.779426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.780359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.781063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.782447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:56.783333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:56.784030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:56.880541 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f49a266f-b185-4ad7-ad2d-46ef63752d90 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.230675 Oct 27 09:26:56.897788 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2543/5045] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:56 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:57.004928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:57.017451 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-acf8c85a-0f39-46e5-a2df-7f9aeb6ba2dc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1672 microversion: 2.1 time: 0.253333 Oct 27 09:26:57.018820 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2503/5046] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:56 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:57.258628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e9672d82-8d3d-453f-b47f-5b2964896690 req-c88ac4c1-7777-4fb1-8cb3-180f0fcd1901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6af5ba-499b-40ef-9ddb-ce476a959c81", "name": "network-vif-plugged", "status": "completed", "tag": "fe14672c-662e-4b62-ad9b-78c12cec9d0b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:57.279415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e9672d82-8d3d-453f-b47f-5b2964896690 req-c88ac4c1-7777-4fb1-8cb3-180f0fcd1901 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:57.280310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e9672d82-8d3d-453f-b47f-5b2964896690 req-c88ac4c1-7777-4fb1-8cb3-180f0fcd1901 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:57.281511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e9672d82-8d3d-453f-b47f-5b2964896690 req-c88ac4c1-7777-4fb1-8cb3-180f0fcd1901 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:57.295653 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e9672d82-8d3d-453f-b47f-5b2964896690 req-c88ac4c1-7777-4fb1-8cb3-180f0fcd1901 service nova] Creating event network-vif-plugged:fe14672c-662e-4b62-ad9b-78c12cec9d0b for instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 on n-h2-858383-16 Oct 27 09:26:57.303047 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e9672d82-8d3d-453f-b47f-5b2964896690 req-c88ac4c1-7777-4fb1-8cb3-180f0fcd1901 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047986 Oct 27 09:26:57.304309 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2544/5047] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:26:57.418190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:57.419819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:57.434509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:57.435343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:57.436050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:57.437901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:57.438662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:57.439274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:57.607363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:57.608565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:57.632328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:57.632884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:57.633334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:57.634080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:57.634559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:57.634960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:57.676957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:57.688209 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-958559d4-f5cf-4870-850e-fd25ed2b0389 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1314 microversion: 2.1 time: 0.274048 Oct 27 09:26:57.690348 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2504/5048] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:57 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:57.711253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:57.713132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:57.742552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:57.743817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:57.748535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:57.749679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:57.750526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:57.751529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:57.776347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:57.786280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:57.787966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:57.796027 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-533395ae-4089-43a4-81b1-51b0a2383f62 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1362 microversion: 2.47 time: 0.193110 Oct 27 09:26:57.813593 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2545/5049] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:57 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:57.905121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d3eedcc6-19f5-4e3e-9b92-73939e55290a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:57.905866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d3eedcc6-19f5-4e3e-9b92-73939e55290a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:57.918670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3eedcc6-19f5-4e3e-9b92-73939e55290a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:57.919381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3eedcc6-19f5-4e3e-9b92-73939e55290a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:57.919982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3eedcc6-19f5-4e3e-9b92-73939e55290a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:57.923549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3eedcc6-19f5-4e3e-9b92-73939e55290a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:57.926209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3eedcc6-19f5-4e3e-9b92-73939e55290a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:57.926807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3eedcc6-19f5-4e3e-9b92-73939e55290a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:58.023182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:58.056219 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e23c8747-5746-4184-af70-c1e1380616eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 0.360192 Oct 27 09:26:58.060593 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2505/5050] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:57 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:58.082312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:58.088080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:58.110964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:58.117906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:58.119378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:58.125855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:58.129591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:58.130477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:58.504241 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d3eedcc6-19f5-4e3e-9b92-73939e55290a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.603721 Oct 27 09:26:58.523630 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2546/5051] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:57 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:26:58.715644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:58.716283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:58.727838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:58.728357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:58.728821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:58.729566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:58.730039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:58.730478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:58.773121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:58.784418 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-483f10fb-37cd-4ef3-a886-01daa431e76f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1652 microversion: 2.1 time: 0.720602 Oct 27 09:26:58.796226 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2506/5052] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:58 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1652 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:58.814511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd61fd38-8b69-45ec-b017-95da1f01f679 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:26:58.815055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cd61fd38-8b69-45ec-b017-95da1f01f679 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:58.842635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd61fd38-8b69-45ec-b017-95da1f01f679 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:58.849558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd61fd38-8b69-45ec-b017-95da1f01f679 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:58.850115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd61fd38-8b69-45ec-b017-95da1f01f679 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:58.851150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd61fd38-8b69-45ec-b017-95da1f01f679 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:58.851806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd61fd38-8b69-45ec-b017-95da1f01f679 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:58.852954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd61fd38-8b69-45ec-b017-95da1f01f679 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:59.033345 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd61fd38-8b69-45ec-b017-95da1f01f679 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.223922 Oct 27 09:26:59.037788 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2507/5053] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:26:58 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:26:59.056259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:59.057904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:59.075173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:59.076043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:59.076698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:59.084359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:59.085118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:59.087874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:59.173443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:59.173950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:59.178059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:59.178840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lazy-loading 'fault' on Instance uuid c876b418-688a-4682-a580-e3d475e0e965 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:26:59.398670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:59.412375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:59.422035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:59.427950 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1bbe479a-f390-4c1d-862d-a44c094cf4cd tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 200 len: 1367 microversion: 2.47 time: 0.386863 Oct 27 09:26:59.431364 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2508/5054] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:26:59 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:26:59.439215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:59.441132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:59.452640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:59.453593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:59.470113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:59.471357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:59.471750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:59.474789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:59.810339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:26:59.824924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6fcccf54-981f-4ff7-bdaf-7cc2a49c93db tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1314 microversion: 2.1 time: 1.109228 Oct 27 09:26:59.829040 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2547/5055] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:58 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1314 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:26:59.840464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:26:59.841181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:26:59.868083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:59.868621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:59.869091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:26:59.869835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:26:59.870288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:26:59.870709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:00.165678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:00.181197 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-30925e18-27b4-42a3-adf8-2c95ae9cab5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.748336 Oct 27 09:27:00.181805 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2509/5056] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:59 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:00.187110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1fca0fe9-e160-4f9d-825d-ab7a5f551c56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:00.192290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1fca0fe9-e160-4f9d-825d-ab7a5f551c56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:00.208199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fca0fe9-e160-4f9d-825d-ab7a5f551c56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:00.208992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fca0fe9-e160-4f9d-825d-ab7a5f551c56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:00.209632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fca0fe9-e160-4f9d-825d-ab7a5f551c56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:00.210523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fca0fe9-e160-4f9d-825d-ab7a5f551c56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:00.211154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fca0fe9-e160-4f9d-825d-ab7a5f551c56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:00.211783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fca0fe9-e160-4f9d-825d-ab7a5f551c56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:00.421390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:00.469959 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-323ee01a-846e-474c-b95c-19e53efaab63 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 0.639362 Oct 27 09:27:00.474908 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2548/5057] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:26:59 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:00.510201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-aab50e7b-8efd-4d98-a79c-70f3a2995483 req-497b176b-3f5e-40fd-9fe5-846bfd30c34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b896a809-0fa3-4871-8de8-f0adfce00a53", "name": "network-vif-plugged", "status": "completed", "tag": "2bc5f327-c98c-435c-aa48-d15e94536ca5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:00.537653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-aab50e7b-8efd-4d98-a79c-70f3a2995483 req-497b176b-3f5e-40fd-9fe5-846bfd30c34f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:00.538360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-aab50e7b-8efd-4d98-a79c-70f3a2995483 req-497b176b-3f5e-40fd-9fe5-846bfd30c34f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:00.544094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-aab50e7b-8efd-4d98-a79c-70f3a2995483 req-497b176b-3f5e-40fd-9fe5-846bfd30c34f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:00.577184 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-aab50e7b-8efd-4d98-a79c-70f3a2995483 req-497b176b-3f5e-40fd-9fe5-846bfd30c34f service nova] Creating event network-vif-plugged:2bc5f327-c98c-435c-aa48-d15e94536ca5 for instance b896a809-0fa3-4871-8de8-f0adfce00a53 on n-h1-858383-16 Oct 27 09:27:00.588879 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-aab50e7b-8efd-4d98-a79c-70f3a2995483 req-497b176b-3f5e-40fd-9fe5-846bfd30c34f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110225 Oct 27 09:27:00.589810 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2549/5058] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:27:00.596058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:00.598636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:00.619777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:00.620463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:00.620922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:00.622775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:00.623261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:00.623739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:00.812575 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1fca0fe9-e160-4f9d-825d-ab7a5f551c56 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.628347 Oct 27 09:27:00.816545 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2510/5059] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:00 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:00.832539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:00.835138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: c876b418-688a-4682-a580-e3d475e0e965] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:00.864914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:00.866393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:00.869609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:00.891107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:00.892362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:00.895695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:00.939923 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] HTTP exception thrown: Instance c876b418-688a-4682-a580-e3d475e0e965 could not be found. Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Request method failure captured: Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 HTTP/1.1 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pnCiw5sP_vgF01oAc6pIrwyjEnCyxvcefQxlvoRyZuGO9Hhbm5Up2W66z-qGH9O39fhpCRflnx9EvOb0Kv0tj1nbJkT_AnSEBUPRzoQtQ6JSvb8Ygn62UW7nw8svy6kvZ3FtQac02RBi6QhlBiISbvrufhIwEnJO_idEHKJHlWLw Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 33cf106de6424278bf2d278203028332 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerShowV247Test-2115389025 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33cf106de6424278bf2d278203028332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_33cf106de6424278bf2d278203028332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33cf106de6424278bf2d278203028332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/33cf106de6424278bf2d278203028332"}]}] Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerShowV247Test-2115389025 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 33cf106de6424278bf2d278203028332 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerShowV247Test-2115389025 Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerShowV247Test-2115389025-project Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 7f08f02f7bcd4a598227a654fbcc4f8b Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerShowV247Test-2115389025-project Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance c876b418-688a-4682-a580-e3d475e0e965 could not be found. Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'c876b418-688a-4682-a580-e3d475e0e965'} Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c876b418-688a-4682-a580-e3d475e0e965 could not be found. Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c876b418-688a-4682-a580-e3d475e0e965 could not be found. Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:00.944800 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:00.955988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:00.955988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:00.955988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:00.955988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:00.955988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:00.955988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c876b418-688a-4682-a580-e3d475e0e965 could not be found. Oct 27 09:27:00.955988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:00.962261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Returning 404 to user: Instance c876b418-688a-4682-a580-e3d475e0e965 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:00.964376 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96e5c474-1373-483d-b54b-819645eeb0d2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965" status: 404 len: 111 microversion: 2.47 time: 0.146089 Oct 27 09:27:00.966122 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2511/5060] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:27:00 2022] GET /compute/v2.1/servers/c876b418-688a-4682-a580-e3d475e0e965 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:27:00.976914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:00.979313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:00.987271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:00.988747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:00.989388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:00.990634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:00.991513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:00.992158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:01.055851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:01.064672 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-894809e9-77f3-4a47-9187-afa9374717a3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.472678 Oct 27 09:27:01.077007 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2550/5061] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:00 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:01.100369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:01.102598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: 8a03cd75-f39a-4970-81a8-f591686b16cd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:01.124033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:01.124925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:01.130319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:01.131745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:01.132425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:01.133356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:01.208450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: 8a03cd75-f39a-4970-81a8-f591686b16cd] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:27:01.456117 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-225dbb1f-498b-4007-bbf3-d6765f148e2b tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd" status: 204 len: 0 microversion: 2.47 time: 0.377010 Oct 27 09:27:01.459048 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2551/5062] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Oct 27 09:27:01 2022] DELETE /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:27:01.473187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:01.475971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:01.511390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:01.513038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:01.514118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:01.515664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:01.517568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:01.519845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:01.569559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:01.572117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:01.583216 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0eed3d39-ba05-4f2f-8734-5dd08c940d3a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1501 microversion: 2.1 time: 0.614342 Oct 27 09:27:01.588303 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2512/5063] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:00 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1501 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:01.593538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:01.594455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: 8a03cd75-f39a-4970-81a8-f591686b16cd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:01.616803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:01.617633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:01.618264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:01.619170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:01.619833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:01.620447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:01.861966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:01.879612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:01.881826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:01.883391 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70bf912e-4e64-4f11-b3be-6db46d4b1142 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd" status: 200 len: 1363 microversion: 2.47 time: 0.293707 Oct 27 09:27:01.884570 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2513/5064] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:27:01 2022] GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:27:01.893595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:01.898504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:01.921279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:01.922112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:01.922746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:01.926533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:01.927342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:01.928009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:02.041404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:02.050146 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ea76a55-fd48-4658-927b-7180459936ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.589224 Oct 27 09:27:02.064150 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2552/5065] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:01 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:02.064150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:02.072386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:02.082513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:02.083022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:02.083724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:02.087193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:02.087912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:02.090686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:02.142234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lazy-loading 'flavor' on Instance uuid fb6af5ba-499b-40ef-9ddb-ce476a959c81 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:27:02.326973 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f7382818-c56a-475c-8f10-9268b1b51efe tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "POST /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81/action" status: 202 len: 0 microversion: 2.1 time: 0.267416 Oct 27 09:27:02.334009 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2553/5066] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:27:02 2022] POST /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:27:02.366624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2651235d-4a5b-4518-a5da-12befba6569a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:02.367349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2651235d-4a5b-4518-a5da-12befba6569a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:02.384970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2651235d-4a5b-4518-a5da-12befba6569a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:02.385483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2651235d-4a5b-4518-a5da-12befba6569a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:02.385936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2651235d-4a5b-4518-a5da-12befba6569a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:02.386666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2651235d-4a5b-4518-a5da-12befba6569a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:02.387128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2651235d-4a5b-4518-a5da-12befba6569a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:02.387593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2651235d-4a5b-4518-a5da-12befba6569a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:02.539290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:02.551838 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9f362d6-6df8-458e-b4e9-04b3105e5f15 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1317 microversion: 2.1 time: 0.664766 Oct 27 09:27:02.559057 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2514/5067] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:01 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:02.573378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:02.579413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:02.590922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:02.591436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:02.594072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:02.595559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:02.596329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:02.596988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:02.836369 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2651235d-4a5b-4518-a5da-12befba6569a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.500692 Oct 27 09:27:02.839327 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2554/5068] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:02 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:02.847927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:02.848957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:02.870548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:02.870906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:02.871362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:02.877087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:02.878343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:02.880132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:02.923533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:02.955458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:03.052393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:03.067963 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f5f5fe2-a8df-4fb4-9f41-ed82e7ed076f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.507240 Oct 27 09:27:03.074503 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2515/5069] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:02 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:03.083509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:03.084767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: 8a03cd75-f39a-4970-81a8-f591686b16cd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:03.104665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:03.107150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:03.107988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:03.109233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:03.109914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:03.110675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:03.151205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:03.227973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:03.264350 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77d4a28d-08ec-41eb-83db-5ee011135b13 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1509 microversion: 2.1 time: 0.420676 Oct 27 09:27:03.265285 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2555/5070] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:02 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:03.289606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:03.290674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:03.305396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:03.305883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:03.306500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:03.307395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:03.309731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:03.313483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:03.333742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:03.347739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:03.355776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:03.357037 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a850994-2685-4473-890d-46bd820bb1b2 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd" status: 200 len: 1363 microversion: 2.47 time: 0.280553 Oct 27 09:27:03.376354 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2516/5071] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:27:03 2022] GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:27:03.582707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:03.583479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:03.595665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:03.596660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:03.597988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:03.598940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:03.599639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:03.600277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:03.684219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:03.697293 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-209dca2b-9411-4a3d-8a50-3ea17b915d0c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.430670 Oct 27 09:27:03.701254 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2556/5072] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:03 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:03.728203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:03.729165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:03.738115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:03.738830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:03.739449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:03.740353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:03.740975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:03.741563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:04.273779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:04.290221 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b71a6286-e871-422b-b651-b8fbbacd3177 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1506 microversion: 2.1 time: 0.706487 Oct 27 09:27:04.291050 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2517/5073] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:03 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:04.298603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9ecefc0-332e-4dfe-831b-cc065e2e8400 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:04.310124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:04.317477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9ecefc0-332e-4dfe-831b-cc065e2e8400 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:04.321633 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c3f53c0e-b9c8-455b-975a-0f6c7efe39d1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.599506 Oct 27 09:27:04.324199 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2557/5074] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:03 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:04.330858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ecefc0-332e-4dfe-831b-cc065e2e8400 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:04.334024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ecefc0-332e-4dfe-831b-cc065e2e8400 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:04.341971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ecefc0-332e-4dfe-831b-cc065e2e8400 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:04.343181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ecefc0-332e-4dfe-831b-cc065e2e8400 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:04.351813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:04.352775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ecefc0-332e-4dfe-831b-cc065e2e8400 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:04.353746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:04.354593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9ecefc0-332e-4dfe-831b-cc065e2e8400 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:04.384411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:04.385880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:04.387127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:04.388020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:04.388620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:04.389168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:04.761952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:04.770527 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9baf2a70-cfa5-48a5-8007-b94653bf36c5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1492 microversion: 2.1 time: 0.444945 Oct 27 09:27:04.771133 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2558/5075] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:04 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1492 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:04.797998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:04.798516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:04.816671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:04.817231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:04.817880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:04.818811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:04.819460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:04.820091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:04.830897 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9ecefc0-332e-4dfe-831b-cc065e2e8400 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.538441 Oct 27 09:27:04.831544 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2518/5076] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:04 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:04.848430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:04.849275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: 8a03cd75-f39a-4970-81a8-f591686b16cd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:04.851287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:27:04.864974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:04.867319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:04.868061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:04.873084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:04.882101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:04.882620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.017841 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6f974d4-a1a2-4340-aea0-33555ab1d9f7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 204 len: 0 microversion: 2.1 time: 0.224418 Oct 27 09:27:05.022120 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2559/5077] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:04 2022] DELETE /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:27:05.033855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5799c6b8-7f31-4638-a8c6-786fa2072f9c req-1f9d54a7-48d9-4a7c-a436-a80cfd56913e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29a5085-e650-4be6-8422-59ac2e59e5a5", "name": "network-vif-plugged", "status": "completed", "tag": "405fdcfd-5bc9-4163-8d14-984aab1200d4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:05.041751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.043548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.044646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.049157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lazy-loading 'fault' on Instance uuid 8a03cd75-f39a-4970-81a8-f591686b16cd {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:27:05.057028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5799c6b8-7f31-4638-a8c6-786fa2072f9c req-1f9d54a7-48d9-4a7c-a436-a80cfd56913e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.057542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5799c6b8-7f31-4638-a8c6-786fa2072f9c req-1f9d54a7-48d9-4a7c-a436-a80cfd56913e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.057980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5799c6b8-7f31-4638-a8c6-786fa2072f9c req-1f9d54a7-48d9-4a7c-a436-a80cfd56913e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.086967 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5799c6b8-7f31-4638-a8c6-786fa2072f9c req-1f9d54a7-48d9-4a7c-a436-a80cfd56913e service nova] Creating event network-vif-plugged:405fdcfd-5bc9-4163-8d14-984aab1200d4 for instance f29a5085-e650-4be6-8422-59ac2e59e5a5 on n-h1-858383-16 Oct 27 09:27:05.103211 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-5799c6b8-7f31-4638-a8c6-786fa2072f9c req-1f9d54a7-48d9-4a7c-a436-a80cfd56913e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079293 Oct 27 09:27:05.106533 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2560/5078] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:27:05.118487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:05.121842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:05.140110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.140611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.140981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:05.141487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.142391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.144236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.145534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.170848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:05.182024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:05.192360 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85094a22-457e-4015-bcaf-39ad9978788a tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd" status: 200 len: 1368 microversion: 2.47 time: 0.349789 Oct 27 09:27:05.193521 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2519/5079] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:27:04 2022] GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:27:05.230842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:27:05.236424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:05.240111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:05.267700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.281300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.282030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.282977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.283637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.286613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.443247 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-153775e2-c3ac-4fd2-95e7-e647214ef04a tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 204 len: 0 microversion: 2.1 time: 0.334348 Oct 27 09:27:05.453027 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2561/5080] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:05 2022] DELETE /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:27:05.464171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:05.464907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:05.487479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.494305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.494874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.495912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.496572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.497457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.640431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:05.655955 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2d9104b4-de22-4ba9-af44-692b2eb95b52 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1512 microversion: 2.1 time: 0.445495 Oct 27 09:27:05.660363 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2520/5081] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:05 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:05.772937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:05.782653 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97cea9a8-114c-4574-9c0f-125dff03677f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1498 microversion: 2.1 time: 0.322915 Oct 27 09:27:05.791591 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2562/5082] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:05 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1498 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:05.874087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd80a78a-7430-4a97-90c6-885e35b5adc1 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:05.874895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd80a78a-7430-4a97-90c6-885e35b5adc1 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:05.889632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd80a78a-7430-4a97-90c6-885e35b5adc1 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.894584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd80a78a-7430-4a97-90c6-885e35b5adc1 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.895317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd80a78a-7430-4a97-90c6-885e35b5adc1 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:05.896374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd80a78a-7430-4a97-90c6-885e35b5adc1 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:05.898523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd80a78a-7430-4a97-90c6-885e35b5adc1 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:05.899186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd80a78a-7430-4a97-90c6-885e35b5adc1 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:06.253535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:06.254249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: 8a03cd75-f39a-4970-81a8-f591686b16cd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:06.269832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:06.269832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:06.270323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:06.271009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:06.271462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:06.271941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:06.364221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:06.367521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:06.368100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:06.368573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lazy-loading 'fault' on Instance uuid 8a03cd75-f39a-4970-81a8-f591686b16cd {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:27:06.456014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:06.465476 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd80a78a-7430-4a97-90c6-885e35b5adc1 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1465 microversion: 2.1 time: 0.595532 Oct 27 09:27:06.466914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:06.468907 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2521/5083] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:05 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1465 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:06.469229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f08f02f7bcd4a598227a654fbcc4f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cf106de6424278bf2d278203028332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:06.471118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37add7f6-6b8d-4d4b-87f3-ed99d52525f8 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd" status: 200 len: 1368 microversion: 2.47 time: 0.226630 Oct 27 09:27:06.471503 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2563/5084] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:27:06 2022] GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:27:06.684707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:06.685818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:06.697571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:06.701526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:06.702393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:06.703545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:06.705046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:06.705650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:06.826371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:06.829726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:06.858732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:06.864066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:06.864907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:06.865950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:06.866900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:06.872318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:07.896060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:07.928568 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9c09d7c-dc2e-432d-a99b-59a01eff61f3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1512 microversion: 2.1 time: 1.248076 Oct 27 09:27:07.948100 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2522/5085] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:06 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1512 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:07.967291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e31a31e2-aa72-4344-a730-14a11c0bf1f4 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:07.968362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e31a31e2-aa72-4344-a730-14a11c0bf1f4 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:08.000386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e31a31e2-aa72-4344-a730-14a11c0bf1f4 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:08.001164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e31a31e2-aa72-4344-a730-14a11c0bf1f4 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:08.001854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e31a31e2-aa72-4344-a730-14a11c0bf1f4 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:08.003094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e31a31e2-aa72-4344-a730-14a11c0bf1f4 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:08.006915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e31a31e2-aa72-4344-a730-14a11c0bf1f4 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:08.008068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e31a31e2-aa72-4344-a730-14a11c0bf1f4 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:08.243295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:08.261650 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b037af4f-dd12-4cc4-b6e8-8977aafd2f0d tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1498 microversion: 2.1 time: 1.438804 Oct 27 09:27:08.263125 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2564/5086] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:06 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1498 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:08.273069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:08.274091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] [instance: 8a03cd75-f39a-4970-81a8-f591686b16cd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:08.283753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:08.284564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:08.285201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:08.286306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:08.287654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:08.288447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:08.308965 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] HTTP exception thrown: Instance 8a03cd75-f39a-4970-81a8-f591686b16cd could not be found. Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Request method failure captured: Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd HTTP/1.1 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pnCiw5sP_vgF01oAc6pIrwyjEnCyxvcefQxlvoRyZuGO9Hhbm5Up2W66z-qGH9O39fhpCRflnx9EvOb0Kv0tj1nbJkT_AnSEBUPRzoQtQ6JSvb8Ygn62UW7nw8svy6kvZ3FtQac02RBi6QhlBiISbvrufhIwEnJO_idEHKJHlWLw Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.47 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 33cf106de6424278bf2d278203028332 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerShowV247Test-2115389025 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33cf106de6424278bf2d278203028332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_33cf106de6424278bf2d278203028332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33cf106de6424278bf2d278203028332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/33cf106de6424278bf2d278203028332"}]}] Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerShowV247Test-2115389025 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 33cf106de6424278bf2d278203028332 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerShowV247Test-2115389025 Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerShowV247Test-2115389025-project Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 7f08f02f7bcd4a598227a654fbcc4f8b Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerShowV247Test-2115389025-project Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 8a03cd75-f39a-4970-81a8-f591686b16cd could not be found. Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '8a03cd75-f39a-4970-81a8-f591686b16cd'} Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a03cd75-f39a-4970-81a8-f591686b16cd could not be found. Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a03cd75-f39a-4970-81a8-f591686b16cd could not be found. Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:08.312279 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:08.319155 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:08.319155 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:08.319155 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:08.319155 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:08.319155 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:08.319155 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a03cd75-f39a-4970-81a8-f591686b16cd could not be found. Oct 27 09:27:08.319155 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:08.339558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] Returning 404 to user: Instance 8a03cd75-f39a-4970-81a8-f591686b16cd could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:08.341376 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a7a6ad0-7b77-4dea-8c1f-5727de8f9e44 tempest-ServerShowV247Test-2115389025 tempest-ServerShowV247Test-2115389025-project] 10.222.0.25 "GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd" status: 404 len: 111 microversion: 2.47 time: 0.076311 Oct 27 09:27:08.352853 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2565/5087] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Oct 27 09:27:08 2022] GET /compute/v2.1/servers/8a03cd75-f39a-4970-81a8-f591686b16cd => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:27:08.758098 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e31a31e2-aa72-4344-a730-14a11c0bf1f4 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1650 microversion: 2.1 time: 0.808407 Oct 27 09:27:08.759060 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2523/5088] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:07 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1650 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:08.798842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-41c28485-26f6-4136-8755-9a033862451c tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:08.800008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-41c28485-26f6-4136-8755-9a033862451c tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:08.816668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41c28485-26f6-4136-8755-9a033862451c tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:08.819057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41c28485-26f6-4136-8755-9a033862451c tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:08.820720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41c28485-26f6-4136-8755-9a033862451c tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:08.821745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41c28485-26f6-4136-8755-9a033862451c tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:08.824525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41c28485-26f6-4136-8755-9a033862451c tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:08.825412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41c28485-26f6-4136-8755-9a033862451c tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:08.973452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:08.977136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:09.002402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:09.008377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:09.012474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:09.015895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:09.020843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:09.022304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:09.244538 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-41c28485-26f6-4136-8755-9a033862451c tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1650 microversion: 2.1 time: 0.448542 Oct 27 09:27:09.246007 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2566/5089] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:08 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1650 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:09.304681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ce8fba6-21a8-480c-9f79-7ae4c9a737c9 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:09.306128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ce8fba6-21a8-480c-9f79-7ae4c9a737c9 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:09.322977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ce8fba6-21a8-480c-9f79-7ae4c9a737c9 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:09.325623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ce8fba6-21a8-480c-9f79-7ae4c9a737c9 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:09.327259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ce8fba6-21a8-480c-9f79-7ae4c9a737c9 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:09.329724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ce8fba6-21a8-480c-9f79-7ae4c9a737c9 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:09.331040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ce8fba6-21a8-480c-9f79-7ae4c9a737c9 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:09.358095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ce8fba6-21a8-480c-9f79-7ae4c9a737c9 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:10.080164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:10.093815 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c600fec-430d-498c-aedf-628c5a18a14b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1512 microversion: 2.1 time: 1.128821 Oct 27 09:27:10.095481 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2524/5090] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:08 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1512 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:10.111416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:10.111679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:10.122068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=89 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:10.145480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:10.146347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:10.147002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:10.148388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:10.149224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:10.150050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:10.280946 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ce8fba6-21a8-480c-9f79-7ae4c9a737c9 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1650 microversion: 2.1 time: 0.990977 Oct 27 09:27:10.282394 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2567/5091] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:09 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1650 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:10.323984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:10.324772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:10.363646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:10.364512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:10.365283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:10.366583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:10.367785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:10.378032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:10.413626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:10.425399 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3120b81-174e-4b7a-865c-cdeb49a5832c tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1456 microversion: 2.1 time: 0.327398 Oct 27 09:27:10.433731 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2525/5092] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:10 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1456 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:10.477331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:27:10.548860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:10.677124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:10.759155 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4bfa271c-2914-4031-813b-bf47f4779e15 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 204 len: 0 microversion: 2.1 time: 0.441385 Oct 27 09:27:10.787514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cabb7168-f363-455b-bc79-9b56aba8e373 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:10.787514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cabb7168-f363-455b-bc79-9b56aba8e373 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:10.789636 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2568/5093] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:10 2022] DELETE /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:27:10.820578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cabb7168-f363-455b-bc79-9b56aba8e373 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:10.830295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cabb7168-f363-455b-bc79-9b56aba8e373 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:10.835398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cabb7168-f363-455b-bc79-9b56aba8e373 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:10.837119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cabb7168-f363-455b-bc79-9b56aba8e373 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:10.838349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cabb7168-f363-455b-bc79-9b56aba8e373 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:10.839929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cabb7168-f363-455b-bc79-9b56aba8e373 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:10.872113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-38ae469d-493c-4b41-9a09-59aec566609d req-400a282d-d394-4514-808a-9f837aca10cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b896a809-0fa3-4871-8de8-f0adfce00a53", "name": "network-vif-deleted", "tag": "2bc5f327-c98c-435c-aa48-d15e94536ca5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:10.933028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-38ae469d-493c-4b41-9a09-59aec566609d req-400a282d-d394-4514-808a-9f837aca10cb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:10.934836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-38ae469d-493c-4b41-9a09-59aec566609d req-400a282d-d394-4514-808a-9f837aca10cb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:10.938906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-38ae469d-493c-4b41-9a09-59aec566609d req-400a282d-d394-4514-808a-9f837aca10cb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:10.998983 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-38ae469d-493c-4b41-9a09-59aec566609d req-400a282d-d394-4514-808a-9f837aca10cb service nova] Creating event network-vif-deleted:2bc5f327-c98c-435c-aa48-d15e94536ca5 for instance b896a809-0fa3-4871-8de8-f0adfce00a53 on n-h1-858383-16 Oct 27 09:27:11.034089 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-38ae469d-493c-4b41-9a09-59aec566609d req-400a282d-d394-4514-808a-9f837aca10cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168516 Oct 27 09:27:11.036462 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2569/5094] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:27:11.138376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:11.139377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:11.147692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:11.148492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:11.172072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:11.173657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:11.174266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:11.174960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:11.406150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:11.421008 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5808cfc2-129a-4123-95ee-f599122aa458 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1470 microversion: 2.1 time: 0.287035 Oct 27 09:27:11.422980 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2570/5095] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:11 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:11.484212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:11.484212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:11.519673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:11.522686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:11.524739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:11.526954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:11.527685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:11.528357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:11.545039 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cabb7168-f363-455b-bc79-9b56aba8e373 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1656 microversion: 2.1 time: 0.768292 Oct 27 09:27:11.560801 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2526/5096] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:10 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1656 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:11.602081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:11.602779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:11.603226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:11.603752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lazy-loading 'fault' on Instance uuid fb6af5ba-499b-40ef-9ddb-ce476a959c81 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:27:11.755440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9243ea430b4d2ba18c2a1e54e7c6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bd45cbfc8b4fb38afebbf40eb09a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:11.771209 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46aadf73-694b-40da-aa8a-518077582dce tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 200 len: 1304 microversion: 2.1 time: 0.299050 Oct 27 09:27:11.772942 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2571/5097] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:11 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 1304 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:12.449353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:12.450202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:12.465402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:12.466145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:12.466763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:12.467728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:12.468385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:12.468990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:12.551913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:12.553168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:12.553806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:12.564050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lazy-loading 'fault' on Instance uuid b896a809-0fa3-4871-8de8-f0adfce00a53 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:27:12.573267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b8807d1-a442-473f-b2d0-5765e2bd9891 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:12.573884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b8807d1-a442-473f-b2d0-5765e2bd9891 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:12.587187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b8807d1-a442-473f-b2d0-5765e2bd9891 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:12.588161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b8807d1-a442-473f-b2d0-5765e2bd9891 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:12.588980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b8807d1-a442-473f-b2d0-5765e2bd9891 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:12.590185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b8807d1-a442-473f-b2d0-5765e2bd9891 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:12.591056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b8807d1-a442-473f-b2d0-5765e2bd9891 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:12.592243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b8807d1-a442-473f-b2d0-5765e2bd9891 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:12.670993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:12.691058 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78d8a8f6-5142-40f4-b9c2-8457ee6de874 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 200 len: 1307 microversion: 2.1 time: 0.244114 Oct 27 09:27:12.693352 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2527/5098] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:12 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:12.802456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:12.803087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:12.820339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:12.821333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:12.824208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:12.825287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:12.827058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:12.828288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:12.865676 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b8807d1-a442-473f-b2d0-5765e2bd9891 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1656 microversion: 2.1 time: 0.296790 Oct 27 09:27:12.876916 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.878602 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2572/5099] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:12 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1656 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 HTTP/1.1 Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'fb6af5ba-499b-40ef-9ddb-ce476a959c81'} Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:12.881938 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.886637 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:12.886637 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:12.886637 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:12.886637 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:12.886637 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:12.886637 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.886637 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.890132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:12.894423 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e400116-755d-4b8c-81e8-4e45696a2f75 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 404 len: 111 microversion: 2.1 time: 0.097722 Oct 27 09:27:12.899724 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2528/5100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:12 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:27:12.916250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:12.916870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:12.950021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:12.950964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:12.951417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:12.952168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:12.952832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:12.953431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:12.990637 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 HTTP/1.1 Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'fb6af5ba-499b-40ef-9ddb-ce476a959c81'} Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:12.992419 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:12.997256 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37140d90-337d-4b45-8798-b95d718ee3e7 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 404 len: 111 microversion: 2.1 time: 0.088609 Oct 27 09:27:13.005377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:13.006642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: fb6af5ba-499b-40ef-9ddb-ce476a959c81] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:13.011603 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2573/5101] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:12 2022] DELETE /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:13.016587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.022641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.023786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.024752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.025408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.026022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.053229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1e76e7ad-71de-4a2c-95b2-907e6c1a4dbe req-0f6f5a60-736e-48a0-9d75-06235bccbcfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6af5ba-499b-40ef-9ddb-ce476a959c81", "name": "network-vif-deleted", "tag": "fe14672c-662e-4b62-ad9b-78c12cec9d0b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:13.073723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1e76e7ad-71de-4a2c-95b2-907e6c1a4dbe req-0f6f5a60-736e-48a0-9d75-06235bccbcfa service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.075395 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 HTTP/1.1 Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'fb6af5ba-499b-40ef-9ddb-ce476a959c81'} Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.077022 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.082866 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.082866 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.082866 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.082866 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:13.082866 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:13.082866 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. Oct 27 09:27:13.082866 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.082866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:13.082866 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2348d10e-cdd2-4f2d-9cd5-59bc229aa23e tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81" status: 404 len: 111 microversion: 2.1 time: 0.078482 Oct 27 09:27:13.085541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1e76e7ad-71de-4a2c-95b2-907e6c1a4dbe req-0f6f5a60-736e-48a0-9d75-06235bccbcfa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.086101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1e76e7ad-71de-4a2c-95b2-907e6c1a4dbe req-0f6f5a60-736e-48a0-9d75-06235bccbcfa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.093142 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2529/5102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:12 2022] GET /compute/v2.1/servers/fb6af5ba-499b-40ef-9ddb-ce476a959c81 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:27:13.099127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:13.099688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:13.122990 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1e76e7ad-71de-4a2c-95b2-907e6c1a4dbe req-0f6f5a60-736e-48a0-9d75-06235bccbcfa service nova] Creating event network-vif-deleted:fe14672c-662e-4b62-ad9b-78c12cec9d0b for instance fb6af5ba-499b-40ef-9ddb-ce476a959c81 on n-h2-858383-16 Oct 27 09:27:13.136442 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1e76e7ad-71de-4a2c-95b2-907e6c1a4dbe req-0f6f5a60-736e-48a0-9d75-06235bccbcfa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087618 Oct 27 09:27:13.138575 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2574/5103] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:27:13.139373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.140116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.140651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.145556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.146912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.149850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.159177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:13.192110 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 HTTP/1.1 Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '28211658-ab52-4f84-8437-e68fd64c3693'} Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:13.194240 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.198860 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.204828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:13.206654 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-920dcf0a-6398-4e30-af59-685b7ccde704 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 404 len: 111 microversion: 2.1 time: 0.111922 Oct 27 09:27:13.210754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2530/5104] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:13 2022] DELETE /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:13.222475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:13.231390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 28211658-ab52-4f84-8437-e68fd64c3693] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:13.282505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.287357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.292157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.297467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.298323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.299058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.384775 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 HTTP/1.1 Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '28211658-ab52-4f84-8437-e68fd64c3693'} Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.396867 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.402518 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.402518 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.402518 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.402518 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:13.402518 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:13.402518 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. Oct 27 09:27:13.402518 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.402518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 28211658-ab52-4f84-8437-e68fd64c3693 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:13.406228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c837870b-db7c-42dc-8bda-8cfcca26ae88 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693" status: 404 len: 111 microversion: 2.1 time: 0.191752 Oct 27 09:27:13.408533 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2575/5105] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:13 2022] GET /compute/v2.1/servers/28211658-ab52-4f84-8437-e68fd64c3693 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:13.416553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:13.417493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:13.428802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.432001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.432613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.442164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.442866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.443527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.482036 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 HTTP/1.1 Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '389f74c5-88ab-43cb-86d5-0ea1b4309ef4'} Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:13.483910 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cec4f226-7136-4772-981e-006b539b8119 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 404 len: 111 microversion: 2.1 time: 0.073128 Oct 27 09:27:13.495532 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2531/5106] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:13 2022] DELETE /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:13.544631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:13.551143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 389f74c5-88ab-43cb-86d5-0ea1b4309ef4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:13.606073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.608331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.619661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.623666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.626598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.627459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.670545 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 HTTP/1.1 Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '389f74c5-88ab-43cb-86d5-0ea1b4309ef4'} Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.674270 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.686914 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.686914 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.686914 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.686914 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:13.686914 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:13.686914 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. Oct 27 09:27:13.686914 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.703758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 389f74c5-88ab-43cb-86d5-0ea1b4309ef4 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:13.709885 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cfd9cfe7-2974-49e0-85d2-03a8ae07a0ae tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4" status: 404 len: 111 microversion: 2.1 time: 0.207978 Oct 27 09:27:13.718910 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2576/5107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:13 2022] GET /compute/v2.1/servers/389f74c5-88ab-43cb-86d5-0ea1b4309ef4 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:13.719118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:13.719118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:13.736007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.736518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.736974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.738257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.738724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.738852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:13.739157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.739868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:13.766712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.768092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.771420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.782885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.792918 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 HTTP/1.1 Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'b896a809-0fa3-4871-8de8-f0adfce00a53'} Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.802101 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.807678 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.807678 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.807678 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.807678 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:13.807678 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:13.807678 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:27:13.807678 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.808297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.808297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.813893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:13.814982 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-86edb34c-b7ee-436f-a098-45963171a7da tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 404 len: 111 microversion: 2.1 time: 0.100646 Oct 27 09:27:13.816406 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2532/5108] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:13 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:13.835374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:13.844142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:13.864096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.864934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.868400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.870030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.875306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.880567 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.881058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e HTTP/1.1 Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e'} Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:13.882652 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.888863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:13.893604 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-20889047-7b34-474d-8448-85e5d5c3ab31 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 404 len: 111 microversion: 2.1 time: 0.168118 Oct 27 09:27:13.896861 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2577/5109] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:13 2022] DELETE /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:27:13.909250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:13.910273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:13.925006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.926223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.927536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.928904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:13.931064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:13.932721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:13.970774 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e HTTP/1.1 Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e'} Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:13.974234 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.978935 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:13.978935 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:13.978935 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:13.978935 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:13.978935 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:13.978935 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. Oct 27 09:27:13.978935 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:13.986692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:13.993036 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49025364-b4c1-4c98-81f7-768503910b30 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e" status: 404 len: 111 microversion: 2.1 time: 0.090271 Oct 27 09:27:13.999985 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2578/5110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:13 2022] GET /compute/v2.1/servers/339d0c72-821b-4f6f-8b77-e6bdb9ea1e3e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:14.007909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:14.008955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:14.016131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:14.017008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:14.017691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:14.018822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:14.020311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:14.021000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:14.070320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:14.071059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:14.072542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:14.073782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lazy-loading 'fault' on Instance uuid f29a5085-e650-4be6-8422-59ac2e59e5a5 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:27:14.226880 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-81bb9da1-5487-426c-8b79-c8e974abf11a tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 200 len: 1455 microversion: 2.1 time: 0.225324 Oct 27 09:27:14.229674 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2579/5111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:14 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 1455 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:14.243528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3bbee9a5-cc83-46e8-8aea-20aa3d32a11f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:14.249913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3bbee9a5-cc83-46e8-8aea-20aa3d32a11f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b4a56315-a394-4a58-b151-8f24e650455a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:14.267375 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-3bbee9a5-cc83-46e8-8aea-20aa3d32a11f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3bbee9a5-cc83-46e8-8aea-20aa3d32a11f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a HTTP/1.1 Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b4a56315-a394-4a58-b151-8f24e650455a'} Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.269483 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:14.274157 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.274157 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:14.274157 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:14.274157 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:14.274157 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:14.274157 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:14.274157 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.274157 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.278137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3bbee9a5-cc83-46e8-8aea-20aa3d32a11f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:14.280403 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3bbee9a5-cc83-46e8-8aea-20aa3d32a11f tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a" status: 404 len: 111 microversion: 2.1 time: 0.049086 Oct 27 09:27:14.281578 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2580/5112] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:14 2022] DELETE /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:14.300620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eae658d2-3588-463c-919a-1dcebcb8ba38 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:14.301689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eae658d2-3588-463c-919a-1dcebcb8ba38 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b4a56315-a394-4a58-b151-8f24e650455a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:14.316812 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-eae658d2-3588-463c-919a-1dcebcb8ba38 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eae658d2-3588-463c-919a-1dcebcb8ba38 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a HTTP/1.1 Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b4a56315-a394-4a58-b151-8f24e650455a'} Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:14.323379 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:14.339489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:14.339489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:14.339489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:14.339489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. Oct 27 09:27:14.339489 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.339489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eae658d2-3588-463c-919a-1dcebcb8ba38 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance b4a56315-a394-4a58-b151-8f24e650455a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:14.339489 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eae658d2-3588-463c-919a-1dcebcb8ba38 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a" status: 404 len: 111 microversion: 2.1 time: 0.038264 Oct 27 09:27:14.339489 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2581/5113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:14 2022] GET /compute/v2.1/servers/b4a56315-a394-4a58-b151-8f24e650455a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:14.502941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:14.555322 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df6d391e-be12-44da-8399-65f95f0704eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.730958 Oct 27 09:27:14.558727 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2533/5114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:13 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:14.827597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f03dc1b-6cac-41a0-8dce-cbebf6acf4b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f03dc1b-6cac-41a0-8dce-cbebf6acf4b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 163 Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": 12345, "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 12345 Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:27:14.835487 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f03dc1b-6cac-41a0-8dce-cbebf6acf4b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:14.840359 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f03dc1b-6cac-41a0-8dce-cbebf6acf4b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.013205 Oct 27 09:27:14.842586 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2582/5115] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:14 2022] POST /compute/v2.1/servers => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:27:14.858695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:14.861902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:14.932566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:14.933038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:14.933497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:14.934257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:14.934727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:14.935167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:15.210201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2aa76e7d-2231-4d3d-a8e8-610636eaa56d req-671e385e-adcb-4fc6-acac-bd1630d4f70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29a5085-e650-4be6-8422-59ac2e59e5a5", "name": "network-vif-deleted", "tag": "405fdcfd-5bc9-4163-8d14-984aab1200d4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:15.229315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2aa76e7d-2231-4d3d-a8e8-610636eaa56d req-671e385e-adcb-4fc6-acac-bd1630d4f70c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:15.229806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2aa76e7d-2231-4d3d-a8e8-610636eaa56d req-671e385e-adcb-4fc6-acac-bd1630d4f70c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:15.230247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2aa76e7d-2231-4d3d-a8e8-610636eaa56d req-671e385e-adcb-4fc6-acac-bd1630d4f70c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:15.268417 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2aa76e7d-2231-4d3d-a8e8-610636eaa56d req-671e385e-adcb-4fc6-acac-bd1630d4f70c service nova] Creating event network-vif-deleted:405fdcfd-5bc9-4163-8d14-984aab1200d4 for instance f29a5085-e650-4be6-8422-59ac2e59e5a5 on n-h1-858383-16 Oct 27 09:27:15.277630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2aa76e7d-2231-4d3d-a8e8-610636eaa56d req-671e385e-adcb-4fc6-acac-bd1630d4f70c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072498 Oct 27 09:27:15.278257 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2583/5116] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:27:15.295801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:15.296516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: f29a5085-e650-4be6-8422-59ac2e59e5a5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:15.314556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:15.315861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:15.322693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:15.323471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:15.323969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:15.327690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:15.370129 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] HTTP exception thrown: Instance f29a5085-e650-4be6-8422-59ac2e59e5a5 could not be found. Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Request method failure captured: Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 HTTP/1.1 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6j00pSVJS6BavF7bICT6ESEy7KzFH6-GFBeLfszzNz2XnNrkTk9SwYCbFHzxQGkPLVN1anfIPEfvxNN1AAhCWP6e68x0tzC5pYmu5btSHXkdjJghRZ3lwJjN6Huf-0xQi1P0jYwjOWZwU8m2EixcTmncJA0_PmQsESKb73XeHaaB8 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e3d4527580694ac4a5a0f4d0ac00b173 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestServerMultinode-340608980 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3d4527580694ac4a5a0f4d0ac00b173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3d4527580694ac4a5a0f4d0ac00b173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3d4527580694ac4a5a0f4d0ac00b173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3d4527580694ac4a5a0f4d0ac00b173"}]}] Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestServerMultinode-340608980 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e3d4527580694ac4a5a0f4d0ac00b173 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestServerMultinode-340608980 Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestServerMultinode-340608980-project-admin Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 33f5f0d58d974dd4999f1ff92452117d Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestServerMultinode-340608980-project-admin Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f29a5085-e650-4be6-8422-59ac2e59e5a5 could not be found. Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f29a5085-e650-4be6-8422-59ac2e59e5a5'} Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29a5085-e650-4be6-8422-59ac2e59e5a5 could not be found. Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29a5085-e650-4be6-8422-59ac2e59e5a5 could not be found. Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:15.375352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:15.381390 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:15.381390 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:15.381390 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:15.381390 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:15.381390 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:15.381390 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29a5085-e650-4be6-8422-59ac2e59e5a5 could not be found. Oct 27 09:27:15.381390 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:15.385693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Returning 404 to user: Instance f29a5085-e650-4be6-8422-59ac2e59e5a5 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:15.386791 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-68ad434f-3419-4ca2-81d9-434fd970ffd6 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5" status: 404 len: 111 microversion: 2.1 time: 0.107445 Oct 27 09:27:15.395614 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2584/5117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:15 2022] GET /compute/v2.1/servers/f29a5085-e650-4be6-8422-59ac2e59e5a5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:15.412105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:15.412816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:15.433113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:15.433616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:15.434064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:15.434790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:15.435312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:15.435712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:15.538419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:27:15.694951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:15.707247 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13b06837-c543-4fa2-8183-c97b5f09858c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.862350 Oct 27 09:27:15.708821 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2534/5118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:14 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:15.748214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:15.763166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:15.782398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:15.783155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:15.788921 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f4ff643-a220-49d8-b9ba-c1f65fcf84d5 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 204 len: 0 microversion: 2.1 time: 0.391545 Oct 27 09:27:15.793244 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2585/5119] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:15 2022] DELETE /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:27:15.793470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:15.793470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:15.793470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:15.793470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:15.798945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-11ea47c6-3aea-4d2b-bc09-5d40ff8397c3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:15.800246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-11ea47c6-3aea-4d2b-bc09-5d40ff8397c3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:15.822419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11ea47c6-3aea-4d2b-bc09-5d40ff8397c3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:15.823235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11ea47c6-3aea-4d2b-bc09-5d40ff8397c3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:15.823877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11ea47c6-3aea-4d2b-bc09-5d40ff8397c3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:15.824779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11ea47c6-3aea-4d2b-bc09-5d40ff8397c3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:15.825431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11ea47c6-3aea-4d2b-bc09-5d40ff8397c3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:15.826034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11ea47c6-3aea-4d2b-bc09-5d40ff8397c3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:16.420726 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-11ea47c6-3aea-4d2b-bc09-5d40ff8397c3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1656 microversion: 2.1 time: 0.625843 Oct 27 09:27:16.439188 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2586/5120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:15 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1656 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:16.706894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:16.721098 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1d9c27f-b79d-47e8-a02c-d9cc6f384b26 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.981450 Oct 27 09:27:16.723533 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2535/5121] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:15 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:17.447148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2424e40b-87e6-43f7-a91a-0293498dbe55 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:17.448485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2424e40b-87e6-43f7-a91a-0293498dbe55 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:17.459373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2424e40b-87e6-43f7-a91a-0293498dbe55 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:17.463237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2424e40b-87e6-43f7-a91a-0293498dbe55 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:17.463750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2424e40b-87e6-43f7-a91a-0293498dbe55 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:17.464521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2424e40b-87e6-43f7-a91a-0293498dbe55 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:17.464994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2424e40b-87e6-43f7-a91a-0293498dbe55 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:17.465430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2424e40b-87e6-43f7-a91a-0293498dbe55 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:18.297923 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2424e40b-87e6-43f7-a91a-0293498dbe55 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1656 microversion: 2.1 time: 0.854469 Oct 27 09:27:18.308859 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2587/5122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:17 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1656 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:19.349715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95f90429-58c8-4f77-9286-be6a41e29194 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:19.350875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95f90429-58c8-4f77-9286-be6a41e29194 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:19.377817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95f90429-58c8-4f77-9286-be6a41e29194 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:19.378640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95f90429-58c8-4f77-9286-be6a41e29194 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:19.379452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95f90429-58c8-4f77-9286-be6a41e29194 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:19.380739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95f90429-58c8-4f77-9286-be6a41e29194 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:19.381558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95f90429-58c8-4f77-9286-be6a41e29194 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:19.382164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95f90429-58c8-4f77-9286-be6a41e29194 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:19.669177 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95f90429-58c8-4f77-9286-be6a41e29194 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1656 microversion: 2.1 time: 0.336672 Oct 27 09:27:19.669652 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2536/5123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:19 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1656 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:20.206891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27024aba-aba4-4f63-8479-8352a0ed3207 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1417748781", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b853ecaf-2945-4d6f-86fa-515fc4827176", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:20.370491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-afa6e524-53f0-48db-8bf2-bd5be06c153e req-40e1d116-260f-47dd-9463-a3ef21aff2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d69b0c-245f-49f3-82a8-97337afb18de", "name": "network-vif-deleted", "tag": "55769c6d-541b-4d04-bbb3-7ceda852ab9c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:20.398206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afa6e524-53f0-48db-8bf2-bd5be06c153e req-40e1d116-260f-47dd-9463-a3ef21aff2b4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:20.398879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afa6e524-53f0-48db-8bf2-bd5be06c153e req-40e1d116-260f-47dd-9463-a3ef21aff2b4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:20.400635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afa6e524-53f0-48db-8bf2-bd5be06c153e req-40e1d116-260f-47dd-9463-a3ef21aff2b4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:20.423641 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-afa6e524-53f0-48db-8bf2-bd5be06c153e req-40e1d116-260f-47dd-9463-a3ef21aff2b4 service nova] Creating event network-vif-deleted:55769c6d-541b-4d04-bbb3-7ceda852ab9c for instance 18d69b0c-245f-49f3-82a8-97337afb18de on n-h2-858383-16 Oct 27 09:27:20.425438 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-27024aba-aba4-4f63-8479-8352a0ed3207 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Block Device b853ecaf-2945-4d6f-86fa-515fc4827176 is not bootable. Oct 27 09:27:20.431250 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-afa6e524-53f0-48db-8bf2-bd5be06c153e req-40e1d116-260f-47dd-9463-a3ef21aff2b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072705 Oct 27 09:27:20.432806 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2537/5124] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27024aba-aba4-4f63-8479-8352a0ed3207 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 358 Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1417748781", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b853ecaf-2945-4d6f-86fa-515fc4827176", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: exception: Block Device b853ecaf-2945-4d6f-86fa-515fc4827176 is not bootable. Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1417748781', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'b853ecaf-2945-4d6f-86fa-515fc4827176'}], 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device b853ecaf-2945-4d6f-86fa-515fc4827176 is not bootable. Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:20.438601 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device b853ecaf-2945-4d6f-86fa-515fc4827176 is not bootable. Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device b853ecaf-2945-4d6f-86fa-515fc4827176 is not bootable. Oct 27 09:27:20.447019 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:20.451364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27024aba-aba4-4f63-8479-8352a0ed3207 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Block Device b853ecaf-2945-4d6f-86fa-515fc4827176 is not bootable. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:20.452692 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27024aba-aba4-4f63-8479-8352a0ed3207 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.250880 Oct 27 09:27:20.458061 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2588/5125] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:20 2022] POST /compute/v2.1/servers => generated 110 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:27:20.477407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:20.478291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:20.486454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:20.487507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:20.487992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:20.488730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:20.489197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:20.489632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:20.716102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:20.719678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:20.734620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:20.735832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:20.737199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:20.739893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:20.740804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:20.741522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:20.819598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:20.820150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:20.821304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:20.821968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lazy-loading 'fault' on Instance uuid 18d69b0c-245f-49f3-82a8-97337afb18de {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:27:20.946180 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b396c34-8e4c-4346-8b4a-50d0e725d8b3 tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 200 len: 1455 microversion: 2.1 time: 0.246948 Oct 27 09:27:20.962409 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2589/5126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:20 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 1455 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:21.203979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:21.204800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:21.226209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.231666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.232403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.234595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.239991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.240457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.266583 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 HTTP/1.1 Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b636e1b0-c610-4b0c-a3b2-8ff5992647c6'} Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:21.276243 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.280963 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.283615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:21.285389 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9cbf0541-61ce-4334-ad0b-0d3ae6c019c9 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 404 len: 111 microversion: 2.1 time: 0.085396 Oct 27 09:27:21.286542 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2590/5127] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:21 2022] DELETE /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:21.294763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:21.301086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: b636e1b0-c610-4b0c-a3b2-8ff5992647c6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:21.319319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.320235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.320902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.327868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.328415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.328869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.366632 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 HTTP/1.1 Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b636e1b0-c610-4b0c-a3b2-8ff5992647c6'} Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:21.376073 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.380903 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.380903 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:21.380903 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:21.380903 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:21.380903 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:21.380903 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. Oct 27 09:27:21.380903 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.384295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance b636e1b0-c610-4b0c-a3b2-8ff5992647c6 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:21.389477 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85077566-fa34-4df4-8f06-56fabd6862b5 tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6" status: 404 len: 111 microversion: 2.1 time: 0.098502 Oct 27 09:27:21.398073 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2591/5128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:21 2022] GET /compute/v2.1/servers/b636e1b0-c610-4b0c-a3b2-8ff5992647c6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:27:21.419769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:21.420515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:21.427862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.431697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.432556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.435096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.436530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.437632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.474076 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde HTTP/1.1 Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '33172046-c141-45cb-9fe0-7d14e946adde'} Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:21.476239 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.481583 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.487556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:21.489027 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-89f5e5fe-0468-4c94-aea8-97b8665c72ff tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 404 len: 111 microversion: 2.1 time: 0.089498 Oct 27 09:27:21.490138 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2592/5129] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:21 2022] DELETE /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:21.500254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:21.504432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] [instance: 33172046-c141-45cb-9fe0-7d14e946adde] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:21.525603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.526435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.527125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.528095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.528820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.529442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.560369 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] HTTP exception thrown: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Request method failure captured: Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde HTTP/1.1 Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk2Ad_FOg6Ik_0Zfce-Ms8Dle543gqxNOzHpSr3cH6MwkyRSl-TQ-N49UqSXcpYOBfccbqQBK-9UfTv10XUSo5D6t6BnvrYAn2pKiVrdkWwOfeKOGQ4tlB-FWO3Jh3JlDxc2cmU22K7AKjDUf30slYyYdpnhYGquzdHWAF04tCkhklQ Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42bd45cbfc8b4fb38afebbf40eb09a12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42bd45cbfc8b4fb38afebbf40eb09a12"}]}] Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 42bd45cbfc8b4fb38afebbf40eb09a12 Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293673673 Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a9243ea430b4d2ba18c2a1e54e7c6aa Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-1293673673-project Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '33172046-c141-45cb-9fe0-7d14e946adde'} Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:21.565329 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.570755 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:21.570755 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:21.570755 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:21.570755 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:21.570755 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:21.570755 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. Oct 27 09:27:21.570755 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:21.574202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] Returning 404 to user: Instance 33172046-c141-45cb-9fe0-7d14e946adde could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:21.574202 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-22c3dea7-3673-4722-bbdb-5580ca2230ea tempest-DeleteServersTestJSON-1293673673 tempest-DeleteServersTestJSON-1293673673-project] 10.222.0.25 "GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde" status: 404 len: 111 microversion: 2.1 time: 0.078169 Oct 27 09:27:21.586129 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2593/5130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:21 2022] GET /compute/v2.1/servers/33172046-c141-45cb-9fe0-7d14e946adde => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:21.700157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:21.742081 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fdf49d0e-0166-432b-8c82-1f520201b742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.280529 Oct 27 09:27:21.744692 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2538/5131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:20 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:21.793031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:21.794036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:21.809980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.810405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.810853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.820178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.820861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.821327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.896082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:21.974627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:21.975725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] [instance: 18d69b0c-245f-49f3-82a8-97337afb18de] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:21.987416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.990188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.992760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:21.993653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:21.995761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:21.998253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:22.041369 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] HTTP exception thrown: Instance 18d69b0c-245f-49f3-82a8-97337afb18de could not be found. Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Request method failure captured: Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de HTTP/1.1 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6j00pSVJS6BavF7bICT6ESEy7KzFH6-GFBeLfszzNz2XnNrkTk9SwYCbFHzxQGkPLVN1anfIPEfvxNN1AAhCWP6e68x0tzC5pYmu5btSHXkdjJghRZ3lwJjN6Huf-0xQi1P0jYwjOWZwU8m2EixcTmncJA0_PmQsESKb73XeHaaB8 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: e3d4527580694ac4a5a0f4d0ac00b173 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestServerMultinode-340608980 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3d4527580694ac4a5a0f4d0ac00b173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3d4527580694ac4a5a0f4d0ac00b173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3d4527580694ac4a5a0f4d0ac00b173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3d4527580694ac4a5a0f4d0ac00b173"}]}] Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestServerMultinode-340608980 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: e3d4527580694ac4a5a0f4d0ac00b173 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestServerMultinode-340608980 Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestServerMultinode-340608980-project-admin Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 33f5f0d58d974dd4999f1ff92452117d Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestServerMultinode-340608980-project-admin Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 18d69b0c-245f-49f3-82a8-97337afb18de could not be found. Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '18d69b0c-245f-49f3-82a8-97337afb18de'} Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d69b0c-245f-49f3-82a8-97337afb18de could not be found. Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d69b0c-245f-49f3-82a8-97337afb18de could not be found. Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:22.049761 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:22.054619 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:22.054619 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:22.054619 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:22.054619 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:22.054619 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:22.054619 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d69b0c-245f-49f3-82a8-97337afb18de could not be found. Oct 27 09:27:22.054619 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:22.054619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] Returning 404 to user: Instance 18d69b0c-245f-49f3-82a8-97337afb18de could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:22.054619 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3f79b36b-3656-456e-926e-7010f8d709ac tempest-TestServerMultinode-340608980 tempest-TestServerMultinode-340608980-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de" status: 404 len: 111 microversion: 2.1 time: 0.083979 Oct 27 09:27:22.055291 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2539/5132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:21 2022] GET /compute/v2.1/servers/18d69b0c-245f-49f3-82a8-97337afb18de => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:22.636287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:22.649263 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3aaf71c-4fa6-40ea-8778-062455ad5b94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.860843 Oct 27 09:27:22.651469 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2594/5133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:21 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:25.749725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aacc3af3-9f05-4aff-b532-f2f8195dd260 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-954576761", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "destination_type": "local"}, {"source_type": "volume", "uuid": "c6c33f52-4cd7-4c5f-8fd8-3a0abca749f0", "destination_type": "invalid"}], "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aacc3af3-9f05-4aff-b532-f2f8195dd260 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 494 Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-954576761", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "destination_type": "local"}, {"source_type": "volume", "uuid": "c6c33f52-4cd7-4c5f-8fd8-3a0abca749f0", "destination_type": "invalid"}], "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-954576761', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c6c33f52-4cd7-4c5f-8fd8-3a0abca749f0', 'destination_type': 'invalid'}], 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'invalid' Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:25.761874 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 27 09:27:25.767294 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:25.771403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aacc3af3-9f05-4aff-b532-f2f8195dd260 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:25.772419 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aacc3af3-9f05-4aff-b532-f2f8195dd260 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.027032 Oct 27 09:27:25.773209 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2540/5134] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:25 2022] POST /compute/v2.1/servers => generated 155 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:27:25.787120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:25.788254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:25.800661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:25.801204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:25.801661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:25.802572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:25.803220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:25.804285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:26.563475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:26.586636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aab23c5e-6e45-40ba-aebf-452e006eeeec tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.800357 Oct 27 09:27:26.590932 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2595/5135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:25 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:26.639067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:26.639800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:26.676609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:26.677251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:26.677723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:26.679409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:26.680374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:26.680834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:27.350030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:27.363673 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51158e57-6fb5-472e-a6da-f61047514a0a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.728989 Oct 27 09:27:27.364287 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2541/5136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:26 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:27.510349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f463494f-bb58-4ff4-9cb2-6def8c95d681 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-536741533", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f463494f-bb58-4ff4-9cb2-6def8c95d681 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 491 Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-536741533", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-536741533', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:27.523057 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 27 09:27:27.527365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:27.533351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f463494f-bb58-4ff4-9cb2-6def8c95d681 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:27.542124 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f463494f-bb58-4ff4-9cb2-6def8c95d681 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.036490 Oct 27 09:27:27.548765 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2596/5137] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:27 2022] POST /compute/v2.1/servers => generated 624 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:27:27.570273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:27.570932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:27.606254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:27.612342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:27.613404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:27.620554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:27.622021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:27.630876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:28.623095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:28.673232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c070fe92-a79f-4c92-b35a-6609bad58521 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.118889 Oct 27 09:27:28.677744 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2542/5138] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:27 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:28.704679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:28.706093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:28.731632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:28.737012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:28.738790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:28.739634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:28.740137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:28.740585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:30.038667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:30.082668 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-100d8c9d-51e9-42cf-8eab-a8d0917ebfcc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.381682 Oct 27 09:27:30.106309 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2597/5139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:28 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:30.233501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54d0de0e-b39a-446d-aa56-32f4e9d86ba0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54d0de0e-b39a-446d-aa56-32f4e9d86ba0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 416 Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:30.244615 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:27:30.253409 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:30.261406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54d0de0e-b39a-446d-aa56-32f4e9d86ba0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:30.262593 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54d0de0e-b39a-446d-aa56-32f4e9d86ba0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.034764 Oct 27 09:27:30.263797 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2543/5140] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:30 2022] POST /compute/v2.1/servers => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:27:30.274345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:30.274985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:30.286548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:30.287115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:30.287707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:30.288363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:30.292834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:30.293635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:30.913871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:30.931950 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bfecaa44-da43-4dfc-991d-a7ae5f0bfed0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.661867 Oct 27 09:27:30.938421 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2598/5141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:30 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:30.976890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:30.978163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:30.990613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:30.993333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:30.994383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:30.996162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:30.999092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:31.000735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:31.614315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:31.628923 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ca43491-2e46-4c65-a3b9-0d785c573b1b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.657016 Oct 27 09:27:31.648979 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2544/5142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:30 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:31.845133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0e43010-cf65-4cac-99d4-bac2a78455b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-181749510", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": -1, "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:31.978184 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a0e43010-cf65-4cac-99d4-bac2a78455b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Flavor -1 could not be found. Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0e43010-cf65-4cac-99d4-bac2a78455b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 205 Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-181749510", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": -1, "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: exception: Flavor -1 could not be found. Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-181749510', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': -1, 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:31.988791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:31.998319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0e43010-cf65-4cac-99d4-bac2a78455b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:32.008342 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a0e43010-cf65-4cac-99d4-bac2a78455b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.163846 Oct 27 09:27:32.010735 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2599/5143] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:31 2022] POST /compute/v2.1/servers => generated 73 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 27 09:27:32.020212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:32.021084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:32.047634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:32.048447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:32.049574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:32.050699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:32.051546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:32.052279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:32.423278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:32.440115 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e3bbeb5-2b1f-4eed-9413-ba266669463a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.422692 Oct 27 09:27:32.453224 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2545/5144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:32 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:32.474499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:32.476290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:32.497889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:32.499213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:32.500291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:32.501873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:32.503964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:32.505182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:33.129631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:33.186468 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85294fc7-97f5-4f09-ad67-a4f9a3ecdb7d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.718125 Oct 27 09:27:33.188457 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2600/5145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:32 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:33.268815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54c080a7-bbae-4eda-a237-ff9cc83ae86b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1421382202", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54c080a7-bbae-4eda-a237-ff9cc83ae86b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 173 Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1421382202", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1421382202', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi -1 Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:27:33.276786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 27 09:27:33.282923 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:33.288505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54c080a7-bbae-4eda-a237-ff9cc83ae86b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:33.290018 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54c080a7-bbae-4eda-a237-ff9cc83ae86b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.025422 Oct 27 09:27:33.294572 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2546/5146] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:33 2022] POST /compute/v2.1/servers => generated 145 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:27:33.338520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:33.339544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:33.350903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:33.351923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:33.352721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:33.354380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:33.354805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:33.356254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:33.850540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:33.895977 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae2379dd-f5ed-4dce-8597-c375cac9ff10 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.593341 Oct 27 09:27:33.897539 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2601/5147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:33 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:33.923000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:33.923810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:33.940740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:33.941585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:33.942247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:33.943207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:33.943852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:33.945487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:34.630095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1932647790", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7a475c77-fcd2-4475-b72a-44ef10abc15a"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:34.648627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:34.679077 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4aa7bb80-9648-4bf7-b728-d5a8cd21ef0b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.760349 Oct 27 09:27:34.700282 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2547/5148] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:33 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:34.788802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] validate_networks() for [('7a475c77-fcd2-4475-b72a-44ef10abc15a', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:27:34.838744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f57e243c-8122-4ccd-bb63-650af434aea5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-650381334", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:34.869309 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f57e243c-8122-4ccd-bb63-650af434aea5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f57e243c-8122-4ccd-bb63-650af434aea5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 215 Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-650381334", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-650381334', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:34.876473 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:34.882458 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:34.882458 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:34.882458 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:34.882458 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:34.882458 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:34.882458 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 27 09:27:34.882458 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:34.882458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f57e243c-8122-4ccd-bb63-650af434aea5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:34.882458 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f57e243c-8122-4ccd-bb63-650af434aea5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.047959 Oct 27 09:27:34.892132 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2548/5149] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:34 2022] POST /compute/v2.1/servers => generated 123 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:27:34.916240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:34.917279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:34.937377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:34.938672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:34.940264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:34.942340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:34.943435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:34.944489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:35.594121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:35.630235 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ead880a-fc65-4f38-8287-d825703ef903 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.735985 Oct 27 09:27:35.631644 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2549/5150] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:34 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:35.677056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:35.678133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:35.726246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:35.727125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:35.739598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:35.740907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:35.741774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:35.742591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:36.711072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:36.727937 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-601b1c8a-57e3-474a-87ab-150eb4972b8d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.052368 Oct 27 09:27:36.728603 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2550/5151] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:35 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:36.852263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73ada171-ae32-4b55-845c-abfd5f2de1ff tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-524045585", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "key_name": "tempest-key-785901796", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:36.956411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-73ada171-ae32-4b55-845c-abfd5f2de1ff tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] validate_networks() for [('50c6db4e-db8b-44ab-b99d-c1c74e5a0258', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:27:38.630712 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-73ada171-ae32-4b55-845c-abfd5f2de1ff tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Invalid key_name provided. Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73ada171-ae32-4b55-845c-abfd5f2de1ff tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 245 Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-524045585", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "key_name": "tempest-key-785901796", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid key_name provided. Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-524045585', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'key_name': 'tempest-key-785901796', 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-785901796 not found for user 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:38.643878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:38.649380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73ada171-ae32-4b55-845c-abfd5f2de1ff tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid key_name provided. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:38.653416 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73ada171-ae32-4b55-845c-abfd5f2de1ff tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.805059 Oct 27 09:27:38.657537 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2551/5152] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:36 2022] POST /compute/v2.1/servers => generated 70 bytes in 1810 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:27:38.669621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:38.670491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:38.684940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:38.685788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:38.690255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:38.691444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:38.692232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:38.692921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:38.740163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:27:38.740749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:27:38.741310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:27:38.741964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:27:38.742505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:27:38.771134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:38.780700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:38.783554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:38.785982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:38.789327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:38.790203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:38.846825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:27:38.853464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for user 993f47058e6d48f7ac30138be91496c5 and project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:27:38.869259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:27:38.872473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:27:38.988775 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ebde9be0-a9d8-4f54-95a2-55cff4779a54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.588740 Oct 27 09:27:38.990290 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2602/5153] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:27:39.009384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-48f8bdeb-564f-4321-9297-a8d2c0e5ed86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:39.014592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-48f8bdeb-564f-4321-9297-a8d2c0e5ed86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:39.317673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-48f8bdeb-564f-4321-9297-a8d2c0e5ed86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:39.327686 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-48f8bdeb-564f-4321-9297-a8d2c0e5ed86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1193 microversion: 2.1 time: 0.323031 Oct 27 09:27:39.330563 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2603/5154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:39 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1193 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:39.462283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:39.484516 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f474c53f-fd09-4e22-b1f9-49c263bd008a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.820470 Oct 27 09:27:39.488899 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2552/5155] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:38 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:39.515052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:39.516879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:39.525638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:39.527416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:39.528134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:39.528907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:39.530053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:39.531850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:39.532643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:40.363528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:40.366689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:40.410143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=52 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:40.418875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:40.420646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:40.424964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:40.426610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:40.427990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:40.429237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:40.908415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:40.961095 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8b3f85b7-01ab-4cff-b024-1f6371272569 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1197 microversion: 2.1 time: 0.603052 Oct 27 09:27:40.962973 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2553/5156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:40 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1197 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:41.304657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:41.338912 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d709dcd4-02d3-4f45-85a4-7cd656e776fd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.829825 Oct 27 09:27:41.362088 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2604/5157] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:39 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:41.662166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffc3291f-3018-4383-af5d-3141ad22bc9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1009132485", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:41.902766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.security_group_api [None req-ffc3291f-3018-4383-af5d-3141ad22bc9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Neutron security group does_not_exist not found {{(pid=120603) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 27 09:27:41.906251 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ffc3291f-3018-4383-af5d-3141ad22bc9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffc3291f-3018-4383-af5d-3141ad22bc9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 258 Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1009132485", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1009132485', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 27 09:27:41.926897 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:41.940132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ffc3291f-3018-4383-af5d-3141ad22bc9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:41.953687 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ffc3291f-3018-4383-af5d-3141ad22bc9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.271974 Oct 27 09:27:41.953687 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2554/5158] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:41 2022] POST /compute/v2.1/servers => generated 106 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:27:41.967489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:41.968825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:41.992906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:41.993535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:42.004250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:42.005792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:42.008150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:42.008649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:42.009094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:42.011064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:42.012610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:42.013931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:42.014393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:42.014737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:42.016493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:42.017615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:42.378765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:42.394890 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5926eeca-0a6a-4a14-89b0-912e450609f3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1263 microversion: 2.1 time: 0.405823 Oct 27 09:27:42.397735 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2555/5159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:41 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1263 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:42.807790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:42.869289 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c758159-66c6-43b4-88b4-91e7f2a9e9e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.907573 Oct 27 09:27:42.884715 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2605/5160] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:41 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:42.917295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:42.922503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:42.963284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:42.969157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:42.969965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:42.979157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:42.980001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:42.980944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:42.999321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:43.435334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:43.439719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:43.458649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:43.462914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:43.464145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:43.465911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:43.466737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:43.467518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:44.432625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:44.443447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b57bc32f-92a4-4526-a7af-9cd06757aeeb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1251 microversion: 2.1 time: 1.020957 Oct 27 09:27:44.447444 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2606/5161] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:43 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1251 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:44.650439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:44.696023 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e381c3c8-d9c1-4f3e-ae69-95b255dc9187 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.779914 Oct 27 09:27:44.699162 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2556/5162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:42 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:44.724725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a222e26-39f7-48bd-b5e2-656c11f50686 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:44.725224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a222e26-39f7-48bd-b5e2-656c11f50686 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: 784aa2b0-383c-441f-878b-768feae941df] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:44.739083 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-5a222e26-39f7-48bd-b5e2-656c11f50686 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance 784aa2b0-383c-441f-878b-768feae941df could not be found. Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a222e26-39f7-48bd-b5e2-656c11f50686 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/784aa2b0-383c-441f-878b-768feae941df HTTP/1.1 Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 784aa2b0-383c-441f-878b-768feae941df could not be found. Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '784aa2b0-383c-441f-878b-768feae941df'} Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784aa2b0-383c-441f-878b-768feae941df could not be found. Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784aa2b0-383c-441f-878b-768feae941df could not be found. Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:44.744617 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:44.750628 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:44.750628 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:44.750628 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:44.750628 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:44.750628 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:44.750628 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:44.750628 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784aa2b0-383c-441f-878b-768feae941df could not be found. Oct 27 09:27:44.750628 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:27:44.755931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a222e26-39f7-48bd-b5e2-656c11f50686 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance 784aa2b0-383c-441f-878b-768feae941df could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:44.757171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a222e26-39f7-48bd-b5e2-656c11f50686 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "DELETE /compute/v2.1/servers/784aa2b0-383c-441f-878b-768feae941df" status: 404 len: 111 microversion: 2.1 time: 0.037746 Oct 27 09:27:44.764000 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2607/5163] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:27:44 2022] DELETE /compute/v2.1/servers/784aa2b0-383c-441f-878b-768feae941df => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:44.774675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:44.778377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:44.810353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:44.811762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:44.812551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:44.813873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:44.817502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:44.819412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:45.471064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:45.471963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:45.484009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:45.484372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:45.484814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:45.485536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:45.486548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:45.486994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:46.362082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:46.387055 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35c33ce8-fc63-46b3-baa6-5da43ee1a36d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.612587 Oct 27 09:27:46.388824 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2557/5164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:44 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:46.420828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:46.421460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:46.436482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:46.437250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:46.439420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:46.441370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:46.443039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:46.443500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:47.207771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:47.216922 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db321105-923d-4975-abac-d382ba880e4d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1293 microversion: 2.1 time: 1.749534 Oct 27 09:27:47.226212 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2608/5165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:45 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1293 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:47.648318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2476c2fc-2cb4-475c-8fd9-f3be0cd27118 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:47.650893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2476c2fc-2cb4-475c-8fd9-f3be0cd27118 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:47.672778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2476c2fc-2cb4-475c-8fd9-f3be0cd27118 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:47.673710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2476c2fc-2cb4-475c-8fd9-f3be0cd27118 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:47.674351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2476c2fc-2cb4-475c-8fd9-f3be0cd27118 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:47.675393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2476c2fc-2cb4-475c-8fd9-f3be0cd27118 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:47.676080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2476c2fc-2cb4-475c-8fd9-f3be0cd27118 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:47.676691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2476c2fc-2cb4-475c-8fd9-f3be0cd27118 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:47.781235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:47.808084 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-820d75f4-6763-4b5a-9444-9080136fe084 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.390984 Oct 27 09:27:47.821556 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2558/5166] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:46 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:47.839383 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2476c2fc-2cb4-475c-8fd9-f3be0cd27118 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.194816 Oct 27 09:27:47.840350 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2609/5167] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:27:47 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:27:47.852290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57b77725-e2a7-4286-8157-11d6fb85c22c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:47.852540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:47.853740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:47.854781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-57b77725-e2a7-4286-8157-11d6fb85c22c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 09:27:47.863052 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-57b77725-e2a7-4286-8157-11d6fb85c22c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57b77725-e2a7-4286-8157-11d6fb85c22c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 9223372036854775808 could not be found. Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '9223372036854775808'} Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:47.866644 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:47.871983 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:47.871983 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:47.871983 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:47.871983 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 27 09:27:47.871983 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:47.871983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57b77725-e2a7-4286-8157-11d6fb85c22c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:47.879659 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-57b77725-e2a7-4286-8157-11d6fb85c22c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.042170 Oct 27 09:27:47.885387 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2559/5168] 10.222.0.25 () {58 vars in 1188 bytes} [Thu Oct 27 09:27:47 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:27:47.885527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:47.885959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:47.886412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:47.887155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:47.887643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:47.888082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:47.908372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:47.920051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:47.934165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:47.935078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:47.935920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:47.937318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:47.948568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:47.949476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:48.588413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:48.597029 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9eb8a66b-2e0d-43cc-a2ee-3fbabd380d63 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1669 microversion: 2.1 time: 0.748972 Oct 27 09:27:48.597641 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2610/5169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:47 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1669 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:48.616520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:48.617483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:48.628860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:48.633791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:48.634424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:48.635321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:48.636011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:48.636603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:48.641226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:48.669395 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b7dd06b-6cc6-4d9b-89e5-75de2f3074ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.777086 Oct 27 09:27:48.674198 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2560/5170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:47 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:48.716629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:48.718221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:48.731920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:48.734679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:48.737968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:48.738951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:48.741860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:48.742708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:48.808492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:49.322095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:49.769206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:49.783536 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49a3ee0a-cd9a-4212-9512-3d88925b7ac1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1293 microversion: 2.1 time: 1.184262 Oct 27 09:27:49.790532 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2611/5171] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:48 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1293 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:49.818494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:49.823498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:49.826565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:49.850374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:49.851373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:49.852110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:49.853180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:49.855931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:49.857312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:49.859066 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8aefcee4-dfea-4933-a850-1415809f5dee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.152193 Oct 27 09:27:49.859954 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2561/5172] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:48 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:49.912704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff2d74c6-edba-4a7a-bd4f-c4c165034f3e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:49.913228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff2d74c6-edba-4a7a-bd4f-c4c165034f3e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Failed to fetch instance by id -1 {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 27 09:27:49.913925 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ff2d74c6-edba-4a7a-bd4f-c4c165034f3e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance -1 could not be found. Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff2d74c6-edba-4a7a-bd4f-c4c165034f3e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance -1 could not be found. Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '-1'} Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:49.916155 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:49.923490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:49.923490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:49.923490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 27 09:27:49.923490 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:49.923490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff2d74c6-edba-4a7a-bd4f-c4c165034f3e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:49.923490 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff2d74c6-edba-4a7a-bd4f-c4c165034f3e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.027870 Oct 27 09:27:49.939687 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2562/5173] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:27:49 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:27:49.946273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:49.956765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:49.994188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:49.995271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:49.996183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:49.997520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:49.998490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:49.999331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:50.428740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:50.440512 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-981aac43-5532-4090-bf92-c2d28cc1c524 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1669 microversion: 2.1 time: 0.648569 Oct 27 09:27:50.445078 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2612/5174] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:49 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1669 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:50.739762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:50.754683 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-52b28808-c538-4315-acad-4d11ce82c88c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.813387 Oct 27 09:27:50.760467 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2563/5175] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:49 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:50.815318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:50.819658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:50.839415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:50.842624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:50.844216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:50.846249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:50.847320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:50.849039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:50.851497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:50.852821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:50.868965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:50.870508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:50.871305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:50.872496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:50.874829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:50.880486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:52.331559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:52.335887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:27:52.351733 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0dbb6171-a66d-4db7-b9c4-4981a53d6c89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.544526 Oct 27 09:27:52.369183 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2613/5176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:50 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:52.386255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f1dd970d-3410-4316-a7db-fe7995a868d3 req-b7f230a4-b9b1-4429-b478-938938e4dc71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841496a0-aacf-4f9c-8522-94dd6f501ba7", "tag": "bb38a11e-0d4a-4785-ab1b-3f9c7e87be4a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:52.412126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f1dd970d-3410-4316-a7db-fe7995a868d3 req-b7f230a4-b9b1-4429-b478-938938e4dc71 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:52.413799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f1dd970d-3410-4316-a7db-fe7995a868d3 req-b7f230a4-b9b1-4429-b478-938938e4dc71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:52.414485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f1dd970d-3410-4316-a7db-fe7995a868d3 req-b7f230a4-b9b1-4429-b478-938938e4dc71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:52.460849 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f1dd970d-3410-4316-a7db-fe7995a868d3 req-b7f230a4-b9b1-4429-b478-938938e4dc71 service nova] Creating event network-changed:bb38a11e-0d4a-4785-ab1b-3f9c7e87be4a for instance 841496a0-aacf-4f9c-8522-94dd6f501ba7 on n-h1-858383-16 Oct 27 09:27:52.484410 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f1dd970d-3410-4316-a7db-fe7995a868d3 req-b7f230a4-b9b1-4429-b478-938938e4dc71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112500 Oct 27 09:27:52.486412 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2614/5177] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:27:52.508346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:52.508585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:52.509254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:52.522895 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d82bf338-4ef4-4976-9ec9-77421fd646a1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1293 microversion: 2.1 time: 1.684584 Oct 27 09:27:52.523142 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2564/5178] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:50 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1293 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:52.541448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:52.542440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:52.543552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:52.544782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:52.545620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:52.545809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-acf9b431-2cc9-4fb7-b49c-df65f757cbbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:52.546383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-acf9b431-2cc9-4fb7-b49c-df65f757cbbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: 1e0b5944-7245-4432-b36f-315a41aa94cd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:52.547797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:52.573171 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-acf9b431-2cc9-4fb7-b49c-df65f757cbbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance 1e0b5944-7245-4432-b36f-315a41aa94cd could not be found. Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-acf9b431-2cc9-4fb7-b49c-df65f757cbbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/1e0b5944-7245-4432-b36f-315a41aa94cd/action HTTP/1.1 Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 19 Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: {"forceDelete": {}} Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 1e0b5944-7245-4432-b36f-315a41aa94cd could not be found. Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '1e0b5944-7245-4432-b36f-315a41aa94cd', 'body': {'forceDelete': {}}} Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0b5944-7245-4432-b36f-315a41aa94cd could not be found. Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0b5944-7245-4432-b36f-315a41aa94cd could not be found. Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:52.589293 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:52.594719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:52.594719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:52.594719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0b5944-7245-4432-b36f-315a41aa94cd could not be found. Oct 27 09:27:52.594719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:52.594719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-acf9b431-2cc9-4fb7-b49c-df65f757cbbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance 1e0b5944-7245-4432-b36f-315a41aa94cd could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:52.594719 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-acf9b431-2cc9-4fb7-b49c-df65f757cbbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0b5944-7245-4432-b36f-315a41aa94cd/action" status: 404 len: 111 microversion: 2.1 time: 0.058853 Oct 27 09:27:52.594719 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2565/5179] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:27:52 2022] POST /compute/v2.1/servers/1e0b5944-7245-4432-b36f-315a41aa94cd/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:52.602071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:52.602982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:52.633477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:52.634037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:52.636520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:52.638059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:52.638620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:52.639024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:53.377835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:53.387172 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1a17738e-c459-4c0a-b6db-696a820a9232 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1674 microversion: 2.1 time: 0.898566 Oct 27 09:27:53.406010 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2615/5180] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:52 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1674 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:53.546273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:53.546847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:53.566107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:53.566624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:53.567279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:53.568233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:53.568880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:53.569497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:53.668891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:53.713913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb360eb5-9f2f-41e9-b609-33247453a573 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.113310 Oct 27 09:27:53.716621 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2566/5181] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:52 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:53.775609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:53.778304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:53.795847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:53.796793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:53.798969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:53.802155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:53.803451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:53.804466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:54.216558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:54.225396 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-acdb2b7e-693d-4ef9-955d-423e84cd3e72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1293 microversion: 2.1 time: 0.682885 Oct 27 09:27:54.233042 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2616/5182] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:53 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1293 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:54.413363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:54.414086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:54.431128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:54.431560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:54.432038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:54.432760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:54.433225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:54.433658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:54.636696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:54.653310 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0aacc1cf-7a00-4141-baa3-11df6f0a6d6a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.909777 Oct 27 09:27:54.653914 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2567/5183] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:53 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:54.679929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d06854b-0f39-4b59-a0fc-9be0d6950d1d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:54.685121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d06854b-0f39-4b59-a0fc-9be0d6950d1d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d08f5642-5908-4171-8d98-f6f1f42620a7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:54.702254 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4d06854b-0f39-4b59-a0fc-9be0d6950d1d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance d08f5642-5908-4171-8d98-f6f1f42620a7 could not be found. Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d06854b-0f39-4b59-a0fc-9be0d6950d1d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/d08f5642-5908-4171-8d98-f6f1f42620a7/action HTTP/1.1 Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 39 Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: {"os-getConsoleOutput": {"length": 10}} Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d08f5642-5908-4171-8d98-f6f1f42620a7 could not be found. Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd08f5642-5908-4171-8d98-f6f1f42620a7', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d08f5642-5908-4171-8d98-f6f1f42620a7 could not be found. Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d08f5642-5908-4171-8d98-f6f1f42620a7 could not be found. Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:54.708371 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:54.714626 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:54.714626 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:54.714626 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:54.714626 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:54.714626 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d08f5642-5908-4171-8d98-f6f1f42620a7 could not be found. Oct 27 09:27:54.714626 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:54.716353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d06854b-0f39-4b59-a0fc-9be0d6950d1d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance d08f5642-5908-4171-8d98-f6f1f42620a7 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:54.717787 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d06854b-0f39-4b59-a0fc-9be0d6950d1d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d08f5642-5908-4171-8d98-f6f1f42620a7/action" status: 404 len: 111 microversion: 2.1 time: 0.041953 Oct 27 09:27:54.723179 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2568/5184] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:27:54 2022] POST /compute/v2.1/servers/d08f5642-5908-4171-8d98-f6f1f42620a7/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:27:54.736702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:54.737689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:54.761629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:54.762147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:54.762748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:54.763505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:54.763999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:54.764442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:55.153605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:55.161574 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2dff53be-ba4a-4f90-b5d9-11b1ef3bc73d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1674 microversion: 2.1 time: 0.752049 Oct 27 09:27:55.162176 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2617/5185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:54 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1674 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:55.251827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:55.252759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:55.263468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:55.268784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:55.269472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:55.270589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:55.271306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:55.284319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:55.484182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:55.496098 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd280178-fd06-4ff9-8db5-6cb688cdc5a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.771418 Oct 27 09:27:55.503005 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2569/5186] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:54 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:55.529698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:55.530816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:55.539906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:55.540755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:55.541413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:55.542377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:55.543092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:55.543762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:56.303462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:56.325556 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f655b60-c50f-4d0e-bb47-bc5784231920 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1293 microversion: 2.1 time: 1.078241 Oct 27 09:27:56.336936 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2618/5187] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:55 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1293 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:56.349366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:56.350295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:56.366929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:56.367958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:56.370175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:56.371401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:56.372137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:56.372850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:56.607671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:56.644898 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51ecc274-3162-45a4-bc06-785466dea59d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.119484 Oct 27 09:27:56.655105 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2570/5188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:55 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:56.672221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67e08a1d-d8ac-4c20-8e37-fdb50f12e17b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:56.673227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67e08a1d-d8ac-4c20-8e37-fdb50f12e17b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: 806da760-22b6-43a8-a3e0-dfddfabd82f5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:56.680516 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-67e08a1d-d8ac-4c20-8e37-fdb50f12e17b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance 806da760-22b6-43a8-a3e0-dfddfabd82f5 could not be found. Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67e08a1d-d8ac-4c20-8e37-fdb50f12e17b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/806da760-22b6-43a8-a3e0-dfddfabd82f5 HTTP/1.1 Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 806da760-22b6-43a8-a3e0-dfddfabd82f5 could not be found. Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '806da760-22b6-43a8-a3e0-dfddfabd82f5'} Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 806da760-22b6-43a8-a3e0-dfddfabd82f5 could not be found. Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 806da760-22b6-43a8-a3e0-dfddfabd82f5 could not be found. Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:56.682420 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:56.688541 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:56.688541 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:27:56.688541 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:27:56.688541 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 806da760-22b6-43a8-a3e0-dfddfabd82f5 could not be found. Oct 27 09:27:56.688541 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:56.705619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67e08a1d-d8ac-4c20-8e37-fdb50f12e17b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance 806da760-22b6-43a8-a3e0-dfddfabd82f5 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:56.722448 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67e08a1d-d8ac-4c20-8e37-fdb50f12e17b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/806da760-22b6-43a8-a3e0-dfddfabd82f5" status: 404 len: 111 microversion: 2.1 time: 0.039138 Oct 27 09:27:56.736145 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2571/5189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:56 2022] GET /compute/v2.1/servers/806da760-22b6-43a8-a3e0-dfddfabd82f5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:27:56.760022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:56.761015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:56.770612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:56.771111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:56.771737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:56.772558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:56.773020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:56.773699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:57.419548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:57.428388 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f37913b-0ce1-4517-a704-9882cea14736 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.690621 Oct 27 09:27:57.428993 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2572/5190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:56 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:57.445537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:57.446221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:57.464079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:57.464741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:57.465340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:57.466183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:57.480373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:57.481042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:57.678892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:57.688636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-151b279e-e43b-456c-8a4b-c8f1f3209c1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1674 microversion: 2.1 time: 1.350068 Oct 27 09:27:57.710449 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2619/5191] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:56 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1674 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:57.727881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:57.728512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:57.741708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:57.742219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:57.742661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:57.748467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:57.749032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:57.750115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:57.886423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:57.903199 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62942a89-5e89-44a3-8666-95b9038d58f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1293 microversion: 2.1 time: 0.473062 Oct 27 09:27:57.923232 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2573/5192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:57 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1293 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:58.295990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:58.310166 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc9a9052-7d43-4bc5-bf35-ed49e4d2107d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.598437 Oct 27 09:27:58.372258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2620/5193] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:57 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:58.546635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f96ab732-19f0-4de8-8342-e1bf5b8cf216 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-883990133", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f96ab732-19f0-4de8-8342-e1bf5b8cf216 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 237 Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-883990133", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-883990133', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:58.571078 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 27 09:27:58.577512 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:27:58.581723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f96ab732-19f0-4de8-8342-e1bf5b8cf216 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:27:58.583535 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f96ab732-19f0-4de8-8342-e1bf5b8cf216 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.044141 Oct 27 09:27:58.588274 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2574/5194] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:27:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:27:58.592981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:58.593612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:58.606183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:58.606742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:58.607207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:58.616408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:58.617391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:58.618049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:58.721028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:58.721721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:58.736342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:58.737240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:58.737870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:58.739815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:58.740696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:58.741370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:59.079436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:59.095616 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0ce9dcc-8d62-457f-b855-b828bbed6d60 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.379572 Oct 27 09:27:59.100007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:27:59.121424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2575/5195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:58 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:27:59.130066 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8cab4c7-274d-4cb3-844e-398bb604be1c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.540843 Oct 27 09:27:59.134135 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2621/5196] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:58 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:27:59.140838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:59.142549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:59.151459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-03422f13-93ad-4974-865b-a9b11d206086 req-448d610a-ecf5-42f2-a996-59db52452780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841496a0-aacf-4f9c-8522-94dd6f501ba7", "name": "network-vif-plugged", "status": "completed", "tag": "bb38a11e-0d4a-4785-ab1b-3f9c7e87be4a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:27:59.180859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:59.182037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:59.182774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:59.186734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:59.192261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:59.195493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:59.209116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-03422f13-93ad-4974-865b-a9b11d206086 req-448d610a-ecf5-42f2-a996-59db52452780 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:59.210426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-03422f13-93ad-4974-865b-a9b11d206086 req-448d610a-ecf5-42f2-a996-59db52452780 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:59.211581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-03422f13-93ad-4974-865b-a9b11d206086 req-448d610a-ecf5-42f2-a996-59db52452780 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:59.247640 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-03422f13-93ad-4974-865b-a9b11d206086 req-448d610a-ecf5-42f2-a996-59db52452780 service nova] Creating event network-vif-plugged:bb38a11e-0d4a-4785-ab1b-3f9c7e87be4a for instance 841496a0-aacf-4f9c-8522-94dd6f501ba7 on n-h1-858383-16 Oct 27 09:27:59.261908 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-03422f13-93ad-4974-865b-a9b11d206086 req-448d610a-ecf5-42f2-a996-59db52452780 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123550 Oct 27 09:27:59.262600 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2622/5197] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:27:59.293735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:27:59.294447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:27:59.365731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:59.366638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:59.371864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:27:59.376892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:27:59.377863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:27:59.379018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:00.211799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:00.228884 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d862d98-0d26-44a5-939e-b15783957332 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1293 microversion: 2.1 time: 1.105666 Oct 27 09:28:00.237885 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2576/5198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:59 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1293 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:00.433780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:00.455184 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-772b1e68-91e1-46b8-acd2-7f1e241afce8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.191291 Oct 27 09:28:00.462531 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2623/5199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:27:59 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:00.634938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-484b2971-b221-45ee-b8dc-bb96f2dafefa tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-931398501", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-484b2971-b221-45ee-b8dc-bb96f2dafefa tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 234 Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-931398501", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-931398501', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:00.639369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:00.649892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-484b2971-b221-45ee-b8dc-bb96f2dafefa tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:00.657896 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-484b2971-b221-45ee-b8dc-bb96f2dafefa tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.018679 Oct 27 09:28:00.659441 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2577/5200] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:28:00 2022] POST /compute/v2.1/servers => generated 133 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:28:00.668040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:00.669587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:00.689811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:00.692095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:00.692969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:00.695230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:00.696102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:00.699936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:01.246828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:01.260828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:01.262530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:01.265547 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9be61185-2202-46b7-8f38-b5cdfa5083a0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.600892 Oct 27 09:28:01.279612 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2624/5201] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:00 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:01.293941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:01.294533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:01.299393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:01.302550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:01.303439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:01.306305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:01.307763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:01.308631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:01.311666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:01.314091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:01.314554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:01.315325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:01.315835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:01.316263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:02.087502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:02.102304 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fab03a15-430c-4153-958a-46e8109c9c1c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1293 microversion: 2.1 time: 0.845396 Oct 27 09:28:02.111611 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2578/5202] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:01 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1293 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:02.168429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:02.183385 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f40cb3e7-37ed-4d7d-a00c-1e0fefabb2bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.893182 Oct 27 09:28:02.208454 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2625/5203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:01 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:02.215018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e37fee4-b5e7-4331-825a-94d95c4492bd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:02.215707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e37fee4-b5e7-4331-825a-94d95c4492bd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: fa791277-5d5b-4c17-aee1-6d38d28a4c54] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:02.229060 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8e37fee4-b5e7-4331-825a-94d95c4492bd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance fa791277-5d5b-4c17-aee1-6d38d28a4c54 could not be found. Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e37fee4-b5e7-4331-825a-94d95c4492bd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/fa791277-5d5b-4c17-aee1-6d38d28a4c54/action HTTP/1.1 Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 13 Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: {"pause": {}} Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance fa791277-5d5b-4c17-aee1-6d38d28a4c54 could not be found. Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'fa791277-5d5b-4c17-aee1-6d38d28a4c54', 'body': {'pause': {}}} Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa791277-5d5b-4c17-aee1-6d38d28a4c54 could not be found. Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa791277-5d5b-4c17-aee1-6d38d28a4c54 could not be found. Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:02.240557 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:02.246089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:02.246089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:02.246089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa791277-5d5b-4c17-aee1-6d38d28a4c54 could not be found. Oct 27 09:28:02.246089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:02.246089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e37fee4-b5e7-4331-825a-94d95c4492bd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance fa791277-5d5b-4c17-aee1-6d38d28a4c54 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:02.246089 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e37fee4-b5e7-4331-825a-94d95c4492bd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/fa791277-5d5b-4c17-aee1-6d38d28a4c54/action" status: 404 len: 111 microversion: 2.1 time: 0.033070 Oct 27 09:28:02.246089 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2579/5204] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:02 2022] POST /compute/v2.1/servers/fa791277-5d5b-4c17-aee1-6d38d28a4c54/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:28:02.254908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:02.255769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:02.266480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:02.269815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:02.272061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:02.272957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:02.274709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:02.276050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:02.607091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:02.619480 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-54b7ac5d-c6c0-40bc-a125-c1048e8a7bf7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.369128 Oct 27 09:28:02.622435 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2626/5205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:02 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:02.644505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:02.646187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:02.680829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:02.681578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:02.686342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:02.688752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:02.694052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:02.694816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:03.050107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:03.053605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:03.071673 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f2de1e4-23ac-4f37-8fb1-8cdb9f6b63db tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.432219 Oct 27 09:28:03.080749 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2580/5206] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:02 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:03.111061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7af2329f-1c55-4daa-b646-3ffca5941201 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:03.120238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7af2329f-1c55-4daa-b646-3ffca5941201 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:03.136718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7af2329f-1c55-4daa-b646-3ffca5941201 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:03.139945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:03.140768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:03.149416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7af2329f-1c55-4daa-b646-3ffca5941201 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:03.157019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7af2329f-1c55-4daa-b646-3ffca5941201 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:03.159093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:03.161340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:03.163851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7af2329f-1c55-4daa-b646-3ffca5941201 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:03.164707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:03.165479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7af2329f-1c55-4daa-b646-3ffca5941201 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:03.166297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7af2329f-1c55-4daa-b646-3ffca5941201 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:03.166723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:03.167388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:03.169561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:03.397623 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7af2329f-1c55-4daa-b646-3ffca5941201 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 202 len: 0 microversion: 2.1 time: 0.285302 Oct 27 09:28:03.399756 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2627/5207] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:03 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:28:03.412917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:03.421567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:03.460483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:03.464677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:03.470604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:03.471883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:03.472625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:03.473908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:03.933183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:03.974046 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77eba983-0f3c-4ef9-bd6d-1f9b0f1bd1a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1474 microversion: 2.1 time: 0.842566 Oct 27 09:28:03.979300 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2581/5208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:03 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1474 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:04.179326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:04.189691 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5448c344-c679-4152-9fb6-d0889bc1ca7e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1509 microversion: 2.1 time: 0.783929 Oct 27 09:28:04.190903 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2628/5209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:03 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1509 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:04.317611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1564159407", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:04.417506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] validate_networks() for [('7a475c77-fcd2-4475-b72a-44ef10abc15a', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:28:05.234526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:05.240721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:05.271336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:05.272258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:05.272990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:05.275886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:05.276743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:05.277412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:05.557700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:28:05.558468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:28:05.560870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:28:05.562081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:28:05.564128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:28:05.605662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:05.611706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:05.612576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:05.614690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:05.615519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:05.618795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:05.620788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:05.632675 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08953f7c-a2b2-4b8c-b72b-7a05efa011ab tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1489 microversion: 2.1 time: 0.410306 Oct 27 09:28:05.633449 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2629/5210] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:05 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1489 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:05.655979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:05.657004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:05.663438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:05.664230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:05.664837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:05.665765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:05.666427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:05.667034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:05.710218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:28:05.712754 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Cannot 'pause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state paused Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action HTTP/1.1 Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 13 Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: {"pause": {}} Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: exception: Cannot 'pause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state paused Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a', 'body': {'pause': {}}} Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a in vm_state paused. Cannot pause while the instance is in this state. Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state paused Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:05.714636 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:05.724710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:05.724710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:05.724710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:05.724710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state paused Oct 27 09:28:05.724710 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:05.724710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 409 to user: Cannot 'pause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state paused {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:05.724710 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-95748fd7-ddf1-4e42-9f90-93db3c759886 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 409 len: 143 microversion: 2.1 time: 0.064378 Oct 27 09:28:05.736096 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2630/5211] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:05 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 143 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:28:05.741187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-014dbda3-dbf1-4ac4-a66d-77807431701a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:05.741738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-014dbda3-dbf1-4ac4-a66d-77807431701a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:05.744021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for user 993f47058e6d48f7ac30138be91496c5 and project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:28:05.757544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014dbda3-dbf1-4ac4-a66d-77807431701a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:05.758050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014dbda3-dbf1-4ac4-a66d-77807431701a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:05.758491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014dbda3-dbf1-4ac4-a66d-77807431701a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:05.759420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014dbda3-dbf1-4ac4-a66d-77807431701a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:05.760237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014dbda3-dbf1-4ac4-a66d-77807431701a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:05.766648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-014dbda3-dbf1-4ac4-a66d-77807431701a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:05.770127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:05.802232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:28:05.810762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: debdabf8-e414-4374-9148-99c78ea2892c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:28:05.933600 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af5d74d4-b079-4d25-adb5-7d03d5667eda tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621238 Oct 27 09:28:05.945470 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2582/5212] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:28:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:28:05.950477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0dc70dcb-1932-4260-a609-ea1a4def987a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:05.950903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0dc70dcb-1932-4260-a609-ea1a4def987a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: debdabf8-e414-4374-9148-99c78ea2892c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:05.994028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0dc70dcb-1932-4260-a609-ea1a4def987a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: debdabf8-e414-4374-9148-99c78ea2892c] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:28:06.006609 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-014dbda3-dbf1-4ac4-a66d-77807431701a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 202 len: 0 microversion: 2.1 time: 0.265304 Oct 27 09:28:06.008161 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2631/5213] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:05 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:28:06.058270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:06.067907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:06.106877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:06.109685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:06.111861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:06.113448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:06.116271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:06.117319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:06.558303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:06.570762 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0d06b550-c969-4a1b-b21d-55202194b9a7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1496 microversion: 2.1 time: 0.558322 Oct 27 09:28:06.571505 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2632/5214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:06 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1496 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:06.735161 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0dc70dcb-1932-4260-a609-ea1a4def987a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c" status: 204 len: 0 microversion: 2.1 time: 0.782552 Oct 27 09:28:06.744701 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2583/5215] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:28:05 2022] DELETE /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c => generated 0 bytes in 796 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:28:06.751823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4288cb16-0199-43c8-8b6b-a6907675f196 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:06.752682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4288cb16-0199-43c8-8b6b-a6907675f196 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: debdabf8-e414-4374-9148-99c78ea2892c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:06.789700 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4288cb16-0199-43c8-8b6b-a6907675f196 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4288cb16-0199-43c8-8b6b-a6907675f196 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c HTTP/1.1 Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'debdabf8-e414-4374-9148-99c78ea2892c'} Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance debdabf8-e414-4374-9148-99c78ea2892c Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:06.793853 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4288cb16-0199-43c8-8b6b-a6907675f196 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4288cb16-0199-43c8-8b6b-a6907675f196 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c" status: 404 len: 111 microversion: 2.1 time: 0.051009 Oct 27 09:28:06.798839 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2633/5216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:06 2022] GET /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:28:06.929891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1853349735", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "7a475c77-fcd2-4475-b72a-44ef10abc15a"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:07.109635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] validate_networks() for [('7a475c77-fcd2-4475-b72a-44ef10abc15a', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:28:07.600026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:07.601513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:07.616925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:07.619784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:07.620506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:07.621431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:07.623864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:07.624538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:09.409425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:09.458370 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ebaa6852-1d78-4b91-af71-d2a5205d52a2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.857511 Oct 27 09:28:09.467115 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2634/5217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:07 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:09.528386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:09.538821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:09.572129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:09.572642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:09.575410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:09.576234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:09.580531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:09.581155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:10.024900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:28:10.025383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:28:10.027416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:28:10.029332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:28:10.030074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:28:10.054686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:10.055512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:10.056153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:10.058411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:10.060548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:10.061441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:10.118551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:28:10.140083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for user 993f47058e6d48f7ac30138be91496c5 and project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:28:10.257285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:28:10.266383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:28:10.459946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:10.527156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:10.554151 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-039cfaeb-eae0-4845-9234-17e077447ce9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.636863 Oct 27 09:28:10.561254 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2584/5218] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:28:10.565300 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-74f8a53b-e60a-4b59-b66f-2c5a5db37ef8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.053950 Oct 27 09:28:10.608159 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2635/5219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:09 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:10.641983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23d90479-413c-4c5c-bce6-4400785416a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:10.648062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:10.648616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23d90479-413c-4c5c-bce6-4400785416a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:10.655484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:10.668317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=68 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:10.683273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:10.691070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:10.700131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:10.701466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:10.702203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:10.702893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:10.768974 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53/action HTTP/1.1 Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 28 Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: {"reboot": {"type": "SOFT"}} Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b896a809-0fa3-4871-8de8-f0adfce00a53', 'body': {'reboot': {'type': 'SOFT'}}} Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:10.771079 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:10.778078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:10.781378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:10.782703 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47bd33c2-4630-47fd-b8ae-4292ba7cf82d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53/action" status: 404 len: 111 microversion: 2.1 time: 0.169772 Oct 27 09:28:10.785741 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2636/5220] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:10 2022] POST /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53/action => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:28:10.805745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:10.806543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:10.817715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:10.823096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:10.823793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:10.824699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:10.825457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:10.826175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:10.920144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-23d90479-413c-4c5c-bce6-4400785416a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:10.939132 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23d90479-413c-4c5c-bce6-4400785416a4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1221 microversion: 2.1 time: 0.356874 Oct 27 09:28:10.944827 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2585/5221] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:10 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1221 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:11.701930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:11.724812 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86664222-4932-4732-bf7c-770a63b1d5b4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.921969 Oct 27 09:28:11.726726 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2637/5222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:10 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:11.774367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:11.775245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:11.787158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:11.787755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:11.788528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:11.790133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:11.797243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:11.798051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:11.974747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc4647d0-362a-4ab4-8cdb-cc835dda76fd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:11.975688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc4647d0-362a-4ab4-8cdb-cc835dda76fd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:12.292913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fc4647d0-362a-4ab4-8cdb-cc835dda76fd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:12.306870 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc4647d0-362a-4ab4-8cdb-cc835dda76fd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1221 microversion: 2.1 time: 0.336674 Oct 27 09:28:12.308389 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2638/5223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:11 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1221 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:12.690232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:12.700301 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5d2da44-ccd6-4ef2-8541-b0fa825c9f03 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.930000 Oct 27 09:28:12.708887 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2586/5224] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:11 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:12.738026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1693562298", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ae09c0e3-851a-4f89-a19f-2ab607592cdc"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:12.783967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8dcc83d-997d-45b6-9eca-35225ce83ab2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:12.805020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8dcc83d-997d-45b6-9eca-35225ce83ab2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: 169400ca-948b-4d5f-b25d-744340e68c87] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:12.861400 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b8dcc83d-997d-45b6-9eca-35225ce83ab2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance 169400ca-948b-4d5f-b25d-744340e68c87 could not be found. Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8dcc83d-997d-45b6-9eca-35225ce83ab2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/169400ca-948b-4d5f-b25d-744340e68c87/action HTTP/1.1 Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 28 Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: {"reboot": {"type": "SOFT"}} Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 169400ca-948b-4d5f-b25d-744340e68c87 could not be found. Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '169400ca-948b-4d5f-b25d-744340e68c87', 'body': {'reboot': {'type': 'SOFT'}}} Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169400ca-948b-4d5f-b25d-744340e68c87 could not be found. Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169400ca-948b-4d5f-b25d-744340e68c87 could not be found. Oct 27 09:28:12.864007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:12.869429 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:12.869429 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:12.869429 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:12.869429 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:12.869429 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:12.869429 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:12.869429 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:12.869429 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169400ca-948b-4d5f-b25d-744340e68c87 could not be found. Oct 27 09:28:12.869429 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:12.879523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8dcc83d-997d-45b6-9eca-35225ce83ab2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance 169400ca-948b-4d5f-b25d-744340e68c87 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:12.880752 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8dcc83d-997d-45b6-9eca-35225ce83ab2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/169400ca-948b-4d5f-b25d-744340e68c87/action" status: 404 len: 111 microversion: 2.1 time: 0.139203 Oct 27 09:28:12.881838 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2587/5225] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:12 2022] POST /compute/v2.1/servers/169400ca-948b-4d5f-b25d-744340e68c87/action => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:28:12.898085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:12.899776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:12.917656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:12.918868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:12.919944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:12.920882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:12.921903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:12.924226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:12.985233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] validate_networks() for [('ae09c0e3-851a-4f89-a19f-2ab607592cdc', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:28:13.742997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:13.758594 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a1124ac-b04a-47c6-8826-73506a61a6b9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.868150 Oct 27 09:28:13.760312 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2588/5226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:12 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:13.769122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:13.770531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:13.785166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:13.787111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:13.788030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:13.792431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:13.793418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:13.795124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:14.477257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:14.489843 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-17a150f9-8c0a-40fc-8237-a74dbe2dd382 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1279 microversion: 2.1 time: 0.728114 Oct 27 09:28:14.493795 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2589/5227] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:13 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1279 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:14.506659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:14.509827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:14.528518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:14.529346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:14.530572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:14.535273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:14.536050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:14.538630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:15.129914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:28:15.135592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:28:15.136532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:28:15.137133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:28:15.137706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:28:15.154752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:15.158900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:15.159654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:15.160654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:15.163601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:15.164308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:15.225037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Getting quotas for project 085f1c568af5494c99a7ff3dd488f76a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:28:15.235238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:15.237424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Getting quotas for user 8d122762f6a446279f6cdc0e66ab5daf and project 085f1c568af5494c99a7ff3dd488f76a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:28:15.266543 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bfbd1fff-d4b8-444b-86e8-7b4782a07a08 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.768749 Oct 27 09:28:15.273511 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2590/5228] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:14 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:15.279316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:28:15.297860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:28:15.303931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:15.317514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:15.342199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:15.344278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:15.344953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:15.352969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:15.360316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:15.361274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:15.402441 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53/action HTTP/1.1 Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 65 Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'b896a809-0fa3-4871-8de8-f0adfce00a53', 'body': {'rebuild': {'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1'}}} Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 09:28:15.405444 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:28:15.411773 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:15.415049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:15.416210 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d0315bf-ec1c-4af7-94b8-ed5e9d550e36 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53/action" status: 404 len: 111 microversion: 2.1 time: 0.121883 Oct 27 09:28:15.425224 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2591/5229] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:15 2022] POST /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53/action => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:28:15.432521 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ff64a253-b7dc-4ece-a7ba-49eff09c62bc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.110409 Oct 27 09:28:15.433180 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2639/5230] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:28:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:28:15.441952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:15.442855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:15.448465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc34ecef-f88d-4b7e-95f4-8d82ce04add5 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:15.449101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc34ecef-f88d-4b7e-95f4-8d82ce04add5 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:15.463195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:15.464789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:15.465467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:15.466431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:15.467132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:15.467868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:15.667243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc34ecef-f88d-4b7e-95f4-8d82ce04add5 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:15.675050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc34ecef-f88d-4b7e-95f4-8d82ce04add5 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1218 microversion: 2.1 time: 0.233074 Oct 27 09:28:15.683397 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2640/5231] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:15 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:15.696260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:15.702850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:15.722450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:15.722976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:15.723425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:15.729779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:15.730287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:15.734466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:17.031345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:17.045413 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-442249b1-d9f4-4dee-9fb6-baf91665b53f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 1.356800 Oct 27 09:28:17.046069 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2641/5232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:15 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:17.049916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:17.061791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:17.062483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:17.064705 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6918b694-8f5e-4ea0-9249-2db01964d54c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.632601 Oct 27 09:28:17.065929 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2592/5233] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:15 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:17.088253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:17.088970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:17.089580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:17.099837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:17.102306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:17.103237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:17.103528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:17.106720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:17.117849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:17.125814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:17.127633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:17.128519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:17.130765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:17.135098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:17.269478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:17.280609 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18307eb7-aeb0-48c1-adb6-5e361ce238c0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1270 microversion: 2.1 time: 0.233364 Oct 27 09:28:17.281789 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2642/5234] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:17 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1270 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:17.606824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:17.629404 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-15be8340-b30a-4e21-87b3-fdc636b4d3d9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.537194 Oct 27 09:28:17.630480 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2593/5235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:17 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:17.654684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b04499ca-ccce-4514-8626-922105219373 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:17.658457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b04499ca-ccce-4514-8626-922105219373 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: 95b4131c-12f6-4602-a230-1496418da40e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:17.669579 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-b04499ca-ccce-4514-8626-922105219373 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance 95b4131c-12f6-4602-a230-1496418da40e could not be found. Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b04499ca-ccce-4514-8626-922105219373 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/95b4131c-12f6-4602-a230-1496418da40e/action HTTP/1.1 Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 65 Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 95b4131c-12f6-4602-a230-1496418da40e could not be found. Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '95b4131c-12f6-4602-a230-1496418da40e', 'body': {'rebuild': {'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1'}}} Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b4131c-12f6-4602-a230-1496418da40e could not be found. Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 27 09:28:17.672665 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b4131c-12f6-4602-a230-1496418da40e could not be found. Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b4131c-12f6-4602-a230-1496418da40e could not be found. Oct 27 09:28:17.684464 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:17.693070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b04499ca-ccce-4514-8626-922105219373 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance 95b4131c-12f6-4602-a230-1496418da40e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:17.694362 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b04499ca-ccce-4514-8626-922105219373 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/95b4131c-12f6-4602-a230-1496418da40e/action" status: 404 len: 111 microversion: 2.1 time: 0.043897 Oct 27 09:28:17.709964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:17.710769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:17.721214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:17.721897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:17.725280 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2643/5236] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:17 2022] POST /compute/v2.1/servers/95b4131c-12f6-4602-a230-1496418da40e/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:28:17.726161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:17.727155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:17.728367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:17.728484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:18.073713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:18.076558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:18.090486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:18.091206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:18.094071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:18.095037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:18.097173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:18.097770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:18.321133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:18.334314 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d06cd463-0e07-41b0-9a7e-3d5768581f78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.629054 Oct 27 09:28:18.345732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2594/5237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:17 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:18.345732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:18.345732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:18.360063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:18.362013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:18.362648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:18.363532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:18.376576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:18.377274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:18.520048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:18.529670 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a1de182-8fe0-4840-ac73-394ba79c6727 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1276 microversion: 2.1 time: 0.193290 Oct 27 09:28:18.534655 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2595/5238] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:18 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:18.542019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:18.546669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:18.550192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:18.556840 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4539473e-c3b1-47c6-8f8c-08c8be4b13e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 0.487331 Oct 27 09:28:18.563224 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2644/5239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:18 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:18.574364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-89ecf3f4-0471-45d8-989c-210c29e1349e req-714a7a91-13a3-420e-8779-1b1e9bbbfe76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c35c8c-0b6a-49be-83eb-166e68b77291", "tag": "1399fc68-02e0-4c18-b1d6-40d26abfb188"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:18.576351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:18.581785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:18.582447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:18.588734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:18.589416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:18.590031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:18.613885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-89ecf3f4-0471-45d8-989c-210c29e1349e req-714a7a91-13a3-420e-8779-1b1e9bbbfe76 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:18.619919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-89ecf3f4-0471-45d8-989c-210c29e1349e req-714a7a91-13a3-420e-8779-1b1e9bbbfe76 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:18.620554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-89ecf3f4-0471-45d8-989c-210c29e1349e req-714a7a91-13a3-420e-8779-1b1e9bbbfe76 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:18.638092 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-89ecf3f4-0471-45d8-989c-210c29e1349e req-714a7a91-13a3-420e-8779-1b1e9bbbfe76 service nova] Creating event network-changed:1399fc68-02e0-4c18-b1d6-40d26abfb188 for instance 32c35c8c-0b6a-49be-83eb-166e68b77291 on n-h2-858383-16 Oct 27 09:28:18.673789 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-89ecf3f4-0471-45d8-989c-210c29e1349e req-714a7a91-13a3-420e-8779-1b1e9bbbfe76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096071 Oct 27 09:28:18.675700 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2645/5240] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:18.897621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:18.907322 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d243b39e-2c9a-4fc5-a7a0-f728a67c63fc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.370766 Oct 27 09:28:18.912708 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2596/5241] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:18 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:18.939784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d40e6de5-131b-4f3e-b4df-6f439792afc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:18.940799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d40e6de5-131b-4f3e-b4df-6f439792afc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: ca54f670-8e9c-497a-800e-cb9e41f66253] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:18.959124 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d40e6de5-131b-4f3e-b4df-6f439792afc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance ca54f670-8e9c-497a-800e-cb9e41f66253 could not be found. Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d40e6de5-131b-4f3e-b4df-6f439792afc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/ca54f670-8e9c-497a-800e-cb9e41f66253/action HTTP/1.1 Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 15 Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: {"restore": {}} Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance ca54f670-8e9c-497a-800e-cb9e41f66253 could not be found. Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'ca54f670-8e9c-497a-800e-cb9e41f66253', 'body': {'restore': {}}} Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca54f670-8e9c-497a-800e-cb9e41f66253 could not be found. Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca54f670-8e9c-497a-800e-cb9e41f66253 could not be found. Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:18.961383 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:18.964392 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:18.964392 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:18.964392 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca54f670-8e9c-497a-800e-cb9e41f66253 could not be found. Oct 27 09:28:18.964392 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:18.967897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d40e6de5-131b-4f3e-b4df-6f439792afc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance ca54f670-8e9c-497a-800e-cb9e41f66253 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:18.969615 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d40e6de5-131b-4f3e-b4df-6f439792afc1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/ca54f670-8e9c-497a-800e-cb9e41f66253/action" status: 404 len: 111 microversion: 2.1 time: 0.034070 Oct 27 09:28:18.970783 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2646/5242] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:18 2022] POST /compute/v2.1/servers/ca54f670-8e9c-497a-800e-cb9e41f66253/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:28:18.979094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:18.980254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:18.991173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:18.992044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:19.001399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:19.002535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:19.003271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:19.003983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:19.361247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:19.377367 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10ca86e0-162b-4294-b429-4c2a419779ba tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.402068 Oct 27 09:28:19.380671 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2597/5243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:18 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:19.409743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:19.410536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:19.428928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:19.437092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:19.438815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:19.446460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:19.447300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:19.447990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:19.559079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:19.560616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:19.569129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:19.569888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:19.570583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:19.571455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:19.574380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:19.576173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:20.088931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:20.381990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:20.394550 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc2ff688-44e7-4f24-b4a1-37ad49b3e7cf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1276 microversion: 2.1 time: 0.840072 Oct 27 09:28:20.404455 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2598/5244] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:19 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1276 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:20.431025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:20.437073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:20.471471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:20.472018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:20.479130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:20.479943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:20.480431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:20.480869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:20.938372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=16 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:20.973534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:21.016112 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80f9e13c-789c-4e63-8027-462b1bb181cf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.605598 Oct 27 09:28:21.036331 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2647/5245] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:19 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:21.061873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:21.062583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:21.076254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:21.076766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:21.077201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:21.087990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:21.088635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:21.089229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:21.140577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:21.174972 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Cannot 'restore' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:28:21.176380 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb01a719-211d-4cf1-a888-136019446be0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 0.754626 Oct 27 09:28:21.177464 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2599/5246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:20 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action HTTP/1.1 Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 15 Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: {"restore": {}} Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: exception: Cannot 'restore' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a', 'body': {'restore': {}}} Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a in vm_state active. Cannot restore while the instance is in this state. Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:21.186575 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:21.189874 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:21.189874 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:21.189874 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:21.189874 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:28:21.189874 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:21.189874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 409 to user: Cannot 'restore' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:21.189874 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a64ee4d-7357-4c64-89f8-112655ebe433 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 409 len: 145 microversion: 2.1 time: 0.133007 Oct 27 09:28:21.195410 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2648/5247] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:21 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 145 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:28:21.203354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:21.205874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:21.217660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:21.218567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:21.219280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:21.220752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:21.221549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:21.222234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:21.262193 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:28:21.262718 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 09:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a (ip 10.222.0.25) !!! Oct 27 09:28:21.430033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:21.430773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:21.443655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:21.444162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:21.444663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:21.445380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:21.445885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:21.446321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:22.255023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:22.266637 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42ef70b2-0b9d-4735-acbd-bd441924642f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.069648 Oct 27 09:28:22.267671 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2600/5248] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:21 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:22.283131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:22.285164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:22.292225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:22.294558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:22.298753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:22.299718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:22.303040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:22.303674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:22.416150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:22.480811 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-557bd945-f521-491d-a962-d2d054f9dc9f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 1.050242 Oct 27 09:28:22.483863 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2649/5249] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:21 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:22.502275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:22.503403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:22.527644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:22.530871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:22.533528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:22.540900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:22.544874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:22.546702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:23.223981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:23.240379 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66dc1da4-6e09-4284-b81a-2ce13a4aab72 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 0.971470 Oct 27 09:28:23.259594 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2601/5250] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:22 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:23.430374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:23.445071 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23b7d7e2-b13b-4838-8de1-859d6fb42768 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.955991 Oct 27 09:28:23.468060 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2650/5251] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:22 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:23.478411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88b4764b-676f-4e85-9194-2b7cdbadcba7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:23.478950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88b4764b-676f-4e85-9194-2b7cdbadcba7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d4dad112-4138-47e9-b731-abe4a7ad08b0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:23.495232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-88b4764b-676f-4e85-9194-2b7cdbadcba7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance d4dad112-4138-47e9-b731-abe4a7ad08b0 could not be found. Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88b4764b-676f-4e85-9194-2b7cdbadcba7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/d4dad112-4138-47e9-b731-abe4a7ad08b0/action HTTP/1.1 Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 14 Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: {"resume": {}} Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d4dad112-4138-47e9-b731-abe4a7ad08b0 could not be found. Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd4dad112-4138-47e9-b731-abe4a7ad08b0', 'body': {'resume': {}}} Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4dad112-4138-47e9-b731-abe4a7ad08b0 could not be found. Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4dad112-4138-47e9-b731-abe4a7ad08b0 could not be found. Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:23.503373 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:23.506545 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:23.506545 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:23.506545 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4dad112-4138-47e9-b731-abe4a7ad08b0 could not be found. Oct 27 09:28:23.506545 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:23.506545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88b4764b-676f-4e85-9194-2b7cdbadcba7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance d4dad112-4138-47e9-b731-abe4a7ad08b0 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:23.506545 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88b4764b-676f-4e85-9194-2b7cdbadcba7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d4dad112-4138-47e9-b731-abe4a7ad08b0/action" status: 404 len: 111 microversion: 2.1 time: 0.030811 Oct 27 09:28:23.506545 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2602/5252] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:23 2022] POST /compute/v2.1/servers/d4dad112-4138-47e9-b731-abe4a7ad08b0/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:28:23.512584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:23.513875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:23.521846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:23.522771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:23.529689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:23.532858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:23.533364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:23.534193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:23.535997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:23.536437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:23.537569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:23.541939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:23.542736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:23.549323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:23.550368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:23.551008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:23.592781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:24.144232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:24.153958 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78dfedd9-232b-426a-8efc-a1e97ae2082e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.643410 Oct 27 09:28:24.166369 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2603/5253] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:23 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:24.187759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:24.188387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:24.211071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:24.211598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:24.218219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:24.221401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:24.221919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:24.222372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:24.455808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:24.472165 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-332164a7-c827-4f77-87af-4afaf6a466d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 0.968539 Oct 27 09:28:24.476278 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2651/5254] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:23 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:24.487114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:24.487769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:24.543716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:24.545290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:24.545883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:24.548318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:24.548971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:24.550360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:25.157524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:25.161887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:25.171110 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cceef414-43a0-49ab-9beb-53b1621e1861 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 0.690395 Oct 27 09:28:25.172375 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2652/5255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:24 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:25.175943 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-06a5406d-34d9-4ab2-bb89-e7cb33f34b2b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.990581 Oct 27 09:28:25.176700 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2604/5256] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:24 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:25.221970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:25.222863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:25.226463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:25.232994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:25.233698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:25.235078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:25.236560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:25.237257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:25.237825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:25.274298 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Cannot 'resume' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action HTTP/1.1 Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 14 Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: {"resume": {}} Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: exception: Cannot 'resume' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a', 'body': {'resume': {}}} Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a in vm_state active. Cannot resume while the instance is in this state. Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:25.276835 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:25.280517 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:25.280517 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:25.280517 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:25.280517 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:25.280517 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:25.280517 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:28:25.280517 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:25.282702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 409 to user: Cannot 'resume' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:25.283800 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0296b1f-d1a4-46fe-909d-42ead530365d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 409 len: 144 microversion: 2.1 time: 0.067285 Oct 27 09:28:25.289853 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2653/5257] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:25 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 144 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:28:25.293148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:25.293922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:25.305539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:25.306208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:25.306770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:25.310696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:25.312181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:25.313100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:25.356157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a41af1d6-618a-4a10-a8f2-81f2b67eadf5 req-67263900-a7e4-46e3-8f3e-822b5cd8c545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9433111c-e2e0-4887-91c0-88b7aacea098", "tag": "ae639caa-6b7b-45e6-98c8-f1f0600730e0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:25.394663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a41af1d6-618a-4a10-a8f2-81f2b67eadf5 req-67263900-a7e4-46e3-8f3e-822b5cd8c545 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:25.395398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a41af1d6-618a-4a10-a8f2-81f2b67eadf5 req-67263900-a7e4-46e3-8f3e-822b5cd8c545 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:25.395992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a41af1d6-618a-4a10-a8f2-81f2b67eadf5 req-67263900-a7e4-46e3-8f3e-822b5cd8c545 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:25.424568 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a41af1d6-618a-4a10-a8f2-81f2b67eadf5 req-67263900-a7e4-46e3-8f3e-822b5cd8c545 service nova] Creating event network-changed:ae639caa-6b7b-45e6-98c8-f1f0600730e0 for instance 9433111c-e2e0-4887-91c0-88b7aacea098 on n-h1-858383-16 Oct 27 09:28:25.431753 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a41af1d6-618a-4a10-a8f2-81f2b67eadf5 req-67263900-a7e4-46e3-8f3e-822b5cd8c545 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082711 Oct 27 09:28:25.438088 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2654/5258] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:25.506394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:25.517067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:25.543192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:25.544749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:25.545556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:25.546569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:25.547778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:25.552046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:25.565631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:25.675290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=10 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:25.907742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:25.916143 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a50488a-2b2a-4f34-bb30-2bae9dec5d98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.626979 Oct 27 09:28:25.928193 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2605/5259] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:25 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:25.946414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:25.953712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:25.955320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:25.960370 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-535c6942-4a76-46bd-a263-f530b79953a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 0.465536 Oct 27 09:28:25.962373 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2655/5260] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:25 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:25.970342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:25.971076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:25.971690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:25.972563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:25.973175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:25.973749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:26.211318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:26.212277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:26.219350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:26.230403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:26.231400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:26.235598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:26.237966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:26.240226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:26.382853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:26.392258 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f6b9a31-2e9b-4417-832c-c1abd5c5b914 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.442852 Oct 27 09:28:26.398636 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2606/5261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:25 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:26.498673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40f83b89-71be-499f-9903-33f76ab6d7d1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40f83b89-71be-499f-9903-33f76ab6d7d1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 160 Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: {"server": {"name": "", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "50c6db4e-db8b-44ab-b99d-c1c74e5a0258"}]}} Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a5a38eaa-9305-45a5-98b3-c9ecee92f0b1', 'flavorRef': '452', 'networks': [{'uuid': '50c6db4e-db8b-44ab-b99d-c1c74e5a0258'}]}}} Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '' Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:28:26.503488 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:28:26.506582 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:26.513661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40f83b89-71be-499f-9903-33f76ab6d7d1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:26.514784 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40f83b89-71be-499f-9903-33f76ab6d7d1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.020001 Oct 27 09:28:26.515624 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2607/5262] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:28:26 2022] POST /compute/v2.1/servers => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:28:26.523945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:26.529525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:26.548910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:26.550613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:26.551291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:26.552275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:26.554083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:26.555129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:26.742284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:26.767296 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f9c0f3b0-3077-42c2-af96-53bdaff9b803 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 0.560272 Oct 27 09:28:26.791617 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2656/5263] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:26 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:26.849189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:26.864080 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91a72979-c6f1-4901-9ff6-415139cbc101 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.343713 Oct 27 09:28:26.879781 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2608/5264] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:26 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:26.906270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:26.907239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:26.914514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:26.920951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:26.922526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:26.923769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:26.925940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:26.926698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:26.989299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:26.989915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:27.005763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.006504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.007165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.007890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.008344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.008769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.266532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:27.280678 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e12dc4f0-36bb-4964-b5d9-6231d78dbacb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.378797 Oct 27 09:28:27.296518 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2657/5265] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:26 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:27.308367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ea2d90f-c7e7-48e2-9e6b-df0a4e8cac57 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:27.308909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ea2d90f-c7e7-48e2-9e6b-df0a4e8cac57 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: fbf27540-f13b-4dc4-bbcb-24fe2af8cf78] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:27.323789 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8ea2d90f-c7e7-48e2-9e6b-df0a4e8cac57 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance fbf27540-f13b-4dc4-bbcb-24fe2af8cf78 could not be found. Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ea2d90f-c7e7-48e2-9e6b-df0a4e8cac57 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/fbf27540-f13b-4dc4-bbcb-24fe2af8cf78/action HTTP/1.1 Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 14 Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: {"shelve": {}} Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance fbf27540-f13b-4dc4-bbcb-24fe2af8cf78 could not be found. Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'fbf27540-f13b-4dc4-bbcb-24fe2af8cf78', 'body': {'shelve': {}}} Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf27540-f13b-4dc4-bbcb-24fe2af8cf78 could not be found. Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf27540-f13b-4dc4-bbcb-24fe2af8cf78 could not be found. Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:27.331506 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:27.334606 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:27.334606 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:27.334606 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf27540-f13b-4dc4-bbcb-24fe2af8cf78 could not be found. Oct 27 09:28:27.334606 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:28:27.334606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ea2d90f-c7e7-48e2-9e6b-df0a4e8cac57 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance fbf27540-f13b-4dc4-bbcb-24fe2af8cf78 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:27.334606 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ea2d90f-c7e7-48e2-9e6b-df0a4e8cac57 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/fbf27540-f13b-4dc4-bbcb-24fe2af8cf78/action" status: 404 len: 111 microversion: 2.1 time: 0.029101 Oct 27 09:28:27.337402 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2658/5266] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:27 2022] POST /compute/v2.1/servers/fbf27540-f13b-4dc4-bbcb-24fe2af8cf78/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:28:27.342313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:27.342867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:27.351021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.351528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.352002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.352725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.353191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.353614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.388103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:27.397343 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2dc8ebf-2b40-4ce7-8b20-4384a3ea9f2d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 0.411829 Oct 27 09:28:27.401725 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2609/5267] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:26 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:27.569191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:27.583459 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-63355456-5ab1-4d25-9351-3f98e33b8b4a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.244864 Oct 27 09:28:27.599077 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2659/5268] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:27 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:27.617071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:27.618094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:27.625672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.626651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.627304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.628309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.628986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.629639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.796483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:27.801339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:27.804344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:27.819718 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0fea5be4-bab6-4569-9618-d95bd9e1cb89 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.205865 Oct 27 09:28:27.822391 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2610/5269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:27 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:27.823687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.824399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.825032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.825961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.826691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.827310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.849290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:27.850174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:27.863816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.864649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.865359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.867923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:27.868487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:27.875121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:27.936402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lazy-loading 'flavor' on Instance uuid d8f35f23-0b67-4a55-8c3e-3950fac6b97a {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:28:28.129319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:28.144054 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f54c747-5ea8-41c4-9c45-1b41fc80cb5d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 0.356792 Oct 27 09:28:28.159643 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2660/5270] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:27 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:28.260262 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3818015d-1440-40e6-9c82-71b224e0e76c tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 202 len: 0 microversion: 2.1 time: 0.415305 Oct 27 09:28:28.261584 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2611/5271] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:27 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:28:28.269835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:28.270709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:28.284848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:28.285668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:28.286292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:28.287187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:28.288446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:28.289065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:28.434727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:28.438566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:28.445977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:28.446848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:28.447460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:28.448788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:28.449379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:28.450111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:28.482619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:28.502414 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a157a77-1b8a-49f8-93a6-c9c753ed5850 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.234912 Oct 27 09:28:28.505948 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2661/5272] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:28 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:28.651800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:28.662386 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e25846bc-042a-44d8-8bdc-42669dd7a320 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 0.234092 Oct 27 09:28:28.663530 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2612/5273] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:28 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:29.179432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:29.180468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:29.203716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:29.205905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:29.207100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:29.209408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:29.210056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:29.212198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:29.533444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:29.535037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:29.558048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:29.560619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:29.564852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:29.565911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:29.569138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:29.571830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:29.988556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:30.005152 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d55a23b-fe9f-46e8-931f-21ab1a52ca04 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 0.823591 Oct 27 09:28:30.006226 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2662/5274] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:29 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:30.011116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:30.011792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:30.032559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:30.038455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:30.038918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:30.039713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:30.040229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:30.040836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:30.063123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:30.075598 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21f032c2-f839-4d10-b244-b5707b98a319 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.550125 Oct 27 09:28:30.089669 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2613/5275] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:29 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:30.345731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:30.353988 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1907ff5-c78c-4951-a7b2-07c305f41dbf tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 0.346577 Oct 27 09:28:30.355348 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2663/5276] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:30 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:30.980779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-82c05a44-dfae-4666-8445-c2192f725fc3 req-9f7c9747-71f8-4c8c-8ace-954f1333650a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c35c8c-0b6a-49be-83eb-166e68b77291", "name": "network-vif-plugged", "status": "completed", "tag": "1399fc68-02e0-4c18-b1d6-40d26abfb188"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:31.010997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-82c05a44-dfae-4666-8445-c2192f725fc3 req-9f7c9747-71f8-4c8c-8ace-954f1333650a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:31.023814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-82c05a44-dfae-4666-8445-c2192f725fc3 req-9f7c9747-71f8-4c8c-8ace-954f1333650a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:31.031150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:31.032120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:31.037081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-82c05a44-dfae-4666-8445-c2192f725fc3 req-9f7c9747-71f8-4c8c-8ace-954f1333650a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:31.046665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:31.049172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:31.050343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:31.055683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:31.056485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:31.058580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:31.088308 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-82c05a44-dfae-4666-8445-c2192f725fc3 req-9f7c9747-71f8-4c8c-8ace-954f1333650a service nova] Creating event network-vif-plugged:1399fc68-02e0-4c18-b1d6-40d26abfb188 for instance 32c35c8c-0b6a-49be-83eb-166e68b77291 on n-h2-858383-16 Oct 27 09:28:31.103020 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-82c05a44-dfae-4666-8445-c2192f725fc3 req-9f7c9747-71f8-4c8c-8ace-954f1333650a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127363 Oct 27 09:28:31.106532 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2614/5277] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:31.139167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:31.149001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:31.174992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:31.180139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:31.180782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:31.185474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:31.187820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:31.191402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:31.624002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:31.636221 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38f08572-8790-44d4-9fa8-bbdcc4900415 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 0.608466 Oct 27 09:28:31.636855 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2664/5278] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:31 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:31.653254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:31.653881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:31.667245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:31.668167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:31.668717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:31.669546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:31.670106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:31.671236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:31.689096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:31.701112 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-64154e14-4624-45e0-ae69-d23e11659cd8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.592942 Oct 27 09:28:31.701708 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2615/5279] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:31 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:31.936248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:31.948577 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7fda9ac2-5f1f-4f2a-b479-14d0e32d6e9d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 0.302250 Oct 27 09:28:31.969569 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2665/5280] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:31 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:32.662283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:32.663698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:32.675418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:32.677261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:32.701113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:32.702286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:32.705856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:32.708743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:32.728896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:32.730275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:32.742775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:32.745302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:32.747393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:32.752130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:32.752828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:32.753995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:33.328070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:33.348462 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-954484df-fee6-419b-8646-533fccca5cb6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.624481 Oct 27 09:28:33.352390 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2666/5281] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:32 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:33.371107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:33.371925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:33.384742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:33.385531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:33.386141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:33.387904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:33.388736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:33.402478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:33.403048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:33.404874 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ada6b44b-b6fb-41ea-a5b0-8dc6bfcb9330 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1321 microversion: 2.1 time: 0.746848 Oct 27 09:28:33.405704 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2616/5282] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:32 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1321 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:34.008334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:34.024220 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c6dd4ff-5807-484f-b89e-5c68635fac06 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 0.670471 Oct 27 09:28:34.025215 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2667/5283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:33 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:34.382582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:34.384055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:34.393822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:34.394899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:34.396270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:34.397250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:34.398020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:34.398675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:34.434317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:34.435463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:34.445858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:34.446359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:34.448910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:34.449720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:34.450201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:34.450645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:35.095802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:35.105839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:35.107226 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b52a2621-f2d2-479c-bd43-d0e69b068334 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.730388 Oct 27 09:28:35.113259 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2617/5284] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:34 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:35.121654 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-adedc273-f7b6-4659-99c5-74c84bfd8cec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1502 microversion: 2.1 time: 0.693044 Oct 27 09:28:35.122250 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2668/5285] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:34 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1502 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:35.132631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:35.133639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:35.148146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:35.156585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:35.162443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:35.164698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:35.165236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:35.166043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:35.169401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:35.169936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:35.181697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:35.182510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:35.183333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:35.184263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:35.184906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:35.185539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:35.752215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:35.772212 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd3c6332-30ef-44e8-8fe6-947759df3cc1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 0.657479 Oct 27 09:28:35.778818 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2618/5286] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:35 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:35.795056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c26a7ca4-61ee-4882-a0b4-e934eb58182e req-2359d75e-52db-49ac-a3bd-1e6d499056cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9433111c-e2e0-4887-91c0-88b7aacea098", "name": "network-vif-plugged", "status": "completed", "tag": "ae639caa-6b7b-45e6-98c8-f1f0600730e0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:35.812854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c26a7ca4-61ee-4882-a0b4-e934eb58182e req-2359d75e-52db-49ac-a3bd-1e6d499056cc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:35.826829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c26a7ca4-61ee-4882-a0b4-e934eb58182e req-2359d75e-52db-49ac-a3bd-1e6d499056cc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:35.828176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c26a7ca4-61ee-4882-a0b4-e934eb58182e req-2359d75e-52db-49ac-a3bd-1e6d499056cc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:35.863171 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c26a7ca4-61ee-4882-a0b4-e934eb58182e req-2359d75e-52db-49ac-a3bd-1e6d499056cc service nova] Creating event network-vif-plugged:ae639caa-6b7b-45e6-98c8-f1f0600730e0 for instance 9433111c-e2e0-4887-91c0-88b7aacea098 on n-h1-858383-16 Oct 27 09:28:35.873102 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c26a7ca4-61ee-4882-a0b4-e934eb58182e req-2359d75e-52db-49ac-a3bd-1e6d499056cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089784 Oct 27 09:28:35.902259 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2619/5287] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:35.927766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:35.948783 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49ec1dc6-bf0a-46bf-8ab1-f6655dd5de2b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1502 microversion: 2.1 time: 0.803946 Oct 27 09:28:35.950676 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2669/5288] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:35 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1502 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:36.001547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:36.002845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:36.016177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:36.017314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:36.018165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:36.019505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:36.020532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:36.021384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:36.080109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:36.092690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:28:36.141162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:36.144840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:36.171390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:36.172797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:36.173802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:36.175546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:36.176641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:36.188469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:36.283361 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c247199-2d5c-4932-9956-680a25065f4a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 204 len: 0 microversion: 2.1 time: 0.291397 Oct 27 09:28:36.284946 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2620/5289] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:28:35 2022] DELETE /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:28:36.309530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:36.312544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:36.331338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:36.333925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:36.335611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:36.336589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:36.341728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:36.342447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:36.958112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:36.966856 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e02a6ad-32e1-45de-b99b-f92db61d1995 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.834772 Oct 27 09:28:36.967453 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2670/5290] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:36 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:36.982012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:36.993023 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f360dcf2-ab2a-4ffe-83e8-736ccae2f154 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1508 microversion: 2.1 time: 0.703004 Oct 27 09:28:36.993875 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2621/5291] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:36 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1508 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:37.009941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:37.012444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:37.019816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:37.020671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:37.021375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:37.022322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:37.022996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:37.023670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:37.575986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:37.590433 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa526ac9-9e7a-4192-b8fd-5100af3c6586 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1318 microversion: 2.1 time: 0.617835 Oct 27 09:28:37.591083 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2671/5292] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:36 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:37.996764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:38.000946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:38.015634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:38.016469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:38.018776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:38.019842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:38.020081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:38.021024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:38.021702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:38.022269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:38.032313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:38.040109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:38.040791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:38.041911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:38.042630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:38.043270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:38.632235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:38.647274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:38.649751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:38.653706 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f013522d-52b4-4565-a5b2-4451575f5fcb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1508 microversion: 2.1 time: 0.636503 Oct 27 09:28:38.658310 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2672/5293] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:38 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1508 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:38.663548 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6a446a8-1ab4-4b0f-9c87-e40c73a694c9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.672381 Oct 27 09:28:38.669852 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2622/5294] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:37 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:38.685275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:38.704172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:38.725089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:38.728956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:38.729685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:38.730477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:38.734546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:38.735150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:39.538027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:39.552632 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1eac014e-fbea-42bd-b4a7-e56ff0b876b8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1507 microversion: 2.1 time: 0.892944 Oct 27 09:28:39.553830 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2673/5295] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:38 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1507 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:39.576066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:39.576676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:39.583848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:39.584567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:39.585154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:39.586168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:39.586770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:39.587341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:39.682862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:39.683501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:39.702208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:39.716423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:39.721939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:39.723195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:39.724208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:39.724667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:39.984098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:40.005899 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86d94ba3-cf41-4c03-8ea5-4c01d3c2d2c0 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 200 len: 1306 microversion: 2.1 time: 0.327533 Oct 27 09:28:40.007273 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2674/5296] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:39 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 1306 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:40.013113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-04379c27-da7a-4a4e-b075-57103a386d04 req-8c89b8bd-0b2d-4878-9f4d-b6f4c70174d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c35c8c-0b6a-49be-83eb-166e68b77291", "name": "network-vif-deleted", "tag": "1399fc68-02e0-4c18-b1d6-40d26abfb188"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:40.032669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-04379c27-da7a-4a4e-b075-57103a386d04 req-8c89b8bd-0b2d-4878-9f4d-b6f4c70174d4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:40.033173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-04379c27-da7a-4a4e-b075-57103a386d04 req-8c89b8bd-0b2d-4878-9f4d-b6f4c70174d4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:40.033618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-04379c27-da7a-4a4e-b075-57103a386d04 req-8c89b8bd-0b2d-4878-9f4d-b6f4c70174d4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:40.045672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:40.051718 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-04379c27-da7a-4a4e-b075-57103a386d04 req-8c89b8bd-0b2d-4878-9f4d-b6f4c70174d4 service nova] Creating event network-vif-deleted:1399fc68-02e0-4c18-b1d6-40d26abfb188 for instance 32c35c8c-0b6a-49be-83eb-166e68b77291 on n-h2-858383-16 Oct 27 09:28:40.059020 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-04379c27-da7a-4a4e-b075-57103a386d04 req-8c89b8bd-0b2d-4878-9f4d-b6f4c70174d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050121 Oct 27 09:28:40.060281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2675/5297] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:40.063095 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ac5fbba-7402-4bbb-b245-4e0158ea1761 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1507 microversion: 2.1 time: 0.490716 Oct 27 09:28:40.065061 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2623/5298] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:39 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:40.070128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:40.070866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:40.080956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:40.081533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:40.082511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:40.083493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:40.084187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:40.084766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:40.088706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:40.094373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:40.109440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:40.114193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:40.115236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:40.116984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:40.123236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:40.124289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:40.292544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:28:40.293433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:28:40.294164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:28:40.294798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:28:40.296751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:28:40.431253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:40.444470 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f111298a-3642-4862-be37-809fa99a493a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.381447 Oct 27 09:28:40.444849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:40.461266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:40.461266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:40.463092 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2676/5299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:40 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:40.473272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:40.475879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:40.476389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:40.476840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:40.588303 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-355968c0-45d2-49af-a5c1-70e450150d43 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "POST /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098/action" status: 202 len: 1109 microversion: 2.1 time: 0.504737 Oct 27 09:28:40.598741 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2624/5300] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:28:40 2022] POST /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098/action => generated 1109 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 452 bytes (3 switches on core 0) Oct 27 09:28:40.609877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:40.610501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:40.619971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:40.623431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:40.625532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:40.626029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:40.632405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:40.632949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:40.633403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:41.040202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:41.043844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:41.062175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:41.089478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:41.091049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:41.097860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:41.102320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:41.104927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:41.105761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:41.140656 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 HTTP/1.1 Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '32c35c8c-0b6a-49be-83eb-166e68b77291'} Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:28:41.142538 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-89c1ebb9-ae5d-4f22-9289-59c6b3a6975f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 404 len: 111 microversion: 2.1 time: 0.111249 Oct 27 09:28:41.150607 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2625/5301] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:41 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:28:41.179703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b1936c1-cc95-495e-8a7d-59d71f54ed50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'create', calling method: .version_select at 0x7f31a8e0e820>, body: {"keypair": {"name": "tempest-key-462347714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID1ucp90tjeDXHlC4ZP2i5rm04fUiJUt2ya4vTIzKaYi/Yz1W9+h0L1ozwFdQguXWQyeCWz7x3mAwtFpca5CUba6CH6Qt+89YqLvW3C3fF5GBnDgoVIQW6M+Ljx+nhI0g=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:41.239005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9b1936c1-cc95-495e-8a7d-59d71f54ed50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:28:41.257367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9b1936c1-cc95-495e-8a7d-59d71f54ed50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for user 993f47058e6d48f7ac30138be91496c5 and project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:28:41.333199 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b1936c1-cc95-495e-8a7d-59d71f54ed50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.156828 Oct 27 09:28:41.333479 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2626/5302] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:28:41 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:41.345232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:41.368925 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cdb1a90c-142d-402f-8a78-d9ef42bcdb0c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.758171 Oct 27 09:28:41.405991 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2677/5303] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:40 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:41.412377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-165ee4f5-579b-4908-8408-6fbb6906286d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '.version_select at 0x7f31a8e11160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:41.419052 n-d-858383-16 devstack@n-api.service[120603]: WARNING oslo_db.sqlalchemy.utils [None req-165ee4f5-579b-4908-8408-6fbb6906286d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 27 09:28:41.427221 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-165ee4f5-579b-4908-8408-6fbb6906286d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.073812 Oct 27 09:28:41.441236 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2627/5304] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:28:41 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:41.468768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:41.469865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:41.498473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:41.504431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:41.505216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:41.506108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:41.506749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:41.507949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:41.541359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1963610213", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "key_name": "tempest-key-462347714", "networks": [{"uuid": "7a475c77-fcd2-4475-b72a-44ef10abc15a"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:41.627969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] validate_networks() for [('7a475c77-fcd2-4475-b72a-44ef10abc15a', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:28:41.827401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:41.836980 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db166463-a8c0-4f74-8136-c75fba3b6697 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.373019 Oct 27 09:28:41.842216 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2678/5305] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:41 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:42.347646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:28:42.348181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:28:42.348666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:28:42.349077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:28:42.349493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:28:42.368664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:42.369164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:42.369648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:42.370323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:42.370765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:42.371194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:42.394733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:42.395460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:42.438915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:42.439598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:42.440149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:42.441243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:42.443117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:28:42.445374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:42.451016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:42.467905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for user 993f47058e6d48f7ac30138be91496c5 and project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:28:42.500850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:28:42.504853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:28:42.614792 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1c57eeb-79bd-4951-9b9b-93a6f8817d63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079784 Oct 27 09:28:42.630136 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2628/5306] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:28:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:28:42.655716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efceee9a-3047-4523-a112-1f26f3d17a40 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:42.655969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efceee9a-3047-4523-a112-1f26f3d17a40 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:42.673411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:42.685219 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-938bb4fd-5f17-41bc-8445-fe99c23e694f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.294574 Oct 27 09:28:42.689427 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2679/5307] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:42 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:42.815540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efceee9a-3047-4523-a112-1f26f3d17a40 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:42.831195 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efceee9a-3047-4523-a112-1f26f3d17a40 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1228 microversion: 2.1 time: 0.194504 Oct 27 09:28:42.832402 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2629/5308] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:42 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1228 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:42.868939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:42.874209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:42.906663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:42.907176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:42.907678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:42.908526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:42.908993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:42.909422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:43.333071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:43.353757 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d8682204-5c27-4435-b62d-bbe14a2b131d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.489293 Oct 27 09:28:43.357884 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2680/5309] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:42 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:43.712515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:43.713664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:43.728120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:43.730097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:43.732105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:43.734471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:43.735129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:43.735553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:43.858794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:43.860996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:43.879275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:43.880072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:43.882381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:43.883318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:43.885956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:43.890641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:44.049804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:44.060409 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-144f3a31-9160-4887-a074-e0716b44250b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.352512 Oct 27 09:28:44.065955 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2630/5310] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:43 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:44.098658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:44.110775 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f5f52ce1-621f-46df-8a77-d3e349e56081 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1224 microversion: 2.1 time: 0.257764 Oct 27 09:28:44.112457 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2681/5311] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:43 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1224 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:44.387434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:44.388520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:44.400097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:44.411295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:44.412191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:44.415728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:44.422222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:44.423217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:44.745146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:44.756718 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf1be169-fb17-4131-a01e-52626a4c480b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.379525 Oct 27 09:28:44.759302 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2631/5312] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:44 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:45.084442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:45.085582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:45.126220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:45.137982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:45.138583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:45.147010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:45.147494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:45.148278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:45.148743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:45.152605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:45.155417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:45.157318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:45.157854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:45.158608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:45.169261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:45.169791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:45.471852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:45.484857 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-edb8d2c0-58fa-4775-96ca-b490601969b7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1286 microversion: 2.1 time: 0.353616 Oct 27 09:28:45.493126 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2632/5313] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:45 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1286 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:45.783766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:45.784557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:45.797457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:45.802006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:45.802768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:45.806661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:45.810518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:45.815256 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28402def-232e-494e-850b-53f525d16464 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.734621 Oct 27 09:28:45.816064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:45.816660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:45.836110 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2682/5314] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:45 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:46.523228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:46.524933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:46.539370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:46.542576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:46.543248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:46.544407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:46.546636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:46.550617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:46.713007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:46.733536 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9814512f-a196-4327-ac2f-e6574b6def37 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.953566 Oct 27 09:28:46.747380 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2633/5315] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:45 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:46.851139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:46.853142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:46.864711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:46.866812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:46.876100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:46.886050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:46.888303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:46.889135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:47.032085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:47.048232 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-44978355-cb30-4b1a-b7b3-19af79fcfd58 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1328 microversion: 2.1 time: 0.529692 Oct 27 09:28:47.049670 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2683/5316] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:46 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1328 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:47.229260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:47.242284 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70580ad0-1151-42ea-b5cb-8eb7d992c2d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.391727 Oct 27 09:28:47.248163 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2634/5317] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:46 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:47.755866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:47.757106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:47.763712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:47.765237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:47.765978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:47.766658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:47.767478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:47.769077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:47.769806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:47.770446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:47.784247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:47.784749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:47.785226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:47.788970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:47.789453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:47.789892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:48.516192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:48.532603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa9d7979-b7b0-47aa-ab7b-a60668799f18 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.774116 Oct 27 09:28:48.536475 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2635/5318] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:47 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:48.547176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:48.556418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:48.557060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:48.560321 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-904f48d4-ce52-45c5-8261-ead7f19239cc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.808868 Oct 27 09:28:48.570178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:48.574999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:48.575662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:48.576618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:48.577480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:48.577700 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2684/5319] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:47 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:48.578331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:48.591000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:48.593246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:48.601294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:48.602103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:48.602722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:48.604284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:48.604985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:48.605594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:49.416353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:49.426716 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40c5e3a0-d8dd-4353-8233-38d56c8fdffc tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.847819 Oct 27 09:28:49.428406 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2685/5320] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:48 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:49.452634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:49.453499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:49.462824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:49.463505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:49.466227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:49.466907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:49.468396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:49.469024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:49.470372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:49.504523 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e8d1fa2-a86d-4d35-a6e3-01d0e16f8514 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1328 microversion: 2.1 time: 0.963858 Oct 27 09:28:49.515593 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2636/5321] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:48 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1328 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:49.541816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a4ad49c9-1385-44ba-94f0-caaf39c12127 req-5f9176d7-d55a-4aee-9b2f-5a37bb1fb264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3", "tag": "b594c575-dcc9-4980-836c-0650a1adfda5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:49.580856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a4ad49c9-1385-44ba-94f0-caaf39c12127 req-5f9176d7-d55a-4aee-9b2f-5a37bb1fb264 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:49.584812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a4ad49c9-1385-44ba-94f0-caaf39c12127 req-5f9176d7-d55a-4aee-9b2f-5a37bb1fb264 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:49.585645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a4ad49c9-1385-44ba-94f0-caaf39c12127 req-5f9176d7-d55a-4aee-9b2f-5a37bb1fb264 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:49.618256 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a4ad49c9-1385-44ba-94f0-caaf39c12127 req-5f9176d7-d55a-4aee-9b2f-5a37bb1fb264 service nova] Creating event network-changed:b594c575-dcc9-4980-836c-0650a1adfda5 for instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 on n-h2-858383-16 Oct 27 09:28:49.624231 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a4ad49c9-1385-44ba-94f0-caaf39c12127 req-5f9176d7-d55a-4aee-9b2f-5a37bb1fb264 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112320 Oct 27 09:28:49.625112 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2637/5322] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:49.632211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:49.633395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:49.642168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:49.643059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:49.643845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:49.645020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:49.645817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:49.646469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:49.690017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:50.026807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:50.048693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-90f68067-bde1-45d2-8173-f1131585634a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.616059 Oct 27 09:28:50.049415 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2686/5323] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:49 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:50.078740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:50.079758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:50.086412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:50.087267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:50.087956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:50.094232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:50.095203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:50.095874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:50.356326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:50.374053 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3023364-c689-4833-a58e-ca001e87a516 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.743405 Oct 27 09:28:50.375101 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2638/5324] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:49 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:50.454626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:50.455338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:50.467629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:50.468155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:50.468606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:50.469338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:50.469800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:50.470232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:50.885650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:50.900235 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8475f3c4-b7a8-4f2d-9d58-ca78c1259972 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.827821 Oct 27 09:28:50.901019 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2687/5325] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:50 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:50.913651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:50.914606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:50.931432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:50.934952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:50.936581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:50.940199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:50.940812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:50.941511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:50.963507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:50.975653 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c937298f-d67b-41ce-9adb-9a32917ac896 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.526592 Oct 27 09:28:50.976190 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2639/5326] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:50 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:51.001164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:51.001786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:51.019372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:51.019906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:51.020353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:51.021073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:51.021536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:51.021966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:51.304497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:51.336094 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-69077787-790c-4330-bb74-edf59bd91779 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1328 microversion: 2.1 time: 0.418186 Oct 27 09:28:51.353232 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2688/5327] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:50 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1328 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:51.420176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:51.420894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:51.427942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:51.428440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:51.428875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:51.429764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:51.430424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:51.431005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:51.521473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:51.536761 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-64e02a9e-89df-4aa8-ba6e-b3a783d1a3bb tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.539369 Oct 27 09:28:51.537858 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2640/5328] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:50 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:51.761164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:51.780447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2956e903-10ee-4b11-a9ff-a5b50917a8a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1531 microversion: 2.1 time: 0.356680 Oct 27 09:28:51.782725 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2689/5329] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:51 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1531 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:51.819710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1646229294", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "9cad971b-61f2-43dd-8137-4ee7400ac93f"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:51.891407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] validate_networks() for [('9cad971b-61f2-43dd-8137-4ee7400ac93f', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:28:52.002840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:52.004159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:52.013596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:52.015396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:52.017020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:52.017960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:52.018589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:52.019250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:52.026125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:52.401829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:52.537497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:52.561674 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64c5a67c-98c3-4bcf-90d6-c44dc05621a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.553353 Oct 27 09:28:52.566026 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2690/5330] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:51 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:52.587617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:52.588615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:52.595516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:52.597841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:52.600385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:52.601566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:52.602262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:52.605897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:52.821828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:28:53.103143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:28:53.103636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:28:53.104201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:28:53.104621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:28:53.105029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:28:53.142804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:53.143319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:53.143831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:53.144574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:53.145210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:53.145652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:53.160181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:53.168485 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fcf0eeb9-b19e-4c93-b6c4-4b4226994d41 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1328 microversion: 2.1 time: 0.600961 Oct 27 09:28:53.169089 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2691/5331] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:52 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1328 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:53.189517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8d35d484-06a7-4072-a1b1-68cd4fc57008 req-772d9afd-ca26-4fe9-8bfb-576b6df1e440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f35f23-0b67-4a55-8c3e-3950fac6b97a", "name": "network-vif-plugged", "status": "completed", "tag": "fe701430-2ee5-4174-b187-9c3bbd60c9e6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:53.222365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d35d484-06a7-4072-a1b1-68cd4fc57008 req-772d9afd-ca26-4fe9-8bfb-576b6df1e440 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:53.222858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d35d484-06a7-4072-a1b1-68cd4fc57008 req-772d9afd-ca26-4fe9-8bfb-576b6df1e440 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:53.223297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8d35d484-06a7-4072-a1b1-68cd4fc57008 req-772d9afd-ca26-4fe9-8bfb-576b6df1e440 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:53.229913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:28:53.238778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for user 9301fb54a8734e1ab31e496add7e9446 and project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:28:53.261937 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8d35d484-06a7-4072-a1b1-68cd4fc57008 req-772d9afd-ca26-4fe9-8bfb-576b6df1e440 service nova] Creating event network-vif-plugged:fe701430-2ee5-4174-b187-9c3bbd60c9e6 for instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a on n-h1-858383-16 Oct 27 09:28:53.272264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:28:53.273289 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8d35d484-06a7-4072-a1b1-68cd4fc57008 req-772d9afd-ca26-4fe9-8bfb-576b6df1e440 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102959 Oct 27 09:28:53.275692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:28:53.275992 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2692/5332] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:53.289604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:53.290527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:53.305367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:53.306110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:53.306725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:53.307639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:53.308243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:53.308818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:53.397937 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-76cc93cd-04a3-44f5-a135-47a08157671c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584205 Oct 27 09:28:53.413827 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2641/5333] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:28:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:28:53.425143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2fefbbe-2ef3-481b-945c-5ff1311c5695 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:53.425377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2fefbbe-2ef3-481b-945c-5ff1311c5695 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:53.667760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2fefbbe-2ef3-481b-945c-5ff1311c5695 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:53.675373 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2fefbbe-2ef3-481b-945c-5ff1311c5695 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1215 microversion: 2.1 time: 0.260335 Oct 27 09:28:53.691514 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2642/5334] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:53 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:53.698274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:53.698895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:53.724533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:53.725039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:53.725484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:53.726194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:53.726652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:53.727080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:53.802737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:53.815133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a2106f54-5458-42b8-bf0a-b07f1b57fff9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1531 microversion: 2.1 time: 0.538017 Oct 27 09:28:53.819138 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2693/5335] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:53 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1531 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:53.991843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:54.001447 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38d55cd1-9f35-42ef-a490-5ebb98ce3570 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.308039 Oct 27 09:28:54.017034 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2643/5336] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:53 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:54.198911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:54.199629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:54.211319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:54.214203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:54.214821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:54.215903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:54.230722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:54.231722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:54.704692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:54.706071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:54.720088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:54.722202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:54.723096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:54.726445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:54.731113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:54.731909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:54.774727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:54.794036 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0464efe6-d055-4ccf-862a-85a962de74a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1328 microversion: 2.1 time: 0.605887 Oct 27 09:28:54.794638 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2694/5337] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:54 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1328 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:54.850282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:54.853186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:54.866474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:54.867510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:54.869487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:54.870668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:54.872220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:54.873165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:54.994554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:55.008471 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b4efada-3944-452f-80b9-ed33100ba0bd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1267 microversion: 2.1 time: 0.309973 Oct 27 09:28:55.024681 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2644/5338] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:54 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1267 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:55.033233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:55.043681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:55.069415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:55.073746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:55.075339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:55.076416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:55.077105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:55.081259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:55.744414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:55.760124 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-504579c4-c13f-452d-9d6d-b8d38f440391 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1531 microversion: 2.1 time: 0.914757 Oct 27 09:28:55.764751 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2695/5339] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:54 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1531 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:28:55.821429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:55.822319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:55.838309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:55.839051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:55.839739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:55.840491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:55.840949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:55.841523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:56.565517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:56.584043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d881c8d0-0313-4509-94f4-fdbe15455c7c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 1.549678 Oct 27 09:28:56.584748 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2645/5340] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:55 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:56.590112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:56.594807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:56.634185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:56.635083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:56.635853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:56.636759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:56.637372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:56.637977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:56.898793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:56.907232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9251a37e-97ca-45d1-89c6-11e2430dff20 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1273 microversion: 2.1 time: 0.321101 Oct 27 09:28:56.907871 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2646/5341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:56 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1273 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:56.924820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:56.925456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:56.943475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:56.944277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:56.944924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:56.946101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:56.947175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:56.948298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:57.340477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:57.347845 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e26dda79-6fc5-4c02-b1e0-30559630c214 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1328 microversion: 2.1 time: 1.530304 Oct 27 09:28:57.349011 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2696/5342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:55 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1328 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:57.473650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:57.484449 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f89cba4-aaa4-4bc9-84e7-0ffbf987cfb9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.572045 Oct 27 09:28:57.510271 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2647/5343] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:56 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:57.620090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:57.621260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:57.638939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:57.640672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:57.641549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:57.644095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:57.645228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:57.646268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:57.934204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:57.936860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:57.963220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:57.963835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:57.964451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:57.965357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:57.968144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:57.968580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:58.376616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:58.394243 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-797412b7-cadd-433e-bb02-f1ce5e38c4a8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1273 microversion: 2.1 time: 0.461998 Oct 27 09:28:58.395164 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2648/5344] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:57 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1273 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:58.403942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:58.405900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:58.419302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:58.420666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:58.421464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:58.438587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:58.448929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:58.452064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:58.594315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:58.627925 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8572f751-df1a-46a5-a819-eaceea460e82 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 1.005389 Oct 27 09:28:58.629050 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2697/5345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:57 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:58.633935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:58.636100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:58.650590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:58.659016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:58.659675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:58.660595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:58.661197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:58.661803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:59.178376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:59.190676 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b1107e2-94a4-4d13-8a62-c31aa8fe110c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1328 microversion: 2.1 time: 0.792521 Oct 27 09:28:59.195602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2649/5346] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:58 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1328 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:59.438233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:59.438856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:59.454214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:59.462639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:59.470308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:59.472353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:59.472854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:59.476456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:59.604576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:28:59.623615 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-277c00bb-b127-4ade-9dfa-5fbb9c821c8a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.992362 Oct 27 09:28:59.628200 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2698/5347] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:58 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:28:59.667936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3a0498c3-1da2-4daf-b943-72b734765f70 req-80b01790-b517-40b4-9053-e54d4d1f7ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3", "name": "network-vif-plugged", "status": "completed", "tag": "b594c575-dcc9-4980-836c-0650a1adfda5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:28:59.694153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3a0498c3-1da2-4daf-b943-72b734765f70 req-80b01790-b517-40b4-9053-e54d4d1f7ad7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:59.698705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3a0498c3-1da2-4daf-b943-72b734765f70 req-80b01790-b517-40b4-9053-e54d4d1f7ad7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:59.699703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3a0498c3-1da2-4daf-b943-72b734765f70 req-80b01790-b517-40b4-9053-e54d4d1f7ad7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:59.740358 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3a0498c3-1da2-4daf-b943-72b734765f70 req-80b01790-b517-40b4-9053-e54d4d1f7ad7 service nova] Creating event network-vif-plugged:b594c575-dcc9-4980-836c-0650a1adfda5 for instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 on n-h2-858383-16 Oct 27 09:28:59.752696 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3a0498c3-1da2-4daf-b943-72b734765f70 req-80b01790-b517-40b4-9053-e54d4d1f7ad7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122763 Oct 27 09:28:59.757690 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2699/5348] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:59.767783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:59.773245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:28:59.803191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:59.805129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:59.806988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:59.807984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:59.812210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:59.812888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:00.324870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:00.369167 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2aca34d2-c9b2-4851-b2bb-bb14058150ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1315 microversion: 2.1 time: 0.930667 Oct 27 09:29:00.380088 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2650/5349] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:59 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:00.391607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:00.407885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:00.418868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:00.420807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:00.433254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:00.434864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:00.452252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:00.453733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:01.305438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:01.318836 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f43617aa-8f82-4401-a2e9-8dc03f5467d8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 1.556622 Oct 27 09:29:01.321272 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2700/5350] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:28:59 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:01.335484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:01.336369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:01.374849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:01.381632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:01.385003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:01.385900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:01.390044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:01.391218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:02.040896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:02.055336 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-75c3b8b4-de60-4cb1-8613-db325b45468f tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.727399 Oct 27 09:29:02.074246 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2701/5351] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:01 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:02.090022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:02.091452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:02.113795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:02.117310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:02.117975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:02.118926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:02.120729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:02.121320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:02.363890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:02.373746 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-200be397-a70f-4ab3-9c01-6a372859187b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1328 microversion: 2.1 time: 1.991773 Oct 27 09:29:02.390731 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2651/5352] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:00 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1328 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:02.397748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:02.398639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:02.415779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:02.417963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:02.419232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:02.421060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:02.422464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:02.423905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:02.804647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:02.826820 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66147441-876a-4d5d-8e50-164a76ed62af tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1315 microversion: 2.1 time: 0.748375 Oct 27 09:29:02.828582 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2702/5353] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:02 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:03.022097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a48bd4fd-be83-48e1-a4f6-4b2174381aa1 req-406c04fc-258a-48d7-97ab-e5dd8b0c616a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f", "tag": "83ab4a35-51f8-44ca-8a16-1fb3a90fbc85"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:03.060216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a48bd4fd-be83-48e1-a4f6-4b2174381aa1 req-406c04fc-258a-48d7-97ab-e5dd8b0c616a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:03.061865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a48bd4fd-be83-48e1-a4f6-4b2174381aa1 req-406c04fc-258a-48d7-97ab-e5dd8b0c616a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:03.069190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a48bd4fd-be83-48e1-a4f6-4b2174381aa1 req-406c04fc-258a-48d7-97ab-e5dd8b0c616a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:03.110111 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a48bd4fd-be83-48e1-a4f6-4b2174381aa1 req-406c04fc-258a-48d7-97ab-e5dd8b0c616a service nova] Creating event network-changed:83ab4a35-51f8-44ca-8a16-1fb3a90fbc85 for instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f on n-h2-858383-16 Oct 27 09:29:03.128753 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a48bd4fd-be83-48e1-a4f6-4b2174381aa1 req-406c04fc-258a-48d7-97ab-e5dd8b0c616a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109824 Oct 27 09:29:03.131070 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2703/5354] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:03.147325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:03.150143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:03.171180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:03.175835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:03.177138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:03.179624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:03.180618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:03.183075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:03.199924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:03.515055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:03.535702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bd849fb-7523-4498-8750-adf0c0c3d77a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 1.141253 Oct 27 09:29:03.536941 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2652/5355] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:02 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:03.554172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:03.555236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:03.571832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:03.573900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:03.574945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:03.576099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:03.577460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:03.578219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:03.579333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:03.690912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:04.165236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:04.175437 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1417b4ca-3b2b-46c0-a121-2e3e68ec0976 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 1.042843 Oct 27 09:29:04.183721 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2704/5356] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:03 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:04.194853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:04.196373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:04.227199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:04.231690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:04.232379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:04.233374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:04.237987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:04.240310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:04.740055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:04.758387 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d6d8bde-7c73-4ac5-8bd7-feedca880578 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1509 microversion: 2.1 time: 1.217474 Oct 27 09:29:04.759238 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2653/5357] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:03 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1509 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:04.770009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:04.771695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:04.784260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:04.785159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:04.786090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:04.787109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:04.787261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:04.788209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:04.788869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:04.813915 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c43ca9aa-f3d9-4588-a30d-d512ce089e30 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1315 microversion: 2.1 time: 0.626078 Oct 27 09:29:04.823499 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2705/5358] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:04 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:04.846019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:04.847308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:04.854114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:04.855486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:04.856205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:04.857081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:04.858471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:04.859209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:06.532335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:06.554470 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-660b9dac-e2a8-420c-9fb4-6cac47f00710 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1509 microversion: 2.1 time: 1.705521 Oct 27 09:29:06.556987 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2706/5359] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:04 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1509 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:06.562679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:06.571275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:06.573997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:06.585013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:06.586153 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71e6c7d5-fd12-429f-849b-1eafbd2d9b1d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 1.825466 Oct 27 09:29:06.586818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:06.589004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:06.590967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:06.595392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:06.596027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:06.609917 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2654/5360] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:04 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:06.639910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:06.646444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:06.662694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:06.665526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:06.667560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:06.668505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:06.669698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:06.673224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:07.397694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:07.405868 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4bbeb9bc-1cb3-4421-b92e-e56a5fc54fee tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.847558 Oct 27 09:29:07.412057 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2707/5361] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:06 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:07.417035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:07.417537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:07.436247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:07.436860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:07.437374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:07.438100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:07.438567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:07.439037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:07.440271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:07.452383 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2fffb122-fae9-4f7a-963b-934969a2aa2b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1315 microversion: 2.1 time: 0.833558 Oct 27 09:29:07.461063 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2655/5362] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:06 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:07.505849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:29:07.509342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:07.619170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:07.620481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:07.635217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:07.635960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:07.641015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:07.642318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:07.642998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:07.643622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:07.842215 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d9ed23d9-ea77-4ec3-8919-88f0caf77ffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 204 len: 0 microversion: 2.1 time: 0.428768 Oct 27 09:29:07.843005 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2708/5363] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:29:07 2022] DELETE /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:29:07.855420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:07.856165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:07.912278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:07.912748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:07.913188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:07.913903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:07.922062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:07.924076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:08.628782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:08.631066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:08.639132 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa5baff6-29c5-4608-83e7-8cf0eb611110 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 1.024168 Oct 27 09:29:08.639755 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2656/5364] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:07 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:08.669084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:08.669767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:08.684212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:08.684803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:08.685194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:08.713369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:08.718418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:08.719071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:09.061695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:09.073919 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-872a8afd-ee11-4583-8871-b0629901a632 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1515 microversion: 2.1 time: 1.222718 Oct 27 09:29:09.088655 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2709/5365] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:07 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1515 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:09.088655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:09.093319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:09.116352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:09.119438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:09.121484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:09.124409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:09.125170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:09.127284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:09.940936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:09.960008 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7fdd2283-0557-4ca7-ba7f-694bb6ba5812 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 1.310620 Oct 27 09:29:09.964300 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2657/5366] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:08 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:09.974662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:09.976300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:10.008655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:10.014836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:10.015306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:10.016102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:10.019724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:10.020534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:10.494309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:10.507705 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38903c58-ad44-4302-8680-a7e04228296b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1315 microversion: 2.1 time: 1.428710 Oct 27 09:29:10.510224 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2710/5367] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:09 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1315 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:10.526829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:10.529304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:10.548925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:10.549790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:10.552752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:10.553595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:10.553723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:10.554202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:10.562507 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a667fb8-081d-4790-a8d4-f4554c1b9e42 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.596880 Oct 27 09:29:10.563117 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2658/5368] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:09 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:10.576905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:10.990796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:10.992115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:11.014443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:11.023499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:11.024267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:11.025203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:11.026329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:11.028205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:11.277098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:11.288380 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9e1b349b-2a19-4f95-8eeb-1db30e63d93b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1515 microversion: 2.1 time: 0.776790 Oct 27 09:29:11.296461 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2711/5369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:10 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1515 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:11.536948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:11.544627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:11.554868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:11.556339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:11.556868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:11.557291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:11.580312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:11.580777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:11.589092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:12.151137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:12.209035 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bdc1a36f-15a0-4510-9acb-d5b065384905 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 1.221694 Oct 27 09:29:12.224649 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2659/5370] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:10 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:12.250561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:12.255919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:12.259981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:12.287450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-822033a4-ae77-4569-ad8f-fd9906c51c35 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1315 microversion: 2.1 time: 0.754687 Oct 27 09:29:12.291969 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2712/5371] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:11 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:12.301882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:12.302391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:12.303002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:12.311113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:12.314560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b05c7c9c-17b5-4107-99d5-b548623ad8c4 req-bc3d8ff0-d8aa-4895-ac7b-0021707b6906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3", "name": "network-vif-deleted", "tag": "b594c575-dcc9-4980-836c-0650a1adfda5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:12.315216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:12.317806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:12.365896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b05c7c9c-17b5-4107-99d5-b548623ad8c4 req-bc3d8ff0-d8aa-4895-ac7b-0021707b6906 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:12.366734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b05c7c9c-17b5-4107-99d5-b548623ad8c4 req-bc3d8ff0-d8aa-4895-ac7b-0021707b6906 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:12.369979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b05c7c9c-17b5-4107-99d5-b548623ad8c4 req-bc3d8ff0-d8aa-4895-ac7b-0021707b6906 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:12.395678 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b05c7c9c-17b5-4107-99d5-b548623ad8c4 req-bc3d8ff0-d8aa-4895-ac7b-0021707b6906 service nova] Creating event network-vif-deleted:b594c575-dcc9-4980-836c-0650a1adfda5 for instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 on n-h2-858383-16 Oct 27 09:29:12.404270 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b05c7c9c-17b5-4107-99d5-b548623ad8c4 req-bc3d8ff0-d8aa-4895-ac7b-0021707b6906 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109964 Oct 27 09:29:12.405282 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2713/5372] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:12.416414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:12.417460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:12.451606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:12.453203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:12.456122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:12.457349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:12.459692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:12.461790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:12.641782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:12.643253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:12.644086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:12.646219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:12.646820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lazy-loading 'fault' on Instance uuid 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:29:12.652392 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1616e439-2d9d-4bf8-ab5a-e1ffc625fec9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1514 microversion: 2.1 time: 0.425985 Oct 27 09:29:12.657895 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2660/5373] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:12 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1514 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:12.725636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:12.738587 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33fb4a7a-ef97-434e-8031-353b0c33c2e9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 200 len: 1318 microversion: 2.1 time: 0.327260 Oct 27 09:29:12.742888 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2714/5374] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:12 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:13.152467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f1d41276-1153-4a87-a0fb-ceeb683ecf93 req-9bf76c67-2fc3-407b-8694-64dd2247ea05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f", "name": "network-vif-plugged", "status": "completed", "tag": "83ab4a35-51f8-44ca-8a16-1fb3a90fbc85"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:13.183404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f1d41276-1153-4a87-a0fb-ceeb683ecf93 req-9bf76c67-2fc3-407b-8694-64dd2247ea05 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:13.184308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f1d41276-1153-4a87-a0fb-ceeb683ecf93 req-9bf76c67-2fc3-407b-8694-64dd2247ea05 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:13.187475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f1d41276-1153-4a87-a0fb-ceeb683ecf93 req-9bf76c67-2fc3-407b-8694-64dd2247ea05 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:13.230081 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f1d41276-1153-4a87-a0fb-ceeb683ecf93 req-9bf76c67-2fc3-407b-8694-64dd2247ea05 service nova] Creating event network-vif-plugged:83ab4a35-51f8-44ca-8a16-1fb3a90fbc85 for instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f on n-h2-858383-16 Oct 27 09:29:13.251097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:13.255908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:13.266114 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f1d41276-1153-4a87-a0fb-ceeb683ecf93 req-9bf76c67-2fc3-407b-8694-64dd2247ea05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117792 Oct 27 09:29:13.271301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:13.272790 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2661/5375] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:29:13.290686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:13.293716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:13.294669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:13.304717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:13.305432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:13.315327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:13.324367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:13.382941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:13.385108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:13.386885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:13.390160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:13.390788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:13.391342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:14.038003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:14.040537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:14.049571 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f1e58d64-e304-4e61-8231-954e66c49a92 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.804522 Oct 27 09:29:14.051635 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2715/5376] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:13 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:14.063778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:14.064661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:14.066474 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e57e8ee-ede5-4b7d-9095-069a49c6b466 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1315 microversion: 2.1 time: 0.755660 Oct 27 09:29:14.070956 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2662/5377] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:13 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:14.076211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:14.077043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:14.083249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:14.083826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:14.083945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:14.084276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:14.084729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:14.084998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:14.085461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:14.086299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:14.086897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:14.087469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:14.089758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:14.090285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:14.111835 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 HTTP/1.1 Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3'} Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:29:14.113463 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:14.117358 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:29:14.117358 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:29:14.117358 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:29:14.117358 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:29:14.117358 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:29:14.117358 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:29:14.117358 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:14.118944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:29:14.120013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-437fdbd3-6b46-4943-bdd5-04c357544c3d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 404 len: 111 microversion: 2.1 time: 0.047743 Oct 27 09:29:14.124379 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2663/5378] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:14 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:29:14.136051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5de69cc8-5882-4107-8d05-0df0dc671b6f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '.version_select at 0x7f31a8e04040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:14.202456 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5de69cc8-5882-4107-8d05-0df0dc671b6f tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-462347714" status: 202 len: 0 microversion: 2.1 time: 0.076684 Oct 27 09:29:14.203173 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2664/5379] 10.222.0.25 () {58 vars in 1206 bytes} [Thu Oct 27 09:29:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-462347714 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:29:14.424871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-228257906", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7a475c77-fcd2-4475-b72a-44ef10abc15a"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:14.437526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:14.445329 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9fddf943-91f5-4e10-87de-62686d707ef4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1520 microversion: 2.1 time: 0.392449 Oct 27 09:29:14.453589 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2716/5380] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:14 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:14.514395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] validate_networks() for [('7a475c77-fcd2-4475-b72a-44ef10abc15a', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:29:15.079184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:15.080541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:15.096736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:15.102665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:15.107604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:15.108910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:15.108910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:15.109424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:15.390400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:29:15.392125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:29:15.392769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:29:15.393332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:29:15.393887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:29:15.427949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:15.429217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:15.430383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:15.436525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:15.437163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:15.440279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:15.519669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:29:15.533805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for user 993f47058e6d48f7ac30138be91496c5 and project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:29:15.560500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:15.565203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:29:15.573651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:29:15.580035 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fb706471-412e-4d28-b0aa-3ad0316bf100 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.497091 Oct 27 09:29:15.580957 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2717/5381] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:15 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:15.596116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:15.597032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:15.621457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:15.622021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:15.623045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:15.624775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:15.625244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:15.632628 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1896d88-cdcf-40c9-90d1-932e6f739bbd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.211900 Oct 27 09:29:15.639936 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2665/5382] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:29:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:29:15.640125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:15.640209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:15.640282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:15.647483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:15.648018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:15.648461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:15.649597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:15.650064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:15.650499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:16.019031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:16.026914 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42411c4d-6f9b-473e-b008-05f52fc45a1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1520 microversion: 2.1 time: 0.391284 Oct 27 09:29:16.033875 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2666/5383] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:15 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:16.045985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a56f7f8-4078-4595-8e8f-9edc5f1f2610 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:16.046601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a56f7f8-4078-4595-8e8f-9edc5f1f2610 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:16.065167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:16.076675 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c354eda-6d93-4d99-89ea-ba78088dadc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1503 microversion: 2.1 time: 0.494473 Oct 27 09:29:16.093030 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2718/5384] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:15 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1503 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:16.112077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:16.121697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:16.132391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:16.133164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:16.133769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:16.134628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:16.135240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:16.135849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:16.260883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a56f7f8-4078-4595-8e8f-9edc5f1f2610 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:16.285643 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a56f7f8-4078-4595-8e8f-9edc5f1f2610 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1208 microversion: 2.1 time: 0.247871 Oct 27 09:29:16.286365 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2667/5385] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:16 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1208 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:16.542882 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.network.security_group_api [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Removing security group a847e211-17db-4d2e-b3a1-3d0bd2d66695 from port 83ab4a35-51f8-44ca-8a16-1fb3a90fbc85 Oct 27 09:29:16.612704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:16.613322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:16.621356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:16.634751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:16.635505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:16.636764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:16.637404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:16.640127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:18.620436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:18.639883 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-313280d9-d9eb-44a8-8b6a-11c5e1a41845 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 2.030540 Oct 27 09:29:18.651651 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2668/5386] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:16 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:18.668600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:18.676278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:18.684511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:18.685467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:18.686319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:18.687215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:18.687842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:18.688413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.027139 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0868d81c-c0d7-4850-b9e6-4f508cc75416 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f/action" status: 202 len: 0 microversion: 2.1 time: 2.920387 Oct 27 09:29:19.032145 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2719/5387] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:29:16 2022] POST /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f/action => generated 0 bytes in 2926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:29:19.051020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:19.053850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:19.085335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.093269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.094088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.105064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.111417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.116251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.306594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:19.320932 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2a13dbd1-a744-45cc-8c58-5692eb503bf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1266 microversion: 2.1 time: 0.286280 Oct 27 09:29:19.326852 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2720/5388] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:19 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:19.338256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2c9cad4f-e8ec-4c66-9cd5-0266dc0da9a6 req-dc75ec01-7613-4621-9a0c-9c4ad449b97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9433111c-e2e0-4887-91c0-88b7aacea098", "name": "network-vif-unplugged", "status": "completed", "tag": "ae639caa-6b7b-45e6-98c8-f1f0600730e0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:19.365508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2c9cad4f-e8ec-4c66-9cd5-0266dc0da9a6 req-dc75ec01-7613-4621-9a0c-9c4ad449b97a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.366288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2c9cad4f-e8ec-4c66-9cd5-0266dc0da9a6 req-dc75ec01-7613-4621-9a0c-9c4ad449b97a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.367074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2c9cad4f-e8ec-4c66-9cd5-0266dc0da9a6 req-dc75ec01-7613-4621-9a0c-9c4ad449b97a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.383318 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2c9cad4f-e8ec-4c66-9cd5-0266dc0da9a6 req-dc75ec01-7613-4621-9a0c-9c4ad449b97a service nova] Creating event network-vif-unplugged:ae639caa-6b7b-45e6-98c8-f1f0600730e0 for instance 9433111c-e2e0-4887-91c0-88b7aacea098 on n-h1-858383-16 Oct 27 09:29:19.391370 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2c9cad4f-e8ec-4c66-9cd5-0266dc0da9a6 req-dc75ec01-7613-4621-9a0c-9c4ad449b97a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061380 Oct 27 09:29:19.392806 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2721/5389] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:19.399532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:19.400975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:19.410979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.411853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.412691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.413660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.414348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.415009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.480884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:19.496629 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8093024-8880-4cad-ab1c-8ad0b8f0d381 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1520 microversion: 2.1 time: 0.840651 Oct 27 09:29:19.498629 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2669/5390] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:18 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1520 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:19.503721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-509eb9ea-e4f7-4111-b502-20562b91141a req-7c5bb7cb-3225-4783-9e10-2e9ba5644df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f", "tag": "83ab4a35-51f8-44ca-8a16-1fb3a90fbc85"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:19.537686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-509eb9ea-e4f7-4111-b502-20562b91141a req-7c5bb7cb-3225-4783-9e10-2e9ba5644df4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.537928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-509eb9ea-e4f7-4111-b502-20562b91141a req-7c5bb7cb-3225-4783-9e10-2e9ba5644df4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.546832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-509eb9ea-e4f7-4111-b502-20562b91141a req-7c5bb7cb-3225-4783-9e10-2e9ba5644df4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.570869 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-509eb9ea-e4f7-4111-b502-20562b91141a req-7c5bb7cb-3225-4783-9e10-2e9ba5644df4 service nova] Creating event network-changed:83ab4a35-51f8-44ca-8a16-1fb3a90fbc85 for instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f on n-h2-858383-16 Oct 27 09:29:19.616686 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-509eb9ea-e4f7-4111-b502-20562b91141a req-7c5bb7cb-3225-4783-9e10-2e9ba5644df4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112912 Oct 27 09:29:19.620073 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2670/5391] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:19.658252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:19.667501 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fb2b0247-934b-4f99-b4f3-51c3cdf2a24d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1461 microversion: 2.1 time: 0.273203 Oct 27 09:29:19.672433 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2722/5392] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:19 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1461 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:19.678972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:19.679713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:19.697504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.698026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.698485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.703156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:19.703812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:19.710615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.711175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.711664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.731386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.732483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.732926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:19.733638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:19.734089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:19.744118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:20.167984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:20.197760 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0d49bdfd-ae3e-4417-bd09-2510b3f481ad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.502232 Oct 27 09:29:20.224829 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2723/5393] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:19 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:20.239176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:20.249504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:20.250308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:20.250734 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-460fc6c4-3a1e-4ddd-9eb3-6b1546d30fb5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.578758 Oct 27 09:29:20.251308 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2671/5394] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:19 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:20.256832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:20.257328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:20.257772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:20.258483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:20.258938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:20.259366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:20.350991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:20.351758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:20.361575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:20.368200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:20.368695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:20.369461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:20.369941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:20.370377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:20.679609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:20.703029 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48277712-b7ab-4d94-8419-94f13f7a4a5e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1266 microversion: 2.1 time: 0.356080 Oct 27 09:29:20.706387 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2672/5395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:20 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:20.720984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:20.728883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:20.746292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:20.755104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:20.755865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:20.757904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:20.759795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:20.760601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:20.836487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:20.846735 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5bceff5a-69eb-4115-8905-48d9de425c5d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.614699 Oct 27 09:29:20.851816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2724/5396] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:20 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:20.881382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:20.882333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:20.899894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:20.900758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:20.901434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:20.902389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:20.903065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:20.903773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:20.907041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:21.161365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:21.173355 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4abc3a40-8fb8-44d8-a748-d92d1f2a4574 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1520 microversion: 2.1 time: 0.463380 Oct 27 09:29:21.187832 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2673/5397] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:20 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1520 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:21.238143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:21.247925 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4d2a4366-e0bf-4d8a-888a-e7bb5482f805 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.369894 Oct 27 09:29:21.248986 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2725/5398] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:20 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:21.279909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:21.281019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:21.284797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:21.285929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:21.315492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:21.318940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:21.352201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:21.352723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:21.353169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:21.355148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:21.356051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:21.357067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:21.357547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:21.357852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:21.358424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:21.360013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:21.974692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:21.991037 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5f4d6702-da5a-4595-9247-c6867507678a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.722243 Oct 27 09:29:21.993805 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2674/5399] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:21 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:22.004312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:22.007867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:22.024249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:22.025509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:22.026553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:22.046221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:22.046762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:22.047222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:22.192582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:22.211722 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43a9d7d9-830d-4d8e-b2b0-1efd81dee528 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.933635 Oct 27 09:29:22.213526 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2726/5400] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:21 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:22.226151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:22.228603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:22.256365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:22.259513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:22.262290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:22.264724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:22.269085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:22.270547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:22.663277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:22.671769 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b190847-f3ba-430c-9ee0-29000922f8c4 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1308 microversion: 2.1 time: 0.675686 Oct 27 09:29:22.677410 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2675/5401] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:21 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1308 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:22.682273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-eb326e2c-e761-4aed-8867-d3faf98e6574 req-e061027b-dfcc-4117-8b94-5ce79a08b056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9433111c-e2e0-4887-91c0-88b7aacea098", "name": "network-vif-plugged", "status": "completed", "tag": "ae639caa-6b7b-45e6-98c8-f1f0600730e0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:22.712684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-eb326e2c-e761-4aed-8867-d3faf98e6574 req-e061027b-dfcc-4117-8b94-5ce79a08b056 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:22.713325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-eb326e2c-e761-4aed-8867-d3faf98e6574 req-e061027b-dfcc-4117-8b94-5ce79a08b056 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:22.713905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-eb326e2c-e761-4aed-8867-d3faf98e6574 req-e061027b-dfcc-4117-8b94-5ce79a08b056 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:22.744526 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-eb326e2c-e761-4aed-8867-d3faf98e6574 req-e061027b-dfcc-4117-8b94-5ce79a08b056 service nova] Creating event network-vif-plugged:ae639caa-6b7b-45e6-98c8-f1f0600730e0 for instance 9433111c-e2e0-4887-91c0-88b7aacea098 on n-h1-858383-16 Oct 27 09:29:22.750524 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-eb326e2c-e761-4aed-8867-d3faf98e6574 req-e061027b-dfcc-4117-8b94-5ce79a08b056 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071679 Oct 27 09:29:22.751447 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2676/5402] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:22.769544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1813731321", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "9cad971b-61f2-43dd-8137-4ee7400ac93f"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:22.902688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] validate_networks() for [('9cad971b-61f2-43dd-8137-4ee7400ac93f', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:29:23.792181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:23.802118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4922e58d-7771-4325-94a3-0755b6f0515f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1520 microversion: 2.1 time: 1.587253 Oct 27 09:29:23.802980 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2727/5403] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:22 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1520 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:23.811592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:23.812960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:23.820740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:23.822996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:23.823792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:23.824814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:23.826021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:23.826888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:24.720756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:24.729739 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-95bb4ba4-2230-49f4-baa2-d959feeda6bc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.925440 Oct 27 09:29:24.734450 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2728/5404] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:23 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:24.745822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:24.749513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:24.769697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:29:24.770608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:29:24.771232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:29:24.772284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:29:24.772969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:29:24.776395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:24.781645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:24.782334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:24.783235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:24.783896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:24.784475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:24.789631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:24.792164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:24.792777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:24.793751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:24.795826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:24.796437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:24.850977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:29:24.861526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Getting quotas for user 9301fb54a8734e1ab31e496add7e9446 and project b4c5d43a28c24b63b960932c678d0858. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:29:24.879614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:29:24.883434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:29:24.973735 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-385265dd-c6b6-4ce8-b004-70d465501d48 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.220840 Oct 27 09:29:24.974414 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2677/5405] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:29:24.991547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:24.992206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:25.009889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:25.010413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:25.010870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:25.011664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:25.012147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:25.013126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:25.562790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:25.575873 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e6796090-db31-40d0-9980-76a4e3c0df81 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1308 microversion: 2.1 time: 0.839429 Oct 27 09:29:25.639881 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2729/5406] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:24 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1308 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:25.665551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:25.674291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0e79cf7-b0dd-4561-bce2-62050f435224 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:25.675452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0e79cf7-b0dd-4561-bce2-62050f435224 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:25.677279 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ed1bc2f-fc68-4c5a-87f0-33ae235512d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1520 microversion: 2.1 time: 0.700927 Oct 27 09:29:25.680318 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2678/5407] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:24 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1520 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:25.735633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-bd10e35b-b718-4888-b996-eb67aa6430d3 req-7617fe6b-f563-4be3-82bf-d01b81ff1e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e68043a-aca2-4e06-9a37-6f4f20abdf3d", "tag": "7c31d462-60d0-4a26-83cb-ea9e2151742e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:25.771396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bd10e35b-b718-4888-b996-eb67aa6430d3 req-7617fe6b-f563-4be3-82bf-d01b81ff1e13 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:25.775600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bd10e35b-b718-4888-b996-eb67aa6430d3 req-7617fe6b-f563-4be3-82bf-d01b81ff1e13 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:25.778466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bd10e35b-b718-4888-b996-eb67aa6430d3 req-7617fe6b-f563-4be3-82bf-d01b81ff1e13 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:25.824098 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-bd10e35b-b718-4888-b996-eb67aa6430d3 req-7617fe6b-f563-4be3-82bf-d01b81ff1e13 service nova] Creating event network-changed:7c31d462-60d0-4a26-83cb-ea9e2151742e for instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d on n-h2-858383-16 Oct 27 09:29:25.844737 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-bd10e35b-b718-4888-b996-eb67aa6430d3 req-7617fe6b-f563-4be3-82bf-d01b81ff1e13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113661 Oct 27 09:29:25.846483 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2679/5408] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:29:25.857712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:25.858789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:25.867583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:25.868264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:25.868996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:25.869874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:25.870814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:25.871392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:25.877544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:26.090098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f0e79cf7-b0dd-4561-bce2-62050f435224 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:26.099082 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0e79cf7-b0dd-4561-bce2-62050f435224 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1215 microversion: 2.1 time: 0.445974 Oct 27 09:29:26.104633 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2730/5409] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:25 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1215 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:26.332139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:26.344437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70af88a1-37e7-4ba9-9057-f921e1b7e4e7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1526 microversion: 2.1 time: 0.493748 Oct 27 09:29:26.347187 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2680/5410] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:25 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1526 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:26.645248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:26.646540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:26.664374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:26.670106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:26.670925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:26.672394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:26.673489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:26.675877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:26.703714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:26.704368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:26.724661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:26.725594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:26.726229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:26.727367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:26.728047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:26.728668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:27.299130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:27.321956 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-69e8d1c4-7bb5-488b-9bc9-1a3fca27ed59 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1505 microversion: 2.1 time: 0.623431 Oct 27 09:29:27.324712 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2681/5411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:26 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:27.333800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:27.337254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:27.350371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:27.352179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:27.355856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:27.357384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:27.357976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:27.363426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:27.575269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:27.591460 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80653f30-9bcd-4044-8ab1-6c25672eb37b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1308 microversion: 2.1 time: 0.953171 Oct 27 09:29:27.593373 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2731/5412] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:26 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1308 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:27.604490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:27.610401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:27.676117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:27.679432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:27.684272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:27.686862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:27.687546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:27.691180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:27.703754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:27.713339 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c78a452-d658-404b-b50d-4855f467fcb8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1275 microversion: 2.1 time: 0.387296 Oct 27 09:29:27.719493 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2682/5413] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:27 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1275 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:27.736935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:27.742248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:27.768237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:27.771540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:27.774040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:27.774909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:27.780322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:27.781628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:28.514402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:28.523237 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f5272d5-6886-45c9-8495-1afeaef2d0ed tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 200 len: 1505 microversion: 2.1 time: 0.928512 Oct 27 09:29:28.523967 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2732/5414] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:27 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 1505 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:28.544497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:28.547762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:28.548485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:28.554134 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40c3e4bd-7eb1-47f0-851b-034dc219c9eb tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1508 microversion: 2.1 time: 0.832238 Oct 27 09:29:28.555340 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2683/5415] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:27 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1508 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:28.557315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:28.558573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:28.559026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:28.560335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:28.561066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:28.561504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:28.590018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:29:28.626182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:28.627077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:28.635167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:28.635698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:28.636194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:28.636987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:28.637643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:28.638596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:28.714643 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7839a329-3c87-4e29-b447-5d8116fbcb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 204 len: 0 microversion: 2.1 time: 0.172094 Oct 27 09:29:28.715653 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2733/5416] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:29:28 2022] DELETE /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:29:28.749592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:28.750385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:28.756895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:28.763785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:28.764432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:28.765240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:28.765722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:28.768128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:28.866904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:28.879142 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25c488f9-4bfd-4469-b040-929ca3c783f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1308 microversion: 2.1 time: 0.264461 Oct 27 09:29:28.886637 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2684/5417] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:28 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:28.908053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:28.917885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1506830310", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ae09c0e3-851a-4f89-a19f-2ab607592cdc"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:28.942398 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91a2d771-9d92-4024-ab53-ed406559a571 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1273 microversion: 2.1 time: 0.200851 Oct 27 09:29:28.943954 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2734/5418] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:28 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:29.014761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] validate_networks() for [('ae09c0e3-851a-4f89-a19f-2ab607592cdc', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:29:29.580253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:29.581682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:29.595140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:29.601986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:29.602921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:29.603913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:29.604648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:29.607273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:29.930344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:29.942484 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-90ea71c4-984a-4c15-85c4-25a9735f67c8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1508 microversion: 2.1 time: 0.368917 Oct 27 09:29:29.956658 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2735/5419] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:29 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1508 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:29.984821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e51afb81-06c1-4c79-9971-7bf3b668c305 req-3bf5a088-0663-4163-b37b-7c223c2c13a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f35f23-0b67-4a55-8c3e-3950fac6b97a", "name": "network-vif-unplugged", "status": "completed", "tag": "fe701430-2ee5-4174-b187-9c3bbd60c9e6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:30.018637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e51afb81-06c1-4c79-9971-7bf3b668c305 req-3bf5a088-0663-4163-b37b-7c223c2c13a8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:30.023193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e51afb81-06c1-4c79-9971-7bf3b668c305 req-3bf5a088-0663-4163-b37b-7c223c2c13a8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:30.023990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e51afb81-06c1-4c79-9971-7bf3b668c305 req-3bf5a088-0663-4163-b37b-7c223c2c13a8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:30.055521 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e51afb81-06c1-4c79-9971-7bf3b668c305 req-3bf5a088-0663-4163-b37b-7c223c2c13a8 service nova] Creating event network-vif-unplugged:fe701430-2ee5-4174-b187-9c3bbd60c9e6 for instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a on n-h1-858383-16 Oct 27 09:29:30.060774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:29:30.061349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:29:30.061898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:29:30.062383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:29:30.063295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:29:30.079293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:30.080323 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e51afb81-06c1-4c79-9971-7bf3b668c305 req-3bf5a088-0663-4163-b37b-7c223c2c13a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119104 Oct 27 09:29:30.084753 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2736/5420] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:30.085310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:30.087308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:30.088239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:30.091908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:30.092468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:30.100470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:30.101343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:30.113989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:30.115059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:30.117583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:30.118444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:30.118992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:30.119905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:30.120400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:30.139555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Getting quotas for project 085f1c568af5494c99a7ff3dd488f76a. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:29:30.156757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Getting quotas for user 8d122762f6a446279f6cdc0e66ab5daf and project 085f1c568af5494c99a7ff3dd488f76a. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:29:30.193886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:29:30.198714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:29:30.262454 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c9e1269-9667-4140-8728-40db3fe3aae7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348694 Oct 27 09:29:30.270545 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2685/5421] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:29:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:29:30.276459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:30.277356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:30.286891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:30.287632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:30.288465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:30.289800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:30.291017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:30.292554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:30.769117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:30.787781 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47224d49-419d-45fb-aeaa-2cf86a9560ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1308 microversion: 2.1 time: 0.698843 Oct 27 09:29:30.789880 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2737/5422] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:30 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1308 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:30.801730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ea87593-1579-4931-83b7-abafe1a5f0d9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:30.803969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4ea87593-1579-4931-83b7-abafe1a5f0d9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:31.021425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4ea87593-1579-4931-83b7-abafe1a5f0d9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:31.038706 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ea87593-1579-4931-83b7-abafe1a5f0d9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1218 microversion: 2.1 time: 0.243365 Oct 27 09:29:31.039350 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2738/5423] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:30 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1218 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:31.069688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:31.070325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:31.102021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:31.102534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:31.102979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:31.104593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:31.105066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:31.105504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:31.249927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:31.259856 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-733e561f-387f-45f5-b8a3-2cc0e37732e9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1315 microversion: 2.1 time: 0.987772 Oct 27 09:29:31.262999 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2686/5424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:30 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:31.442507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:31.451147 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed16e82d-399a-4969-9e5e-1067a475d2b7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1508 microversion: 2.1 time: 0.396292 Oct 27 09:29:31.451993 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2739/5425] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:31 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1508 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:31.802006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-06d08a47-3b7f-415b-badd-1ce3d1fffbfd req-a341bd49-b6e5-4f73-b415-97136e0ec2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222bb9b2-8066-4145-a9b2-a797cd414d5e", "tag": "cb3da523-3f15-44f5-a3c8-7eb439acdc40"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:31.817439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:31.820757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:31.845082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06d08a47-3b7f-415b-badd-1ce3d1fffbfd req-a341bd49-b6e5-4f73-b415-97136e0ec2f9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:31.845803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06d08a47-3b7f-415b-badd-1ce3d1fffbfd req-a341bd49-b6e5-4f73-b415-97136e0ec2f9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:31.848238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06d08a47-3b7f-415b-badd-1ce3d1fffbfd req-a341bd49-b6e5-4f73-b415-97136e0ec2f9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:31.852810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:31.853598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:31.854044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:31.855726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:31.855726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:31.864988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:31.866721 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-06d08a47-3b7f-415b-badd-1ce3d1fffbfd req-a341bd49-b6e5-4f73-b415-97136e0ec2f9 service nova] Creating event network-changed:cb3da523-3f15-44f5-a3c8-7eb439acdc40 for instance 222bb9b2-8066-4145-a9b2-a797cd414d5e on n-h1-858383-16 Oct 27 09:29:31.873452 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-06d08a47-3b7f-415b-badd-1ce3d1fffbfd req-a341bd49-b6e5-4f73-b415-97136e0ec2f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075068 Oct 27 09:29:31.874741 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2687/5426] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:32.064454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:32.065156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:32.081605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:32.082355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:32.082956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:32.083904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:32.084335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:32.084920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:32.418293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:32.440484 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cfa8ae65-7716-4ab8-b93f-6edc7751be1b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1278 microversion: 2.1 time: 0.380400 Oct 27 09:29:32.442616 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2688/5427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:32 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1278 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:32.450268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:32.451397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:32.462055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:32.462936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:32.463837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:32.465865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:32.469026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:32.470092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:32.809485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:32.827193 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98062ba3-949f-47a4-bb1f-5fde5d6e920d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1308 microversion: 2.1 time: 1.010583 Oct 27 09:29:32.829072 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2740/5428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:31 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1308 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:32.842670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:32.844560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:32.860009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:32.863670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:32.867356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:32.869475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:32.872368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:32.874216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:33.036138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:33.044466 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ddc17a42-4752-4d74-8e82-8f029447b4e0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1315 microversion: 2.1 time: 0.600258 Oct 27 09:29:33.056312 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2689/5429] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:32 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:33.061526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a9391560-6761-4e32-9004-86167597906e req-3aa76545-de16-4265-af6e-ce4be00eb678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e68043a-aca2-4e06-9a37-6f4f20abdf3d", "name": "network-vif-plugged", "status": "completed", "tag": "7c31d462-60d0-4a26-83cb-ea9e2151742e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:33.083836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a9391560-6761-4e32-9004-86167597906e req-3aa76545-de16-4265-af6e-ce4be00eb678 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:33.084620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a9391560-6761-4e32-9004-86167597906e req-3aa76545-de16-4265-af6e-ce4be00eb678 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:33.085212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a9391560-6761-4e32-9004-86167597906e req-3aa76545-de16-4265-af6e-ce4be00eb678 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:33.107553 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a9391560-6761-4e32-9004-86167597906e req-3aa76545-de16-4265-af6e-ce4be00eb678 service nova] Creating event network-vif-plugged:7c31d462-60d0-4a26-83cb-ea9e2151742e for instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d on n-h2-858383-16 Oct 27 09:29:33.123187 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a9391560-6761-4e32-9004-86167597906e req-3aa76545-de16-4265-af6e-ce4be00eb678 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065892 Oct 27 09:29:33.124091 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2690/5430] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:33.468289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:33.471126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:33.484453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:33.485465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:33.488707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:33.492863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:33.494000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:33.494690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:33.531831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:33.551712 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38a83aaa-cf90-42a2-abd9-e8ba7f82d822 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1451 microversion: 2.1 time: 0.719837 Oct 27 09:29:33.553101 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2741/5431] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:32 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1451 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:33.584981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:33.586473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:33.597047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:33.597604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:33.598104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:33.598984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:33.599657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:33.600183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:33.697129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:33.708354 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b844a97-f588-4ae9-958b-b7af83f5ffce tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1276 microversion: 2.1 time: 0.244774 Oct 27 09:29:33.709165 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2691/5432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:33 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:33.713794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2a47ca14-f011-4d27-bcb8-1e3b20e8272e req-69e2ee76-a71b-4c62-bbaf-3a1847328ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9433111c-e2e0-4887-91c0-88b7aacea098", "name": "network-vif-deleted", "tag": "ae639caa-6b7b-45e6-98c8-f1f0600730e0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:33.724467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2a47ca14-f011-4d27-bcb8-1e3b20e8272e req-69e2ee76-a71b-4c62-bbaf-3a1847328ff0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:33.725141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2a47ca14-f011-4d27-bcb8-1e3b20e8272e req-69e2ee76-a71b-4c62-bbaf-3a1847328ff0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:33.725784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2a47ca14-f011-4d27-bcb8-1e3b20e8272e req-69e2ee76-a71b-4c62-bbaf-3a1847328ff0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:33.739684 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2a47ca14-f011-4d27-bcb8-1e3b20e8272e req-69e2ee76-a71b-4c62-bbaf-3a1847328ff0 service nova] Creating event network-vif-deleted:ae639caa-6b7b-45e6-98c8-f1f0600730e0 for instance 9433111c-e2e0-4887-91c0-88b7aacea098 on n-h1-858383-16 Oct 27 09:29:33.747117 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2a47ca14-f011-4d27-bcb8-1e3b20e8272e req-69e2ee76-a71b-4c62-bbaf-3a1847328ff0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036441 Oct 27 09:29:33.747969 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2692/5433] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:33.859421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:33.861810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:33.869758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:33.870252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:33.871106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:33.871936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:33.872693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:33.873372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:34.397933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:34.403137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:34.417651 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7b68a875-d85d-4b61-a401-4fb8ab7377dc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1451 microversion: 2.1 time: 0.839895 Oct 27 09:29:34.418590 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2742/5434] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:33 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1451 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:34.430442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:34.431407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:34.442518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:34.443120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:34.444011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:34.444843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:34.445520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:34.446065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:34.631975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:34.641034 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-781e243b-5b18-482c-921d-f1327f9fcdca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1308 microversion: 2.1 time: 0.788925 Oct 27 09:29:34.641757 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2693/5435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:33 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1308 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:34.647145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:34.648638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:34.661015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:34.661621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:34.662197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:34.662975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:34.663719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:34.664615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:34.813806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:34.825171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ec734df-307f-4b2a-890c-0d14d17ad7ae tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1315 microversion: 2.1 time: 0.404319 Oct 27 09:29:34.826086 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2743/5436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:34 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:34.852888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:34.855095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:34.871296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:34.877255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:34.878015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:34.879539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:34.882479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:34.883229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:35.054788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:35.077495 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4adf4a8b-490c-4f4a-9ed8-729508a10246 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1276 microversion: 2.1 time: 0.250061 Oct 27 09:29:35.084781 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2744/5437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:34 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:35.132727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lazy-loading 'flavor' on Instance uuid d8f35f23-0b67-4a55-8c3e-3950fac6b97a {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:29:35.148123 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Cannot 'shelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state shelved_offloaded Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action HTTP/1.1 Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 14 Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: {"shelve": {}} Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: exception: Cannot 'shelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state shelved_offloaded Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a', 'body': {'shelve': {}}} Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:29:35.150988 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state shelved_offloaded Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state shelved_offloaded Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 409 to user: Cannot 'shelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state shelved_offloaded {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:29:35.155334 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-adaa79c5-3c6d-45fc-b247-4fbc3793a333 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 409 len: 155 microversion: 2.1 time: 0.509492 Oct 27 09:29:35.163741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:35.164293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:35.167803 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2694/5438] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:29:34 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 155 bytes in 525 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:29:35.176292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:35.180169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:35.181680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:35.182561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:35.184219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:35.186112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:35.255293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120602) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 27 09:29:35.371158 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40e25a27-6ddb-4119-b0df-10001c320071 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 202 len: 0 microversion: 2.1 time: 0.212290 Oct 27 09:29:35.375860 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2745/5439] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:29:35 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:29:35.381629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:35.382785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:35.406357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:35.408675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:35.413827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:35.420370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:35.420916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:35.423876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:35.683283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:35.684435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:35.713075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:35.713935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:35.715994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:35.717249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:35.718483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:35.719689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:36.453311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:36.461596 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ceb64f6a-3a9d-4eb3-baf0-b95ec975933d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1459 microversion: 2.1 time: 1.084985 Oct 27 09:29:36.484235 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2695/5440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:35 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1459 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:36.492346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:36.493017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:36.523497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:36.531256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:36.531989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:36.540776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:36.541604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:36.542263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:36.666924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:36.684753 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-095085dd-319e-40da-88c5-17348036fec3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1489 microversion: 2.1 time: 1.023043 Oct 27 09:29:36.685948 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2746/5441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:35 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1489 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:36.700826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:36.701627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:36.712326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:36.713256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:36.713985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:36.714915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:36.715800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:36.716432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:37.217623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:37.227412 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c55026a-0a4f-4d70-9a7d-3f70cac09a8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1315 microversion: 2.1 time: 0.741554 Oct 27 09:29:37.236441 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2696/5442] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:36 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:37.250144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-228257906", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7a475c77-fcd2-4475-b72a-44ef10abc15a"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:37.281234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:37.293891 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e05e842f-96e3-408a-90e8-58556353aaa8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1318 microversion: 2.1 time: 0.606206 Oct 27 09:29:37.300913 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2747/5443] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:36 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:37.346084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] validate_networks() for [('7a475c77-fcd2-4475-b72a-44ef10abc15a', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:29:37.492047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:37.492571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:37.505844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:37.506714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:37.507379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:37.508357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:37.509751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:37.510401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:38.418232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:38.428459 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5123b711-65f5-4ffa-8e62-f61922960f87 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.940387 Oct 27 09:29:38.444601 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2748/5444] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:37 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:38.452833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a45b10a7-8704-492e-978e-6910ca119e74 req-317353b9-2dc8-447f-8fae-c00f3758c962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bb9b2-8066-4145-a9b2-a797cd414d5e", "name": "network-vif-plugged", "status": "completed", "tag": "cb3da523-3f15-44f5-a3c8-7eb439acdc40"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:38.466231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a45b10a7-8704-492e-978e-6910ca119e74 req-317353b9-2dc8-447f-8fae-c00f3758c962 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:38.466993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a45b10a7-8704-492e-978e-6910ca119e74 req-317353b9-2dc8-447f-8fae-c00f3758c962 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:38.467686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a45b10a7-8704-492e-978e-6910ca119e74 req-317353b9-2dc8-447f-8fae-c00f3758c962 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:38.485807 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a45b10a7-8704-492e-978e-6910ca119e74 req-317353b9-2dc8-447f-8fae-c00f3758c962 service nova] Creating event network-vif-plugged:cb3da523-3f15-44f5-a3c8-7eb439acdc40 for instance 222bb9b2-8066-4145-a9b2-a797cd414d5e on n-h1-858383-16 Oct 27 09:29:38.491384 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a45b10a7-8704-492e-978e-6910ca119e74 req-317353b9-2dc8-447f-8fae-c00f3758c962 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045024 Oct 27 09:29:38.492861 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2749/5445] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:38.499902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:38.501021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:38.508360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:38.509251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:38.509837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:38.510687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:38.511313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:38.512097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:39.104637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:39.119276 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e19a2782-e903-4a00-9dbd-d45e1b3163f4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1315 microversion: 2.1 time: 0.624968 Oct 27 09:29:39.120240 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2750/5446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:38 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:39.125014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:39.125702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:39.140036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:39.140791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:39.141298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:39.142079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:39.142733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:39.143099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:39.420246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:29:39.421037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:29:39.421958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:29:39.422793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:29:39.423308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:29:39.432945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:39.433660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:39.434605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:39.435962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:39.436660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:39.437314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:39.461690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:29:39.470953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for user 993f47058e6d48f7ac30138be91496c5 and project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:29:39.485322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:29:39.487944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:29:39.508178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:39.517974 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-276e3b34-1cbc-4081-a099-4763e717c16f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1318 microversion: 2.1 time: 0.396593 Oct 27 09:29:39.518636 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2751/5447] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:39 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:39.526494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1c86402d-6fe3-4569-b99f-94d18cb97b78 req-8f6f8b6b-fa99-4c2e-a854-1dc0d8aa5e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90178e3e-8064-49d5-bd94-5f733fe53d8a", "tag": "d55fed31-ab9f-4255-b941-5596c59b9377"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:39.538179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1c86402d-6fe3-4569-b99f-94d18cb97b78 req-8f6f8b6b-fa99-4c2e-a854-1dc0d8aa5e4b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:39.538777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1c86402d-6fe3-4569-b99f-94d18cb97b78 req-8f6f8b6b-fa99-4c2e-a854-1dc0d8aa5e4b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:39.539266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1c86402d-6fe3-4569-b99f-94d18cb97b78 req-8f6f8b6b-fa99-4c2e-a854-1dc0d8aa5e4b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:39.547477 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f01aa6b-e162-4eb2-8947-cea0fbbb0653 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.309669 Oct 27 09:29:39.548682 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2697/5448] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:29:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:29:39.554180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:39.555209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:39.562230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:39.563014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:39.563788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:39.567366 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1c86402d-6fe3-4569-b99f-94d18cb97b78 req-8f6f8b6b-fa99-4c2e-a854-1dc0d8aa5e4b service nova] Creating event network-changed:d55fed31-ab9f-4255-b941-5596c59b9377 for instance 90178e3e-8064-49d5-bd94-5f733fe53d8a on n-h2-858383-16 Oct 27 09:29:39.577875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1c86402d-6fe3-4569-b99f-94d18cb97b78 req-8f6f8b6b-fa99-4c2e-a854-1dc0d8aa5e4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057784 Oct 27 09:29:39.578893 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2752/5449] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:39.579110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:39.579773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:39.580223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:39.584565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-435ddaac-ecb9-4fbf-b2ed-5dc3a4a17050 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:39.585685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-435ddaac-ecb9-4fbf-b2ed-5dc3a4a17050 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:39.593287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:39.736517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-435ddaac-ecb9-4fbf-b2ed-5dc3a4a17050 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:39.743480 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-435ddaac-ecb9-4fbf-b2ed-5dc3a4a17050 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1208 microversion: 2.1 time: 0.163405 Oct 27 09:29:39.744174 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2753/5450] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:39 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:40.078441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:40.092678 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71af6196-6042-4755-8a37-9cb972f37ecc tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.542811 Oct 27 09:29:40.108195 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2698/5451] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:39 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:40.148242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:40.148878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:40.167265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:40.167789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:40.168766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:40.169478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:40.169934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:40.170367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:40.476432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:40.493260 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-830f41e1-6e50-459e-aac0-b1a00688e68a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1503 microversion: 2.1 time: 0.345371 Oct 27 09:29:40.498495 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2754/5452] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:40 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:40.527470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2bc0c325-0177-498a-a797-e9adfd6f0146 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:40.528734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2bc0c325-0177-498a-a797-e9adfd6f0146 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:40.541223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bc0c325-0177-498a-a797-e9adfd6f0146 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:40.541462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bc0c325-0177-498a-a797-e9adfd6f0146 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:40.541981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bc0c325-0177-498a-a797-e9adfd6f0146 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:40.542644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bc0c325-0177-498a-a797-e9adfd6f0146 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:40.543045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bc0c325-0177-498a-a797-e9adfd6f0146 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:40.544352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:40.545063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:40.552015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2bc0c325-0177-498a-a797-e9adfd6f0146 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:40.565057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:40.567280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:40.568672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:40.572551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:40.573147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:40.573691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:40.625522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:40.690716 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2bc0c325-0177-498a-a797-e9adfd6f0146 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e/action" status: 202 len: 0 microversion: 2.1 time: 0.167301 Oct 27 09:29:40.691752 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2699/5453] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:29:40 2022] POST /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:29:40.700893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:40.701601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:40.729616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:40.730123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:40.730567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:40.736297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:40.736999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:40.737452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:41.054140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a97dd019-f015-4627-9fb4-3ab4a68b826b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1318 microversion: 2.1 time: 0.523774 Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2755/5454] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:40 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:41.202165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:41.235963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:41.252362 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e7bcb11-3b4c-4c76-a483-ebf124bca9c7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1508 microversion: 2.1 time: 0.556237 Oct 27 09:29:41.254793 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2700/5455] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:40 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1508 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:41.358273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:41.358273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:41.358273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:41.358273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:41.358273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:41.358273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:41.358273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:41.358273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:41.505224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:41.539678 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-15babdeb-ac10-4346-9518-2336558ee722 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1260 microversion: 2.1 time: 0.426862 Oct 27 09:29:41.539678 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2756/5456] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:41 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1260 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:42.115662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:42.118068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:42.139326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:42.142491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:42.144561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:42.149739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:42.151019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:42.153607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:42.692164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:42.706083 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ddb42758-be17-44da-8236-a5cf8f7256e9 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 1.449906 Oct 27 09:29:42.707076 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2701/5457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:41 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:42.750146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:42.760645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:42.806536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:42.807277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:42.807868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:42.820137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:42.826678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:42.834111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:43.397488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:43.407753 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9eafbc0c-7cb1-4afc-b2e3-a2c86be40922 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1318 microversion: 2.1 time: 1.298529 Oct 27 09:29:43.428736 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2757/5458] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:42 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1318 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:43.443783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:43.447999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:43.476234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:43.477853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:43.478362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:43.478806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:43.479529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:43.480022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:43.480451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:43.495113 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d9d9eefe-3d7b-4203-87e1-ac7128e8ae4a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1488 microversion: 2.1 time: 0.760372 Oct 27 09:29:43.496260 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2702/5459] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:42 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1488 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:43.521922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:43.522835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:43.536479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:43.537240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:43.538080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:43.538972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:43.540125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:43.544299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:43.630189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lazy-loading 'flavor' on Instance uuid 222bb9b2-8066-4145-a9b2-a797cd414d5e {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:29:44.177602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59bcc32f-fdb6-423b-b00b-33d42fb302a5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e/action" status: 202 len: 0 microversion: 2.1 time: 0.659714 Oct 27 09:29:44.188311 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2703/5460] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:29:43 2022] POST /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:29:44.210966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:44.220690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:44.236079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:44.237340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:44.238087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:44.241163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:44.249204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:44.251240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:45.395860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:45.426302 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-686c8ccf-ce4a-450e-b3f7-925fba7286ed tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1308 microversion: 2.1 time: 1.984609 Oct 27 09:29:45.434652 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2758/5461] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:43 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1308 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:45.460977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:45.463682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:45.495046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:45.506650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:45.508569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:45.513145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:45.514834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:45.516741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:45.533193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:45.545405 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe360cd0-d127-4bca-b17f-5e1e073ee892 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 1.354840 Oct 27 09:29:45.552061 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2704/5462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:44 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:45.581813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:45.594917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:45.633636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:45.653714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:45.657438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:45.659278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:45.666993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:45.669060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:47.561370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:47.573270 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ab89c7aa-c815-46d2-af97-37d824cee51d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1494 microversion: 2.1 time: 2.134700 Oct 27 09:29:47.578168 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2759/5463] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:45 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1494 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:47.599629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b2861f54-6b6e-4c00-afba-107b94b62255 req-c94cd228-f9f8-4787-b36d-63333bf966a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90178e3e-8064-49d5-bd94-5f733fe53d8a", "name": "network-vif-plugged", "status": "completed", "tag": "d55fed31-ab9f-4255-b941-5596c59b9377"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:47.631190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b2861f54-6b6e-4c00-afba-107b94b62255 req-c94cd228-f9f8-4787-b36d-63333bf966a0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:47.638869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b2861f54-6b6e-4c00-afba-107b94b62255 req-c94cd228-f9f8-4787-b36d-63333bf966a0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:47.642620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b2861f54-6b6e-4c00-afba-107b94b62255 req-c94cd228-f9f8-4787-b36d-63333bf966a0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:47.671463 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b2861f54-6b6e-4c00-afba-107b94b62255 req-c94cd228-f9f8-4787-b36d-63333bf966a0 service nova] Creating event network-vif-plugged:d55fed31-ab9f-4255-b941-5596c59b9377 for instance 90178e3e-8064-49d5-bd94-5f733fe53d8a on n-h2-858383-16 Oct 27 09:29:47.678292 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b2861f54-6b6e-4c00-afba-107b94b62255 req-c94cd228-f9f8-4787-b36d-63333bf966a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097080 Oct 27 09:29:47.680622 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2760/5464] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:47.686606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:47.697300 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1860f06e-481d-42d6-9d89-f9c7fd0792b7 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1318 microversion: 2.1 time: 2.141607 Oct 27 09:29:47.702785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:47.704044 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2705/5465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:45 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1318 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:47.716387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:47.716554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:47.717912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:47.724069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:47.724876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:47.725551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:47.726506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:47.729517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:47.733178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:47.739826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:47.740924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:47.741862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:47.742843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:47.743541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:47.750932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:47.788558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:48.809463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:48.817882 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5df15c80-ba4c-472e-8f8f-e75536292011 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 1.112550 Oct 27 09:29:48.818482 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2706/5466] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:47 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:48.834285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:48.848068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:48.850945 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de745fef-59e8-4d91-af4c-4c5e033a2820 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1308 microversion: 2.1 time: 1.168287 Oct 27 09:29:48.851751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:48.853712 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2761/5467] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:47 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1308 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:48.884958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:48.892627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:48.893716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:48.894023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:48.894790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:48.895298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:48.895714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:48.899099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:48.918408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:48.925848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:48.926970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:48.932416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:48.933268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:48.934648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:49.451143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:49.478566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=26 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:49.743769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:49.965480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:49.978184 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-583fe951-2fb0-4f08-8148-91a7e2e16e31 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1318 microversion: 2.1 time: 1.103655 Oct 27 09:29:49.982746 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2762/5468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:48 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1318 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:50.003748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3265555e-4292-4bf2-a72e-83556057c5b2 req-1f09f14c-4989-437f-94c6-00b0cce040b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55191f9f-2b1b-46e7-93bd-5070540d8c4e", "tag": "76cc40c1-8368-4fff-9c39-e87b1994e51e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:50.050010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3265555e-4292-4bf2-a72e-83556057c5b2 req-1f09f14c-4989-437f-94c6-00b0cce040b4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:50.050875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3265555e-4292-4bf2-a72e-83556057c5b2 req-1f09f14c-4989-437f-94c6-00b0cce040b4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:50.051904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3265555e-4292-4bf2-a72e-83556057c5b2 req-1f09f14c-4989-437f-94c6-00b0cce040b4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:50.132441 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3265555e-4292-4bf2-a72e-83556057c5b2 req-1f09f14c-4989-437f-94c6-00b0cce040b4 service nova] Creating event network-changed:76cc40c1-8368-4fff-9c39-e87b1994e51e for instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e on n-h1-858383-16 Oct 27 09:29:50.156012 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3265555e-4292-4bf2-a72e-83556057c5b2 req-1f09f14c-4989-437f-94c6-00b0cce040b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169698 Oct 27 09:29:50.160713 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2763/5469] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:50.181932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:50.190414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:50.226069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:50.228162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:50.237638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:50.243109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:50.248869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:50.249782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:50.295900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:50.307855 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-daeafbf5-21b9-451a-9572-b1440747b3b6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1515 microversion: 2.1 time: 1.486238 Oct 27 09:29:50.328723 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2707/5470] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:48 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1515 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:50.334665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:50.341704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:50.354927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:50.355831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:50.356534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:50.359446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:50.360427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:50.361066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:51.010470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:51.020416 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9bc4b67-818d-444f-9868-fe3595b6a9b2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.857805 Oct 27 09:29:51.021010 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2764/5471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:50 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:51.033265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f6b1e678-19a7-42a5-94cd-a9dd842f568c req-68153665-b6e8-458f-80f3-03e6f693431c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bb9b2-8066-4145-a9b2-a797cd414d5e", "name": "network-vif-plugged", "status": "completed", "tag": "cb3da523-3f15-44f5-a3c8-7eb439acdc40"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:51.074811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f6b1e678-19a7-42a5-94cd-a9dd842f568c req-68153665-b6e8-458f-80f3-03e6f693431c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:51.075309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f6b1e678-19a7-42a5-94cd-a9dd842f568c req-68153665-b6e8-458f-80f3-03e6f693431c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:51.076177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f6b1e678-19a7-42a5-94cd-a9dd842f568c req-68153665-b6e8-458f-80f3-03e6f693431c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:51.110815 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f6b1e678-19a7-42a5-94cd-a9dd842f568c req-68153665-b6e8-458f-80f3-03e6f693431c service nova] Creating event network-vif-plugged:cb3da523-3f15-44f5-a3c8-7eb439acdc40 for instance 222bb9b2-8066-4145-a9b2-a797cd414d5e on n-h1-858383-16 Oct 27 09:29:51.121014 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f6b1e678-19a7-42a5-94cd-a9dd842f568c req-68153665-b6e8-458f-80f3-03e6f693431c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091206 Oct 27 09:29:51.129654 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2765/5472] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:51.138223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:51.139327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:51.149027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:51.149549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:51.150063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:51.151072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:51.151543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:51.152011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:51.242262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:51.253565 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14a12967-45a6-44d5-90d0-c7e5c619a80d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1308 microversion: 2.1 time: 0.923310 Oct 27 09:29:51.270428 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2708/5473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:50 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1308 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:51.336223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:51.337646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:51.353159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:51.353961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:51.358986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:51.369656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:51.371010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:51.381455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:52.191939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:52.216922 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e752a23-3841-48d6-8c98-147604a92e56 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.883817 Oct 27 09:29:52.221243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:52.233767 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2709/5474] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:51 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:52.239525 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-26ad2d9f-8180-418d-8ccd-72c0c3e10056 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1507 microversion: 2.1 time: 1.100638 Oct 27 09:29:52.241141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:52.243029 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2766/5475] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:51 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1507 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:52.246594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:52.264198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:52.267353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:52.267837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:52.269865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:52.270546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:52.271975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:52.272415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:52.273214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:52.284894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:52.291223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:52.292008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:52.293609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:52.294195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:52.294736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:52.780787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:52.805354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:52.805893 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee2cb165-e515-469e-b350-d5c6d568842d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.570626 Oct 27 09:29:52.807213 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2710/5476] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:52 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:52.819972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:52.821914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:52.831417 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e58b0fa8-41fd-49ae-90da-64cc91765b47 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1507 microversion: 2.1 time: 0.563929 Oct 27 09:29:52.832887 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2767/5477] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:52 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1507 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:52.834796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:52.835497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:52.835978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:52.836709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:52.839878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:52.840386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:52.866157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-abf26a8b-97cd-4256-b88a-bc2ebc00579f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:52.879646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-abf26a8b-97cd-4256-b88a-bc2ebc00579f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:52.898822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abf26a8b-97cd-4256-b88a-bc2ebc00579f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:52.899642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abf26a8b-97cd-4256-b88a-bc2ebc00579f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:52.902770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abf26a8b-97cd-4256-b88a-bc2ebc00579f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:52.903920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abf26a8b-97cd-4256-b88a-bc2ebc00579f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:52.904561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abf26a8b-97cd-4256-b88a-bc2ebc00579f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:52.905279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abf26a8b-97cd-4256-b88a-bc2ebc00579f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:53.044685 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-abf26a8b-97cd-4256-b88a-bc2ebc00579f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "PUT /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1079 microversion: 2.1 time: 0.182395 Oct 27 09:29:53.046046 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2768/5478] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 09:29:52 2022] PUT /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1079 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:53.081333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:53.082399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:53.124095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:53.124604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:53.125049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:53.125781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:53.126240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:53.126672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:53.460844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:53.474143 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-865c302e-34e8-4c94-aa48-de7aeb104d3a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1308 microversion: 2.1 time: 0.665372 Oct 27 09:29:53.481194 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2711/5479] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:52 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1308 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:53.490993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:53.492449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:53.505103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:53.510652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:53.518550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:53.520505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:53.536566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:53.537552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:53.538383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:53.546156 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-47646239-5a6d-4a5c-8ea9-d61d32f60d97 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1505 microversion: 2.1 time: 0.481664 Oct 27 09:29:53.561258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2769/5480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:53 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:53.572486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:53.573209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:53.580024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:53.580521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:53.580961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:53.581675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:53.582130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:53.582561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:54.491353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:54.501962 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85dbb80f-c687-43c4-9f3e-593515998bc1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 1.018900 Oct 27 09:29:54.520085 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2712/5481] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:53 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:54.536311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:54.537383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:54.549239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:54.550607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:54.552060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:54.554154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:54.554908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:54.556259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:54.567040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:54.580428 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-672e9fe9-a80c-44d8-89dc-9306203e5c5c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1505 microversion: 2.1 time: 1.012418 Oct 27 09:29:54.581670 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2770/5482] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:53 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1505 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:54.586764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:54.587769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:54.595667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:54.596605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:54.597279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:54.598209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:54.598886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:54.599539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:55.198546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:55.212482 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8650da60-3550-480f-8e7b-4eb6e84d7252 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1308 microversion: 2.1 time: 0.629439 Oct 27 09:29:55.227691 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2771/5483] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:54 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1308 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:55.235219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:55.246838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:55.269317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:55.269745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:55.270249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:55.270997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:55.271471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:55.271945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:55.324182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:55.327841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:55.357331 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-432e9a2c-316c-4d34-9df5-c7a624562c75 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.835543 Oct 27 09:29:55.362681 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2713/5484] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:54 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:55.536549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:55.538115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:55.571617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:55.579744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:55.586347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:55.593280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:55.594246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:55.594934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:56.322600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:56.350351 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ebec01a-2514-4fea-bbbd-0c268a050dbc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.813830 Oct 27 09:29:56.356132 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2714/5485] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:55 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:56.365404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:56.374524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:56.396962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:56.398214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:56.400771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:56.404083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:56.407192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:56.411331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:56.784510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:56.795549 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-39ea37a9-bb76-4a33-9e59-302820841609 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1308 microversion: 2.1 time: 0.437759 Oct 27 09:29:56.803042 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2715/5486] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:56 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:56.821760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:56.822759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:56.837270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:56.838139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:56.838758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:56.843186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:56.843913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:56.844547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:57.200937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:57.212199 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0d514da-bf15-4ed6-a6a9-a75605f67a60 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.406270 Oct 27 09:29:57.235595 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2716/5487] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:56 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:57.379109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:57.379768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:57.394658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:57.398088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:57.400797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:57.404138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:57.405888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:57.408440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:57.823124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:57.840014 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-187205dd-0536-49d0-9cb2-f18bb822ef76 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.464827 Oct 27 09:29:57.846049 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2717/5488] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:57 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:57.854706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:57.859006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:57.879638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:57.880544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:57.881193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:57.882355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:57.883032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:57.883659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:58.366219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:58.404449 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0955a48-fad1-42fa-b4e2-4595a97937ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1308 microversion: 2.1 time: 0.556506 Oct 27 09:29:58.417195 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2718/5489] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:57 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1308 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:58.437885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:58.444915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:58.454326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:58.455347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:58.456448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:58.458398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:58.459105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:58.459715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:58.948892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:58.997109 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0d1cf96-ba45-4c56-b42e-9c04062a83b8 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.563138 Oct 27 09:29:59.000951 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2719/5490] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:58 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:59.028633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-db715e14-5aa9-43c8-a0e0-10c9b54c49d7 req-34818ca6-2ed0-4254-aedc-317da6630692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55191f9f-2b1b-46e7-93bd-5070540d8c4e", "name": "network-vif-plugged", "status": "completed", "tag": "76cc40c1-8368-4fff-9c39-e87b1994e51e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:59.090448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-db715e14-5aa9-43c8-a0e0-10c9b54c49d7 req-34818ca6-2ed0-4254-aedc-317da6630692 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:59.103016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-db715e14-5aa9-43c8-a0e0-10c9b54c49d7 req-34818ca6-2ed0-4254-aedc-317da6630692 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:59.104355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-db715e14-5aa9-43c8-a0e0-10c9b54c49d7 req-34818ca6-2ed0-4254-aedc-317da6630692 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:59.137981 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-db715e14-5aa9-43c8-a0e0-10c9b54c49d7 req-34818ca6-2ed0-4254-aedc-317da6630692 service nova] Creating event network-vif-plugged:76cc40c1-8368-4fff-9c39-e87b1994e51e for instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e on n-h1-858383-16 Oct 27 09:29:59.151302 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-db715e14-5aa9-43c8-a0e0-10c9b54c49d7 req-34818ca6-2ed0-4254-aedc-317da6630692 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146425 Oct 27 09:29:59.159561 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2720/5491] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:59.170268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:59.171200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:59.194985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:59.195656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:59.196451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:59.197219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:59.197701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:59.198214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:59.509453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:29:59.546889 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70afed06-bf6b-4ad2-a194-c29638a8b6c6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.363240 Oct 27 09:29:59.565953 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2721/5492] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:59 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:59.577562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:59.578213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:29:59.607961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:59.608471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:59.608986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:29:59.609716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:29:59.610230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:29:59.622274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:00.018796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:00.052746 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-57ba8b5c-a16f-40bd-b8ee-671dc43e6fb2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1308 microversion: 2.1 time: 0.485426 Oct 27 09:30:00.053614 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2722/5493] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:29:59 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1308 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:00.059204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:00.060292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:00.066350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:00.068608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:00.069550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:00.070590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:00.071534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:00.072657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:00.073249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:00.606903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:00.622918 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67e15baf-4a86-402b-a11a-d3717ae5c03d tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.567788 Oct 27 09:30:00.640031 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2723/5494] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:00 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:00.667175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:00.687089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:00.745806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:00.746323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:00.746869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:00.749624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:00.756863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:00.757440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:01.239018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:01.252619 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8c0c53d-9831-422c-972f-ae138aefb684 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.611163 Oct 27 09:30:01.253452 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2724/5495] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:00 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:01.267198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:01.270188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:01.295012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:01.299146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:01.301789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:01.302906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:01.304312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:01.307549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:01.646035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:01.659192 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e241d417-a901-49b6-b6eb-5309a34260c8 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1489 microversion: 2.1 time: 0.400970 Oct 27 09:30:01.662989 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2725/5496] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:01 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1489 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:01.676858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:01.677878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:01.697793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:01.699175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:01.699857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:01.700775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:01.702056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:01.705458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.074694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:02.084037 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca480405-4023-40cd-a925-df977ebd391e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.417748 Oct 27 09:30:02.084678 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2726/5497] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:01 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:02.104713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:02.123208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:02.151415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.156431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.162276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.163080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.163597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.166448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.468166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:02.478314 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-306fa551-ff2f-40ea-a97e-2a70cddd4418 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1489 microversion: 2.1 time: 0.389414 Oct 27 09:30:02.481198 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2727/5498] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:02 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1489 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:02.489190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:02.490307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:02.499285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.500230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.500942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.502297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.503399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.504412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.597990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:30:02.600392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:30:02.601392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:30:02.602076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:30:02.602775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:30:02.700383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:02.710411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.711373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.712065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.713408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.714197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.715294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.784200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:02.798646 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d0efb0d2-8176-44d4-95de-3c938546f2a0 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "POST /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a/action" status: 202 len: 1111 microversion: 2.1 time: 7.555713 Oct 27 09:30:02.812355 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2772/5499] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:29:55 2022] POST /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a/action => generated 1111 bytes in 7594 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 09:30:02.816057 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5e76c2c-f549-4e5d-9777-1b150fd12e36 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.333191 Oct 27 09:30:02.817170 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2728/5500] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:02 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:02.823121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:02.824155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:02.830285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:02.834209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:02.843625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.844501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.851149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.852087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.852856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.854125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.857392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.858927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.862146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:02.862669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:02.863482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:02.866482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:03.360350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:03.372849 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c10da08-b1a6-4231-9129-8e6b058e95fb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1489 microversion: 2.1 time: 0.559256 Oct 27 09:30:03.387929 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2773/5501] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:02 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1489 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:03.408372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:03.408984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:03.415392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:03.416158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:03.416809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:03.418466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:03.419121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:03.419750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:03.428254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:03.439773 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f302238-4338-4009-aef6-9a09a4952413 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 0.621259 Oct 27 09:30:03.442465 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2729/5502] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:02 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:03.451515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:03.456069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:03.469591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:03.471371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:03.472071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:03.482850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:03.484064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:03.487841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:03.550170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:30:03.585234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:03.625200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:03.634445 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d82abfbd-01c2-4ac3-a8d1-d921073f9827 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.245327 Oct 27 09:30:03.636905 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2774/5503] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:03 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:03.722727 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ecbb76ec-9d92-493a-879c-5acf3944378d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 204 len: 0 microversion: 2.1 time: 0.277465 Oct 27 09:30:03.723157 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2730/5504] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:30:03 2022] DELETE /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:30:03.732044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:03.732666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:03.740205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:03.741319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:03.741947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:03.742878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:03.743615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:03.744249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:03.843989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:03.844949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:03.865235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:03.870896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:03.871656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:03.872604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:03.873238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:03.873849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:04.234809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:04.244034 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5468f73-da30-4eb1-97a1-3b9473281f33 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1495 microversion: 2.1 time: 0.516366 Oct 27 09:30:04.247498 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2775/5505] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:03 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1495 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:04.322358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:04.334028 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a89e5c8d-ec58-4a85-993f-9bdf4a323073 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.494847 Oct 27 09:30:04.334631 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2731/5506] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:03 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:04.471617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:04.472174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:04.521006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:04.525032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:04.529323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:04.531410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:04.533306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:04.535665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:04.673366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:04.674053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:04.725310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:04.726126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:04.726597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:04.727367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:04.728717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:04.729165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:05.107383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:05.110725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:05.118143 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72a58e7f-6200-4a52-89c0-4c62cac17d0e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 0.652047 Oct 27 09:30:05.124682 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2776/5507] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:04 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:05.209446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:05.227967 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4f9aca3-cc30-4dcb-9f53-5caf32241841 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.566370 Oct 27 09:30:05.229022 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2732/5508] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:04 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:05.272124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:05.273031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:05.287956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:05.288464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:05.288918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:05.289638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:05.290279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:05.291710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:05.367410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:05.376448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:05.391919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:05.392994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:05.397469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:05.398875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:05.399611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:05.400594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:06.018137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:06.047228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9dd4c466-f269-453b-8e4b-e4cfb75b91d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1495 microversion: 2.1 time: 0.780252 Oct 27 09:30:06.051243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:06.052272 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2777/5509] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:05 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1495 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:06.088521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-84cafbf1-fdfb-4988-b48b-542e926ee438 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.724897 Oct 27 09:30:06.121039 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2733/5510] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:05 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:06.150408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:06.151887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:06.162755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:06.166038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:06.166714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:06.167732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:06.169535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:06.171153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:06.255028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:06.255692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:06.268491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:06.269104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:06.269916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:06.270754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:06.271126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:06.271554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:06.768968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:06.778720 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5bd1fd23-70a3-4075-9fd6-23bebdd95621 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 0.632248 Oct 27 09:30:06.795795 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2778/5511] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:06 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:06.817769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:06.836768 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-834d6d6e-ea48-468e-8c6c-c6079c4b4f29 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.585604 Oct 27 09:30:06.837891 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2734/5512] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:06 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:07.079114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:07.079761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:07.102918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:07.103715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:07.104330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:07.105775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:07.158210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:07.159414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:07.168582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:07.169135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.063s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:07.175810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:07.176804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:07.177418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:07.178330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:07.179045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:07.179707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:07.840076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:07.852116 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4be11699-2fe2-4cdd-b681-ae597555d758 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.719367 Oct 27 09:30:07.853171 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2735/5513] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:07 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:07.862574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:07.876620 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19b6577f-dbc8-442f-841c-d0d05ffc092d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1495 microversion: 2.1 time: 0.804027 Oct 27 09:30:07.883189 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2779/5514] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:07 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1495 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:07.887785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:07.893725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:07.902579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:07.910569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:07.914883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:07.916575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:07.917640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:07.923986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:07.924931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:07.926816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:07.929009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:07.935250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:07.936878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:07.938056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:07.945189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:07.947290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:09.126337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:09.136271 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01a3e1bc-0983-45b2-a9ec-e831b0ffd2ab tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 1.280656 Oct 27 09:30:09.137089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:09.149857 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2736/5515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:07 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:09.171505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-08f4934b-99df-4812-8f23-da7d53ab3c32 req-ee37b510-1179-495d-9e82-579739e20879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55191f9f-2b1b-46e7-93bd-5070540d8c4e", "name": "network-vif-deleted", "tag": "76cc40c1-8368-4fff-9c39-e87b1994e51e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:09.176797 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-804fc0b9-6345-40cd-b0c1-e2cf6c5e415e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 1.285788 Oct 27 09:30:09.194933 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2780/5516] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:07 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:09.197364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-08f4934b-99df-4812-8f23-da7d53ab3c32 req-ee37b510-1179-495d-9e82-579739e20879 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:09.200197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-08f4934b-99df-4812-8f23-da7d53ab3c32 req-ee37b510-1179-495d-9e82-579739e20879 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:09.201806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-08f4934b-99df-4812-8f23-da7d53ab3c32 req-ee37b510-1179-495d-9e82-579739e20879 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:09.225536 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-08f4934b-99df-4812-8f23-da7d53ab3c32 req-ee37b510-1179-495d-9e82-579739e20879 service nova] Creating event network-vif-deleted:76cc40c1-8368-4fff-9c39-e87b1994e51e for instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e on n-h1-858383-16 Oct 27 09:30:09.229272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:09.241665 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-08f4934b-99df-4812-8f23-da7d53ab3c32 req-ee37b510-1179-495d-9e82-579739e20879 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090198 Oct 27 09:30:09.249533 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2737/5517] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:09.252349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:09.269460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:09.270487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:09.278806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:09.281051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:09.281810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:09.290261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:09.291046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:09.292774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:09.293473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:09.294444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:09.297724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:09.298669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:09.299060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:09.301457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:09.388486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:09.392048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:09.395294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:09.397641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lazy-loading 'fault' on Instance uuid 55191f9f-2b1b-46e7-93bd-5070540d8c4e {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:30:09.512165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:09.526958 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2e41adf-083a-449f-bf00-8434263adc0c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 200 len: 1298 microversion: 2.1 time: 0.275803 Oct 27 09:30:09.527868 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2738/5518] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:09 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 1298 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:09.700038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:09.714934 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-055a0755-9efd-4b49-823b-ca5e1331d560 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.518557 Oct 27 09:30:09.715546 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2781/5519] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:09 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:10.178548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:10.182409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:10.217820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:10.218953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:10.220612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:10.221518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:10.222333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:10.227543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=63 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:10.234549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:10.235408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:10.236113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:10.260405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:10.261748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:10.262556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:10.275950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:10.279969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:10.281724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:10.727911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:10.748825 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-188a0d0a-b421-4236-a815-662ff45f7314 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.539110 Oct 27 09:30:10.762617 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2782/5520] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:10 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:10.788281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:10.796837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:10.854202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:10.859005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:10.860872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:10.863664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:10.864141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:10.864580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:10.930383 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e HTTP/1.1 Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '55191f9f-2b1b-46e7-93bd-5070540d8c4e'} Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:10.935883 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:10.941404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:10.941404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:10.941404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:10.941404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:10.941404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:10.941404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:30:10.941404 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:10.943049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:10.944096 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e71bed70-053d-422d-816f-f5465803f530 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 404 len: 111 microversion: 2.1 time: 0.179606 Oct 27 09:30:10.944714 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2783/5521] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:10 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:30:10.952145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:10.957091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:10.981187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:10.982314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:10.982834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:10.986854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:10.987483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:10.988199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:11.031433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:11.049304 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b8c3bc0-fed8-46fc-883e-fe5d2cc5d27a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 0.873412 Oct 27 09:30:11.066999 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2739/5522] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:10 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:11.075757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0cdfe2f9-59de-4864-9fce-77c9e966094a req-2897c5ae-8757-406d-aa69-c0abb184e76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f35f23-0b67-4a55-8c3e-3950fac6b97a", "name": "network-vif-plugged", "status": "completed", "tag": "fe701430-2ee5-4174-b187-9c3bbd60c9e6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:11.088366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0cdfe2f9-59de-4864-9fce-77c9e966094a req-2897c5ae-8757-406d-aa69-c0abb184e76c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:11.089816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0cdfe2f9-59de-4864-9fce-77c9e966094a req-2897c5ae-8757-406d-aa69-c0abb184e76c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:11.090506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0cdfe2f9-59de-4864-9fce-77c9e966094a req-2897c5ae-8757-406d-aa69-c0abb184e76c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:11.109792 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0cdfe2f9-59de-4864-9fce-77c9e966094a req-2897c5ae-8757-406d-aa69-c0abb184e76c service nova] Creating event network-vif-plugged:fe701430-2ee5-4174-b187-9c3bbd60c9e6 for instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a on n-h1-858383-16 Oct 27 09:30:11.118385 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0cdfe2f9-59de-4864-9fce-77c9e966094a req-2897c5ae-8757-406d-aa69-c0abb184e76c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049346 Oct 27 09:30:11.119331 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2740/5523] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:11.125946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:11.140393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:11.152630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:11.153574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:11.154903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:11.155984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:11.156727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:11.157392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:11.215534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:30:11.506077 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d23bd1bd-1fd4-4895-8238-f2f319389f3c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 204 len: 0 microversion: 2.1 time: 0.382966 Oct 27 09:30:11.514756 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2741/5524] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:30:11 2022] DELETE /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:30:11.527977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:11.532573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:11.546926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:11.547845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:11.550224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:11.552969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:11.553472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:11.556492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:11.691881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:11.704729 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5accc3b1-c360-4e16-a180-f90a90665138 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.758757 Oct 27 09:30:11.709566 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2784/5525] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:10 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:11.786265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:11.787171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:11.822913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:11.825382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:11.826147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:11.827408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:11.828013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:11.828460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:12.144531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:12.166027 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b4c04d7-609f-4a30-885f-82ce0d73f5ca tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1495 microversion: 2.1 time: 0.649104 Oct 27 09:30:12.175421 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2742/5526] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:11 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1495 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:12.176265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:12.186207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:12.210507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:12.216533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:12.218660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:12.219640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:12.220276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:12.220859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:12.640304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:12.653602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-688526d8-7454-4665-b1a9-acb8f7dc5fef tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 0.483291 Oct 27 09:30:12.664261 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2743/5527] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:12 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:12.720952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:12.735145 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0391c41e-30ee-455b-8b42-f20c0953c5e5 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.961452 Oct 27 09:30:12.744619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:12.744619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:12.755142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:12.755142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:12.755142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:12.755142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:12.755142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:12.755142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:12.759385 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2785/5528] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:11 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:13.193421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:13.204710 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc1f070a-8c44-4cde-aabd-cc4cd5016d6c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 0.471797 Oct 27 09:30:13.228757 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2744/5529] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:12 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:13.247666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:13.248298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:13.255215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:13.256044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:13.256640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:13.257534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:13.258003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:13.258438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:13.680094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:13.680900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:13.697783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:13.698931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:13.715378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:13.716501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:13.718418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:13.719071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:13.771375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:14.862139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:14.879550 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-92ab71a7-4962-4ab3-808a-a61f64de114b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1495 microversion: 2.1 time: 1.650203 Oct 27 09:30:14.891679 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2786/5530] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:13 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1495 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:14.897111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:14.897239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:14.923467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:14.924014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:14.924473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:14.925201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:14.925667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:14.927492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:14.977220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:14.988963 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e5941a5-8bba-4875-a1fe-a6418c1decee tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 1.312678 Oct 27 09:30:14.989578 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2745/5531] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:13 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:15.484510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:15.493206 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc8bad95-9d64-43ee-9935-f676770cc056 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1517 microversion: 2.1 time: 0.607671 Oct 27 09:30:15.493580 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2787/5532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:14 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1517 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:15.803468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:15.805104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:15.816364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:15.848870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:15.850011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:15.851328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:15.855210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-634657a0-2b1c-4fcb-9e2c-1ef1d1882ccc req-06628ac5-7f1c-4703-aa65-c86c2b143225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e68043a-aca2-4e06-9a37-6f4f20abdf3d", "name": "network-vif-deleted", "tag": "7c31d462-60d0-4a26-83cb-ea9e2151742e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:15.855832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:15.860235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:15.893284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-634657a0-2b1c-4fcb-9e2c-1ef1d1882ccc req-06628ac5-7f1c-4703-aa65-c86c2b143225 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:15.894802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-634657a0-2b1c-4fcb-9e2c-1ef1d1882ccc req-06628ac5-7f1c-4703-aa65-c86c2b143225 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:15.896115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-634657a0-2b1c-4fcb-9e2c-1ef1d1882ccc req-06628ac5-7f1c-4703-aa65-c86c2b143225 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:15.917280 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-634657a0-2b1c-4fcb-9e2c-1ef1d1882ccc req-06628ac5-7f1c-4703-aa65-c86c2b143225 service nova] Creating event network-vif-deleted:7c31d462-60d0-4a26-83cb-ea9e2151742e for instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d on n-h2-858383-16 Oct 27 09:30:15.945665 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-634657a0-2b1c-4fcb-9e2c-1ef1d1882ccc req-06628ac5-7f1c-4703-aa65-c86c2b143225 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091511 Oct 27 09:30:15.946852 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2788/5533] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:15.982559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:15.988864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:16.014010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:16.016320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:16.019017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:16.021368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:16.024490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:16.026990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:16.249201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:16.259766 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5ac4450-321a-4123-a9d2-68a720dcbef9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 200 len: 1293 microversion: 2.1 time: 0.304816 Oct 27 09:30:16.275615 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2789/5534] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:15 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 1293 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:16.290364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:16.292676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:16.314648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:16.321785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:16.324973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:16.325917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:16.334233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:16.334813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:16.412920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:16.434686 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-99092022-c16c-4bf1-9701-0c1ae23f8dff tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1510 microversion: 2.1 time: 1.444004 Oct 27 09:30:16.444581 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2746/5535] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:14 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1510 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:16.516997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:16.517920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:16.533927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:16.537187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:16.541059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:16.545353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:16.556723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:16.568866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:16.609945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:16.619109 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-09a8f04a-a882-4d50-a786-33567ff54ebb tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 0.352518 Oct 27 09:30:16.635137 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2790/5536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:16 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:16.842105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:16.852791 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1593f7c-39d0-49bc-91a0-a0f61894d8ce tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.340100 Oct 27 09:30:16.853960 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2747/5537] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:16 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:16.894791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:16.895625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:16.914292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:16.914794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:16.915749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:16.915978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:16.916722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:16.917162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:17.279486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:17.286560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:17.287515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:17.287999 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64e3d11e-3874-4ffb-b771-99a716b78295 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.399124 Oct 27 09:30:17.289085 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2791/5538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:16 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:17.295497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:17.296243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:17.296849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:17.297745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:17.298367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:17.298952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:17.328961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:17.329863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:17.350894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:17.351401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:17.351934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:17.352661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:17.353148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:17.353572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:17.359424 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d HTTP/1.1 Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7e68043a-aca2-4e06-9a37-6f4f20abdf3d'} Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:17.361690 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:17.366300 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:17.366300 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:17.366300 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:17.366300 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:17.366300 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:17.366300 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:30:17.366300 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:17.366300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:17.366300 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebdb91c4-28e9-4232-a52c-b6916edcd3bc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 404 len: 111 microversion: 2.1 time: 0.080834 Oct 27 09:30:17.370387 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2748/5539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:17 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:30:17.470450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:17.471132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:17.483079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:17.483745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:17.484425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:17.485328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:17.486038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:17.488115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:17.710580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:17.722888 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f3c6161-2eab-4554-aa05-c6e72ee63acd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.397830 Oct 27 09:30:17.723476 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2792/5540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:17 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:17.749056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2053945060", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7a475c77-fcd2-4475-b72a-44ef10abc15a"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:17.853778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:17.865707 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91aeee55-16c4-49ce-9802-dc756bd8da2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1507 microversion: 2.1 time: 0.399291 Oct 27 09:30:17.866893 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2749/5541] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:17 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:17.891001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:17.891751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:17.906160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] validate_networks() for [('7a475c77-fcd2-4475-b72a-44ef10abc15a', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:30:17.910215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:17.911185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:17.912855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:17.913779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:17.926433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:17.928516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:18.269600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:18.283622 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87e3b6f7-46dc-4d94-bc30-a240c9567e44 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 0.415295 Oct 27 09:30:18.284517 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2750/5542] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:17 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:18.290376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53de254e-e32f-44e5-8626-6802ccfc02f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:18.310126 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-53de254e-e32f-44e5-8626-6802ccfc02f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance 081797bc-ba1e-43cd-9f96-28035b4df943 has no mapping to a cell. Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53de254e-e32f-44e5-8626-6802ccfc02f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/081797bc-ba1e-43cd-9f96-28035b4df943/action HTTP/1.1 Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 15 Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: {"os-stop": {}} Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 081797bc-ba1e-43cd-9f96-28035b4df943 has no mapping to a cell. Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '081797bc-ba1e-43cd-9f96-28035b4df943', 'body': {'os-stop': {}}} Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 081797bc-ba1e-43cd-9f96-28035b4df943 has no mapping to a cell. Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:18.317854 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081797bc-ba1e-43cd-9f96-28035b4df943 has no mapping to a cell. Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081797bc-ba1e-43cd-9f96-28035b4df943 has no mapping to a cell. Oct 27 09:30:18.321794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:18.323715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53de254e-e32f-44e5-8626-6802ccfc02f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance 081797bc-ba1e-43cd-9f96-28035b4df943 has no mapping to a cell. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:18.331107 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53de254e-e32f-44e5-8626-6802ccfc02f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/081797bc-ba1e-43cd-9f96-28035b4df943/action" status: 404 len: 117 microversion: 2.1 time: 0.045052 Oct 27 09:30:18.336725 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2751/5543] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:18 2022] POST /compute/v2.1/servers/081797bc-ba1e-43cd-9f96-28035b4df943/action => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:30:18.349869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:18.350936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:18.359507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:18.360458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:18.361130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:18.362235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:18.363026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:18.363704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:18.629293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:30:18.629711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:30:18.630181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:30:18.630582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:30:18.630986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:30:18.634235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:18.644629 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f28c23b6-9219-4ccb-a5ec-75a3fc2d9b19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.306416 Oct 27 09:30:18.646408 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2752/5544] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:18 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:18.661523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:18.669289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:18.670021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:18.671067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:18.671785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:18.672450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:18.674298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:18.674872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:18.686743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:18.687270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:18.689602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:18.690894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:18.692255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:30:18.692826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:18.693365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:18.698364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for user 993f47058e6d48f7ac30138be91496c5 and project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:30:18.712342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:30:18.715607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:30:18.778694 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dea4549f-401f-4c3a-be1d-03c7ad914ff3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041682 Oct 27 09:30:18.784772 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2793/5545] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:30:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:30:18.803947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-032521f9-b0f8-4854-b8eb-1d7b6f2834aa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:18.805703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-032521f9-b0f8-4854-b8eb-1d7b6f2834aa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:18.914411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-032521f9-b0f8-4854-b8eb-1d7b6f2834aa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:18.929022 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-032521f9-b0f8-4854-b8eb-1d7b6f2834aa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1209 microversion: 2.1 time: 0.136877 Oct 27 09:30:18.931732 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2794/5546] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:18 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:18.936935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:18.938480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:18.953527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:18.964440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:18.964987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:18.965924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:18.968579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:18.969029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:19.033916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:19.059156 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-808a10c2-5185-48e8-97ac-5c03b7fb6301 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.389010 Oct 27 09:30:19.062804 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2753/5547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:18 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:19.102851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-042a0b85-33e7-4515-9976-e12e2de45410 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:19.103904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-042a0b85-33e7-4515-9976-e12e2de45410 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d2fe7ab2-b9b2-4102-a818-8b92790cd1a9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:19.120874 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-042a0b85-33e7-4515-9976-e12e2de45410 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance d2fe7ab2-b9b2-4102-a818-8b92790cd1a9 could not be found. Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-042a0b85-33e7-4515-9976-e12e2de45410 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/d2fe7ab2-b9b2-4102-a818-8b92790cd1a9/action HTTP/1.1 Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 15 Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: {"suspend": {}} Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d2fe7ab2-b9b2-4102-a818-8b92790cd1a9 could not be found. Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd2fe7ab2-b9b2-4102-a818-8b92790cd1a9', 'body': {'suspend': {}}} Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2fe7ab2-b9b2-4102-a818-8b92790cd1a9 could not be found. Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2fe7ab2-b9b2-4102-a818-8b92790cd1a9 could not be found. Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:19.124920 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:19.129036 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:19.129036 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:19.129036 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2fe7ab2-b9b2-4102-a818-8b92790cd1a9 could not be found. Oct 27 09:30:19.129036 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:19.131335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-042a0b85-33e7-4515-9976-e12e2de45410 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance d2fe7ab2-b9b2-4102-a818-8b92790cd1a9 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:19.134651 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-042a0b85-33e7-4515-9976-e12e2de45410 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d2fe7ab2-b9b2-4102-a818-8b92790cd1a9/action" status: 404 len: 111 microversion: 2.1 time: 0.047087 Oct 27 09:30:19.137908 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2754/5548] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:19 2022] POST /compute/v2.1/servers/d2fe7ab2-b9b2-4102-a818-8b92790cd1a9/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:30:19.150017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:19.150943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:19.169249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:19.172015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:19.173677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:19.174594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:19.176135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:19.178028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:19.390960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:19.402994 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-53e63c6f-9b3b-4de0-9ee1-e89da4b8a2ab tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1507 microversion: 2.1 time: 0.470018 Oct 27 09:30:19.403954 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2795/5549] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:18 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:19.416047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:19.420405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:19.437863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:19.445123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:19.445873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:19.453133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:19.453955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:19.454893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:19.530488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:19.539854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:19.563810 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e20c8591-a9aa-4685-8457-67760c1028bf tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.421912 Oct 27 09:30:19.569500 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2755/5550] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:19 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:19.605727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:19.606592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:19.623051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:19.625650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:19.626227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:19.627062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:19.627961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:19.630485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:19.984879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:20.009307 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80e75c2c-91e2-4dda-942c-9c5be6f79b98 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1516 microversion: 2.1 time: 0.596776 Oct 27 09:30:20.010820 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2796/5551] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:19 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1516 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:20.024096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:20.025367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:20.045859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:20.046389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.047715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.048803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.058418 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61bec94b-6e3a-4609-8d22-271373a2e2f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.461814 Oct 27 09:30:20.076071 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2756/5552] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:19 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:20.078291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.079747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.082171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.090426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:20.090968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:20.103321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.103859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.107821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.116649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.117385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.117989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.160949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lazy-loading 'flavor' on Instance uuid d8f35f23-0b67-4a55-8c3e-3950fac6b97a {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:30:20.210431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:20.228745 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-808589ac-3661-485e-b617-7f909e4e8217 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1205 microversion: 2.1 time: 0.215650 Oct 27 09:30:20.231986 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2797/5553] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:20 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1205 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:20.292773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a6f2117d-8f07-4684-9840-50981922ad72 req-36e73a93-ab03-4f8f-8463-887d963f928e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bb9b2-8066-4145-a9b2-a797cd414d5e", "name": "network-vif-unplugged", "status": "completed", "tag": "cb3da523-3f15-44f5-a3c8-7eb439acdc40"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:20.318446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a6f2117d-8f07-4684-9840-50981922ad72 req-36e73a93-ab03-4f8f-8463-887d963f928e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.339124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a6f2117d-8f07-4684-9840-50981922ad72 req-36e73a93-ab03-4f8f-8463-887d963f928e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.342477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a6f2117d-8f07-4684-9840-50981922ad72 req-36e73a93-ab03-4f8f-8463-887d963f928e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.396591 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3fced01-d9fe-4888-931e-899c8e2601a4 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 202 len: 0 microversion: 2.1 time: 0.307761 Oct 27 09:30:20.404486 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2757/5554] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:20 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:30:20.407302 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a6f2117d-8f07-4684-9840-50981922ad72 req-36e73a93-ab03-4f8f-8463-887d963f928e service nova] Creating event network-vif-unplugged:cb3da523-3f15-44f5-a3c8-7eb439acdc40 for instance 222bb9b2-8066-4145-a9b2-a797cd414d5e on n-h1-858383-16 Oct 27 09:30:20.426036 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a6f2117d-8f07-4684-9840-50981922ad72 req-36e73a93-ab03-4f8f-8463-887d963f928e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137988 Oct 27 09:30:20.427077 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2798/5555] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:20.432846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:20.433879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:20.442589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.443477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.443858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:20.444546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.444668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:20.445833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.446605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.447293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.471245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.471814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.472370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.479364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.482446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.485225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.811173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:20.841090 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7397a914-ec02-42c7-b1a4-4fe23fd5dfc4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 200 len: 1450 microversion: 2.1 time: 0.412455 Oct 27 09:30:20.842258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2799/5556] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:20 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 1450 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:20.866271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:20.866923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:20.880307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.881216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.882025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.883200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:20.883921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:20.884814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:20.963435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:20.973232 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f3878e9-5ad6-49eb-b51d-8a208c0bf537 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1512 microversion: 2.1 time: 0.564375 Oct 27 09:30:20.974548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2758/5557] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:20 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1512 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:21.042647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:21.045358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:21.062006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:21.064090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:21.066301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:21.067251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:21.071894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:21.072419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:21.271740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:21.284275 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-392ebaaf-2e69-4109-9685-fdc185a2a048 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.422819 Oct 27 09:30:21.290362 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2800/5558] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:20 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:21.325820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:21.327194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:21.342691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:21.343901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:21.347609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:21.349072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:21.351547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:21.352895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:21.493318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:21.504644 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5234107b-2581-40cc-85eb-b0061aa2bda6 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1522 microversion: 2.1 time: 0.470274 Oct 27 09:30:21.507085 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2759/5559] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:21 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:21.517843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:21.522764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:21.533106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:21.533746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:21.534275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:21.535138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:21.535770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:21.536277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:21.661510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:21.671355 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-67d9793e-23e7-4529-b1f5-73090ebbe0cd tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1269 microversion: 2.1 time: 0.379664 Oct 27 09:30:21.671991 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2801/5560] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:21 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1269 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:21.930455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:21.944618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc3f57c1-b63c-458e-9e65-59e31c7af85c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.432416 Oct 27 09:30:21.945364 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2760/5561] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:21 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:21.971782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:21.972634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:21.985401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:21.986156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:21.986778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:21.987694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:21.988314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:21.988897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:21.996127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:21.997046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:22.011926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:22.022193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:22.022957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:22.024410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:22.032394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:22.032857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:22.344555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:22.356764 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a0007eb-6f09-41f6-b0d3-5060d140dc59 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1495 microversion: 2.1 time: 0.364602 Oct 27 09:30:22.372584 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2761/5562] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:21 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1495 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:22.392076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:22.392076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:22.401395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:22.408917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:22.409611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:22.410639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:22.411769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:22.412425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:22.468143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lazy-loading 'flavor' on Instance uuid d8f35f23-0b67-4a55-8c3e-3950fac6b97a {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:30:22.513841 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Cannot 'suspend' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state suspended Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action HTTP/1.1 Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 15 Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: {"suspend": {}} Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: exception: Cannot 'suspend' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state suspended Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a', 'body': {'suspend': {}}} Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a in vm_state suspended. Cannot suspend while the instance is in this state. Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 27 09:30:22.518447 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state suspended Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state suspended Oct 27 09:30:22.522778 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:22.529198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 409 to user: Cannot 'suspend' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state suspended {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:22.531900 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b4077f1-3d45-4478-9455-3f9a047a2449 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 409 len: 148 microversion: 2.1 time: 0.145472 Oct 27 09:30:22.544007 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2762/5563] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:22 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 148 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:30:22.556626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:22.557794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:22.586497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:22.587009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:22.587459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:22.588269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:22.588734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:22.592697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:22.618280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:22.759388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:22.770085 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-39199d45-0fb7-41b8-b987-197cd43846d4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.802087 Oct 27 09:30:22.771500 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2802/5564] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:21 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:22.781388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c77fe8d6-55c0-41c1-bfce-bf505202af19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:22.782577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c77fe8d6-55c0-41c1-bfce-bf505202af19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:22.795392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c77fe8d6-55c0-41c1-bfce-bf505202af19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:22.796068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c77fe8d6-55c0-41c1-bfce-bf505202af19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:22.796603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c77fe8d6-55c0-41c1-bfce-bf505202af19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:22.797430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c77fe8d6-55c0-41c1-bfce-bf505202af19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:22.797973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c77fe8d6-55c0-41c1-bfce-bf505202af19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:22.798641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c77fe8d6-55c0-41c1-bfce-bf505202af19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:22.913846 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c77fe8d6-55c0-41c1-bfce-bf505202af19 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 202 len: 0 microversion: 2.1 time: 0.140340 Oct 27 09:30:22.914512 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2803/5565] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:22 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:30:22.925193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:22.945324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:23.000294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:23.003207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:23.003915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:23.004962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:23.006272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:23.008360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:23.183712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:23.196810 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad0c0f22-d42b-4f95-8469-98b986224c3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1522 microversion: 2.1 time: 0.651184 Oct 27 09:30:23.197408 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2763/5566] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:22 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1522 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:23.202335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:23.211170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:23.226254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:23.227028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:23.227633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:23.228501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:23.229714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:23.230147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:23.453513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:23.465702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-440efeaf-d1db-4580-808f-26f451cebd0b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1309 microversion: 2.1 time: 0.549643 Oct 27 09:30:23.467341 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2804/5567] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:22 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1309 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:23.477829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:23.478701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:23.493104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:23.500382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:23.501105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:23.504302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:23.504938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:23.505526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:24.524316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:24.539857 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-095589c9-1896-4213-9f7f-17af71b7389d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 1.340928 Oct 27 09:30:24.540469 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2764/5568] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:23 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:24.570222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-dae9cd74-1ba4-42e4-a7cc-7a9f8d539669 req-c957c332-52cd-4844-abfa-ad2bd8c18a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90178e3e-8064-49d5-bd94-5f733fe53d8a", "name": "network-vif-unplugged", "status": "completed", "tag": "d55fed31-ab9f-4255-b941-5596c59b9377"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:24.583542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-dae9cd74-1ba4-42e4-a7cc-7a9f8d539669 req-c957c332-52cd-4844-abfa-ad2bd8c18a7a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:24.584348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-dae9cd74-1ba4-42e4-a7cc-7a9f8d539669 req-c957c332-52cd-4844-abfa-ad2bd8c18a7a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:24.584990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-dae9cd74-1ba4-42e4-a7cc-7a9f8d539669 req-c957c332-52cd-4844-abfa-ad2bd8c18a7a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:24.591790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:24.602060 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5dba1e8-3129-47e4-91a1-ddde1585a2a6 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1501 microversion: 2.1 time: 1.133284 Oct 27 09:30:24.603491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2805/5569] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:23 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1501 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:24.610857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:24.611874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:24.622328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:24.623972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:24.625266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:24.626342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:24.627205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:24.627910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:24.631169 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-dae9cd74-1ba4-42e4-a7cc-7a9f8d539669 req-c957c332-52cd-4844-abfa-ad2bd8c18a7a service nova] Creating event network-vif-unplugged:d55fed31-ab9f-4255-b941-5596c59b9377 for instance 90178e3e-8064-49d5-bd94-5f733fe53d8a on n-h2-858383-16 Oct 27 09:30:24.643633 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-dae9cd74-1ba4-42e4-a7cc-7a9f8d539669 req-c957c332-52cd-4844-abfa-ad2bd8c18a7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083210 Oct 27 09:30:24.646684 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2765/5570] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:24.657806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2c7c3504-8ac9-417a-8412-4640d486318c req-911c47b9-cdb3-4e7b-a453-29fc4eb547d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d8c34f-411b-482d-9b7d-d21353f09769", "tag": "8886f394-3b28-4e4d-8b57-1ea74c4035e3"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:24.663124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:24.689324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2c7c3504-8ac9-417a-8412-4640d486318c req-911c47b9-cdb3-4e7b-a453-29fc4eb547d3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:24.692330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2c7c3504-8ac9-417a-8412-4640d486318c req-911c47b9-cdb3-4e7b-a453-29fc4eb547d3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:24.693025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2c7c3504-8ac9-417a-8412-4640d486318c req-911c47b9-cdb3-4e7b-a453-29fc4eb547d3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:24.722750 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2c7c3504-8ac9-417a-8412-4640d486318c req-911c47b9-cdb3-4e7b-a453-29fc4eb547d3 service nova] Creating event network-changed:8886f394-3b28-4e4d-8b57-1ea74c4035e3 for instance 91d8c34f-411b-482d-9b7d-d21353f09769 on n-h1-858383-16 Oct 27 09:30:24.732049 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2c7c3504-8ac9-417a-8412-4640d486318c req-911c47b9-cdb3-4e7b-a453-29fc4eb547d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083862 Oct 27 09:30:24.737342 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2766/5571] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:24.752211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:24.753678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:24.768149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:24.769666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:24.772640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:24.773837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:24.774509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:24.775125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:25.011118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:25.022796 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99d58e63-9e21-486c-ae79-6b8f41ec036a tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1522 microversion: 2.1 time: 0.416510 Oct 27 09:30:25.030573 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2806/5572] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:24 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:25.036217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d0faecb-c1bb-4a0b-9649-6e73a65e9e4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:25.047076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d0faecb-c1bb-4a0b-9649-6e73a65e9e4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:25.051729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d0faecb-c1bb-4a0b-9649-6e73a65e9e4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:25.053320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d0faecb-c1bb-4a0b-9649-6e73a65e9e4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:25.110998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8d0faecb-c1bb-4a0b-9649-6e73a65e9e4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Going to try to stop instance {{(pid=120602) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:30:25.204747 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d0faecb-c1bb-4a0b-9649-6e73a65e9e4c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.172269 Oct 27 09:30:25.205923 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2807/5573] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:25 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:30:25.215473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:25.216465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:25.227346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:25.228079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:25.230050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:25.231010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:25.231924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:25.232548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:25.376372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:25.386366 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13d4ded3-e7c8-4858-b903-b01ab2e6af63 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1309 microversion: 2.1 time: 0.644552 Oct 27 09:30:25.387452 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2767/5574] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:24 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1309 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:25.529855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:25.548815 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9e059e59-6fb8-476e-b02a-ea5ebb402fc5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.336318 Oct 27 09:30:25.551025 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2808/5575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:25 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:25.629618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:25.630399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:25.637104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:25.638097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:25.638849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:25.639899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:25.640599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:25.641255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:25.980329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:25.988210 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-05c7b9b6-3c83-43ce-9cc1-a1beac03ede3 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1501 microversion: 2.1 time: 0.362669 Oct 27 09:30:25.990046 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2768/5576] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:25 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1501 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:26.061888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:26.064695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:26.112648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:26.113154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:26.113594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:26.114396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:26.114858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:26.115282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:26.323354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:26.337375 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86bed7b2-e33d-4094-8015-40866f52f658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1522 microversion: 2.1 time: 0.282814 Oct 27 09:30:26.338290 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2809/5577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:26 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:26.413347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:26.414106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:26.422993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:26.423789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:26.424489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:26.425443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:26.426146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:26.426803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:26.530066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93d42134-b14b-4cfd-bb97-0a20ee468f5f tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Action: 'create', calling method: .version_select at 0x7f31a949fd30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-799152563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJGD+1+25brufOiis7HZTGqrdhFgoBt4K9teKxm8P8XzSq6RAt3094zRlGy93u3lLoPxmJlt6C639+t7agcR2oL14xv30kko4Koc0/AWlnX7BgZvW6MF6Mei/ok9qFClg=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:26.552143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-93d42134-b14b-4cfd-bb97-0a20ee468f5f tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Getting quotas for project e82508c6b5aa427eb96983ffde2a63ae. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:30:26.560072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-93d42134-b14b-4cfd-bb97-0a20ee468f5f tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Getting quotas for user 0ed1067cc8c9463ba493811eaf51c1f0 and project e82508c6b5aa427eb96983ffde2a63ae. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:30:26.579884 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [None req-93d42134-b14b-4cfd-bb97-0a20ee468f5f tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [e73a6fbf-08ce-4173-adca-11259d20346d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 09:30:26.680978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:26.690225 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87f233f8-6bc5-46c2-a5da-999f7e185356 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1309 microversion: 2.1 time: 0.281544 Oct 27 09:30:26.690980 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2769/5578] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:26 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1309 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:26.696356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:26.697060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:26.703999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:26.704757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:26.705673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:26.706807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:26.707433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:26.707894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:26.936618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:26.944854 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-acee6dcb-9862-41b7-bdc7-60b9e4685bb1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.252569 Oct 27 09:30:26.945440 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2770/5579] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:26 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:26.950680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-339f3022-3069-47d3-90ab-185dd362fb31 req-4f37583f-7d98-4f9d-8ab9-b7f85dbb9507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90178e3e-8064-49d5-bd94-5f733fe53d8a", "name": "network-vif-plugged", "status": "completed", "tag": "d55fed31-ab9f-4255-b941-5596c59b9377"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:26.964372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-339f3022-3069-47d3-90ab-185dd362fb31 req-4f37583f-7d98-4f9d-8ab9-b7f85dbb9507 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:26.965053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-339f3022-3069-47d3-90ab-185dd362fb31 req-4f37583f-7d98-4f9d-8ab9-b7f85dbb9507 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:26.965653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-339f3022-3069-47d3-90ab-185dd362fb31 req-4f37583f-7d98-4f9d-8ab9-b7f85dbb9507 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:26.983038 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-339f3022-3069-47d3-90ab-185dd362fb31 req-4f37583f-7d98-4f9d-8ab9-b7f85dbb9507 service nova] Creating event network-vif-plugged:d55fed31-ab9f-4255-b941-5596c59b9377 for instance 90178e3e-8064-49d5-bd94-5f733fe53d8a on n-h2-858383-16 Oct 27 09:30:26.989201 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-339f3022-3069-47d3-90ab-185dd362fb31 req-4f37583f-7d98-4f9d-8ab9-b7f85dbb9507 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042346 Oct 27 09:30:26.990299 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2771/5580] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:27.024201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:27.025075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:27.046831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:27.047316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:27.047816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:27.048651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:27.049127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:27.049553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:27.478110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:27.493480 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0afe915-be28-4a6e-8c79-7eaae9cb706e tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1501 microversion: 2.1 time: 0.480575 Oct 27 09:30:27.495349 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2772/5581] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:27 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1501 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:27.502039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:27.503193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:27.517364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:27.518241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:27.518920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:27.521025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:27.522606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:27.523329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:27.589431 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [None req-93d42134-b14b-4cfd-bb97-0a20ee468f5f tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [e73a6fbf-08ce-4173-adca-11259d20346d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37858. Oct 27 09:30:27.622920 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-93d42134-b14b-4cfd-bb97-0a20ee468f5f tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 1.096589 Oct 27 09:30:27.624080 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2810/5582] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:30:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:27.716745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:27.718287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:27.735682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:27.736315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:27.736790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:27.743031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:27.743546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:27.744052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:27.864521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:27.883396 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef08019d-ca3d-48e0-aaa7-f963213d4d3e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1522 microversion: 2.1 time: 0.386647 Oct 27 09:30:27.885247 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2773/5583] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:27 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:27.972005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:27.972960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:27.983896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:27.984754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:27.990453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:27.991557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:27.994717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:27.995516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:28.102514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:28.114836 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b0e6e7c9-c245-4847-a828-00daeceb2905 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1309 microversion: 2.1 time: 0.404315 Oct 27 09:30:28.115811 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2811/5584] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:27 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:28.346629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:28.359731 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efdd351b-a350-47b1-b451-91e56c1d2234 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.391482 Oct 27 09:30:28.406083 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2774/5585] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:27 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:28.518792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:28.520888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:28.532805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:28.533311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:28.533758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:28.534483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:28.534946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:28.535384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:28.681168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:28.772240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:28.780650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:28.788146 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79350027-4749-41e6-8c67-8345cd4dda14 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.275141 Oct 27 09:30:28.818929 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2812/5586] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:28 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:28.825160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:28.826132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:28.834320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:28.835215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:28.836149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:28.837477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:28.838232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:28.839134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:28.920494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:28.921398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:28.930266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:28.931357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:28.932618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:28.933998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:28.934730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:28.935682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:29.264548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:29.278856 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-832fb9c4-0ce3-44bf-b54b-299b854b35e0 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.457910 Oct 27 09:30:29.288139 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2775/5587] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:28 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:29.294150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:29.295172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:29.313359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:29.319470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:29.320225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:29.321158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:29.321659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:29.322080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:29.353108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:29.365095 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b28406b-a174-484a-ac62-d83abce344d1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1522 microversion: 2.1 time: 0.457176 Oct 27 09:30:29.365716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2813/5588] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:28 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:29.373671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f90e1b9-c0cc-4bcc-bd3d-b3a1ecff5202 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:29.374429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6f90e1b9-c0cc-4bcc-bd3d-b3a1ecff5202 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: f4820f36-7830-4c1f-ab60-c9ea95589e86] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:29.383322 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6f90e1b9-c0cc-4bcc-bd3d-b3a1ecff5202 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance f4820f36-7830-4c1f-ab60-c9ea95589e86 could not be found. Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f90e1b9-c0cc-4bcc-bd3d-b3a1ecff5202 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/f4820f36-7830-4c1f-ab60-c9ea95589e86/action HTTP/1.1 Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 15 Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: {"unpause": {}} Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f4820f36-7830-4c1f-ab60-c9ea95589e86 could not be found. Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f4820f36-7830-4c1f-ab60-c9ea95589e86', 'body': {'unpause': {}}} Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4820f36-7830-4c1f-ab60-c9ea95589e86 could not be found. Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4820f36-7830-4c1f-ab60-c9ea95589e86 could not be found. Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:29.387633 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:29.392175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:29.392175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:29.392175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4820f36-7830-4c1f-ab60-c9ea95589e86 could not be found. Oct 27 09:30:29.392175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:29.404807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f90e1b9-c0cc-4bcc-bd3d-b3a1ecff5202 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance f4820f36-7830-4c1f-ab60-c9ea95589e86 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:29.407394 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f90e1b9-c0cc-4bcc-bd3d-b3a1ecff5202 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/f4820f36-7830-4c1f-ab60-c9ea95589e86/action" status: 404 len: 111 microversion: 2.1 time: 0.040653 Oct 27 09:30:29.408583 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2814/5589] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:29 2022] POST /compute/v2.1/servers/f4820f36-7830-4c1f-ab60-c9ea95589e86/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:30:29.419150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:29.425010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:29.434536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:29.437312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:29.438004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:29.438917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:29.439545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:29.440158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:29.659715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:29.669554 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f256ca3-28a1-4406-aeb7-a28a5c1a71fa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1309 microversion: 2.1 time: 0.380175 Oct 27 09:30:29.670327 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2776/5590] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:29 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1309 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:29.694069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:29.695027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:29.703099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:29.703917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:29.704510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:29.705420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:29.706331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:29.706917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:29.804559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:29.821237 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-03e48534-3797-4001-959d-40a7aec66ce4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.401651 Oct 27 09:30:29.821912 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2815/5591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:29 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:29.989295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:30.009744 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb7d6a7b-048a-4a5a-a3b7-604c5fb82d78 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.322813 Oct 27 09:30:30.012857 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2777/5592] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:29 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:30.042628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:30.043693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:30.051500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:30.056298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:30.059347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:30.063362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:30.064190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:30.065170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:30.395061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:30.396802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:30.409071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:30.425824 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5fb17324-5320-4a85-aed2-e4c41fcca4a1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.391322 Oct 27 09:30:30.426432 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2816/5593] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:30 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:30.428510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:30.429500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:30.430101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:30.432062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:30.432827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:30.433532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:30.453873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:30.457998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:30.469660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:30.470758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:30.471420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:30.472634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:30.473503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:30.476517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:30.572973 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Cannot 'unpause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action HTTP/1.1 Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 15 Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: {"unpause": {}} Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: exception: Cannot 'unpause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a', 'body': {'unpause': {}}} Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a in vm_state active. Cannot unpause while the instance is in this state. Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:30.577096 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:30.580815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:30.580815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:30.580815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:30.580815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:30:30.580815 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:30.581290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 409 to user: Cannot 'unpause' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:30.582880 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4bedd2c0-31d4-4817-91a6-a3d797d51889 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 409 len: 145 microversion: 2.1 time: 0.136795 Oct 27 09:30:30.586478 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2817/5594] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:30 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 145 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:30:30.606833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:30.608522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:30.626798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:30.627547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:30.628070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:30.631032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:30.631782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:30.633613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:30.875700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:30.886064 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-03291110-6f0d-4167-89fe-837220a20739 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1507 microversion: 2.1 time: 0.496106 Oct 27 09:30:30.888065 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2778/5595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:30 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:30.897100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-219705104", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c2fd29da-535e-4664-856b-e562babe1249", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-799152563", "security_groups": [{"name": "tempest-secgroup-smoke-1915686121"}], "networks": [{"uuid": "6b97c3e3-0389-4eb1-bcd2-0195c59f47e1"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:31.064464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:31.084982 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a3d16210-3f27-413c-8dba-5c944598af84 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.492560 Oct 27 09:30:31.093380 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2818/5596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:30 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:31.102142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:31.108601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:31.136411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:31.145736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:31.147099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:31.150348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:31.152061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:31.156791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:31.158759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:31.212055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] validate_networks() for [('6b97c3e3-0389-4eb1-bcd2-0195c59f47e1', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:30:31.940740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:31.978883 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f1746df4-8381-4e78-85f7-e96d2c3e7234 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1309 microversion: 2.1 time: 0.883099 Oct 27 09:30:31.986876 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2819/5597] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:31 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1309 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:32.006197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:32.007732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:32.032491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:32.032491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:32.032491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:32.033113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:32.033666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:32.034301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:32.404792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:32.421075 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2576dd8c-b9be-4fd9-8c68-06e07838589c tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.432403 Oct 27 09:30:32.450770 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2820/5598] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:31 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:32.465246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:32.465863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:32.484302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:32.484808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:32.485484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:32.486395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:32.487038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:32.487684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:32.705850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:30:32.706460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:30:32.707353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:30:32.708013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:30:32.708865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:30:32.731766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:32.732613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:32.733247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:32.735071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:32.736001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:32.736645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:32.757365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:32.772144 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2abd833e-aef3-4751-81d6-7c44f992db66 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 200 len: 1507 microversion: 2.1 time: 0.317088 Oct 27 09:30:32.776029 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2821/5599] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:32 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:32.782297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Getting quotas for project e82508c6b5aa427eb96983ffde2a63ae. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:30:32.783040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:32.784012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:32.794540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:32.795136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:32.796006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:32.796984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:32.797297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:32.797796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:32.803134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Getting quotas for user 0ed1067cc8c9463ba493811eaf51c1f0 and project e82508c6b5aa427eb96983ffde2a63ae. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:30:32.975822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:30:32.985345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2fd29da-535e-4664-856b-e562babe1249',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:30:33.027870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:33.041134 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d1d17e5-ccf8-4467-b431-e6ec3e4748f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.263819 Oct 27 09:30:33.051707 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2822/5600] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:32 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:33.051707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-75f7fa9d-a654-4d7b-a06f-970104f37143 req-fbd791c9-c017-42ca-8574-d27ff32d3cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d8c34f-411b-482d-9b7d-d21353f09769", "name": "network-vif-plugged", "status": "completed", "tag": "8886f394-3b28-4e4d-8b57-1ea74c4035e3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:33.062016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-75f7fa9d-a654-4d7b-a06f-970104f37143 req-fbd791c9-c017-42ca-8574-d27ff32d3cf3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:33.062736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-75f7fa9d-a654-4d7b-a06f-970104f37143 req-fbd791c9-c017-42ca-8574-d27ff32d3cf3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:33.063328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-75f7fa9d-a654-4d7b-a06f-970104f37143 req-fbd791c9-c017-42ca-8574-d27ff32d3cf3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:33.087411 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-75f7fa9d-a654-4d7b-a06f-970104f37143 req-fbd791c9-c017-42ca-8574-d27ff32d3cf3 service nova] Creating event network-vif-plugged:8886f394-3b28-4e4d-8b57-1ea74c4035e3 for instance 91d8c34f-411b-482d-9b7d-d21353f09769 on n-h1-858383-16 Oct 27 09:30:33.094171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-75f7fa9d-a654-4d7b-a06f-970104f37143 req-fbd791c9-c017-42ca-8574-d27ff32d3cf3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050536 Oct 27 09:30:33.097597 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2823/5601] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:33.106307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:33.108955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:33.122860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:33.123787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:33.124456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:33.125345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:33.125947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:33.126521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:33.166610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:30:33.256711 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-919db163-3453-4912-8aaa-d53693a0a952 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.367196 Oct 27 09:30:33.258228 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2779/5602] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:30:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 2369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:30:33.263967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:33.265419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:33.274529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:33.276027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:33.276760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:33.277734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:33.278486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:33.279310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:33.367424 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-390ccf81-06e0-4816-bc18-0d291b6b7259 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "DELETE /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 204 len: 0 microversion: 2.1 time: 0.265411 Oct 27 09:30:33.369633 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2824/5603] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:30:33 2022] DELETE /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:30:33.382736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51d668e3-8e22-4bb2-8eea-50bcdc7c648b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:33.383780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-51d668e3-8e22-4bb2-8eea-50bcdc7c648b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: 74bececf-f55c-4c16-aa2f-2519da59269f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:33.394548 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-51d668e3-8e22-4bb2-8eea-50bcdc7c648b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance 74bececf-f55c-4c16-aa2f-2519da59269f could not be found. Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51d668e3-8e22-4bb2-8eea-50bcdc7c648b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/74bececf-f55c-4c16-aa2f-2519da59269f/action HTTP/1.1 Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 18 Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: {"unshelve": null} Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 74bececf-f55c-4c16-aa2f-2519da59269f could not be found. Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '74bececf-f55c-4c16-aa2f-2519da59269f', 'body': {'unshelve': None}} Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74bececf-f55c-4c16-aa2f-2519da59269f could not be found. Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74bececf-f55c-4c16-aa2f-2519da59269f could not be found. Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:33.396445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:33.401282 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:33.401282 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:33.401282 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:33.401282 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:33.401282 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:33.401282 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:33.401282 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74bececf-f55c-4c16-aa2f-2519da59269f could not be found. Oct 27 09:30:33.401282 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:33.403821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51d668e3-8e22-4bb2-8eea-50bcdc7c648b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance 74bececf-f55c-4c16-aa2f-2519da59269f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:33.406952 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-51d668e3-8e22-4bb2-8eea-50bcdc7c648b tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/74bececf-f55c-4c16-aa2f-2519da59269f/action" status: 404 len: 111 microversion: 2.1 time: 0.030904 Oct 27 09:30:33.411548 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2825/5604] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:33 2022] POST /compute/v2.1/servers/74bececf-f55c-4c16-aa2f-2519da59269f/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:30:33.427682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a11e8aa5-7bad-41ca-8d4a-ac513eb58012 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:33.428533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a11e8aa5-7bad-41ca-8d4a-ac513eb58012 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:33.571641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a11e8aa5-7bad-41ca-8d4a-ac513eb58012 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:33.591097 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a11e8aa5-7bad-41ca-8d4a-ac513eb58012 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1097 microversion: 2.1 time: 0.172299 Oct 27 09:30:33.591789 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2826/5605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:33 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1097 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:33.610570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:33.613584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:33.630852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:33.631673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:33.632334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:33.633097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:33.633564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:33.633987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:33.663603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:33.673473 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bad40daa-4262-426e-aeaf-3a6a988774f7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1309 microversion: 2.1 time: 0.413774 Oct 27 09:30:33.676753 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2780/5606] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:33 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1309 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:33.684657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:33.689970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:33.702843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:33.703361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:33.703858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:33.704609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:33.706595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:33.707205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:34.048466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:34.059158 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d21b70b4-383a-445e-b25c-c85093c9f451 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.466232 Oct 27 09:30:34.061141 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2827/5607] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:33 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:34.070612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1491838174", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "ae09c0e3-851a-4f89-a19f-2ab607592cdc"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:34.097617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:34.111783 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f4826b0-c2a3-45cf-9579-7326f83eaf8a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.429680 Oct 27 09:30:34.112419 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2781/5608] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:33 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:34.138047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:34.139515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:34.147420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:34.150018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:34.151344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:34.152973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:34.154224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] validate_networks() for [('ae09c0e3-851a-4f89-a19f-2ab607592cdc', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:30:34.155036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:34.155755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:34.191429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:34.515729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:34.539463 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c4b27c3-2f9d-456f-9318-ee040abad2ae tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.408366 Oct 27 09:30:34.542293 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2782/5609] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:34 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:34.567010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:34.567833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:34.580511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:34.582958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:34.583670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:34.584572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:34.585037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:34.585467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:34.674820 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Cannot 'unshelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action HTTP/1.1 Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 18 Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: {"unshelve": null} Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: exception: Cannot 'unshelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a', 'body': {'unshelve': None}} Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a in vm_state active. Cannot unshelve while the instance is in this state. Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:30:34.677304 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active Oct 27 09:30:34.681296 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:30:34.683714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 409 to user: Cannot 'unshelve' instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a while it is in vm_state active {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:34.684751 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b980d671-85a0-4a4a-9014-0b2014c1e293 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action" status: 409 len: 146 microversion: 2.1 time: 0.122961 Oct 27 09:30:34.686600 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2783/5610] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:34 2022] POST /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a/action => generated 146 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:30:34.700212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:34.703036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:34.721817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:34.724656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:34.725381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:34.726369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:34.731485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:34.732267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:34.856642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:34.870672 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71b60f01-01dd-4303-93dd-e1ed4c04f4db tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1139 microversion: 2.1 time: 0.178946 Oct 27 09:30:34.871977 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2784/5611] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:34 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1139 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:34.886359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:34.887317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:34.904305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:34.905455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:34.907628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:34.908638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:34.910793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:34.913848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:35.244132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:30:35.245271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:30:35.245971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:30:35.246637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:30:35.247289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:30:35.268231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:35.268948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:35.271148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:35.272305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:35.274933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:35.276296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:35.340180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Getting quotas for project 085f1c568af5494c99a7ff3dd488f76a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:30:35.361288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Getting quotas for user 8d122762f6a446279f6cdc0e66ab5daf and project 085f1c568af5494c99a7ff3dd488f76a. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:30:35.392547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:30:35.394940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:30:35.489427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:35.504466 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01c34cfa-3db9-4fad-9449-a55f083dde38 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.629265 Oct 27 09:30:35.508139 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2785/5612] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:34 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:35.522251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:35.530716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:35.533220 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-60a79ba7-15a0-4511-8b50-19a76988c348 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464052 Oct 27 09:30:35.536691 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2828/5613] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:30:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:30:35.552018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:35.553528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:35.563322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:35.564117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:35.564955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:35.565854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:35.566692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:35.567384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:35.574868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:35.576736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:35.579680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:35.580431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:35.580906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:35.581345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:36.281524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:36.339650 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fb433a6-2acd-4de4-a287-e27949b67e7c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1491 microversion: 2.1 time: 0.829614 Oct 27 09:30:36.341347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:36.350379 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-144314b7-a291-4f04-96b4-155b825321e5 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1677 microversion: 2.1 time: 0.810035 Oct 27 09:30:36.350788 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2786/5614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:35 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1491 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:36.358508 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2829/5615] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:35 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1677 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:36.378767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:36.379418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9514be05-abf0-4735-99a5-deb3bac02658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:36.379897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:36.384455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9514be05-abf0-4735-99a5-deb3bac02658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:36.399277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:36.400268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:36.401666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:36.403878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:36.405852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:36.406753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:36.755431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9514be05-abf0-4735-99a5-deb3bac02658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:36.792464 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9514be05-abf0-4735-99a5-deb3bac02658 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1218 microversion: 2.1 time: 0.420513 Oct 27 09:30:36.816535 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2787/5616] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:36 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1218 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:36.848135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:36.849408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:36.893964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:36.894850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:36.895707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:36.896710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:36.897429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:36.898228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:37.032549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:37.045756 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36cc6d09-6ded-4e5d-9cb7-486b0223b26c tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1213 microversion: 2.1 time: 0.216289 Oct 27 09:30:37.048954 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2788/5617] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:36 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:37.060413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fe1255d-2de4-4a56-a767-8021cfc4af31 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:37.070447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fe1255d-2de4-4a56-a767-8021cfc4af31 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:37.092505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fe1255d-2de4-4a56-a767-8021cfc4af31 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:37.094126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fe1255d-2de4-4a56-a767-8021cfc4af31 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:37.096810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fe1255d-2de4-4a56-a767-8021cfc4af31 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:37.098000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fe1255d-2de4-4a56-a767-8021cfc4af31 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:37.099184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fe1255d-2de4-4a56-a767-8021cfc4af31 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:37.101119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fe1255d-2de4-4a56-a767-8021cfc4af31 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:37.178635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:37.219602 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0afed836-b64e-40a2-ac4c-a67f0532fa81 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.859708 Oct 27 09:30:37.222358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2830/5618] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:36 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:37.249669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b96e280d-2eef-4b71-8972-4e29a3691cd7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-986038717_updated"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:37.254837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b96e280d-2eef-4b71-8972-4e29a3691cd7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: 5b7eef89-a771-49a8-8b93-8e501364e056] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:37.278118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-b96e280d-2eef-4b71-8972-4e29a3691cd7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance 5b7eef89-a771-49a8-8b93-8e501364e056 could not be found. Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b96e280d-2eef-4b71-8972-4e29a3691cd7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/servers/5b7eef89-a771-49a8-8b93-8e501364e056 HTTP/1.1 Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 80 Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-986038717_updated"}} Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 5b7eef89-a771-49a8-8b93-8e501364e056 could not be found. Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5b7eef89-a771-49a8-8b93-8e501364e056', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-986038717_updated'}}} Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b7eef89-a771-49a8-8b93-8e501364e056 could not be found. Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 27 09:30:37.281277 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b7eef89-a771-49a8-8b93-8e501364e056 could not be found. Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b7eef89-a771-49a8-8b93-8e501364e056 could not be found. Oct 27 09:30:37.284979 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:37.289704 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5fe1255d-2de4-4a56-a767-8021cfc4af31 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "PUT /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1086 microversion: 2.1 time: 0.237226 Oct 27 09:30:37.292937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b96e280d-2eef-4b71-8972-4e29a3691cd7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance 5b7eef89-a771-49a8-8b93-8e501364e056 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:37.293373 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2789/5619] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 09:30:37 2022] PUT /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1086 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:37.296051 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b96e280d-2eef-4b71-8972-4e29a3691cd7 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "PUT /compute/v2.1/servers/5b7eef89-a771-49a8-8b93-8e501364e056" status: 404 len: 111 microversion: 2.1 time: 0.053716 Oct 27 09:30:37.298969 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2831/5620] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 09:30:37 2022] PUT /compute/v2.1/servers/5b7eef89-a771-49a8-8b93-8e501364e056 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:30:37.321524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:37.323923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:37.325172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:37.328192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:37.352365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:37.353550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:37.354522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:37.355184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:37.355815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:37.356499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:37.357837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:37.358630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:37.359622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:37.360582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:37.361757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:37.364169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:38.107965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:38.124471 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c00d794-d48a-4d78-8b01-5dcf74bb6e57 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1512 microversion: 2.1 time: 0.810661 Oct 27 09:30:38.151287 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2790/5621] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:37 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1512 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:38.160965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:38.165062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:38.183676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:38.183676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:38.184117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:38.184847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:38.194278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:38.194860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:38.214634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:38.238361 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fcebdcd2-0b0b-41f3-8422-4551fbcd7776 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.924479 Oct 27 09:30:38.239051 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2832/5622] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:37 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:38.270011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6f749fee-411d-45a4-9ef3-39de876faee7 req-2ca805e4-0203-4146-bf69-f74036328778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90178e3e-8064-49d5-bd94-5f733fe53d8a", "name": "network-vif-deleted", "tag": "d55fed31-ab9f-4255-b941-5596c59b9377"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:38.310477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6f749fee-411d-45a4-9ef3-39de876faee7 req-2ca805e4-0203-4146-bf69-f74036328778 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:38.311025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6f749fee-411d-45a4-9ef3-39de876faee7 req-2ca805e4-0203-4146-bf69-f74036328778 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:38.318425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6f749fee-411d-45a4-9ef3-39de876faee7 req-2ca805e4-0203-4146-bf69-f74036328778 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:38.366299 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6f749fee-411d-45a4-9ef3-39de876faee7 req-2ca805e4-0203-4146-bf69-f74036328778 service nova] Creating event network-vif-deleted:d55fed31-ab9f-4255-b941-5596c59b9377 for instance 90178e3e-8064-49d5-bd94-5f733fe53d8a on n-h2-858383-16 Oct 27 09:30:38.394609 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6f749fee-411d-45a4-9ef3-39de876faee7 req-2ca805e4-0203-4146-bf69-f74036328778 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135881 Oct 27 09:30:38.396220 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2833/5623] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:38.411846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:38.413598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:38.423529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:38.424633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:38.425667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:38.426744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:38.427469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:38.428158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:38.434093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:38.830149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:38.860117 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fabba574-9aa5-4078-84ab-710f2b683b1e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1276 microversion: 2.1 time: 0.458494 Oct 27 09:30:38.861233 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2834/5624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:38 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1276 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:38.882070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:38.886807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:38.916998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:38.919501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:38.921310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:38.922708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:38.926501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:38.928604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:38.994358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:39.013287 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d932a23-704a-4718-bd2b-b41259628e06 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1654 microversion: 2.1 time: 0.860316 Oct 27 09:30:39.014867 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2791/5625] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:38 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1654 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:39.034611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:39.038803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:39.077097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:39.082356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:39.083221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:39.085942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:39.087104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:39.091180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:39.475715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:39.501985 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4731ef9e-f346-48bf-aaee-d98d51f3e182 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1281 microversion: 2.1 time: 0.635812 Oct 27 09:30:39.503163 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2835/5626] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:38 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1281 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:39.516102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:39.525838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:39.559851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:39.561448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:39.563418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:39.564601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:39.566079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:39.567225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:39.608669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:39.624756 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23d9ad0f-1b7f-4c63-b2a3-b889357bd2ec tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1512 microversion: 2.1 time: 0.606480 Oct 27 09:30:39.635600 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2792/5627] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:39 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1512 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:39.654563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff2ed1a5-47a7-4676-8f24-06340299ac2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:39.676566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff2ed1a5-47a7-4676-8f24-06340299ac2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:39.680409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff2ed1a5-47a7-4676-8f24-06340299ac2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:39.681650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff2ed1a5-47a7-4676-8f24-06340299ac2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:39.752539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff2ed1a5-47a7-4676-8f24-06340299ac2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Going to try to start instance {{(pid=120603) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 09:30:39.874825 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff2ed1a5-47a7-4676-8f24-06340299ac2e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.227806 Oct 27 09:30:39.885151 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2793/5628] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:39 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:30:39.965255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:39.970476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:39.993507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:39.995469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:39.996057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:39.997352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:40.001400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:40.002664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:40.003481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:40.013595 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-247eee75-a879-4179-9c04-9e69071b9277 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.509061 Oct 27 09:30:40.020685 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2836/5629] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:39 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:40.032950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:40.033877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:40.097516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:40.098534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:40.099398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:40.100754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:40.101839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:40.102728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:40.104717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:30:40.279497 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f91e1d7d-2891-4f50-a470-bb199e3cfb86 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 204 len: 0 microversion: 2.1 time: 0.380857 Oct 27 09:30:40.282646 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2794/5630] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:30:39 2022] DELETE /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:30:40.296767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:40.297511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:40.331813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:40.332327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:40.333854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:40.334697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:40.335185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:40.346998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:40.831342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:40.870965 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-128eec11-1e8a-4a0c-9ee1-ae85c827f11c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1276 microversion: 2.1 time: 0.848065 Oct 27 09:30:40.871615 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2837/5631] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:40 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1276 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16411aab-b7dc-435b-9152-eb819c451e53 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16411aab-b7dc-435b-9152-eb819c451e53 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a HTTP/1.1 Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 280 Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 27 09:30:40.883860 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16411aab-b7dc-435b-9152-eb819c451e53 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:40.886810 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16411aab-b7dc-435b-9152-eb819c451e53 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "PUT /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 400 len: 619 microversion: 2.1 time: 0.009254 Oct 27 09:30:40.893452 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2838/5632] 10.222.0.25 () {60 vars in 1257 bytes} [Thu Oct 27 09:30:40 2022] PUT /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:30:40.903911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:40.905644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:40.936028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:40.936918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:40.937576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:40.938697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:40.952549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:40.952549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:41.610677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:41.645669 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd03d1df-00c4-4566-ba9f-e4b636388b5b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1663 microversion: 2.1 time: 1.361058 Oct 27 09:30:41.647334 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2795/5633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:40 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1663 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:41.658962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:41.662329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:41.677988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:41.679055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:41.680189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:41.681518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:41.682348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:41.683299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:41.771816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:41.801885 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-053c47f3-9a3d-4fa0-a92e-e5a5dacbfdf1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1518 microversion: 2.1 time: 0.892160 Oct 27 09:30:41.803295 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2839/5634] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:40 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1518 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:41.816694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:41.817860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:41.826268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:41.828279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:41.829697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:41.831310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:41.832057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:41.834740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:42.444715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:42.454921 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c2280c5c-11c4-49ac-9276-8eca4e2462ac tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1281 microversion: 2.1 time: 0.805220 Oct 27 09:30:42.459448 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2796/5635] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:41 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1281 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:42.471867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:42.472495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:42.489687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:42.493420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:42.494673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:42.497915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:42.501043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:42.501834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:42.512823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:42.752255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:42.763198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:42.771754 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-11768aa4-48e0-4090-a488-b6f537c3e742 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.964253 Oct 27 09:30:42.776332 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2840/5636] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:41 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:42.803106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:42.804053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:42.822259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:42.823140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:42.834233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:42.834233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:42.844455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:42.845089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:43.471886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:43.491291 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c482a7c8-9073-416e-be64-48800f72a902 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1318 microversion: 2.1 time: 1.027203 Oct 27 09:30:43.492206 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2797/5637] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:42 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:43.495361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:43.504004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:43.508139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:43.518697 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1dc32c1d-5d59-41da-859f-91a6e2aac52b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1663 microversion: 2.1 time: 0.738162 Oct 27 09:30:43.521349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:43.524222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:43.525549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:43.525738 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2841/5638] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:42 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1663 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:43.528382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:43.529328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:43.536286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:43.538056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:43.538921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:43.558623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:43.559421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:43.560358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:43.561337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:43.572421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:43.572883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:44.440144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:44.448894 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-71bed13b-3cb0-4ffd-91be-f00d535b4688 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1518 microversion: 2.1 time: 0.921764 Oct 27 09:30:44.449491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2842/5639] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:43 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1518 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:44.464042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:44.465311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:44.479559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:44.483894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:44.484545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:44.486750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:44.487927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:44.490241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:44.553030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:44.573208 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42bb89d7-6d15-4641-a01f-ea3bf1b4fcd2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 1.079516 Oct 27 09:30:44.583009 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2798/5640] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:43 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:44.607464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f12f8f30-6b52-4de6-993f-c2e5ef4991fd req-0be2b0f9-b136-496d-b46d-f3432c3906b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9a91c4-0af7-4057-9057-10e1f096b507", "tag": "09aae92a-6611-4dc3-a6bc-3ac924a97948"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:44.669957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f12f8f30-6b52-4de6-993f-c2e5ef4991fd req-0be2b0f9-b136-496d-b46d-f3432c3906b1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:44.670465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f12f8f30-6b52-4de6-993f-c2e5ef4991fd req-0be2b0f9-b136-496d-b46d-f3432c3906b1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:44.670913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f12f8f30-6b52-4de6-993f-c2e5ef4991fd req-0be2b0f9-b136-496d-b46d-f3432c3906b1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:44.702433 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f12f8f30-6b52-4de6-993f-c2e5ef4991fd req-0be2b0f9-b136-496d-b46d-f3432c3906b1 service nova] Creating event network-changed:09aae92a-6611-4dc3-a6bc-3ac924a97948 for instance aa9a91c4-0af7-4057-9057-10e1f096b507 on n-h2-858383-16 Oct 27 09:30:44.707711 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f12f8f30-6b52-4de6-993f-c2e5ef4991fd req-0be2b0f9-b136-496d-b46d-f3432c3906b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121530 Oct 27 09:30:44.708657 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2799/5641] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:44.720353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:44.725406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:44.726386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:44.735172 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8124f944-2efe-437a-a9b0-79f8d3938dec tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1281 microversion: 2.1 time: 0.279562 Oct 27 09:30:44.736403 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2843/5642] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:44 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:44.741601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:44.742434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:44.753238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:44.753985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:44.755282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:44.756125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:44.756495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:44.757944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:44.758947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:44.760154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:44.760861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:44.761066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:44.761794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:44.763123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.155646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:45.168551 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-09cf931a-0b43-4ca8-91fb-1b4d5d93db1a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.430790 Oct 27 09:30:45.170447 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2844/5643] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:44 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:45.171282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:45.178807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fdc517bb-688e-4a88-bdaa-5895d8edfcaa tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fdc517bb-688e-4a88-bdaa-5895d8edfcaa tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: request: PUT /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a HTTP/1.1 Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 24 Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: {"server": {"name": ""}} Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a', 'body': {'server': {'name': ''}}} Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '' Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:30:45.183078 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 27 09:30:45.187428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:45.189618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fdc517bb-688e-4a88-bdaa-5895d8edfcaa tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:45.190708 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fdc517bb-688e-4a88-bdaa-5895d8edfcaa tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "PUT /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 400 len: 108 microversion: 2.1 time: 0.019076 Oct 27 09:30:45.192044 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2845/5644] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 09:30:45 2022] PUT /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:30:45.194490 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ad31dab-2812-4d01-87ce-4946c294e717 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1318 microversion: 2.1 time: 0.484370 Oct 27 09:30:45.197901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-4745f848-781d-46f7-8afe-bb666ab1390a req-978c4a69-9a13-4f4f-905f-e8278e92f655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d8c34f-411b-482d-9b7d-d21353f09769", "name": "network-vif-deleted", "tag": "8886f394-3b28-4e4d-8b57-1ea74c4035e3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:45.201284 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2800/5645] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:44 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:45.206376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:45.206993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:45.219936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.220435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.220881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.221601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.222016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4745f848-781d-46f7-8afe-bb666ab1390a req-978c4a69-9a13-4f4f-905f-e8278e92f655 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.222141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.222477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.222596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4745f848-781d-46f7-8afe-bb666ab1390a req-978c4a69-9a13-4f4f-905f-e8278e92f655 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.222934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4745f848-781d-46f7-8afe-bb666ab1390a req-978c4a69-9a13-4f4f-905f-e8278e92f655 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.234291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-4745f848-781d-46f7-8afe-bb666ab1390a req-978c4a69-9a13-4f4f-905f-e8278e92f655 service nova] Creating event network-vif-deleted:8886f394-3b28-4e4d-8b57-1ea74c4035e3 for instance 91d8c34f-411b-482d-9b7d-d21353f09769 on n-h1-858383-16 Oct 27 09:30:45.241514 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-4745f848-781d-46f7-8afe-bb666ab1390a req-978c4a69-9a13-4f4f-905f-e8278e92f655 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047881 Oct 27 09:30:45.243792 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2846/5646] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:45.253166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:45.253869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:45.261043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.274029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.275270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.276294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.276923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.277498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.316603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:45.385907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=20 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:45.538655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:45.556056 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3d58d81e-998c-4157-8701-aa68996b7e98 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1504 microversion: 2.1 time: 0.306700 Oct 27 09:30:45.558295 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2847/5647] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:45 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:45.571359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:45.575178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:45.584345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:45.591307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.591842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.593076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.593794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.594247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.594670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.600639 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fffdedd3-b37f-4f5c-8eb3-9e0faf6edc08 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.397879 Oct 27 09:30:45.601426 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2801/5648] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:45 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:45.651964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:45.653762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:45.665822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.666950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.667988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.669444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.670460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.671448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.694525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:45.695015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:45.695455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:45.696367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lazy-loading 'fault' on Instance uuid 91d8c34f-411b-482d-9b7d-d21353f09769 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:30:46.013472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:46.021836 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-70ec2ac4-eb8a-4f09-a9c3-f54c17f3d4eb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 200 len: 1320 microversion: 2.1 time: 0.461309 Oct 27 09:30:46.030124 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2848/5649] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:45 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:46.039458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:46.040109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:46.071754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:46.072378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:46.072834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:46.073585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:46.074042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:46.074468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:46.177637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:46.193237 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-90506db3-80cc-4e2c-8094-9a5c715b105a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.545155 Oct 27 09:30:46.215733 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2802/5650] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:45 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:46.248110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:46.251005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:46.274520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:46.276147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:46.277793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:46.285020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:46.285753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:46.286691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:46.346799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:46.356682 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c571149c-3bb5-4b38-9e6a-733c3c5253f5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1281 microversion: 2.1 time: 0.325305 Oct 27 09:30:46.357603 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2849/5651] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:46 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1281 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:46.375531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:46.386813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:46.393853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:46.394349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:46.394786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:46.395498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:46.395983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:46.408956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:46.729247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:46.745850 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59aeb060-593c-4066-8d5c-4d0b5f458808 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.523404 Oct 27 09:30:46.746960 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2803/5652] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:46 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:46.769371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:46.770569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:46.777046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:46.779117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:46.780010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:46.780929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:46.781859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:46.782485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:46.783075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:46.785504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:46.819020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:46.832380 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1cd02d3a-1860-4758-8dea-4d763499598f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1318 microversion: 2.1 time: 0.472396 Oct 27 09:30:46.852100 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2850/5653] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:46 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:46.971920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0bc1e3a2-a7ef-468a-8074-f37cd97da6c0 req-d4f33a59-d9c6-458b-bcd4-e96e598b6df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "190fc59b-248a-4259-8531-def6afcde4ed", "tag": "8dab394f-f2b0-4c3f-abc6-83c31c8f2aaa"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:46.996142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0bc1e3a2-a7ef-468a-8074-f37cd97da6c0 req-d4f33a59-d9c6-458b-bcd4-e96e598b6df7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:47.000399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0bc1e3a2-a7ef-468a-8074-f37cd97da6c0 req-d4f33a59-d9c6-458b-bcd4-e96e598b6df7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:47.004176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0bc1e3a2-a7ef-468a-8074-f37cd97da6c0 req-d4f33a59-d9c6-458b-bcd4-e96e598b6df7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:47.048337 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0bc1e3a2-a7ef-468a-8074-f37cd97da6c0 req-d4f33a59-d9c6-458b-bcd4-e96e598b6df7 service nova] Creating event network-changed:8dab394f-f2b0-4c3f-abc6-83c31c8f2aaa for instance 190fc59b-248a-4259-8531-def6afcde4ed on n-h1-858383-16 Oct 27 09:30:47.059015 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0bc1e3a2-a7ef-468a-8074-f37cd97da6c0 req-d4f33a59-d9c6-458b-bcd4-e96e598b6df7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096996 Oct 27 09:30:47.062028 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2851/5654] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:47.076475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:47.078111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:47.095228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:47.096075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:47.098281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:47.099299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:47.101682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:47.102346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:47.140780 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 HTTP/1.1 Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '91d8c34f-411b-482d-9b7d-d21353f09769'} Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:47.142890 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:47.146870 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:47.146870 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:47.146870 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:47.146870 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:47.146870 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:47.146870 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:30:47.146870 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:47.152726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:47.157875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4a977ef3-f05e-43f7-86d9-dfaa49537235 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 404 len: 111 microversion: 2.1 time: 0.089845 Oct 27 09:30:47.158652 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2852/5655] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:47 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:30:47.179369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:47.207035 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7dd0c600-da90-4a6f-8782-e9a4731a20a4 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.441452 Oct 27 09:30:47.232325 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2804/5656] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:46 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:47.243720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:47.246531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:47.261378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:47.264081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:47.265449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:47.267040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:47.268732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:47.269761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:47.316574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lazy-loading 'flavor' on Instance uuid dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:30:47.363354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:47.382543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1164787586", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7a475c77-fcd2-4475-b72a-44ef10abc15a"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:47.475616 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-800ef4de-9abb-41c6-af54-4cfe78dd1b59 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.238293 Oct 27 09:30:47.484428 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2853/5657] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:47 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:30:47.501493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:47.502304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:47.523182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] validate_networks() for [('7a475c77-fcd2-4475-b72a-44ef10abc15a', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:30:47.525965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:47.529413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:47.530023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:47.531633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:47.532092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:47.532536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:47.836044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:47.846476 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d97c71f-af3d-44c0-8524-36d0cec60ffe tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1281 microversion: 2.1 time: 0.360189 Oct 27 09:30:47.847582 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2854/5658] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:47 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1281 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:47.868957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:47.869978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:47.877687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:47.878297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:47.878872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:47.879766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:47.880340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:47.881012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:48.172976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:48.181880 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-052cc38e-be8a-49ce-b1ca-e387a29993f1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1675 microversion: 2.1 time: 0.320549 Oct 27 09:30:48.182478 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2855/5659] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:47 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1675 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:48.212315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:48.213224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:48.220318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:48.221229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:48.221984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:48.222863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:48.223484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:48.225019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:48.406852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:30:48.407556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:30:48.408164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:30:48.408892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:30:48.409716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:30:48.430815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:48.433208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:48.434554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:48.438734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:48.439375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:48.440545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:48.467649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:30:48.492687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Getting quotas for user 993f47058e6d48f7ac30138be91496c5 and project 6e0440a7838f46d182ae8186f2a1d45f. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:30:48.534512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:30:48.546146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:30:48.590880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:48.612220 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-689cf954-62d6-4f74-8e03-ca05d952f3ea tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1318 microversion: 2.1 time: 0.409550 Oct 27 09:30:48.612975 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2856/5660] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:48 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:48.631123 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca8620f8-2918-4a8e-9804-1ace1b8c71ac tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261075 Oct 27 09:30:48.632616 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2805/5661] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:30:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:30:48.644599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f67617fd-af65-4d8d-8da8-52ea7506bb00 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:48.645513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f67617fd-af65-4d8d-8da8-52ea7506bb00 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:48.737320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f67617fd-af65-4d8d-8da8-52ea7506bb00 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:48.748084 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f67617fd-af65-4d8d-8da8-52ea7506bb00 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1209 microversion: 2.1 time: 0.106749 Oct 27 09:30:48.748988 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2857/5662] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:48 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:48.875625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:48.876288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:48.887494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:48.888026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:48.888467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:48.889266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:48.889723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:48.896144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:49.209792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:49.210474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:49.213878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:49.218124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:49.229629 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97aa05de-80e5-40ef-bf39-b61891a803a7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1269 microversion: 2.1 time: 0.359195 Oct 27 09:30:49.233148 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2806/5663] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:48 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1269 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:49.260087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:49.270915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:49.271534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:49.272442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:49.276418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:49.277813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:49.607090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:49.622412 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c982af18-bf96-4a10-a142-cbbd892322a9 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1658 microversion: 2.1 time: 0.416699 Oct 27 09:30:49.623748 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2858/5664] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:49 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1658 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:49.649510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:49.652139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:49.652564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7cdfd721-d224-4e45-9f71-cae27114fa5a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:49.653857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7cdfd721-d224-4e45-9f71-cae27114fa5a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:49.661531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:49.663839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:49.664470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:49.665414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:49.666476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cdfd721-d224-4e45-9f71-cae27114fa5a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:49.668125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cdfd721-d224-4e45-9f71-cae27114fa5a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:49.668678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cdfd721-d224-4e45-9f71-cae27114fa5a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:49.668799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:49.669400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:49.671333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cdfd721-d224-4e45-9f71-cae27114fa5a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:49.675370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cdfd721-d224-4e45-9f71-cae27114fa5a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:49.675965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cdfd721-d224-4e45-9f71-cae27114fa5a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:49.804312 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7cdfd721-d224-4e45-9f71-cae27114fa5a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action" status: 202 len: 0 microversion: 2.1 time: 0.156083 Oct 27 09:30:49.805487 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2859/5665] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:30:49 2022] POST /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:30:49.821021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:49.823885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:49.846450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:49.851179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:49.852264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:49.855912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:49.856681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:49.862229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:49.989869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:50.003857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:50.014439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01c1b6c5-2807-4aed-b46d-a24739b7bb1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1318 microversion: 2.1 time: 0.382197 Oct 27 09:30:50.029533 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6e0e6119-23f3-4385-bb3e-390bb609bfa7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1213 microversion: 2.1 time: 0.221820 Oct 27 09:30:50.031371 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2807/5666] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:49 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:50.032661 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2860/5667] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:49 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1213 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:50.037051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:50.037906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:50.046092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:50.046832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:50.047468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:50.048431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:50.049087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:50.050147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:50.260455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:50.261240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:50.275181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:50.278423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:50.279102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:50.279579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:50.280352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:50.280810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:50.281395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:50.289972 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9723e3e9-b062-42a4-98f9-de2d7ae7e657 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1664 microversion: 2.1 time: 0.257096 Oct 27 09:30:50.291753 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2808/5668] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:50 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1664 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:50.587630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:50.606542 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-21bb1b93-16e6-4203-a2c6-699af9281b05 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1269 microversion: 2.1 time: 0.351662 Oct 27 09:30:50.613078 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2861/5669] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:50 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1269 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:51.046877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:51.051491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:51.060903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:51.061527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:51.066968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:51.068053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:51.068562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:51.069003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:51.069785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:51.070238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:51.070495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:51.070971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:51.071395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:51.072043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:51.072168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:51.072568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:51.208669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:51.238274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-01a5f9ff-c168-439e-b9bb-04c6fe16104c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1205 microversion: 2.1 time: 0.181525 Oct 27 09:30:51.240082 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2862/5670] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:51 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1205 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:51.302820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:51.314602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65ac1330-b04c-45bd-8c68-111053c2228c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1318 microversion: 2.1 time: 0.279000 Oct 27 09:30:51.327595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:51.327595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:51.327595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:51.327595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:51.328598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:51.329401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:51.329758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:51.330265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:51.330931 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2809/5671] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:51 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:51.509101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:51.525714 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bfeaa750-91a7-4dc3-973e-b648f3fcf30e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1664 microversion: 2.1 time: 0.212676 Oct 27 09:30:51.548173 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2863/5672] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:51 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1664 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:51.648187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:51.648932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:51.660966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:51.663523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:51.667056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:51.676801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:51.677570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:51.682084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:51.978145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:51.990310 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f700850-f0e5-4957-89c0-1857c5ea4947 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1269 microversion: 2.1 time: 0.348476 Oct 27 09:30:51.992574 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2810/5673] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:51 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1269 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:52.264612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:52.265142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:52.272112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:52.283009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:52.283934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:52.284852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:52.285559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:52.286672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:52.348123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:52.358408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:52.373748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:52.374639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:52.375342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:52.376373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:52.379314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:52.380117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:52.654673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:52.664258 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e309ad23-7c66-440e-8cfa-5f95a09bb294 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1269 microversion: 2.1 time: 0.403533 Oct 27 09:30:52.664867 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2864/5674] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:52 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1269 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:52.694643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:52.698259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:52.756365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:52.757021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:52.757491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:52.758250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:52.758757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:52.761031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:53.303657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:53.331596 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-490fe6b7-69ff-4e85-a3a1-0baa8c349569 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1318 microversion: 2.1 time: 0.991788 Oct 27 09:30:53.356037 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2811/5675] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:52 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1318 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:53.374154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:53.377559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:53.420557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:53.424480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:53.426245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:53.429546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:53.433901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:53.437565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:53.548204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:53.558482 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91e400b4-1aa1-4c1c-a965-f406efa227fd tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1664 microversion: 2.1 time: 0.868030 Oct 27 09:30:53.559315 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2865/5676] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:52 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1664 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:53.689595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:53.690282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:53.703172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:53.703704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:53.704156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:53.704876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:53.705334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:53.705768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:53.974975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:53.984696 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd7179c2-5953-471d-b366-776c01a50274 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1267 microversion: 2.1 time: 0.299311 Oct 27 09:30:53.985966 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2866/5677] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:53 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:53.996618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:53.997181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:54.014627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.015417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.016054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.019220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.020068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.020667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.050058 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 HTTP/1.1 Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b896a809-0fa3-4871-8de8-f0adfce00a53'} Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:30:54.054851 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:54.061545 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4cba847a-be5a-48ed-ac91-1cae3d2117f2 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 404 len: 111 microversion: 2.1 time: 0.069817 Oct 27 09:30:54.064007 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2867/5678] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:30:53 2022] DELETE /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:30:54.075037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:54.085044 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae040cc9-3d1d-4d88-84c5-fe5afddad201 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1269 microversion: 2.1 time: 0.724991 Oct 27 09:30:54.085560 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2812/5679] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:53 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1269 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:54.088637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:54.096409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: b896a809-0fa3-4871-8de8-f0adfce00a53] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:54.105818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.106553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.106765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.108932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.110492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.111255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.161102 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 HTTP/1.1 Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b896a809-0fa3-4871-8de8-f0adfce00a53'} Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:54.162698 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.167336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:54.167336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:54.167336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:54.167336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:54.167336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:54.167336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. Oct 27 09:30:54.167336 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:30:54.167336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance b896a809-0fa3-4871-8de8-f0adfce00a53 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:54.167336 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-149e0cd3-c319-43f6-ad7c-267dcabfa024 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53" status: 404 len: 111 microversion: 2.1 time: 0.100762 Oct 27 09:30:54.168079 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2868/5680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:54 2022] GET /compute/v2.1/servers/b896a809-0fa3-4871-8de8-f0adfce00a53 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:30:54.175529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:54.176208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:54.186976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.190608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.192042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.192893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.197827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.198566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.331048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:30:54.362445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:54.363056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:54.373450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.373941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.374384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.375104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.375624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.380934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.483051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:54.576598 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-349bd778-5c85-4760-8485-66e96c1eddbd tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 204 len: 0 microversion: 2.1 time: 0.407078 Oct 27 09:30:54.579822 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2813/5681] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:30:54 2022] DELETE /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:30:54.590240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:54.591135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:54.600823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.604038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.604500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.605453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.606007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.606746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.811307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:54.823549 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-508326c2-bae5-4040-abdd-8c74daa4415d tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1318 microversion: 2.1 time: 0.464839 Oct 27 09:30:54.825647 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2869/5682] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:54 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:30:54.835444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:54.839697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:54.854329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.855905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.856535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:54.857846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:54.858484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:54.859296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.094249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:55.109219 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2277b876-a74f-4a85-9294-df37ac318e45 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.521010 Oct 27 09:30:55.131160 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2814/5683] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:54 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:55.279116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:55.281834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:55.307702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c77f17c-e865-492b-b29d-db5f7abf4f94 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.480342 Oct 27 09:30:55.310298 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2870/5684] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:54 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:55.316521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:55.323754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:55.342440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.343174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.344127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.345008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.345612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.351125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.383165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8276f616-a483-4de6-9524-50e44155ddd4 req-abd57db1-73a9-4ace-a5ff-58bdd65855a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190fc59b-248a-4259-8531-def6afcde4ed", "name": "network-vif-plugged", "status": "completed", "tag": "8dab394f-f2b0-4c3f-abc6-83c31c8f2aaa"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:55.394917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8276f616-a483-4de6-9524-50e44155ddd4 req-abd57db1-73a9-4ace-a5ff-58bdd65855a3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.395395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8276f616-a483-4de6-9524-50e44155ddd4 req-abd57db1-73a9-4ace-a5ff-58bdd65855a3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.401892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8276f616-a483-4de6-9524-50e44155ddd4 req-abd57db1-73a9-4ace-a5ff-58bdd65855a3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.414536 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8276f616-a483-4de6-9524-50e44155ddd4 req-abd57db1-73a9-4ace-a5ff-58bdd65855a3 service nova] Creating event network-vif-plugged:8dab394f-f2b0-4c3f-abc6-83c31c8f2aaa for instance 190fc59b-248a-4259-8531-def6afcde4ed on n-h1-858383-16 Oct 27 09:30:55.420743 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8276f616-a483-4de6-9524-50e44155ddd4 req-abd57db1-73a9-4ace-a5ff-58bdd65855a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304522 Oct 27 09:30:55.421969 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2815/5685] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:55.428266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:55.428986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:55.435814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.436312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.436754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.437465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.437926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.438355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.581147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:55.593940 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7042b005-cf8f-4fb2-9f95-94eac0a93836 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1309 microversion: 2.1 time: 0.282290 Oct 27 09:30:55.609088 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2871/5686] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:55 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:55.617443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:55.618992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:55.625723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.626500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.627121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.628097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.629080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.629672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.664140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:55.673224 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-febf1c29-06fd-4ced-9316-6fd2b39807ae tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1269 microversion: 2.1 time: 0.249542 Oct 27 09:30:55.674231 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2816/5687] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:55 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1269 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:55.791668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:55.804368 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1022d0e2-3c99-4c30-a28b-deb70214da3b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1667 microversion: 2.1 time: 0.193939 Oct 27 09:30:55.805846 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2872/5688] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:55 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1667 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:55.831113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:55.831914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:55.839383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.840255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.841057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.842186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.842948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.843717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.852239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:55.854264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:55.866715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.868052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.870315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.871349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:55.877436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:55.878242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:55.929416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:30:55.945879 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.compute.api [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Working on deleting snapshot 413f00d2-4e1e-432b-a1ed-4c8da82d36a6 from shelved instance... Oct 27 09:30:56.286428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:56.296671 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e8d357d-a071-42ac-adea-8ebe7e4d4393 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1318 microversion: 2.1 time: 0.448373 Oct 27 09:30:56.310984 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2873/5689] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:55 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:56.332321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:56.332941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:56.344358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:56.344872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:56.345384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:56.346034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:56.346503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:56.346933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:56.799195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Doing local delete in cell ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) {{(pid=120603) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 27 09:30:56.800168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:56.800831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:56.801454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:56.802174 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.compute.api [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 27 09:30:56.809021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] deallocate_for_instance() {{(pid=120603) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 27 09:30:56.839739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:56.848250 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-482cf2b8-d4f2-467a-a03b-3bb6972f4a9a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1510 microversion: 2.1 time: 0.521718 Oct 27 09:30:56.864335 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2874/5690] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:56 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1510 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:56.871356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:56.872318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:56.880170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:56.880841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:56.881438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:56.882321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:56.883022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:56.884689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:57.961121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:57.976001 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83635e87-e301-4ce3-988a-07dc6d8302e3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1309 microversion: 2.1 time: 1.105031 Oct 27 09:30:57.976745 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2875/5691] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:56 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1309 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:57.988975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:57.992947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:58.013763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:58.016623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:58.017156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:58.018225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:58.022378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:58.026902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:58.453854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:58.516248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:58.709966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:58.723842 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8fbd96da-4f2a-4dcc-9aa6-d97e3b9c4fba tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1269 microversion: 2.1 time: 0.743922 Oct 27 09:30:58.724742 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2876/5692] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:57 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1269 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:58.737995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:58.738950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:58.753348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:58.755188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:58.761974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:58.763053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:58.764028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:58.764675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:58.765286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:59.198185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Updating instance_info_cache with network_info: [] {{(pid=120603) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 27 09:30:59.235973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:59.245813 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08a1fed0-21d0-421a-abc0-e28cd0c0fc19 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1507 microversion: 2.1 time: 0.520010 Oct 27 09:30:59.252550 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2877/5693] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:58 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1507 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:59.269532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:59.273457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:59.290517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:59.300771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:59.304735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:59.308106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:59.308712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:59.309444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:59.507424 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1525cd09-3018-4e65-b4a5-d6cb9653b98e tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 204 len: 0 microversion: 2.1 time: 3.680112 Oct 27 09:30:59.508350 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2817/5694] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:30:55 2022] DELETE /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 0 bytes in 3682 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:30:59.514907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-13157cea-240e-4789-b001-db96b4c35184 req-f69c25e9-6878-49f5-aae4-b5ceb4eba2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405ba9d1-a37f-4060-8488-62e5fcea9bb3", "tag": "9cffa956-5507-414c-a2fc-fcd1f31af850"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:59.527253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-13157cea-240e-4789-b001-db96b4c35184 req-f69c25e9-6878-49f5-aae4-b5ceb4eba2c1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:59.528355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-13157cea-240e-4789-b001-db96b4c35184 req-f69c25e9-6878-49f5-aae4-b5ceb4eba2c1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:59.529146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-13157cea-240e-4789-b001-db96b4c35184 req-f69c25e9-6878-49f5-aae4-b5ceb4eba2c1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:59.543623 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-13157cea-240e-4789-b001-db96b4c35184 req-f69c25e9-6878-49f5-aae4-b5ceb4eba2c1 service nova] Creating event network-changed:9cffa956-5507-414c-a2fc-fcd1f31af850 for instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 on n-h1-858383-16 Oct 27 09:30:59.550696 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-13157cea-240e-4789-b001-db96b4c35184 req-f69c25e9-6878-49f5-aae4-b5ceb4eba2c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040076 Oct 27 09:30:59.552011 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2818/5695] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:59.558850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:59.560536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:59.570203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:59.571850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:59.572495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:59.573519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:59.574192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:59.574812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:59.612036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:59.628457 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c550fb2-72c9-4426-a5b3-a4556606c55a tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1468 microversion: 2.1 time: 0.374376 Oct 27 09:30:59.644316 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2878/5696] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:59 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1468 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:59.651539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:59.652497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:30:59.659333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:59.660167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:59.660769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:59.661682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:30:59.662362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:30:59.662950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:30:59.978682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:30:59.988419 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87b7a4c2-221b-4ac6-83b9-ca1295660afc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1309 microversion: 2.1 time: 0.434998 Oct 27 09:30:59.989147 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2819/5697] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:59 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:59.994663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:59.995792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 222bb9b2-8066-4145-a9b2-a797cd414d5e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:00.005359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.006296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.006976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.007968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.009424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.010096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.027651 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] HTTP exception thrown: Instance 222bb9b2-8066-4145-a9b2-a797cd414d5e could not be found. Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Request method failure captured: Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e HTTP/1.1 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk1NW1iFAG-q3IJ54oZWfKh3CNO_EF5jnXqA5GerkUeJ0txazj2zZzKz-nqsGtjcUfQhqSuw6yfredcMS8g-HG6ROlJPAHneL3NK_xneNortyFwBSnbXAd0hTWoUi0UNK79Omwrb2gPcxkPGuECxlTUoaG3jfeC-ZD9oWt5dtdc8Pbk Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4c5d43a28c24b63b960932c678d0858"}]}] Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9301fb54a8734e1ab31e496add7e9446 Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 222bb9b2-8066-4145-a9b2-a797cd414d5e could not be found. Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '222bb9b2-8066-4145-a9b2-a797cd414d5e'} Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222bb9b2-8066-4145-a9b2-a797cd414d5e could not be found. Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222bb9b2-8066-4145-a9b2-a797cd414d5e could not be found. Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:00.030221 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:00.034195 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:00.034195 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:00.034195 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:00.034195 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:00.034195 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:00.034195 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222bb9b2-8066-4145-a9b2-a797cd414d5e could not be found. Oct 27 09:31:00.034195 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:00.037037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Returning 404 to user: Instance 222bb9b2-8066-4145-a9b2-a797cd414d5e could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:00.038298 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-03023111-a494-4894-a185-40f9373ed0e6 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e" status: 404 len: 111 microversion: 2.1 time: 0.047959 Oct 27 09:31:00.039446 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2820/5698] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:59 2022] GET /compute/v2.1/servers/222bb9b2-8066-4145-a9b2-a797cd414d5e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:00.046929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:00.047823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:00.056945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.058044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.058580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.062227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.063011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.063616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.067730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:00.099479 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5d12e39-d672-4a30-b974-0b6d6901335b tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1507 microversion: 2.1 time: 0.453581 Oct 27 09:31:00.100440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2879/5699] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:30:59 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:00.129331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:00.132681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:00.156519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.157741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.160561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.162321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.164540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.165964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.214457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:31:00.322054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:00.337061 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50178cfe-74d5-43a8-beca-77dbf7fc0f2b tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1269 microversion: 2.1 time: 0.294699 Oct 27 09:31:00.337061 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2821/5700] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:00 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1269 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:00.355828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a369bd47-c68d-4440-9d39-45d963c9c1b4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:00.360062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a369bd47-c68d-4440-9d39-45d963c9c1b4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:00.369092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a369bd47-c68d-4440-9d39-45d963c9c1b4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.369610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a369bd47-c68d-4440-9d39-45d963c9c1b4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.370051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a369bd47-c68d-4440-9d39-45d963c9c1b4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.370766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a369bd47-c68d-4440-9d39-45d963c9c1b4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.371533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a369bd47-c68d-4440-9d39-45d963c9c1b4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.371727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a369bd47-c68d-4440-9d39-45d963c9c1b4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.409001 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9417a87-8603-45d4-9fef-93147e99f63f tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 204 len: 0 microversion: 2.1 time: 0.294808 Oct 27 09:31:00.414504 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2880/5701] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:00 2022] DELETE /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:31:00.423201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:00.423927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:00.442217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.442968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.443623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.444366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.444836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.445267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.464004 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a369bd47-c68d-4440-9d39-45d963c9c1b4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "PUT /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1079 microversion: 2.1 time: 0.126440 Oct 27 09:31:00.481073 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2822/5702] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 09:31:00 2022] PUT /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1079 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:00.491612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:00.492251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:00.501053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.501560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.501994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.502718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.503182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.503645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.588966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:00.614667 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8caf3d6c-cd06-49fa-a09b-960a561f3fc0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1467 microversion: 2.1 time: 0.197272 Oct 27 09:31:00.615281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2881/5703] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:00 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1467 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:00.661816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:00.663188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:00.672929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.673803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.674939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.676297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.677260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.677982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.724944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.726104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.727028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.728711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lazy-loading 'fault' on Instance uuid d8f35f23-0b67-4a55-8c3e-3950fac6b97a {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:31:00.806628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dce47ed98f48d5ba1c8dd744fdbead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b12f02b2d745179ce7300489278d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:00.810510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:00.820860 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf306c3c-58f8-44fd-b125-2f47069a4ca1 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 200 len: 1306 microversion: 2.1 time: 0.167027 Oct 27 09:31:00.823928 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2882/5704] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:00 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 1306 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:00.824231 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c436e709-6215-478c-9109-e6d5ec116a78 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1505 microversion: 2.1 time: 0.339482 Oct 27 09:31:00.825432 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2823/5705] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:00 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:00.835043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-12261bf9-1adf-4401-a818-504dd2ee4a9a req-9ee8d4b2-1527-4136-bb23-290a96272c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa9a91c4-0af7-4057-9057-10e1f096b507", "name": "network-vif-plugged", "status": "completed", "tag": "09aae92a-6611-4dc3-a6bc-3ac924a97948"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:00.849384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:00.850039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-12261bf9-1adf-4401-a818-504dd2ee4a9a req-9ee8d4b2-1527-4136-bb23-290a96272c10 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.850475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:00.850727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-12261bf9-1adf-4401-a818-504dd2ee4a9a req-9ee8d4b2-1527-4136-bb23-290a96272c10 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.851289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-12261bf9-1adf-4401-a818-504dd2ee4a9a req-9ee8d4b2-1527-4136-bb23-290a96272c10 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.860065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.861108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.861752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.863993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:00.865467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:00.866476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:00.869473 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-12261bf9-1adf-4401-a818-504dd2ee4a9a req-9ee8d4b2-1527-4136-bb23-290a96272c10 service nova] Creating event network-vif-plugged:09aae92a-6611-4dc3-a6bc-3ac924a97948 for instance aa9a91c4-0af7-4057-9057-10e1f096b507 on n-h2-858383-16 Oct 27 09:31:00.875835 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-12261bf9-1adf-4401-a818-504dd2ee4a9a req-9ee8d4b2-1527-4136-bb23-290a96272c10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047594 Oct 27 09:31:00.877568 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2883/5706] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:01.018649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:01.019494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:01.032441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.033210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.034143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.035355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.036359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.037069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.059652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:01.083805 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4627c6c0-d93a-4f15-8565-4f261c2b574c tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1505 microversion: 2.1 time: 0.238974 Oct 27 09:31:01.101790 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2824/5707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:00 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:01.110460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47f46fac-72ed-476d-9b30-dcf83d3c1525 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:01.114027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-47f46fac-72ed-476d-9b30-dcf83d3c1525 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:01.122126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47f46fac-72ed-476d-9b30-dcf83d3c1525 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.122707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47f46fac-72ed-476d-9b30-dcf83d3c1525 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.123332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47f46fac-72ed-476d-9b30-dcf83d3c1525 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.124549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47f46fac-72ed-476d-9b30-dcf83d3c1525 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.125287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47f46fac-72ed-476d-9b30-dcf83d3c1525 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.125878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47f46fac-72ed-476d-9b30-dcf83d3c1525 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.135234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:01.262172 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-47f46fac-72ed-476d-9b30-dcf83d3c1525 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "PUT /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1081 microversion: 2.1 time: 0.157346 Oct 27 09:31:01.263203 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2825/5708] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 09:31:01 2022] PUT /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1081 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:01.285344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:01.286912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:01.293985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.294622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.295275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.296647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.297595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.297745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.372290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:01.380297 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-658fab7b-7c64-4c4c-9e46-a7abf51b7db6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1309 microversion: 2.1 time: 0.368488 Oct 27 09:31:01.392308 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2884/5709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:01 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1309 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:01.402641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:01.403261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:01.410259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.410938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.411187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.411955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.412410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.412833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.610110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:01.630755 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b4d7b153-c47d-45ee-9e6e-7c721c360ef9 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1507 microversion: 2.1 time: 0.350426 Oct 27 09:31:01.635088 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2826/5710] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:01 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:01.650874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c39bc1bf-21df-486f-9e34-230f9fb35448 req-fa7912be-6191-47b2-99d8-1fcb4af8e0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bb9b2-8066-4145-a9b2-a797cd414d5e", "name": "network-vif-deleted", "tag": "cb3da523-3f15-44f5-a3c8-7eb439acdc40"}, {"server_uuid": "d8f35f23-0b67-4a55-8c3e-3950fac6b97a", "name": "network-vif-deleted", "tag": "fe701430-2ee5-4174-b187-9c3bbd60c9e6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:01.667717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c39bc1bf-21df-486f-9e34-230f9fb35448 req-fa7912be-6191-47b2-99d8-1fcb4af8e0e6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.668590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c39bc1bf-21df-486f-9e34-230f9fb35448 req-fa7912be-6191-47b2-99d8-1fcb4af8e0e6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.669298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c39bc1bf-21df-486f-9e34-230f9fb35448 req-fa7912be-6191-47b2-99d8-1fcb4af8e0e6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.687338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.server_external_events [req-c39bc1bf-21df-486f-9e34-230f9fb35448 req-fa7912be-6191-47b2-99d8-1fcb4af8e0e6 service nova] Unable to find a host for instance 222bb9b2-8066-4145-a9b2-a797cd414d5e. Dropping event network-vif-deleted {{(pid=120603) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 09:31:01.688126 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c39bc1bf-21df-486f-9e34-230f9fb35448 req-fa7912be-6191-47b2-99d8-1fcb4af8e0e6 service nova] Creating event network-vif-deleted:fe701430-2ee5-4174-b187-9c3bbd60c9e6 for instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a on n-h1-858383-16 Oct 27 09:31:01.699697 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c39bc1bf-21df-486f-9e34-230f9fb35448 req-fa7912be-6191-47b2-99d8-1fcb4af8e0e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 351 microversion: 2.1 time: 0.062934 Oct 27 09:31:01.700749 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2827/5711] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 351 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 09:31:01.706733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:01.707753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:01.716467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.717373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.717994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.718892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.719520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.720166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.730844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:01.740057 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f9284306-6b7b-4c3d-b8de-c468e9eba130 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1269 microversion: 2.1 time: 0.346465 Oct 27 09:31:01.741301 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2885/5712] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:01 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1269 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:01.763380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:01.764797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:01.772157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.772943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.773547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.774460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:01.775092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:01.775524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:01.780085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:01.893890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:01.906964 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97cf48fc-9efb-4fe7-b01c-57de0fc90646 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1467 microversion: 2.1 time: 0.204372 Oct 27 09:31:01.907939 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2828/5713] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:01 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1467 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:01.987202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:02.000688 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae986681-746e-4ed3-9c3c-5981da3df4f1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1507 microversion: 2.1 time: 0.245667 Oct 27 09:31:02.001971 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2886/5714] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:01 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:02.026696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:02.027596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:02.037479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.040346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.041191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.052201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.057014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.057801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.159952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:31:02.316730 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d4211f5c-278a-43f5-8a44-d8935a03bb8e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "DELETE /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 204 len: 0 microversion: 2.1 time: 0.294076 Oct 27 09:31:02.323700 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2887/5715] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:02 2022] DELETE /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:31:02.331076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:02.331927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:02.353892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.361599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.362074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.362874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.363317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.363768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.423774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:31:02.465106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:02.465999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] [instance: d8f35f23-0b67-4a55-8c3e-3950fac6b97a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:02.474372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.474881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.476030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.476839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.477345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.477787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.495050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.api [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Instance is already in deleting state, ignoring this request Oct 27 09:31:02.496203 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7130aa89-dfc3-456e-be4f-58b9937fd272 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "DELETE /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 204 len: 0 microversion: 2.1 time: 0.170753 Oct 27 09:31:02.496817 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] HTTP exception thrown: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a could not be found. Oct 27 09:31:02.497929 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2888/5716] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:02 2022] DELETE /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Request method failure captured: Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a HTTP/1.1 Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk6pAZMKWm2DKFkjCQy8gxpyJfn6cr5y8AP7CokD3XtRA01xMeQZJ7xkzqH9ut-ZuSXn_ueW9_qaUKg_p_JUaQNQMK1R5SatehZE2nSLdJ7GXoX1PaRuZJE1DnKrc2keGJW7IEu7nc6k1Txhnc4FxsY2QpX0wf8dDQUBgSStAy_wO3k Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91b12f02b2d745179ce7300489278d6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91b12f02b2d745179ce7300489278d6e"}]}] Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 91b12f02b2d745179ce7300489278d6e Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-648660877 Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 57dce47ed98f48d5ba1c8dd744fdbead Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-648660877-project Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a could not be found. Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd8f35f23-0b67-4a55-8c3e-3950fac6b97a'} Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a could not be found. Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a could not be found. Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:02.502181 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a could not be found. Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] Returning 404 to user: Instance d8f35f23-0b67-4a55-8c3e-3950fac6b97a could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0645a4d-f126-4640-915d-e2a87cf0e989 tempest-ServersNegativeTestJSON-648660877 tempest-ServersNegativeTestJSON-648660877-project] 10.222.0.25 "GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a" status: 404 len: 111 microversion: 2.1 time: 0.595026 Oct 27 09:31:02.508821 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2829/5717] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:01 2022] GET /compute/v2.1/servers/d8f35f23-0b67-4a55-8c3e-3950fac6b97a => generated 111 bytes in 597 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:02.510654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:02.511277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:02.512804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:02.513621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:02.522772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.523475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.525026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.526163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.526792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.527438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.531601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.532152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.532620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.537864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.538588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.539101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.769255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:02.778159 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5995111-4677-44bf-923b-9e455198aa62 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1309 microversion: 2.1 time: 0.278091 Oct 27 09:31:02.778702 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2889/5718] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:02 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:02.798669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:02.799300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:02.805359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.807165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.807641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.808373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.808854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.809272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.870288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:02.882306 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77300642-3f9a-4089-b632-26c9bb78aab8 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1513 microversion: 2.1 time: 0.374181 Oct 27 09:31:02.882306 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2830/5719] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:02 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1513 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:02.936255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:02.937719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:02.947205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.947939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.949172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:02.950164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:02.950785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:02.951373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:03.092634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:03.107477 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dfb0080c-0c7b-4d32-bd22-2c56bc4878c1 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1467 microversion: 2.1 time: 0.176535 Oct 27 09:31:03.109477 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2831/5720] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:02 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1467 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:03.176864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:03.191290 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-539be36e-f3e3-4a86-9ad1-9e61ae99f6f7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1269 microversion: 2.1 time: 0.398002 Oct 27 09:31:03.193389 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2890/5721] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:02 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1269 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:03.785898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d1bfa926-67e4-4746-9ce0-04813ec50457 req-d313a951-6d97-446c-98c9-87bc532442f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f", "name": "network-vif-deleted", "tag": "83ab4a35-51f8-44ca-8a16-1fb3a90fbc85"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:03.804540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:03.805800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:03.812098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d1bfa926-67e4-4746-9ce0-04813ec50457 req-d313a951-6d97-446c-98c9-87bc532442f8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:03.814877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d1bfa926-67e4-4746-9ce0-04813ec50457 req-d313a951-6d97-446c-98c9-87bc532442f8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:03.815492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d1bfa926-67e4-4746-9ce0-04813ec50457 req-d313a951-6d97-446c-98c9-87bc532442f8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:03.819320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:03.820160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:03.822487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:03.825308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:03.826255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:03.833335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:03.881119 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d1bfa926-67e4-4746-9ce0-04813ec50457 req-d313a951-6d97-446c-98c9-87bc532442f8 service nova] Creating event network-vif-deleted:83ab4a35-51f8-44ca-8a16-1fb3a90fbc85 for instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f on n-h2-858383-16 Oct 27 09:31:03.896163 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d1bfa926-67e4-4746-9ce0-04813ec50457 req-d313a951-6d97-446c-98c9-87bc532442f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116144 Oct 27 09:31:03.904898 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2832/5722] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:31:03.922069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:03.931937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:03.969820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:03.973179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:03.975226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:03.977415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:03.978247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:03.978698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:05.175069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:05.194864 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6524d2c-57b4-4240-89e4-0c30213a5401 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1513 microversion: 2.1 time: 1.287419 Oct 27 09:31:05.196164 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2833/5723] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:03 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1513 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:05.201880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:05.203118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:05.210275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:05.211028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:05.212224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:05.214199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:05.215080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:05.215703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:05.258493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:05.271081 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-029a55e0-11bb-485d-9497-9b36206b12e1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1309 microversion: 2.1 time: 1.467509 Oct 27 09:31:05.274273 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2891/5724] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:03 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1309 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:05.279696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:05.281282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:05.281846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:05.282812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lazy-loading 'fault' on Instance uuid bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:31:05.292277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:05.293331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:05.299986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:05.300784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:05.301588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:05.302554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:05.303370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:05.304193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:05.529652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:05.538113 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d109c78f-5ce4-4a36-b389-988b32bcce32 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 200 len: 1305 microversion: 2.1 time: 0.340608 Oct 27 09:31:05.539708 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2834/5725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:05 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 1305 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:05.813984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:05.823736 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23ae1666-bac9-4f54-b1ab-1d2bb410dfcd tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1459 microversion: 2.1 time: 0.546962 Oct 27 09:31:05.825155 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2892/5726] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:05 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1459 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:05.851417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:05.853031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:05.862199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:05.863188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:05.864206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:05.865631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:05.866479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:05.868572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.226592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:06.227986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:06.235845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.236685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.237513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.238344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.238787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.240183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.311424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:06.320315 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d95e08a7-3968-482c-8bcd-f1606e13f791 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1459 microversion: 2.1 time: 0.475423 Oct 27 09:31:06.321574 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2835/5727] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:05 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1459 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:06.342406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:06.347530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:06.368094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.368774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.369373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.370252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.370889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.371465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.645053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:06.659307 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-625515f5-263a-4047-990b-5d97f6f9e377 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1471 microversion: 2.1 time: 0.444782 Oct 27 09:31:06.662302 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2893/5728] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:06 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1471 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:06.673357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:06.673982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:06.688920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.689418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.689873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.694242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.698637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.699130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.739040 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] HTTP exception thrown: Instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f could not be found. Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Request method failure captured: Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f HTTP/1.1 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk1NW1iFAG-q3IJ54oZWfKh3CNO_EF5jnXqA5GerkUeJ0txazj2zZzKz-nqsGtjcUfQhqSuw6yfredcMS8g-HG6ROlJPAHneL3NK_xneNortyFwBSnbXAd0hTWoUi0UNK79Omwrb2gPcxkPGuECxlTUoaG3jfeC-ZD9oWt5dtdc8Pbk Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4c5d43a28c24b63b960932c678d0858"}]}] Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9301fb54a8734e1ab31e496add7e9446 Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f could not be found. Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f'} Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f could not be found. Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f could not be found. Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:06.744092 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:06.748667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:06.748667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:06.748667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:06.748667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:06.748667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:06.748667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f could not be found. Oct 27 09:31:06.748667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:06.748667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Returning 404 to user: Instance bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:06.751369 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d138ac93-a7d2-43d9-a7bc-ee418447729a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f" status: 404 len: 111 microversion: 2.1 time: 0.087957 Oct 27 09:31:06.752190 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2894/5729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:06 2022] GET /compute/v2.1/servers/bf8ade9a-13a1-48cb-9a9c-a9a5bceacc6f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:06.764450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-851cb387-95b4-431d-99dd-59c0ea70ba04 req-c10edc10-45c1-4506-9121-81dba674c877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190fc59b-248a-4259-8531-def6afcde4ed", "name": "network-vif-deleted", "tag": "8dab394f-f2b0-4c3f-abc6-83c31c8f2aaa"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:06.780998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-851cb387-95b4-431d-99dd-59c0ea70ba04 req-c10edc10-45c1-4506-9121-81dba674c877 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.781743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-851cb387-95b4-431d-99dd-59c0ea70ba04 req-c10edc10-45c1-4506-9121-81dba674c877 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.782708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-851cb387-95b4-431d-99dd-59c0ea70ba04 req-c10edc10-45c1-4506-9121-81dba674c877 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.819143 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-851cb387-95b4-431d-99dd-59c0ea70ba04 req-c10edc10-45c1-4506-9121-81dba674c877 service nova] Creating event network-vif-deleted:8dab394f-f2b0-4c3f-abc6-83c31c8f2aaa for instance 190fc59b-248a-4259-8531-def6afcde4ed on n-h1-858383-16 Oct 27 09:31:06.831059 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-851cb387-95b4-431d-99dd-59c0ea70ba04 req-c10edc10-45c1-4506-9121-81dba674c877 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073059 Oct 27 09:31:06.832197 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2895/5730] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:06.839515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-65f67f87-a0de-4335-9ec0-334e4d71a709 req-1a7c5c32-c140-49c7-ba68-548275ee4f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405ba9d1-a37f-4060-8488-62e5fcea9bb3", "name": "network-vif-plugged", "status": "completed", "tag": "9cffa956-5507-414c-a2fc-fcd1f31af850"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:06.851541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-65f67f87-a0de-4335-9ec0-334e4d71a709 req-1a7c5c32-c140-49c7-ba68-548275ee4f0e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.852903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-65f67f87-a0de-4335-9ec0-334e4d71a709 req-1a7c5c32-c140-49c7-ba68-548275ee4f0e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.854126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-65f67f87-a0de-4335-9ec0-334e4d71a709 req-1a7c5c32-c140-49c7-ba68-548275ee4f0e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.882969 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-65f67f87-a0de-4335-9ec0-334e4d71a709 req-1a7c5c32-c140-49c7-ba68-548275ee4f0e service nova] Creating event network-vif-plugged:9cffa956-5507-414c-a2fc-fcd1f31af850 for instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 on n-h1-858383-16 Oct 27 09:31:06.892967 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-65f67f87-a0de-4335-9ec0-334e4d71a709 req-1a7c5c32-c140-49c7-ba68-548275ee4f0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058574 Oct 27 09:31:06.894114 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2896/5731] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:06.910236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:06.913591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:06.921862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.922597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.923807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.924709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:06.925321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:06.925898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:06.962731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:31:07.135121 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5eb5a4b3-4734-47e0-9ba8-282c3be36fb3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 204 len: 0 microversion: 2.1 time: 0.239342 Oct 27 09:31:07.136215 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2897/5732] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:06 2022] DELETE /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:31:07.153906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:07.154436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:07.156382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:07.169993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:07.171610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:07.172206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:07.173102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:07.173578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:07.174003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:07.262485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:07.276858 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf170dbd-8ef2-4b88-aedb-8b4063a16b11 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1309 microversion: 2.1 time: 0.953942 Oct 27 09:31:07.277739 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2836/5733] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:06 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1309 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:07.690065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:07.691388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:07.702663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:07.706361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:07.707963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:07.709717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:07.712580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:07.713191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:07.725428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:07.736954 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a70d44d-40b0-482a-833c-e84d8fb0092a tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1507 microversion: 2.1 time: 0.585019 Oct 27 09:31:07.743315 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2898/5734] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:07 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1507 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:07.785642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:07.788149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:07.788798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:07.789299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lazy-loading 'fault' on Instance uuid 190fc59b-248a-4259-8531-def6afcde4ed {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:31:07.901492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d122762f6a446279f6cdc0e66ab5daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085f1c568af5494c99a7ff3dd488f76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:07.912754 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e654492-21c4-4e23-bad2-69b14974cf1f tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 200 len: 1308 microversion: 2.1 time: 0.226553 Oct 27 09:31:07.914852 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2837/5735] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:07 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:08.300457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:08.302371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:08.315355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:08.316689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:08.317568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:08.322014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:08.322759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:08.323525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:08.767900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:08.768516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:08.772503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:08.787260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:08.788230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:08.788837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:08.790928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:08.793336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:08.793860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.366630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:09.376074 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f81f738-1e87-4b61-94c9-65475cad26cc tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1309 microversion: 2.1 time: 1.079095 Oct 27 09:31:09.393295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:09.403521 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2899/5736] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:08 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1309 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:09.406303 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ef681e6-c369-4b6f-bdad-bc75952c9cad tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1507 microversion: 2.1 time: 0.642031 Oct 27 09:31:09.409641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:09.410288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 190fc59b-248a-4259-8531-def6afcde4ed] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:09.415147 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2838/5737] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:08 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1507 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:09.416697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.417191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.417631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.418345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.418802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.419230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.461967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:09.464433 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] HTTP exception thrown: Instance 190fc59b-248a-4259-8531-def6afcde4ed could not be found. Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Request method failure captured: Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed HTTP/1.1 Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8rvMGscT8GtSWK8LoPMzrLW07in3wErH8kC6QscnHzV_quR8WUjsBiY79Nadwgrya28-BW_6pUpOkVygvuz0qJYn002PW1JGtuQp3kxgFwNUyiCIvA36YsAOw1YAVq-7jZnPtYnetZ84ngWoQ48i8T5-WfylSbaZDKO9GEW6z09ro Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/085f1c568af5494c99a7ff3dd488f76a"}]}] Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8d122762f6a446279f6cdc0e66ab5daf Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 190fc59b-248a-4259-8531-def6afcde4ed could not be found. Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '190fc59b-248a-4259-8531-def6afcde4ed'} Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 190fc59b-248a-4259-8531-def6afcde4ed could not be found. Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 190fc59b-248a-4259-8531-def6afcde4ed could not be found. Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.468920 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.472682 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.472682 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.472682 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.472682 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:09.472682 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:09.472682 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 190fc59b-248a-4259-8531-def6afcde4ed could not be found. Oct 27 09:31:09.472682 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.472682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Returning 404 to user: Instance 190fc59b-248a-4259-8531-def6afcde4ed could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:09.473266 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-decce503-d0ce-49ec-8d86-133de446e6ec tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed" status: 404 len: 111 microversion: 2.1 time: 0.068388 Oct 27 09:31:09.473606 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2900/5738] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:09 2022] GET /compute/v2.1/servers/190fc59b-248a-4259-8531-def6afcde4ed => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:09.484138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:09.485186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:09.492099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.493026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.493815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.495022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.495715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.496343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.513987 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] HTTP exception thrown: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Request method failure captured: Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a HTTP/1.1 Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8rvMGscT8GtSWK8LoPMzrLW07in3wErH8kC6QscnHzV_quR8WUjsBiY79Nadwgrya28-BW_6pUpOkVygvuz0qJYn002PW1JGtuQp3kxgFwNUyiCIvA36YsAOw1YAVq-7jZnPtYnetZ84ngWoQ48i8T5-WfylSbaZDKO9GEW6z09ro Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/085f1c568af5494c99a7ff3dd488f76a"}]}] Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8d122762f6a446279f6cdc0e66ab5daf Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '90178e3e-8064-49d5-bd94-5f733fe53d8a'} Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:09.517085 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.521469 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.526361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Returning 404 to user: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:09.527370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-76f1774d-78e0-4ff8-9e66-f55bdf797cd1 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "DELETE /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 404 len: 111 microversion: 2.1 time: 0.049234 Oct 27 09:31:09.534106 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2839/5739] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:09 2022] DELETE /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:31:09.546690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:09.547415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 90178e3e-8064-49d5-bd94-5f733fe53d8a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:09.572544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.572960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.573416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.574154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.586807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.589018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.642644 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] HTTP exception thrown: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Request method failure captured: Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a HTTP/1.1 Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8rvMGscT8GtSWK8LoPMzrLW07in3wErH8kC6QscnHzV_quR8WUjsBiY79Nadwgrya28-BW_6pUpOkVygvuz0qJYn002PW1JGtuQp3kxgFwNUyiCIvA36YsAOw1YAVq-7jZnPtYnetZ84ngWoQ48i8T5-WfylSbaZDKO9GEW6z09ro Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/085f1c568af5494c99a7ff3dd488f76a"}]}] Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8d122762f6a446279f6cdc0e66ab5daf Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '90178e3e-8064-49d5-bd94-5f733fe53d8a'} Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.648071 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.651927 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.651927 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.651927 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.651927 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:09.651927 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:09.651927 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. Oct 27 09:31:09.651927 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.654530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Returning 404 to user: Instance 90178e3e-8064-49d5-bd94-5f733fe53d8a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:09.655890 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bbe7f3bf-84c1-418b-aaa8-5aed1c1384d4 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a" status: 404 len: 111 microversion: 2.1 time: 0.118009 Oct 27 09:31:09.667520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:09.668849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:09.674635 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2901/5740] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:09 2022] GET /compute/v2.1/servers/90178e3e-8064-49d5-bd94-5f733fe53d8a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:09.679373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.682366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.683057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.684341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.685292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.685957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.738689 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] HTTP exception thrown: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Request method failure captured: Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 HTTP/1.1 Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8rvMGscT8GtSWK8LoPMzrLW07in3wErH8kC6QscnHzV_quR8WUjsBiY79Nadwgrya28-BW_6pUpOkVygvuz0qJYn002PW1JGtuQp3kxgFwNUyiCIvA36YsAOw1YAVq-7jZnPtYnetZ84ngWoQ48i8T5-WfylSbaZDKO9GEW6z09ro Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/085f1c568af5494c99a7ff3dd488f76a"}]}] Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8d122762f6a446279f6cdc0e66ab5daf Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '9433111c-e2e0-4887-91c0-88b7aacea098'} Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:09.741878 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.746043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Returning 404 to user: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:09.746740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4475962d-7efa-4d63-8801-81d9f6b8a371 tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 404 len: 111 microversion: 2.1 time: 0.083892 Oct 27 09:31:09.749290 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2840/5741] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:09 2022] DELETE /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:09.757412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:09.758045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] [instance: 9433111c-e2e0-4887-91c0-88b7aacea098] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:09.768733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.769243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.769864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.770759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:09.771514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:09.772223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:09.792692 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] HTTP exception thrown: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Request method failure captured: Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 HTTP/1.1 Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8rvMGscT8GtSWK8LoPMzrLW07in3wErH8kC6QscnHzV_quR8WUjsBiY79Nadwgrya28-BW_6pUpOkVygvuz0qJYn002PW1JGtuQp3kxgFwNUyiCIvA36YsAOw1YAVq-7jZnPtYnetZ84ngWoQ48i8T5-WfylSbaZDKO9GEW6z09ro Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/085f1c568af5494c99a7ff3dd488f76a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/085f1c568af5494c99a7ff3dd488f76a"}]}] Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 085f1c568af5494c99a7ff3dd488f76a Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1578064535 Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8d122762f6a446279f6cdc0e66ab5daf Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerDiskConfigTestJSON-1578064535-project Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '9433111c-e2e0-4887-91c0-88b7aacea098'} Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:09.794664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.798640 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:09.798640 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:09.798640 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:09.798640 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:09.798640 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:09.798640 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. Oct 27 09:31:09.798640 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:09.802308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] Returning 404 to user: Instance 9433111c-e2e0-4887-91c0-88b7aacea098 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:09.803401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a494310d-a43b-4f04-a8be-3b01b419754e tempest-ServerDiskConfigTestJSON-1578064535 tempest-ServerDiskConfigTestJSON-1578064535-project] 10.222.0.25 "GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098" status: 404 len: 111 microversion: 2.1 time: 0.051014 Oct 27 09:31:09.804481 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2902/5742] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:09 2022] GET /compute/v2.1/servers/9433111c-e2e0-4887-91c0-88b7aacea098 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:10.244576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2694f2b4-0e1e-48db-b956-19a655906934 req-b7760e7f-40af-46e4-a6a1-cf01ae4148fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab076d0-2bc7-41aa-aa63-c3c351810229", "name": "network-vif-deleted", "tag": "6bf65e73-b72e-4706-9d24-1fdf324db41f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:10.271015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2694f2b4-0e1e-48db-b956-19a655906934 req-b7760e7f-40af-46e4-a6a1-cf01ae4148fe service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.272386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2694f2b4-0e1e-48db-b956-19a655906934 req-b7760e7f-40af-46e4-a6a1-cf01ae4148fe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.273408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2694f2b4-0e1e-48db-b956-19a655906934 req-b7760e7f-40af-46e4-a6a1-cf01ae4148fe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:10.327944 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2694f2b4-0e1e-48db-b956-19a655906934 req-b7760e7f-40af-46e4-a6a1-cf01ae4148fe service nova] Creating event network-vif-deleted:6bf65e73-b72e-4706-9d24-1fdf324db41f for instance 4ab076d0-2bc7-41aa-aa63-c3c351810229 on n-h1-858383-16 Oct 27 09:31:10.343491 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2694f2b4-0e1e-48db-b956-19a655906934 req-b7760e7f-40af-46e4-a6a1-cf01ae4148fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103050 Oct 27 09:31:10.345691 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2841/5743] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:10.406245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:10.406929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:10.418415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.421615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.426633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:10.429465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.430306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.433751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:10.433983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:10.434715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:10.448406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.449271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.449938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:10.452679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.453387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.460316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:10.538701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.543433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.544162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:10.544752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lazy-loading 'fault' on Instance uuid 4ab076d0-2bc7-41aa-aa63-c3c351810229 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:31:10.703920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:10.725859 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-caa86759-128c-4939-8619-d136afff2ac3 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1491 microversion: 2.1 time: 0.322530 Oct 27 09:31:10.726959 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2903/5744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:10 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1491 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:10.737200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:10.750631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43535640-5bec-41c3-aba4-eed7678c849c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1384026835"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:10.753010 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-421609ba-d203-4a28-b2c0-a07bcc5e6d1b tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 200 len: 1304 microversion: 2.1 time: 0.323448 Oct 27 09:31:10.753680 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2842/5745] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:10 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 1304 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:10.753806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-43535640-5bec-41c3-aba4-eed7678c849c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:10.762554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43535640-5bec-41c3-aba4-eed7678c849c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.763368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43535640-5bec-41c3-aba4-eed7678c849c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.764101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43535640-5bec-41c3-aba4-eed7678c849c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:10.765210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43535640-5bec-41c3-aba4-eed7678c849c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.765934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43535640-5bec-41c3-aba4-eed7678c849c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.766570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43535640-5bec-41c3-aba4-eed7678c849c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:10.934054 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43535640-5bec-41c3-aba4-eed7678c849c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "PUT /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1076 microversion: 2.1 time: 0.186650 Oct 27 09:31:10.936839 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2904/5746] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 09:31:10 2022] PUT /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1076 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:10.968291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:10.968922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:10.978764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.979541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.980156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:10.981002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:10.982194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:10.982194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:11.295954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:11.307516 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea2a8c37-f125-4bfe-928c-d0495e339174 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1502 microversion: 2.1 time: 0.345899 Oct 27 09:31:11.308780 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2843/5747] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:10 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1502 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:11.345702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:11.346552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:11.353391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:11.354156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:11.354747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:11.355714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:11.356324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:11.356945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:11.680717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:11.700812 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f06cef4-6528-4c2e-8341-2ad361f1de17 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1502 microversion: 2.1 time: 0.367289 Oct 27 09:31:11.749663 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2905/5748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:11 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:11.751036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bde614ac-7037-415a-82a0-e4044a636d8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:11.792367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bde614ac-7037-415a-82a0-e4044a636d8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:11.792901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bde614ac-7037-415a-82a0-e4044a636d8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:11.793360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bde614ac-7037-415a-82a0-e4044a636d8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:11.795987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:11.805311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 4ab076d0-2bc7-41aa-aa63-c3c351810229] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:11.817238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:11.829959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:11.832997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:11.837621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:11.839172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:11.843279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:11.844603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:11.853575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bde614ac-7037-415a-82a0-e4044a636d8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Going to try to stop instance {{(pid=120603) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:31:11.915068 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] HTTP exception thrown: Instance 4ab076d0-2bc7-41aa-aa63-c3c351810229 could not be found. Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Request method failure captured: Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 HTTP/1.1 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk1NW1iFAG-q3IJ54oZWfKh3CNO_EF5jnXqA5GerkUeJ0txazj2zZzKz-nqsGtjcUfQhqSuw6yfredcMS8g-HG6ROlJPAHneL3NK_xneNortyFwBSnbXAd0hTWoUi0UNK79Omwrb2gPcxkPGuECxlTUoaG3jfeC-ZD9oWt5dtdc8Pbk Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4c5d43a28c24b63b960932c678d0858"}]}] Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9301fb54a8734e1ab31e496add7e9446 Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4ab076d0-2bc7-41aa-aa63-c3c351810229 could not be found. Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4ab076d0-2bc7-41aa-aa63-c3c351810229'} Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab076d0-2bc7-41aa-aa63-c3c351810229 could not be found. Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab076d0-2bc7-41aa-aa63-c3c351810229 could not be found. Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:11.924081 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:11.935891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:11.935891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:11.935891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:11.935891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:11.935891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:11.935891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab076d0-2bc7-41aa-aa63-c3c351810229 could not be found. Oct 27 09:31:11.935891 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:11.941154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Returning 404 to user: Instance 4ab076d0-2bc7-41aa-aa63-c3c351810229 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:11.946701 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-714bd99b-7acc-4015-8cc5-9949bc9daa77 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229" status: 404 len: 111 microversion: 2.1 time: 0.162914 Oct 27 09:31:11.957911 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2906/5749] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:11 2022] GET /compute/v2.1/servers/4ab076d0-2bc7-41aa-aa63-c3c351810229 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:11.967455 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bde614ac-7037-415a-82a0-e4044a636d8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "POST /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3/action" status: 202 len: 0 microversion: 2.1 time: 0.227362 Oct 27 09:31:11.979749 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2844/5750] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:31:11 2022] POST /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:31:11.994938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:12.011074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:12.027288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:12.032783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:12.033632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:12.034376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:12.035599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:12.036418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:12.037282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:12.046303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:12.093541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:12.094766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:12.095807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:12.097658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:12.098741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:12.099791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:12.132284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:31:12.262607 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46ffd764-0c7b-447a-a973-a10f9c6a2941 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 204 len: 0 microversion: 2.1 time: 0.302428 Oct 27 09:31:12.268672 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2907/5751] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:11 2022] DELETE /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:31:12.284788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:12.285751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:12.309170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:12.309664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:12.310576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:12.311291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:12.311970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:12.312390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:12.596253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:12.626139 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01b9cc9b-4757-4385-820f-46b06c778c0d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.643048 Oct 27 09:31:12.627266 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2845/5752] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:11 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:12.650898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1d52b995-7330-44e1-82fa-3637993be600 req-591eafdc-08a0-47e0-b23a-a6587c80fdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9a91c4-0af7-4057-9057-10e1f096b507", "tag": "09aae92a-6611-4dc3-a6bc-3ac924a97948"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:12.662327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1d52b995-7330-44e1-82fa-3637993be600 req-591eafdc-08a0-47e0-b23a-a6587c80fdf8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:12.663145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1d52b995-7330-44e1-82fa-3637993be600 req-591eafdc-08a0-47e0-b23a-a6587c80fdf8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:12.663839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1d52b995-7330-44e1-82fa-3637993be600 req-591eafdc-08a0-47e0-b23a-a6587c80fdf8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:12.691366 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1d52b995-7330-44e1-82fa-3637993be600 req-591eafdc-08a0-47e0-b23a-a6587c80fdf8 service nova] Creating event network-changed:09aae92a-6611-4dc3-a6bc-3ac924a97948 for instance aa9a91c4-0af7-4057-9057-10e1f096b507 on n-h2-858383-16 Oct 27 09:31:12.702056 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1d52b995-7330-44e1-82fa-3637993be600 req-591eafdc-08a0-47e0-b23a-a6587c80fdf8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058956 Oct 27 09:31:12.704704 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2846/5753] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:12.848130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:12.858992 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3682f3c4-61bd-4ad3-813e-98f8bdfa579d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1495 microversion: 2.1 time: 0.588127 Oct 27 09:31:12.860357 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2908/5754] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:12 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1495 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:13.658482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:13.659276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:13.673521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:13.676682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:13.677450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:13.680412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:13.681251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:13.682912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:13.891813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:13.895361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:13.910022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:13.911487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:13.912201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:13.913242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:13.915032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:13.916411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:14.926839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:14.949058 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0e05d09e-6b09-4865-9677-840c23df7dc7 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 200 len: 1495 microversion: 2.1 time: 1.067233 Oct 27 09:31:14.949973 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2909/5755] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:13 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 1495 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:14.991121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-59e2c0be-e663-49b3-9363-6bfa9aebc5c6 req-f17e6c49-3f22-4384-813c-33a788de55d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "229acc83-2e36-452f-a088-78560d42493e", "name": "network-vif-deleted", "tag": "1532eda3-7b97-4b5d-a7a5-5dc7177de918"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:15.025939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-59e2c0be-e663-49b3-9363-6bfa9aebc5c6 req-f17e6c49-3f22-4384-813c-33a788de55d0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:15.026435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-59e2c0be-e663-49b3-9363-6bfa9aebc5c6 req-f17e6c49-3f22-4384-813c-33a788de55d0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:15.026926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-59e2c0be-e663-49b3-9363-6bfa9aebc5c6 req-f17e6c49-3f22-4384-813c-33a788de55d0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:15.051669 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-59e2c0be-e663-49b3-9363-6bfa9aebc5c6 req-f17e6c49-3f22-4384-813c-33a788de55d0 service nova] Creating event network-vif-deleted:1532eda3-7b97-4b5d-a7a5-5dc7177de918 for instance 229acc83-2e36-452f-a088-78560d42493e on n-h2-858383-16 Oct 27 09:31:15.068580 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-59e2c0be-e663-49b3-9363-6bfa9aebc5c6 req-f17e6c49-3f22-4384-813c-33a788de55d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081057 Oct 27 09:31:15.072586 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2910/5756] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:15.232069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:15.294327 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9af196fe-3aae-4f09-bda1-4adc7f31842b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 1.638812 Oct 27 09:31:15.297125 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2847/5757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:13 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:15.989848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:15.990780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: 229acc83-2e36-452f-a088-78560d42493e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:16.013563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:16.014073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:16.019075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:16.020495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:16.022698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:16.024427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:16.074274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] HTTP exception thrown: Instance 229acc83-2e36-452f-a088-78560d42493e could not be found. Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Request method failure captured: Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e HTTP/1.1 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk1NW1iFAG-q3IJ54oZWfKh3CNO_EF5jnXqA5GerkUeJ0txazj2zZzKz-nqsGtjcUfQhqSuw6yfredcMS8g-HG6ROlJPAHneL3NK_xneNortyFwBSnbXAd0hTWoUi0UNK79Omwrb2gPcxkPGuECxlTUoaG3jfeC-ZD9oWt5dtdc8Pbk Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4c5d43a28c24b63b960932c678d0858"}]}] Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9301fb54a8734e1ab31e496add7e9446 Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 229acc83-2e36-452f-a088-78560d42493e could not be found. Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '229acc83-2e36-452f-a088-78560d42493e'} Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 229acc83-2e36-452f-a088-78560d42493e could not be found. Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 229acc83-2e36-452f-a088-78560d42493e could not be found. Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:16.079688 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:16.085175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:16.085175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:16.085175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:16.085175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:16.085175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:16.085175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 229acc83-2e36-452f-a088-78560d42493e could not be found. Oct 27 09:31:16.085175 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:16.091824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Returning 404 to user: Instance 229acc83-2e36-452f-a088-78560d42493e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:16.093109 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3a69420c-65f7-45c0-88ff-7d8e4b1452bc tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e" status: 404 len: 111 microversion: 2.1 time: 0.110012 Oct 27 09:31:16.100001 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2911/5758] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:15 2022] GET /compute/v2.1/servers/229acc83-2e36-452f-a088-78560d42493e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:16.106068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:16.107010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:16.121248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:16.123586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:16.124288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:16.125268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:16.125972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:16.126762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:16.156143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:31:16.324259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:16.326081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:16.334691 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c853ad5-5bfa-4fdb-b1e3-7f40b333f5d3 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 204 len: 0 microversion: 2.1 time: 0.235487 Oct 27 09:31:16.346377 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2848/5759] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:16 2022] DELETE /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:31:16.361246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:16.362722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:16.365601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:16.369196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:16.372118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:16.373323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:16.373980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:16.378716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:16.392991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:16.393508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:16.393962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:16.394683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:16.395337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:16.395969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:17.144442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:17.151634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:17.154999 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3a4fcf74-b1e9-4689-b0df-23cecf3f7553 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.836013 Oct 27 09:31:17.157291 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2912/5760] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:16 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:17.173740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e3167919-aac8-4041-aab4-2d0e558ed8c8 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1673 microversion: 2.1 time: 0.822994 Oct 27 09:31:17.174782 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2849/5761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:16 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1673 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:17.595216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7ca0f1ac-4b04-4c42-8d64-3cf9b38f8660 req-f801cdcd-e7f7-4c51-bdc6-ec116c19e9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9a91c4-0af7-4057-9057-10e1f096b507", "tag": "09aae92a-6611-4dc3-a6bc-3ac924a97948"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:17.628851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7ca0f1ac-4b04-4c42-8d64-3cf9b38f8660 req-f801cdcd-e7f7-4c51-bdc6-ec116c19e9b2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:17.631604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7ca0f1ac-4b04-4c42-8d64-3cf9b38f8660 req-f801cdcd-e7f7-4c51-bdc6-ec116c19e9b2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:17.632353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7ca0f1ac-4b04-4c42-8d64-3cf9b38f8660 req-f801cdcd-e7f7-4c51-bdc6-ec116c19e9b2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:17.671295 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7ca0f1ac-4b04-4c42-8d64-3cf9b38f8660 req-f801cdcd-e7f7-4c51-bdc6-ec116c19e9b2 service nova] Creating event network-changed:09aae92a-6611-4dc3-a6bc-3ac924a97948 for instance aa9a91c4-0af7-4057-9057-10e1f096b507 on n-h2-858383-16 Oct 27 09:31:17.679022 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7ca0f1ac-4b04-4c42-8d64-3cf9b38f8660 req-f801cdcd-e7f7-4c51-bdc6-ec116c19e9b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327838 Oct 27 09:31:17.683968 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2913/5762] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:18.182719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:18.183702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:18.205700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:18.207906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:18.210766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:18.212093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:18.212706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:18.213162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:18.483892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc1465ab-d797-47b8-9a2a-b4a7cec126b8 tempest-ExtensionsTest-1415440379 tempest-ExtensionsTest-1415440379-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:18.489240 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc1465ab-d797-47b8-9a2a-b4a7cec126b8 tempest-ExtensionsTest-1415440379 tempest-ExtensionsTest-1415440379-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.341245 Oct 27 09:31:18.492338 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2850/5763] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Oct 27 09:31:18 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:18.505873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:18.506522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:18.527037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:18.527594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:18.528052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:18.533122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:18.533716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:18.534431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:18.695931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:18.723539 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e71f63a0-77d2-48c2-a8a1-5a03c9afb4a9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.546605 Oct 27 09:31:18.730076 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2914/5764] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:18 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:18.769017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da3819ba-3c7d-4d50-826b-d457a2f34503 tempest-ExtensionsTest-1415440379 tempest-ExtensionsTest-1415440379-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:18.783002 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da3819ba-3c7d-4d50-826b-d457a2f34503 tempest-ExtensionsTest-1415440379 tempest-ExtensionsTest-1415440379-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.044911 Oct 27 09:31:18.785738 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2915/5765] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Oct 27 09:31:18 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:31:19.675364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:19.698437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-770e3e65-723d-48b8-ab2a-2008d53e4d64 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1673 microversion: 2.1 time: 1.203950 Oct 27 09:31:19.699287 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2851/5766] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:18 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1673 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:19.756361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:19.757271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:19.760302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-812cd9d6-097d-48eb-8286-3fae835480a6 req-90c48ad4-4af3-4d94-9465-5c2e79e78326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9a91c4-0af7-4057-9057-10e1f096b507", "tag": "09aae92a-6611-4dc3-a6bc-3ac924a97948"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:19.780038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:19.780549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:19.786958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-812cd9d6-097d-48eb-8286-3fae835480a6 req-90c48ad4-4af3-4d94-9465-5c2e79e78326 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:19.787352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-812cd9d6-097d-48eb-8286-3fae835480a6 req-90c48ad4-4af3-4d94-9465-5c2e79e78326 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:19.787847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-812cd9d6-097d-48eb-8286-3fae835480a6 req-90c48ad4-4af3-4d94-9465-5c2e79e78326 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:19.791062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:19.795878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:19.796513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:19.796980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:19.830965 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-812cd9d6-097d-48eb-8286-3fae835480a6 req-90c48ad4-4af3-4d94-9465-5c2e79e78326 service nova] Creating event network-changed:09aae92a-6611-4dc3-a6bc-3ac924a97948 for instance aa9a91c4-0af7-4057-9057-10e1f096b507 on n-h2-858383-16 Oct 27 09:31:19.848855 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-812cd9d6-097d-48eb-8286-3fae835480a6 req-90c48ad4-4af3-4d94-9465-5c2e79e78326 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094121 Oct 27 09:31:19.850027 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2852/5767] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:20.571219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:20.588765 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bf14a1ee-aaf3-4970-afb8-3b92a37dce01 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.839409 Oct 27 09:31:20.600749 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2916/5768] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:19 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:20.727098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:20.728783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:20.736554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:20.738927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:20.739651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:20.741368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:20.741895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:20.742965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:20.861376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:20.877743 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c7a489e-10fd-45b2-96d7-95fa240bfff0 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1605 microversion: 2.1 time: 0.156380 Oct 27 09:31:20.891639 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2853/5769] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:20 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:21.198402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5ba4c881-277a-4068-a250-a19fe96c8666 req-3439f353-a3f8-4a02-baeb-be467269245f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985", "name": "network-vif-deleted", "tag": "60d3bf40-b24a-4c84-8b49-73fc632d2272"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:21.221744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5ba4c881-277a-4068-a250-a19fe96c8666 req-3439f353-a3f8-4a02-baeb-be467269245f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:21.222245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5ba4c881-277a-4068-a250-a19fe96c8666 req-3439f353-a3f8-4a02-baeb-be467269245f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:21.222692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5ba4c881-277a-4068-a250-a19fe96c8666 req-3439f353-a3f8-4a02-baeb-be467269245f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:21.317293 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5ba4c881-277a-4068-a250-a19fe96c8666 req-3439f353-a3f8-4a02-baeb-be467269245f service nova] Creating event network-vif-deleted:60d3bf40-b24a-4c84-8b49-73fc632d2272 for instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 on n-h2-858383-16 Oct 27 09:31:21.337836 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-5ba4c881-277a-4068-a250-a19fe96c8666 req-3439f353-a3f8-4a02-baeb-be467269245f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143593 Oct 27 09:31:21.353162 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2917/5770] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:21.617982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:21.619899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:21.637047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:21.638858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:21.639395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:21.641315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:21.641988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:21.644041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:21.910569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:21.911167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:21.920419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:21.920924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:21.921381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:21.922112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:21.922574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:21.923014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:21.997582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:22.001824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:22.002533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:22.003206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lazy-loading 'fault' on Instance uuid dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:31:22.017317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:22.031711 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8268740-4029-47dd-92f2-c42356fbdfce tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.423449 Oct 27 09:31:22.038002 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2854/5771] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:21 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:22.099104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9301fb54a8734e1ab31e496add7e9446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c5d43a28c24b63b960932c678d0858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:22.115149 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bacd3901-960a-4b51-b13b-3f01a6c04edf tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 200 len: 1327 microversion: 2.1 time: 0.209425 Oct 27 09:31:22.119803 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2918/5772] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:21 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 1327 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:23.063028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:23.063673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:23.073373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:23.074251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:23.074869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:23.076249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:23.077495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:23.078308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:23.147709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:23.148949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] [instance: dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:23.158882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:23.161235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:23.162704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:23.163951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:23.165913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:23.166988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:23.190760 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] HTTP exception thrown: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 could not be found. Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Request method failure captured: Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 HTTP/1.1 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk1NW1iFAG-q3IJ54oZWfKh3CNO_EF5jnXqA5GerkUeJ0txazj2zZzKz-nqsGtjcUfQhqSuw6yfredcMS8g-HG6ROlJPAHneL3NK_xneNortyFwBSnbXAd0hTWoUi0UNK79Omwrb2gPcxkPGuECxlTUoaG3jfeC-ZD9oWt5dtdc8Pbk Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4c5d43a28c24b63b960932c678d0858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4c5d43a28c24b63b960932c678d0858"}]}] Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: b4c5d43a28c24b63b960932c678d0858 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-666323554 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9301fb54a8734e1ab31e496add7e9446 Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-666323554-project Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 could not be found. Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985'} Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 could not be found. Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 could not be found. Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:23.193479 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:23.198508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:23.198508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:23.198508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:23.198508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:23.198508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:23.198508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 could not be found. Oct 27 09:31:23.198508 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:23.201508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Returning 404 to user: Instance dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:23.203171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b020f718-ec3e-4fbe-8e17-ca6a78788eb2 tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985" status: 404 len: 111 microversion: 2.1 time: 0.063411 Oct 27 09:31:23.204262 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2919/5773] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:23 2022] GET /compute/v2.1/servers/dfc0e8b6-f97a-4cc6-b6c4-8e54475f8985 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:23.214977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-74ae7700-afff-45ab-829a-c4695b21ce8d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] Calling method '.version_select at 0x7f31a94f71f0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:23.243616 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-74ae7700-afff-45ab-829a-c4695b21ce8d tempest-ServerActionsTestJSON-666323554 tempest-ServerActionsTestJSON-666323554-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-110512966" status: 202 len: 0 microversion: 2.1 time: 0.035024 Oct 27 09:31:23.244902 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2920/5774] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:31:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-110512966 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:31:23.371357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:23.384741 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3e114a4-e553-46b6-be0b-663313cce551 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.325651 Oct 27 09:31:23.399596 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2855/5775] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:23 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:24.420104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:24.422643 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:24.447926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:24.448472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:24.448849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:24.453738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:24.454236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:24.454830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:24.979386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:24.997110 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3960de25-17ca-4d33-8cdb-7c87988f667e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.592251 Oct 27 09:31:25.015864 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2921/5776] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:24 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:26.029859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:26.030531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:26.050530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:26.051035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:26.051586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:26.052386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:26.052868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:26.053308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:26.618911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:26.630471 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45e8325b-3b82-40a7-b199-18997e4bcd6d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.604501 Oct 27 09:31:26.631233 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2856/5777] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:26 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:27.657609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:27.658372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:27.669610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:27.670569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:27.674780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:27.675846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:27.678855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:27.680199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:27.748641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:28.518134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:28.527535 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8fa9aa28-c920-473d-a989-5c8587495648 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.873820 Oct 27 09:31:28.536255 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2922/5778] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:27 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:29.566999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:29.569076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:29.600196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:29.604269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:29.605407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:29.608783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:29.610781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:29.611709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:30.949567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:30.962484 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8a324bc-fbad-47b1-894e-fd8eaff4e122 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 1.403373 Oct 27 09:31:30.963872 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2857/5779] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:29 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:32.016544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:32.017863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:32.033625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:32.033988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:32.034437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:32.035162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:32.035646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:32.036086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:33.018784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:33.048559 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a328833-7d50-4683-9a06-de33f1ba672b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 1.035659 Oct 27 09:31:33.059696 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2923/5780] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:32 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:34.080408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:34.081697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:34.091074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:34.092600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:34.093328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:34.098982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:34.099818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:34.100422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:34.366861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:34.377126 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e991674-5b32-4f2b-b95b-ea343b1d3888 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.300578 Oct 27 09:31:34.383836 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2858/5781] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:34 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:35.414747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:35.416496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:35.424474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:35.425351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:35.426180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:35.427010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:35.427732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:35.428432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:36.180580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:36.192109 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a436f71b-7ed5-42e4-b49b-a0aca1e817f6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.782007 Oct 27 09:31:36.209566 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2924/5782] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:35 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:37.220666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:37.222628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:37.235952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:37.236517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:37.236936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:37.237737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:37.238197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:37.243924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:37.694963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:37.704113 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2404e170-e69c-445e-b95e-2a7d1a4b71e6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1512 microversion: 2.1 time: 0.488939 Oct 27 09:31:37.706752 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2859/5783] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:37 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:38.451057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2003392228", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a86786c2-c174-4a75-a492-956aa309832d"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:38.469148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:38.562701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] validate_networks() for [('a86786c2-c174-4a75-a492-956aa309832d', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:31:38.727592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:38.729071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:38.741954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:38.744332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:38.749735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:38.756227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:38.763787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:38.764791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:38.814222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:39.468223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:39.481151 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1633569-32d3-47db-be26-67a0c88aa3ea tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1489 microversion: 2.1 time: 0.757725 Oct 27 09:31:39.493520 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2860/5784] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:38 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1489 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:39.508145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-58d933e0-8b21-41e4-b2b6-2ef3e8a58180 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1603898834"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:39.511251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-58d933e0-8b21-41e4-b2b6-2ef3e8a58180 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:39.524061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:39.525641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58d933e0-8b21-41e4-b2b6-2ef3e8a58180 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:39.531456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58d933e0-8b21-41e4-b2b6-2ef3e8a58180 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:39.532059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58d933e0-8b21-41e4-b2b6-2ef3e8a58180 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:39.532937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58d933e0-8b21-41e4-b2b6-2ef3e8a58180 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:39.533535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58d933e0-8b21-41e4-b2b6-2ef3e8a58180 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:39.534072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-58d933e0-8b21-41e4-b2b6-2ef3e8a58180 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:39.731796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:31:39.733000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:31:39.733789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:31:39.734363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:31:39.734986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:31:39.737711 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-58d933e0-8b21-41e4-b2b6-2ef3e8a58180 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "PUT /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1062 microversion: 2.1 time: 0.233465 Oct 27 09:31:39.744136 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2861/5785] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 09:31:39 2022] PUT /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1062 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:39.763181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:39.764032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:39.766616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:39.768195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:39.769127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:39.770690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:39.771719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:39.773059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:39.782950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:39.788549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:39.789245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:39.790182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:39.791207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:39.792117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:39.809397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Getting quotas for project 7891348e553f48e881fbd5ed0cb399cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:31:39.819064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Getting quotas for user 3c23ef023b744339afbd8e7d205f1adf and project 7891348e553f48e881fbd5ed0cb399cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:31:39.845437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Going to run 2 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:31:39.853295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: d583e7ad-7baa-456c-90e2-d691b584737c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:31:39.957970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=d583e7ad-7baa-456c-90e2-d691b584737c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:31:40.112419 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a7362cbc-93ae-4f80-ae72-f4301804596d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.211268 Oct 27 09:31:40.113683 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2925/5786] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:31:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:31:40.125448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:40.143345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:40.145986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Searching by: {'deleted': False, 'project_id': '7891348e553f48e881fbd5ed0cb399cf'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:31:40.251451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:40.251993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:40.252439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:40.254321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:40.254793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:40.261182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:40.264875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:40.278344 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8be1795c-f3c8-4f7d-ab1e-16d78beb2de9 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1489 microversion: 2.1 time: 0.515260 Oct 27 09:31:40.279975 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2862/5787] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:39 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1489 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:40.318165 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c500f81b-7291-46b8-b573-a4fa86d58089 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.196465 Oct 27 09:31:40.319419 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2926/5788] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:31:40 2022] GET /compute/v2.1/servers => generated 677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:31:40.322151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:40.323132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:40.331560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:40.343041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:40.343506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:40.344288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:40.344755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:40.347069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aafe8ddf-f89e-45f7-832c-459964d6ecc6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:40.347769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aafe8ddf-f89e-45f7-832c-459964d6ecc6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:40.352087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:40.526075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aafe8ddf-f89e-45f7-832c-459964d6ecc6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:40.553007 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aafe8ddf-f89e-45f7-832c-459964d6ecc6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1220 microversion: 2.1 time: 0.218731 Oct 27 09:31:40.554207 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2927/5789] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:40 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1220 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:40.986596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:41.016876 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4431149f-279f-4043-819e-9c9dabf3904c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1489 microversion: 2.1 time: 0.703748 Oct 27 09:31:41.024117 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2863/5790] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:40 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1489 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:41.052570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:41.054271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:41.069060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:41.072423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:41.080103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:41.081204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:41.081939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:41.088033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:41.171519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:31:41.415273 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3bbddfc8-7cb7-4b29-9265-980a76263062 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 204 len: 0 microversion: 2.1 time: 0.373401 Oct 27 09:31:41.423129 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2928/5791] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:41 2022] DELETE /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:31:41.425699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:41.426538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:41.447473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:41.450625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:41.451342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:41.452100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:41.452568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:41.455557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:41.581535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93405514-3f18-466d-a3c3-19fd3de4cd22 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:41.582316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-93405514-3f18-466d-a3c3-19fd3de4cd22 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:41.932892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-93405514-3f18-466d-a3c3-19fd3de4cd22 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:41.942629 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-93405514-3f18-466d-a3c3-19fd3de4cd22 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1220 microversion: 2.1 time: 0.365503 Oct 27 09:31:41.958505 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2929/5792] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:41 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1220 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:41.965927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1217336846", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "a4294d48-d66a-402f-bbac-b3287ad64d54"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:42.097252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:42.121613 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-506d63ee-6672-43fa-9e23-f9e7990d9baa tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1495 microversion: 2.1 time: 0.686445 Oct 27 09:31:42.125479 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2864/5793] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:41 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1495 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:42.174219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] validate_networks() for [('a4294d48-d66a-402f-bbac-b3287ad64d54', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:31:42.968913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:42.969527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:42.999689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:43.000240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:43.000780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:43.001516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:43.004148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:43.004686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:43.293054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:43.302552 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9daa2c58-4ac7-45b0-90e3-a7d4cc55338f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1272 microversion: 2.1 time: 0.337817 Oct 27 09:31:43.325025 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2865/5794] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:42 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:43.333380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:43.333380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:43.388198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:43.419047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:43.422095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:43.423185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:43.426012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:43.427122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:44.513665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:31:44.514439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:31:44.514709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:31:44.515126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:31:44.515539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:31:44.534399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:44.534895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:44.535336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:44.536118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:44.536580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:44.537009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:44.611461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Getting quotas for project d6312352490a4276a1bba8a35e96529c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:31:44.622282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Getting quotas for user 513175c80e154bc9a48e7ebc9ddd021f and project d6312352490a4276a1bba8a35e96529c. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:31:44.651988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:31:44.654606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:31:44.764274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f1c1bcf0-15a2-4e72-ada8-e3c12f93018b tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.804499 Oct 27 09:31:44.764944 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2930/5795] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:31:44.785581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:44.786194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:44.836358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:44.839909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:44.841023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:44.842913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:44.844118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:44.845088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:44.867635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:44.881567 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3daa46cc-c567-48ab-86fc-1fac351a673c tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1495 microversion: 2.1 time: 1.567838 Oct 27 09:31:44.886528 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2866/5796] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:43 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1495 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:44.908499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8dca5052-68f9-4110-89bc-108a2ccc75e6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:44.912657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8dca5052-68f9-4110-89bc-108a2ccc75e6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:45.255172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:45.267777 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59d08505-2275-48b4-95eb-1f99e39b6c49 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1278 microversion: 2.1 time: 0.485939 Oct 27 09:31:45.269084 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2931/5797] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:44 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1278 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:45.483013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8dca5052-68f9-4110-89bc-108a2ccc75e6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:45.492413 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8dca5052-68f9-4110-89bc-108a2ccc75e6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1214 microversion: 2.1 time: 0.602394 Oct 27 09:31:45.493253 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2867/5798] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:44 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1214 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:45.686842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f46148ac-ba3f-4c30-a651-bc0e035ea7ba req-1a1e21e3-6ca0-433a-bb80-ab87fa8d0a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405ba9d1-a37f-4060-8488-62e5fcea9bb3", "name": "network-vif-deleted", "tag": "9cffa956-5507-414c-a2fc-fcd1f31af850"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:45.714342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f46148ac-ba3f-4c30-a651-bc0e035ea7ba req-1a1e21e3-6ca0-433a-bb80-ab87fa8d0a05 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:45.715099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f46148ac-ba3f-4c30-a651-bc0e035ea7ba req-1a1e21e3-6ca0-433a-bb80-ab87fa8d0a05 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:45.716860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f46148ac-ba3f-4c30-a651-bc0e035ea7ba req-1a1e21e3-6ca0-433a-bb80-ab87fa8d0a05 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:45.755104 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f46148ac-ba3f-4c30-a651-bc0e035ea7ba req-1a1e21e3-6ca0-433a-bb80-ab87fa8d0a05 service nova] Creating event network-vif-deleted:9cffa956-5507-414c-a2fc-fcd1f31af850 for instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 on n-h1-858383-16 Oct 27 09:31:45.769238 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f46148ac-ba3f-4c30-a651-bc0e035ea7ba req-1a1e21e3-6ca0-433a-bb80-ab87fa8d0a05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086919 Oct 27 09:31:45.770375 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2932/5799] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:45.923295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:45.923965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:45.948748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:45.951544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:45.952198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:45.953965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:45.954651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:45.957646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:46.081494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:46.082266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:46.082909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:46.084847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lazy-loading 'fault' on Instance uuid 405ba9d1-a37f-4060-8488-62e5fcea9bb3 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:31:46.301363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:46.302516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:46.319261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:46.320302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:46.320759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:46.324508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:46.326261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:46.326792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:46.654570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:46.670446 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b6653ae-16ae-4096-9289-6364ad9896d6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 200 len: 1310 microversion: 2.1 time: 0.756106 Oct 27 09:31:46.686092 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2868/5800] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:45 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 1310 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:46.695907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:46.696830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:46.703166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:46.704106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:46.705755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:46.706692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:46.707359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:46.708125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:46.783368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:46.806781 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fffa6bf1-0ad2-442e-b883-46b1bb7ded9b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1278 microversion: 2.1 time: 0.507447 Oct 27 09:31:46.809615 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2933/5801] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:46 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1278 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:47.022810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:47.044482 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-882eef89-f23e-41cb-b18d-4cea073603d3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1266 microversion: 2.1 time: 0.350223 Oct 27 09:31:47.045124 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2869/5802] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:46 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:47.697538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:47.698457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:47.720270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:47.721105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:47.721766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:47.722770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:47.723450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:47.724111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:47.760617 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 HTTP/1.1 Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '405ba9d1-a37f-4060-8488-62e5fcea9bb3'} Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:47.762662 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.766783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:47.766783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:47.766783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:47.766783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:47.766783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:47.766783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.766783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.773103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:47.774484 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b7329591-fa2d-45cd-a168-7cad4140e6d2 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 404 len: 111 microversion: 2.1 time: 0.081190 Oct 27 09:31:47.782440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2934/5803] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:47 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:47.793526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:47.794033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:47.805198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:47.805698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:47.806140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:47.806851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:47.807306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:47.807764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:47.838531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:47.840962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:47.850849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:47.851187 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 HTTP/1.1 Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '405ba9d1-a37f-4060-8488-62e5fcea9bb3'} Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:47.852949 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.856670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:47.864379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:47.865435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:47.869682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:47.870917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:47.871732 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91fa0e52-9f54-428d-a208-cb74595faf94 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 404 len: 111 microversion: 2.1 time: 0.064807 Oct 27 09:31:47.872765 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2870/5804] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:47 2022] DELETE /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:47.873428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:47.880790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:47.882192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 405ba9d1-a37f-4060-8488-62e5fcea9bb3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:47.895136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:47.895659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:47.896975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:47.896975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:47.897533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:47.897689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:47.968739 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 HTTP/1.1 Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '405ba9d1-a37f-4060-8488-62e5fcea9bb3'} Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:47.970360 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 405ba9d1-a37f-4060-8488-62e5fcea9bb3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-52594e80-80fb-4948-b05b-d24f51441026 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3" status: 404 len: 111 microversion: 2.1 time: 0.095038 Oct 27 09:31:47.975252 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2871/5805] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:47 2022] GET /compute/v2.1/servers/405ba9d1-a37f-4060-8488-62e5fcea9bb3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:31:47.980299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:47.980796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:47.999048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:47.999549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.000016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.000731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.001193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.001621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.048136 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 HTTP/1.1 Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '91d8c34f-411b-482d-9b7d-d21353f09769'} Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:48.049815 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.054848 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.058939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:48.063148 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ba4d4cb-677e-453b-a237-e5130b5a0990 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 404 len: 111 microversion: 2.1 time: 0.083377 Oct 27 09:31:48.068065 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2872/5806] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:47 2022] DELETE /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:31:48.075426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.075924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:48.100956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.102413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.103332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.104929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.105561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.106431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.366552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:48.383819 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11333733-b844-49c2-9474-555873cf71f2 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1272 microversion: 2.1 time: 0.311702 Oct 27 09:31:48.386802 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2873/5807] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:48 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:48.404413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:48.412090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.413684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 91d8c34f-411b-482d-9b7d-d21353f09769] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:48.417606 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed5551d5-4106-4e41-a3e9-824c3763f03e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1278 microversion: 2.1 time: 0.583330 Oct 27 09:31:48.423497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.424584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.427160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.428845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.429654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.430257 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2935/5808] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:47 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1278 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:48.433338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.451708 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 HTTP/1.1 Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '91d8c34f-411b-482d-9b7d-d21353f09769'} Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.454157 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.457984 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.457984 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.457984 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.457984 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:48.457984 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:48.457984 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. Oct 27 09:31:48.457984 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.460731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 91d8c34f-411b-482d-9b7d-d21353f09769 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:48.463598 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-810c0a82-51c4-4d00-9f92-4a3131ca41e7 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769" status: 404 len: 111 microversion: 2.1 time: 0.074723 Oct 27 09:31:48.465588 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2874/5809] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:48 2022] GET /compute/v2.1/servers/91d8c34f-411b-482d-9b7d-d21353f09769 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:48.474554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.477406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:48.487147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.487664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.488113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.488835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.489297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.489725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.526015 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e HTTP/1.1 Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '55191f9f-2b1b-46e7-93bd-5070540d8c4e'} Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:48.528301 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.532367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:48.533584 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf206c10-31a0-4545-961b-c9ae945bdc2a tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 404 len: 111 microversion: 2.1 time: 0.062636 Oct 27 09:31:48.535594 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2936/5810] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:48 2022] DELETE /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:48.543796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.544567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 55191f9f-2b1b-46e7-93bd-5070540d8c4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:48.562698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.564337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.564848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.567834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.570171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.570655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.608673 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e HTTP/1.1 Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '55191f9f-2b1b-46e7-93bd-5070540d8c4e'} Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.611887 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.617786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.617786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.617786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.617786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:48.617786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:48.617786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. Oct 27 09:31:48.617786 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.617786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 55191f9f-2b1b-46e7-93bd-5070540d8c4e could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:48.617786 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-288a229b-ab67-40f0-910f-9cef37aab9b1 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e" status: 404 len: 111 microversion: 2.1 time: 0.076223 Oct 27 09:31:48.618906 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2875/5811] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:48 2022] GET /compute/v2.1/servers/55191f9f-2b1b-46e7-93bd-5070540d8c4e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:48.623968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.624543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:48.636222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.638158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.638961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.641101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.642460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.644861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.685578 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d HTTP/1.1 Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7e68043a-aca2-4e06-9a37-6f4f20abdf3d'} Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:48.691778 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.695725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.697440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:48.698466 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18c0f2b7-799e-4683-95ad-28866155fb98 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 404 len: 111 microversion: 2.1 time: 0.078901 Oct 27 09:31:48.700143 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2937/5812] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:48 2022] DELETE /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:31:48.708978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.710921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 7e68043a-aca2-4e06-9a37-6f4f20abdf3d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:48.719392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.720304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.720949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.721872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.722661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.723297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.740226 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d HTTP/1.1 Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7e68043a-aca2-4e06-9a37-6f4f20abdf3d'} Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.742193 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.746930 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.746930 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.746930 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.746930 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:48.746930 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:48.746930 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. Oct 27 09:31:48.746930 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.748514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 7e68043a-aca2-4e06-9a37-6f4f20abdf3d could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:48.749746 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f48b2bf-5020-4e96-9054-86604ea69a8d tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d" status: 404 len: 111 microversion: 2.1 time: 0.045496 Oct 27 09:31:48.750908 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2876/5813] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:48 2022] GET /compute/v2.1/servers/7e68043a-aca2-4e06-9a37-6f4f20abdf3d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:48.759443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.760509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:48.769088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.769907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.770534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.771487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.773439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.774452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.794368 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 HTTP/1.1 Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3'} Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:48.796964 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.801014 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.805786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:48.807029 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a6ea123-78aa-4e19-857d-6893dffebffb tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 404 len: 111 microversion: 2.1 time: 0.052303 Oct 27 09:31:48.808237 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2938/5814] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:48 2022] DELETE /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:48.821789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.823059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:48.829466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.830057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.832228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.833226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.833770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.838239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.880204 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 HTTP/1.1 Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3'} Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.884715 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.889734 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.889734 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.889734 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.889734 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:48.889734 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:48.889734 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. Oct 27 09:31:48.889734 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.897020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:48.898081 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33fc8a93-5225-454e-bcc7-7e7686b4b954 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3" status: 404 len: 111 microversion: 2.1 time: 0.085743 Oct 27 09:31:48.899134 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2877/5815] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:48 2022] GET /compute/v2.1/servers/4c7045d4-5fe3-4a4a-8d42-a4cf8d4346d3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:48.907363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.907900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:48.917600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.917980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.920830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.921760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:48.922394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:48.932991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:48.959995 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 HTTP/1.1 Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '32c35c8c-0b6a-49be-83eb-166e68b77291'} Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:48.967803 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:48.972453 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:48.976074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:48.983875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7306cc00-2c6d-4c43-adf9-0b49820fe45b tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 404 len: 111 microversion: 2.1 time: 0.079808 Oct 27 09:31:48.984756 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2939/5816] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:48 2022] DELETE /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:48.995330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:48.996348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 32c35c8c-0b6a-49be-83eb-166e68b77291] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:49.016092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.017251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.019530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:49.023934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.024737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.025350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:49.058228 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 HTTP/1.1 Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '32c35c8c-0b6a-49be-83eb-166e68b77291'} Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:49.060309 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.064971 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:49.064971 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:49.064971 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:49.064971 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:49.064971 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:49.064971 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. Oct 27 09:31:49.064971 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.064971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 32c35c8c-0b6a-49be-83eb-166e68b77291 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:49.073735 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4238a5f9-20ad-4a94-8881-a5115e22ebcf tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291" status: 404 len: 111 microversion: 2.1 time: 0.076388 Oct 27 09:31:49.075377 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2878/5817] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:48 2022] GET /compute/v2.1/servers/32c35c8c-0b6a-49be-83eb-166e68b77291 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:49.083210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-55c19f29-73f9-4b45-b66b-c2f1672c500e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:49.083996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-55c19f29-73f9-4b45-b66b-c2f1672c500e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: debdabf8-e414-4374-9148-99c78ea2892c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:49.091650 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-55c19f29-73f9-4b45-b66b-c2f1672c500e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-55c19f29-73f9-4b45-b66b-c2f1672c500e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c HTTP/1.1 Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'debdabf8-e414-4374-9148-99c78ea2892c'} Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:49.095555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.100657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:49.100657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:49.100657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:49.100657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:49.100657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:49.100657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.100657 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.106317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-55c19f29-73f9-4b45-b66b-c2f1672c500e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:49.107348 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-55c19f29-73f9-4b45-b66b-c2f1672c500e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c" status: 404 len: 111 microversion: 2.1 time: 0.028100 Oct 27 09:31:49.111896 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2940/5818] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:49 2022] DELETE /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:49.117364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b1feaae-0da1-4f48-9c7e-702c1b301ad6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:49.118201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b1feaae-0da1-4f48-9c7e-702c1b301ad6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: debdabf8-e414-4374-9148-99c78ea2892c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:49.129705 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6b1feaae-0da1-4f48-9c7e-702c1b301ad6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b1feaae-0da1-4f48-9c7e-702c1b301ad6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c HTTP/1.1 Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'debdabf8-e414-4374-9148-99c78ea2892c'} Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:49.132645 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:49.137803 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:49.137803 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:49.137803 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:49.137803 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. Oct 27 09:31:49.137803 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:31:49.137803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b1feaae-0da1-4f48-9c7e-702c1b301ad6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance debdabf8-e414-4374-9148-99c78ea2892c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:49.138983 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b1feaae-0da1-4f48-9c7e-702c1b301ad6 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c" status: 404 len: 111 microversion: 2.1 time: 0.026011 Oct 27 09:31:49.144938 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2879/5819] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:49 2022] GET /compute/v2.1/servers/debdabf8-e414-4374-9148-99c78ea2892c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:49.153946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:49.154937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:49.164107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.169064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.174251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:49.177816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.179139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.180004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:49.228733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:31:49.411399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:49.413794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:49.424761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.425832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.434316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:49.436971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.438046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.439889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:49.490377 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc455d4f-8e3a-4afe-a599-c581962a9d50 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "DELETE /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 204 len: 0 microversion: 2.1 time: 0.345523 Oct 27 09:31:49.490967 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2941/5820] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:49 2022] DELETE /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:31:49.498615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:49.499411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:49.515061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.515559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.516443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:49.517230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.517689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.518115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:49.699241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:49.733827 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b80454e-7e55-42e1-8396-74b64a055db4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1272 microversion: 2.1 time: 0.326921 Oct 27 09:31:49.735862 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2880/5821] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:49 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:49.751637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:49.752968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:49.767202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.768278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.772503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:49.774225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:49.776221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:49.777415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:50.392925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:50.406641 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c52364a-badf-4f68-b0c1-b30e99608083 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1320 microversion: 2.1 time: 0.914311 Oct 27 09:31:50.412979 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2942/5822] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:49 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1320 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:50.433516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:50.436991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:50.455603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:50.456111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:50.456720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:50.457527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:50.457996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:50.458430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:50.499687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:50.512888 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45812aac-0be0-46b3-9f1a-5209aced9d54 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1480 microversion: 2.1 time: 0.773498 Oct 27 09:31:50.513488 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2881/5823] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:49 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1480 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:50.520104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c014c2d7-ef29-4bfc-8c8d-b5a0f07e7975 req-fc9dd2e9-49bd-4597-b765-e5363c8f2cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9a91c4-0af7-4057-9057-10e1f096b507", "tag": "09aae92a-6611-4dc3-a6bc-3ac924a97948"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:50.540471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:31:50.578673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c014c2d7-ef29-4bfc-8c8d-b5a0f07e7975 req-fc9dd2e9-49bd-4597-b765-e5363c8f2cb1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:50.582952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c014c2d7-ef29-4bfc-8c8d-b5a0f07e7975 req-fc9dd2e9-49bd-4597-b765-e5363c8f2cb1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:50.584454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c014c2d7-ef29-4bfc-8c8d-b5a0f07e7975 req-fc9dd2e9-49bd-4597-b765-e5363c8f2cb1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:50.634386 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c014c2d7-ef29-4bfc-8c8d-b5a0f07e7975 req-fc9dd2e9-49bd-4597-b765-e5363c8f2cb1 service nova] Creating event network-changed:09aae92a-6611-4dc3-a6bc-3ac924a97948 for instance aa9a91c4-0af7-4057-9057-10e1f096b507 on n-h2-858383-16 Oct 27 09:31:50.648588 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c014c2d7-ef29-4bfc-8c8d-b5a0f07e7975 req-fc9dd2e9-49bd-4597-b765-e5363c8f2cb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131677 Oct 27 09:31:50.651451 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2882/5824] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:50.693969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:50.761177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:50.761893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:50.780108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:50.782882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:50.783353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:50.784150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:50.789588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:50.790660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:50.849754 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33100f28-a6c2-4809-817c-9ea7198a9ba3 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 204 len: 0 microversion: 2.1 time: 0.419858 Oct 27 09:31:50.853473 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2943/5825] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:31:50 2022] DELETE /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:31:50.881049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:50.882214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:50.899740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:50.902414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:50.902881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:50.903704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:50.904175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:50.904606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:51.592662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:51.606492 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f3b5b1ec-0e17-430d-9bad-03ccb4ba4aca tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1583 microversion: 2.1 time: 0.746739 Oct 27 09:31:51.607155 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2944/5826] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:50 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1583 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:51.620013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:51.624072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:51.639268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:51.639823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:51.640274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:51.645153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:51.645658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:51.646109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:51.824552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:51.837042 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4db3d135-89c2-4063-bbfe-a071ed0816af tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1314 microversion: 2.1 time: 1.082137 Oct 27 09:31:51.839490 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2883/5827] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:50 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1314 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:51.844386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:51.845009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:51.866823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:51.885565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:51.886390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:51.887345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:51.888493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:51.889146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:51.892619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:52.608983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:52.633321 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b895b9d-3b8c-4aef-9a1f-9982c884a06f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1320 microversion: 2.1 time: 1.023646 Oct 27 09:31:52.634264 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2945/5828] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:51 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1320 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:52.640521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:52.641471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:52.649406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:52.654647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:52.655266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:52.656413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:52.657078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:52.657693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:52.768019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:52.778078 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-821c49cf-ddd6-47a2-aa9c-38f67041ef2e tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1480 microversion: 2.1 time: 0.937418 Oct 27 09:31:52.779888 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2884/5829] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:51 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1480 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:52.863101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:52.863933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:52.874854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:52.875819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:52.876494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:52.878275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:52.878967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:52.879718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:53.758314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:53.767056 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-165be713-5d88-43cc-8dde-b3387a8e3561 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1314 microversion: 2.1 time: 0.907783 Oct 27 09:31:53.787028 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2885/5830] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:52 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1314 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:53.793058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:53.793201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:53.820109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:53.820856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:53.822458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:53.824713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:53.825409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:53.827781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:54.403495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:54.413899 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86216576-f9cd-4973-8c38-04820ef98ecc tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1583 microversion: 2.1 time: 1.777490 Oct 27 09:31:54.417450 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2946/5831] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:52 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1583 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:54.428451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:54.430188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:54.452424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:54.453157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:54.454029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:54.454988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:54.455713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:54.460388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:54.590946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:54.642197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=16 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:55.018878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:55.055849 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6fd85635-0b89-4c02-9824-87841cbf6db9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1320 microversion: 2.1 time: 1.265757 Oct 27 09:31:55.057179 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2886/5832] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:53 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1320 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:55.065909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a028f758-5f24-49b8-b872-1dfa8fd6bc80 req-415c6d3f-b08d-4213-bb72-215eab7c140c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d583e7ad-7baa-456c-90e2-d691b584737c", "tag": "32fcebb9-ff7e-4b0b-9acd-fea83b6c49dc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:55.082305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a028f758-5f24-49b8-b872-1dfa8fd6bc80 req-415c6d3f-b08d-4213-bb72-215eab7c140c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:55.083766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a028f758-5f24-49b8-b872-1dfa8fd6bc80 req-415c6d3f-b08d-4213-bb72-215eab7c140c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:55.084658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a028f758-5f24-49b8-b872-1dfa8fd6bc80 req-415c6d3f-b08d-4213-bb72-215eab7c140c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:55.099219 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a028f758-5f24-49b8-b872-1dfa8fd6bc80 req-415c6d3f-b08d-4213-bb72-215eab7c140c service nova] Creating event network-changed:32fcebb9-ff7e-4b0b-9acd-fea83b6c49dc for instance d583e7ad-7baa-456c-90e2-d691b584737c on n-h2-858383-16 Oct 27 09:31:55.107490 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a028f758-5f24-49b8-b872-1dfa8fd6bc80 req-415c6d3f-b08d-4213-bb72-215eab7c140c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048348 Oct 27 09:31:55.108564 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2887/5833] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:55.116105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:55.117234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:55.138713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:55.139617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:55.140284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:55.141533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:55.142222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:55.143107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:55.491070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:55.503079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993f47058e6d48f7ac30138be91496c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0440a7838f46d182ae8186f2a1d45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:55.517831 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-41eb0190-fca3-43d1-af81-f1964eef01ff tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 200 len: 1480 microversion: 2.1 time: 1.096810 Oct 27 09:31:55.521046 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2947/5834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:54 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 1480 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:56.042287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5344bfdc-3296-48d6-adf8-ce2ae9f4d3f4 tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Action: 'create', calling method: .version_select at 0x7f31a9192af0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:56.056911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:UPDATE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:56.095503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5344bfdc-3296-48d6-adf8-ce2ae9f4d3f4 tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Getting quotas for project 95e4d59b292544cca44d9ae3dabfe400. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:31:56.110785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5344bfdc-3296-48d6-adf8-ce2ae9f4d3f4 tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Getting quotas for user 3dc4ac235c544e65bcd3bce08bf9ca36 and project 95e4d59b292544cca44d9ae3dabfe400. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:31:56.231664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:56.245468 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c63feb1-33a7-4183-bc00-9696a8d00ba1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1314 microversion: 2.1 time: 1.133323 Oct 27 09:31:56.248626 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2888/5835] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:55 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1314 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:56.295437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:56.296285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:56.337286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5344bfdc-3296-48d6-adf8-ce2ae9f4d3f4 tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Getting quotas for project 95e4d59b292544cca44d9ae3dabfe400. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:31:56.337994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:56.342663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:56.343349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:56.349080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:56.349561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:56.350626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:56.380664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5344bfdc-3296-48d6-adf8-ce2ae9f4d3f4 tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Getting quotas for user 3dc4ac235c544e65bcd3bce08bf9ca36 and project 95e4d59b292544cca44d9ae3dabfe400. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:31:56.442926 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5344bfdc-3296-48d6-adf8-ce2ae9f4d3f4 tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.919955 Oct 27 09:31:56.450103 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2948/5836] 10.222.0.25 () {62 vars in 1214 bytes} [Thu Oct 27 09:31:55 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:31:56.655183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:56.658685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-313bfcdc-d650-4cfd-8ebb-c40b17c32dff req-283944df-48bc-4b5d-b233-c45f7b0770c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa9a91c4-0af7-4057-9057-10e1f096b507", "name": "network-vif-deleted", "tag": "09aae92a-6611-4dc3-a6bc-3ac924a97948"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:56.665460 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1e4c4647-f8b9-4a2e-90c0-4a179d99eee5 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1228 microversion: 2.1 time: 0.397781 Oct 27 09:31:56.665982 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2889/5837] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:56 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1228 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:56.686402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:56.687033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:56.688463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-313bfcdc-d650-4cfd-8ebb-c40b17c32dff req-283944df-48bc-4b5d-b233-c45f7b0770c3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:56.689220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-313bfcdc-d650-4cfd-8ebb-c40b17c32dff req-283944df-48bc-4b5d-b233-c45f7b0770c3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:56.689958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-313bfcdc-d650-4cfd-8ebb-c40b17c32dff req-283944df-48bc-4b5d-b233-c45f7b0770c3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:56.703709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:56.704220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:56.704665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:56.705380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:56.705845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:56.706275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:56.733616 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-313bfcdc-d650-4cfd-8ebb-c40b17c32dff req-283944df-48bc-4b5d-b233-c45f7b0770c3 service nova] Creating event network-vif-deleted:09aae92a-6611-4dc3-a6bc-3ac924a97948 for instance aa9a91c4-0af7-4057-9057-10e1f096b507 on n-h2-858383-16 Oct 27 09:31:56.747207 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-313bfcdc-d650-4cfd-8ebb-c40b17c32dff req-283944df-48bc-4b5d-b233-c45f7b0770c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294747 Oct 27 09:31:56.751023 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2949/5838] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:56.763092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c9e717c-7fcf-4c99-8705-b2fbe2c9fdd2 tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:56.817709 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c9e717c-7fcf-4c99-8705-b2fbe2c9fdd2 tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.065036 Oct 27 09:31:56.819624 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2950/5839] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Oct 27 09:31:56 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:31:56.825605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:56.826817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] [instance: 841496a0-aacf-4f9c-8522-94dd6f501ba7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:56.851729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:56.852449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:56.853232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:56.854289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:56.854971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:56.855616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:56.873867 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] HTTP exception thrown: Instance 841496a0-aacf-4f9c-8522-94dd6f501ba7 could not be found. Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Request method failure captured: Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 HTTP/1.1 Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk8GIcCD16ci3eba4gLYqLUXJusSohK6CdgwU9KKce3KwKYpW0FPcvbzkYpSp9RA2t0ibaFU8G6Gh6r777gmPqmm0jkqywnrTQUh0J_aq24ccXcocGBWt-VxLgF05Syj2nrjmcaOpOTQNKJ4UG68DhXAE3PkOhVybyeKgvh96QuA4AU Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e0440a7838f46d182ae8186f2a1d45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e0440a7838f46d182ae8186f2a1d45f"}]}] Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersTestJSON-1631056954 Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 6e0440a7838f46d182ae8186f2a1d45f Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersTestJSON-1631056954 Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 993f47058e6d48f7ac30138be91496c5 Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersTestJSON-1631056954-project Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 841496a0-aacf-4f9c-8522-94dd6f501ba7 could not be found. Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '841496a0-aacf-4f9c-8522-94dd6f501ba7'} Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841496a0-aacf-4f9c-8522-94dd6f501ba7 could not be found. Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841496a0-aacf-4f9c-8522-94dd6f501ba7 could not be found. Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:56.876416 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:56.882986 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:56.882986 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:56.882986 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:56.882986 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:56.882986 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:56.882986 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841496a0-aacf-4f9c-8522-94dd6f501ba7 could not be found. Oct 27 09:31:56.882986 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:56.887542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] Returning 404 to user: Instance 841496a0-aacf-4f9c-8522-94dd6f501ba7 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:56.888819 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e2c44ce-6a96-4e99-a24b-d6027ed8cd55 tempest-ServersTestJSON-1631056954 tempest-ServersTestJSON-1631056954-project] 10.222.0.25 "GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7" status: 404 len: 111 microversion: 2.1 time: 0.068003 Oct 27 09:31:56.889542 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2951/5840] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:56 2022] GET /compute/v2.1/servers/841496a0-aacf-4f9c-8522-94dd6f501ba7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:31:56.899059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be61ea61-0ba1-46b2-bcf8-cd5521b68f7c tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:56.913711 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be61ea61-0ba1-46b2-bcf8-cd5521b68f7c tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/b3ff6b61-ebf8-424d-8cf1-476cfd90aea1" status: 200 len: 235 microversion: 2.64 time: 0.022091 Oct 27 09:31:56.914671 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2952/5841] 10.222.0.25 () {60 vars in 1304 bytes} [Thu Oct 27 09:31:56 2022] GET /compute/v2.1/os-server-groups/b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 => generated 235 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:31:56.929243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28571342-ec21-4c6b-afec-277c14af06cb tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:56.976407 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28571342-ec21-4c6b-afec-277c14af06cb tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/b3ff6b61-ebf8-424d-8cf1-476cfd90aea1" status: 204 len: 0 microversion: 2.64 time: 0.053479 Oct 27 09:31:56.985356 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2953/5842] 10.222.0.25 () {60 vars in 1307 bytes} [Thu Oct 27 09:31:56 2022] DELETE /compute/v2.1/os-server-groups/b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:31:56.996515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49856680-e466-4048-9e54-530b36d7b84c tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:57.005166 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-49856680-e466-4048-9e54-530b36d7b84c tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] HTTP exception thrown: Instance group b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 could not be found. Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49856680-e466-4048-9e54-530b36d7b84c tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Request method failure captured: Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-server-groups/b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 HTTP/1.1 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlALuQ2iRTvnsmC-CyraLJYMXjOYaADzmnNwcqoXMaDZ-tiyIXdveYahVaXha3pNuZ3XqxFXao1DrwtzkZseD83cOGq7fCFQjjSho9sD0BNHSHs8cv13S4_STZJK-NZ57X66M_4mLSr36ka5A-WgCvUdKRv07KPWEOEls-y-osA_8ko Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Openstack-Nova-Api-Version: 2.64 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 95e4d59b292544cca44d9ae3dabfe400 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerGroup264TestJSON-2095951630 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95e4d59b292544cca44d9ae3dabfe400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95e4d59b292544cca44d9ae3dabfe400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95e4d59b292544cca44d9ae3dabfe400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95e4d59b292544cca44d9ae3dabfe400"}]}] Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerGroup264TestJSON-2095951630 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 95e4d59b292544cca44d9ae3dabfe400 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2095951630 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerGroup264TestJSON-2095951630-project Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 3dc4ac235c544e65bcd3bce08bf9ca36 Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerGroup264TestJSON-2095951630-project Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance group b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 could not be found. Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'b3ff6b61-ebf8-424d-8cf1-476cfd90aea1'} Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 could not be found. Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 could not be found. Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:57.029260 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:31:57.034228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:31:57.034228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:31:57.034228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:31:57.034228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:31:57.034228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 could not be found. Oct 27 09:31:57.034228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:31:57.034228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49856680-e466-4048-9e54-530b36d7b84c tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] Returning 404 to user: Instance group b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:31:57.034228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49856680-e466-4048-9e54-530b36d7b84c tempest-ServerGroup264TestJSON-2095951630 tempest-ServerGroup264TestJSON-2095951630-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/b3ff6b61-ebf8-424d-8cf1-476cfd90aea1" status: 404 len: 117 microversion: 2.64 time: 0.043712 Oct 27 09:31:57.036523 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2954/5843] 10.222.0.25 () {60 vars in 1307 bytes} [Thu Oct 27 09:31:56 2022] DELETE /compute/v2.1/os-server-groups/b3ff6b61-ebf8-424d-8cf1-476cfd90aea1 => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:31:57.155208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5d5cc9d0-bd23-4e1c-a389-371b4a7160d4 req-78a4ca6e-61aa-4ae0-9b38-864a769c6dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841496a0-aacf-4f9c-8522-94dd6f501ba7", "name": "network-vif-deleted", "tag": "bb38a11e-0d4a-4785-ab1b-3f9c7e87be4a"}, {"name": "network-changed", "server_uuid": "ffc3c9ad-4379-4584-bdcc-a0edc7474b01", "tag": "7e11bc69-6608-4933-b3e6-680e5c6551f7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:57.185996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5d5cc9d0-bd23-4e1c-a389-371b4a7160d4 req-78a4ca6e-61aa-4ae0-9b38-864a769c6dd4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:57.186487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5d5cc9d0-bd23-4e1c-a389-371b4a7160d4 req-78a4ca6e-61aa-4ae0-9b38-864a769c6dd4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:57.189613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5d5cc9d0-bd23-4e1c-a389-371b4a7160d4 req-78a4ca6e-61aa-4ae0-9b38-864a769c6dd4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:57.223676 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5d5cc9d0-bd23-4e1c-a389-371b4a7160d4 req-78a4ca6e-61aa-4ae0-9b38-864a769c6dd4 service nova] Creating event network-vif-deleted:bb38a11e-0d4a-4785-ab1b-3f9c7e87be4a for instance 841496a0-aacf-4f9c-8522-94dd6f501ba7 on n-h1-858383-16 Oct 27 09:31:57.228331 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5d5cc9d0-bd23-4e1c-a389-371b4a7160d4 req-78a4ca6e-61aa-4ae0-9b38-864a769c6dd4 service nova] Creating event network-changed:7e11bc69-6608-4933-b3e6-680e5c6551f7 for instance ffc3c9ad-4379-4584-bdcc-a0edc7474b01 on n-h1-858383-16 Oct 27 09:31:57.246108 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-5d5cc9d0-bd23-4e1c-a389-371b4a7160d4 req-78a4ca6e-61aa-4ae0-9b38-864a769c6dd4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.094472 Oct 27 09:31:57.249074 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2955/5844] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:57.275876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:57.276585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:57.292313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:57.292862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:57.293316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:57.296900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:57.297394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:57.297833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:57.308438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:57.324819 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0dd274af-945d-4d6b-b003-033d45227fd7 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1320 microversion: 2.1 time: 0.645109 Oct 27 09:31:57.325683 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2890/5845] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:56 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1320 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:57.696923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:57.698700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:57.710146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:57.712368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:57.712987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:57.729624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:57.735090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:57.736029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:58.230801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:58.246212 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8599b2a9-b942-43a1-9e74-7bb697906f30 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1228 microversion: 2.1 time: 0.555725 Oct 27 09:31:58.246966 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2891/5846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:57 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1228 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:58.351466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:58.352831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:58.363585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:58.364336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:58.364950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:58.372696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:58.373454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:58.374096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:58.414915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:58.435764 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd56bf89-4ee4-418b-9b8b-de711e36a4a0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1314 microversion: 2.1 time: 1.164745 Oct 27 09:31:58.452593 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2956/5847] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:57 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1314 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:58.763896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a1f94ea0-f3a7-4596-ab3a-7de57f1c8207 req-8b65ff79-6035-43fb-9345-44df96df1254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "078ee78e-9270-441f-b5ff-21a9809356fe", "tag": "9f278dec-829b-4f52-b4dd-88bcb1567cbd"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:31:58.782164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a1f94ea0-f3a7-4596-ab3a-7de57f1c8207 req-8b65ff79-6035-43fb-9345-44df96df1254 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:58.784125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a1f94ea0-f3a7-4596-ab3a-7de57f1c8207 req-8b65ff79-6035-43fb-9345-44df96df1254 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:58.786585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a1f94ea0-f3a7-4596-ab3a-7de57f1c8207 req-8b65ff79-6035-43fb-9345-44df96df1254 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:58.811827 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a1f94ea0-f3a7-4596-ab3a-7de57f1c8207 req-8b65ff79-6035-43fb-9345-44df96df1254 service nova] Creating event network-changed:9f278dec-829b-4f52-b4dd-88bcb1567cbd for instance 078ee78e-9270-441f-b5ff-21a9809356fe on n-h2-858383-16 Oct 27 09:31:58.822601 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a1f94ea0-f3a7-4596-ab3a-7de57f1c8207 req-8b65ff79-6035-43fb-9345-44df96df1254 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062463 Oct 27 09:31:58.825491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2957/5848] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:31:58.962669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:58.978243 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-90e5464b-b39c-4fa8-be45-b5ee387b9ca4 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1320 microversion: 2.1 time: 0.630689 Oct 27 09:31:58.981093 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2892/5849] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:58 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1320 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:31:59.282350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:59.283830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:59.302095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:59.306822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:59.307903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:59.311340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:59.313509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:59.314341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:59.562359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:31:59.573048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:59.574814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:31:59.581753 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6226a01f-06e1-49bc-b5a8-7dca48525300 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1228 microversion: 2.1 time: 0.309206 Oct 27 09:31:59.597654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:59.597945 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2958/5850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:59 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1228 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:59.600868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:59.601336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:31:59.602083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:31:59.602571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:31:59.602990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:00.006866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:00.007823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:00.022144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:00.024428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:00.025153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:00.028183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:00.028909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:00.030648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:00.713919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:00.728314 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4969ce0b-48cb-4da4-810b-3de25d39f107 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1314 microversion: 2.1 time: 1.158934 Oct 27 09:32:00.730925 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2893/5851] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:31:59 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1314 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:00.743489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:00.747778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:00.761915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:00.763774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:00.764902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:00.767496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:00.768323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:00.769881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:01.270222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:01.292398 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c87a8bac-5015-40da-9cf7-8a25b56f5699 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1228 microversion: 2.1 time: 0.557703 Oct 27 09:32:01.293209 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2894/5852] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:00 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1228 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:01.757778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:01.758603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:01.769186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:01.772487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:01.773027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:01.774412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:01.777277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:01.787403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:02.048574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:02.058251 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-992ca75f-6184-4dbf-b249-34f294fb422c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1320 microversion: 2.1 time: 2.055552 Oct 27 09:32:02.069616 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2959/5853] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:00 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1320 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:02.321414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:02.322055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:02.334332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:02.335613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:02.335613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:02.341210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:02.341210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:02.341210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:02.718860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:02.737379 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3debd46a-afe9-4930-bed1-6652967dba24 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1228 microversion: 2.1 time: 0.422241 Oct 27 09:32:02.744479 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2960/5854] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:02 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1228 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:03.089073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:03.097668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:03.113646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:03.118019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:03.118685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:03.119720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:03.120592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:03.124274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:03.887669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:03.904043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d81ce27d-6ea0-4460-a6ca-2b7733c714ef tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1314 microversion: 2.1 time: 2.148575 Oct 27 09:32:03.907181 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2895/5855] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:01 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1314 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:03.925036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0cdcbbac-791c-4fd0-bfa4-1fc9451a057f req-d5e0b8a3-6a9b-4b3f-84e1-cd66264786e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc3c9ad-4379-4584-bdcc-a0edc7474b01", "name": "network-vif-plugged", "status": "completed", "tag": "7e11bc69-6608-4933-b3e6-680e5c6551f7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:03.946709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0cdcbbac-791c-4fd0-bfa4-1fc9451a057f req-d5e0b8a3-6a9b-4b3f-84e1-cd66264786e2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:03.947526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0cdcbbac-791c-4fd0-bfa4-1fc9451a057f req-d5e0b8a3-6a9b-4b3f-84e1-cd66264786e2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:03.948257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0cdcbbac-791c-4fd0-bfa4-1fc9451a057f req-d5e0b8a3-6a9b-4b3f-84e1-cd66264786e2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:03.962662 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0cdcbbac-791c-4fd0-bfa4-1fc9451a057f req-d5e0b8a3-6a9b-4b3f-84e1-cd66264786e2 service nova] Creating event network-vif-plugged:7e11bc69-6608-4933-b3e6-680e5c6551f7 for instance ffc3c9ad-4379-4584-bdcc-a0edc7474b01 on n-h1-858383-16 Oct 27 09:32:03.970200 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0cdcbbac-791c-4fd0-bfa4-1fc9451a057f req-d5e0b8a3-6a9b-4b3f-84e1-cd66264786e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061405 Oct 27 09:32:03.971556 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2896/5856] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:03.979966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:03.981102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:03.990624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:03.991475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:03.992187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:03.993200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:03.993994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:03.994822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:04.034459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:04.035621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:04.036554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:04.038618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lazy-loading 'fault' on Instance uuid aa9a91c4-0af7-4057-9057-10e1f096b507 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:32:04.390132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed1067cc8c9463ba493811eaf51c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82508c6b5aa427eb96983ffde2a63ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:04.403488 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7abf7162-7cff-495a-b20a-9ceac1a0fdc7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 200 len: 1187 microversion: 2.1 time: 0.429648 Oct 27 09:32:04.404130 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2897/5857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:03 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 1187 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:04.678890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:04.688454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b2e86519-f3cc-4a27-a7be-d2391aa1709c tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1320 microversion: 2.1 time: 1.604541 Oct 27 09:32:04.692531 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2961/5858] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:03 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1320 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:04.930179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:04.931650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:04.941288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:04.942026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:04.942677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:04.944131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:04.944759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:04.945522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:05.227327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:05.243114 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff05ea65-69a4-4c93-9adf-31ab5d78fed8 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1314 microversion: 2.1 time: 0.317745 Oct 27 09:32:05.243774 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2898/5859] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:04 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:05.432510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:05.433130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] [instance: aa9a91c4-0af7-4057-9057-10e1f096b507] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:05.444209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:05.445719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:05.446989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:05.447971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:05.448617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:05.449861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:05.472480 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] HTTP exception thrown: Instance aa9a91c4-0af7-4057-9057-10e1f096b507 could not be found. Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Request method failure captured: Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 HTTP/1.1 Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk66rvdK_QvVndF1ZsQCOWFR_7bymKxWBnmh6BOZ01hv0zBQTxiPdtU5P-jfz1QymBSy4e2xlopD3HwIv3UFqri5ooEo9OvrIDMdrekR29RcgKGKdYA0YqvYFvSlZy7Bb3qvVKO0MZrZ8ddYRsnWEGw0cuKVMEal_WRekinaMz5tOA0 Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: e82508c6b5aa427eb96983ffde2a63ae Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestVolumeBackupRestore-1614452774 Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e82508c6b5aa427eb96983ffde2a63ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e82508c6b5aa427eb96983ffde2a63ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e82508c6b5aa427eb96983ffde2a63ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e82508c6b5aa427eb96983ffde2a63ae"}]}] Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestVolumeBackupRestore-1614452774 Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: e82508c6b5aa427eb96983ffde2a63ae Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1614452774 Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestVolumeBackupRestore-1614452774-project Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0ed1067cc8c9463ba493811eaf51c1f0 Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestVolumeBackupRestore-1614452774-project Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance aa9a91c4-0af7-4057-9057-10e1f096b507 could not be found. Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'aa9a91c4-0af7-4057-9057-10e1f096b507'} Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa9a91c4-0af7-4057-9057-10e1f096b507 could not be found. Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa9a91c4-0af7-4057-9057-10e1f096b507 could not be found. Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:05.475216 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:05.479988 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:05.479988 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:05.479988 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:05.479988 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:32:05.479988 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:32:05.479988 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa9a91c4-0af7-4057-9057-10e1f096b507 could not be found. Oct 27 09:32:05.479988 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:05.481700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Returning 404 to user: Instance aa9a91c4-0af7-4057-9057-10e1f096b507 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:05.482737 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1dae5f33-e058-4f74-926c-001000d61df7 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507" status: 404 len: 111 microversion: 2.1 time: 0.055825 Oct 27 09:32:05.483817 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2962/5860] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:05 2022] GET /compute/v2.1/servers/aa9a91c4-0af7-4057-9057-10e1f096b507 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:32:05.719309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:05.720119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:05.747789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:05.749021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:05.749727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:05.753963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:05.756899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:05.757649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:06.079542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-da1f043e-f33d-49ab-839d-10a432839d19 req-54e81c44-9171-4a85-8185-9e153d01b898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d583e7ad-7baa-456c-90e2-d691b584737c", "name": "network-vif-plugged", "status": "completed", "tag": "32fcebb9-ff7e-4b0b-9acd-fea83b6c49dc"}, {"server_uuid": "078ee78e-9270-441f-b5ff-21a9809356fe", "name": "network-vif-plugged", "status": "completed", "tag": "9f278dec-829b-4f52-b4dd-88bcb1567cbd"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:06.129516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-da1f043e-f33d-49ab-839d-10a432839d19 req-54e81c44-9171-4a85-8185-9e153d01b898 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:06.129516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-da1f043e-f33d-49ab-839d-10a432839d19 req-54e81c44-9171-4a85-8185-9e153d01b898 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:06.130025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-da1f043e-f33d-49ab-839d-10a432839d19 req-54e81c44-9171-4a85-8185-9e153d01b898 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:06.145630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-da1f043e-f33d-49ab-839d-10a432839d19 req-54e81c44-9171-4a85-8185-9e153d01b898 service nova] Creating event network-vif-plugged:32fcebb9-ff7e-4b0b-9acd-fea83b6c49dc for instance d583e7ad-7baa-456c-90e2-d691b584737c on n-h2-858383-16 Oct 27 09:32:06.147242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-da1f043e-f33d-49ab-839d-10a432839d19 req-54e81c44-9171-4a85-8185-9e153d01b898 service nova] Creating event network-vif-plugged:9f278dec-829b-4f52-b4dd-88bcb1567cbd for instance 078ee78e-9270-441f-b5ff-21a9809356fe on n-h2-858383-16 Oct 27 09:32:06.154656 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-da1f043e-f33d-49ab-839d-10a432839d19 req-54e81c44-9171-4a85-8185-9e153d01b898 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085235 Oct 27 09:32:06.155686 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2963/5861] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:06.272598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:06.273474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:06.283888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:06.288503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:06.289088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:06.296060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:06.296898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:06.297461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:06.408150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:06.537647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:06.552021 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12a4f2ed-ca7f-4d0d-bbba-3846b642417f tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1320 microversion: 2.1 time: 0.838001 Oct 27 09:32:06.570870 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2899/5862] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:05 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1320 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:06.584663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ce9febc-4bad-4aa5-a4ab-25951a86ddf2 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] Calling method '.version_select at 0x7f31aa358280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:06.660778 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ce9febc-4bad-4aa5-a4ab-25951a86ddf2 tempest-TestVolumeBackupRestore-1614452774 tempest-TestVolumeBackupRestore-1614452774-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-799152563" status: 202 len: 0 microversion: 2.1 time: 0.087882 Oct 27 09:32:06.661547 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2900/5863] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:32:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-799152563 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:32:06.888990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:06.901663 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-339857ec-74c4-42ae-b2b5-cf4a7e63c78c tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1314 microversion: 2.1 time: 0.635000 Oct 27 09:32:06.912841 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2964/5864] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:06 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:07.581403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:07.584107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:07.601323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:07.604436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:07.605611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:07.606517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:07.607004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:07.607616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:07.928948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:07.929668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:07.956632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:07.960456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:07.961106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:07.961971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:07.962963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:07.963701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:08.227207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:08.254551 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95594e02-997f-4216-bc5e-f0fac343f87b tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 200 len: 1506 microversion: 2.1 time: 0.679016 Oct 27 09:32:08.287791 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2901/5865] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:07 2022] GET /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:08.294048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:08.295102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: d583e7ad-7baa-456c-90e2-d691b584737c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:08.307947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:08.309042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:08.331197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:08.339853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:08.341190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:08.341970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:08.654548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:08.673136 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2deb931c-7215-4456-b6c7-9779d9d7e327 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1314 microversion: 2.1 time: 0.747831 Oct 27 09:32:08.675961 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2965/5866] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:07 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:08.950933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:08.961649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:08.983139 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea11b493-02e0-48bb-b810-8359c4cc30c2 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/d583e7ad-7baa-456c-90e2-d691b584737c" status: 200 len: 1320 microversion: 2.1 time: 0.694064 Oct 27 09:32:08.999331 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2902/5867] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:08 2022] GET /compute/v2.1/servers/d583e7ad-7baa-456c-90e2-d691b584737c => generated 1320 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:09.705180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:09.706344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:09.740637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:09.742724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:09.749884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:09.761358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:09.765092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:09.767680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:10.026668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:10.027288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: d583e7ad-7baa-456c-90e2-d691b584737c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:10.031137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:10.060262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:10.060773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:10.061225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:10.061974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:10.062399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:10.062838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:10.779255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:10.793557 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-04f04489-591a-49b2-8a8a-700b6974678e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1497 microversion: 2.1 time: 1.094443 Oct 27 09:32:10.794805 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2966/5868] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:09 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1497 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:10.905842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:10.930067 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f022698-f261-4c7b-b083-5db6cd7278d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/d583e7ad-7baa-456c-90e2-d691b584737c" status: 200 len: 1507 microversion: 2.1 time: 0.908454 Oct 27 09:32:10.934309 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2903/5869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:10 2022] GET /compute/v2.1/servers/d583e7ad-7baa-456c-90e2-d691b584737c => generated 1507 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:10.963316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:10.964105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: d583e7ad-7baa-456c-90e2-d691b584737c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:10.977137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:10.980272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:10.980927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:10.981985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:10.983710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:10.984927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:11.042446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: d583e7ad-7baa-456c-90e2-d691b584737c] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:32:11.103339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:11.229899 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84b68f37-7193-4a08-aabd-5da7fc6c65f8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d583e7ad-7baa-456c-90e2-d691b584737c" status: 204 len: 0 microversion: 2.1 time: 0.270174 Oct 27 09:32:11.234409 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2967/5870] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:32:10 2022] DELETE /compute/v2.1/servers/d583e7ad-7baa-456c-90e2-d691b584737c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:11.243081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:11.243671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:11.259124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:11.259752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:11.260413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:11.261349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:11.262740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:11.263382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:11.335296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: ffc3c9ad-4379-4584-bdcc-a0edc7474b01] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:32:11.575392 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b66e0823-aece-43af-b235-fa96d277f363 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01" status: 204 len: 0 microversion: 2.1 time: 0.333972 Oct 27 09:32:11.588809 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2904/5871] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:32:11 2022] DELETE /compute/v2.1/servers/ffc3c9ad-4379-4584-bdcc-a0edc7474b01 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:11.887296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:11.888359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1544160473", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a86786c2-c174-4a75-a492-956aa309832d"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:11.889520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:11.906852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:11.908788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:11.911498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:11.912760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:11.916274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:11.917782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:12.022199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:32:12.041389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] validate_networks() for [('a86786c2-c174-4a75-a492-956aa309832d', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:32:12.199427 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0546e05e-a55a-41a5-a205-b32ca8b71ce4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 204 len: 0 microversion: 2.1 time: 0.329827 Oct 27 09:32:12.200308 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2905/5872] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:32:11 2022] DELETE /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:12.209717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:12.210661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:12.220214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:12.232921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:12.232921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:12.233687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:12.234333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:12.234924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:12.994734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:13.006424 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a50fe23-59ff-4204-a7ea-293920b4fa0e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1503 microversion: 2.1 time: 0.801459 Oct 27 09:32:13.009952 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2906/5873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:12 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1503 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:13.326191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b38f18bd-2202-459b-bc89-8a3c483862f0 tempest-ComputeTenantNetworksTest-2004877550 tempest-ComputeTenantNetworksTest-2004877550-project] Calling method '.version_select at 0x7f31aa25ddc0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:14.368258 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b38f18bd-2202-459b-bc89-8a3c483862f0 tempest-ComputeTenantNetworksTest-2004877550 tempest-ComputeTenantNetworksTest-2004877550-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.280483 Oct 27 09:32:14.369766 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2907/5874] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 09:32:13 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:14.376008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:14.376626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:14.394126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:14.395108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:14.395558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:14.396980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:14.397441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:14.397869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:15.018528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:32:15.020360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:32:15.021171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:32:15.021847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:32:15.022834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:32:15.037191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:15.038082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:15.038775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:15.040677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:15.041227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:15.041785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:15.071293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Getting quotas for project 7891348e553f48e881fbd5ed0cb399cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:32:15.090708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Getting quotas for user 3c23ef023b744339afbd8e7d205f1adf and project 7891348e553f48e881fbd5ed0cb399cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:32:15.122454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Going to run 2 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:32:15.125147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: 00c2ac94-3aef-4de0-a39e-0b68ff6acd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:32:15.202096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=00c2ac94-3aef-4de0-a39e-0b68ff6acd42,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:32:15.234410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:15.258922 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54615638-bb73-4bd7-9e23-535540da7d95 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1503 microversion: 2.1 time: 0.888038 Oct 27 09:32:15.259912 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2908/5875] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:14 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1503 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:15.293298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2293c94a-9661-4c94-b6aa-af7e3527e19f tempest-ComputeTenantNetworksTest-2004877550 tempest-ComputeTenantNetworksTest-2004877550-project] Calling method '.version_select at 0x7f31aa4e4dc0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:15.388500 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d9f0d8fd-c839-4395-8116-50532c6ae371 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.524847 Oct 27 09:32:15.389447 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2968/5876] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:32:11 2022] POST /compute/v2.1/servers => generated 32 bytes in 3529 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 27 09:32:15.396467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-84eb4735-8892-4865-bdf3-6ca2cfcaf49d req-6b417744-9935-41c8-a9b8-19e215d1bb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d583e7ad-7baa-456c-90e2-d691b584737c", "name": "network-vif-deleted", "tag": "32fcebb9-ff7e-4b0b-9acd-fea83b6c49dc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:15.413856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-84eb4735-8892-4865-bdf3-6ca2cfcaf49d req-6b417744-9935-41c8-a9b8-19e215d1bb7b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:15.414845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-84eb4735-8892-4865-bdf3-6ca2cfcaf49d req-6b417744-9935-41c8-a9b8-19e215d1bb7b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:15.415508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-84eb4735-8892-4865-bdf3-6ca2cfcaf49d req-6b417744-9935-41c8-a9b8-19e215d1bb7b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:15.430009 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-84eb4735-8892-4865-bdf3-6ca2cfcaf49d req-6b417744-9935-41c8-a9b8-19e215d1bb7b service nova] Creating event network-vif-deleted:32fcebb9-ff7e-4b0b-9acd-fea83b6c49dc for instance d583e7ad-7baa-456c-90e2-d691b584737c on n-h2-858383-16 Oct 27 09:32:15.437306 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-84eb4735-8892-4865-bdf3-6ca2cfcaf49d req-6b417744-9935-41c8-a9b8-19e215d1bb7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045990 Oct 27 09:32:15.449630 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2969/5877] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:15.458907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:15.466107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:15.467697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Searching by: {'deleted': False, 'project_id': '7891348e553f48e881fbd5ed0cb399cf'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:32:15.474231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:15.501483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:15.502413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:15.503032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:15.504423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:15.506029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:15.506937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:15.564705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:32:15.627820 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6681fef6-ac23-4738-a21f-4c050fcb3ce3 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.176594 Oct 27 09:32:15.628703 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2970/5878] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 09:32:15 2022] GET /compute/v2.1/servers => generated 1337 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:15.645841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c753906d-6a93-46e8-8982-fc2ce76b899e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:15.650480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c753906d-6a93-46e8-8982-fc2ce76b899e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:15.874964 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2293c94a-9661-4c94-b6aa-af7e3527e19f tempest-ComputeTenantNetworksTest-2004877550 tempest-ComputeTenantNetworksTest-2004877550-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/22db3631-cf08-4609-a2c9-083b6387bd75" status: 200 len: 139 microversion: 2.1 time: 0.591581 Oct 27 09:32:15.876247 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2909/5879] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Oct 27 09:32:15 2022] GET /compute/v2.1/os-tenant-networks/22db3631-cf08-4609-a2c9-083b6387bd75 => generated 139 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:16.015505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c753906d-6a93-46e8-8982-fc2ce76b899e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:16.035188 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c753906d-6a93-46e8-8982-fc2ce76b899e tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1218 microversion: 2.1 time: 0.388134 Oct 27 09:32:16.036146 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2971/5880] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:15 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1218 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:16.291449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:16.292357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:16.305996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:16.306555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:16.307010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:16.307798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:16.308257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:16.313562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:17.063329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:17.064450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:17.118684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:17.119190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:17.119717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:17.120691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:17.120899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:17.121343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:17.331426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:17.335867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:17.341436 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61892b6d-8344-4551-b42d-0fcbb3493d87 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1222 microversion: 2.1 time: 0.283324 Oct 27 09:32:17.346409 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2972/5881] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:17 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1222 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:17.351517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-097aedb8-d04f-4382-aa75-0cb5f74601a2 req-07df1b29-4388-4349-8c9a-64f6926e9602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc3c9ad-4379-4584-bdcc-a0edc7474b01", "name": "network-vif-deleted", "tag": "7e11bc69-6608-4933-b3e6-680e5c6551f7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:17.352539 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec2009b0-e1e0-4127-b5f7-baa126048450 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1503 microversion: 2.1 time: 1.066060 Oct 27 09:32:17.369075 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2910/5882] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:16 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1503 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:17.382433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-097aedb8-d04f-4382-aa75-0cb5f74601a2 req-07df1b29-4388-4349-8c9a-64f6926e9602 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:17.383059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-097aedb8-d04f-4382-aa75-0cb5f74601a2 req-07df1b29-4388-4349-8c9a-64f6926e9602 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:17.383990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-097aedb8-d04f-4382-aa75-0cb5f74601a2 req-07df1b29-4388-4349-8c9a-64f6926e9602 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:17.406125 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-097aedb8-d04f-4382-aa75-0cb5f74601a2 req-07df1b29-4388-4349-8c9a-64f6926e9602 service nova] Creating event network-vif-deleted:7e11bc69-6608-4933-b3e6-680e5c6551f7 for instance ffc3c9ad-4379-4584-bdcc-a0edc7474b01 on n-h1-858383-16 Oct 27 09:32:17.413428 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-097aedb8-d04f-4382-aa75-0cb5f74601a2 req-07df1b29-4388-4349-8c9a-64f6926e9602 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065385 Oct 27 09:32:17.421182 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2973/5883] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:18.378325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:18.378948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:18.383213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:18.383951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:18.387457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:18.392150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:18.392861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:18.393785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:18.394260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:18.405748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:18.412086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:18.412882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:18.413349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:18.414107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:18.414575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:18.415004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:18.519388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:18.519905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:18.523382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:18.523892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lazy-loading 'fault' on Instance uuid 078ee78e-9270-441f-b5ff-21a9809356fe {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:32:18.860749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:18.870093 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1769fa8-5ebc-4e37-b2b4-7fe300b6d08e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 200 len: 1304 microversion: 2.1 time: 0.492384 Oct 27 09:32:18.878495 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2974/5884] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:18 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 1304 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:18.898091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:18.925946 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18c671ed-226e-4c7f-a32d-8c75f13c2eae tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1278 microversion: 2.1 time: 0.542876 Oct 27 09:32:18.925946 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2911/5885] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:18 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1278 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:19.492823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8598c864-17b0-4153-a342-dc451a0eaf40 req-046be386-8aa2-473d-86fd-1b2e10a55741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078ee78e-9270-441f-b5ff-21a9809356fe", "name": "network-vif-deleted", "tag": "9f278dec-829b-4f52-b4dd-88bcb1567cbd"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:19.519739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8598c864-17b0-4153-a342-dc451a0eaf40 req-046be386-8aa2-473d-86fd-1b2e10a55741 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:19.520146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8598c864-17b0-4153-a342-dc451a0eaf40 req-046be386-8aa2-473d-86fd-1b2e10a55741 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:19.520621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8598c864-17b0-4153-a342-dc451a0eaf40 req-046be386-8aa2-473d-86fd-1b2e10a55741 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:19.543888 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8598c864-17b0-4153-a342-dc451a0eaf40 req-046be386-8aa2-473d-86fd-1b2e10a55741 service nova] Creating event network-vif-deleted:9f278dec-829b-4f52-b4dd-88bcb1567cbd for instance 078ee78e-9270-441f-b5ff-21a9809356fe on n-h2-858383-16 Oct 27 09:32:19.561574 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8598c864-17b0-4153-a342-dc451a0eaf40 req-046be386-8aa2-473d-86fd-1b2e10a55741 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072837 Oct 27 09:32:19.562546 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2975/5886] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:19.910330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:19.910963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 078ee78e-9270-441f-b5ff-21a9809356fe] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:19.937144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:19.940014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:19.941095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:19.944246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:19.945142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:19.945827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:19.953530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:19.954257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:19.966226 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] HTTP exception thrown: Instance 078ee78e-9270-441f-b5ff-21a9809356fe could not be found. Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Request method failure captured: Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe HTTP/1.1 Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk_5FIYyBvvQ4tGVV0KlGkhqSkZgwCrvj_8nfUiOLjurt7XN-oqPzzCk6KOBOeJWGA00igW7il4OcPRxjHkzGPG9kXDpwjKG9qZPGpMfGIeprQ9PWsYi6MoeOsB8bnn57ib5pp43_NYRa7hRfwjOleZ7MpRolczpQZVk0s1qXhuRfBw Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d6312352490a4276a1bba8a35e96529c Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesActionsTest-1960699392 Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6312352490a4276a1bba8a35e96529c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d6312352490a4276a1bba8a35e96529c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6312352490a4276a1bba8a35e96529c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d6312352490a4276a1bba8a35e96529c"}]}] Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-VolumesActionsTest-1960699392 Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d6312352490a4276a1bba8a35e96529c Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesActionsTest-1960699392 Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-VolumesActionsTest-1960699392-project Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 513175c80e154bc9a48e7ebc9ddd021f Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-VolumesActionsTest-1960699392-project Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 078ee78e-9270-441f-b5ff-21a9809356fe could not be found. Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '078ee78e-9270-441f-b5ff-21a9809356fe'} Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 078ee78e-9270-441f-b5ff-21a9809356fe could not be found. Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 078ee78e-9270-441f-b5ff-21a9809356fe could not be found. Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:19.968705 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:19.974728 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:19.974728 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:19.974728 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:19.974728 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:32:19.974728 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:32:19.974728 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 078ee78e-9270-441f-b5ff-21a9809356fe could not be found. Oct 27 09:32:19.974728 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:19.978002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Returning 404 to user: Instance 078ee78e-9270-441f-b5ff-21a9809356fe could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:19.979236 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eadd9ccf-1a6d-43c3-8cc0-cc2566140bd1 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe" status: 404 len: 111 microversion: 2.1 time: 0.074488 Oct 27 09:32:19.980230 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2912/5887] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:19 2022] GET /compute/v2.1/servers/078ee78e-9270-441f-b5ff-21a9809356fe => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:32:19.995886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:19.996950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:19.997959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:19.998862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:19.999476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:20.000113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:20.213732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1492480853", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "a4294d48-d66a-402f-bbac-b3287ad64d54"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:20.348318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:20.350926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] validate_networks() for [('a4294d48-d66a-402f-bbac-b3287ad64d54', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:32:20.360178 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6afb95d1-f836-47ef-9b07-26416e0708c6 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1276 microversion: 2.1 time: 0.409613 Oct 27 09:32:20.362841 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2976/5888] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:19 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1276 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:20.686644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-335092ae-dd97-4433-9b6f-34fb215a1e7d tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Action: 'create', calling method: .version_select at 0x7f31a96a5f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-83499329", "metadata": {"Type": "work"}}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-335092ae-dd97-4433-9b6f-34fb215a1e7d tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Request method failure captured: Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 120 Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAkW8dgF4w2dEID3sOm202jiNBsc15nlWTyz6PvtjRM5ytDQ3aPIJjEWHRk330_gsFMcKU6x_D60aC9_yewc26CcLlrLlaJycfpALwXxZpFEjIdwJnFD9K2hPe8Eks-8uNeOznmbt5vwF-PR1-57RlpOo3zkVGpONXlPWr7KLgTtvY Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}] Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e8a75a657cff4af0bb9e04c2e39a65d7 Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-83499329", "metadata": {"Type": "work"}}} Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-83499329', 'metadata': {'Type': 'work'}}}} Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '#$%' Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:32:20.696074 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 09:32:20.701053 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.701905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-335092ae-dd97-4433-9b6f-34fb215a1e7d tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:20.703332 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-335092ae-dd97-4433-9b6f-34fb215a1e7d tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.257801 Oct 27 09:32:20.711379 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2977/5889] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Oct 27 09:32:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:32:20.717629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae3f917d-b87e-4172-8f9e-6baf7ecc60c2 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Action: 'create', calling method: .version_select at 0x7f31a9201f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-453745786", "metadata": {"Type": "work"}}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae3f917d-b87e-4172-8f9e-6baf7ecc60c2 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Request method failure captured: Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 119 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAkW8dgF4w2dEID3sOm202jiNBsc15nlWTyz6PvtjRM5ytDQ3aPIJjEWHRk330_gsFMcKU6x_D60aC9_yewc26CcLlrLlaJycfpALwXxZpFEjIdwJnFD9K2hPe8Eks-8uNeOznmbt5vwF-PR1-57RlpOo3zkVGpONXlPWr7KLgTtvY Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}] Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e8a75a657cff4af0bb9e04c2e39a65d7 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-453745786", "metadata": {"Type": "work"}}} Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-453745786', 'metadata': {'Type': 'work'}}}} Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '0' Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:32:20.726849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 09:32:20.735213 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.738595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae3f917d-b87e-4172-8f9e-6baf7ecc60c2 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:20.740443 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae3f917d-b87e-4172-8f9e-6baf7ecc60c2 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027222 Oct 27 09:32:20.741771 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2978/5890] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Oct 27 09:32:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:32:20.758707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a89379a-b4f4-4266-8f07-028ce64b29bd tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Action: 'create', calling method: .version_select at 0x7f31a94f81f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1182533403", "metadata": {"Type": "work"}}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a89379a-b4f4-4266-8f07-028ce64b29bd tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Request method failure captured: Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 119 Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAkW8dgF4w2dEID3sOm202jiNBsc15nlWTyz6PvtjRM5ytDQ3aPIJjEWHRk330_gsFMcKU6x_D60aC9_yewc26CcLlrLlaJycfpALwXxZpFEjIdwJnFD9K2hPe8Eks-8uNeOznmbt5vwF-PR1-57RlpOo3zkVGpONXlPWr7KLgTtvY Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}] Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e8a75a657cff4af0bb9e04c2e39a65d7 Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1182533403", "metadata": {"Type": "work"}}} Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1182533403', 'metadata': {'Type': 'work'}}}} Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '' Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:32:20.763554 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a89379a-b4f4-4266-8f07-028ce64b29bd tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:20.769705 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a89379a-b4f4-4266-8f07-028ce64b29bd tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022251 Oct 27 09:32:20.772893 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2979/5891] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Oct 27 09:32:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:32:20.783392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-765886fc-4493-446f-b763-0f93a7f26a93 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Calling method '.version_select at 0x7f31a9192670>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:20.820872 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-765886fc-4493-446f-b763-0f93a7f26a93 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] HTTP exception thrown: Volume tempest-invalid-936776208 could not be found. Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-765886fc-4493-446f-b763-0f93a7f26a93 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Request method failure captured: Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-936776208 HTTP/1.1 Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAkW8dgF4w2dEID3sOm202jiNBsc15nlWTyz6PvtjRM5ytDQ3aPIJjEWHRk330_gsFMcKU6x_D60aC9_yewc26CcLlrLlaJycfpALwXxZpFEjIdwJnFD9K2hPe8Eks-8uNeOznmbt5vwF-PR1-57RlpOo3zkVGpONXlPWr7KLgTtvY Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}] Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e8a75a657cff4af0bb9e04c2e39a65d7 Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: exception: Volume tempest-invalid-936776208 could not be found. Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'tempest-invalid-936776208'} Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-936776208 could not be found. (HTTP 404) (Request-ID: req-fd18cbd0-7510-4d39-9240-4c4032bb6fe5) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:32:20.823193 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-936776208 could not be found. Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-936776208 could not be found. Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-936776208 could not be found. Oct 27 09:32:20.829982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.837449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-765886fc-4493-446f-b763-0f93a7f26a93 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Returning 404 to user: Volume tempest-invalid-936776208 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:20.838570 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-765886fc-4493-446f-b763-0f93a7f26a93 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-936776208" status: 404 len: 98 microversion: 2.1 time: 0.059415 Oct 27 09:32:20.839782 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2980/5892] 10.222.0.25 () {58 vars in 1215 bytes} [Thu Oct 27 09:32:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-936776208 => generated 98 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:32:20.850935 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c3182a2-6595-49bc-b58a-25dd59efd5a5 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004081 Oct 27 09:32:20.852372 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2981/5893] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Oct 27 09:32:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 09:32:20.862520 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84b826b7-058b-4c96-b51e-e59ceff81df2 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004974 Oct 27 09:32:20.864976 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2982/5894] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Oct 27 09:32:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 09:32:20.875048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd5d7e85-cf7d-44d8-9cc7-100f606082fe tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Calling method '.version_select at 0x7f31a9480ee0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:20.914835 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-fd5d7e85-cf7d-44d8-9cc7-100f606082fe tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] HTTP exception thrown: Volume 20a1b8e4-2ac7-4011-8382-6b7bcf519dd5 could not be found. Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd5d7e85-cf7d-44d8-9cc7-100f606082fe tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Request method failure captured: Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-volumes/20a1b8e4-2ac7-4011-8382-6b7bcf519dd5 HTTP/1.1 Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAkW8dgF4w2dEID3sOm202jiNBsc15nlWTyz6PvtjRM5ytDQ3aPIJjEWHRk330_gsFMcKU6x_D60aC9_yewc26CcLlrLlaJycfpALwXxZpFEjIdwJnFD9K2hPe8Eks-8uNeOznmbt5vwF-PR1-57RlpOo3zkVGpONXlPWr7KLgTtvY Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}] Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e8a75a657cff4af0bb9e04c2e39a65d7 Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: exception: Volume 20a1b8e4-2ac7-4011-8382-6b7bcf519dd5 could not be found. Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '20a1b8e4-2ac7-4011-8382-6b7bcf519dd5'} Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20a1b8e4-2ac7-4011-8382-6b7bcf519dd5 could not be found. (HTTP 404) (Request-ID: req-12ac98bd-bca5-4156-9425-e474bc266db8) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:32:20.917236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20a1b8e4-2ac7-4011-8382-6b7bcf519dd5 could not be found. Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20a1b8e4-2ac7-4011-8382-6b7bcf519dd5 could not be found. Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20a1b8e4-2ac7-4011-8382-6b7bcf519dd5 could not be found. Oct 27 09:32:20.923376 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.928545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd5d7e85-cf7d-44d8-9cc7-100f606082fe tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Returning 404 to user: Volume 20a1b8e4-2ac7-4011-8382-6b7bcf519dd5 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:20.930144 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd5d7e85-cf7d-44d8-9cc7-100f606082fe tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/20a1b8e4-2ac7-4011-8382-6b7bcf519dd5" status: 404 len: 109 microversion: 2.1 time: 0.059675 Oct 27 09:32:20.931272 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2983/5895] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:32:20 2022] DELETE /compute/v2.1/os-volumes/20a1b8e4-2ac7-4011-8382-6b7bcf519dd5 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:32:20.943659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28fa7056-07e4-448f-88cb-f523221219d9 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Calling method '.version_select at 0x7f31a9480af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:20.978738 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-28fa7056-07e4-448f-88cb-f523221219d9 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] HTTP exception thrown: Volume 5b74346c-191c-4d72-96e2-8e9976f22ee4 could not be found. Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28fa7056-07e4-448f-88cb-f523221219d9 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Request method failure captured: Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-volumes/5b74346c-191c-4d72-96e2-8e9976f22ee4 HTTP/1.1 Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAkW8dgF4w2dEID3sOm202jiNBsc15nlWTyz6PvtjRM5ytDQ3aPIJjEWHRk330_gsFMcKU6x_D60aC9_yewc26CcLlrLlaJycfpALwXxZpFEjIdwJnFD9K2hPe8Eks-8uNeOznmbt5vwF-PR1-57RlpOo3zkVGpONXlPWr7KLgTtvY Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1c6a94b9211f4afc9cb4b5116c0c9f1f"}]}] Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 1c6a94b9211f4afc9cb4b5116c0c9f1f Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesNegativeTest-323330536 Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: e8a75a657cff4af0bb9e04c2e39a65d7 Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesNegativeTest-323330536-project Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: exception: Volume 5b74346c-191c-4d72-96e2-8e9976f22ee4 could not be found. Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5b74346c-191c-4d72-96e2-8e9976f22ee4'} Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b74346c-191c-4d72-96e2-8e9976f22ee4 could not be found. (HTTP 404) (Request-ID: req-3f94a01a-76d9-4779-8ba6-1c197a7c743d) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:32:20.981733 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b74346c-191c-4d72-96e2-8e9976f22ee4 could not be found. Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b74346c-191c-4d72-96e2-8e9976f22ee4 could not be found. Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b74346c-191c-4d72-96e2-8e9976f22ee4 could not be found. Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28fa7056-07e4-448f-88cb-f523221219d9 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] Returning 404 to user: Volume 5b74346c-191c-4d72-96e2-8e9976f22ee4 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:20.990667 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28fa7056-07e4-448f-88cb-f523221219d9 tempest-VolumesNegativeTest-323330536 tempest-VolumesNegativeTest-323330536-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/5b74346c-191c-4d72-96e2-8e9976f22ee4" status: 404 len: 109 microversion: 2.1 time: 0.045575 Oct 27 09:32:21.009241 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2984/5896] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:32:20 2022] GET /compute/v2.1/os-volumes/5b74346c-191c-4d72-96e2-8e9976f22ee4 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:32:21.389714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:21.390405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:21.402798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:21.403305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:21.403789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:21.407704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:21.408880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:21.410295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:21.665240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:21.678739 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f5bf5904-e3d6-4564-8cf5-a2c1bdd79702 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1276 microversion: 2.1 time: 0.294885 Oct 27 09:32:21.684054 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2985/5897] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:21 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1276 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:22.110986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:32:22.112443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:32:22.115001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:32:22.115961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:32:22.117333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:32:22.149851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:22.150602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:22.152303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:22.158426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:22.159255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:22.159982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:22.217678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Getting quotas for project d6312352490a4276a1bba8a35e96529c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:32:22.230739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Getting quotas for user 513175c80e154bc9a48e7ebc9ddd021f and project d6312352490a4276a1bba8a35e96529c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:32:22.265292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:32:22.268339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:32:22.464128 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca3cd4db-ccca-4ca9-8541-63dbeeb621f5 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.258204 Oct 27 09:32:22.465420 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2913/5898] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:32:22.477966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bb6714f0-8b25-4c1c-9c35-dad905306c1a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:22.478588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bb6714f0-8b25-4c1c-9c35-dad905306c1a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:22.713130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:22.714209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:22.725642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:22.733967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:22.734771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:22.736212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:22.737391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:22.738298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:23.727929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bb6714f0-8b25-4c1c-9c35-dad905306c1a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:23.745559 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bb6714f0-8b25-4c1c-9c35-dad905306c1a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1214 microversion: 2.1 time: 1.269720 Oct 27 09:32:23.747226 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2986/5899] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:22 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1214 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:23.940128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:23.950521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-56dd3ec7-cf24-4550-8772-6a9cc6dafb39 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 1.243356 Oct 27 09:32:23.961743 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2914/5900] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:22 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:24.774962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:24.775597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:24.788480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:24.803936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:24.804433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:24.805213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:24.808132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:24.809056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:24.974678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:24.976240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:24.988396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:24.990502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:24.992283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:24.993192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:24.996410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:24.997100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:25.254383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:25.264341 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4fb7d11c-b74a-45ed-8710-a1d1a1289196 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1272 microversion: 2.1 time: 0.494680 Oct 27 09:32:25.268957 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2987/5901] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:24 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1272 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:26.189858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:26.199510 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8af37ab-0020-4e70-b39d-da45a88b0a52 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 1.229110 Oct 27 09:32:26.218996 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2915/5902] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:24 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:26.289834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:26.298624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:26.299259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:26.321791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:26.326841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:26.327798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:26.328715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:26.329195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:26.335241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:26.545721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:26.566044 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc2a4801-58e2-4712-a9b0-5a5953886538 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1272 microversion: 2.1 time: 0.276870 Oct 27 09:32:26.568199 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2988/5903] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:26 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:27.226722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:27.227342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:27.238518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:27.239052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:27.239496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:27.240236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:27.240690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:27.241119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:27.590538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:27.591800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:27.600165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:27.607966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:27.608712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:27.609823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:27.610455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:27.611052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:27.815325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:27.829930 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba115a6e-cdb0-48d8-b5cd-833285e71bed tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1272 microversion: 2.1 time: 0.243248 Oct 27 09:32:27.830893 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2989/5904] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:27 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:27.840980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:27.853234 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73467b68-a153-4203-bd96-2210d4740006 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 0.630830 Oct 27 09:32:27.853831 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2916/5905] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:27 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:27.994198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b8de2446-094d-400f-a233-25e477590ff0 req-27f2bc79-8375-488c-b800-90b856208943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dafb899a-0faf-424e-9781-832e5f3fa4c2", "tag": "38d1949f-9832-4032-8ffc-c9d2c2c34dcd"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:28.018250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b8de2446-094d-400f-a233-25e477590ff0 req-27f2bc79-8375-488c-b800-90b856208943 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:28.019923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b8de2446-094d-400f-a233-25e477590ff0 req-27f2bc79-8375-488c-b800-90b856208943 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:28.021357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b8de2446-094d-400f-a233-25e477590ff0 req-27f2bc79-8375-488c-b800-90b856208943 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:28.041003 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b8de2446-094d-400f-a233-25e477590ff0 req-27f2bc79-8375-488c-b800-90b856208943 service nova] Creating event network-changed:38d1949f-9832-4032-8ffc-c9d2c2c34dcd for instance dafb899a-0faf-424e-9781-832e5f3fa4c2 on n-h2-858383-16 Oct 27 09:32:28.050651 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b8de2446-094d-400f-a233-25e477590ff0 req-27f2bc79-8375-488c-b800-90b856208943 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060049 Oct 27 09:32:28.052709 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2990/5906] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:28.856230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:28.857484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:28.869819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:28.871192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:28.873520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:28.883112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:28.884087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:28.890615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:28.891454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:28.892088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:28.902327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:28.902821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:28.903269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:28.911283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:28.914267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:28.914828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:29.720472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:29.737054 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2a3de304-cfba-4c40-b53f-2764c7375842 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 0.860134 Oct 27 09:32:29.739771 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2991/5907] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:28 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:29.788154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:29.799266 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-adbfe565-ef96-40f5-a026-ee483f49a36a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 0.946412 Oct 27 09:32:29.803620 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2917/5908] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:28 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:30.394217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6aa72be4-3cd8-4a95-b1d9-4378f8024090 req-f5780b20-2706-408a-8d06-446536859cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c2ac94-3aef-4de0-a39e-0b68ff6acd42", "tag": "d7af3f9f-96a5-4fa9-b514-40fa0b8c0ed6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:30.432165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6aa72be4-3cd8-4a95-b1d9-4378f8024090 req-f5780b20-2706-408a-8d06-446536859cba service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:30.435465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6aa72be4-3cd8-4a95-b1d9-4378f8024090 req-f5780b20-2706-408a-8d06-446536859cba service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:30.437425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6aa72be4-3cd8-4a95-b1d9-4378f8024090 req-f5780b20-2706-408a-8d06-446536859cba service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:30.486203 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6aa72be4-3cd8-4a95-b1d9-4378f8024090 req-f5780b20-2706-408a-8d06-446536859cba service nova] Creating event network-changed:d7af3f9f-96a5-4fa9-b514-40fa0b8c0ed6 for instance 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 on n-h1-858383-16 Oct 27 09:32:30.498263 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6aa72be4-3cd8-4a95-b1d9-4378f8024090 req-f5780b20-2706-408a-8d06-446536859cba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108840 Oct 27 09:32:30.500695 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2992/5909] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:30.765202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:30.765800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:30.773339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:30.774084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:30.774716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:30.775631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:30.776271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:30.776861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:30.831112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:30.832132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:30.840053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:30.841031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:30.841713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:30.843014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:30.843725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:30.844370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:31.516032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:31.543126 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-859446a3-49c6-4716-bba8-5b9dc54607c9 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 0.710672 Oct 27 09:32:31.545626 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2993/5910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:30 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:31.580517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:31.605648 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a133e93a-18f4-438b-b9d1-fe2e86781630 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 0.843648 Oct 27 09:32:31.606928 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2918/5911] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:30 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:32.579249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:32.580053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:32.580788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-41c8ecb6-fdfc-4e06-82f3-3992c4cdfdc4 req-df93a63d-568b-4851-bdb6-8c50ff892bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "445e5b46-5c67-4e37-819d-c2f4a8f02d09", "tag": "2f75b938-8af1-4213-ba44-8117202f870a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:32.607377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:32.607913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:32.608348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:32.609069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:32.609530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:32.609961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:32.614804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:32.615579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:32.617472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-41c8ecb6-fdfc-4e06-82f3-3992c4cdfdc4 req-df93a63d-568b-4851-bdb6-8c50ff892bf8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:32.617953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-41c8ecb6-fdfc-4e06-82f3-3992c4cdfdc4 req-df93a63d-568b-4851-bdb6-8c50ff892bf8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:32.618575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-41c8ecb6-fdfc-4e06-82f3-3992c4cdfdc4 req-df93a63d-568b-4851-bdb6-8c50ff892bf8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:32.668030 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-41c8ecb6-fdfc-4e06-82f3-3992c4cdfdc4 req-df93a63d-568b-4851-bdb6-8c50ff892bf8 service nova] Creating event network-changed:2f75b938-8af1-4213-ba44-8117202f870a for instance 445e5b46-5c67-4e37-819d-c2f4a8f02d09 on n-h1-858383-16 Oct 27 09:32:32.679811 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-41c8ecb6-fdfc-4e06-82f3-3992c4cdfdc4 req-df93a63d-568b-4851-bdb6-8c50ff892bf8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105543 Oct 27 09:32:32.681234 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2919/5912] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:32:32.694021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:32.704394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:32.711864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:32.712365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:32.712814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:32.713529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:32.713992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:32.714425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:32.724637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:33.052031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:33.066517 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29f314db-09aa-4933-b76e-1c05de39bdbe tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 0.383621 Oct 27 09:32:33.080195 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2920/5913] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:32 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:33.202449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:33.218300 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5ae1f29-d42b-4a63-826f-95ad9b3fbde3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 0.649392 Oct 27 09:32:33.230955 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2994/5914] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:32 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:34.095694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:34.096444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:34.110190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:34.118526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:34.119247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:34.120257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:34.120905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:34.121523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:34.243391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:34.244075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:34.252815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=10 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:34.258557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:34.259472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:34.264369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:34.269335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:34.270164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:34.270841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:35.416654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:35.436856 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f83e31bc-026a-4029-a617-27b4fadbebee tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 1.346512 Oct 27 09:32:35.443392 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2921/5915] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:34 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:35.451599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:35.462593 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ac4dfd4a-7566-4814-8ea5-045c94ff635a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 1.223670 Oct 27 09:32:35.475997 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2995/5916] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:34 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:35.863266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d4413251-c050-4a45-8261-ee44d4778484 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'create', calling method: .version_select at 0x7f31aa1d9280>, body: {"keypair": {"name": "tempest-keypair-803298344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWBoGa8TcqA6rigVg5wX6xC2Kd1Rh/NnJg3a7jCTHjChVNLo9CzyGtGeYgN7Pyzko25J3HinLV7jmCY9a6QdK5btX0rQzQdJXmNl+lmD+qpXhkoUVfWvoIkI2DzIHhAdQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:35.918828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d4413251-c050-4a45-8261-ee44d4778484 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Getting quotas for project 86767ef47c0a4d9bbdda088354b82c02. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:32:35.944785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d4413251-c050-4a45-8261-ee44d4778484 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Getting quotas for user 9153c5ce21b24daa91bacaa9f47b7c57 and project 86767ef47c0a4d9bbdda088354b82c02. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:32:36.043864 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d4413251-c050-4a45-8261-ee44d4778484 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.594322 Oct 27 09:32:36.044802 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2922/5917] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:32:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:36.463718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:36.466022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:36.484301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:36.485040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:36.485821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:36.487537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:36.488244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:36.488975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:36.495131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:36.495795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:36.515556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:36.520526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:36.523913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:36.524749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:36.525420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:36.530898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:38.237911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:38.251796 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb948cc6-1b85-470b-970c-415ce2b32889 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 1.764413 Oct 27 09:32:38.266571 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2923/5918] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:36 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:38.277696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ee8b3c06-cb1e-403c-ae0f-75c08a6b241b req-f3894a41-d980-49e3-97cb-72c19baeda9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c2ac94-3aef-4de0-a39e-0b68ff6acd42", "name": "network-vif-plugged", "status": "completed", "tag": "d7af3f9f-96a5-4fa9-b514-40fa0b8c0ed6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:38.311965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ee8b3c06-cb1e-403c-ae0f-75c08a6b241b req-f3894a41-d980-49e3-97cb-72c19baeda9f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:38.321746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ee8b3c06-cb1e-403c-ae0f-75c08a6b241b req-f3894a41-d980-49e3-97cb-72c19baeda9f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:38.326010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ee8b3c06-cb1e-403c-ae0f-75c08a6b241b req-f3894a41-d980-49e3-97cb-72c19baeda9f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:38.360410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:38.390843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:38.402237 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a345c19-de0c-4234-acff-3390765784cb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 1.941031 Oct 27 09:32:38.405631 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2996/5919] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:36 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:38.417850 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ee8b3c06-cb1e-403c-ae0f-75c08a6b241b req-f3894a41-d980-49e3-97cb-72c19baeda9f service nova] Creating event network-vif-plugged:d7af3f9f-96a5-4fa9-b514-40fa0b8c0ed6 for instance 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 on n-h1-858383-16 Oct 27 09:32:38.451314 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ee8b3c06-cb1e-403c-ae0f-75c08a6b241b req-f3894a41-d980-49e3-97cb-72c19baeda9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169029 Oct 27 09:32:38.454979 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2924/5920] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:39.282030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:39.282910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:39.292770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:39.293519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:39.294120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:39.295026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:39.295738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:39.296563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:39.428157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:39.429068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:39.437200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:39.438426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:39.439729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:39.442295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:39.443180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:39.444468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:39.803799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:39.818762 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-641618aa-4674-4617-946e-915ba2df6f92 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 0.541042 Oct 27 09:32:39.839010 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2997/5921] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:39 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:39.899015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:39.910423 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c90d50d-8ba0-43d9-97f1-916315af3d3d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 0.488784 Oct 27 09:32:39.916888 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2925/5922] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:39 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:40.247288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1719774868", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fbe562a-e575-4d52-8273-b69f7949b042"}], "security_groups": [{"name": "tempest-securitygroup--644911060"}], "key_name": "tempest-keypair-803298344", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:40.456525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] validate_networks() for [('6fbe562a-e575-4d52-8273-b69f7949b042', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:32:40.470651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3443cc29-f924-4a35-ad16-8dfd23ec523c req-208399cc-3d4e-4a86-bf14-21e009f521b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafb899a-0faf-424e-9781-832e5f3fa4c2", "name": "network-vif-plugged", "status": "completed", "tag": "38d1949f-9832-4032-8ffc-c9d2c2c34dcd"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:40.481378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:40.483625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3443cc29-f924-4a35-ad16-8dfd23ec523c req-208399cc-3d4e-4a86-bf14-21e009f521b9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:40.484339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3443cc29-f924-4a35-ad16-8dfd23ec523c req-208399cc-3d4e-4a86-bf14-21e009f521b9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:40.485560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3443cc29-f924-4a35-ad16-8dfd23ec523c req-208399cc-3d4e-4a86-bf14-21e009f521b9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:40.502451 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3443cc29-f924-4a35-ad16-8dfd23ec523c req-208399cc-3d4e-4a86-bf14-21e009f521b9 service nova] Creating event network-vif-plugged:38d1949f-9832-4032-8ffc-c9d2c2c34dcd for instance dafb899a-0faf-424e-9781-832e5f3fa4c2 on n-h2-858383-16 Oct 27 09:32:40.509670 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3443cc29-f924-4a35-ad16-8dfd23ec523c req-208399cc-3d4e-4a86-bf14-21e009f521b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042429 Oct 27 09:32:40.511303 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2926/5923] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:40.848666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:40.849811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:40.867619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:40.868666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:40.878184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:40.882861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:40.885097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:40.886774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:41.250483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:41.261034 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dec662ca-b532-4ef3-90b7-aa3d7e9649b0 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 0.418351 Oct 27 09:32:41.264323 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2927/5924] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:40 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:41.282208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:41.283281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:41.295744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:41.296770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:41.298009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:41.300091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:41.300598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:41.301848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:41.655550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:32:41.656223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:32:41.657012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:32:41.658289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:32:41.659143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:32:41.669999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:41.678525 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df791809-af21-4078-9b5f-cc7c39aa846a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1318 microversion: 2.1 time: 0.412876 Oct 27 09:32:41.681818 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2928/5925] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:41 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:41.695760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:41.695760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:41.695760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:41.695760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:41.695760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:41.695760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:41.740202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Getting quotas for project 86767ef47c0a4d9bbdda088354b82c02. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:32:41.755857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Getting quotas for user 9153c5ce21b24daa91bacaa9f47b7c57 and project 86767ef47c0a4d9bbdda088354b82c02. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:32:41.780532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:32:41.782894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:32:41.882026 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18538c7d-14d8-4ed5-aa3a-c552d70d3ee7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.636823 Oct 27 09:32:41.895436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1e1d1ae-ae42-420f-b617-621d9277cded tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:41.896565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1e1d1ae-ae42-420f-b617-621d9277cded tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:41.897520 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2998/5926] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:32:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:32:42.032909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1e1d1ae-ae42-420f-b617-621d9277cded tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:42.043879 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1e1d1ae-ae42-420f-b617-621d9277cded tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1237 microversion: 2.1 time: 0.153343 Oct 27 09:32:42.048518 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2929/5927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:41 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1237 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:42.288122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:42.288926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:42.295823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:42.304955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:42.305574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:42.308546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:42.309105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:42.310020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:42.576345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:42.587084 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-085eaa1b-d0f6-4a00-ba06-20cdfc859ccd tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 0.303439 Oct 27 09:32:42.588314 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 2999/5928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:42 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:42.708516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:42.709064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:42.722134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:42.722692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:42.723135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:42.724462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:42.724946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:42.725377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.005296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:43.013437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0a0e674-c95e-4d82-afbe-637f5710b0d1 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 200 len: 1505 microversion: 2.1 time: 0.309002 Oct 27 09:32:43.015691 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2930/5929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:42 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:43.037786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:43.038673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: 00c2ac94-3aef-4de0-a39e-0b68ff6acd42] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:43.051857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.052360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.052801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.053514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.053964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.054390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.070798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:43.071412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:43.079452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.079976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.080425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.081136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.081616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.082789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.312062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:43.325124 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac9e7b27-30c1-4f0f-849d-085e5fafad0f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1233 microversion: 2.1 time: 0.258610 Oct 27 09:32:43.340425 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2931/5930] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:43 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1233 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:43.347799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-da2db5ba-0ebe-42fa-bac0-be8ea0b64e2c req-9ca0785e-360e-472d-8fdd-2b7cc3abfc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445e5b46-5c67-4e37-819d-c2f4a8f02d09", "name": "network-vif-plugged", "status": "completed", "tag": "2f75b938-8af1-4213-ba44-8117202f870a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:43.369003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-da2db5ba-0ebe-42fa-bac0-be8ea0b64e2c req-9ca0785e-360e-472d-8fdd-2b7cc3abfc7e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.370513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-da2db5ba-0ebe-42fa-bac0-be8ea0b64e2c req-9ca0785e-360e-472d-8fdd-2b7cc3abfc7e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.371485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-da2db5ba-0ebe-42fa-bac0-be8ea0b64e2c req-9ca0785e-360e-472d-8fdd-2b7cc3abfc7e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.400168 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-da2db5ba-0ebe-42fa-bac0-be8ea0b64e2c req-9ca0785e-360e-472d-8fdd-2b7cc3abfc7e service nova] Creating event network-vif-plugged:2f75b938-8af1-4213-ba44-8117202f870a for instance 445e5b46-5c67-4e37-819d-c2f4a8f02d09 on n-h1-858383-16 Oct 27 09:32:43.412765 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-da2db5ba-0ebe-42fa-bac0-be8ea0b64e2c req-9ca0785e-360e-472d-8fdd-2b7cc3abfc7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074842 Oct 27 09:32:43.415444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:43.415995 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2932/5931] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:43.431689 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b16fcd8-edd2-4627-871b-1ee1f63e9654 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42" status: 200 len: 1504 microversion: 2.1 time: 0.398130 Oct 27 09:32:43.432898 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3000/5932] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:43 2022] GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:43.460944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:43.461808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: 00c2ac94-3aef-4de0-a39e-0b68ff6acd42] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:43.469967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.470630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.471077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.471819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.472461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.473119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.507016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: 00c2ac94-3aef-4de0-a39e-0b68ff6acd42] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:32:43.618342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:43.619113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:43.627741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.630410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.631674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.633151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.633868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.634525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.673515 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb8b2fe2-0b5e-4fba-9804-fcc2c759c4c9 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "DELETE /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42" status: 204 len: 0 microversion: 2.1 time: 0.217032 Oct 27 09:32:43.676336 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2933/5933] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:32:43 2022] DELETE /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:43.685535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:43.686343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:43.693326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.694046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.694646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.695544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.696179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.696763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.732382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:32:43.902195 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-81a37c37-9283-48be-846c-3f0a8ab9a86a tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 204 len: 0 microversion: 2.1 time: 0.220005 Oct 27 09:32:43.902980 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2934/5934] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:32:43 2022] DELETE /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:43.917509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:43.918528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: 00c2ac94-3aef-4de0-a39e-0b68ff6acd42] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:43.929232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.930774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.931619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.932530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:43.933292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:43.934174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:43.993416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:44.010249 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79d53f98-a09a-4fcb-90fe-7b5826bf8ab3 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 0.396776 Oct 27 09:32:44.011105 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3001/5935] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:43 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:44.176670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:44.186926 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1864538-00ea-4d95-8eff-df5cdd63cda8 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42" status: 200 len: 1510 microversion: 2.1 time: 0.279262 Oct 27 09:32:44.195630 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2935/5936] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:43 2022] GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:44.355486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:44.356443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:44.371208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:44.372424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:44.376066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:44.377358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:44.378502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:44.379205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:44.507347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:44.522455 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e33118e-1d37-46f5-9f91-d3e59d285278 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1307 microversion: 2.1 time: 0.172382 Oct 27 09:32:44.526667 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3002/5937] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:44 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:45.043396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:45.044782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:45.053490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:45.054472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:45.054858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:45.055768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:45.056621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:45.057217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:45.210258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:45.210870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: 00c2ac94-3aef-4de0-a39e-0b68ff6acd42] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:45.225404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:45.225878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:45.226327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:45.227045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:45.227506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:45.228005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:45.229221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:45.242169 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f2a24d8-78d9-4994-8fff-b74a15f5a4c6 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1314 microversion: 2.1 time: 0.204296 Oct 27 09:32:45.243382 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2936/5938] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:45 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:45.547639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:45.548475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:45.566780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:45.567905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:45.571327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:45.572385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:45.575142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:45.575851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:45.620106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:45.834742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:45.849828 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5fca801-0f55-4aee-853e-3f4f9c32831b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1295 microversion: 2.1 time: 0.308318 Oct 27 09:32:45.851957 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2937/5939] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:45 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1295 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:45.970481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:45.991733 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-06aad13d-73e7-4a57-adb6-2698d91f128d tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42" status: 200 len: 1510 microversion: 2.1 time: 0.783302 Oct 27 09:32:45.997300 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3003/5940] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:45 2022] GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42 => generated 1510 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:46.267895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:46.268678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:46.271985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-354076ee-7f39-42ec-9b81-9024bbb915ff req-07e29412-4066-4219-ad05-5b0923c60176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafb899a-0faf-424e-9781-832e5f3fa4c2", "name": "network-vif-deleted", "tag": "38d1949f-9832-4032-8ffc-c9d2c2c34dcd"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:46.280201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:46.285559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:46.288136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-354076ee-7f39-42ec-9b81-9024bbb915ff req-07e29412-4066-4219-ad05-5b0923c60176 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:46.288909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-354076ee-7f39-42ec-9b81-9024bbb915ff req-07e29412-4066-4219-ad05-5b0923c60176 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:46.289706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-354076ee-7f39-42ec-9b81-9024bbb915ff req-07e29412-4066-4219-ad05-5b0923c60176 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:46.291730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:46.292543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:46.293322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:46.293802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:46.294232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:46.306707 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-354076ee-7f39-42ec-9b81-9024bbb915ff req-07e29412-4066-4219-ad05-5b0923c60176 service nova] Creating event network-vif-deleted:38d1949f-9832-4032-8ffc-c9d2c2c34dcd for instance dafb899a-0faf-424e-9781-832e5f3fa4c2 on n-h2-858383-16 Oct 27 09:32:46.317867 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-354076ee-7f39-42ec-9b81-9024bbb915ff req-07e29412-4066-4219-ad05-5b0923c60176 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051780 Oct 27 09:32:46.323620 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3004/5941] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:32:46.877364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:46.879409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:46.900289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:46.902197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:46.902847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:46.903650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:46.905403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:46.907823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:46.908622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:46.913691 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9be9ed5-1284-4a23-a364-4ba75e0dd9df tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1497 microversion: 2.1 time: 0.652001 Oct 27 09:32:46.917807 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2938/5942] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:46 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1497 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:47.020308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:47.021991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: 00c2ac94-3aef-4de0-a39e-0b68ff6acd42] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:47.038163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:47.058135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:47.059892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:47.065747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:47.068050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:47.071027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:47.098269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:47.111866 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6a2b786-d68c-4eff-8dfb-abb009b37099 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1295 microversion: 2.1 time: 0.239703 Oct 27 09:32:47.115812 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3005/5943] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:46 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1295 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:47.409109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:47.428400 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-02c2ed11-bdf9-414e-a5e3-acf089cbbddb tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42" status: 200 len: 1510 microversion: 2.1 time: 0.413472 Oct 27 09:32:47.451480 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2939/5944] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:47 2022] GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42 => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:47.634256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c3bbfb45-7cc5-4d3c-b9a3-4865d07a1929 req-86bf3f0b-3014-4707-a9a7-483969b8b6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c2ac94-3aef-4de0-a39e-0b68ff6acd42", "name": "network-vif-deleted", "tag": "d7af3f9f-96a5-4fa9-b514-40fa0b8c0ed6"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:47.677655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c3bbfb45-7cc5-4d3c-b9a3-4865d07a1929 req-86bf3f0b-3014-4707-a9a7-483969b8b6d6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:47.677655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c3bbfb45-7cc5-4d3c-b9a3-4865d07a1929 req-86bf3f0b-3014-4707-a9a7-483969b8b6d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:47.682596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c3bbfb45-7cc5-4d3c-b9a3-4865d07a1929 req-86bf3f0b-3014-4707-a9a7-483969b8b6d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:47.704801 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c3bbfb45-7cc5-4d3c-b9a3-4865d07a1929 req-86bf3f0b-3014-4707-a9a7-483969b8b6d6 service nova] Creating event network-vif-deleted:d7af3f9f-96a5-4fa9-b514-40fa0b8c0ed6 for instance 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 on n-h1-858383-16 Oct 27 09:32:47.713042 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c3bbfb45-7cc5-4d3c-b9a3-4865d07a1929 req-86bf3f0b-3014-4707-a9a7-483969b8b6d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081566 Oct 27 09:32:47.715303 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3006/5945] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:47.784230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:47.784962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:47.797794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:47.798805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:47.800204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:47.801220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:47.803209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:47.804640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:47.867674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:32:48.074285 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd093e94-4693-4f95-9f34-a835ae0a9e9f tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 204 len: 0 microversion: 2.1 time: 0.294934 Oct 27 09:32:48.074893 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2940/5946] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:32:47 2022] DELETE /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:48.087757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:48.088757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:48.098704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:48.099349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:48.099908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:48.100714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:48.101343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:48.102256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:48.138263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:48.139253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:48.151626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:48.152470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:48.158340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:48.159464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:48.160169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:48.160998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:48.524954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:48.534556 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-24f9f805-7559-48da-87e7-6f5b6301bf76 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1503 microversion: 2.1 time: 0.454942 Oct 27 09:32:48.536414 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3007/5947] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:48 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1503 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:48.542852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:48.544181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: 00c2ac94-3aef-4de0-a39e-0b68ff6acd42] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:48.551718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:48.552465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:48.553145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:48.554063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:48.554731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:48.555365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:48.605406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:48.605970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:48.606493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:48.607011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lazy-loading 'fault' on Instance uuid 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:32:48.610178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:48.620076 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f98a0bad-f976-4d38-ae54-9f19bd3ad6c8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1362 microversion: 2.1 time: 0.485721 Oct 27 09:32:48.624169 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2941/5948] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:48 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:48.677443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c23ef023b744339afbd8e7d205f1adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7891348e553f48e881fbd5ed0cb399cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:48.690815 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0d472538-4455-4d5e-8476-0ed6ce1f0b11 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42" status: 200 len: 1308 microversion: 2.1 time: 0.152786 Oct 27 09:32:48.694221 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3008/5949] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:48 2022] GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42 => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:49.565709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:49.567695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:49.587100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:49.588716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:49.589177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:49.595845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:49.595845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:49.595845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:49.648865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:49.650294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:49.669635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:49.671414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:49.672341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:49.673461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:49.674186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:49.675085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:50.218567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:50.230786 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0d4f0b7-ea10-4e64-81de-d3e18d50d23a tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1503 microversion: 2.1 time: 0.669063 Oct 27 09:32:50.231804 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2942/5950] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:49 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1503 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:50.243029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:50.246287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: 00c2ac94-3aef-4de0-a39e-0b68ff6acd42] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:50.262380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:50.265217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:50.265909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:50.267959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:50.268711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:50.269933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:50.289912 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] HTTP exception thrown: Instance 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 could not be found. Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Request method failure captured: Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42 HTTP/1.1 Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWk_5eDKoN3Iu3fHwODgLKwgVcyYVqctWJ0x6Ci5_md9QWPpXKYmdpWhIb9qWwiezS3eZLyTFa_VO9a247s7FQypGghHkAC63w14PE40m1SmheNXXlUOF24l5Du8GC0uX_9WoNGQvfEvCy42LRGL77eGfn-NqOtqBIBw_Lq15GK5T-Pc Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7891348e553f48e881fbd5ed0cb399cf Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-MultipleCreateTestJSON-1631498736 Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7891348e553f48e881fbd5ed0cb399cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7891348e553f48e881fbd5ed0cb399cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7891348e553f48e881fbd5ed0cb399cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7891348e553f48e881fbd5ed0cb399cf"}]}] Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-MultipleCreateTestJSON-1631498736 Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7891348e553f48e881fbd5ed0cb399cf Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1631498736 Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-MultipleCreateTestJSON-1631498736-project Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 3c23ef023b744339afbd8e7d205f1adf Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-MultipleCreateTestJSON-1631498736-project Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 could not be found. Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '00c2ac94-3aef-4de0-a39e-0b68ff6acd42'} Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 could not be found. Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 could not be found. Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:50.292387 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.296613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:50.296613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:50.296613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:50.296613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:32:50.296613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:32:50.296613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 could not be found. Oct 27 09:32:50.296613 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.299852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Returning 404 to user: Instance 00c2ac94-3aef-4de0-a39e-0b68ff6acd42 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:50.301128 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef699b67-c9eb-4da6-be50-1a585eea1645 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42" status: 404 len: 111 microversion: 2.1 time: 0.068124 Oct 27 09:32:50.302302 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2943/5951] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:50 2022] GET /compute/v2.1/servers/00c2ac94-3aef-4de0-a39e-0b68ff6acd42 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:32:50.310003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-79115c52-71cd-4074-b904-22ad20cf12c0 req-adde1250-3057-4c36-ace5-9c20a61dc67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41895c9e-2d2a-4a6b-8636-4edf5a76aeaf", "tag": "a03f8ca0-47a7-4d0b-b072-278c1c52845e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:50.319416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:50.358675 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa1451d4-3f4a-40c1-abb0-9dab693d6e4d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1362 microversion: 2.1 time: 0.714413 Oct 27 09:32:50.361310 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3009/5952] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:49 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:50.366903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-79115c52-71cd-4074-b904-22ad20cf12c0 req-adde1250-3057-4c36-ace5-9c20a61dc67f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:50.367467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-79115c52-71cd-4074-b904-22ad20cf12c0 req-adde1250-3057-4c36-ace5-9c20a61dc67f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:50.367888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-79115c52-71cd-4074-b904-22ad20cf12c0 req-adde1250-3057-4c36-ace5-9c20a61dc67f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:50.383855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:50.384959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] [instance: dafb899a-0faf-424e-9781-832e5f3fa4c2] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:50.393939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:50.395924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:50.396592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:50.398719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:50.399415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:50.400099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:50.402262 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-79115c52-71cd-4074-b904-22ad20cf12c0 req-adde1250-3057-4c36-ace5-9c20a61dc67f service nova] Creating event network-changed:a03f8ca0-47a7-4d0b-b072-278c1c52845e for instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf on n-h2-858383-16 Oct 27 09:32:50.422051 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-79115c52-71cd-4074-b904-22ad20cf12c0 req-adde1250-3057-4c36-ace5-9c20a61dc67f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117784 Oct 27 09:32:50.422978 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2944/5953] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:50.423478 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] HTTP exception thrown: Instance dafb899a-0faf-424e-9781-832e5f3fa4c2 could not be found. Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Request method failure captured: Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 HTTP/1.1 Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk_5eDKoN3Iu3fHwODgLKwgVcyYVqctWJ0x6Ci5_md9QWPpXKYmdpWhIb9qWwiezS3eZLyTFa_VO9a247s7FQypGghHkAC63w14PE40m1SmheNXXlUOF24l5Du8GC0uX_9WoNGQvfEvCy42LRGL77eGfn-NqOtqBIBw_Lq15GK5T-Pc Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7891348e553f48e881fbd5ed0cb399cf Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-MultipleCreateTestJSON-1631498736 Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7891348e553f48e881fbd5ed0cb399cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7891348e553f48e881fbd5ed0cb399cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7891348e553f48e881fbd5ed0cb399cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7891348e553f48e881fbd5ed0cb399cf"}]}] Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-MultipleCreateTestJSON-1631498736 Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7891348e553f48e881fbd5ed0cb399cf Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1631498736 Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-MultipleCreateTestJSON-1631498736-project Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 3c23ef023b744339afbd8e7d205f1adf Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-MultipleCreateTestJSON-1631498736-project Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance dafb899a-0faf-424e-9781-832e5f3fa4c2 could not be found. Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'dafb899a-0faf-424e-9781-832e5f3fa4c2'} Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafb899a-0faf-424e-9781-832e5f3fa4c2 could not be found. Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafb899a-0faf-424e-9781-832e5f3fa4c2 could not be found. Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:50.425465 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.429536 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:50.429536 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:50.429536 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:50.429536 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:32:50.429536 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:32:50.429536 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafb899a-0faf-424e-9781-832e5f3fa4c2 could not be found. Oct 27 09:32:50.429536 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:50.432165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] Returning 404 to user: Instance dafb899a-0faf-424e-9781-832e5f3fa4c2 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:50.433425 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6116a4ca-6c87-4182-8664-1d7346dc9963 tempest-MultipleCreateTestJSON-1631498736 tempest-MultipleCreateTestJSON-1631498736-project] 10.222.0.25 "GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2" status: 404 len: 111 microversion: 2.1 time: 0.055600 Oct 27 09:32:50.434909 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3010/5954] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:50 2022] GET /compute/v2.1/servers/dafb899a-0faf-424e-9781-832e5f3fa4c2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:32:51.275173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:51.276565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:51.303137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:51.303947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:51.304504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:51.308473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:51.309505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:51.311216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:51.388746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:51.389380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:51.410246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:51.412033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:51.412892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:51.416081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:51.416590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:51.417001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:51.417206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:51.417490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:51.417938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:51.422583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lazy-loading 'fault' on Instance uuid 445e5b46-5c67-4e37-819d-c2f4a8f02d09 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:32:51.705514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:51.770326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:51.965233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513175c80e154bc9a48e7ebc9ddd021f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6312352490a4276a1bba8a35e96529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:51.975401 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca6d772f-106d-4322-829e-5f35d413722e tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 200 len: 1304 microversion: 2.1 time: 0.705667 Oct 27 09:32:52.003175 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2945/5955] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:51 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 1304 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:52.350253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:52.362387 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5edcc673-262c-4516-a241-e645e3409f5a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1362 microversion: 2.1 time: 0.978461 Oct 27 09:32:52.362973 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3011/5956] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:51 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1362 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:52.477132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5156ca8f-4b79-4e9b-a0b4-cee6a3a06e5d req-dc7e8cfd-b666-47d0-925e-7cd33234cfde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445e5b46-5c67-4e37-819d-c2f4a8f02d09", "name": "network-vif-deleted", "tag": "2f75b938-8af1-4213-ba44-8117202f870a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:52.490508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:52.518017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5156ca8f-4b79-4e9b-a0b4-cee6a3a06e5d req-dc7e8cfd-b666-47d0-925e-7cd33234cfde service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:52.518724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5156ca8f-4b79-4e9b-a0b4-cee6a3a06e5d req-dc7e8cfd-b666-47d0-925e-7cd33234cfde service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:52.522468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5156ca8f-4b79-4e9b-a0b4-cee6a3a06e5d req-dc7e8cfd-b666-47d0-925e-7cd33234cfde service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:52.569355 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5156ca8f-4b79-4e9b-a0b4-cee6a3a06e5d req-dc7e8cfd-b666-47d0-925e-7cd33234cfde service nova] Creating event network-vif-deleted:2f75b938-8af1-4213-ba44-8117202f870a for instance 445e5b46-5c67-4e37-819d-c2f4a8f02d09 on n-h1-858383-16 Oct 27 09:32:52.582186 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5156ca8f-4b79-4e9b-a0b4-cee6a3a06e5d req-dc7e8cfd-b666-47d0-925e-7cd33234cfde service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118881 Oct 27 09:32:52.583331 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2946/5957] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:32:53.018363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:53.020204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] [instance: 445e5b46-5c67-4e37-819d-c2f4a8f02d09] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:53.044465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:53.045518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:53.046198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:53.062552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:53.067786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:53.073924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:53.103429 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] HTTP exception thrown: Instance 445e5b46-5c67-4e37-819d-c2f4a8f02d09 could not be found. Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Request method failure captured: Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 HTTP/1.1 Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWk_5FIYyBvvQ4tGVV0KlGkhqSkZgwCrvj_8nfUiOLjurt7XN-oqPzzCk6KOBOeJWGA00igW7il4OcPRxjHkzGPG9kXDpwjKG9qZPGpMfGIeprQ9PWsYi6MoeOsB8bnn57ib5pp43_NYRa7hRfwjOleZ7MpRolczpQZVk0s1qXhuRfBw Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: d6312352490a4276a1bba8a35e96529c Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesActionsTest-1960699392 Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6312352490a4276a1bba8a35e96529c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d6312352490a4276a1bba8a35e96529c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6312352490a4276a1bba8a35e96529c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d6312352490a4276a1bba8a35e96529c"}]}] Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesActionsTest-1960699392 Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: d6312352490a4276a1bba8a35e96529c Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesActionsTest-1960699392 Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesActionsTest-1960699392-project Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 513175c80e154bc9a48e7ebc9ddd021f Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesActionsTest-1960699392-project Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 445e5b46-5c67-4e37-819d-c2f4a8f02d09 could not be found. Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '445e5b46-5c67-4e37-819d-c2f4a8f02d09'} Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445e5b46-5c67-4e37-819d-c2f4a8f02d09 could not be found. Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445e5b46-5c67-4e37-819d-c2f4a8f02d09 could not be found. Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:32:53.106044 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:53.111289 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:32:53.111289 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:32:53.111289 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:32:53.111289 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:32:53.111289 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:32:53.111289 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445e5b46-5c67-4e37-819d-c2f4a8f02d09 could not be found. Oct 27 09:32:53.111289 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:32:53.113555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] Returning 404 to user: Instance 445e5b46-5c67-4e37-819d-c2f4a8f02d09 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:32:53.115317 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ab0d5e8-ed09-4cf6-9b87-63a4177125f4 tempest-VolumesActionsTest-1960699392 tempest-VolumesActionsTest-1960699392-project] 10.222.0.25 "GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09" status: 404 len: 111 microversion: 2.1 time: 0.101808 Oct 27 09:32:53.116851 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3012/5958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:53 2022] GET /compute/v2.1/servers/445e5b46-5c67-4e37-819d-c2f4a8f02d09 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:32:53.398105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:53.400794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:53.418010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:53.419377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:53.420331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:53.428502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:53.436098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:53.436098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:54.142413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:54.153353 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f70d424-cf99-4afe-b7fd-9edf6e792da6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1362 microversion: 2.1 time: 0.768107 Oct 27 09:32:54.164621 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2947/5959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:53 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1362 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:55.193701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:55.195205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:55.220189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:55.221902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:55.223129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:55.225354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:55.227109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:55.227800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:55.540987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:55.556171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d867f721-5032-46a5-8ebc-cc907d39b3b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1362 microversion: 2.1 time: 0.367089 Oct 27 09:32:55.558316 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3013/5960] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:55 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:56.583720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:56.584343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:56.624779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:56.633268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:56.633999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:56.634916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:56.637080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:56.639771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:57.197544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:57.214761 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-46e26ad7-d06b-4c83-beb7-56732bcb8c2b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1362 microversion: 2.1 time: 0.634463 Oct 27 09:32:57.215429 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2948/5961] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:56 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1362 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:32:58.237869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:58.239272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:58.256809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:58.259793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:58.262081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:58.267742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:58.268502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:58.275026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:58.928575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:32:58.940457 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a4f336da-e172-4a42-b937-a6aaf5aa31b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1362 microversion: 2.1 time: 0.706258 Oct 27 09:32:58.949065 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3014/5962] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:58 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1362 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:32:59.302488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-71a0708f-4176-48ab-bfc4-bc53c5f98232 req-9b8abeb3-df60-4b80-a1f0-53c04f558f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41895c9e-2d2a-4a6b-8636-4edf5a76aeaf", "name": "network-vif-plugged", "status": "completed", "tag": "a03f8ca0-47a7-4d0b-b072-278c1c52845e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:32:59.376383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-71a0708f-4176-48ab-bfc4-bc53c5f98232 req-9b8abeb3-df60-4b80-a1f0-53c04f558f1c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:59.377150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-71a0708f-4176-48ab-bfc4-bc53c5f98232 req-9b8abeb3-df60-4b80-a1f0-53c04f558f1c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:59.378114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-71a0708f-4176-48ab-bfc4-bc53c5f98232 req-9b8abeb3-df60-4b80-a1f0-53c04f558f1c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:59.401814 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-71a0708f-4176-48ab-bfc4-bc53c5f98232 req-9b8abeb3-df60-4b80-a1f0-53c04f558f1c service nova] Creating event network-vif-plugged:a03f8ca0-47a7-4d0b-b072-278c1c52845e for instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf on n-h2-858383-16 Oct 27 09:32:59.411476 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-71a0708f-4176-48ab-bfc4-bc53c5f98232 req-9b8abeb3-df60-4b80-a1f0-53c04f558f1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117175 Oct 27 09:32:59.413569 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2949/5963] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:32:59.973080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:32:59.974864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:32:59.987669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:32:59.994812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:32:59.996795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:32:59.998909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:00.001735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:00.002414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:00.431164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:00.440388 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91fe6e86-25c0-458c-8bf8-ff0db437ba52 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1362 microversion: 2.1 time: 0.471750 Oct 27 09:33:00.441341 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3015/5964] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:32:59 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1362 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:01.464775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:01.465545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:01.486795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:01.487846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:01.488461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:01.493640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:01.495484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:01.496136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:01.902834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:01.916906 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-162b7074-249a-428a-9ed7-c01a0eb12b77 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1547 microversion: 2.1 time: 0.456242 Oct 27 09:33:01.921937 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2950/5965] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:01 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1547 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:01.983151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b357a286-1e7b-4d04-be84-aee55aca56b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:01.985183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b357a286-1e7b-4d04-be84-aee55aca56b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:02.006220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b357a286-1e7b-4d04-be84-aee55aca56b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:02.007121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b357a286-1e7b-4d04-be84-aee55aca56b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:02.007863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b357a286-1e7b-4d04-be84-aee55aca56b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:02.008879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b357a286-1e7b-4d04-be84-aee55aca56b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:02.009776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b357a286-1e7b-4d04-be84-aee55aca56b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:02.010426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b357a286-1e7b-4d04-be84-aee55aca56b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:02.041139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:02.205329 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b357a286-1e7b-4d04-be84-aee55aca56b0 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.262702 Oct 27 09:33:02.206403 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3016/5966] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:33:01 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:05.766793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-92430b08-1bac-4db0-b0d3-1826f6e0163a req-241784c9-6e1d-4e6e-8155-1f053e03f831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41895c9e-2d2a-4a6b-8636-4edf5a76aeaf", "tag": "a03f8ca0-47a7-4d0b-b072-278c1c52845e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:05.796504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-92430b08-1bac-4db0-b0d3-1826f6e0163a req-241784c9-6e1d-4e6e-8155-1f053e03f831 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:05.799142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-92430b08-1bac-4db0-b0d3-1826f6e0163a req-241784c9-6e1d-4e6e-8155-1f053e03f831 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:05.801182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-92430b08-1bac-4db0-b0d3-1826f6e0163a req-241784c9-6e1d-4e6e-8155-1f053e03f831 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:05.844237 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-92430b08-1bac-4db0-b0d3-1826f6e0163a req-241784c9-6e1d-4e6e-8155-1f053e03f831 service nova] Creating event network-changed:a03f8ca0-47a7-4d0b-b072-278c1c52845e for instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf on n-h2-858383-16 Oct 27 09:33:05.865322 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-92430b08-1bac-4db0-b0d3-1826f6e0163a req-241784c9-6e1d-4e6e-8155-1f053e03f831 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101737 Oct 27 09:33:05.866441 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2951/5967] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:33:14.128105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=27 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:14.129027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:14.842101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6755ac50-1bb6-47f5-b542-2ca8090cd7f6 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Action: 'create', calling method: .version_select at 0x7f31aa6d71f0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-392994852", "policies": ["affinity"]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:14.886460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-6755ac50-1bb6-47f5-b542-2ca8090cd7f6 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:14.906830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-6755ac50-1bb6-47f5-b542-2ca8090cd7f6 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:14.991826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-6755ac50-1bb6-47f5-b542-2ca8090cd7f6 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:15.000089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-6755ac50-1bb6-47f5-b542-2ca8090cd7f6 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:15.017227 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6755ac50-1bb6-47f5-b542-2ca8090cd7f6 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.903032 Oct 27 09:33:15.019225 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3017/5968] 10.222.0.25 () {60 vars in 1174 bytes} [Thu Oct 27 09:33:14 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:15.032955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0541be10-dc96-4916-934c-705e66c648a1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Action: 'create', calling method: .version_select at 0x7f31aa22d8b0>, body: {"server_group": {"name": "tempest-server-group-344424658", "policies": ["affinity"]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:15.070427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:15.103359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0541be10-dc96-4916-934c-705e66c648a1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:15.116412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0541be10-dc96-4916-934c-705e66c648a1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:15.240777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0541be10-dc96-4916-934c-705e66c648a1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:15.248797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0541be10-dc96-4916-934c-705e66c648a1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:15.277597 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0541be10-dc96-4916-934c-705e66c648a1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.249969 Oct 27 09:33:15.286618 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2952/5969] 10.222.0.25 () {60 vars in 1173 bytes} [Thu Oct 27 09:33:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:15.307133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e0f9c3fa-a8b5-4eb9-933b-26e0e139eb25 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Action: 'create', calling method: .version_select at 0x7f31a9dc0ca0>, body: {"server_group": {"name": "tempest-server-group-344424658", "policies": ["affinity"]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:15.337741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e0f9c3fa-a8b5-4eb9-933b-26e0e139eb25 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:15.347055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e0f9c3fa-a8b5-4eb9-933b-26e0e139eb25 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:15.431703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e0f9c3fa-a8b5-4eb9-933b-26e0e139eb25 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:15.445487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e0f9c3fa-a8b5-4eb9-933b-26e0e139eb25 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:15.498345 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e0f9c3fa-a8b5-4eb9-933b-26e0e139eb25 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.203990 Oct 27 09:33:15.501847 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3018/5970] 10.222.0.25 () {60 vars in 1173 bytes} [Thu Oct 27 09:33:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:15.511790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df1c9a2d-fe2f-4aef-8555-02c4ecf25003 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:15.620000 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df1c9a2d-fe2f-4aef-8555-02c4ecf25003 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/51063350-958f-4a41-985e-eebd764a5df5" status: 204 len: 0 microversion: 2.1 time: 0.112974 Oct 27 09:33:15.626291 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2953/5971] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:33:15 2022] DELETE /compute/v2.1/os-server-groups/51063350-958f-4a41-985e-eebd764a5df5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:33:15.636201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0fbaa0d6-9fea-4050-83de-6650488dc494 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:15.656935 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0fbaa0d6-9fea-4050-83de-6650488dc494 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.026090 Oct 27 09:33:15.659979 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3019/5972] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:33:15 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:15.671384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-028f2140-c110-4a8d-acb6-8502b1fa32a1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:15.745558 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-028f2140-c110-4a8d-acb6-8502b1fa32a1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/8aa70531-4990-4e74-99fd-67a2498653ce" status: 204 len: 0 microversion: 2.1 time: 0.069973 Oct 27 09:33:15.746362 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2954/5973] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:33:15 2022] DELETE /compute/v2.1/os-server-groups/8aa70531-4990-4e74-99fd-67a2498653ce => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:15.755544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9bc5d5d6-4d31-4b82-a962-3060fc469197 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:15.768637 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9bc5d5d6-4d31-4b82-a962-3060fc469197 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.017934 Oct 27 09:33:15.769772 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3020/5974] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:33:15 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:33:15.782502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b4f31d4-6a13-427a-b71c-d969c773d0ec tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Action: 'create', calling method: .version_select at 0x7f31a97c8c10>, body: {"server_group": {"name": "tempest-server-group-464285058", "policies": ["affinity"]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:15.813864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5b4f31d4-6a13-427a-b71c-d969c773d0ec tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:15.824184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:15.832621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5b4f31d4-6a13-427a-b71c-d969c773d0ec tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:15.921830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5b4f31d4-6a13-427a-b71c-d969c773d0ec tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:15.948719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5b4f31d4-6a13-427a-b71c-d969c773d0ec tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:15.996956 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b4f31d4-6a13-427a-b71c-d969c773d0ec tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.218867 Oct 27 09:33:15.998186 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2955/5975] 10.222.0.25 () {60 vars in 1173 bytes} [Thu Oct 27 09:33:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:16.011602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b05b25f4-47c0-4e39-af9b-f394265f79bd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:16.082009 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b05b25f4-47c0-4e39-af9b-f394265f79bd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/cf533b9b-01d2-4b3a-9374-a95f59afb99f" status: 204 len: 0 microversion: 2.1 time: 0.074816 Oct 27 09:33:16.082919 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3021/5976] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:33:16 2022] DELETE /compute/v2.1/os-server-groups/cf533b9b-01d2-4b3a-9374-a95f59afb99f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:16.091594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4cf83dc7-70ca-40ea-a641-439a0cdede03 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:16.126186 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4cf83dc7-70ca-40ea-a641-439a0cdede03 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.038615 Oct 27 09:33:16.127345 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2956/5977] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:33:16 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:16.140677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98a62208-5cce-4623-a38a-b8f0d5606e66 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Action: 'create', calling method: .version_select at 0x7f31a9d0ef70>, body: {"server_group": {"name": "tempest-server-group-603637371", "policies": ["anti-affinity"]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:16.177395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-98a62208-5cce-4623-a38a-b8f0d5606e66 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:16.196070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-98a62208-5cce-4623-a38a-b8f0d5606e66 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:16.287365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-98a62208-5cce-4623-a38a-b8f0d5606e66 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:16.294205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-98a62208-5cce-4623-a38a-b8f0d5606e66 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_groups'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:16.310719 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98a62208-5cce-4623-a38a-b8f0d5606e66 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.175103 Oct 27 09:33:16.324496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-043cd93f-cf61-47d7-a347-cdf145e56651 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:16.328739 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3022/5978] 10.222.0.25 () {60 vars in 1173 bytes} [Thu Oct 27 09:33:16 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:16.361643 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-043cd93f-cf61-47d7-a347-cdf145e56651 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/4bd4820a-1a4b-4c3d-9c99-39754512495f" status: 204 len: 0 microversion: 2.1 time: 0.041603 Oct 27 09:33:16.375161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-78040293-5072-4767-87a1-c96f65548fe9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:16.380471 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2957/5979] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:33:16 2022] DELETE /compute/v2.1/os-server-groups/4bd4820a-1a4b-4c3d-9c99-39754512495f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:16.393811 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-78040293-5072-4767-87a1-c96f65548fe9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023649 Oct 27 09:33:16.394764 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3023/5980] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:33:16 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:16.559979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1478496359", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "c737d831-3e63-417b-859e-610605a35dcd"}]}, "os:scheduler_hints": {"group": "961e9f31-1b83-49da-afbc-0dcabfd645f2"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:16.672610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] validate_networks() for [('c737d831-3e63-417b-859e-610605a35dcd', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:33:17.529278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:33:17.529910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:33:17.530227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:33:17.530902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:33:17.531871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:33:17.570215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:17.572920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:17.573643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:17.576090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:17.578228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:17.579469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:17.631619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:17.652836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:17.688653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:33:17.695037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:33:17.833610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120603) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 27 09:33:17.842671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:17.934492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_group_members'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:17.950572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_group_members'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:18.035238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_group_members'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:33:18.042703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Getting quotas for user d32b13ae55774659ac071fd000bb60fb and project efcd94a86c7e4feb973cc2a0deba5b56. Resources: {'server_group_members'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:33:18.088632 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad578548-9a3e-409f-a9dd-b05a75681f29 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533067 Oct 27 09:33:18.090781 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2958/5981] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:33:18.101331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd0b24b0-7072-4b1e-8da1-a2e72583116f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:18.102070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd0b24b0-7072-4b1e-8da1-a2e72583116f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:18.810876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd0b24b0-7072-4b1e-8da1-a2e72583116f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:18.825238 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd0b24b0-7072-4b1e-8da1-a2e72583116f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1213 microversion: 2.1 time: 0.727878 Oct 27 09:33:18.827394 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3024/5982] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:18 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1213 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:19.854986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:19.855653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:19.871366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:19.872569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:19.873033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:19.873774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:19.874243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:19.874680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:20.094809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:20.108252 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff369af6-ac4f-4d6a-abf7-15c66f45fbbe tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1265 microversion: 2.1 time: 0.258382 Oct 27 09:33:20.116429 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2959/5983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:19 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:21.145266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:21.145866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:21.159065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:21.160670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:21.161161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:21.161616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:21.162593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:21.163058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:21.163486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:21.500609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:21.538604 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0a955b8-7906-4bf5-ab89-9862c3b263e9 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1271 microversion: 2.1 time: 0.395394 Oct 27 09:33:21.541709 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3025/5984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:21 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1271 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:22.574482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:22.576818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:22.623018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:22.623864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:22.624899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:22.629436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:22.631286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:22.632419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:22.975614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:22.993534 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78b30486-78c8-4b2a-aee3-69e522283b33 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1271 microversion: 2.1 time: 0.434294 Oct 27 09:33:22.996265 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2960/5985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:22 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1271 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:24.021667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:24.022894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:24.033941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:24.034881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:24.036002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:24.037096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:24.038384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:24.039088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:24.581644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:24.596208 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97f84a94-9e44-47f1-b39d-8cfe70dbc6c4 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1313 microversion: 2.1 time: 0.577161 Oct 27 09:33:24.607794 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3026/5986] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:24 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:25.623163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:25.624744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:25.650303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:25.653035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:25.654361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:25.656701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:25.660653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:25.661305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:26.030718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:26.039533 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f8ceaff-7a60-4ffc-bdf5-67d5c9039891 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1313 microversion: 2.1 time: 0.421913 Oct 27 09:33:26.044690 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2961/5987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:25 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:26.148426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-02199981-ed67-4a4c-b62b-260da3a9894a req-42e32b03-b8a9-4c68-817d-892956c17a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1", "tag": "c7b9ded3-24d7-4cb5-8669-3ce74b94965e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:26.167547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-02199981-ed67-4a4c-b62b-260da3a9894a req-42e32b03-b8a9-4c68-817d-892956c17a4b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:26.170006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-02199981-ed67-4a4c-b62b-260da3a9894a req-42e32b03-b8a9-4c68-817d-892956c17a4b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:26.171529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-02199981-ed67-4a4c-b62b-260da3a9894a req-42e32b03-b8a9-4c68-817d-892956c17a4b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:26.213564 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-02199981-ed67-4a4c-b62b-260da3a9894a req-42e32b03-b8a9-4c68-817d-892956c17a4b service nova] Creating event network-changed:c7b9ded3-24d7-4cb5-8669-3ce74b94965e for instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 on n-h1-858383-16 Oct 27 09:33:26.226341 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-02199981-ed67-4a4c-b62b-260da3a9894a req-42e32b03-b8a9-4c68-817d-892956c17a4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080946 Oct 27 09:33:26.228235 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3027/5988] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:27.072518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:27.074064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:27.098834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:27.103387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:27.107762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:27.110468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:27.112420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:27.113815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:27.605674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:27.763476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:27.781951 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c61fdfb-d5d9-4f11-be06-a1e6062aa380 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1313 microversion: 2.1 time: 0.717699 Oct 27 09:33:27.782604 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2962/5989] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:27 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:28.807962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:28.810264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:28.821482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:28.822260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:28.822909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:28.823877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:28.825868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:28.826554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:28.827329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=26 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:29.149198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:29.162821 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2c6b9d8b-0f99-4810-962f-2881269bbca7 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1313 microversion: 2.1 time: 0.354685 Oct 27 09:33:29.163482 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3028/5990] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:28 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:30.187280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:30.193026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:30.198019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=30 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:30.217429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:30.225637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:30.229180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:30.230715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:30.231210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:30.231686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:30.653111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:30.671152 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3456c047-d8ce-4720-95cd-91bdee60074e tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1313 microversion: 2.1 time: 0.487728 Oct 27 09:33:30.672920 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2963/5991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:30 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:31.696663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:31.697578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:31.712671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:31.715147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:31.715737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:31.718454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:31.721974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:31.722594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:32.026464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:32.040021 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f4bc046-6c4c-4693-8891-3da212c69aaf tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1313 microversion: 2.1 time: 0.343575 Oct 27 09:33:32.041240 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3029/5992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:31 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:33.067445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:33.068294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:33.075367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:33.076168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:33.076836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:33.077757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:33.078426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:33.079114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:33.346847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:33.362437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad2dfdbb-6e21-40bd-b708-0f827d8dc00b tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1313 microversion: 2.1 time: 0.299144 Oct 27 09:33:33.385936 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2964/5993] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:33 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:33.749733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f00d8541-1f29-4483-a184-710944419e38 req-dc9f9233-5891-4c66-a2f3-e9da42e299e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1", "name": "network-vif-plugged", "status": "completed", "tag": "c7b9ded3-24d7-4cb5-8669-3ce74b94965e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:33.776684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f00d8541-1f29-4483-a184-710944419e38 req-dc9f9233-5891-4c66-a2f3-e9da42e299e3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:33.776949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f00d8541-1f29-4483-a184-710944419e38 req-dc9f9233-5891-4c66-a2f3-e9da42e299e3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:33.777168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f00d8541-1f29-4483-a184-710944419e38 req-dc9f9233-5891-4c66-a2f3-e9da42e299e3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:33.844439 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f00d8541-1f29-4483-a184-710944419e38 req-dc9f9233-5891-4c66-a2f3-e9da42e299e3 service nova] Creating event network-vif-plugged:c7b9ded3-24d7-4cb5-8669-3ce74b94965e for instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 on n-h1-858383-16 Oct 27 09:33:33.863262 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f00d8541-1f29-4483-a184-710944419e38 req-dc9f9233-5891-4c66-a2f3-e9da42e299e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118984 Oct 27 09:33:33.863924 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3030/5994] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:34.392439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:34.394490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:34.406792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:34.411061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:34.412715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:34.416684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:34.418573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:34.419982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:34.814467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:34.824849 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88fed6e8-7fe0-4564-9ba2-7f776a7ff964 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1313 microversion: 2.1 time: 0.437891 Oct 27 09:33:34.829058 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2965/5995] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:34 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:35.862870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:35.864883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:35.884737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:35.885998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:35.888545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:35.891116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:35.894255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:35.895165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:36.168707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:36.185028 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25be314b-3b56-464a-9db6-27355fd6958f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1498 microversion: 2.1 time: 0.329982 Oct 27 09:33:36.186070 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3031/5996] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:35 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1498 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:36.211803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fc65953-2ffd-428d-88c3-1934cf1be14f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:36.237382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.server_groups [None req-8fc65953-2ffd-428d-88c3-1934cf1be14f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Querying cell ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) for 1 instances {{(pid=120603) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 09:33:36.238107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fc65953-2ffd-428d-88c3-1934cf1be14f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:36.238594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fc65953-2ffd-428d-88c3-1934cf1be14f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:36.239034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fc65953-2ffd-428d-88c3-1934cf1be14f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:36.287468 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fc65953-2ffd-428d-88c3-1934cf1be14f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/961e9f31-1b83-49da-afbc-0dcabfd645f2" status: 200 len: 221 microversion: 2.1 time: 0.079603 Oct 27 09:33:36.288837 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2966/5997] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:33:36 2022] GET /compute/v2.1/os-server-groups/961e9f31-1b83-49da-afbc-0dcabfd645f2 => generated 221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:33:36.301431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:36.302191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:36.310206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:36.311012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:36.311750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:36.312755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:36.313433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:36.314124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:36.347106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:33:36.489074 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-42eb5b2c-f289-44f7-9e6b-86ae8d36f6b1 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 204 len: 0 microversion: 2.1 time: 0.188512 Oct 27 09:33:36.490917 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3032/5998] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:33:36 2022] DELETE /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:36.507710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:36.508339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:36.516024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:36.516527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:36.517006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:36.517743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:36.518198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:36.518618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:36.726245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:36.745478 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-468b79b3-efdf-45b8-87e8-b9d86ba2ee44 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1504 microversion: 2.1 time: 0.231543 Oct 27 09:33:36.753969 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2967/5999] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:36 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:37.763876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:37.763876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:37.770952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:37.771520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:37.772236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:37.773459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:37.773809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:37.774335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:38.047442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:38.058573 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-919550fe-4c05-45c5-b58a-42257d6a9b47 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1504 microversion: 2.1 time: 0.302240 Oct 27 09:33:38.059580 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3033/6000] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:37 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:38.569782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-13d19c33-6a31-466d-b104-c5bf35171a05 req-41675e30-4524-4593-84fb-7e773169c3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1", "name": "network-vif-deleted", "tag": "c7b9ded3-24d7-4cb5-8669-3ce74b94965e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:33:38.585969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-13d19c33-6a31-466d-b104-c5bf35171a05 req-41675e30-4524-4593-84fb-7e773169c3f6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:38.586530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-13d19c33-6a31-466d-b104-c5bf35171a05 req-41675e30-4524-4593-84fb-7e773169c3f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:38.587147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-13d19c33-6a31-466d-b104-c5bf35171a05 req-41675e30-4524-4593-84fb-7e773169c3f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:38.608147 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-13d19c33-6a31-466d-b104-c5bf35171a05 req-41675e30-4524-4593-84fb-7e773169c3f6 service nova] Creating event network-vif-deleted:c7b9ded3-24d7-4cb5-8669-3ce74b94965e for instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 on n-h1-858383-16 Oct 27 09:33:38.615715 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-13d19c33-6a31-466d-b104-c5bf35171a05 req-41675e30-4524-4593-84fb-7e773169c3f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050211 Oct 27 09:33:38.616578 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2968/6001] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:39.091102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:39.092853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:39.115067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:39.115861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:39.116679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:39.117954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:39.119688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:39.120632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:39.185810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:39.186399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:39.187056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:39.187959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lazy-loading 'fault' on Instance uuid ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:33:39.297397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32b13ae55774659ac071fd000bb60fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcd94a86c7e4feb973cc2a0deba5b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:33:39.305646 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f59f1675-558a-4324-8b25-e701c22ebabd tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 200 len: 1303 microversion: 2.1 time: 0.220422 Oct 27 09:33:39.306270 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3034/6002] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:39 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 1303 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:40.342644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.358337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:40.379986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:40.381209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:40.382041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:40.383693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:40.384636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:40.385907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:40.409662 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] HTTP exception thrown: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Request method failure captured: Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 HTTP/1.1 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlBZtVo3cy3aWcoek31m240AbpLyygzt6qN7TQTVF8uePPfQNEvmZ-K82eVi4Y_QaVFmkwV_WmyAVfeq16-LmUuQmCCT1i9EbRqCKn8eXlngcdHg74N-cmvOOFxhMKtSIYNly9rFtKLEaQhYf1B_uhzDzb0ZmU68uUqpJFc_bv5hCz8 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efcd94a86c7e4feb973cc2a0deba5b56"}]}] Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d32b13ae55774659ac071fd000bb60fb Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1'} Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.411859 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Returning 404 to user: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-98b7c96f-f063-4ad7-afa0-e36e00fc35e3 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 404 len: 111 microversion: 2.1 time: 0.087523 Oct 27 09:33:40.422831 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2969/6003] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:40 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:33:40.432112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fb443b63-1c57-4a30-8a97-d8a9bf5c397f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.451165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.compute.server_groups [None req-fb443b63-1c57-4a30-8a97-d8a9bf5c397f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Querying cell ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) for 1 instances {{(pid=120602) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 09:33:40.452248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb443b63-1c57-4a30-8a97-d8a9bf5c397f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:40.452920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb443b63-1c57-4a30-8a97-d8a9bf5c397f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:40.453509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb443b63-1c57-4a30-8a97-d8a9bf5c397f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:40.466274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fb443b63-1c57-4a30-8a97-d8a9bf5c397f tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.039300 Oct 27 09:33:40.474647 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3035/6004] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:33:40 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:40.481953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fabc9ff-c892-484b-9656-101a859616e8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.497925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.server_groups [None req-8fabc9ff-c892-484b-9656-101a859616e8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Querying cell ca6a4242-3cb0-40b8-b656-fee1e0b6f427(cell1) for 1 instances {{(pid=120603) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 27 09:33:40.498634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fabc9ff-c892-484b-9656-101a859616e8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:40.499303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fabc9ff-c892-484b-9656-101a859616e8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:40.499777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fabc9ff-c892-484b-9656-101a859616e8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:40.511095 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fabc9ff-c892-484b-9656-101a859616e8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/961e9f31-1b83-49da-afbc-0dcabfd645f2" status: 200 len: 183 microversion: 2.1 time: 0.034962 Oct 27 09:33:40.511601 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2970/6005] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:33:40 2022] GET /compute/v2.1/os-server-groups/961e9f31-1b83-49da-afbc-0dcabfd645f2 => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:33:40.525006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.525563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:40.532511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:40.533860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:40.535129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:40.535289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:40.539843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:40.540814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:40.557300 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] HTTP exception thrown: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Request method failure captured: Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 HTTP/1.1 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlBZtVo3cy3aWcoek31m240AbpLyygzt6qN7TQTVF8uePPfQNEvmZ-K82eVi4Y_QaVFmkwV_WmyAVfeq16-LmUuQmCCT1i9EbRqCKn8eXlngcdHg74N-cmvOOFxhMKtSIYNly9rFtKLEaQhYf1B_uhzDzb0ZmU68uUqpJFc_bv5hCz8 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efcd94a86c7e4feb973cc2a0deba5b56"}]}] Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: d32b13ae55774659ac071fd000bb60fb Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1'} Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:33:40.559299 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Returning 404 to user: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-412dc52c-ca33-48ce-9732-a8ea4fb49f50 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 404 len: 111 microversion: 2.1 time: 0.040029 Oct 27 09:33:40.567683 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3036/6006] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:33:40 2022] DELETE /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:33:40.572261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.573038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] [instance: ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:33:40.583585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:40.584251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:40.585547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:40.586510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:33:40.587378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:33:40.588153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:33:40.604619 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] HTTP exception thrown: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Request method failure captured: Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 HTTP/1.1 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlBZtVo3cy3aWcoek31m240AbpLyygzt6qN7TQTVF8uePPfQNEvmZ-K82eVi4Y_QaVFmkwV_WmyAVfeq16-LmUuQmCCT1i9EbRqCKn8eXlngcdHg74N-cmvOOFxhMKtSIYNly9rFtKLEaQhYf1B_uhzDzb0ZmU68uUqpJFc_bv5hCz8 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efcd94a86c7e4feb973cc2a0deba5b56"}]}] Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d32b13ae55774659ac071fd000bb60fb Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1'} Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.606709 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.611498 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.611498 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.611498 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.611498 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:33:40.611498 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:33:40.611498 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. Oct 27 09:33:40.611498 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.613171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Returning 404 to user: Instance ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:33:40.614306 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf24e350-7c1a-4f8a-b476-3bce875173f8 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1" status: 404 len: 111 microversion: 2.1 time: 0.048280 Oct 27 09:33:40.615419 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2971/6007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:33:40 2022] GET /compute/v2.1/servers/ecb7b22f-abc9-4340-b106-5c3a2ef6c9a1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:33:40.623705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd06cee7-b824-4fb4-b455-93619da2b8ae tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.631047 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-bd06cee7-b824-4fb4-b455-93619da2b8ae tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] HTTP exception thrown: Instance group 4bd4820a-1a4b-4c3d-9c99-39754512495f could not be found. Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd06cee7-b824-4fb4-b455-93619da2b8ae tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Request method failure captured: Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-server-groups/4bd4820a-1a4b-4c3d-9c99-39754512495f HTTP/1.1 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlBZtVo3cy3aWcoek31m240AbpLyygzt6qN7TQTVF8uePPfQNEvmZ-K82eVi4Y_QaVFmkwV_WmyAVfeq16-LmUuQmCCT1i9EbRqCKn8eXlngcdHg74N-cmvOOFxhMKtSIYNly9rFtKLEaQhYf1B_uhzDzb0ZmU68uUqpJFc_bv5hCz8 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efcd94a86c7e4feb973cc2a0deba5b56"}]}] Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: d32b13ae55774659ac071fd000bb60fb Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance group 4bd4820a-1a4b-4c3d-9c99-39754512495f could not be found. Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4bd4820a-1a4b-4c3d-9c99-39754512495f'} Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4bd4820a-1a4b-4c3d-9c99-39754512495f could not be found. Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4bd4820a-1a4b-4c3d-9c99-39754512495f could not be found. Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.633664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.639224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.639224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.639224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:33:40.639224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:33:40.639224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4bd4820a-1a4b-4c3d-9c99-39754512495f could not be found. Oct 27 09:33:40.639224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.643487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd06cee7-b824-4fb4-b455-93619da2b8ae tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Returning 404 to user: Instance group 4bd4820a-1a4b-4c3d-9c99-39754512495f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:33:40.644629 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd06cee7-b824-4fb4-b455-93619da2b8ae tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/4bd4820a-1a4b-4c3d-9c99-39754512495f" status: 404 len: 117 microversion: 2.1 time: 0.025169 Oct 27 09:33:40.646171 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3037/6008] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:33:40 2022] DELETE /compute/v2.1/os-server-groups/4bd4820a-1a4b-4c3d-9c99-39754512495f => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:33:40.659475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c9885ba-76d3-404c-818a-f0dfeb7fc9e2 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.667111 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-2c9885ba-76d3-404c-818a-f0dfeb7fc9e2 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] HTTP exception thrown: Instance group cf533b9b-01d2-4b3a-9374-a95f59afb99f could not be found. Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c9885ba-76d3-404c-818a-f0dfeb7fc9e2 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Request method failure captured: Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-server-groups/cf533b9b-01d2-4b3a-9374-a95f59afb99f HTTP/1.1 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlBZtVo3cy3aWcoek31m240AbpLyygzt6qN7TQTVF8uePPfQNEvmZ-K82eVi4Y_QaVFmkwV_WmyAVfeq16-LmUuQmCCT1i9EbRqCKn8eXlngcdHg74N-cmvOOFxhMKtSIYNly9rFtKLEaQhYf1B_uhzDzb0ZmU68uUqpJFc_bv5hCz8 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efcd94a86c7e4feb973cc2a0deba5b56"}]}] Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d32b13ae55774659ac071fd000bb60fb Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance group cf533b9b-01d2-4b3a-9374-a95f59afb99f could not be found. Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'cf533b9b-01d2-4b3a-9374-a95f59afb99f'} Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cf533b9b-01d2-4b3a-9374-a95f59afb99f could not be found. Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cf533b9b-01d2-4b3a-9374-a95f59afb99f could not be found. Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.670167 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.674857 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.674857 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.674857 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:33:40.674857 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:33:40.674857 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cf533b9b-01d2-4b3a-9374-a95f59afb99f could not be found. Oct 27 09:33:40.674857 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.678214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c9885ba-76d3-404c-818a-f0dfeb7fc9e2 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Returning 404 to user: Instance group cf533b9b-01d2-4b3a-9374-a95f59afb99f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:33:40.680810 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c9885ba-76d3-404c-818a-f0dfeb7fc9e2 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/cf533b9b-01d2-4b3a-9374-a95f59afb99f" status: 404 len: 117 microversion: 2.1 time: 0.029780 Oct 27 09:33:40.682201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2972/6009] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:33:40 2022] DELETE /compute/v2.1/os-server-groups/cf533b9b-01d2-4b3a-9374-a95f59afb99f => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:33:40.698870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f04ea25-d710-4465-98c6-fade32690c86 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.710744 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-5f04ea25-d710-4465-98c6-fade32690c86 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] HTTP exception thrown: Instance group 8aa70531-4990-4e74-99fd-67a2498653ce could not be found. Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f04ea25-d710-4465-98c6-fade32690c86 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Request method failure captured: Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/os-server-groups/8aa70531-4990-4e74-99fd-67a2498653ce HTTP/1.1 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlBZtVo3cy3aWcoek31m240AbpLyygzt6qN7TQTVF8uePPfQNEvmZ-K82eVi4Y_QaVFmkwV_WmyAVfeq16-LmUuQmCCT1i9EbRqCKn8eXlngcdHg74N-cmvOOFxhMKtSIYNly9rFtKLEaQhYf1B_uhzDzb0ZmU68uUqpJFc_bv5hCz8 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efcd94a86c7e4feb973cc2a0deba5b56"}]}] Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: d32b13ae55774659ac071fd000bb60fb Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance group 8aa70531-4990-4e74-99fd-67a2498653ce could not be found. Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '8aa70531-4990-4e74-99fd-67a2498653ce'} Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8aa70531-4990-4e74-99fd-67a2498653ce could not be found. Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8aa70531-4990-4e74-99fd-67a2498653ce could not be found. Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.712380 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.717715 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.717715 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.717715 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:33:40.717715 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:33:40.717715 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8aa70531-4990-4e74-99fd-67a2498653ce could not be found. Oct 27 09:33:40.717715 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.717715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f04ea25-d710-4465-98c6-fade32690c86 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Returning 404 to user: Instance group 8aa70531-4990-4e74-99fd-67a2498653ce could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:33:40.717715 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f04ea25-d710-4465-98c6-fade32690c86 tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/8aa70531-4990-4e74-99fd-67a2498653ce" status: 404 len: 117 microversion: 2.1 time: 0.025455 Oct 27 09:33:40.717715 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3038/6010] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:33:40 2022] DELETE /compute/v2.1/os-server-groups/8aa70531-4990-4e74-99fd-67a2498653ce => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:33:40.724408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d94698ac-563b-466b-8bbd-bf52c8529f6d tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.758555 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d94698ac-563b-466b-8bbd-bf52c8529f6d tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] HTTP exception thrown: Instance group 51063350-958f-4a41-985e-eebd764a5df5 could not be found. Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d94698ac-563b-466b-8bbd-bf52c8529f6d tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Request method failure captured: Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-server-groups/51063350-958f-4a41-985e-eebd764a5df5 HTTP/1.1 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlBZtVo3cy3aWcoek31m240AbpLyygzt6qN7TQTVF8uePPfQNEvmZ-K82eVi4Y_QaVFmkwV_WmyAVfeq16-LmUuQmCCT1i9EbRqCKn8eXlngcdHg74N-cmvOOFxhMKtSIYNly9rFtKLEaQhYf1B_uhzDzb0ZmU68uUqpJFc_bv5hCz8 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efcd94a86c7e4feb973cc2a0deba5b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efcd94a86c7e4feb973cc2a0deba5b56"}]}] Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: efcd94a86c7e4feb973cc2a0deba5b56 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerGroupTestJSON-1540394736 Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d32b13ae55774659ac071fd000bb60fb Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerGroupTestJSON-1540394736-project Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance group 51063350-958f-4a41-985e-eebd764a5df5 could not be found. Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '51063350-958f-4a41-985e-eebd764a5df5'} Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 51063350-958f-4a41-985e-eebd764a5df5 could not be found. Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 51063350-958f-4a41-985e-eebd764a5df5 could not be found. Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.760385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:33:40.766843 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:33:40.766843 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:33:40.766843 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:33:40.766843 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:33:40.766843 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 51063350-958f-4a41-985e-eebd764a5df5 could not be found. Oct 27 09:33:40.766843 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:33:40.766843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d94698ac-563b-466b-8bbd-bf52c8529f6d tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Returning 404 to user: Instance group 51063350-958f-4a41-985e-eebd764a5df5 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:33:40.766843 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d94698ac-563b-466b-8bbd-bf52c8529f6d tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/51063350-958f-4a41-985e-eebd764a5df5" status: 404 len: 117 microversion: 2.1 time: 0.042619 Oct 27 09:33:40.769524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2973/6011] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:33:40 2022] DELETE /compute/v2.1/os-server-groups/51063350-958f-4a41-985e-eebd764a5df5 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:33:40.774619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-36090a5e-78df-45aa-9955-a3a5b2f7dccb tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:33:40.809112 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-36090a5e-78df-45aa-9955-a3a5b2f7dccb tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/961e9f31-1b83-49da-afbc-0dcabfd645f2" status: 204 len: 0 microversion: 2.1 time: 0.038200 Oct 27 09:33:40.810546 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3039/6012] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 09:33:40 2022] DELETE /compute/v2.1/os-server-groups/961e9f31-1b83-49da-afbc-0dcabfd645f2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:34:05.611751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d94698ac-563b-466b-8bbd-bf52c8529f6d tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:05.612592 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d94698ac-563b-466b-8bbd-bf52c8529f6d tempest-ServerGroupTestJSON-1540394736 tempest-ServerGroupTestJSON-1540394736-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001472 Oct 27 09:34:05.612939 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2974/6013] 10.222.0.25 () {56 vars in 886 bytes} [Thu Oct 27 09:34:05 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 09:34:08.859776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:08.862506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:08.873701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:08.878155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:08.883950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:08.897286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:08.911896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:08.920659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:08.923381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:08.925130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:09.005676 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/ips" status: 200 len: 145 microversion: 2.1 time: 0.192756 Oct 27 09:34:09.020131 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3040/6014] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:34:08 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/ips => generated 145 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:12.897076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=62 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:12.897843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:12.903946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59c34252-9aac-4915-b7bb-af0771e70975 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6793311-ba79-47c8-a804-fc6bf9dea596"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:34:12.911970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59c34252-9aac-4915-b7bb-af0771e70975 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:12.924864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c34252-9aac-4915-b7bb-af0771e70975 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:12.925374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c34252-9aac-4915-b7bb-af0771e70975 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:12.925824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c34252-9aac-4915-b7bb-af0771e70975 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:12.926551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c34252-9aac-4915-b7bb-af0771e70975 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:12.927018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c34252-9aac-4915-b7bb-af0771e70975 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:12.927449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c34252-9aac-4915-b7bb-af0771e70975 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:13.609432 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59c34252-9aac-4915-b7bb-af0771e70975 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713504 Oct 27 09:34:13.610051 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2975/6015] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:34:12 2022] POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:20.720935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:20.722048 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae371716-fbb6-4c92-80ac-b0b50d03126a tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001444 Oct 27 09:34:20.722738 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3041/6016] 10.222.0.25 () {56 vars in 886 bytes} [Thu Oct 27 09:34:20 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 27 09:34:26.964854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe45943b-2fd0-4f4f-9524-73489fd51392 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31a97f1a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:26.981680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:26.982695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:27.068513 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe45943b-2fd0-4f4f-9524-73489fd51392 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/7aa28693-dc51-4d34-ac74-070618030a51" status: 200 len: 351 microversion: 2.1 time: 0.108106 Oct 27 09:34:27.076968 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2976/6017] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:34:26 2022] GET /compute/v2.1/os-volumes/7aa28693-dc51-4d34-ac74-070618030a51 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:29.811887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a1e0110-da42-4126-aac1-396592904114 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31a9192a60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:29.880260 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4a1e0110-da42-4126-aac1-396592904114 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4f883092-0635-481e-9a01-da6a9949112a" status: 200 len: 351 microversion: 2.1 time: 0.073806 Oct 27 09:34:29.888909 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3042/6018] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:34:29 2022] GET /compute/v2.1/os-volumes/4f883092-0635-481e-9a01-da6a9949112a => generated 351 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:30.826265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0d2a93f-17f3-45c6-a0a8-91011fe73130 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:34:30.834364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0d2a93f-17f3-45c6-a0a8-91011fe73130 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:30.835221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0d2a93f-17f3-45c6-a0a8-91011fe73130 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:30.835942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0d2a93f-17f3-45c6-a0a8-91011fe73130 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:30.885664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0d2a93f-17f3-45c6-a0a8-91011fe73130 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Going to try to stop instance {{(pid=120603) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:34:30.970829 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0d2a93f-17f3-45c6-a0a8-91011fe73130 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/action" status: 202 len: 0 microversion: 2.1 time: 0.149173 Oct 27 09:34:30.974781 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2977/6019] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:34:30 2022] POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:34:30.987599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:30.991381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:31.016865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:31.017881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:31.018510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:31.021464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:31.023776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:31.024452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:31.351257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:31.365251 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2014cd2b-e2cb-4df4-99ac-98fce47aef87 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.386220 Oct 27 09:34:31.366237 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3043/6020] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:30 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:32.396236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:32.397532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:32.404109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:32.404858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:32.405493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:32.406372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:32.406987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:32.407596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:32.678150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7a5e7fa-884b-4b33-9bcb-32899bc63f27 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31a94704c0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:32.695180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:32.703926 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a545d66f-7605-4833-8937-26ce193d8a30 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.313230 Oct 27 09:34:32.707946 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2978/6021] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:32 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:32.775202 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7a5e7fa-884b-4b33-9bcb-32899bc63f27 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/215edf3d-1d58-4a23-a328-f1b96787c21c" status: 200 len: 350 microversion: 2.1 time: 0.101017 Oct 27 09:34:32.776114 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3044/6022] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:34:32 2022] GET /compute/v2.1/os-volumes/215edf3d-1d58-4a23-a328-f1b96787c21c => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:32.797452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d5eae8e-3579-411e-a4d0-3245e3e61c8b tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31aa12d430>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:32.903197 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d5eae8e-3579-411e-a4d0-3245e3e61c8b tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.114908 Oct 27 09:34:32.914175 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2979/6023] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Oct 27 09:34:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:32.919308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b31040fa-4535-4e07-9276-1ae2770b6af2 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31a94a5c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:33.043170 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b31040fa-4535-4e07-9276-1ae2770b6af2 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.127541 Oct 27 09:34:33.064345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c428de79-6587-42bd-b2dd-0c4264b66fa7 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31a9964f70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:33.065373 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3045/6024] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Oct 27 09:34:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:33.243552 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c428de79-6587-42bd-b2dd-0c4264b66fa7 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.183119 Oct 27 09:34:33.253939 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2980/6025] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Oct 27 09:34:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:33.262440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4bc90286-53e1-4bc0-8727-f5e9e32ed794 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31ae6a1e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:33.441670 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4bc90286-53e1-4bc0-8727-f5e9e32ed794 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.183934 Oct 27 09:34:33.442625 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3046/6026] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Oct 27 09:34:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:33.457924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e3938e90-02db-425a-a216-67e38dfdcde8 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31a9030af0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:33.603272 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e3938e90-02db-425a-a216-67e38dfdcde8 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.149517 Oct 27 09:34:33.628176 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2981/6027] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Oct 27 09:34:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:33.629828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c81f89d5-60a1-4414-b64d-d53384cb0b0c tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31a9f903a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:33.740158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:33.740158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:33.774651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:33.775562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:33.783523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:33.794069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:33.796776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:33.797875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:33.845606 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c81f89d5-60a1-4414-b64d-d53384cb0b0c tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.225330 Oct 27 09:34:33.847222 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3047/6028] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:34:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:33.884018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0d355eab-e22b-4ccf-9338-72d0802ef82a tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31a9e24550>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:34.034286 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0d355eab-e22b-4ccf-9338-72d0802ef82a tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.165636 Oct 27 09:34:34.034942 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3048/6029] 10.222.0.25 () {58 vars in 1188 bytes} [Thu Oct 27 09:34:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:34.049559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-16b16f38-9d9c-4478-a391-4b60f7128fd2 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] Calling method '.version_select at 0x7f31ab07a5e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:34.210750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:34.228656 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9324a41e-4fc1-4854-a9a7-648f6ec8cf13 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.498464 Oct 27 09:34:34.230017 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2982/6030] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:33 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:34:34.267544 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-16b16f38-9d9c-4478-a391-4b60f7128fd2 tempest-VolumesTestJSON-2086888048 tempest-VolumesTestJSON-2086888048-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.222010 Oct 27 09:34:34.268381 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3049/6031] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:34:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:34:35.276811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:35.277622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:35.313039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:35.315597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:35.316321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:35.317170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:35.317704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:35.324885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:35.649232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:35.667189 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61473b36-2edc-4d26-a0d1-116de778263d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.400361 Oct 27 09:34:35.669519 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2983/6032] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:35 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:36.709229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:36.710970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:36.745864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:36.746717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:36.747545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:36.748485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:36.762872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:36.763692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:37.054952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:37.068965 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd9cbfff-c1fa-4ee0-a289-c84a1dfc97b1 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.375003 Oct 27 09:34:37.070530 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3050/6033] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:36 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:38.113572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:38.114194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:38.144187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:38.144599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:38.145042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:38.145789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:38.146419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:38.147001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:38.475052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:38.506728 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cbc8468b-d10d-41cd-97ab-38dea076b6db tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.396862 Oct 27 09:34:38.535977 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2984/6034] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:38 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:39.554802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:39.556542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:39.588724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:39.594926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:39.603086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:39.603775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:39.604795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:39.608519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:40.073357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:40.087554 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9cca7af-c5cc-48d1-be38-7a35278387d6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.543182 Oct 27 09:34:40.089883 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3051/6035] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:39 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:41.120978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:41.122920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:41.131114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:41.135412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:41.136168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:41.139558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:41.140288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:41.142630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:41.329210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:41.352443 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77394e46-28e9-4183-9da0-5556d092bd4f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.237916 Oct 27 09:34:41.353202 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2985/6036] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:41 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:42.376988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:42.377605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:42.387037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:42.387532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:42.387999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:42.388721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:42.389212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:42.389642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:43.263150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:43.282817 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4da026f6-87dc-4292-9e48-df3260eafbe3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.908820 Oct 27 09:34:43.287989 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3052/6037] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:42 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:44.313898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:44.314635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:44.346953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:44.353638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:44.355984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:44.356866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:44.358994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:44.361145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:45.445707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:45.459171 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0cc0ae31-5076-4089-adbf-d165544863fa tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 1.151026 Oct 27 09:34:45.462195 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2986/6038] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:44 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:46.496556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:46.497233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:46.524135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:46.526670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:46.527180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:46.530587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:46.531544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:46.532945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:46.787106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:46.797210 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-727b38f1-b459-4de3-8786-6bd86eef9e78 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1722 microversion: 2.1 time: 0.310996 Oct 27 09:34:46.798121 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3053/6039] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:46 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:47.822660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:47.823276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:47.833598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:47.834097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:47.834537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:47.835251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:47.835766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:47.858241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:48.215277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:48.225557 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dcfd1349-88e2-4be4-983a-1bcb028ba45e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1699 microversion: 2.1 time: 0.407511 Oct 27 09:34:48.230351 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2987/6040] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:47 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1699 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:48.251153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ae64c2e-b6d2-4ab2-953e-8cde33107623 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:34:48.264639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ae64c2e-b6d2-4ab2-953e-8cde33107623 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:48.265140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ae64c2e-b6d2-4ab2-953e-8cde33107623 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:48.265582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ae64c2e-b6d2-4ab2-953e-8cde33107623 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:48.313801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ae64c2e-b6d2-4ab2-953e-8cde33107623 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Going to try to start instance {{(pid=120602) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 09:34:48.406574 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ae64c2e-b6d2-4ab2-953e-8cde33107623 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/action" status: 202 len: 0 microversion: 2.1 time: 0.160610 Oct 27 09:34:48.407351 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3054/6041] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:34:48 2022] POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:34:48.418065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:48.419174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:48.430788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:48.431369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:48.431911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:48.433553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:48.434246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:48.434784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:48.733807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:48.750454 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e08488c1-bb89-4966-b30e-74e4e87ef359 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1708 microversion: 2.1 time: 0.337997 Oct 27 09:34:48.751176 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2988/6042] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:48 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1708 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:49.780639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:49.782135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:49.793865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:49.796956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:49.797819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:49.800590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:49.801256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:49.801851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:50.174679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:50.183202 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5546a281-07c3-40c9-beb3-1b1ee10ebf2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1708 microversion: 2.1 time: 0.408872 Oct 27 09:34:50.192024 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3055/6043] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:49 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1708 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:51.216227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:51.217655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:51.226783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:51.241630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:51.242088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:51.258051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:51.258599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:51.259047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:52.038149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:52.051983 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3c2cb32-d8d2-4155-a0b1-457e7e00572d tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1712 microversion: 2.1 time: 0.839978 Oct 27 09:34:52.055936 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2989/6044] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:51 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1712 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:54.250006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1341446207", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "821578f5-1ec5-4036-a9aa-0293f8fcf84e"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:34:54.332423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] validate_networks() for [('821578f5-1ec5-4036-a9aa-0293f8fcf84e', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:34:55.027662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:34:55.028241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:34:55.028732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:34:55.029885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:34:55.030316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:34:55.055307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:55.055896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:55.056553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:55.057474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:55.057967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:55.058849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:55.108134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Getting quotas for project dcbf308f12364b7d9a6be5b5e1a4f90b. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:34:55.127225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Getting quotas for user 5e4011fcac884c7cb5a7a9319f28ec6e and project dcbf308f12364b7d9a6be5b5e1a4f90b. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:34:55.178460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:34:55.181392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:34:55.282535 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a02ce54-75a8-4167-bd10-0db832a3ae97 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473484 Oct 27 09:34:55.284040 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3056/6045] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:34:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:34:55.308087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5b16a55-2913-4e96-ae9d-207c71ab42d3 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:55.310485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5b16a55-2913-4e96-ae9d-207c71ab42d3 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:55.456110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5b16a55-2913-4e96-ae9d-207c71ab42d3 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:55.464776 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5b16a55-2913-4e96-ae9d-207c71ab42d3 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1214 microversion: 2.1 time: 0.172391 Oct 27 09:34:55.469673 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2990/6046] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:55 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:34:56.541542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:56.546106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:56.566267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:56.567025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:56.568416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:56.569681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:56.570343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:56.571092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:56.664937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:56.678867 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-021b67c3-2f59-4ecc-9019-f4d70144ea14 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1210 microversion: 2.1 time: 0.165983 Oct 27 09:34:56.680254 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3057/6047] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:56 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:57.704757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:57.706008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:57.719440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=25 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:57.724856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:57.725465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:57.727009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:57.728645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:57.730576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:57.731899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:57.800809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:57.910173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:57.927854 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5a26c96-95a2-4bf6-9a1e-d075abd26768 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1272 microversion: 2.1 time: 0.223200 Oct 27 09:34:57.928754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2991/6048] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:57 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:58.966920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:58.967805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:34:58.995312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:58.996361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:59.003078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:59.004055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:59.009933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:59.016645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:59.410049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:34:59.458446 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c8e9fb8-c346-44e7-ba06-9315a65ca730 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1314 microversion: 2.1 time: 0.497098 Oct 27 09:34:59.461790 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3058/6049] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:34:58 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:59.943067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f01f397e-3e57-471e-9e88-bf8ad4bccf45 req-8fd4c115-1d21-4cc3-bac4-c07ae5ab4f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7809ffb3-56ba-4a6f-96bc-a9169f7ed061", "tag": "e544e724-9ff7-4e9e-beb2-213cadf2caa4"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:34:59.980008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f01f397e-3e57-471e-9e88-bf8ad4bccf45 req-8fd4c115-1d21-4cc3-bac4-c07ae5ab4f71 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:59.980713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f01f397e-3e57-471e-9e88-bf8ad4bccf45 req-8fd4c115-1d21-4cc3-bac4-c07ae5ab4f71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:59.981321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f01f397e-3e57-471e-9e88-bf8ad4bccf45 req-8fd4c115-1d21-4cc3-bac4-c07ae5ab4f71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:00.028302 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f01f397e-3e57-471e-9e88-bf8ad4bccf45 req-8fd4c115-1d21-4cc3-bac4-c07ae5ab4f71 service nova] Creating event network-changed:e544e724-9ff7-4e9e-beb2-213cadf2caa4 for instance 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 on n-h1-858383-16 Oct 27 09:35:00.040167 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f01f397e-3e57-471e-9e88-bf8ad4bccf45 req-8fd4c115-1d21-4cc3-bac4-c07ae5ab4f71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101594 Oct 27 09:35:00.041461 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2992/6050] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:35:00.483372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:00.484190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:00.487379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:00.521410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:00.521924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:00.522384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:00.527500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:00.528412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:00.531094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:00.584608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:00.881482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:00.890971 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-807e61a6-0f36-4464-984f-73f41fe7eb80 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1314 microversion: 2.1 time: 0.412121 Oct 27 09:35:00.903590 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3059/6051] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:00 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:01.917593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:01.918315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:01.930742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:01.944685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:01.945152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:01.945912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:01.947133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:01.947613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:02.353738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:02.362786 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abc66a7e-83e8-44e6-8148-4601c05d90e1 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1314 microversion: 2.1 time: 0.451643 Oct 27 09:35:02.379597 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2993/6052] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:01 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:03.394125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:03.394892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:03.429734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:03.432054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:03.434079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:03.445894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:03.447961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:03.454299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:03.895514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:03.910783 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ff6089a-2bc8-4db8-8b4b-73ca74331234 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1314 microversion: 2.1 time: 0.521153 Oct 27 09:35:03.911392 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3060/6053] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:03 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:04.935180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:04.935948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:04.943779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:04.944624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:04.945290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:04.946189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:04.946748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:04.947478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:05.217588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:05.230308 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0013bd20-b5dd-46e6-9875-f87a2b3cef41 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1314 microversion: 2.1 time: 0.299969 Oct 27 09:35:05.230916 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2994/6054] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:04 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:05.674192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-75ef5e10-24e1-459d-a88d-1464a01913f1 req-ccfb2607-d641-42ed-9f3f-38d9374cd46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7809ffb3-56ba-4a6f-96bc-a9169f7ed061", "name": "network-vif-plugged", "status": "completed", "tag": "e544e724-9ff7-4e9e-beb2-213cadf2caa4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:05.679443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:05.684752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:05.702384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-75ef5e10-24e1-459d-a88d-1464a01913f1 req-ccfb2607-d641-42ed-9f3f-38d9374cd46d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:05.702855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-75ef5e10-24e1-459d-a88d-1464a01913f1 req-ccfb2607-d641-42ed-9f3f-38d9374cd46d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:05.703306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-75ef5e10-24e1-459d-a88d-1464a01913f1 req-ccfb2607-d641-42ed-9f3f-38d9374cd46d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:05.735118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-75ef5e10-24e1-459d-a88d-1464a01913f1 req-ccfb2607-d641-42ed-9f3f-38d9374cd46d service nova] Creating event network-vif-plugged:e544e724-9ff7-4e9e-beb2-213cadf2caa4 for instance 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 on n-h1-858383-16 Oct 27 09:35:05.741803 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-75ef5e10-24e1-459d-a88d-1464a01913f1 req-ccfb2607-d641-42ed-9f3f-38d9374cd46d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072724 Oct 27 09:35:05.742848 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3061/6055] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:35:06.256787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:06.257417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:06.267287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:06.273162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:06.278035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:06.278617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:06.279373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:06.279874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:06.280314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:06.491927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:06.502136 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b040d5b-637f-4d98-8aeb-306658a40e79 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1314 microversion: 2.1 time: 0.249058 Oct 27 09:35:06.502733 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2995/6056] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:06 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:35:07.529779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:07.531277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:07.558089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:07.559169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:07.561083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:07.563087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:07.564861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:07.565781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:07.858770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:07.872962 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b03f9f6b-cbf3-4d09-a843-72a7ca1a8334 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1497 microversion: 2.1 time: 0.349469 Oct 27 09:35:07.877181 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3062/6057] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:07 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1497 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:13.427881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:13.429678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:13.452694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:13.460034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:13.462777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:13.464066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:13.467080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:13.469022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:13.536717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:35:13.691114 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3000ad95-a4b7-4d75-a80f-665f6473b2d4 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 204 len: 0 microversion: 2.1 time: 0.271663 Oct 27 09:35:13.692116 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2996/6058] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:35:13 2022] DELETE /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:35:13.701400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:13.702017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:13.717696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:13.718405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:13.719106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:13.720242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:13.720869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:13.721880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:13.909680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:13.920009 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ca1be1c5-3ca4-4578-8e53-2c6f32587a56 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1503 microversion: 2.1 time: 0.223368 Oct 27 09:35:13.922782 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3063/6059] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:13 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:35:14.175849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-298201914", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "2807eece-45d1-4709-8d13-6ba823a39ff8"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:14.272890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] validate_networks() for [('2807eece-45d1-4709-8d13-6ba823a39ff8', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:35:14.945084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:14.946320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:14.954894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:14.955688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:14.956327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:14.957220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:14.957865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:14.958463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:15.002842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:35:15.004092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:35:15.004846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:35:15.005429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:35:15.006055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:35:15.018474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:15.019215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:15.019862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:15.020845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:15.021532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:15.022209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:15.043640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Getting quotas for project 2cea321144ad4104bca58f5f262c929b. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:35:15.051718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Getting quotas for user c24a6275c8b145d9aafb2413777ea267 and project 2cea321144ad4104bca58f5f262c929b. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:35:15.067389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:35:15.069880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:35:15.133523 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-935bac2a-6266-424e-b477-c0cba191feed tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963178 Oct 27 09:35:15.134531 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2997/6060] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:35:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:35:15.148563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b3f91d7-44b8-400f-8243-990000d5b5ac tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:15.149444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b3f91d7-44b8-400f-8243-990000d5b5ac tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:15.225275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:15.239225 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-328e69e1-eca1-46cc-a915-653530af0588 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1503 microversion: 2.1 time: 0.294136 Oct 27 09:35:15.245337 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3064/6061] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:14 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:35:15.425022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b3f91d7-44b8-400f-8243-990000d5b5ac tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:15.432721 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b3f91d7-44b8-400f-8243-990000d5b5ac tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1218 microversion: 2.1 time: 0.288996 Oct 27 09:35:15.433570 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2998/6062] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:15 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1218 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:16.133197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3e6e59f3-8a10-499e-ad1e-9c0835f3e20a req-31384a9a-9159-4554-a982-2102ac118a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7809ffb3-56ba-4a6f-96bc-a9169f7ed061", "name": "network-vif-deleted", "tag": "e544e724-9ff7-4e9e-beb2-213cadf2caa4"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:16.163709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3e6e59f3-8a10-499e-ad1e-9c0835f3e20a req-31384a9a-9159-4554-a982-2102ac118a9d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:16.164465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3e6e59f3-8a10-499e-ad1e-9c0835f3e20a req-31384a9a-9159-4554-a982-2102ac118a9d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:16.165040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3e6e59f3-8a10-499e-ad1e-9c0835f3e20a req-31384a9a-9159-4554-a982-2102ac118a9d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:16.197315 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3e6e59f3-8a10-499e-ad1e-9c0835f3e20a req-31384a9a-9159-4554-a982-2102ac118a9d service nova] Creating event network-vif-deleted:e544e724-9ff7-4e9e-beb2-213cadf2caa4 for instance 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 on n-h1-858383-16 Oct 27 09:35:16.210318 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3e6e59f3-8a10-499e-ad1e-9c0835f3e20a req-31384a9a-9159-4554-a982-2102ac118a9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082049 Oct 27 09:35:16.216183 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3065/6063] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:35:16.268555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:16.269175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:16.289228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:16.289723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:16.290448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:16.291429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:16.292254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:16.292785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:16.358965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:16.359623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:16.360317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:16.372495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lazy-loading 'fault' on Instance uuid 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:35:16.461739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:16.462444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:16.482132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:16.485346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:16.488106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:16.489051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:16.489688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:16.490295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:16.501781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4011fcac884c7cb5a7a9319f28ec6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcbf308f12364b7d9a6be5b5e1a4f90b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:16.514774 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d440191-6f15-48a4-b906-e0422a4cd56e tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 200 len: 1304 microversion: 2.1 time: 0.250218 Oct 27 09:35:16.515368 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2999/6064] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:16 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 1304 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:16.612510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:16.626996 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ad05b49a-714e-482b-94ee-84b4c2fa2c14 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1270 microversion: 2.1 time: 0.165675 Oct 27 09:35:16.630290 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3066/6065] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:16 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:17.540426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:17.541119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] [instance: 7809ffb3-56ba-4a6f-96bc-a9169f7ed061] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:17.551435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:17.552232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:17.552860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:17.555426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:17.556534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:17.556916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:17.574643 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] HTTP exception thrown: Instance 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 could not be found. Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Request method failure captured: Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 HTTP/1.1 Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlC6xvqyvImdq8RY3kw8L_RNnQnQVgn1pgKZcOtaCTYGfEnXwhzN6qG8ssNU396u7mFAKfZHyO2KAF2KJBAc7X4D3ah65UkF5Fx2cOOwSxt8L9Y20hatUIZS7MSU0KgMubB8eM0TQwnvtQb9BDsbSRLILLl3sVCiu9VbVfRTMDQWjA0 Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: dcbf308f12364b7d9a6be5b5e1a4f90b Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesActionsTest-813741941 Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dcbf308f12364b7d9a6be5b5e1a4f90b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dcbf308f12364b7d9a6be5b5e1a4f90b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dcbf308f12364b7d9a6be5b5e1a4f90b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dcbf308f12364b7d9a6be5b5e1a4f90b"}]}] Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-VolumesActionsTest-813741941 Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: dcbf308f12364b7d9a6be5b5e1a4f90b Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesActionsTest-813741941 Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-VolumesActionsTest-813741941-project Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5e4011fcac884c7cb5a7a9319f28ec6e Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-VolumesActionsTest-813741941-project Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 could not be found. Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7809ffb3-56ba-4a6f-96bc-a9169f7ed061'} Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 could not be found. Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 could not be found. Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:35:17.576763 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 could not be found. Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] Returning 404 to user: Instance 7809ffb3-56ba-4a6f-96bc-a9169f7ed061 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01e60cbd-da36-439f-bd09-6e1e2d7af483 tempest-VolumesActionsTest-813741941 tempest-VolumesActionsTest-813741941-project] 10.222.0.25 "GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061" status: 404 len: 111 microversion: 2.1 time: 0.043597 Oct 27 09:35:17.581788 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3000/6066] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:17 2022] GET /compute/v2.1/servers/7809ffb3-56ba-4a6f-96bc-a9169f7ed061 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:35:17.662373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:17.666482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:17.689491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:17.689924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:17.691793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:17.694124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:17.696760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:17.697594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:17.840316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:17.854208 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-821f3b9b-cf0e-4ff9-b0d1-db775d07cf00 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1276 microversion: 2.1 time: 0.199452 Oct 27 09:35:17.856612 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3067/6067] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:17 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:18.881390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:18.882117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:18.890791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:18.895784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:18.896260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:18.897031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:18.897531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:18.897936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:19.555156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:19.570071 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2150258c-e0dc-42be-b347-f9f7fa2a3fcd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1318 microversion: 2.1 time: 0.692630 Oct 27 09:35:19.580346 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3001/6068] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:18 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1318 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:20.091446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1345c5f2-6e5a-4131-a777-336edb6686ab req-9b1e873c-4530-4d5a-88fe-7664de7a7d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccae5497-f422-499d-b288-c70616475180", "tag": "713facfa-2e60-480a-9a40-726070ca36bc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:20.109813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1345c5f2-6e5a-4131-a777-336edb6686ab req-9b1e873c-4530-4d5a-88fe-7664de7a7d4a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:20.110487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1345c5f2-6e5a-4131-a777-336edb6686ab req-9b1e873c-4530-4d5a-88fe-7664de7a7d4a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:20.128228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1345c5f2-6e5a-4131-a777-336edb6686ab req-9b1e873c-4530-4d5a-88fe-7664de7a7d4a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:20.150636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1345c5f2-6e5a-4131-a777-336edb6686ab req-9b1e873c-4530-4d5a-88fe-7664de7a7d4a service nova] Creating event network-changed:713facfa-2e60-480a-9a40-726070ca36bc for instance ccae5497-f422-499d-b288-c70616475180 on n-h2-858383-16 Oct 27 09:35:20.167765 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1345c5f2-6e5a-4131-a777-336edb6686ab req-9b1e873c-4530-4d5a-88fe-7664de7a7d4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080834 Oct 27 09:35:20.169975 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3068/6069] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:35:20.598421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:20.599677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:20.614170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:20.615898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:20.617035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:20.619516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:20.625249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:20.628986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:21.009588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:21.029124 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67704619-f819-4ed9-9e56-8565ee31e051 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1318 microversion: 2.1 time: 0.434404 Oct 27 09:35:21.030494 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3002/6070] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:20 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:22.057662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:22.058649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:22.075656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:22.076197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:22.076616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:22.077343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:22.077846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:22.078366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:22.310953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:22.327952 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-60f0d1bc-5140-4c36-9abc-922af7e1562a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1318 microversion: 2.1 time: 0.275419 Oct 27 09:35:22.334071 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3069/6071] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:22 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:23.358049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:23.358598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:23.372993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:23.373526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:23.379097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:23.379929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:23.380480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:23.381214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:23.703895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:23.716936 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0631b0a-10cd-4c3b-8726-256aab7ae82a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1318 microversion: 2.1 time: 0.363246 Oct 27 09:35:23.717719 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3003/6072] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:23 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:24.744314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:24.745716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:24.761648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:24.765332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:24.766259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:24.767413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:24.769232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:24.770807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:25.077202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:25.086351 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0fe8b036-a45a-44e8-ad21-01c1473f1789 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1318 microversion: 2.1 time: 0.347562 Oct 27 09:35:25.089277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3070/6073] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:24 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:25.801459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1672877297", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:25.846063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:25.847593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:25.880339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:35:26.126603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:26.127708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:26.140668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:26.141459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:26.142114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:26.143998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:26.145029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:26.147440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:26.260277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:35:26.261376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:35:26.262331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:35:26.263052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:35:26.263829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:35:26.275933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:26.276598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:26.277309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:26.278336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:26.279021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:26.279655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:26.303185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Getting quotas for project 4f0ecf94c0b5405e98cb3ac1ec1c5277. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:35:26.310584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Getting quotas for user 1b4fa1de5c9544de93a0751f4f6a07e5 and project 4f0ecf94c0b5405e98cb3ac1ec1c5277. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:35:26.340388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:26.345044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:35:26.347559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:35:26.350976 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aebb4470-9d46-44ae-9a5b-20d3c1ad60dd tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1318 microversion: 2.1 time: 0.238401 Oct 27 09:35:26.365135 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3071/6074] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:26 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:26.400529 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-642c8147-dee9-4625-b1db-06386fd96dac tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606872 Oct 27 09:35:26.402271 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3004/6075] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:35:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:35:26.413122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-97ff5953-985c-4afe-afd3-697506213b4b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:26.413743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-97ff5953-985c-4afe-afd3-697506213b4b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:26.490765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-97ff5953-985c-4afe-afd3-697506213b4b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:26.499450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-97ff5953-985c-4afe-afd3-697506213b4b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1215 microversion: 2.1 time: 0.089957 Oct 27 09:35:26.500112 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3072/6076] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:26 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:27.378684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:27.379936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:27.394753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:27.395264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:27.395812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:27.396739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:27.397410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:27.397825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:27.524269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:27.525653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:27.540600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:27.541106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:27.541621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:27.542343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:27.542807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:27.543276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:27.697178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:27.715370 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-00fb521f-a8f5-428d-97e5-90453c0e96e2 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1267 microversion: 2.1 time: 0.195857 Oct 27 09:35:27.721939 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3073/6077] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:27 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:27.736642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:27.756775 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a168c92-76c3-41be-aaff-67b4780e992b tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1318 microversion: 2.1 time: 0.382681 Oct 27 09:35:27.763345 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3005/6078] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:27 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:27.990207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-28c489fc-124a-4398-8daf-220c93617158 req-1607d48b-e17b-4ff7-ab1e-752e52aecbcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccae5497-f422-499d-b288-c70616475180", "name": "network-vif-plugged", "status": "completed", "tag": "713facfa-2e60-480a-9a40-726070ca36bc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:28.010889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-28c489fc-124a-4398-8daf-220c93617158 req-1607d48b-e17b-4ff7-ab1e-752e52aecbcc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:28.028478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-28c489fc-124a-4398-8daf-220c93617158 req-1607d48b-e17b-4ff7-ab1e-752e52aecbcc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:28.029042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-28c489fc-124a-4398-8daf-220c93617158 req-1607d48b-e17b-4ff7-ab1e-752e52aecbcc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:28.062604 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-28c489fc-124a-4398-8daf-220c93617158 req-1607d48b-e17b-4ff7-ab1e-752e52aecbcc service nova] Creating event network-vif-plugged:713facfa-2e60-480a-9a40-726070ca36bc for instance ccae5497-f422-499d-b288-c70616475180 on n-h2-858383-16 Oct 27 09:35:28.076140 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-28c489fc-124a-4398-8daf-220c93617158 req-1607d48b-e17b-4ff7-ab1e-752e52aecbcc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089508 Oct 27 09:35:28.076754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3074/6079] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:35:28.749243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:28.749860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:28.760296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:28.773873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:28.774388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:28.775015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:28.775781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:28.776249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:28.776682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:28.782535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:28.789404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:28.790703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:28.809811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:28.820315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:28.821048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:28.821964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:28.828209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:28.828928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:29.422961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:29.445574 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0849db3-b59d-42b2-9d5e-8a4a3cbd876b tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1273 microversion: 2.1 time: 0.700550 Oct 27 09:35:29.446627 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3006/6080] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:28 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1273 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:29.691600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:29.710259 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9186d5ec-4335-4771-92a0-5183a4d59a47 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1318 microversion: 2.1 time: 0.924906 Oct 27 09:35:29.710910 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3075/6081] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:28 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1318 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:30.473397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:30.474304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:30.485728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:30.486250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:30.486705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:30.487431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:30.487933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:30.501012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:30.733207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:30.733856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:30.736736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=36 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:30.766088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:30.766592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:30.767045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:30.767793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:30.768447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:30.769043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:30.774944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=80 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:31.434529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:31.447385 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d9f7160b-6cf0-4975-a98f-5a13064efea1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1506 microversion: 2.1 time: 0.718275 Oct 27 09:35:31.448440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3076/6082] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:30 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1506 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:31.742279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:31.758282 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9154279d-4df9-4173-9ecc-61f4c4c8d485 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1315 microversion: 2.1 time: 1.290923 Oct 27 09:35:31.760424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3007/6083] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:30 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1315 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:32.399974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1ca7e35e-933d-4ebc-8a83-572085afcf3f req-4da281ee-7fa0-42bd-a6bb-a862b1fd5863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b", "tag": "446ce2bd-0792-441d-81a5-29a290460e89"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:32.419533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1ca7e35e-933d-4ebc-8a83-572085afcf3f req-4da281ee-7fa0-42bd-a6bb-a862b1fd5863 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:32.437746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1ca7e35e-933d-4ebc-8a83-572085afcf3f req-4da281ee-7fa0-42bd-a6bb-a862b1fd5863 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:32.438210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1ca7e35e-933d-4ebc-8a83-572085afcf3f req-4da281ee-7fa0-42bd-a6bb-a862b1fd5863 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:32.469380 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1ca7e35e-933d-4ebc-8a83-572085afcf3f req-4da281ee-7fa0-42bd-a6bb-a862b1fd5863 service nova] Creating event network-changed:446ce2bd-0792-441d-81a5-29a290460e89 for instance 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b on n-h1-858383-16 Oct 27 09:35:32.487275 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1ca7e35e-933d-4ebc-8a83-572085afcf3f req-4da281ee-7fa0-42bd-a6bb-a862b1fd5863 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090982 Oct 27 09:35:32.495306 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3077/6084] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:35:32.784047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:32.785314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:32.802804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:32.804355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:32.805664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:32.806636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:32.807292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:32.807932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:33.045940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:33.054708 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af770c0a-4cb3-4a9c-96b1-742bbb3badb8 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1315 microversion: 2.1 time: 0.274872 Oct 27 09:35:33.056531 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3008/6085] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:32 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:34.087073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:34.087981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:34.100720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:34.101148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:34.103933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:34.104731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:34.107261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:34.108611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:34.479227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:34.494495 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e679e312-6344-45de-8553-b5aa37e9913a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1315 microversion: 2.1 time: 0.414253 Oct 27 09:35:34.495658 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3078/6086] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:34 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:35.520732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:35.523907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:35.547612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:35.549997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:35.551431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:35.553945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:35.556178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:35.559906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:36.266733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:36.280141 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04e005c4-394e-432e-9c3f-53636eddccb1 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1315 microversion: 2.1 time: 0.762712 Oct 27 09:35:36.281105 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3009/6087] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:35 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:37.307829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:37.308804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:37.326943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:37.328651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:37.329350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:37.329968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:37.331125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:37.331801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:37.332437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:37.613563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:37.626401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e32d5ba0-737c-4593-b0bd-79e3f4d9202a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1315 microversion: 2.1 time: 0.322388 Oct 27 09:35:37.629528 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3079/6088] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:37 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:37.869735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0586142c-6a0e-467a-b64f-a001ec4e657a req-56b1c1bd-2262-4f4f-98d2-5db0df6649ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b", "name": "network-vif-plugged", "status": "completed", "tag": "446ce2bd-0792-441d-81a5-29a290460e89"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:37.887142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:37.888157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:37.892084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0586142c-6a0e-467a-b64f-a001ec4e657a req-56b1c1bd-2262-4f4f-98d2-5db0df6649ff service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:37.893447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0586142c-6a0e-467a-b64f-a001ec4e657a req-56b1c1bd-2262-4f4f-98d2-5db0df6649ff service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:37.894105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0586142c-6a0e-467a-b64f-a001ec4e657a req-56b1c1bd-2262-4f4f-98d2-5db0df6649ff service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:37.912239 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0586142c-6a0e-467a-b64f-a001ec4e657a req-56b1c1bd-2262-4f4f-98d2-5db0df6649ff service nova] Creating event network-vif-plugged:446ce2bd-0792-441d-81a5-29a290460e89 for instance 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b on n-h1-858383-16 Oct 27 09:35:37.919894 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0586142c-6a0e-467a-b64f-a001ec4e657a req-56b1c1bd-2262-4f4f-98d2-5db0df6649ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053709 Oct 27 09:35:37.924860 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3010/6089] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:35:38.654494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:38.655111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:38.678922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:38.679882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:38.682378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:38.683744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:38.687050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:38.688223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:39.050843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:39.064895 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d49e504d-5e06-484c-9f39-bb37a7ca5b44 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1315 microversion: 2.1 time: 0.413585 Oct 27 09:35:39.080974 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3080/6090] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:38 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:40.093504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:40.094932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:40.102489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:40.103487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:40.104140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:40.105389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:40.106240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:40.107046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:40.310101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:40.319204 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e9e6722-04ba-49c3-a443-2a95cfe46a40 tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1465 microversion: 2.1 time: 0.231719 Oct 27 09:35:40.320290 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3011/6091] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:40 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1465 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:40.378535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:40.379723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:40.388736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:40.389767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:40.390871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:40.392090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:40.392754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:40.393905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:40.439662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:35:40.620139 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1f0af0b8-f787-4488-9cfb-a762b41a915f tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 204 len: 0 microversion: 2.1 time: 0.245743 Oct 27 09:35:40.624056 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3081/6092] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:35:40 2022] DELETE /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:35:40.632409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:40.633036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:40.650860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:40.651376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:40.651984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:40.652614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:40.653077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:40.653531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:41.219180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:41.231293 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53e31e65-7f8b-4098-a6b2-6c067ec962ff tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1471 microversion: 2.1 time: 0.602517 Oct 27 09:35:41.232507 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3012/6093] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:40 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:35:42.259332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:42.260184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:42.268305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:42.268926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:42.269478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:42.270279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:42.270835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:42.271357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:42.587515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:42.601087 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7b5b375e-60e3-4708-972e-102afe4db36e tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1471 microversion: 2.1 time: 0.346026 Oct 27 09:35:42.601756 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3082/6094] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:42 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1471 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:43.177442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-36e2148b-7d68-4268-9cfb-4d5e7508121e req-680fc147-c085-433c-a8f5-a4c245a34ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b", "name": "network-vif-deleted", "tag": "446ce2bd-0792-441d-81a5-29a290460e89"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:43.197366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-36e2148b-7d68-4268-9cfb-4d5e7508121e req-680fc147-c085-433c-a8f5-a4c245a34ef3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:43.199907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-36e2148b-7d68-4268-9cfb-4d5e7508121e req-680fc147-c085-433c-a8f5-a4c245a34ef3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:43.200453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-36e2148b-7d68-4268-9cfb-4d5e7508121e req-680fc147-c085-433c-a8f5-a4c245a34ef3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:43.227702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-36e2148b-7d68-4268-9cfb-4d5e7508121e req-680fc147-c085-433c-a8f5-a4c245a34ef3 service nova] Creating event network-vif-deleted:446ce2bd-0792-441d-81a5-29a290460e89 for instance 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b on n-h1-858383-16 Oct 27 09:35:43.247432 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-36e2148b-7d68-4268-9cfb-4d5e7508121e req-680fc147-c085-433c-a8f5-a4c245a34ef3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071502 Oct 27 09:35:43.248761 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3013/6095] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:35:43.632189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:43.633454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:43.651680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:43.652480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:43.653115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:43.654010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:43.654638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:43.655250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:43.734948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:43.735451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:43.735919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:43.737775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lazy-loading 'fault' on Instance uuid 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:35:43.904621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4fa1de5c9544de93a0751f4f6a07e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0ecf94c0b5405e98cb3ac1ec1c5277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:43.919149 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-351de717-c4aa-4801-a419-5ed14a91cd6a tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 200 len: 1305 microversion: 2.1 time: 0.297047 Oct 27 09:35:43.923651 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3083/6096] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:43 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 1305 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:44.946631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:44.948068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] [instance: 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:44.967540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:44.969898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:44.982438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:44.988536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:44.994161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:44.994876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:45.042849 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] HTTP exception thrown: Instance 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b could not be found. Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Request method failure captured: Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b HTTP/1.1 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlDa8l-wO1XS5oBYX_RchwDbfYq_GOAzoL6UXOK0rvW1d074Y-TOs7BvIzSba_5Tif00XaeWHgG4Ro6mmGeHoTVb54zFM5U754bxbTvn51__E-VsALnz2CZJCExxgkUaS1Nz9d1ETvgFjOBk3-6kInu-amEDyOTtRX_mSTsjG_lRQX0 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 4f0ecf94c0b5405e98cb3ac1ec1c5277 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1528089947 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f0ecf94c0b5405e98cb3ac1ec1c5277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f0ecf94c0b5405e98cb3ac1ec1c5277"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f0ecf94c0b5405e98cb3ac1ec1c5277"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f0ecf94c0b5405e98cb3ac1ec1c5277"}]}] Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1528089947 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 4f0ecf94c0b5405e98cb3ac1ec1c5277 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1528089947 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1528089947-project Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 1b4fa1de5c9544de93a0751f4f6a07e5 Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1528089947-project Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b could not be found. Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b'} Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b could not be found. Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b could not be found. Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:35:45.044586 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:45.050183 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:35:45.050183 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:35:45.050183 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:35:45.050183 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:35:45.050183 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:35:45.050183 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b could not be found. Oct 27 09:35:45.050183 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:35:45.050183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] Returning 404 to user: Instance 7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:35:45.050183 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad3fa17f-060a-4df1-b4b4-ec8d90b610da tempest-VolumesNegativeTest-1528089947 tempest-VolumesNegativeTest-1528089947-project] 10.222.0.25 "GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b" status: 404 len: 111 microversion: 2.1 time: 0.104219 Oct 27 09:35:45.061064 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3014/6097] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:44 2022] GET /compute/v2.1/servers/7f0ca7dd-ecee-4ed2-a1ae-4586e95a170b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:35:47.393498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:47.394687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:47.405555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:47.407021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:47.408466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:47.409078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:47.410460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:47.410900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:47.535274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lazy-loading 'services' on Instance uuid 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:35:47.727061 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31a92c5f-ab16-486d-b52c-04f7a76fbaea tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/os-volume_attachments/c6793311-ba79-47c8-a804-fc6bf9dea596" status: 202 len: 0 microversion: 2.1 time: 0.337625 Oct 27 09:35:47.728314 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3084/6098] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:35:47 2022] DELETE /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/os-volume_attachments/c6793311-ba79-47c8-a804-fc6bf9dea596 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:35:57.494691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff293edd-2a11-4bf5-ab97-aefe81322cd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:35:57.501128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=17 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:57.504004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=41 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:57.508420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff293edd-2a11-4bf5-ab97-aefe81322cd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:57.517589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff293edd-2a11-4bf5-ab97-aefe81322cd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:57.519815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff293edd-2a11-4bf5-ab97-aefe81322cd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:57.584973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff293edd-2a11-4bf5-ab97-aefe81322cd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Going to try to stop instance {{(pid=120603) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:35:57.696697 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff293edd-2a11-4bf5-ab97-aefe81322cd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/action" status: 202 len: 0 microversion: 2.1 time: 0.206336 Oct 27 09:35:57.697972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3015/6099] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:35:57 2022] POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:35:57.715499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:57.717066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:57.734582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:57.736167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:57.756891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:57.757768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:57.758679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:57.759441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:57.760209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:57.761436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:58.140646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:35:58.149880 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae5a2c49-d8e7-4583-b001-a290361a4930 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1676 microversion: 2.1 time: 0.436468 Oct 27 09:35:58.154926 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3085/6100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:57 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1676 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:35:59.188100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:35:59.191260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:35:59.224351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:59.225397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:59.227148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:59.228141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:59.234020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:59.235823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:00.405587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:00.420906 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f46b75e4-8c39-4dfe-8a77-d8189ea178b9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1676 microversion: 2.1 time: 1.245914 Oct 27 09:36:00.426813 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3016/6101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:35:59 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1676 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:01.446931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:01.448259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:01.458814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:01.461767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:01.462623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:01.465911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:01.470080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:01.470801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:02.290934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:02.306143 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f010566-8d18-4de7-9434-2a1c60e179a5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1676 microversion: 2.1 time: 0.859319 Oct 27 09:36:02.308364 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3086/6102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:01 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1676 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:03.341728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:03.343329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:03.387814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:03.390797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:03.391907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:03.394140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:03.395282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:03.397377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:04.025591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:04.049677 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7097a324-57d7-4ce2-86fd-8c08a17b0272 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1676 microversion: 2.1 time: 0.720453 Oct 27 09:36:04.058802 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3017/6103] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:03 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1676 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:05.106801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:05.109866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:05.130799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:05.131603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:05.132859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:05.135275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:05.136612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:05.140247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:05.654983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:05.670133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8ec2a2d-572e-46e6-93e3-a620a8019a1f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1676 microversion: 2.1 time: 0.582624 Oct 27 09:36:05.675651 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3087/6104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:05 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1676 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:05.766673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c71efce-c83b-4c5b-9892-13356a71ab0a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82112378-6d62-41e6-bea1-feddcb76b707", "device": "/dev/sdb"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:05.772218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c71efce-c83b-4c5b-9892-13356a71ab0a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:05.788796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c71efce-c83b-4c5b-9892-13356a71ab0a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:05.789287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c71efce-c83b-4c5b-9892-13356a71ab0a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:05.792799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c71efce-c83b-4c5b-9892-13356a71ab0a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:05.793630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c71efce-c83b-4c5b-9892-13356a71ab0a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:05.794123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c71efce-c83b-4c5b-9892-13356a71ab0a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:05.794541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c71efce-c83b-4c5b-9892-13356a71ab0a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:06.519499 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c71efce-c83b-4c5b-9892-13356a71ab0a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "POST /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754897 Oct 27 09:36:06.528021 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3018/6105] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:36:05 2022] POST /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180/os-volume_attachments => generated 194 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:06.703583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:06.704781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:06.717937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:06.718454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:06.718904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:06.719653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:06.720119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:06.720555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:07.213394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:07.227714 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c604f853-de70-41d1-ac46-2d58208626eb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1676 microversion: 2.1 time: 0.527917 Oct 27 09:36:07.255786 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3088/6106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:06 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1676 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:08.282307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:08.283994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:08.299149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:08.303043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:08.305606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:08.310735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:08.314101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:08.316196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:09.148295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:09.162920 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-30122b05-e571-4382-a2ee-bcf342ee1bd3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1653 microversion: 2.1 time: 0.883007 Oct 27 09:36:09.172697 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3019/6107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:08 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1653 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:09.189403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-88bd4425-4ed1-490a-b335-8d5118eb8bd8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:09.218375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-88bd4425-4ed1-490a-b335-8d5118eb8bd8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:09.219494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-88bd4425-4ed1-490a-b335-8d5118eb8bd8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:09.226915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-88bd4425-4ed1-490a-b335-8d5118eb8bd8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:09.348086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-88bd4425-4ed1-490a-b335-8d5118eb8bd8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Going to try to start instance {{(pid=120602) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 09:36:09.486718 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-88bd4425-4ed1-490a-b335-8d5118eb8bd8 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/action" status: 202 len: 0 microversion: 2.1 time: 0.300845 Oct 27 09:36:09.495384 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3089/6108] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:36:09 2022] POST /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:36:09.503422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:09.504042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:09.524202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:09.524723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:09.525174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:09.525940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:09.546958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:09.547861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:10.518346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:10.528343 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b8e4087-acac-4abc-bab6-ee016ea01198 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1662 microversion: 2.1 time: 1.033765 Oct 27 09:36:10.528983 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3020/6109] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:09 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1662 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:11.559423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:11.561288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:11.586834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:11.592800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:11.593639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:11.595330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:11.598997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:11.599727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:12.180051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:12.201217 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6c0078fc-0fb5-4cd7-ad8b-3195402d15f7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1662 microversion: 2.1 time: 0.646539 Oct 27 09:36:12.231859 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3090/6110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:11 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1662 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:13.230111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:13.230717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:13.263781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:13.268525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:13.278190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:13.279084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:13.281313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:13.281866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:14.938507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:14.953048 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1aef3de6-8a41-4354-8993-099b1a8b8413 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1662 microversion: 2.1 time: 1.728105 Oct 27 09:36:14.961471 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3021/6111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:13 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1662 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:15.984999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:15.986830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:16.008275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:16.009078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:16.009775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:16.010732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:16.011382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:16.012018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:16.326355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:16.349031 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4726b7eb-8441-4ebf-ad0e-19025469d375 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1662 microversion: 2.1 time: 0.369861 Oct 27 09:36:16.350271 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3091/6112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:15 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1662 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:17.375881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:17.376491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:17.390486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:17.391646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:17.394207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:17.394939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:17.399254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:17.400015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:17.691145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:17.700604 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91cdaf39-4df2-40bc-834d-4163f4536def tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1666 microversion: 2.1 time: 0.329184 Oct 27 09:36:17.706600 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3022/6113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:17 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1666 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:26.324444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=14 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:26.330442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:26.662589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-645847e8-ba00-44c5-93f7-b28f2c30330a tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1007063917", "availability_zone": "foo_zone"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:26.714470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.aggregate [None req-645847e8-ba00-44c5-93f7-b28f2c30330a tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Generated uuid 06ac1dde-0093-4091-8ba9-cef70c1a1c9a for aggregate {{(pid=120602) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 27 09:36:26.798927 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-645847e8-ba00-44c5-93f7-b28f2c30330a tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.481165 Oct 27 09:36:26.802185 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3092/6114] 10.222.0.25 () {60 vars in 1164 bytes} [Thu Oct 27 09:36:26 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:26.816011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b51e2213-c9dd-4fc4-ada1-5d5588d8aa4f tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:26.877497 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b51e2213-c9dd-4fc4-ada1-5d5588d8aa4f tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.066639 Oct 27 09:36:26.878796 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3023/6115] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:36:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:26.891550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-764847bd-9866-43ae-8469-0c3dd8f9ce83 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:26.910294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-764847bd-9866-43ae-8469-0c3dd8f9ce83 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:26.912627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-764847bd-9866-43ae-8469-0c3dd8f9ce83 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:26.913326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-764847bd-9866-43ae-8469-0c3dd8f9ce83 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:26.916466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-764847bd-9866-43ae-8469-0c3dd8f9ce83 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:26.918086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-764847bd-9866-43ae-8469-0c3dd8f9ce83 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:26.920235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-764847bd-9866-43ae-8469-0c3dd8f9ce83 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:26.997128 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-764847bd-9866-43ae-8469-0c3dd8f9ce83 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.108318 Oct 27 09:36:26.999213 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3093/6116] 10.222.0.25 () {58 vars in 1176 bytes} [Thu Oct 27 09:36:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:27.010767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c614d73-9060-4785-80ff-6fba6c33602e tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:27.023127 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c614d73-9060-4785-80ff-6fba6c33602e tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.016124 Oct 27 09:36:27.026146 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3024/6117] 10.222.0.25 () {58 vars in 1143 bytes} [Thu Oct 27 09:36:27 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:27.040238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2958ee07-9bc1-4dae-9dff-2523726a393c tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-16"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:27.068693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2958ee07-9bc1-4dae-9dff-2523726a393c tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:27.070397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2958ee07-9bc1-4dae-9dff-2523726a393c tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:27.070939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2958ee07-9bc1-4dae-9dff-2523726a393c tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:27.796519 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2958ee07-9bc1-4dae-9dff-2523726a393c tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.753803 Oct 27 09:36:27.797869 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3094/6118] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:36:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:27.817793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-805944ba-845b-4023-8343-318eb2f2c7a7 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:27.820876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:27.836626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:27.857873 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-805944ba-845b-4023-8343-318eb2f2c7a7 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.051687 Oct 27 09:36:27.858472 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3025/6119] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:36:27 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:27.879464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7bd88f3f-5581-4ede-a383-21c062a818d1 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1943198885", "availability_zone": "foo_zone"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:28.137689 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7bd88f3f-5581-4ede-a383-21c062a818d1 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.268621 Oct 27 09:36:28.147270 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3095/6120] 10.222.0.25 () {60 vars in 1173 bytes} [Thu Oct 27 09:36:27 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:36:28.152527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5edcd0a5-3458-40dd-b52e-655ceac1273f tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:28.262128 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5edcd0a5-3458-40dd-b52e-655ceac1273f tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.114949 Oct 27 09:36:28.269243 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3026/6121] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:36:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:28.275872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eea4a45f-0f9c-4b12-a72b-4a9ed8c88171 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:28.298708 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eea4a45f-0f9c-4b12-a72b-4a9ed8c88171 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.025196 Oct 27 09:36:28.309065 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3096/6122] 10.222.0.25 () {58 vars in 1152 bytes} [Thu Oct 27 09:36:28 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:28.314657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11547e87-c746-4ed1-a9a6-748402d7a909 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-16"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:28.349312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11547e87-c746-4ed1-a9a6-748402d7a909 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:28.351277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11547e87-c746-4ed1-a9a6-748402d7a909 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:28.355684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11547e87-c746-4ed1-a9a6-748402d7a909 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:28.800941 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11547e87-c746-4ed1-a9a6-748402d7a909 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.491527 Oct 27 09:36:28.803247 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3027/6123] 10.222.0.25 () {60 vars in 1194 bytes} [Thu Oct 27 09:36:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:28.815286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-06fcb0d7-5490-4462-8c3b-ab46a42abe79 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:28.867245 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-06fcb0d7-5490-4462-8c3b-ab46a42abe79 tempest-TestAggregatesBasicOps-473024778 tempest-TestAggregatesBasicOps-473024778-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.055329 Oct 27 09:36:28.875223 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3097/6124] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Oct 27 09:36:28 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 27 09:36:52.537120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:52.539142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:52.547453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:52.548263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:52.556996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:52.558112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:52.558616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:52.559735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:52.560260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:52.560747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:52.657617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lazy-loading 'services' on Instance uuid ccae5497-f422-499d-b288-c70616475180 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:36:52.745782 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0dfc44e-2926-4035-8bb3-b0c1816b32b1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180/os-volume_attachments/82112378-6d62-41e6-bea1-feddcb76b707" status: 202 len: 0 microversion: 2.1 time: 0.210226 Oct 27 09:36:52.749666 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3028/6125] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:36:52 2022] DELETE /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180/os-volume_attachments/82112378-6d62-41e6-bea1-feddcb76b707 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:37:00.788152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:00.790293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:00.793725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:00.795222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:00.798893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:00.825537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.826246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.826719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.827522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.828027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.828468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.888976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:37:01.095447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e4ba7c92-c20d-4e12-a9cc-465be123fa1c tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 204 len: 0 microversion: 2.1 time: 0.311202 Oct 27 09:37:01.098068 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3098/6126] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:37:00 2022] DELETE /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:37:01.109817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:01.110774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:01.124929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:01.125453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:01.125909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:01.133525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:01.134378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:01.135385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:01.416886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:01.435269 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9cc1b86f-e667-4bcc-93cc-5421f4a0f70d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1512 microversion: 2.1 time: 0.331676 Oct 27 09:37:01.439726 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3029/6127] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:01 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:02.465065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:02.466863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:02.474255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:02.474856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:02.475591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:02.476959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:02.477550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:02.478086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:02.663299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:02.672247 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-50205a6b-436d-41a0-a5a9-57a3ba2d1567 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1512 microversion: 2.1 time: 0.213406 Oct 27 09:37:02.673380 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3099/6128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:02 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:03.700984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:03.701622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:03.711813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.712319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.712771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.713502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.713969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.714406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.891933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:03.918455 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e50d0b0-8a6f-4ed1-ab8d-7e5133149075 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 200 len: 1470 microversion: 2.1 time: 0.224036 Oct 27 09:37:03.919151 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3030/6129] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:03 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:04.365568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a37834e2-835a-4506-8472-108e14481d1d req-ebf5991d-bbd3-458d-a0cd-19f0f3e44132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccae5497-f422-499d-b288-c70616475180", "name": "network-vif-deleted", "tag": "713facfa-2e60-480a-9a40-726070ca36bc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:04.387794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a37834e2-835a-4506-8472-108e14481d1d req-ebf5991d-bbd3-458d-a0cd-19f0f3e44132 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:04.389828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a37834e2-835a-4506-8472-108e14481d1d req-ebf5991d-bbd3-458d-a0cd-19f0f3e44132 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:04.391099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a37834e2-835a-4506-8472-108e14481d1d req-ebf5991d-bbd3-458d-a0cd-19f0f3e44132 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:04.421749 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a37834e2-835a-4506-8472-108e14481d1d req-ebf5991d-bbd3-458d-a0cd-19f0f3e44132 service nova] Creating event network-vif-deleted:713facfa-2e60-480a-9a40-726070ca36bc for instance ccae5497-f422-499d-b288-c70616475180 on n-h2-858383-16 Oct 27 09:37:04.439350 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a37834e2-835a-4506-8472-108e14481d1d req-ebf5991d-bbd3-458d-a0cd-19f0f3e44132 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.417447 Oct 27 09:37:04.441804 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3100/6130] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:04.952967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:04.961889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: ccae5497-f422-499d-b288-c70616475180] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:04.972566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:04.973522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:04.974197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:04.975137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:04.975830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:04.979590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:05.009421 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] HTTP exception thrown: Instance ccae5497-f422-499d-b288-c70616475180 could not be found. Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Request method failure captured: Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 HTTP/1.1 Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlB2GpHeAwI7Utmgics2rq04v8e50u94jS-IE9Qx6dABGuNPCEz-882iriHj456MR1SfVMD2YRsbyBCS5FkG5_Sd7XPayQNqSUPBfP_3MPxruQagj6PnuPjKoVBuKg0UZ0KkL7E5q3MNDVjCweXb7zwd1e1iaEpFYVLkj9W6ap4ytPI Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 2cea321144ad4104bca58f5f262c929b Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotTestJSON-359308288 Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2cea321144ad4104bca58f5f262c929b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2cea321144ad4104bca58f5f262c929b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2cea321144ad4104bca58f5f262c929b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2cea321144ad4104bca58f5f262c929b"}]}] Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotTestJSON-359308288 Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 2cea321144ad4104bca58f5f262c929b Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-359308288 Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotTestJSON-359308288-project Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: c24a6275c8b145d9aafb2413777ea267 Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotTestJSON-359308288-project Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance ccae5497-f422-499d-b288-c70616475180 could not be found. Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'ccae5497-f422-499d-b288-c70616475180'} Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccae5497-f422-499d-b288-c70616475180 could not be found. Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccae5497-f422-499d-b288-c70616475180 could not be found. Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:05.012453 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:37:05.018468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:05.018468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:05.018468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:05.018468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:37:05.018468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:37:05.018468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccae5497-f422-499d-b288-c70616475180 could not be found. Oct 27 09:37:05.018468 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:37:05.020832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Returning 404 to user: Instance ccae5497-f422-499d-b288-c70616475180 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:37:05.021988 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6589a3ad-3af2-431e-9924-b50a8de488f3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180" status: 404 len: 111 microversion: 2.1 time: 0.078659 Oct 27 09:37:05.023170 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3031/6131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:04 2022] GET /compute/v2.1/servers/ccae5497-f422-499d-b288-c70616475180 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:37:13.157162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-06317a39-c57d-49d8-8b49-fedc4d9ab13b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:13.159505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-06317a39-c57d-49d8-8b49-fedc4d9ab13b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:13.181047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06317a39-c57d-49d8-8b49-fedc4d9ab13b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.181543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06317a39-c57d-49d8-8b49-fedc4d9ab13b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.181988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06317a39-c57d-49d8-8b49-fedc4d9ab13b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.204580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06317a39-c57d-49d8-8b49-fedc4d9ab13b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.209830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06317a39-c57d-49d8-8b49-fedc4d9ab13b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.211210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-06317a39-c57d-49d8-8b49-fedc4d9ab13b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.362431 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-06317a39-c57d-49d8-8b49-fedc4d9ab13b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.207364 Oct 27 09:37:13.364610 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3101/6132] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:37:13 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf/os-volume_attachments => generated 25 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:37:13.495302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:13.495873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:13.514079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.514825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.515955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.516942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.517439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.520596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.607229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:37:13.741369 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb87bed1-25b7-4fc6-aeb2-7241613a9579 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 204 len: 0 microversion: 2.1 time: 0.251418 Oct 27 09:37:13.743508 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3032/6133] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:37:13 2022] DELETE /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:37:13.755757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:13.755757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:13.760645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.761366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.762020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.762914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.763902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.765202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:14.546885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:14.572860 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62b9dac5-fbfe-45c0-a0a2-d9f2ee112b47 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1672 microversion: 2.1 time: 0.823076 Oct 27 09:37:14.575629 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3102/6134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:13 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1672 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:15.607336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:15.609205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:15.620113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.620935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.621527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:15.622520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.623531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.624215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:15.771400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1447979160", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "2807eece-45d1-4709-8d13-6ba823a39ff8"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:15.880505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] validate_networks() for [('2807eece-45d1-4709-8d13-6ba823a39ff8', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:37:16.406302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:16.415447 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd440f59-6c81-4644-9b43-b66ad3a15910 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1672 microversion: 2.1 time: 0.815885 Oct 27 09:37:16.432700 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3033/6135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:15 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1672 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:17.443380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:17.444926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:17.474617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.475509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.476496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.477287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.477800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.478232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.792470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:37:17.793428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:37:17.793428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:37:17.793681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:37:17.794051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:37:17.816349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.816820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.817269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.818013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.818465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.822624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.849589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Getting quotas for project 2cea321144ad4104bca58f5f262c929b. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:37:17.856814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Getting quotas for user c24a6275c8b145d9aafb2413777ea267 and project 2cea321144ad4104bca58f5f262c929b. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:37:17.872779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:37:17.875404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:37:17.904330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:17.918137 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68774d9a-ed71-4015-9a53-1a6d970b081f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1672 microversion: 2.1 time: 0.478766 Oct 27 09:37:17.919204 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3034/6136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:17 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1672 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:17.966208 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dcb934a7-8449-46c9-8b27-a06c6fd546c6 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.200747 Oct 27 09:37:17.967291 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3103/6137] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:37:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:37:17.979113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8b81f13-2f16-43d8-bc66-63fc068b43d7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:17.979884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8b81f13-2f16-43d8-bc66-63fc068b43d7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:18.350395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8b81f13-2f16-43d8-bc66-63fc068b43d7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:18.362749 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8b81f13-2f16-43d8-bc66-63fc068b43d7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1219 microversion: 2.1 time: 0.387597 Oct 27 09:37:18.378417 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3035/6138] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:17 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1219 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:18.978647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:18.987778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:19.047348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.052146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.056714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.060750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.065416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.071538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.129601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e29c1e52-8d68-47f5-af39-c84c24eedeaf req-57a9e87e-66cd-43f1-abf3-e83eb37e0702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41895c9e-2d2a-4a6b-8636-4edf5a76aeaf", "name": "network-vif-deleted", "tag": "a03f8ca0-47a7-4d0b-b072-278c1c52845e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:19.223642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e29c1e52-8d68-47f5-af39-c84c24eedeaf req-57a9e87e-66cd-43f1-abf3-e83eb37e0702 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.228741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e29c1e52-8d68-47f5-af39-c84c24eedeaf req-57a9e87e-66cd-43f1-abf3-e83eb37e0702 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.232364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e29c1e52-8d68-47f5-af39-c84c24eedeaf req-57a9e87e-66cd-43f1-abf3-e83eb37e0702 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.333767 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e29c1e52-8d68-47f5-af39-c84c24eedeaf req-57a9e87e-66cd-43f1-abf3-e83eb37e0702 service nova] Creating event network-vif-deleted:a03f8ca0-47a7-4d0b-b072-278c1c52845e for instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf on n-h2-858383-16 Oct 27 09:37:19.363490 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e29c1e52-8d68-47f5-af39-c84c24eedeaf req-57a9e87e-66cd-43f1-abf3-e83eb37e0702 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241183 Oct 27 09:37:19.387925 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3036/6139] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:19.430012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:19.431044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:19.453990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.454801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.455446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.456912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.457577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.458258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.566275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:19.597152 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-878bccd6-483e-482d-85c0-6139a9e3f325 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 200 len: 1605 microversion: 2.1 time: 0.649754 Oct 27 09:37:19.603708 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3104/6140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:18 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 1605 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:19.644726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:19.656685 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45009c52-76f9-431d-b713-ae2782107ccc tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1223 microversion: 2.1 time: 0.254002 Oct 27 09:37:19.658529 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3037/6141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:19 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1223 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:20.651283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:20.653579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:20.682616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:20.683221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:20.690945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:20.690945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:20.690945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:20.699707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:20.700596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:20.702662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:20.704486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:20.705299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:20.708247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:20.711962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:20.712678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:20.714509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:20.763765 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] HTTP exception thrown: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Request method failure captured: Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf HTTP/1.1 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAyQtLz1ja0iiWYoMgGcUYWb3Z6sa5Q82C7bizruR0bbfIQGpJ1vHlEcnYm251Mi1n3HbbSVOg8B3aOHLUo-SGss6ELI7ozBxy7lmxz-oSHNqkDyexf0bEMFtSiipFBQbt8u8fRPOEMloKaN4sTa0oTKX5T1uMqT4LCaRYwQFRU0CU Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86767ef47c0a4d9bbdda088354b82c02"}]}] Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9153c5ce21b24daa91bacaa9f47b7c57 Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '41895c9e-2d2a-4a6b-8636-4edf5a76aeaf'} Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:20.774992 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:37:20.778741 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:20.778741 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:20.778741 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:20.778741 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:37:20.778741 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:37:20.778741 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:37:20.778741 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:37:20.778741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Returning 404 to user: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:37:20.779921 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-542e22f2-51ae-4322-8516-5540e32ecf46 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 404 len: 111 microversion: 2.1 time: 0.134784 Oct 27 09:37:20.780738 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3105/6142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:20 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:37:20.800474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e974e56-39a4-44ee-a7f7-700be97e4a1e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '.version_select at 0x7f31a948c3a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:20.840624 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e974e56-39a4-44ee-a7f7-700be97e4a1e tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803298344" status: 202 len: 0 microversion: 2.1 time: 0.053182 Oct 27 09:37:20.844022 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3106/6143] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:37:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803298344 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:37:21.009411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:21.040370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb1b59b5-3f27-48fe-a457-6b12b254079e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1279 microversion: 2.1 time: 0.361446 Oct 27 09:37:21.056963 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3038/6144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:20 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1279 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:22.081049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:22.081689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:22.117090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:22.123905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:22.124817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:22.128717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:22.129465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:22.131402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:22.589001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:22.607722 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fc9af834-a5a4-45b7-8c16-be3b79b39efe tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1277 microversion: 2.1 time: 0.530865 Oct 27 09:37:22.613408 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3107/6145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:22 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1277 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:23.251255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42e85268-41fc-4ddd-a134-410209d47329 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'create', calling method: .version_select at 0x7f31ae5323a0>, body: {"keypair": {"name": "tempest-keypair-176605454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2oYUVsvfvKUduC6EK0yggwy57soI2uJK90TLPg3EuuSbVCpV+Bl4ib4hjjSnzNNx6EGTeNoiq26BnO863+Kun6d0hzHsHrTVAOdED8iP4PYtKFZSb9beTSSbuIfdbfqg=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:23.263983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:23.305151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-42e85268-41fc-4ddd-a134-410209d47329 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Getting quotas for project 86767ef47c0a4d9bbdda088354b82c02. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:37:23.314790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-42e85268-41fc-4ddd-a134-410209d47329 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Getting quotas for user 9153c5ce21b24daa91bacaa9f47b7c57 and project 86767ef47c0a4d9bbdda088354b82c02. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:37:23.407453 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42e85268-41fc-4ddd-a134-410209d47329 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159292 Oct 27 09:37:23.410958 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3039/6146] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:37:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:23.642138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:23.643329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:23.673867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.675081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.683099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:23.684229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.684974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.686009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:24.221723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:24.234692 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1ddc34da-e30d-4d00-8a46-f7fd9a57750f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1319 microversion: 2.1 time: 0.598558 Oct 27 09:37:24.235653 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3108/6147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:23 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:24.817386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94f7ac40-b981-4ccf-a06a-e5d144ad7eea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Action: 'create', calling method: .version_select at 0x7f31a9803dc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-246869637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3GtjhVxzX7W+ATilfa8VzWb1L6t5Id2xbq90NL/v90eFI7n34ll0AAMGz8PiqvHizN1v8W48ccY2cHBD65q7ChborpMA4HrcWqwp60AE6mspALyOUKBPdOf6nm3Gnz7Q=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:24.852719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-94f7ac40-b981-4ccf-a06a-e5d144ad7eea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Getting quotas for project 69fc539ecb9c4526bac4242bec19739c. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:37:24.862220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-94f7ac40-b981-4ccf-a06a-e5d144ad7eea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Getting quotas for user ae06558b53a04f85b6698de28e9a0c68 and project 69fc539ecb9c4526bac4242bec19739c. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:37:24.898355 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94f7ac40-b981-4ccf-a06a-e5d144ad7eea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.441088 Oct 27 09:37:24.906474 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3040/6148] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:37:24 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:25.285793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:25.287010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:25.305343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:25.306258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:25.306958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:25.308248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:25.309228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:25.310661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:25.891054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:25.909207 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d2183c45-ea6d-4306-9dc9-ded2824adc9e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1319 microversion: 2.1 time: 0.629530 Oct 27 09:37:25.910695 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3109/6149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:25 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1319 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:26.406621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-029a1b34-2343-4380-9739-ad4189f91f0b req-85d2d122-f294-499a-baac-fced2a4d86f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3e6d93-a72a-425a-83f6-f17b26c26704", "tag": "40f561b0-270e-48d9-b298-556d3dd6fdf7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:26.462491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-029a1b34-2343-4380-9739-ad4189f91f0b req-85d2d122-f294-499a-baac-fced2a4d86f1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.463801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-029a1b34-2343-4380-9739-ad4189f91f0b req-85d2d122-f294-499a-baac-fced2a4d86f1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.465175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-029a1b34-2343-4380-9739-ad4189f91f0b req-85d2d122-f294-499a-baac-fced2a4d86f1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:26.484904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:26.516649 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-029a1b34-2343-4380-9739-ad4189f91f0b req-85d2d122-f294-499a-baac-fced2a4d86f1 service nova] Creating event network-changed:40f561b0-270e-48d9-b298-556d3dd6fdf7 for instance 5a3e6d93-a72a-425a-83f6-f17b26c26704 on n-h1-858383-16 Oct 27 09:37:26.529580 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-029a1b34-2343-4380-9739-ad4189f91f0b req-85d2d122-f294-499a-baac-fced2a4d86f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134572 Oct 27 09:37:26.532632 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3041/6150] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:26.660162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-675229915", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fbe562a-e575-4d52-8273-b69f7949b042"}], "security_groups": [{"name": "tempest-securitygroup--750174800"}], "key_name": "tempest-keypair-176605454", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:26.959147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:26.960827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:26.979814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.981651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.982424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:26.983940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.985204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.986162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:27.065582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] validate_networks() for [('6fbe562a-e575-4d52-8273-b69f7949b042', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:37:27.833334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:27.865004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:27.896786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:27.906228 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-205a67b5-2613-4abc-84f1-e362d9bea187 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1319 microversion: 2.1 time: 0.962251 Oct 27 09:37:27.922565 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3042/6151] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:26 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1319 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:28.687631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:37:28.688019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:37:28.688770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:37:28.689407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:37:28.690384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:37:28.706180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.707412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.708465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.709961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.710902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.711811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.744739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Getting quotas for project 86767ef47c0a4d9bbdda088354b82c02. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:37:28.755250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Getting quotas for user 9153c5ce21b24daa91bacaa9f47b7c57 and project 86767ef47c0a4d9bbdda088354b82c02. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:37:28.772870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:37:28.775310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:37:28.832585 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ba41998-f5cd-498d-b236-5061a5ee9430 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.176823 Oct 27 09:37:28.844570 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3110/6152] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:37:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:37:28.849930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22cefbed-ccc5-49af-b1e4-a57edd04f046 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:28.851252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22cefbed-ccc5-49af-b1e4-a57edd04f046 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:28.932489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:28.933116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:28.950126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.955030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.955486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.956477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.956952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.958406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:29.018575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-22cefbed-ccc5-49af-b1e4-a57edd04f046 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:29.028578 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-22cefbed-ccc5-49af-b1e4-a57edd04f046 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1236 microversion: 2.1 time: 0.183203 Oct 27 09:37:29.039602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3043/6153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:28 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1236 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:29.437699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:29.462892 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dfc77510-9cd7-4713-9bef-ea2ca8c6baf8 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1319 microversion: 2.1 time: 0.536348 Oct 27 09:37:29.464742 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3111/6154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:28 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:30.075447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:30.076371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:30.100827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.101247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.101712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.111266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.111814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.124708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.404683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:30.424141 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96c3fa40-2e2a-4265-9296-8e19d2d7a6c2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1232 microversion: 2.1 time: 0.349071 Oct 27 09:37:30.435611 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3044/6155] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:30 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1232 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:30.492340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:30.493514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:30.506579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.507337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.507989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.512516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.513189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.513857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.313544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:31.321048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:31.325187 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b6ca4df-d2a0-48f8-9afa-6cc46af8911f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1319 microversion: 2.1 time: 0.837461 Oct 27 09:37:31.330445 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3112/6156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:30 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1319 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:31.453028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:31.454454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:31.468860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:31.476328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:31.477060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.478186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:31.478838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:31.479445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.684940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:31.701786 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f8b1608-2ad6-4b58-a79d-e527999d566b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1294 microversion: 2.1 time: 0.251038 Oct 27 09:37:31.703879 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3045/6157] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:31 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1294 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:32.359061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:32.360544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:32.364632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:32.373432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.374169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.374887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.375951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.376658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.377323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.747242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:32.748653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:32.796792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.797741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.802018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.803928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.804751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.805618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:33.011218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:33.028678 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67d3b89b-8c2f-4473-b70f-be78c37713bb tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1294 microversion: 2.1 time: 0.285405 Oct 27 09:37:33.029281 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3046/6158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:32 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1294 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:33.077983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:33.088827 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-20334ecd-08ad-47a8-bea6-a3a09d94b6f7 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1319 microversion: 2.1 time: 0.734190 Oct 27 09:37:33.090202 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3113/6159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:32 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1319 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:34.076301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:34.078085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:34.099375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:34.100994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:34.102368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:34.106370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:34.110021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:34.111286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:34.136939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:34.137904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:34.183241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:34.184250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:34.184250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:34.185005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:34.194791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:34.195375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:36.087351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:36.099185 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1b64d5aa-4b8c-4738-a19a-1a7f4816d18a tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1319 microversion: 2.1 time: 1.969621 Oct 27 09:37:36.099707 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3114/6160] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:34 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1319 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:36.341885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:36.357557 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b4dd0b4-c904-4542-a549-61c4ed3d609b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1361 microversion: 2.1 time: 2.285840 Oct 27 09:37:36.361611 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3047/6161] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:34 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1361 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:36.420800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-476314be-1b1a-4f99-ba72-357d9e45c0c4 req-b92e1d7b-ddf6-46bf-8305-6efe78ad3af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3e6d93-a72a-425a-83f6-f17b26c26704", "name": "network-vif-plugged", "status": "completed", "tag": "40f561b0-270e-48d9-b298-556d3dd6fdf7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:36.448857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-476314be-1b1a-4f99-ba72-357d9e45c0c4 req-b92e1d7b-ddf6-46bf-8305-6efe78ad3af5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:36.450312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-476314be-1b1a-4f99-ba72-357d9e45c0c4 req-b92e1d7b-ddf6-46bf-8305-6efe78ad3af5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:36.451043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-476314be-1b1a-4f99-ba72-357d9e45c0c4 req-b92e1d7b-ddf6-46bf-8305-6efe78ad3af5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:36.477804 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-476314be-1b1a-4f99-ba72-357d9e45c0c4 req-b92e1d7b-ddf6-46bf-8305-6efe78ad3af5 service nova] Creating event network-vif-plugged:40f561b0-270e-48d9-b298-556d3dd6fdf7 for instance 5a3e6d93-a72a-425a-83f6-f17b26c26704 on n-h1-858383-16 Oct 27 09:37:36.493058 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-476314be-1b1a-4f99-ba72-357d9e45c0c4 req-b92e1d7b-ddf6-46bf-8305-6efe78ad3af5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.387983 Oct 27 09:37:36.495939 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3115/6162] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:36.838915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b38206c0-08c6-47f7-bfce-961e1bf67618 req-dfca2635-eefb-495e-ab79-8e2e69447f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f545f70f-06c4-4746-9b39-dcd1463c262d", "tag": "79448c61-c6dc-42f9-b060-4e3121874e12"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:36.880633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b38206c0-08c6-47f7-bfce-961e1bf67618 req-dfca2635-eefb-495e-ab79-8e2e69447f6c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:36.882974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b38206c0-08c6-47f7-bfce-961e1bf67618 req-dfca2635-eefb-495e-ab79-8e2e69447f6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:36.895538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b38206c0-08c6-47f7-bfce-961e1bf67618 req-dfca2635-eefb-495e-ab79-8e2e69447f6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:36.920000 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b38206c0-08c6-47f7-bfce-961e1bf67618 req-dfca2635-eefb-495e-ab79-8e2e69447f6c service nova] Creating event network-changed:79448c61-c6dc-42f9-b060-4e3121874e12 for instance f545f70f-06c4-4746-9b39-dcd1463c262d on n-h2-858383-16 Oct 27 09:37:36.939367 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b38206c0-08c6-47f7-bfce-961e1bf67618 req-dfca2635-eefb-495e-ab79-8e2e69447f6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105474 Oct 27 09:37:36.940800 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3048/6163] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:37.152530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:37.165033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:37.196078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:37.197253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:37.198200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:37.199766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:37.200772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:37.201702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:37.391896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:37.397030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:37.426845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:37.428378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:37.429047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:37.432856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:37.437132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:37.437746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:37.885025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:37.914007 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83f43bdc-bcf2-471b-b80d-81bd589055e1 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1319 microversion: 2.1 time: 0.770710 Oct 27 09:37:37.932901 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3116/6164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:37 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1319 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:38.032344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:38.045306 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1fb37d61-9fbb-4270-b678-4e79f51b7bae tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1361 microversion: 2.1 time: 0.661520 Oct 27 09:37:38.046393 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3049/6165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:37 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1361 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:38.964227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:38.971081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:38.982963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:38.986154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:39.015968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:39.023284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:39.032713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:39.034285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:39.035303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:39.036274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:39.101013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:39.103752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:39.123295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:39.133319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:39.134681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:39.135820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:39.137522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:39.138706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:39.139812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:39.859935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:39.903512 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2c20a521-d291-42bb-8265-931f549fd31f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1508 microversion: 2.1 time: 0.947226 Oct 27 09:37:39.904869 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3117/6166] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:38 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1508 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:39.948411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d8c36642-bc2a-40f4-bd70-4aff2e1f57d3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9eced009-91d0-41ac-b08f-669764e77635", "device": "/dev/sdb"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:39.951290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d8c36642-bc2a-40f4-bd70-4aff2e1f57d3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:39.969791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c36642-bc2a-40f4-bd70-4aff2e1f57d3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:39.970426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c36642-bc2a-40f4-bd70-4aff2e1f57d3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:39.970972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c36642-bc2a-40f4-bd70-4aff2e1f57d3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:39.971864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c36642-bc2a-40f4-bd70-4aff2e1f57d3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:39.972458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c36642-bc2a-40f4-bd70-4aff2e1f57d3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:39.975262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c36642-bc2a-40f4-bd70-4aff2e1f57d3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:40.011928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:40.043398 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-27cc7f38-7e8e-4574-940a-0f8b977d1af3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1361 microversion: 2.1 time: 0.949630 Oct 27 09:37:40.046726 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3050/6167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:39 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1361 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:40.229547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-569233901-access_point-22707486", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "cf68523c-2938-4b48-9dc6-d4915e6f01e7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-246869637", "security_groups": [{"name": "tempest-secgroup_access--1656968147"}, {"name": "tempest-secgroup_general--1964707049"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:40.630181 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d8c36642-bc2a-40f4-bd70-4aff2e1f57d3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "POST /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688305 Oct 27 09:37:40.631202 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3118/6168] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:37:39 2022] POST /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:37:41.075131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:41.078235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:41.102712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:41.103910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:41.104778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:41.106114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:41.110648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:41.113813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:41.463508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] validate_networks() for [('cf68523c-2938-4b48-9dc6-d4915e6f01e7', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:37:41.882774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:41.915389 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd121b55-513d-44e0-ac83-bef4a9a4009f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1361 microversion: 2.1 time: 0.842056 Oct 27 09:37:41.916644 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3119/6169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:41 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1361 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:42.970790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:42.977918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:43.041032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:43.045499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:43.051369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:43.056535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:43.063711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:43.065758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:44.140270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:44.151634 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-87ab1152-7e07-45f8-8747-85832e5c5256 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1361 microversion: 2.1 time: 1.192503 Oct 27 09:37:44.164340 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3120/6170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:42 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1361 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:44.293465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:37:44.294518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:37:44.295392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:37:44.296199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:37:44.296952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:37:44.371024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:44.371930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:44.375605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:44.377321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:44.378531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:44.393400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:44.548685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Getting quotas for project 69fc539ecb9c4526bac4242bec19739c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:37:44.585709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Getting quotas for user ae06558b53a04f85b6698de28e9a0c68 and project 69fc539ecb9c4526bac4242bec19739c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:37:44.649101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:37:44.660341 n-d-858383-16 devstack@n-api.service[120603]: WARNING nova.utils [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-569233901-access_point-22707486 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-569233901-acc Oct 27 09:37:44.661826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:37:44.904955 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-26a33f79-a80d-4b80-aabe-bc11b5524228 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 4.686402 Oct 27 09:37:44.906674 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3051/6171] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:37:40 2022] POST /compute/v2.1/servers => generated 458 bytes in 4690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:37:44.940453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-15a7f894-8e42-4b2f-80a0-58e0ffa6e35e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:44.942940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15a7f894-8e42-4b2f-80a0-58e0ffa6e35e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:45.077023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-15a7f894-8e42-4b2f-80a0-58e0ffa6e35e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:45.093994 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-15a7f894-8e42-4b2f-80a0-58e0ffa6e35e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1291 microversion: 2.1 time: 0.164310 Oct 27 09:37:45.095502 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3121/6172] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:44 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1291 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:45.184890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:45.206583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:45.273901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:45.275346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:45.276510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:45.305832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:45.306805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:45.307894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:46.145283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a46e39be-d100-4d89-ade2-8b11426d70d9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:46.168104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:46.204974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a46e39be-d100-4d89-ade2-8b11426d70d9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:46.245536 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7672d7a-36f2-4331-b2a9-13192ef1624b tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1361 microversion: 2.1 time: 1.069894 Oct 27 09:37:46.254788 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3052/6173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:45 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1361 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:46.425138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a46e39be-d100-4d89-ade2-8b11426d70d9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:46.457772 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a46e39be-d100-4d89-ade2-8b11426d70d9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1291 microversion: 2.1 time: 0.320068 Oct 27 09:37:46.467306 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3122/6174] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:46 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1291 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:47.211085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2945c616-d3d4-4b19-951a-b5a325a3de6f req-0ce2b4e7-8125-4849-bf74-f799e6a0cd17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f545f70f-06c4-4746-9b39-dcd1463c262d", "name": "network-vif-plugged", "status": "completed", "tag": "79448c61-c6dc-42f9-b060-4e3121874e12"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:47.246571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2945c616-d3d4-4b19-951a-b5a325a3de6f req-0ce2b4e7-8125-4849-bf74-f799e6a0cd17 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:47.248020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2945c616-d3d4-4b19-951a-b5a325a3de6f req-0ce2b4e7-8125-4849-bf74-f799e6a0cd17 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:47.249221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2945c616-d3d4-4b19-951a-b5a325a3de6f req-0ce2b4e7-8125-4849-bf74-f799e6a0cd17 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:47.275288 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2945c616-d3d4-4b19-951a-b5a325a3de6f req-0ce2b4e7-8125-4849-bf74-f799e6a0cd17 service nova] Creating event network-vif-plugged:79448c61-c6dc-42f9-b060-4e3121874e12 for instance f545f70f-06c4-4746-9b39-dcd1463c262d on n-h2-858383-16 Oct 27 09:37:47.286467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:47.293773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:47.310599 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2945c616-d3d4-4b19-951a-b5a325a3de6f req-0ce2b4e7-8125-4849-bf74-f799e6a0cd17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107788 Oct 27 09:37:47.328788 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3053/6175] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:47.346302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:47.364062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:47.365893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:47.382563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:47.384201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:47.386619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:47.505349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:47.510142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:47.541757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:47.546756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:47.549934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:47.565661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:47.567226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:47.570181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:48.167911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:48.196651 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abe980e7-2c0d-4632-b85e-d784e7a831b9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1351 microversion: 2.1 time: 0.689651 Oct 27 09:37:48.197336 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3054/6176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:47 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1351 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:48.402300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:48.433923 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c7ed0d8-c9ce-4963-976e-0be4963d3303 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1361 microversion: 2.1 time: 1.155138 Oct 27 09:37:48.435982 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3123/6177] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:47 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1361 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:49.229312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:49.231786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:49.250645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:49.252219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:49.253480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:49.255288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:49.256229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:49.256855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:49.463167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:49.464540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:49.494850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:49.498668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:49.499676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:49.503325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:49.504853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:49.506956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:49.922144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:49.938845 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4a40774-ede7-4dc0-8aa7-7015ffd39439 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1349 microversion: 2.1 time: 0.719685 Oct 27 09:37:49.940133 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3055/6178] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:49 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1349 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:50.083085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:50.116002 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e9de6011-8d57-479e-8d64-a2878833b5a7 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1361 microversion: 2.1 time: 0.655937 Oct 27 09:37:50.119041 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3124/6179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:49 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1361 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:50.977828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:50.980727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:51.003625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.005057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.006657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.010139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.012179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.014608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.149035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:51.150150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:51.179840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.181117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.184224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.187312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.189379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.190513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.550504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:51.560138 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-07a77bb9-a800-4b8d-b908-df2c309732e3 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1469 microversion: 2.1 time: 0.596421 Oct 27 09:37:51.561208 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3056/6180] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:50 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1469 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:51.617543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:51.650641 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-14ac8d50-6cc1-4526-a81a-41fe9780d8a9 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1547 microversion: 2.1 time: 0.510862 Oct 27 09:37:51.651973 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3125/6181] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:51 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1547 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:51.675352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c478c2c5-bfb6-40c3-a2a1-10fa8b78197c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:51.676007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c478c2c5-bfb6-40c3-a2a1-10fa8b78197c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:51.684157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c478c2c5-bfb6-40c3-a2a1-10fa8b78197c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.684662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c478c2c5-bfb6-40c3-a2a1-10fa8b78197c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.685115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c478c2c5-bfb6-40c3-a2a1-10fa8b78197c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.685847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c478c2c5-bfb6-40c3-a2a1-10fa8b78197c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.686315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c478c2c5-bfb6-40c3-a2a1-10fa8b78197c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.686744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c478c2c5-bfb6-40c3-a2a1-10fa8b78197c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.871850 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c478c2c5-bfb6-40c3-a2a1-10fa8b78197c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198113 Oct 27 09:37:51.873696 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3057/6182] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:37:51 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:52.056214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-8bc3f67b-c959-4a4d-864a-1be058d88415 req-21f7f650-d019-4cd5-8a58-e4495de253af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eab0924-3c66-4fef-888e-c388910895b6", "tag": "930702a6-00ce-4008-8de9-7453c72c8815"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:52.084141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8bc3f67b-c959-4a4d-864a-1be058d88415 req-21f7f650-d019-4cd5-8a58-e4495de253af service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:52.087075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8bc3f67b-c959-4a4d-864a-1be058d88415 req-21f7f650-d019-4cd5-8a58-e4495de253af service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:52.088756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-8bc3f67b-c959-4a4d-864a-1be058d88415 req-21f7f650-d019-4cd5-8a58-e4495de253af service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:52.121752 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-8bc3f67b-c959-4a4d-864a-1be058d88415 req-21f7f650-d019-4cd5-8a58-e4495de253af service nova] Creating event network-changed:930702a6-00ce-4008-8de9-7453c72c8815 for instance 4eab0924-3c66-4fef-888e-c388910895b6 on n-h1-858383-16 Oct 27 09:37:52.132841 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-8bc3f67b-c959-4a4d-864a-1be058d88415 req-21f7f650-d019-4cd5-8a58-e4495de253af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088821 Oct 27 09:37:52.140406 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3126/6183] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:52.604855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:52.605509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:52.620965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:52.621842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:52.622612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:52.623986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:52.624752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:52.629793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:52.980667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:52.995102 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-031706a3-5429-4c7b-8003-2db204b4e5b0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1469 microversion: 2.1 time: 0.395846 Oct 27 09:37:53.001636 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3058/6184] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:52 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1469 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:54.036020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:54.041918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:54.063306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:54.066073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:54.067626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:54.070344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:54.072084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:54.073955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:54.464657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:54.476074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1a8c1411-95b7-4001-8709-b11e891bb6d5 req-510decc7-0360-4674-b583-8aae9b0ca319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f545f70f-06c4-4746-9b39-dcd1463c262d", "tag": "79448c61-c6dc-42f9-b060-4e3121874e12"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:54.488690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:54.496212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:54.503818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1a8c1411-95b7-4001-8709-b11e891bb6d5 req-510decc7-0360-4674-b583-8aae9b0ca319 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:54.504882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1a8c1411-95b7-4001-8709-b11e891bb6d5 req-510decc7-0360-4674-b583-8aae9b0ca319 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:54.505616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1a8c1411-95b7-4001-8709-b11e891bb6d5 req-510decc7-0360-4674-b583-8aae9b0ca319 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:54.510225 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-13065bc2-f407-4c45-8638-2d00b09e12e2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1469 microversion: 2.1 time: 0.493510 Oct 27 09:37:54.510864 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3127/6185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:54 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1469 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:54.544079 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1a8c1411-95b7-4001-8709-b11e891bb6d5 req-510decc7-0360-4674-b583-8aae9b0ca319 service nova] Creating event network-changed:79448c61-c6dc-42f9-b060-4e3121874e12 for instance f545f70f-06c4-4746-9b39-dcd1463c262d on n-h2-858383-16 Oct 27 09:37:54.558040 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1a8c1411-95b7-4001-8709-b11e891bb6d5 req-510decc7-0360-4674-b583-8aae9b0ca319 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394874 Oct 27 09:37:54.560689 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3059/6186] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:55.544564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:55.545339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:55.554166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:55.554670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:55.558334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:55.560067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:55.560563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:55.561000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:56.120507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:56.144445 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64622b41-7ac4-480f-8b98-469956b8b871 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1469 microversion: 2.1 time: 0.609769 Oct 27 09:37:56.148128 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3128/6187] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:55 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1469 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:57.181751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:57.188178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:57.188924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:57.197275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:57.197762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:57.199375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:57.200344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:57.201015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:57.201423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:57.209238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=86 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:57.432337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:57.443740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef2deba9-bdfe-4358-a5a8-3bd8549fa788 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1469 microversion: 2.1 time: 0.262498 Oct 27 09:37:57.459842 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3060/6188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:57 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:58.473286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:58.481617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:58.492293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:58.532173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:58.534729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:58.535459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:58.536530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:58.540889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:58.542357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:58.852782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:58.867283 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ea88b49-599e-4316-a578-fbbf394c1af1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1469 microversion: 2.1 time: 0.404274 Oct 27 09:37:58.868627 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3129/6189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:58 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1469 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:59.903213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:59.904472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:59.920435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:59.921795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:59.923841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:59.931380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:59.937682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:59.939159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:00.338958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:00.387761 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-694473a0-3c69-4fc5-868e-4cee1740d30f tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1469 microversion: 2.1 time: 0.488154 Oct 27 09:38:00.389854 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3061/6190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:59 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1469 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:00.513545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-eac22ea8-57bf-4f3b-abb5-818f3e7b7cff req-0991de6a-ad77-43c4-8e3d-e5234907671a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eab0924-3c66-4fef-888e-c388910895b6", "name": "network-vif-plugged", "status": "completed", "tag": "930702a6-00ce-4008-8de9-7453c72c8815"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:00.531671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eac22ea8-57bf-4f3b-abb5-818f3e7b7cff req-0991de6a-ad77-43c4-8e3d-e5234907671a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:00.532885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eac22ea8-57bf-4f3b-abb5-818f3e7b7cff req-0991de6a-ad77-43c4-8e3d-e5234907671a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:00.534490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-eac22ea8-57bf-4f3b-abb5-818f3e7b7cff req-0991de6a-ad77-43c4-8e3d-e5234907671a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:00.554746 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-eac22ea8-57bf-4f3b-abb5-818f3e7b7cff req-0991de6a-ad77-43c4-8e3d-e5234907671a service nova] Creating event network-vif-plugged:930702a6-00ce-4008-8de9-7453c72c8815 for instance 4eab0924-3c66-4fef-888e-c388910895b6 on n-h1-858383-16 Oct 27 09:38:00.567549 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-eac22ea8-57bf-4f3b-abb5-818f3e7b7cff req-0991de6a-ad77-43c4-8e3d-e5234907671a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054182 Oct 27 09:38:00.569506 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3130/6191] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:38:01.419554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:01.420301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:01.429135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:01.429639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:01.430887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:01.430887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:01.431368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:01.431731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:01.712356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:01.722419 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78ac3121-67c5-4a5b-b7c7-6ff66b252f5a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1469 microversion: 2.1 time: 0.306927 Oct 27 09:38:01.724139 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3062/6192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:01 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1469 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:02.764828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:02.767892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:02.778707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=40 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:02.785082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:02.786537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:02.787954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:02.788884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:02.789481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:02.790091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:02.807075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:03.043999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:03.064393 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-412040b7-bdbb-4214-8ac0-76d94cf4653e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1642 microversion: 2.1 time: 0.305251 Oct 27 09:38:03.074971 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3131/6193] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:02 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1642 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:03.096933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:03.100651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:03.119156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:03.120580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:03.121801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:03.122894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:03.123490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:03.140341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:03.402703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:03.412453 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a23d6ea-fee4-45f1-84c0-208a764a8ebd tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1642 microversion: 2.1 time: 0.327948 Oct 27 09:38:03.413060 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3063/6194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:03 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1642 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:03.435291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d1bd3bc-b64c-4015-a977-df08e66475a0 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:03.436314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d1bd3bc-b64c-4015-a977-df08e66475a0 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:03.443688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1bd3bc-b64c-4015-a977-df08e66475a0 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:03.444495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1bd3bc-b64c-4015-a977-df08e66475a0 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:03.445102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1bd3bc-b64c-4015-a977-df08e66475a0 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:03.446288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1bd3bc-b64c-4015-a977-df08e66475a0 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:03.446925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1bd3bc-b64c-4015-a977-df08e66475a0 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:03.447510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d1bd3bc-b64c-4015-a977-df08e66475a0 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:03.949869 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d1bd3bc-b64c-4015-a977-df08e66475a0 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1795 microversion: 2.1 time: 0.518185 Oct 27 09:38:03.950839 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3132/6195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:03 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1795 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:07.589211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-551446f5-2f0a-4524-a78f-811bd66c3ef7 req-c09e99ca-ff3d-42c8-b3dc-9214d9ce702a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eab0924-3c66-4fef-888e-c388910895b6", "tag": "930702a6-00ce-4008-8de9-7453c72c8815"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:07.611812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-551446f5-2f0a-4524-a78f-811bd66c3ef7 req-c09e99ca-ff3d-42c8-b3dc-9214d9ce702a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:07.612555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-551446f5-2f0a-4524-a78f-811bd66c3ef7 req-c09e99ca-ff3d-42c8-b3dc-9214d9ce702a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:07.626272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-551446f5-2f0a-4524-a78f-811bd66c3ef7 req-c09e99ca-ff3d-42c8-b3dc-9214d9ce702a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:07.669084 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-551446f5-2f0a-4524-a78f-811bd66c3ef7 req-c09e99ca-ff3d-42c8-b3dc-9214d9ce702a service nova] Creating event network-changed:930702a6-00ce-4008-8de9-7453c72c8815 for instance 4eab0924-3c66-4fef-888e-c388910895b6 on n-h1-858383-16 Oct 27 09:38:07.685300 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-551446f5-2f0a-4524-a78f-811bd66c3ef7 req-c09e99ca-ff3d-42c8-b3dc-9214d9ce702a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099348 Oct 27 09:38:07.694409 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3064/6196] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:14.903810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:14.904423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:14.908069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:14.908911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=11 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:14.923460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:14.924004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:14.924452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:14.925255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:14.925662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:14.926420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:15.075612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lazy-loading 'services' on Instance uuid 5a3e6d93-a72a-425a-83f6-f17b26c26704 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:38:15.227406 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c32f3f83-619a-4f65-b9c8-81e5ac016b3f tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704/os-volume_attachments/9eced009-91d0-41ac-b08f-669764e77635" status: 202 len: 0 microversion: 2.1 time: 0.327094 Oct 27 09:38:15.228683 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3133/6197] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:38:14 2022] DELETE /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704/os-volume_attachments/9eced009-91d0-41ac-b08f-669764e77635 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:38:22.273512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=11 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:22.275152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=25 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:22.280458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:22.281134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:22.289698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.290130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.290497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.291714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.292255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.292816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.339358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:38:22.459945 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7903120-47b3-4b99-96f0-2b5acec6379e tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 204 len: 0 microversion: 2.1 time: 0.188180 Oct 27 09:38:22.464292 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3065/6198] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:38:22 2022] DELETE /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:38:22.479840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:22.482309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:22.496016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.497145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.497892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.499133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.500234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.501935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.756734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:22.778087 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25637182-0406-4634-acd2-d4f813f0c0d9 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1514 microversion: 2.1 time: 0.306031 Oct 27 09:38:22.779380 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3134/6199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:22 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1514 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:23.827803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:23.831080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:23.841492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:23.842353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:23.842962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:23.843972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:23.844778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:23.845536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:24.077136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:24.089754 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b00ce72-75d7-4f3b-a99b-25fe4d2838fb tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1514 microversion: 2.1 time: 0.270846 Oct 27 09:38:24.090756 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3066/6200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:23 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:25.126803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:25.128027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:25.142164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:25.143068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:25.143971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:25.145288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:25.146328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:25.147097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:25.433998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24a6275c8b145d9aafb2413777ea267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cea321144ad4104bca58f5f262c929b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:25.471614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-eafd94c0-f306-480c-a92e-7de0ffdde2fb req-1c54a886-4448-4d93-98e4-385d550988bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3e6d93-a72a-425a-83f6-f17b26c26704", "name": "network-vif-deleted", "tag": "40f561b0-270e-48d9-b298-556d3dd6fdf7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:25.496043 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ca906749-a5c9-4f54-8b57-1dbf915b7f8d tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 200 len: 1472 microversion: 2.1 time: 0.377565 Oct 27 09:38:25.497797 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3135/6201] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:25 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 1472 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:25.505358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-eafd94c0-f306-480c-a92e-7de0ffdde2fb req-1c54a886-4448-4d93-98e4-385d550988bb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:25.506408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-eafd94c0-f306-480c-a92e-7de0ffdde2fb req-1c54a886-4448-4d93-98e4-385d550988bb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:25.507238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-eafd94c0-f306-480c-a92e-7de0ffdde2fb req-1c54a886-4448-4d93-98e4-385d550988bb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:25.533937 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-eafd94c0-f306-480c-a92e-7de0ffdde2fb req-1c54a886-4448-4d93-98e4-385d550988bb service nova] Creating event network-vif-deleted:40f561b0-270e-48d9-b298-556d3dd6fdf7 for instance 5a3e6d93-a72a-425a-83f6-f17b26c26704 on n-h1-858383-16 Oct 27 09:38:25.545292 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-eafd94c0-f306-480c-a92e-7de0ffdde2fb req-1c54a886-4448-4d93-98e4-385d550988bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086200 Oct 27 09:38:25.552481 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3067/6202] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:38:26.527652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:26.528609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] [instance: 5a3e6d93-a72a-425a-83f6-f17b26c26704] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:26.537470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:26.538186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:26.538779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:26.539780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:26.540451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:26.541027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:26.558543 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] HTTP exception thrown: Instance 5a3e6d93-a72a-425a-83f6-f17b26c26704 could not be found. Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Request method failure captured: Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 HTTP/1.1 Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlB2GpHeAwI7Utmgics2rq04v8e50u94jS-IE9Qx6dABGuNPCEz-882iriHj456MR1SfVMD2YRsbyBCS5FkG5_Sd7XPayQNqSUPBfP_3MPxruQagj6PnuPjKoVBuKg0UZ0KkL7E5q3MNDVjCweXb7zwd1e1iaEpFYVLkj9W6ap4ytPI Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 2cea321144ad4104bca58f5f262c929b Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesSnapshotTestJSON-359308288 Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2cea321144ad4104bca58f5f262c929b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2cea321144ad4104bca58f5f262c929b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2cea321144ad4104bca58f5f262c929b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2cea321144ad4104bca58f5f262c929b"}]}] Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesSnapshotTestJSON-359308288 Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 2cea321144ad4104bca58f5f262c929b Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-359308288 Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesSnapshotTestJSON-359308288-project Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: c24a6275c8b145d9aafb2413777ea267 Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesSnapshotTestJSON-359308288-project Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 5a3e6d93-a72a-425a-83f6-f17b26c26704 could not be found. Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5a3e6d93-a72a-425a-83f6-f17b26c26704'} Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3e6d93-a72a-425a-83f6-f17b26c26704 could not be found. Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3e6d93-a72a-425a-83f6-f17b26c26704 could not be found. Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:38:26.560604 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3e6d93-a72a-425a-83f6-f17b26c26704 could not be found. Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] Returning 404 to user: Instance 5a3e6d93-a72a-425a-83f6-f17b26c26704 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84e3d6c9-3935-4960-8362-5041b35602e3 tempest-VolumesSnapshotTestJSON-359308288 tempest-VolumesSnapshotTestJSON-359308288-project] 10.222.0.25 "GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704" status: 404 len: 111 microversion: 2.1 time: 0.040664 Oct 27 09:38:26.573087 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3136/6203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:26 2022] GET /compute/v2.1/servers/5a3e6d93-a72a-425a-83f6-f17b26c26704 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:38:56.680581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ae6eb69-b7aa-44dc-829d-19e799639eec tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:56.684329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ae6eb69-b7aa-44dc-829d-19e799639eec tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:56.692126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:56.693963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:56.697129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ae6eb69-b7aa-44dc-829d-19e799639eec tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:56.697626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ae6eb69-b7aa-44dc-829d-19e799639eec tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:56.698072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ae6eb69-b7aa-44dc-829d-19e799639eec tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:56.698811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ae6eb69-b7aa-44dc-829d-19e799639eec tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:56.699279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ae6eb69-b7aa-44dc-829d-19e799639eec tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:56.699769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ae6eb69-b7aa-44dc-829d-19e799639eec tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:56.734711 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ae6eb69-b7aa-44dc-829d-19e799639eec tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/ips" status: 200 len: 146 microversion: 2.1 time: 0.062700 Oct 27 09:38:56.736469 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3068/6204] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:38:56 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/ips => generated 146 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:59.732250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9ed5b81-cfda-49ea-83f9-860845305cb4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e57b236-d677-4559-92a1-0dca210e1e32"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:59.735494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e9ed5b81-cfda-49ea-83f9-860845305cb4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:59.738789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:59.739942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:59.746805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9ed5b81-cfda-49ea-83f9-860845305cb4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:59.747465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9ed5b81-cfda-49ea-83f9-860845305cb4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:59.748438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9ed5b81-cfda-49ea-83f9-860845305cb4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:59.749650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9ed5b81-cfda-49ea-83f9-860845305cb4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:59.750349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9ed5b81-cfda-49ea-83f9-860845305cb4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:59.750983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9ed5b81-cfda-49ea-83f9-860845305cb4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:00.535856 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e9ed5b81-cfda-49ea-83f9-860845305cb4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807717 Oct 27 09:39:00.538518 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3137/6205] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:38:59 2022] POST /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:39:15.486502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf618875-ef40-4db0-959e-0724f259801c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:15.490321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf618875-ef40-4db0-959e-0724f259801c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:15.494330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:15.495696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:15.504870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf618875-ef40-4db0-959e-0724f259801c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.505794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf618875-ef40-4db0-959e-0724f259801c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.506604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf618875-ef40-4db0-959e-0724f259801c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.507854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf618875-ef40-4db0-959e-0724f259801c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.508770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf618875-ef40-4db0-959e-0724f259801c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.509553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf618875-ef40-4db0-959e-0724f259801c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.564065 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf618875-ef40-4db0-959e-0724f259801c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084042 Oct 27 09:39:15.565207 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3069/6206] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:39:15 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:39:15.581207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0efb4fd9-d735-4818-8921-600139aae3e3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:15.582013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0efb4fd9-d735-4818-8921-600139aae3e3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:15.590318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:15.591421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:15.594054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0efb4fd9-d735-4818-8921-600139aae3e3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.594602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0efb4fd9-d735-4818-8921-600139aae3e3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.595071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0efb4fd9-d735-4818-8921-600139aae3e3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.596437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0efb4fd9-d735-4818-8921-600139aae3e3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.596925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0efb4fd9-d735-4818-8921-600139aae3e3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.597373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0efb4fd9-d735-4818-8921-600139aae3e3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.651333 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0efb4fd9-d735-4818-8921-600139aae3e3 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5e57b236-d677-4559-92a1-0dca210e1e32" status: 200 len: 194 microversion: 2.1 time: 0.075966 Oct 27 09:39:15.652262 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3138/6207] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Oct 27 09:39:15 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5e57b236-d677-4559-92a1-0dca210e1e32 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:39:18.405477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ce86050-f0b9-4cc0-8892-295e8fa7cb2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5195082f-de68-4489-bafd-412b8d794217"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:18.409995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ce86050-f0b9-4cc0-8892-295e8fa7cb2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:18.432733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce86050-f0b9-4cc0-8892-295e8fa7cb2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:18.435439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce86050-f0b9-4cc0-8892-295e8fa7cb2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:18.436385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce86050-f0b9-4cc0-8892-295e8fa7cb2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:18.437356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce86050-f0b9-4cc0-8892-295e8fa7cb2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:18.438107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce86050-f0b9-4cc0-8892-295e8fa7cb2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:18.444013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ce86050-f0b9-4cc0-8892-295e8fa7cb2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:19.034883 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ce86050-f0b9-4cc0-8892-295e8fa7cb2c tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "POST /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635120 Oct 27 09:39:19.036944 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3070/6208] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:39:18 2022] POST /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:34.196713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-89e95061-19a8-4d87-9c1f-c8a455e29782 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:34.200662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-89e95061-19a8-4d87-9c1f-c8a455e29782 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:34.208527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:34.210863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:34.213528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e95061-19a8-4d87-9c1f-c8a455e29782 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.214741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e95061-19a8-4d87-9c1f-c8a455e29782 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.215425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e95061-19a8-4d87-9c1f-c8a455e29782 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.216638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e95061-19a8-4d87-9c1f-c8a455e29782 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.217437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e95061-19a8-4d87-9c1f-c8a455e29782 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.218337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-89e95061-19a8-4d87-9c1f-c8a455e29782 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.288299 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-89e95061-19a8-4d87-9c1f-c8a455e29782 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.095826 Oct 27 09:39:34.289939 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3139/6209] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:39:34 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments => generated 371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:34.445679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b65f80e9-b4b5-4269-aaee-643f36f70475 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:34.447134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b65f80e9-b4b5-4269-aaee-643f36f70475 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:34.455684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:34.458796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:34.466153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65f80e9-b4b5-4269-aaee-643f36f70475 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.467007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65f80e9-b4b5-4269-aaee-643f36f70475 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.468256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65f80e9-b4b5-4269-aaee-643f36f70475 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.470016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65f80e9-b4b5-4269-aaee-643f36f70475 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.471176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65f80e9-b4b5-4269-aaee-643f36f70475 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.472018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b65f80e9-b4b5-4269-aaee-643f36f70475 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.560023 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b65f80e9-b4b5-4269-aaee-643f36f70475 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5e57b236-d677-4559-92a1-0dca210e1e32" status: 200 len: 194 microversion: 2.1 time: 0.121936 Oct 27 09:39:34.564201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3071/6210] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Oct 27 09:39:34 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5e57b236-d677-4559-92a1-0dca210e1e32 => generated 194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:34.587224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:34.587772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:34.595660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.597497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.598134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.600085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.600918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.601581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.728272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lazy-loading 'services' on Instance uuid f545f70f-06c4-4746-9b39-dcd1463c262d {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:39:34.939910 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c44f98b6-36de-43c5-9331-e225970e5011 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5e57b236-d677-4559-92a1-0dca210e1e32" status: 202 len: 0 microversion: 2.1 time: 0.361037 Oct 27 09:39:34.946760 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3140/6211] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:39:34 2022] DELETE /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5e57b236-d677-4559-92a1-0dca210e1e32 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:39:36.424645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-892991413", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "7612320e-c1b2-4a67-92d4-e5c09818b2bd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-246869637", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4eab0924-3c66-4fef-888e-c388910895b6"]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:36.555527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] validate_networks() for [('7612320e-c1b2-4a67-92d4-e5c09818b2bd', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:39:37.425950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:39:37.426984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:39:37.427437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:39:37.428087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:39:37.428702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:39:37.453629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.457751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.461316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:37.465441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.468725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.469919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:37.517159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Getting quotas for project 69fc539ecb9c4526bac4242bec19739c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:39:37.528794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Getting quotas for user ae06558b53a04f85b6698de28e9a0c68 and project 69fc539ecb9c4526bac4242bec19739c. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:39:37.552537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:39:37.557074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:39:37.702300 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-450caf3a-efc9-433d-a583-da15b6bff2cb tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.286916 Oct 27 09:39:37.702922 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3072/6212] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:39:36 2022] POST /compute/v2.1/servers => generated 361 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:39:37.727649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2f8f9874-eedb-471c-8a2f-86a6a596b5b8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:37.736095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2f8f9874-eedb-471c-8a2f-86a6a596b5b8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:37.915878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2f8f9874-eedb-471c-8a2f-86a6a596b5b8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:37.934696 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2f8f9874-eedb-471c-8a2f-86a6a596b5b8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1240 microversion: 2.1 time: 0.218700 Oct 27 09:39:37.935998 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3141/6213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:37 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1240 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:38.983242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:38.985584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:39.006005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.006715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.007179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.007989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.008454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.008885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.107694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:39.119389 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45a0d05d-9110-4f02-b575-6e91097c1a40 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1236 microversion: 2.1 time: 0.145980 Oct 27 09:39:39.120066 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3073/6214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:38 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1236 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:40.169465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:40.173207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:40.233564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:40.238581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:40.245684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:40.248573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:40.251845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:40.252301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:40.490792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:40.537246 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a4c0dbda-7357-4431-b58d-cd62bc06f16b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1300 microversion: 2.1 time: 0.352695 Oct 27 09:39:40.540686 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3142/6215] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:40 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1300 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:41.580546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:41.581249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:41.599461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:41.600012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:41.600462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.601210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:41.601688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:41.602132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.809065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:41.821913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59b64d07-d5ab-48f1-bfa5-4d06b1d9bdea tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1298 microversion: 2.1 time: 0.245140 Oct 27 09:39:41.823719 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3074/6216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:41 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1298 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:42.636059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c33a8734-2787-4410-9a94-9c3830bb9c18 req-fde86ad9-68dd-40ca-82b6-40c72de63bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2e90d7-d40c-4d20-b5ed-9c63595da67d", "tag": "e905ed35-9f40-4d47-a994-2e0121ce6e15"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:42.664173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c33a8734-2787-4410-9a94-9c3830bb9c18 req-fde86ad9-68dd-40ca-82b6-40c72de63bbf service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.665690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c33a8734-2787-4410-9a94-9c3830bb9c18 req-fde86ad9-68dd-40ca-82b6-40c72de63bbf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.666540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c33a8734-2787-4410-9a94-9c3830bb9c18 req-fde86ad9-68dd-40ca-82b6-40c72de63bbf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.739374 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c33a8734-2787-4410-9a94-9c3830bb9c18 req-fde86ad9-68dd-40ca-82b6-40c72de63bbf service nova] Creating event network-changed:e905ed35-9f40-4d47-a994-2e0121ce6e15 for instance 4c2e90d7-d40c-4d20-b5ed-9c63595da67d on n-h2-858383-16 Oct 27 09:39:42.755721 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c33a8734-2787-4410-9a94-9c3830bb9c18 req-fde86ad9-68dd-40ca-82b6-40c72de63bbf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129126 Oct 27 09:39:42.759735 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3143/6217] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:42.864090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:42.864923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:42.877008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.877711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.878297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.879173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.880034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.881148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:43.310702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:43.343481 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2056072e-f8bf-4d1f-a51c-11cd6981fb25 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1298 microversion: 2.1 time: 0.487776 Oct 27 09:39:43.345082 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3075/6218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:42 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1298 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:44.215709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c85058ea-0624-46b9-91cc-a03f02f0c871 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:44.215709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c85058ea-0624-46b9-91cc-a03f02f0c871 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:44.221373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c85058ea-0624-46b9-91cc-a03f02f0c871 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.221880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c85058ea-0624-46b9-91cc-a03f02f0c871 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.222329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c85058ea-0624-46b9-91cc-a03f02f0c871 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.223061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c85058ea-0624-46b9-91cc-a03f02f0c871 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.223526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c85058ea-0624-46b9-91cc-a03f02f0c871 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.223989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c85058ea-0624-46b9-91cc-a03f02f0c871 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.261224 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c85058ea-0624-46b9-91cc-a03f02f0c871 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5195082f-de68-4489-bafd-412b8d794217" status: 200 len: 194 microversion: 2.1 time: 0.053886 Oct 27 09:39:44.262277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3144/6219] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Oct 27 09:39:44 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5195082f-de68-4489-bafd-412b8d794217 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:44.282910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:44.284236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:44.291770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.292274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.292720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.293799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.294477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.295998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.385224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:44.389634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:44.418412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.419868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.421014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.423126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lazy-loading 'services' on Instance uuid f545f70f-06c4-4746-9b39-dcd1463c262d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:39:44.423627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.424807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.425930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.522570 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-feac2dc2-2379-4770-92c0-9a51fcc74fb2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5195082f-de68-4489-bafd-412b8d794217" status: 202 len: 0 microversion: 2.1 time: 0.247445 Oct 27 09:39:44.523534 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3076/6220] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:39:44 2022] DELETE /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments/5195082f-de68-4489-bafd-412b8d794217 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:39:44.965656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:44.982806 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79a01f4a-22cb-43f4-9805-27c489bf3e6d tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1298 microversion: 2.1 time: 0.605607 Oct 27 09:39:45.003680 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3145/6221] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:44 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1298 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:46.020646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:46.021472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:46.029871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:46.030380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:46.030841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:46.032293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:46.032774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:46.033261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:46.364754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:46.374008 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2579690e-cb56-41c8-97b1-e1810965ab3a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1298 microversion: 2.1 time: 0.358543 Oct 27 09:39:46.374774 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3077/6222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:46 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1298 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:47.411883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:47.413133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:47.422514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.423287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.424192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.425388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.426124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.426770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.532526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:47.544853 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-02f036b1-9e80-40b7-933b-4697530765f8 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1298 microversion: 2.1 time: 0.137996 Oct 27 09:39:47.546319 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3146/6223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:47 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1298 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:48.576494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:48.579051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:48.591103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:48.606385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:48.626424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:48.628180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:48.631017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:48.634085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:48.636919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:48.637730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:48.786544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:48.816173 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12f991ff-d09e-4cba-bb10-f9f323697f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1298 microversion: 2.1 time: 0.245572 Oct 27 09:39:48.834606 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3078/6224] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:48 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1298 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:49.358487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-4c5315e8-da04-46d9-adbc-97a42e1f5564 req-b80f2319-290b-48f4-bd30-90d2a973966a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2e90d7-d40c-4d20-b5ed-9c63595da67d", "name": "network-vif-plugged", "status": "completed", "tag": "e905ed35-9f40-4d47-a994-2e0121ce6e15"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:49.387230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:49.394815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4c5315e8-da04-46d9-adbc-97a42e1f5564 req-b80f2319-290b-48f4-bd30-90d2a973966a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:49.395446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4c5315e8-da04-46d9-adbc-97a42e1f5564 req-b80f2319-290b-48f4-bd30-90d2a973966a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:49.395940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-4c5315e8-da04-46d9-adbc-97a42e1f5564 req-b80f2319-290b-48f4-bd30-90d2a973966a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:49.429464 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-4c5315e8-da04-46d9-adbc-97a42e1f5564 req-b80f2319-290b-48f4-bd30-90d2a973966a service nova] Creating event network-vif-plugged:e905ed35-9f40-4d47-a994-2e0121ce6e15 for instance 4c2e90d7-d40c-4d20-b5ed-9c63595da67d on n-h2-858383-16 Oct 27 09:39:49.442210 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-4c5315e8-da04-46d9-adbc-97a42e1f5564 req-b80f2319-290b-48f4-bd30-90d2a973966a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091424 Oct 27 09:39:49.443162 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3147/6225] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:49.849695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:49.850589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:49.864043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:49.864591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:49.866361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:49.869493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:49.870576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:49.872269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:50.053230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:50.062898 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc0d66f2-dfd9-4239-b5d0-df28c044f6e0 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1298 microversion: 2.1 time: 0.219957 Oct 27 09:39:50.063502 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3079/6226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:49 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1298 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:51.104339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:51.108434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:51.133335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.134712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.135940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.137611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.138427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.139436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.365776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:51.414599 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-13ad972b-5cb3-48b6-86a9-f99905572808 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1470 microversion: 2.1 time: 0.324764 Oct 27 09:39:51.415489 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3148/6227] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:51 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1470 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:51.445276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:51.446084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:51.459492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.461234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.462748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.464523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.465711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.466801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.610591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:51.629656 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a4b43ab-fac1-48ed-bb31-86c29b9c65ce tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1470 microversion: 2.1 time: 0.192756 Oct 27 09:39:51.631051 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3080/6228] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:51 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:51.653720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eef7c29a-3889-4fa9-baaf-6de316ff21d5 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:51.654930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eef7c29a-3889-4fa9-baaf-6de316ff21d5 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:51.664227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef7c29a-3889-4fa9-baaf-6de316ff21d5 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.666173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef7c29a-3889-4fa9-baaf-6de316ff21d5 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.669933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef7c29a-3889-4fa9-baaf-6de316ff21d5 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.671240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef7c29a-3889-4fa9-baaf-6de316ff21d5 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.673059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef7c29a-3889-4fa9-baaf-6de316ff21d5 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.673799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef7c29a-3889-4fa9-baaf-6de316ff21d5 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.786912 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eef7c29a-3889-4fa9-baaf-6de316ff21d5 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1623 microversion: 2.1 time: 0.137094 Oct 27 09:39:51.788514 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3149/6229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:51 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1623 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:51.811264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc94f9cc-ddc1-4956-bc80-68d1ce0c0e06 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:51.812055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc94f9cc-ddc1-4956-bc80-68d1ce0c0e06 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:51.819661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc94f9cc-ddc1-4956-bc80-68d1ce0c0e06 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.820175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc94f9cc-ddc1-4956-bc80-68d1ce0c0e06 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.820868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc94f9cc-ddc1-4956-bc80-68d1ce0c0e06 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.821879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc94f9cc-ddc1-4956-bc80-68d1ce0c0e06 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.822565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc94f9cc-ddc1-4956-bc80-68d1ce0c0e06 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.823207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc94f9cc-ddc1-4956-bc80-68d1ce0c0e06 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:52.014959 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc94f9cc-ddc1-4956-bc80-68d1ce0c0e06 tempest-TestSecurityGroupsBasicOps-1999780448 tempest-TestSecurityGroupsBasicOps-1999780448-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1914 microversion: 2.1 time: 0.207668 Oct 27 09:39:52.015682 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3081/6230] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:51 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1914 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:52.114677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:52.115498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:52.125831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:52.126889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:52.127858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:52.129618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:52.130418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:52.131234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:52.196672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:39:52.356806 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ffd7b77e-7b4a-4285-a7ce-f84c20566aca tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 204 len: 0 microversion: 2.1 time: 0.247052 Oct 27 09:39:52.358852 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3150/6231] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:39:52 2022] DELETE /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:39:52.369183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:52.370443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:52.398426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:52.399531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:52.400421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:52.401349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:52.402059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:52.403688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:52.558186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:52.573357 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bd55a78-c290-497e-b494-b182c7164f3b tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1476 microversion: 2.1 time: 0.209202 Oct 27 09:39:52.574297 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3082/6232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:52 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1476 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:53.599362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:53.602756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:53.620748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:53.624195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:53.626587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:53.627825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:53.630800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:53.632189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:53.960431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ea52e05-0331-4d30-a4b1-a97c82897aac tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:53.965554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ea52e05-0331-4d30-a4b1-a97c82897aac tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:53.979229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea52e05-0331-4d30-a4b1-a97c82897aac tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:53.980535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea52e05-0331-4d30-a4b1-a97c82897aac tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:53.981847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea52e05-0331-4d30-a4b1-a97c82897aac tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:53.983362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea52e05-0331-4d30-a4b1-a97c82897aac tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:53.984736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea52e05-0331-4d30-a4b1-a97c82897aac tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:53.985459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea52e05-0331-4d30-a4b1-a97c82897aac tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:53.992588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:54.012595 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d29c09f5-9b68-4398-aba5-03f4c5d3782c tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1476 microversion: 2.1 time: 0.418296 Oct 27 09:39:54.013922 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3151/6233] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:53 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1476 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:54.058957 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ea52e05-0331-4d30-a4b1-a97c82897aac tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106588 Oct 27 09:39:54.059904 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3083/6234] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:39:53 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:39:54.284826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bef4b196-3d68-4e3b-8bda-784655dce570 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:54.289351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bef4b196-3d68-4e3b-8bda-784655dce570 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:54.301783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bef4b196-3d68-4e3b-8bda-784655dce570 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.302692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bef4b196-3d68-4e3b-8bda-784655dce570 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.303480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bef4b196-3d68-4e3b-8bda-784655dce570 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.304782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bef4b196-3d68-4e3b-8bda-784655dce570 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.305634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bef4b196-3d68-4e3b-8bda-784655dce570 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.307202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bef4b196-3d68-4e3b-8bda-784655dce570 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.370636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bef4b196-3d68-4e3b-8bda-784655dce570 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093425 Oct 27 09:39:54.372127 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3152/6235] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:39:54 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:39:54.517852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:54.524368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:54.537446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.538781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.549412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.551549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.552736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.553769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.622023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:39:54.781453 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33c1c16b-2609-4373-a548-3dc7872760b6 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 204 len: 0 microversion: 2.1 time: 0.272877 Oct 27 09:39:54.782343 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3084/6236] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:39:54 2022] DELETE /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:39:54.793988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:54.795504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:54.813114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.813623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.814075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.814826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.815465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.816236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.919870 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:39:54.923099 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 09:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d (ip 10.222.0.25) !!! Oct 27 09:39:54.925125 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:39:54.925397 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 09:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d (ip 10.222.0.25) !!! Oct 27 09:39:55.065172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:55.069980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:55.090432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:55.092218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:55.093298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:55.096405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:55.098018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:55.099174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:55.392409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:55.399425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:55.410611 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b2026aa-2e2c-4eae-aa19-e569b9e9dc7a tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1476 microversion: 2.1 time: 0.354847 Oct 27 09:39:55.413772 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3085/6237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:55 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1476 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:55.425083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-90a1a5d8-6530-4cd4-9304-561acb125b27 req-f7159aac-9de7-4977-a8f0-f92b00b5a84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2e90d7-d40c-4d20-b5ed-9c63595da67d", "name": "network-vif-deleted", "tag": "e905ed35-9f40-4d47-a994-2e0121ce6e15"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:55.454415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:55.455048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-90a1a5d8-6530-4cd4-9304-561acb125b27 req-f7159aac-9de7-4977-a8f0-f92b00b5a84f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:55.456504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-90a1a5d8-6530-4cd4-9304-561acb125b27 req-f7159aac-9de7-4977-a8f0-f92b00b5a84f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:55.458314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-90a1a5d8-6530-4cd4-9304-561acb125b27 req-f7159aac-9de7-4977-a8f0-f92b00b5a84f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:55.477893 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a57733d1-00de-4772-8382-a3d419317b94 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1672 microversion: 2.1 time: 0.687594 Oct 27 09:39:55.479759 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3153/6238] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:54 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1672 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:55.492796 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-90a1a5d8-6530-4cd4-9304-561acb125b27 req-f7159aac-9de7-4977-a8f0-f92b00b5a84f service nova] Creating event network-vif-deleted:e905ed35-9f40-4d47-a994-2e0121ce6e15 for instance 4c2e90d7-d40c-4d20-b5ed-9c63595da67d on n-h2-858383-16 Oct 27 09:39:55.506177 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-90a1a5d8-6530-4cd4-9304-561acb125b27 req-f7159aac-9de7-4977-a8f0-f92b00b5a84f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089696 Oct 27 09:39:55.507778 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3086/6239] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:56.461084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:56.462256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:56.489395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:56.500898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:56.508682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:56.509541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:56.510418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:56.511786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:56.541276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:56.545809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:56.570847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:56.571954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:56.572916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:56.584608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:56.591949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:56.593797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:56.635727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:56.636474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:56.637070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:56.637706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lazy-loading 'fault' on Instance uuid 4c2e90d7-d40c-4d20-b5ed-9c63595da67d {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:39:56.762005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:56.781491 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da147e2c-89b7-4741-be7b-3fed9d6502fe tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 200 len: 1330 microversion: 2.1 time: 0.327995 Oct 27 09:39:56.782667 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3154/6240] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:56 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 1330 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:57.100248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:57.124554 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77ed8115-729f-4b67-b143-ee4751e7aad2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1672 microversion: 2.1 time: 0.602223 Oct 27 09:39:57.125580 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3087/6241] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:56 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1672 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:57.813615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:57.814727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4c2e90d7-d40c-4d20-b5ed-9c63595da67d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:57.829903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:57.830825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:57.831621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:57.832840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:57.833593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:57.834607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:57.845338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:57.900209 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] HTTP exception thrown: Instance 4c2e90d7-d40c-4d20-b5ed-9c63595da67d could not be found. Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Request method failure captured: Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d HTTP/1.1 Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlFSbG7fMjpqbD-iiCFEcJ4kpfsHvIQgfj1LaRN0EcLxCldU32rc58PHPjPJwoe-QnRaRm2V1XjIBpnUFPBn5NoVO_2an7Lumh3t4YO0d1FSnZ8xlIU_vC8aw5NtECf8jnH96Hj3Quu8t92Iuo1V9cs_Q-ztpVrz624Ke5C9sboK3s8 Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 69fc539ecb9c4526bac4242bec19739c Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-569233901 Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69fc539ecb9c4526bac4242bec19739c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69fc539ecb9c4526bac4242bec19739c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69fc539ecb9c4526bac4242bec19739c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69fc539ecb9c4526bac4242bec19739c"}]}] Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestSecurityGroupsBasicOps-569233901 Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 69fc539ecb9c4526bac4242bec19739c Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-569233901 Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestSecurityGroupsBasicOps-569233901-project Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: ae06558b53a04f85b6698de28e9a0c68 Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestSecurityGroupsBasicOps-569233901-project Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4c2e90d7-d40c-4d20-b5ed-9c63595da67d could not be found. Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4c2e90d7-d40c-4d20-b5ed-9c63595da67d'} Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2e90d7-d40c-4d20-b5ed-9c63595da67d could not be found. Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2e90d7-d40c-4d20-b5ed-9c63595da67d could not be found. Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:39:57.905664 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:39:57.914534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:39:57.914534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:39:57.914534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:39:57.914534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:39:57.914534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:39:57.914534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2e90d7-d40c-4d20-b5ed-9c63595da67d could not be found. Oct 27 09:39:57.914534 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:39:57.917458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Returning 404 to user: Instance 4c2e90d7-d40c-4d20-b5ed-9c63595da67d could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:39:57.919304 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-14b1c5d6-16f3-456a-92cf-9b039ddd5526 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d" status: 404 len: 111 microversion: 2.1 time: 0.115778 Oct 27 09:39:57.922144 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3155/6242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:57 2022] GET /compute/v2.1/servers/4c2e90d7-d40c-4d20-b5ed-9c63595da67d => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:39:58.164824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:58.168369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:58.186433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:58.204849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:58.206022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:58.207711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:58.208951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:58.210291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:58.525096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:58.557411 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8033655-d35b-4a53-8fc2-0bc98855f4d5 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1605 microversion: 2.1 time: 0.399460 Oct 27 09:39:58.568287 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3088/6243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:58 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1605 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:59.380187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-5215d518-b1d7-4b91-8fca-e64b5dcd3b74 req-e876914e-4e5d-4401-a8e3-b16c081ce463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f545f70f-06c4-4746-9b39-dcd1463c262d", "name": "network-vif-deleted", "tag": "79448c61-c6dc-42f9-b060-4e3121874e12"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:59.422046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5215d518-b1d7-4b91-8fca-e64b5dcd3b74 req-e876914e-4e5d-4401-a8e3-b16c081ce463 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.422577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5215d518-b1d7-4b91-8fca-e64b5dcd3b74 req-e876914e-4e5d-4401-a8e3-b16c081ce463 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.422869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-5215d518-b1d7-4b91-8fca-e64b5dcd3b74 req-e876914e-4e5d-4401-a8e3-b16c081ce463 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.490133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-5215d518-b1d7-4b91-8fca-e64b5dcd3b74 req-e876914e-4e5d-4401-a8e3-b16c081ce463 service nova] Creating event network-vif-deleted:79448c61-c6dc-42f9-b060-4e3121874e12 for instance f545f70f-06c4-4746-9b39-dcd1463c262d on n-h2-858383-16 Oct 27 09:39:59.504253 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-5215d518-b1d7-4b91-8fca-e64b5dcd3b74 req-e876914e-4e5d-4401-a8e3-b16c081ce463 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137196 Oct 27 09:39:59.507661 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3156/6244] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:39:59.604240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:59.605033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:59.634301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.637277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.642521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.643482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.645719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.649069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.756802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.759972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.760620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.761377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lazy-loading 'fault' on Instance uuid f545f70f-06c4-4746-9b39-dcd1463c262d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:39:59.911250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153c5ce21b24daa91bacaa9f47b7c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86767ef47c0a4d9bbdda088354b82c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:59.925546 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42919358-46f7-45b3-9ec0-948edafa680f tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 200 len: 1326 microversion: 2.1 time: 0.325188 Oct 27 09:39:59.963732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3089/6245] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:59 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 1326 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:00.959318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:00.960362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:00.979270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:00.979985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:00.980447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:00.981180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:00.981647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:00.982084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:01.004261 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] HTTP exception thrown: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Request method failure captured: Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d HTTP/1.1 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAyQtLz1ja0iiWYoMgGcUYWb3Z6sa5Q82C7bizruR0bbfIQGpJ1vHlEcnYm251Mi1n3HbbSVOg8B3aOHLUo-SGss6ELI7ozBxy7lmxz-oSHNqkDyexf0bEMFtSiipFBQbt8u8fRPOEMloKaN4sTa0oTKX5T1uMqT4LCaRYwQFRU0CU Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86767ef47c0a4d9bbdda088354b82c02"}]}] Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9153c5ce21b24daa91bacaa9f47b7c57 Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f545f70f-06c4-4746-9b39-dcd1463c262d'} Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:01.006331 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Returning 404 to user: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9ec9ff0b-3c94-4a1c-af3c-104dc7204cbc tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 404 len: 111 microversion: 2.1 time: 0.057065 Oct 27 09:40:01.016794 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3157/6246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:00 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:40:01.034753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd5324d8-eac2-4da5-a296-bc6b9f9d3063 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '.version_select at 0x7f31aa13fc10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:01.078326 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd5324d8-eac2-4da5-a296-bc6b9f9d3063 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176605454" status: 202 len: 0 microversion: 2.1 time: 0.056413 Oct 27 09:40:01.083002 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3090/6247] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:40:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176605454 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:40:10.412278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-18e8dbb1-adc8-414d-8478-25fadcb9f090 req-c95b3ea7-7a3a-46a7-8e49-e3b17426dccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eab0924-3c66-4fef-888e-c388910895b6", "tag": "930702a6-00ce-4008-8de9-7453c72c8815"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:10.415363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:10.416285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:10.432828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:10.437449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.447889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.449573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.456886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.459280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=22 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:10.468947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.470455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.471210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:10.481802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-18e8dbb1-adc8-414d-8478-25fadcb9f090 req-c95b3ea7-7a3a-46a7-8e49-e3b17426dccc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.496663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-18e8dbb1-adc8-414d-8478-25fadcb9f090 req-c95b3ea7-7a3a-46a7-8e49-e3b17426dccc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.497282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-18e8dbb1-adc8-414d-8478-25fadcb9f090 req-c95b3ea7-7a3a-46a7-8e49-e3b17426dccc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.535039 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-18e8dbb1-adc8-414d-8478-25fadcb9f090 req-c95b3ea7-7a3a-46a7-8e49-e3b17426dccc service nova] Creating event network-changed:930702a6-00ce-4008-8de9-7453c72c8815 for instance 4eab0924-3c66-4fef-888e-c388910895b6 on n-h1-858383-16 Oct 27 09:40:10.564562 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-18e8dbb1-adc8-414d-8478-25fadcb9f090 req-c95b3ea7-7a3a-46a7-8e49-e3b17426dccc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155870 Oct 27 09:40:10.581485 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3091/6248] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:40:10.608888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:40:10.814987 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-abd62146-fe90-428e-8e56-4acdf0e571f9 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 204 len: 0 microversion: 2.1 time: 0.410587 Oct 27 09:40:10.817196 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3158/6249] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:40:10 2022] DELETE /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:40:10.826496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:10.828978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:10.852674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.857894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.858676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.860242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.862808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.863600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:11.390406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:11.412606 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fab0c9b-ab04-425d-9974-33e1243eb6a1 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1767 microversion: 2.1 time: 0.591563 Oct 27 09:40:11.422812 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3092/6250] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:10 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1767 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:12.447123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:12.448001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:12.467350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:12.476090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:12.476739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:12.477719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:12.478128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:12.478637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.321145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae06558b53a04f85b6698de28e9a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fc539ecb9c4526bac4242bec19739c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:14.412272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e6cdc0c4-9e39-409b-aefc-bfa3eaa157e4 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 200 len: 1767 microversion: 2.1 time: 1.962811 Oct 27 09:40:14.414874 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3159/6251] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:12 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 1767 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:14.611037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d4c1ce0a-9110-4978-947d-de592157f98e req-32c7f69d-b35e-4421-87cf-b0083dedd90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eab0924-3c66-4fef-888e-c388910895b6", "name": "network-vif-deleted", "tag": "930702a6-00ce-4008-8de9-7453c72c8815"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:14.632211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d4c1ce0a-9110-4978-947d-de592157f98e req-32c7f69d-b35e-4421-87cf-b0083dedd90f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.634303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d4c1ce0a-9110-4978-947d-de592157f98e req-32c7f69d-b35e-4421-87cf-b0083dedd90f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.636593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d4c1ce0a-9110-4978-947d-de592157f98e req-32c7f69d-b35e-4421-87cf-b0083dedd90f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.659109 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d4c1ce0a-9110-4978-947d-de592157f98e req-32c7f69d-b35e-4421-87cf-b0083dedd90f service nova] Creating event network-vif-deleted:930702a6-00ce-4008-8de9-7453c72c8815 for instance 4eab0924-3c66-4fef-888e-c388910895b6 on n-h1-858383-16 Oct 27 09:40:14.668012 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d4c1ce0a-9110-4978-947d-de592157f98e req-32c7f69d-b35e-4421-87cf-b0083dedd90f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061602 Oct 27 09:40:14.669863 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3093/6252] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:15.467220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:15.469422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] [instance: 4eab0924-3c66-4fef-888e-c388910895b6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:15.480192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:15.481037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:15.481696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.482644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:15.484274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:15.484961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.502510 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] HTTP exception thrown: Instance 4eab0924-3c66-4fef-888e-c388910895b6 could not be found. Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Request method failure captured: Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 HTTP/1.1 Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlFSbG7fMjpqbD-iiCFEcJ4kpfsHvIQgfj1LaRN0EcLxCldU32rc58PHPjPJwoe-QnRaRm2V1XjIBpnUFPBn5NoVO_2an7Lumh3t4YO0d1FSnZ8xlIU_vC8aw5NtECf8jnH96Hj3Quu8t92Iuo1V9cs_Q-ztpVrz624Ke5C9sboK3s8 Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 69fc539ecb9c4526bac4242bec19739c Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-569233901 Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69fc539ecb9c4526bac4242bec19739c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69fc539ecb9c4526bac4242bec19739c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69fc539ecb9c4526bac4242bec19739c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69fc539ecb9c4526bac4242bec19739c"}]}] Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestSecurityGroupsBasicOps-569233901 Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 69fc539ecb9c4526bac4242bec19739c Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-569233901 Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestSecurityGroupsBasicOps-569233901-project Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: ae06558b53a04f85b6698de28e9a0c68 Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestSecurityGroupsBasicOps-569233901-project Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4eab0924-3c66-4fef-888e-c388910895b6 could not be found. Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4eab0924-3c66-4fef-888e-c388910895b6'} Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eab0924-3c66-4fef-888e-c388910895b6 could not be found. Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eab0924-3c66-4fef-888e-c388910895b6 could not be found. Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:15.504944 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:15.510856 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:15.510856 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:15.510856 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:15.510856 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:40:15.510856 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:40:15.510856 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eab0924-3c66-4fef-888e-c388910895b6 could not be found. Oct 27 09:40:15.510856 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:15.511970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Returning 404 to user: Instance 4eab0924-3c66-4fef-888e-c388910895b6 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:40:15.513006 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a72019b6-e72a-4406-8929-00ce7f67cc0e tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6" status: 404 len: 111 microversion: 2.1 time: 0.058189 Oct 27 09:40:15.513707 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3160/6253] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:15 2022] GET /compute/v2.1/servers/4eab0924-3c66-4fef-888e-c388910895b6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:40:17.932658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:17.933869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:17.945040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:17.952464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:17.953345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:17.955597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:17.956263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:17.956890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:17.997872 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] HTTP exception thrown: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Request method failure captured: Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d HTTP/1.1 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlAyQtLz1ja0iiWYoMgGcUYWb3Z6sa5Q82C7bizruR0bbfIQGpJ1vHlEcnYm251Mi1n3HbbSVOg8B3aOHLUo-SGss6ELI7ozBxy7lmxz-oSHNqkDyexf0bEMFtSiipFBQbt8u8fRPOEMloKaN4sTa0oTKX5T1uMqT4LCaRYwQFRU0CU Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86767ef47c0a4d9bbdda088354b82c02"}]}] Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9153c5ce21b24daa91bacaa9f47b7c57 Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f545f70f-06c4-4746-9b39-dcd1463c262d'} Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:40:18.000065 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.004097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.008536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Returning 404 to user: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:40:18.016931 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bcb29d6f-fdbc-4abe-be47-352b406bf072 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 404 len: 111 microversion: 2.1 time: 0.089213 Oct 27 09:40:18.017790 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3094/6254] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:40:17 2022] DELETE /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:40:18.026263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:18.027283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: f545f70f-06c4-4746-9b39-dcd1463c262d] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:18.038410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:18.043941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:18.050266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:18.051190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:18.051790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:18.053712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:18.086110 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] HTTP exception thrown: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Request method failure captured: Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d HTTP/1.1 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAyQtLz1ja0iiWYoMgGcUYWb3Z6sa5Q82C7bizruR0bbfIQGpJ1vHlEcnYm251Mi1n3HbbSVOg8B3aOHLUo-SGss6ELI7ozBxy7lmxz-oSHNqkDyexf0bEMFtSiipFBQbt8u8fRPOEMloKaN4sTa0oTKX5T1uMqT4LCaRYwQFRU0CU Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86767ef47c0a4d9bbdda088354b82c02"}]}] Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9153c5ce21b24daa91bacaa9f47b7c57 Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f545f70f-06c4-4746-9b39-dcd1463c262d'} Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:18.092968 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.096917 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:18.096917 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:18.096917 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:18.096917 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:40:18.096917 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:40:18.096917 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. Oct 27 09:40:18.096917 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:18.096917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Returning 404 to user: Instance f545f70f-06c4-4746-9b39-dcd1463c262d could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:40:18.097764 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c5a474e-21cb-47d0-96dd-17dd2e24b0d2 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d" status: 404 len: 111 microversion: 2.1 time: 0.074919 Oct 27 09:40:18.101055 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3161/6255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:18 2022] GET /compute/v2.1/servers/f545f70f-06c4-4746-9b39-dcd1463c262d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:40:23.287377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33fb5b23-84d4-410f-afe0-908f6bcff3c2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] Calling method '.version_select at 0x7f31a8e2ed30>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:23.352365 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33fb5b23-84d4-410f-afe0-908f6bcff3c2 tempest-TestSecurityGroupsBasicOps-569233901 tempest-TestSecurityGroupsBasicOps-569233901-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-246869637" status: 202 len: 0 microversion: 2.1 time: 0.100071 Oct 27 09:40:23.354857 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3095/6256] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:40:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-246869637 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:40:24.032154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:24.033442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:24.044539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:24.045042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:24.049890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:24.052132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:24.057882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:24.058972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:24.121488 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] HTTP exception thrown: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Request method failure captured: Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf HTTP/1.1 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlAyQtLz1ja0iiWYoMgGcUYWb3Z6sa5Q82C7bizruR0bbfIQGpJ1vHlEcnYm251Mi1n3HbbSVOg8B3aOHLUo-SGss6ELI7ozBxy7lmxz-oSHNqkDyexf0bEMFtSiipFBQbt8u8fRPOEMloKaN4sTa0oTKX5T1uMqT4LCaRYwQFRU0CU Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86767ef47c0a4d9bbdda088354b82c02"}]}] Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9153c5ce21b24daa91bacaa9f47b7c57 Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '41895c9e-2d2a-4a6b-8636-4edf5a76aeaf'} Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:40:24.129784 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.133791 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.139815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Returning 404 to user: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:40:24.141076 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83759475-6491-4d25-be9c-a2fe3bd4aca4 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 404 len: 111 microversion: 2.1 time: 0.113332 Oct 27 09:40:24.142298 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3162/6257] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:40:24 2022] DELETE /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:40:24.150792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:24.151788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] [instance: 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:24.164910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:24.166264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:24.170615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:24.171801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:24.172482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:24.173121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:24.206976 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] HTTP exception thrown: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Request method failure captured: Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf HTTP/1.1 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlAyQtLz1ja0iiWYoMgGcUYWb3Z6sa5Q82C7bizruR0bbfIQGpJ1vHlEcnYm251Mi1n3HbbSVOg8B3aOHLUo-SGss6ELI7ozBxy7lmxz-oSHNqkDyexf0bEMFtSiipFBQbt8u8fRPOEMloKaN4sTa0oTKX5T1uMqT4LCaRYwQFRU0CU Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86767ef47c0a4d9bbdda088354b82c02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86767ef47c0a4d9bbdda088354b82c02"}]}] Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 86767ef47c0a4d9bbdda088354b82c02 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260296865 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9153c5ce21b24daa91bacaa9f47b7c57 Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-1260296865-project Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '41895c9e-2d2a-4a6b-8636-4edf5a76aeaf'} Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:24.213011 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.216919 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:24.216919 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:24.216919 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:24.216919 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:40:24.216919 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:40:24.216919 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. Oct 27 09:40:24.216919 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:40:24.219534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] Returning 404 to user: Instance 41895c9e-2d2a-4a6b-8636-4edf5a76aeaf could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:40:24.227795 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53fb5080-7ee5-4f45-85b9-61659c7a1301 tempest-AttachVolumeTestJSON-1260296865 tempest-AttachVolumeTestJSON-1260296865-project] 10.222.0.25 "GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf" status: 404 len: 111 microversion: 2.1 time: 0.081450 Oct 27 09:40:24.229037 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3096/6258] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:24 2022] GET /compute/v2.1/servers/41895c9e-2d2a-4a6b-8636-4edf5a76aeaf => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:40:43.641732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1489152631", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7363916a-c528-4dee-8fd5-3ace286c10be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8f250b0-c481-437b-8054-ee4c9ca61f10"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:43.686949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:43.687965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:43.757336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] validate_networks() for [('c8f250b0-c481-437b-8054-ee4c9ca61f10', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:40:44.933794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:40:44.934517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:40:44.934976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:40:44.935635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:40:44.936111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:40:44.961864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:44.962383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:44.962836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:44.963671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:44.971081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:44.975952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:45.045689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:40:45.069641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for user 9ab30747d0444c32bbc058a522262b62 and project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:40:45.184461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:45.186427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=14 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:45.209171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:40:45.211878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7363916a-c528-4dee-8fd5-3ace286c10be',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:40:45.590572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6348a6c0-1bb4-45ac-9119-d9fe1079ec0a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: .version_select at 0x7f31aa12d430>, body: {"keypair": {"name": "tempest-keypair-1671538543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMETVrCEI26niqH+alOtfGLOsOOnIUZWNYekzNk/FQph0gTD2ASe5Y7wqXMCdnjG3aJjC9qb8spdJC5RJbR+xlAOVNUCVw3Q7HwOgoazqn/ECauOoHecJMokpT4891edBA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:45.666868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-6348a6c0-1bb4-45ac-9119-d9fe1079ec0a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for project a82209ade47d45dfa83c52c24366f737. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:40:45.717894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-6348a6c0-1bb4-45ac-9119-d9fe1079ec0a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for user 485ee99d7fbd4f359824aff38966a868 and project a82209ade47d45dfa83c52c24366f737. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:40:45.738478 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-32fbc568-aad8-4661-b2bd-804c6d87f286 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.101388 Oct 27 09:40:45.746612 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3163/6259] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:40:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:40:45.761917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-367e30c9-ee8a-4ff5-9b47-3cf75d46658f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:45.763489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-367e30c9-ee8a-4ff5-9b47-3cf75d46658f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:45.785834 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6348a6c0-1bb4-45ac-9119-d9fe1079ec0a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.608974 Oct 27 09:40:45.786596 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3097/6260] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:40:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:40:45.979023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-367e30c9-ee8a-4ff5-9b47-3cf75d46658f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:46.006996 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-367e30c9-ee8a-4ff5-9b47-3cf75d46658f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1057 microversion: 2.1 time: 0.248264 Oct 27 09:40:46.025125 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3164/6261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:45 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1057 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:47.064373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-05355732-aaf4-4aec-bcf1-08ac804e2767 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:47.066995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-05355732-aaf4-4aec-bcf1-08ac804e2767 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:47.357924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-05355732-aaf4-4aec-bcf1-08ac804e2767 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:47.385898 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-05355732-aaf4-4aec-bcf1-08ac804e2767 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1057 microversion: 2.1 time: 0.343851 Oct 27 09:40:47.407810 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3098/6262] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:47 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1057 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:48.448280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:48.449633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:48.474060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:48.474945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:48.475789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:48.477124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:48.477970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:48.478772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:48.704400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:48.724924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e8cbd230-4f4e-498a-8c3e-dcd4c6542bf7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1163 microversion: 2.1 time: 0.286699 Oct 27 09:40:48.729772 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3165/6263] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:48 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1163 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:49.612373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1064857960", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0dbda36-c7d7-4d8b-8839-e59a3043c05d"}], "security_groups": [{"name": "tempest-securitygroup--803515789"}], "key_name": "tempest-keypair-1671538543", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:49.757999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:49.759172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:49.773266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:49.774095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:49.774916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:49.776831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:49.777744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:49.778592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:50.027431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] validate_networks() for [('d0dbda36-c7d7-4d8b-8839-e59a3043c05d', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:40:50.811703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:50.859121 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f9662b74-6924-45f2-9a5e-48e8fc97a159 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1215 microversion: 2.1 time: 1.104940 Oct 27 09:40:50.875999 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3166/6264] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:49 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1215 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:51.744903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:40:51.745489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:40:51.746053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:40:51.746569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:40:51.747261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:40:51.772045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:51.772932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:51.773615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:51.774657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:51.775411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:51.776263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:51.815164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for project a82209ade47d45dfa83c52c24366f737. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:40:51.824668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for user 485ee99d7fbd4f359824aff38966a868 and project a82209ade47d45dfa83c52c24366f737. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:40:51.861440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:40:51.867367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:40:51.935447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:51.936597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:51.954210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:51.955663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:51.956734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:51.960719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:51.961855 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7382e85-ac00-4be5-a5ac-9e69927a8a0b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.355705 Oct 27 09:40:51.963038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:51.964262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:51.966304 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3099/6265] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:40:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:40:51.979203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ab7cf9c-6f1a-444d-a09e-9064a6fb91b3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:51.980370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ab7cf9c-6f1a-444d-a09e-9064a6fb91b3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:52.221960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ab7cf9c-6f1a-444d-a09e-9064a6fb91b3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:52.256010 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ab7cf9c-6f1a-444d-a09e-9064a6fb91b3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1242 microversion: 2.1 time: 0.282587 Oct 27 09:40:52.260894 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3100/6266] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:51 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1242 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:52.518013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:52.527428 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1627016a-7970-4b60-84e3-bf1f9db79085 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1215 microversion: 2.1 time: 0.606302 Oct 27 09:40:52.551561 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3167/6267] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:51 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1215 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:53.056145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f3f9a508-43a3-4293-b715-918bdc1081da req-23617b3b-95d0-4762-9845-75c5ef1ca2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c624f468-9848-4110-ba0a-cda3d43b219b", "tag": "226ef3a8-119a-491a-a6d0-4635c6ed7f16"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:53.113341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f3f9a508-43a3-4293-b715-918bdc1081da req-23617b3b-95d0-4762-9845-75c5ef1ca2c2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:53.113535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f3f9a508-43a3-4293-b715-918bdc1081da req-23617b3b-95d0-4762-9845-75c5ef1ca2c2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:53.114138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f3f9a508-43a3-4293-b715-918bdc1081da req-23617b3b-95d0-4762-9845-75c5ef1ca2c2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:53.166693 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f3f9a508-43a3-4293-b715-918bdc1081da req-23617b3b-95d0-4762-9845-75c5ef1ca2c2 service nova] Creating event network-changed:226ef3a8-119a-491a-a6d0-4635c6ed7f16 for instance c624f468-9848-4110-ba0a-cda3d43b219b on n-h2-858383-16 Oct 27 09:40:53.178005 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f3f9a508-43a3-4293-b715-918bdc1081da req-23617b3b-95d0-4762-9845-75c5ef1ca2c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133301 Oct 27 09:40:53.178741 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3101/6268] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:53.316245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:53.349008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:53.365811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:53.367399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:53.368938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:53.370834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:53.372224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:53.373704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:53.564008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:53.574345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:53.599466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:53.600973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:53.603775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:53.613527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:53.615019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:53.616235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:53.650053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:53.707858 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e738b00b-1458-4543-a2a5-b7555a850f4f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1238 microversion: 2.1 time: 0.410856 Oct 27 09:40:53.732073 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3168/6269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:53 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1238 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:54.168504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:54.179116 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d240f5c-1d10-4d46-8907-2d8c27f73c93 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1215 microversion: 2.1 time: 0.626480 Oct 27 09:40:54.185207 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3102/6270] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:53 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1215 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:54.765028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:54.766163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:54.800936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:54.802571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:54.803389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:54.813162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:54.814079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:54.814889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:55.011869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:55.087651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:55.097489 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc7fe775-b143-4983-b29b-9437a676ec11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1300 microversion: 2.1 time: 0.339741 Oct 27 09:40:55.099329 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3169/6271] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:54 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1300 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:55.212928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:55.213806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:55.239443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:55.240489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:55.241518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:55.242962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:55.244344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:55.248345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:55.859333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:55.880294 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff350bad-f74d-43f0-b476-faef862dbb91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1215 microversion: 2.1 time: 0.673283 Oct 27 09:40:55.881459 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3103/6272] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:55 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1215 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:56.149913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:56.158695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:56.165096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:56.192440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:56.193349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:56.194297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:56.195474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:56.196635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:56.197455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:56.339492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:56.353211 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e17ba13-6894-42b1-a0bb-83e0a01a4b80 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1300 microversion: 2.1 time: 0.213333 Oct 27 09:40:56.354515 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3170/6273] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:56 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1300 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:56.932459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:56.933239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:56.946369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:56.946869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:56.953038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:56.955495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:56.956857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:56.958966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:57.318893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:57.332866 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a06f636-ff5d-46d7-927e-7ddf630db701 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1215 microversion: 2.1 time: 0.410484 Oct 27 09:40:57.349509 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3104/6274] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:56 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1215 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:57.395688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:57.400110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:57.419355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:57.420863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:57.422531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:57.424260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:57.425425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:57.429872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:57.699527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:57.709441 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4120ed77-2e0f-4a96-8507-efd86a9b190d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1367 microversion: 2.1 time: 0.323008 Oct 27 09:40:57.710407 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3171/6275] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:57 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:58.063156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-de64870a-8aec-4909-ad9e-9e6cf848ba87 req-f3739788-475a-491e-9e04-d93187f24e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af38803d-9721-430f-82f0-b4d1d5ac1bda", "tag": "0ba8a8fb-0ceb-4ac4-bb71-e336f8cc31b7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:58.080197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-de64870a-8aec-4909-ad9e-9e6cf848ba87 req-f3739788-475a-491e-9e04-d93187f24e2c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:58.081992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-de64870a-8aec-4909-ad9e-9e6cf848ba87 req-f3739788-475a-491e-9e04-d93187f24e2c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:58.083755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-de64870a-8aec-4909-ad9e-9e6cf848ba87 req-f3739788-475a-491e-9e04-d93187f24e2c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:58.101264 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-de64870a-8aec-4909-ad9e-9e6cf848ba87 req-f3739788-475a-491e-9e04-d93187f24e2c service nova] Creating event network-changed:0ba8a8fb-0ceb-4ac4-bb71-e336f8cc31b7 for instance af38803d-9721-430f-82f0-b4d1d5ac1bda on n-h1-858383-16 Oct 27 09:40:58.109084 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-de64870a-8aec-4909-ad9e-9e6cf848ba87 req-f3739788-475a-491e-9e04-d93187f24e2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050281 Oct 27 09:40:58.110539 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3105/6276] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:58.363289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:58.364335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:58.373940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:58.375641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:58.376666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:58.377544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:58.378132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:58.381780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:58.734824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:58.736186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:58.743530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:58.744344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:58.744994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:58.745931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:58.746391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:58.747620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:58.987468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:59.002622 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3afee44f-2fab-43ec-88cc-5747d5fb108c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1203 microversion: 2.1 time: 0.645087 Oct 27 09:40:59.003884 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3172/6277] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:58 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1203 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:59.080421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:59.096381 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-31a1c81e-9278-47e6-88d0-68c1a27b70ab tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1367 microversion: 2.1 time: 0.365556 Oct 27 09:40:59.111728 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3106/6278] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:58 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:00.038727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:00.039985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:00.052731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:00.053239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:00.053700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:00.054436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:00.054901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:00.055631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:00.137319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:00.138753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:00.154636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:00.155483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:00.156605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:00.158215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:00.159339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:00.160263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:00.309582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:00.320401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e50429f-7c7c-4e29-be29-60a9bf67a4e1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1203 microversion: 2.1 time: 0.287845 Oct 27 09:41:00.321520 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3173/6279] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:00 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1203 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:00.410872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:00.422848 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f18ebad-84e8-4de7-9210-0f1d8b917710 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1367 microversion: 2.1 time: 0.294367 Oct 27 09:41:00.423940 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3107/6280] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:00 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:01.359063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:01.359913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:01.372121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.373425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.373959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.374731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.375630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.376313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.447509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:01.448586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:01.459779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.460870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.461974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.463282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.464169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.464952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.767018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:01.782767 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ab4e48b-f01f-45a5-a8e6-803cf9559748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1203 microversion: 2.1 time: 0.428194 Oct 27 09:41:01.790794 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3174/6281] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:01 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1203 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:01.807892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:01.808533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:01.822129 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ddc5c5c3-67a6-4edf-b511-5f2df603628d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1367 microversion: 2.1 time: 0.378506 Oct 27 09:41:01.823226 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3108/6282] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:01 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:02.822152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:02.823304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:02.837037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:02.838236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:02.839377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:02.842236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:02.843466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:02.844418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:02.861240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:02.862195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:02.864973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=14 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:02.873829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:02.875529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:02.876419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:02.877441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:02.878097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:02.878603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:03.227742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:03.243320 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-231fda03-5b3a-4ce7-ae5e-94091d9843f9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1203 microversion: 2.1 time: 0.429185 Oct 27 09:41:03.246465 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3175/6283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:02 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1203 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:03.270659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:03.286847 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1497bf49-0ba4-4d48-bbe1-3dca3ba1db27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1367 microversion: 2.1 time: 0.429667 Oct 27 09:41:03.287993 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3109/6284] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:02 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:04.281579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:04.282428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:04.289650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:04.290135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:04.290581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:04.291374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:04.291871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:04.292295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:04.327693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:04.328423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:04.339332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:04.341036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:04.341842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:04.343176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:04.344368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:04.345473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:04.522198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:04.533566 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4d0d4f7d-39c5-443f-9fc1-18592988fd0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1203 microversion: 2.1 time: 0.256195 Oct 27 09:41:04.534462 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3176/6285] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:04 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1203 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:04.559497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:04.568937 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf07ac19-3187-41c4-8b47-663de3e7825c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1367 microversion: 2.1 time: 0.247707 Oct 27 09:41:04.569865 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3110/6286] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:04 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:05.238533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c6f68505-837d-4159-bc33-0d936ef5bc30 req-827d413b-447d-4a6f-a84b-735228351bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af38803d-9721-430f-82f0-b4d1d5ac1bda", "name": "network-vif-plugged", "status": "completed", "tag": "0ba8a8fb-0ceb-4ac4-bb71-e336f8cc31b7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:05.253436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c6f68505-837d-4159-bc33-0d936ef5bc30 req-827d413b-447d-4a6f-a84b-735228351bb7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:05.254238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c6f68505-837d-4159-bc33-0d936ef5bc30 req-827d413b-447d-4a6f-a84b-735228351bb7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:05.255330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c6f68505-837d-4159-bc33-0d936ef5bc30 req-827d413b-447d-4a6f-a84b-735228351bb7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:05.271407 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c6f68505-837d-4159-bc33-0d936ef5bc30 req-827d413b-447d-4a6f-a84b-735228351bb7 service nova] Creating event network-vif-plugged:0ba8a8fb-0ceb-4ac4-bb71-e336f8cc31b7 for instance af38803d-9721-430f-82f0-b4d1d5ac1bda on n-h1-858383-16 Oct 27 09:41:05.278619 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c6f68505-837d-4159-bc33-0d936ef5bc30 req-827d413b-447d-4a6f-a84b-735228351bb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046414 Oct 27 09:41:05.280143 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3177/6287] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:05.560748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:05.562786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:05.599144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:05.601318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:05.601851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:05.602672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:05.603448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:05.604973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:05.605541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:05.607125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:05.617228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:05.618570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:05.619688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:05.621540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:05.622607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:05.623844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:05.904015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:05.917408 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2586cfbf-c4fe-46f5-9bfd-ad7d985b3a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1367 microversion: 2.1 time: 0.325732 Oct 27 09:41:05.919373 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3178/6288] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:05 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:05.921134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:05.931005 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f74c5c2c-9233-4256-9d31-9002eb9f1e13 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1203 microversion: 2.1 time: 0.375643 Oct 27 09:41:05.931829 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3111/6289] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:05 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1203 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:06.945447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:06.946531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:06.957437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:06.958079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:06.958669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:06.959702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:06.960473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:06.960646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:06.961136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:06.961422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:06.975104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:06.976243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:06.977237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:06.978719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:06.979767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:06.981299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:07.353675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:07.363528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:07.370980 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-990fd4da-ed2d-41a5-9578-e8ba95b772d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1557 microversion: 2.1 time: 0.431793 Oct 27 09:41:07.377312 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e0a4e7c-dcfe-49d7-9088-4649414c4591 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1203 microversion: 2.1 time: 0.425912 Oct 27 09:41:07.378185 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3112/6290] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:06 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1203 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:07.396454 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3179/6291] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:06 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1557 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:07.401598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48b4ad97-2d42-41e4-b8b6-a17f7d9df00a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:07.402389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48b4ad97-2d42-41e4-b8b6-a17f7d9df00a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:07.410919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48b4ad97-2d42-41e4-b8b6-a17f7d9df00a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:07.411650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48b4ad97-2d42-41e4-b8b6-a17f7d9df00a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:07.412266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48b4ad97-2d42-41e4-b8b6-a17f7d9df00a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:07.413165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48b4ad97-2d42-41e4-b8b6-a17f7d9df00a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:07.413794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48b4ad97-2d42-41e4-b8b6-a17f7d9df00a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:07.414432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48b4ad97-2d42-41e4-b8b6-a17f7d9df00a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:07.451206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1ba73664-cbe9-417b-840d-a9cc1d81c331 req-ad702957-c257-4eaf-ab2b-7a9ab94b1d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c624f468-9848-4110-ba0a-cda3d43b219b", "name": "network-vif-plugged", "status": "completed", "tag": "226ef3a8-119a-491a-a6d0-4635c6ed7f16"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:07.463714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1ba73664-cbe9-417b-840d-a9cc1d81c331 req-ad702957-c257-4eaf-ab2b-7a9ab94b1d3e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:07.464355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1ba73664-cbe9-417b-840d-a9cc1d81c331 req-ad702957-c257-4eaf-ab2b-7a9ab94b1d3e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:07.464870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1ba73664-cbe9-417b-840d-a9cc1d81c331 req-ad702957-c257-4eaf-ab2b-7a9ab94b1d3e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:07.478050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1ba73664-cbe9-417b-840d-a9cc1d81c331 req-ad702957-c257-4eaf-ab2b-7a9ab94b1d3e service nova] Creating event network-vif-plugged:226ef3a8-119a-491a-a6d0-4635c6ed7f16 for instance c624f468-9848-4110-ba0a-cda3d43b219b on n-h2-858383-16 Oct 27 09:41:07.484646 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1ba73664-cbe9-417b-840d-a9cc1d81c331 req-ad702957-c257-4eaf-ab2b-7a9ab94b1d3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041098 Oct 27 09:41:07.485672 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3180/6292] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:07.516076 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48b4ad97-2d42-41e4-b8b6-a17f7d9df00a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123387 Oct 27 09:41:07.516691 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3113/6293] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:41:07 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:08.424636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:08.429298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:08.446726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:08.448009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:08.448646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:08.450567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:08.451210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:08.451891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:08.655757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:08.665662 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da41bc73-593a-4859-a034-7f4b1667bc85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1203 microversion: 2.1 time: 0.258349 Oct 27 09:41:08.666430 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3181/6294] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:08 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1203 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:09.219076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-043c3be2-ea6a-49de-a9c5-a9b574236f94 req-6ff187a2-0d83-476d-aaaa-1302ab1d7921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af38803d-9721-430f-82f0-b4d1d5ac1bda", "tag": "0ba8a8fb-0ceb-4ac4-bb71-e336f8cc31b7"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:09.230754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-043c3be2-ea6a-49de-a9c5-a9b574236f94 req-6ff187a2-0d83-476d-aaaa-1302ab1d7921 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:09.231262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-043c3be2-ea6a-49de-a9c5-a9b574236f94 req-6ff187a2-0d83-476d-aaaa-1302ab1d7921 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:09.231843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-043c3be2-ea6a-49de-a9c5-a9b574236f94 req-6ff187a2-0d83-476d-aaaa-1302ab1d7921 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:09.250179 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-043c3be2-ea6a-49de-a9c5-a9b574236f94 req-6ff187a2-0d83-476d-aaaa-1302ab1d7921 service nova] Creating event network-changed:0ba8a8fb-0ceb-4ac4-bb71-e336f8cc31b7 for instance af38803d-9721-430f-82f0-b4d1d5ac1bda on n-h1-858383-16 Oct 27 09:41:09.255642 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-043c3be2-ea6a-49de-a9c5-a9b574236f94 req-6ff187a2-0d83-476d-aaaa-1302ab1d7921 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041398 Oct 27 09:41:09.256590 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3114/6295] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:09.697910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:09.699384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:09.708026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:09.708868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:09.709531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:09.710536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:09.711322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:09.712526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:09.741421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:10.056282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:10.078856 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c68a4d6-0943-48d7-b777-41bf850ad90d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1391 microversion: 2.1 time: 0.384460 Oct 27 09:41:10.081193 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3182/6296] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:09 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1391 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:10.113624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:10.114935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:10.126647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.127496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.128607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.130406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.131617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.132746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.357711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:10.370294 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4769fb5-a94f-49a7-8bf1-29c9163a040e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1391 microversion: 2.1 time: 0.268076 Oct 27 09:41:10.371618 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3115/6297] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:10 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1391 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:10.394124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:10.394874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:10.401037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.401533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.402003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.417905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.418689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.419156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.641244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:10.650002 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb54638a-7bf6-4a7e-bd97-53dbe554ab76 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1391 microversion: 2.1 time: 0.259811 Oct 27 09:41:10.650605 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3183/6298] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:10 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:10.692638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:10.693259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:10.704648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.705451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.706228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.707648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.708367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.709140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.758617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:41:10.864642 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e589ee1a-bfaf-400e-845b-410ddb58d748 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 204 len: 0 microversion: 2.1 time: 0.179262 Oct 27 09:41:10.865883 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3116/6299] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:41:10 2022] DELETE /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:41:10.875995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:10.876854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:10.885637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.886234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.886770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.887589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.888126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.888778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:11.062790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:11.073313 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ba6f565-c743-44bb-b9df-0e2df758792c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1397 microversion: 2.1 time: 0.201237 Oct 27 09:41:11.075222 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3184/6300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:10 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1397 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:12.111355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:12.112628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:12.126088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.126985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.127826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.129132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.130210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.131013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.309702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:12.313411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:12.319166 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f19c885c-d73f-4e92-96ac-b29de5e6826b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1397 microversion: 2.1 time: 0.214876 Oct 27 09:41:12.319802 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3117/6301] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:12 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1397 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:13.218699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-596d4069-b91a-4b05-83b6-f14ae87392f3 req-383245d8-e4ad-4aa5-a4e2-3fab8525ff71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c624f468-9848-4110-ba0a-cda3d43b219b", "name": "network-vif-deleted", "tag": "226ef3a8-119a-491a-a6d0-4635c6ed7f16"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:13.238077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-596d4069-b91a-4b05-83b6-f14ae87392f3 req-383245d8-e4ad-4aa5-a4e2-3fab8525ff71 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:13.238951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-596d4069-b91a-4b05-83b6-f14ae87392f3 req-383245d8-e4ad-4aa5-a4e2-3fab8525ff71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:13.239398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-596d4069-b91a-4b05-83b6-f14ae87392f3 req-383245d8-e4ad-4aa5-a4e2-3fab8525ff71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:13.254213 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-596d4069-b91a-4b05-83b6-f14ae87392f3 req-383245d8-e4ad-4aa5-a4e2-3fab8525ff71 service nova] Creating event network-vif-deleted:226ef3a8-119a-491a-a6d0-4635c6ed7f16 for instance c624f468-9848-4110-ba0a-cda3d43b219b on n-h2-858383-16 Oct 27 09:41:13.262826 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-596d4069-b91a-4b05-83b6-f14ae87392f3 req-383245d8-e4ad-4aa5-a4e2-3fab8525ff71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047117 Oct 27 09:41:13.270529 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3185/6302] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:13.346259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:13.347006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:13.356603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:13.357189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:13.357650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:13.358630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:13.359107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:13.359683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:13.476001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:13.485582 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e354014-7946-4642-8913-5a83292ef833 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1188 microversion: 2.1 time: 0.143677 Oct 27 09:41:13.486678 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3118/6303] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:13 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:14.536727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:14.538597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:14.548550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:14.551261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:14.553123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:14.553914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:14.555077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:14.556784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:14.557584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:14.653738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:14.668447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fb94bd78-bd5b-431d-be11-cb523aadeae7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1188 microversion: 2.1 time: 0.151217 Oct 27 09:41:14.669698 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3186/6304] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:14 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1188 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:15.717160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:15.718477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:15.730920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:15.734251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:15.735005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:15.736183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:15.737472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:15.738361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:15.739171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:15.825348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:15.843854 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9d113033-ddc5-41c1-b26b-8b5d46089ef9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1188 microversion: 2.1 time: 0.134831 Oct 27 09:41:15.845979 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3119/6305] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:15 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1188 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:16.892033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:16.892665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:16.901460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:16.901971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:16.903041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:16.903919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:16.904299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:16.904741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:16.981831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:16.991537 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4db38096-501d-42be-beba-d594ca9e2794 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1188 microversion: 2.1 time: 0.106255 Oct 27 09:41:16.992179 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3187/6306] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:16 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1188 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:18.020710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:18.022909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:18.036876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:18.038421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:18.039368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:18.041356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:18.043644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:18.044779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:18.151153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:18.162304 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2b748b0-27c4-49b8-9620-883522fafc9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 200 len: 1188 microversion: 2.1 time: 0.148615 Oct 27 09:41:18.162902 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3120/6307] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:18 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 1188 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:19.191342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:19.193578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: c624f468-9848-4110-ba0a-cda3d43b219b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:19.203820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:19.204443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:19.204929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:19.205862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:19.206704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:19.207301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:19.225758 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance c624f468-9848-4110-ba0a-cda3d43b219b could not be found. Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b HTTP/1.1 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance c624f468-9848-4110-ba0a-cda3d43b219b could not be found. Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'c624f468-9848-4110-ba0a-cda3d43b219b'} Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c624f468-9848-4110-ba0a-cda3d43b219b could not be found. Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c624f468-9848-4110-ba0a-cda3d43b219b could not be found. Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:19.227587 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:41:19.232887 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:19.232887 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:19.232887 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:19.232887 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:41:19.232887 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:41:19.232887 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c624f468-9848-4110-ba0a-cda3d43b219b could not be found. Oct 27 09:41:19.232887 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:41:19.235689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance c624f468-9848-4110-ba0a-cda3d43b219b could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:41:19.236852 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-20b82901-e3ea-425b-8111-8504411498d0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b" status: 404 len: 111 microversion: 2.1 time: 0.052322 Oct 27 09:41:19.237663 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3188/6308] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:19 2022] GET /compute/v2.1/servers/c624f468-9848-4110-ba0a-cda3d43b219b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:41:24.620808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1d9d7f43-16a9-47ca-a12f-b0defbd5c3fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'create', calling method: .version_select at 0x7f31a8f08af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-143302509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRrtjudlivYDTPVuSLkWEcXy877MXKgaRUlLk6wNKSEAaXIrsi6xtUIvVxYBRGJYLzCro6k1GOLsrlxozqw9VVhNjRYfpEkYuXsjSGvlOCOVtbVgKR1PteowRpKxYniIw=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:24.642360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1d9d7f43-16a9-47ca-a12f-b0defbd5c3fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for project f7fdcfbb223c44e693f100b3717522cf. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:41:24.648610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1d9d7f43-16a9-47ca-a12f-b0defbd5c3fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for user 0d83fee6e4854240b13a10c262453b32 and project f7fdcfbb223c44e693f100b3717522cf. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:41:24.681368 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1d9d7f43-16a9-47ca-a12f-b0defbd5c3fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.357476 Oct 27 09:41:24.682239 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3121/6309] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:41:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:27.091798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-514849905", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "49f68166-443d-4691-acdb-eccc7c882a60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8f250b0-c481-437b-8054-ee4c9ca61f10"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:27.195793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] validate_networks() for [('c8f250b0-c481-437b-8054-ee4c9ca61f10', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:41:27.711693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:41:27.712572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:41:27.713483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:41:27.714939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:41:27.715552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:41:27.727301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:27.727855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:27.728313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:27.729124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:27.729650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:27.730294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:27.751454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:41:27.763834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for user 9ab30747d0444c32bbc058a522262b62 and project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:41:27.854048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:41:27.856262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49f68166-443d-4691-acdb-eccc7c882a60',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:41:28.042338 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25e5fc7f-0b0b-4499-b104-82f4419fe258 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955674 Oct 27 09:41:28.043521 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3189/6310] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:41:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:41:28.068792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f6c670ef-c4c6-4b0d-b299-71c5a1047d90 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:28.072859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f6c670ef-c4c6-4b0d-b299-71c5a1047d90 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:28.156970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=18 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:28.177991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6c670ef-c4c6-4b0d-b299-71c5a1047d90 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:28.191598 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f6c670ef-c4c6-4b0d-b299-71c5a1047d90 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1056 microversion: 2.1 time: 0.134583 Oct 27 09:41:28.192972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3122/6311] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:28 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1056 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:29.237169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:29.239743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:29.254124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.255155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.256112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.257622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.258610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.259762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.424443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:29.460381 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a71dca69-6a86-440b-b9b6-5e47e6993e71 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1154 microversion: 2.1 time: 0.233942 Oct 27 09:41:29.476388 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3190/6312] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:29 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1154 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:30.508411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:30.513582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:30.575272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.577671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.582269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.584544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.590539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.592583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.815559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:30.827069 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f68fe6c-45de-40eb-bbb8-cdcf352aa5f4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1172 microversion: 2.1 time: 0.330616 Oct 27 09:41:30.829151 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3123/6313] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:30 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1172 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:31.878237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:31.880912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:31.904856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.907598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.909543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:31.912033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.914495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.915975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:32.387069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:32.402932 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb4b3261-3d1d-43c3-9ec1-006425e3d217 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1214 microversion: 2.1 time: 0.531321 Oct 27 09:41:32.404324 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3191/6314] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:31 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1214 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:33.458200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:33.459698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:33.487445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:33.488602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:33.489554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:33.491272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:33.493087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:33.494615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:34.478073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:34.528462 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2190b451-9641-42a2-9631-5f5d27186a11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1214 microversion: 2.1 time: 1.096451 Oct 27 09:41:34.534287 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3124/6315] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:33 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1214 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:35.223912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a434e7a8-79e4-4a97-a684-8bbad2bc0809 req-3a525f26-408b-4357-a9d1-e088c5327e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4845dd-46b3-417b-b72e-43181a954946", "tag": "76a3b8b3-6c8e-47ad-91a2-f309d5ade731"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:35.244014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a434e7a8-79e4-4a97-a684-8bbad2bc0809 req-3a525f26-408b-4357-a9d1-e088c5327e3c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.246350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a434e7a8-79e4-4a97-a684-8bbad2bc0809 req-3a525f26-408b-4357-a9d1-e088c5327e3c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.251011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a434e7a8-79e4-4a97-a684-8bbad2bc0809 req-3a525f26-408b-4357-a9d1-e088c5327e3c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.275162 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a434e7a8-79e4-4a97-a684-8bbad2bc0809 req-3a525f26-408b-4357-a9d1-e088c5327e3c service nova] Creating event network-changed:76a3b8b3-6c8e-47ad-91a2-f309d5ade731 for instance 1b4845dd-46b3-417b-b72e-43181a954946 on n-h2-858383-16 Oct 27 09:41:35.287825 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a434e7a8-79e4-4a97-a684-8bbad2bc0809 req-3a525f26-408b-4357-a9d1-e088c5327e3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068703 Oct 27 09:41:35.289736 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3192/6316] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:35.571801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:35.573894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:35.616948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1200673607", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "2678afb6-497a-4794-b234-0b6b605293aa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-143302509", "security_groups": [{"name": "tempest-secgroup-smoke-1399422794"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:35.620882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.627682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.640067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.641431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.642165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.642758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.029469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] validate_networks() for [('2678afb6-497a-4794-b234-0b6b605293aa', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:41:36.107303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:36.122428 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a2171e5b-7815-41b0-b697-7c92b305640a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1214 microversion: 2.1 time: 0.558967 Oct 27 09:41:36.123920 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3125/6317] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:35 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1214 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:36.793345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:41:36.794425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:41:36.794917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:41:36.795513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:41:36.796006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:41:36.818012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.818921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.819860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.821159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.821926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.822614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.852673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for project f7fdcfbb223c44e693f100b3717522cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:41:36.861854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for user 0d83fee6e4854240b13a10c262453b32 and project f7fdcfbb223c44e693f100b3717522cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:41:36.886922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:41:36.890114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:41:36.955993 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5a55b395-14ed-40f1-a1d6-493ec723b859 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.347311 Oct 27 09:41:36.957261 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3193/6318] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:41:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:41:36.969841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e3d3f2d-15b7-4be8-a88e-7eda9f803fa8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:36.971602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e3d3f2d-15b7-4be8-a88e-7eda9f803fa8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:37.095242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4e3d3f2d-15b7-4be8-a88e-7eda9f803fa8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:37.110389 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e3d3f2d-15b7-4be8-a88e-7eda9f803fa8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1266 microversion: 2.1 time: 0.144664 Oct 27 09:41:37.111707 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3126/6319] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:36 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:37.148754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:37.149865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:37.158396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:37.159055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:37.159638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:37.160471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:37.161037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:37.161588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:37.369613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:37.379097 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fdf6f7f5-074d-4ccb-9db7-96278cd1171b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1214 microversion: 2.1 time: 0.235418 Oct 27 09:41:37.379754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3194/6320] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:37 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:38.138496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:38.139583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:38.154295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:38.155242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:38.155892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:38.156725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:38.157419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:38.158427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:38.275993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:38.285861 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f317817-90ae-4153-9772-1e472b9f54b3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1318 microversion: 2.1 time: 0.153203 Oct 27 09:41:38.286759 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3127/6321] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:38 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:38.407807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:38.408909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:38.419185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:38.420020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:38.420603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:38.421472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:38.422062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:38.422612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:38.752496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:38.764051 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9d818f0d-255b-4a7b-beb8-7d7207341062 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.363286 Oct 27 09:41:38.776895 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3195/6322] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:38 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:39.317773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:39.318460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:39.326770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:39.327593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:39.328278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:39.329036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:39.329511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:39.329954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:39.417184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:39.427278 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb2ea365-413b-4792-a91b-53e6bf7719b5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1324 microversion: 2.1 time: 0.113675 Oct 27 09:41:39.428075 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3128/6323] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:39 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:39.797760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:39.805995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:39.829356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:39.833003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:39.837631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:39.844700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:39.847955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:39.850084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:39.862928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=61 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:40.101960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:40.111546 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-327d9269-f3bf-40be-95d7-2e7cbb9f9a38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.326238 Oct 27 09:41:40.112448 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3196/6324] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:39 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:40.455146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:40.455953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:40.463133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:40.464143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:40.464390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:40.465213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:40.465620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:40.466104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:40.641919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7326c9ef-fe5b-40de-8bad-43f6733cb626 req-abb765b5-9bcf-4e9c-87a6-bb13a181907f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7130735-fb19-49f2-bdf1-8663e83fdd4a", "tag": "57f84ee8-9ac4-4791-84fd-24e83244d60b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:40.673348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7326c9ef-fe5b-40de-8bad-43f6733cb626 req-abb765b5-9bcf-4e9c-87a6-bb13a181907f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:40.674202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7326c9ef-fe5b-40de-8bad-43f6733cb626 req-abb765b5-9bcf-4e9c-87a6-bb13a181907f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:40.675317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7326c9ef-fe5b-40de-8bad-43f6733cb626 req-abb765b5-9bcf-4e9c-87a6-bb13a181907f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:40.690814 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7326c9ef-fe5b-40de-8bad-43f6733cb626 req-abb765b5-9bcf-4e9c-87a6-bb13a181907f service nova] Creating event network-changed:57f84ee8-9ac4-4791-84fd-24e83244d60b for instance c7130735-fb19-49f2-bdf1-8663e83fdd4a on n-h1-858383-16 Oct 27 09:41:40.696945 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7326c9ef-fe5b-40de-8bad-43f6733cb626 req-abb765b5-9bcf-4e9c-87a6-bb13a181907f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069112 Oct 27 09:41:40.697587 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3197/6325] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:41.026512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:41.036838 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c2f41f5b-5fa7-44d5-94c7-16322329cb38 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1392 microversion: 2.1 time: 0.586131 Oct 27 09:41:41.038443 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3129/6326] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:40 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1392 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:41.143484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:41.144684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:41.155879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:41.156739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:41.157514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:41.158782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:41.159692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:41.160488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:41.551847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:41.566082 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-190d916e-4ac0-49ee-8904-57905e7d07b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.432156 Oct 27 09:41:41.567082 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3198/6327] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:41 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:42.080858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:42.081576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:42.089918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:42.090421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:42.090860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:42.091601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:42.092061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:42.092484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:42.253712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:42.268732 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b134e138-20c5-4cbb-827e-2d1de35e7bba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1392 microversion: 2.1 time: 0.193294 Oct 27 09:41:42.269284 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3130/6328] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:42 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:42.593835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:42.594496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:42.602406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:42.602904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:42.603352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:42.604650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:42.605124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:42.605561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:42.773630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:42.784585 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-35794ba1-60c2-4bb4-bffa-6dd001e53838 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.197785 Oct 27 09:41:42.785198 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3199/6329] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:42 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:43.305692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:43.306330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:43.313921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:43.314394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:43.314835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:43.315542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:43.316029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:43.316453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:43.487040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:43.496043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ede744fa-d55a-4ffb-92a5-4ab448fc5ca5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1392 microversion: 2.1 time: 0.194426 Oct 27 09:41:43.496794 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3131/6330] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:43 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:43.812555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:43.813576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:43.821413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:43.822026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:43.822909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:43.823927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:43.824511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:43.825044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:44.121340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:44.132106 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-50cf73d4-26b3-4234-9b84-adbea28ca5fe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.326543 Oct 27 09:41:44.132909 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3200/6331] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:43 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:44.527254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:44.528545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:44.542129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:44.543373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:44.544164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:44.545451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:44.546291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:44.547014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:44.758324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:44.773343 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9393385-76ac-494b-88f7-17de0cb6fe84 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1392 microversion: 2.1 time: 0.253194 Oct 27 09:41:44.774378 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3132/6332] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:44 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1392 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:45.172185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:45.173623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:45.177353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:45.186840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:45.188009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:45.188880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:45.189972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:45.190907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:45.191633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:45.457391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:45.473502 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3003c571-45d8-4427-9a41-01b400d7b59f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.307377 Oct 27 09:41:45.475698 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3201/6333] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:45 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:45.801441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:45.802117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:45.805245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:45.813144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:45.813645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:45.814086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:45.814799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:45.815259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:45.815710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:46.003921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:46.018568 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-370271c4-6a3b-460b-9a6f-6106e6fe4442 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1392 microversion: 2.1 time: 0.223490 Oct 27 09:41:46.019712 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3133/6334] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:45 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1392 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:46.510634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:46.511640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:46.519453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:46.520004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:46.520456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:46.521196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:46.521809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:46.522254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:46.677311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:46.692870 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5828aa57-3194-481b-a9f8-37c3bf681132 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.186918 Oct 27 09:41:46.693901 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3202/6335] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:46 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:47.053410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:47.055110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:47.067917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.068787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.069580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.071071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.071965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.073437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.112025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:47.234129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d435688e-d5b9-4848-abc1-9c8dd49b6275 req-964656f2-90ff-4449-9eb1-5af6a98b9f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7130735-fb19-49f2-bdf1-8663e83fdd4a", "name": "network-vif-plugged", "status": "completed", "tag": "57f84ee8-9ac4-4791-84fd-24e83244d60b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:47.243032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:47.244453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:47.257602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d435688e-d5b9-4848-abc1-9c8dd49b6275 req-964656f2-90ff-4449-9eb1-5af6a98b9f25 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.258315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d435688e-d5b9-4848-abc1-9c8dd49b6275 req-964656f2-90ff-4449-9eb1-5af6a98b9f25 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.258935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d435688e-d5b9-4848-abc1-9c8dd49b6275 req-964656f2-90ff-4449-9eb1-5af6a98b9f25 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.279621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d435688e-d5b9-4848-abc1-9c8dd49b6275 req-964656f2-90ff-4449-9eb1-5af6a98b9f25 service nova] Creating event network-vif-plugged:57f84ee8-9ac4-4791-84fd-24e83244d60b for instance c7130735-fb19-49f2-bdf1-8663e83fdd4a on n-h1-858383-16 Oct 27 09:41:47.289842 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d435688e-d5b9-4848-abc1-9c8dd49b6275 req-964656f2-90ff-4449-9eb1-5af6a98b9f25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060496 Oct 27 09:41:47.291998 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3203/6336] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:47.353027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:47.371872 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd929a3a-e882-4540-8b02-78350f8ab9f9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1392 microversion: 2.1 time: 0.330225 Oct 27 09:41:47.384346 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3134/6337] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:47 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1392 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:47.734289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:47.735430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:47.743545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.744225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.744870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.745656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.746155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.746631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.907689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:47.916049 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4d4dae77-27f4-429e-a40d-3640c8daa2e3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.188199 Oct 27 09:41:47.916689 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3204/6338] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:47 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:48.397453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:48.398378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:48.405856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:48.406361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:48.407076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:48.408010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:48.408539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:48.409055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:48.577995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:48.590198 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b449ecc-8e38-4fe2-9f73-1942b6455961 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1392 microversion: 2.1 time: 0.196526 Oct 27 09:41:48.590824 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3135/6339] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:48 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:48.958734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:48.959862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:48.972233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:48.973079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:48.973881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:48.975178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:48.976017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:48.976832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:49.138411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:49.148342 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f600b352-db67-4aac-929e-6cbb02b51f78 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.197098 Oct 27 09:41:49.149038 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3205/6340] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:48 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:49.314735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-eb1c8c77-e122-41c0-9ff9-7ed0ce87783c req-33a60ab5-3ddc-4c43-9e1d-9fa4453e34b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4845dd-46b3-417b-b72e-43181a954946", "name": "network-vif-plugged", "status": "completed", "tag": "76a3b8b3-6c8e-47ad-91a2-f309d5ade731"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:49.325927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-eb1c8c77-e122-41c0-9ff9-7ed0ce87783c req-33a60ab5-3ddc-4c43-9e1d-9fa4453e34b5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:49.326406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-eb1c8c77-e122-41c0-9ff9-7ed0ce87783c req-33a60ab5-3ddc-4c43-9e1d-9fa4453e34b5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:49.326845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-eb1c8c77-e122-41c0-9ff9-7ed0ce87783c req-33a60ab5-3ddc-4c43-9e1d-9fa4453e34b5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:49.341324 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-eb1c8c77-e122-41c0-9ff9-7ed0ce87783c req-33a60ab5-3ddc-4c43-9e1d-9fa4453e34b5 service nova] Creating event network-vif-plugged:76a3b8b3-6c8e-47ad-91a2-f309d5ade731 for instance 1b4845dd-46b3-417b-b72e-43181a954946 on n-h2-858383-16 Oct 27 09:41:49.348974 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-eb1c8c77-e122-41c0-9ff9-7ed0ce87783c req-33a60ab5-3ddc-4c43-9e1d-9fa4453e34b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037895 Oct 27 09:41:49.349605 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3136/6341] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:49.618290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:49.618996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:49.626080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:49.626585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:49.627038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:49.627855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:49.628328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:49.628772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:49.792975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:49.801435 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d3b65eb6-51c4-4eb2-aa96-61655b935a3a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1564 microversion: 2.1 time: 0.187557 Oct 27 09:41:49.802304 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3206/6342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:49 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1564 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:49.828460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:49.829185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:49.835999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:49.836520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:49.836969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:49.837720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:49.838845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:49.839279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:50.003126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:50.012451 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ddc1ea0-ffe9-46f3-acbc-3c9499d795bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1564 microversion: 2.1 time: 0.189530 Oct 27 09:41:50.013011 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3137/6343] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:49 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:50.176246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:50.177505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:50.187227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:50.188062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:50.188653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:50.189578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:50.190387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:50.191135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:50.459649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:50.470274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83a450bc-81bf-4aa2-b9a5-7e7835ff35dd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1202 microversion: 2.1 time: 0.299154 Oct 27 09:41:50.471093 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3207/6344] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:50 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1202 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:51.499064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:51.501269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:51.513286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:51.514386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:51.515073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:51.516258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:51.517060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:51.517769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:51.917758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:51.927329 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc954218-fb23-496f-8d5c-5b05c4feb53b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1389 microversion: 2.1 time: 0.436056 Oct 27 09:41:51.928033 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3138/6345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:51 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1389 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:51.955692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:51.956956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:51.966016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:51.966517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:51.966999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:51.967878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:51.968390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:51.968817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:52.771440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:52.781202 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-023ea496-86a7-4b3d-aa01-d9a75a45e1a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1389 microversion: 2.1 time: 0.830937 Oct 27 09:41:52.781816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3208/6346] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:51 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1389 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:52.806744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:52.807712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:52.815123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:52.816794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:52.816794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:52.818111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:52.818603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:52.819039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.106677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:53.116125 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-72fe87ae-148e-48d6-afe2-82bfb3627536 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1389 microversion: 2.1 time: 0.313321 Oct 27 09:41:53.117124 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3139/6347] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:52 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1389 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:53.144221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:53.145287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:53.158829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.159825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.160688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.161929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.162780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.163546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.213739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:41:53.360702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9aaea740-f45f-4f71-acb7-4ff19b05ed11 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 204 len: 0 microversion: 2.1 time: 0.222646 Oct 27 09:41:53.361702 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3209/6348] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:41:53 2022] DELETE /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:41:53.369608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:53.370508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:53.376687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:53.378001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:53.378225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.378762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.379319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.380270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.380986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.381578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.390320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.391553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.392377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.393652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.394485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.395243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.721408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:53.734784 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0805ae82-aec6-4bcf-8ec4-9aca94aa23e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1564 microversion: 2.1 time: 0.369643 Oct 27 09:41:53.735623 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3140/6349] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:53 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1564 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:53.745975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8eb8f937-88bd-4286-b5b0-ee848743b0a8 req-90fb51be-6a41-481e-b7f9-aa60f4f9f509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7130735-fb19-49f2-bdf1-8663e83fdd4a", "tag": "57f84ee8-9ac4-4791-84fd-24e83244d60b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:53.771983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8eb8f937-88bd-4286-b5b0-ee848743b0a8 req-90fb51be-6a41-481e-b7f9-aa60f4f9f509 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.774250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8eb8f937-88bd-4286-b5b0-ee848743b0a8 req-90fb51be-6a41-481e-b7f9-aa60f4f9f509 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.774784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:53.775085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8eb8f937-88bd-4286-b5b0-ee848743b0a8 req-90fb51be-6a41-481e-b7f9-aa60f4f9f509 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.780764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:53.790436 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-674ae668-905e-47c7-9a4d-203980089342 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1395 microversion: 2.1 time: 0.421564 Oct 27 09:41:53.792306 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3210/6350] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:53 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1395 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:53.802703 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8eb8f937-88bd-4286-b5b0-ee848743b0a8 req-90fb51be-6a41-481e-b7f9-aa60f4f9f509 service nova] Creating event network-changed:57f84ee8-9ac4-4791-84fd-24e83244d60b for instance c7130735-fb19-49f2-bdf1-8663e83fdd4a on n-h1-858383-16 Oct 27 09:41:53.813820 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8eb8f937-88bd-4286-b5b0-ee848743b0a8 req-90fb51be-6a41-481e-b7f9-aa60f4f9f509 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075468 Oct 27 09:41:53.816567 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3141/6351] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:54.838492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:54.839989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:54.850767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:54.851453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:54.852342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:54.853195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:54.854262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:54.855849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:55.054034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:55.064127 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a51dc7a-0cd4-4a4c-bc6b-f351490d2204 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1395 microversion: 2.1 time: 0.233846 Oct 27 09:41:55.064821 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3211/6352] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:54 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1395 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:55.842842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-811df359-868d-4267-b647-e3842cdd5f42 req-8ba66fa1-ab50-49d0-bda8-d48a84162418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4845dd-46b3-417b-b72e-43181a954946", "name": "network-vif-deleted", "tag": "76a3b8b3-6c8e-47ad-91a2-f309d5ade731"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:55.859291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-811df359-868d-4267-b647-e3842cdd5f42 req-8ba66fa1-ab50-49d0-bda8-d48a84162418 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:55.859826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-811df359-868d-4267-b647-e3842cdd5f42 req-8ba66fa1-ab50-49d0-bda8-d48a84162418 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:55.860267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-811df359-868d-4267-b647-e3842cdd5f42 req-8ba66fa1-ab50-49d0-bda8-d48a84162418 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:55.873571 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-811df359-868d-4267-b647-e3842cdd5f42 req-8ba66fa1-ab50-49d0-bda8-d48a84162418 service nova] Creating event network-vif-deleted:76a3b8b3-6c8e-47ad-91a2-f309d5ade731 for instance 1b4845dd-46b3-417b-b72e-43181a954946 on n-h2-858383-16 Oct 27 09:41:55.882588 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-811df359-868d-4267-b647-e3842cdd5f42 req-8ba66fa1-ab50-49d0-bda8-d48a84162418 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044292 Oct 27 09:41:55.883935 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3142/6353] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:56.094716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:56.095812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:56.107744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:56.108604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:56.109375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:56.110649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:56.111454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:56.112265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:56.142875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:56.216716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:56.226208 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91909e2b-f028-4f6d-99ae-bed57289b8aa tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1187 microversion: 2.1 time: 0.139535 Oct 27 09:41:56.227104 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3212/6354] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:56 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1187 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:57.266502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:57.267380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:57.275034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:57.276242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:57.276858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:57.277739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:57.278368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:57.278899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:57.360591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:57.370065 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb00deb7-86e3-4a9d-85c2-ad513a03ef87 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1187 microversion: 2.1 time: 0.108963 Oct 27 09:41:57.370805 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3143/6355] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:57 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1187 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:58.398756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:58.399884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:58.412476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:58.413364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:58.414152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:58.415430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:58.416814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:58.417577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:58.520662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:58.530468 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-edd3e9f9-3073-4bba-bd0f-03ee5a2391e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1187 microversion: 2.1 time: 0.138894 Oct 27 09:41:58.531075 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3213/6356] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:58 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:59.568318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:59.569461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:59.582533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:59.583226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:59.583990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:59.585288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:59.586106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:59.586854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:59.684724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:59.700238 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ecde09eb-b77e-42cd-af9c-432bfb88e42b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1187 microversion: 2.1 time: 0.139015 Oct 27 09:41:59.701280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3144/6357] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:59 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1187 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:00.735246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:00.735900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:00.743697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:00.744261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:00.744741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:00.745498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:00.745963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:00.746394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:00.783038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:00.783723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:00.784268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:00.784821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lazy-loading 'fault' on Instance uuid 1b4845dd-46b3-417b-b72e-43181a954946 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:42:00.846497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:00.856317 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ed348ac4-83ea-4c4b-93fb-0e0b441f3a63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 200 len: 1192 microversion: 2.1 time: 0.125025 Oct 27 09:42:00.857138 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3214/6358] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:00 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 1192 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:01.886650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:01.887259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 1b4845dd-46b3-417b-b72e-43181a954946] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:01.894544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:01.895045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:01.895493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:01.896249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:01.896714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:01.897146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:01.914944 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 1b4845dd-46b3-417b-b72e-43181a954946 could not be found. Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 HTTP/1.1 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 1b4845dd-46b3-417b-b72e-43181a954946 could not be found. Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '1b4845dd-46b3-417b-b72e-43181a954946'} Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4845dd-46b3-417b-b72e-43181a954946 could not be found. Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4845dd-46b3-417b-b72e-43181a954946 could not be found. Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:01.917200 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4845dd-46b3-417b-b72e-43181a954946 could not be found. Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 1b4845dd-46b3-417b-b72e-43181a954946 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-903ac2ea-87f2-499e-b9dd-40eb45fde9b8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946" status: 404 len: 111 microversion: 2.1 time: 0.036075 Oct 27 09:42:01.923963 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3145/6359] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:01 2022] GET /compute/v2.1/servers/1b4845dd-46b3-417b-b72e-43181a954946 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:42:25.148338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7e57d35d-0d1e-46f0-a9ff-e8e1783dba68 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:25.149744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7e57d35d-0d1e-46f0-a9ff-e8e1783dba68 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:25.163833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:25.166583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=17 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:25.170552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e57d35d-0d1e-46f0-a9ff-e8e1783dba68 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:25.172618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e57d35d-0d1e-46f0-a9ff-e8e1783dba68 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:25.173856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e57d35d-0d1e-46f0-a9ff-e8e1783dba68 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:25.175426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e57d35d-0d1e-46f0-a9ff-e8e1783dba68 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:25.177284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e57d35d-0d1e-46f0-a9ff-e8e1783dba68 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:25.178016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7e57d35d-0d1e-46f0-a9ff-e8e1783dba68 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:25.254196 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7e57d35d-0d1e-46f0-a9ff-e8e1783dba68 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/ips" status: 200 len: 149 microversion: 2.1 time: 0.115596 Oct 27 09:42:25.262482 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3215/6360] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:42:25 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/ips => generated 149 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:25.783381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1699387060", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "75dc16bd-494e-4088-831f-b9f43701b445", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c8f250b0-c481-437b-8054-ee4c9ca61f10"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:25.805029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=25 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:25.806559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=16 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:25.959339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] validate_networks() for [('c8f250b0-c481-437b-8054-ee4c9ca61f10', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:42:26.539396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:42:26.540222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:42:26.541113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:42:26.542404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:42:26.542877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:42:26.554658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:26.555494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:26.555957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:26.557282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:26.557962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:26.560875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:26.582722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:42:26.590360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for user 9ab30747d0444c32bbc058a522262b62 and project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:42:26.618061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:42:26.622109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='75dc16bd-494e-4088-831f-b9f43701b445',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:42:26.709053 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d7c7693-4d81-41b2-a2c9-682138f2ba95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934986 Oct 27 09:42:26.715838 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3146/6361] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:42:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:42:26.727312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-daf6c0cc-2ba2-4e01-8dd2-a785cff6d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:26.728516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-daf6c0cc-2ba2-4e01-8dd2-a785cff6d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:26.823464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-daf6c0cc-2ba2-4e01-8dd2-a785cff6d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:26.834889 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-daf6c0cc-2ba2-4e01-8dd2-a785cff6d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1057 microversion: 2.1 time: 0.116267 Oct 27 09:42:26.847657 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3216/6362] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:26 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1057 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:26.877909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4bfbfbb7-05a4-411a-b41a-43afd6a9c471 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85bee3c1-8d41-45ea-8a37-c402f2b75f44"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:26.880713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4bfbfbb7-05a4-411a-b41a-43afd6a9c471 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:26.888937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bfbfbb7-05a4-411a-b41a-43afd6a9c471 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:26.889340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bfbfbb7-05a4-411a-b41a-43afd6a9c471 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:26.889787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bfbfbb7-05a4-411a-b41a-43afd6a9c471 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:26.890519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bfbfbb7-05a4-411a-b41a-43afd6a9c471 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:26.890987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bfbfbb7-05a4-411a-b41a-43afd6a9c471 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:26.891427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4bfbfbb7-05a4-411a-b41a-43afd6a9c471 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:27.200760 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4bfbfbb7-05a4-411a-b41a-43afd6a9c471 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327532 Oct 27 09:42:27.202552 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3147/6363] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:42:26 2022] POST /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:27.865670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:27.867046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:27.882532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:27.883619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:27.884682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:27.885707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:27.886345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:27.886887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:27.999309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:28.007878 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38a668ad-2ead-4c7f-95ea-40b2a1632791 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1109 microversion: 2.1 time: 0.149493 Oct 27 09:42:28.008480 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3217/6364] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:27 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1109 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:28.268105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7469271e-5541-4286-92f6-b0a647e87228 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:28.271967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7469271e-5541-4286-92f6-b0a647e87228 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:28.284748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7469271e-5541-4286-92f6-b0a647e87228 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:28.285818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7469271e-5541-4286-92f6-b0a647e87228 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:28.286634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7469271e-5541-4286-92f6-b0a647e87228 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:28.287967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7469271e-5541-4286-92f6-b0a647e87228 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:28.288836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7469271e-5541-4286-92f6-b0a647e87228 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:28.289634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7469271e-5541-4286-92f6-b0a647e87228 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:28.391134 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7469271e-5541-4286-92f6-b0a647e87228 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action" status: 200 len: 24565 microversion: 2.1 time: 0.132014 Oct 27 09:42:28.399139 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3148/6365] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:42:28 2022] POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action => generated 24565 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:42:29.033212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:29.045000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:29.064595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:29.067952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:29.070168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:29.071325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:29.072086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:29.073780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:29.267770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:29.283472 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c4fa8db-7d15-46e2-9958-0e46682101bf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1127 microversion: 2.1 time: 0.254977 Oct 27 09:42:29.285727 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3218/6366] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:29 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1127 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:30.318639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:30.321260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:30.339907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:30.341354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:30.342547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:30.345772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:30.347079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:30.348110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:30.693364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:30.717229 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9422816e-99ec-474e-bce1-ea7b54c0ea98 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.408041 Oct 27 09:42:30.726223 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3149/6367] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:30 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:31.226441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7f562949-9765-46fe-82fc-059224d5b6ce req-49c42b44-5e98-4269-a5ca-803af47ed629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab544dc-02bd-4536-8376-6e4f7e4f2bc4", "tag": "1ae38424-1773-446c-ba75-0193a4a7f012"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:31.238195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7f562949-9765-46fe-82fc-059224d5b6ce req-49c42b44-5e98-4269-a5ca-803af47ed629 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:31.239220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7f562949-9765-46fe-82fc-059224d5b6ce req-49c42b44-5e98-4269-a5ca-803af47ed629 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:31.240089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7f562949-9765-46fe-82fc-059224d5b6ce req-49c42b44-5e98-4269-a5ca-803af47ed629 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:31.256050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7f562949-9765-46fe-82fc-059224d5b6ce req-49c42b44-5e98-4269-a5ca-803af47ed629 service nova] Creating event network-changed:1ae38424-1773-446c-ba75-0193a4a7f012 for instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 on n-h2-858383-16 Oct 27 09:42:31.263198 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7f562949-9765-46fe-82fc-059224d5b6ce req-49c42b44-5e98-4269-a5ca-803af47ed629 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168611 Oct 27 09:42:31.264622 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3219/6368] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:31.749556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:31.750774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:31.764199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:31.765535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:31.766150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:31.767458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:31.768296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:31.768891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:32.080048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:32.102554 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21e22f9f-ebb1-4f17-a68b-427bdd94fd16 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.359609 Oct 27 09:42:32.104782 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3150/6369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:31 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:33.135542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:33.141515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:33.156595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:33.157817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:33.158891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:33.160669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:33.161779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:33.162724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:33.455737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:33.467019 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43fb28ed-b779-4c5e-9817-f393b18f7c85 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.342278 Oct 27 09:42:33.485770 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3220/6370] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:33 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:34.508928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:34.510058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:34.524004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.524750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.525510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.526670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.527306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.527791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.767456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:34.781905 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d257a83c-cec4-4faf-9996-cd152ce93e0e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.278725 Oct 27 09:42:34.783315 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3151/6371] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:34 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:35.831500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:35.833086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:35.844052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:35.844826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:35.845408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:35.846293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:35.847114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:35.847985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:36.107666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:36.119824 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c394ae3c-0fa6-4d9d-9e4c-8e9c1da8672b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.296269 Oct 27 09:42:36.132367 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3221/6372] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:35 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:37.152999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:37.154268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:37.165405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:37.167382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:37.172763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:37.173582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:37.174671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:37.175808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:37.176418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:37.177216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:37.441657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:37.456439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0b092af-cc8d-4f9d-8cdc-c1869dc8c596 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.313848 Oct 27 09:42:37.457821 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3152/6373] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:37 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:38.498220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:38.507045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:38.507833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:38.516847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:38.517608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:38.518375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:38.519636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:38.520369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:38.521059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:38.721400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:38.735521 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc81db47-8222-419a-8fb0-25bb2f7b8807 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.238575 Oct 27 09:42:38.736505 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3222/6374] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:38 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:39.635296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9d2039a-5397-4b31-989c-0212a32ff243 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: .version_select at 0x7f31a8d38f70>, body: {"keypair": {"name": "tempest-keypair-1568324395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJ8dOXthrD2sfJHzOzca8WyEYEeuQBiwGjQRrMuAkKrnara6RDXIE5+0+vL+ZHoJm8kLe4sGdA57Hofd/ka3Dqsz5pvjyXpFQz/NZl7KdvkbviiEFuSdUXAtaXy8xplTw=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:39.654042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-e9d2039a-5397-4b31-989c-0212a32ff243 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for project a82209ade47d45dfa83c52c24366f737. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:42:39.661129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-e9d2039a-5397-4b31-989c-0212a32ff243 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for user 485ee99d7fbd4f359824aff38966a868 and project a82209ade47d45dfa83c52c24366f737. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:42:39.690609 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e9d2039a-5397-4b31-989c-0212a32ff243 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059059 Oct 27 09:42:39.691358 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3153/6375] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:42:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:39.776303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:39.777476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:39.787309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:39.788444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:39.789030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:39.790227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:39.791067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:39.791679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:39.999156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:40.008009 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f21491ea-de70-4d6d-bc64-eb7a2be32ce1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.237219 Oct 27 09:42:40.008616 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3223/6376] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:39 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:41.036412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:41.037567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:41.049571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:41.050353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:41.050925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:41.051804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:41.052389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:41.052973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:41.279705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:41.295549 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a30867d3-1125-4c2d-9a6b-b51d112d2e33 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.266596 Oct 27 09:42:41.296754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3154/6377] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:41 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:41.503502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1968632772", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0dbda36-c7d7-4d8b-8839-e59a3043c05d"}], "security_groups": [{"name": "tempest-securitygroup--568110391"}], "key_name": "tempest-keypair-1568324395", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:41.672451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] validate_networks() for [('d0dbda36-c7d7-4d8b-8839-e59a3043c05d', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:42:42.141930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:42:42.142709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:42:42.143680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:42:42.144450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:42:42.145215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:42:42.161728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:42.162577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:42.163367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:42.164788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:42.165646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:42.166455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:42.200910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for project a82209ade47d45dfa83c52c24366f737. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:42:42.212285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for user 485ee99d7fbd4f359824aff38966a868 and project a82209ade47d45dfa83c52c24366f737. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:42:42.232798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:42:42.235672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:42:42.300017 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-524b30c5-c0ca-46e0-b059-b393db564a6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.805304 Oct 27 09:42:42.300674 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3224/6378] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:42:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:42:42.318573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54c4b12d-ae79-488e-8492-94ffb9eeb833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:42.320756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:42.321369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:42.322258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54c4b12d-ae79-488e-8492-94ffb9eeb833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:42.340910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:42.341599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:42.342339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:42.346372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:42.348297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:42.349201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:42.411990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-54c4b12d-ae79-488e-8492-94ffb9eeb833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:42.424866 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54c4b12d-ae79-488e-8492-94ffb9eeb833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1242 microversion: 2.1 time: 0.114467 Oct 27 09:42:42.426524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3155/6379] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:42 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:42.552770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:42.562544 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1dc32eb1-ea32-4964-9b68-0df373ea2093 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.245650 Oct 27 09:42:42.563229 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3225/6380] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:42 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:43.451151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:43.452066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:43.459619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:43.460119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:43.460757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:43.461763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:43.462310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:43.462824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:43.542396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:43.556664 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee323c65-060a-419b-9f3a-db1c29dc032f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1294 microversion: 2.1 time: 0.109613 Oct 27 09:42:43.558246 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3156/6381] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:43 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:43.586864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:43.587509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:43.595897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:43.596418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:43.596875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:43.597654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:43.598137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:43.598578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:43.794671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:43.811291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1df26d65-1e71-4206-8b5f-8daa6d4c6681 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.228083 Oct 27 09:42:43.812610 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3226/6382] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:43 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:44.598813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:44.601368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:44.614247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:44.615789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:44.616885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:44.618394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:44.619422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:44.620698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:44.761816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:44.770071 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42d19c52-dbae-4291-9dc2-77f73333aa84 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1300 microversion: 2.1 time: 0.178431 Oct 27 09:42:44.770980 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3157/6383] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:44 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1300 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:44.854425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:44.855542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:44.871962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:44.873428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:44.874080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:44.875237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:44.875944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:44.876573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:45.162001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:45.184420 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23a408cb-e322-41a4-857e-a0eb42f64d1c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.334204 Oct 27 09:42:45.187399 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3227/6384] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:44 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:45.796210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:45.797666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:45.805455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:45.805945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:45.806385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:45.807115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:45.808101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:45.808536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:46.202696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:46.216234 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efa4fcef-7625-4f57-9605-d5a60a91250f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1367 microversion: 2.1 time: 0.424714 Oct 27 09:42:46.217516 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3158/6385] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:45 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:46.233628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:46.236106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:46.251803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:46.252756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:46.253582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:46.254512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:46.255341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:46.255985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:46.534479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:46.551379 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-25d6ec73-a174-4058-b925-5512808501e5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.327083 Oct 27 09:42:46.552545 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3228/6386] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:46 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:46.825012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-aaf66fe3-f32b-48c8-a9a9-842f291ea7b0 req-9e1afd77-4b5c-475a-9d93-7f2cbaeb465a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcea22af-75e3-48e1-b4ab-0ea49995bb18", "tag": "6b316f6c-6e06-4b5c-92e8-bed68a4d8540"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:46.841715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aaf66fe3-f32b-48c8-a9a9-842f291ea7b0 req-9e1afd77-4b5c-475a-9d93-7f2cbaeb465a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:46.842484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aaf66fe3-f32b-48c8-a9a9-842f291ea7b0 req-9e1afd77-4b5c-475a-9d93-7f2cbaeb465a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:46.843127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aaf66fe3-f32b-48c8-a9a9-842f291ea7b0 req-9e1afd77-4b5c-475a-9d93-7f2cbaeb465a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:46.860690 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-aaf66fe3-f32b-48c8-a9a9-842f291ea7b0 req-9e1afd77-4b5c-475a-9d93-7f2cbaeb465a service nova] Creating event network-changed:6b316f6c-6e06-4b5c-92e8-bed68a4d8540 for instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 on n-h1-858383-16 Oct 27 09:42:46.866925 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-aaf66fe3-f32b-48c8-a9a9-842f291ea7b0 req-9e1afd77-4b5c-475a-9d93-7f2cbaeb465a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048819 Oct 27 09:42:46.868038 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3159/6387] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:47.263842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:47.265252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:47.279523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:47.280347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:47.281457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:47.282792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:47.283752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:47.284563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:47.583147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:47.595020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:47.596284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:47.598173 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9e050278-d820-4a30-9201-a19131ba6456 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1367 microversion: 2.1 time: 0.341839 Oct 27 09:42:47.599245 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3229/6388] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:47 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:47.604530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:47.605373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:47.606167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:47.607128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:47.607854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:47.608492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:47.926352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:47.941290 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ba1713f-b5b8-45c5-b9b6-cef6d6f25a94 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1169 microversion: 2.1 time: 0.350213 Oct 27 09:42:47.942547 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3160/6389] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:47 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1169 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:48.640748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:48.641319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:48.648951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:48.649453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:48.649907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:48.650632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:48.651104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:48.651543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:48.799764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:48.809034 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e697977e-4de5-4221-8a96-d11fd0bd0445 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1367 microversion: 2.1 time: 0.172064 Oct 27 09:42:48.809750 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3230/6390] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:48 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:48.978472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:48.979041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:48.986974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:48.987476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:48.987999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:48.988715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:48.989186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:48.989624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:49.133362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:49.141794 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2fc4db3-a8b0-4a36-bc68-8f6a60603142 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.167289 Oct 27 09:42:49.142394 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3161/6391] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:48 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:49.833819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:49.834540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:49.843441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:49.844051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:49.844541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:49.845327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:49.846024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:49.846550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.002480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:50.016115 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-95fc264c-2a8c-4baf-944d-814d41c006fe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1367 microversion: 2.1 time: 0.186041 Oct 27 09:42:50.017046 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3231/6392] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:49 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:50.164889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:50.165776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:50.173845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.174511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.175045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.175980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.176496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.176978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.329237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:50.340790 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73944f9d-e99d-48ca-ba09-023a7f754a3a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.179778 Oct 27 09:42:50.342261 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3162/6393] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:50 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:51.054284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:51.054965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:51.062976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:51.063471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:51.063962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:51.064702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:51.065167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:51.065610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:51.242034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:51.259250 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-daa2b7cc-6ec4-4356-ac17-ca42fae0f56e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1367 microversion: 2.1 time: 0.208802 Oct 27 09:42:51.260378 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3232/6394] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:51 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:51.370457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:51.371659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:51.385096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:51.386544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:51.387359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:51.389005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:51.393321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:51.394304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:51.594373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:51.606364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0c2f4d3-d0d5-4fb7-9444-585d362a146c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.243958 Oct 27 09:42:51.607188 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3163/6395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:51 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:52.299962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:52.300657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:52.303549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:52.304729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:52.313125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:52.313693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:52.314313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:52.315098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:52.315680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:52.316180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:52.473862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:52.483746 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4cac845a-fe55-4b8b-a579-a5a23e525083 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1367 microversion: 2.1 time: 0.187941 Oct 27 09:42:52.484413 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3233/6396] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:52 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:52.633421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:52.634131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:52.637203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:52.643079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:52.643598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:52.644050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:52.644778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:52.645241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:52.645673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:52.795744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:52.800348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:52.806682 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc3ac252-762b-42dd-a587-e14322096494 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.177103 Oct 27 09:42:52.807288 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3164/6397] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:52 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:53.515365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:53.516579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:53.525408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:53.526083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:53.526868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:53.527997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:53.528701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:53.529357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:53.538108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:53.661938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-63151613-dc9e-4d09-9fef-9e6a2af0ba2c req-b29004ea-531d-4e24-9af8-63af8d0037e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcea22af-75e3-48e1-b4ab-0ea49995bb18", "name": "network-vif-plugged", "status": "completed", "tag": "6b316f6c-6e06-4b5c-92e8-bed68a4d8540"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:53.678194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-63151613-dc9e-4d09-9fef-9e6a2af0ba2c req-b29004ea-531d-4e24-9af8-63af8d0037e4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:53.678677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-63151613-dc9e-4d09-9fef-9e6a2af0ba2c req-b29004ea-531d-4e24-9af8-63af8d0037e4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:53.679311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-63151613-dc9e-4d09-9fef-9e6a2af0ba2c req-b29004ea-531d-4e24-9af8-63af8d0037e4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:53.693159 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-63151613-dc9e-4d09-9fef-9e6a2af0ba2c req-b29004ea-531d-4e24-9af8-63af8d0037e4 service nova] Creating event network-vif-plugged:6b316f6c-6e06-4b5c-92e8-bed68a4d8540 for instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 on n-h1-858383-16 Oct 27 09:42:53.699858 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-63151613-dc9e-4d09-9fef-9e6a2af0ba2c req-b29004ea-531d-4e24-9af8-63af8d0037e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155710 Oct 27 09:42:53.700488 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3165/6398] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:53.731486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:53.740463 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc9d10a9-a657-4dfd-8d1d-a9a969717438 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1367 microversion: 2.1 time: 0.233335 Oct 27 09:42:53.741358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3234/6399] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:53 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:53.832726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:53.833744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:53.843368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:53.844093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:53.844517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:53.845255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:53.845928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:53.846360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:54.003680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:54.013040 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dfed7dd7-871c-44f4-bdf5-765e3d216f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.185595 Oct 27 09:42:54.013703 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3166/6400] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:53 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:54.778265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:54.778894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:54.786573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:54.787077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:54.787524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:54.788289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:54.788747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:54.789172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:54.952100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:54.960496 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6f96668-5afd-4996-8ec5-1cd1c6770133 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1367 microversion: 2.1 time: 0.186920 Oct 27 09:42:54.961365 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3235/6401] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:54 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:55.046042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:55.046696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:55.053973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:55.054485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:55.054936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:55.055712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:55.056205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:55.056643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:55.214858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:55.223521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5100fa54-e641-4f5b-8406-27b66cb31b38 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.181515 Oct 27 09:42:55.224201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3167/6402] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:55 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:55.987381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:55.988359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:55.991375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:55.999217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:55.999824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.000357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.001245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.001854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.002454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.162022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:56.171793 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c633e56f-5f26-42a8-b486-a037d6397a27 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1557 microversion: 2.1 time: 0.188675 Oct 27 09:42:56.172491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3236/6403] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:55 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1557 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:56.198695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e80459fb-0956-4b24-a3a5-8857e3146b1c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:56.199856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e80459fb-0956-4b24-a3a5-8857e3146b1c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:56.204644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:56.216639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80459fb-0956-4b24-a3a5-8857e3146b1c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.217180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80459fb-0956-4b24-a3a5-8857e3146b1c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.217633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80459fb-0956-4b24-a3a5-8857e3146b1c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.218373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80459fb-0956-4b24-a3a5-8857e3146b1c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.218841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80459fb-0956-4b24-a3a5-8857e3146b1c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.219279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e80459fb-0956-4b24-a3a5-8857e3146b1c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.248374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:56.248997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:56.259275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.260168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.261150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.262486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.263350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.264172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.349403 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e80459fb-0956-4b24-a3a5-8857e3146b1c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156887 Oct 27 09:42:56.350443 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3168/6404] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:42:56 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:56.476976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:56.487358 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8dc58c6a-15e4-4108-b249-3e889493a5f1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.243799 Oct 27 09:42:56.488293 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3237/6405] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:56 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:57.516461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:57.517547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:57.525158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.525900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.526548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.527504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.528412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.528945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.735634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:57.744439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6ae4b25a-7e9c-4ab4-8db9-8ef7f3b99018 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.233141 Oct 27 09:42:57.745124 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3169/6406] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:57 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:57.957481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-195dd958-dae2-46ea-9004-8a96fd76f99b req-ded1ad6f-c079-4d5f-947e-1caf07cc3157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcea22af-75e3-48e1-b4ab-0ea49995bb18", "tag": "6b316f6c-6e06-4b5c-92e8-bed68a4d8540"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:57.969331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-195dd958-dae2-46ea-9004-8a96fd76f99b req-ded1ad6f-c079-4d5f-947e-1caf07cc3157 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.969932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-195dd958-dae2-46ea-9004-8a96fd76f99b req-ded1ad6f-c079-4d5f-947e-1caf07cc3157 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.970459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-195dd958-dae2-46ea-9004-8a96fd76f99b req-ded1ad6f-c079-4d5f-947e-1caf07cc3157 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.984178 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-195dd958-dae2-46ea-9004-8a96fd76f99b req-ded1ad6f-c079-4d5f-947e-1caf07cc3157 service nova] Creating event network-changed:6b316f6c-6e06-4b5c-92e8-bed68a4d8540 for instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 on n-h1-858383-16 Oct 27 09:42:57.991317 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-195dd958-dae2-46ea-9004-8a96fd76f99b req-ded1ad6f-c079-4d5f-947e-1caf07cc3157 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152119 Oct 27 09:42:57.992119 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3238/6407] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:42:58.782482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:58.783432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:58.791154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:58.792458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:58.793022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:58.793928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:58.794702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:58.795338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:59.004421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:59.014614 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ced4a364-79d5-4d78-8a43-8c9e2b77c17b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.236110 Oct 27 09:42:59.015215 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3170/6408] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:58 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:59.779818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-99bcd25b-5f30-450b-8217-0d35bfdac63e req-03d7f782-0da4-4260-89c0-62e8813ebb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab544dc-02bd-4536-8376-6e4f7e4f2bc4", "name": "network-vif-plugged", "status": "completed", "tag": "1ae38424-1773-446c-ba75-0193a4a7f012"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:59.796328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-99bcd25b-5f30-450b-8217-0d35bfdac63e req-03d7f782-0da4-4260-89c0-62e8813ebb10 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:59.797099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-99bcd25b-5f30-450b-8217-0d35bfdac63e req-03d7f782-0da4-4260-89c0-62e8813ebb10 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:59.797528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-99bcd25b-5f30-450b-8217-0d35bfdac63e req-03d7f782-0da4-4260-89c0-62e8813ebb10 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:59.814286 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-99bcd25b-5f30-450b-8217-0d35bfdac63e req-03d7f782-0da4-4260-89c0-62e8813ebb10 service nova] Creating event network-vif-plugged:1ae38424-1773-446c-ba75-0193a4a7f012 for instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 on n-h2-858383-16 Oct 27 09:42:59.821452 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-99bcd25b-5f30-450b-8217-0d35bfdac63e req-03d7f782-0da4-4260-89c0-62e8813ebb10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050637 Oct 27 09:42:59.822302 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3239/6409] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:00.039198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:00.040247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:00.048322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:00.048821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:00.049269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:00.049998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:00.050464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:00.050897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:00.207968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:00.217901 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e63fc9e-4ebd-464e-96b5-db8f733c59a9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.183167 Oct 27 09:43:00.218612 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3171/6410] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:00 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:01.248692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:01.249996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:01.263318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:01.264177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:01.264933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:01.266161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:01.266954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:01.267758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:01.492793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:01.501992 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b773eb80-6959-4a6a-b842-c72122d14534 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1203 microversion: 2.1 time: 0.262393 Oct 27 09:43:01.502729 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3240/6411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:01 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1203 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:02.528188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:02.528923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:02.536652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.537216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.537766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:02.538604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.539080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.539538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:02.688632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:02.697327 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3568095d-0575-480d-9520-1bd2bc486ef3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1391 microversion: 2.1 time: 0.174511 Oct 27 09:43:02.697938 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3172/6412] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:02 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:02.723708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:02.724381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:02.732311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.732839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.733296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:02.734064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.734540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.735025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:02.906563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:02.916065 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40832184-3c85-4e29-893e-9301fe49d43f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1391 microversion: 2.1 time: 0.196207 Oct 27 09:43:02.916698 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3241/6413] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:02 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:02.940339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:02.941113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:02.947919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.949148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.949644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:02.950547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.951169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.951734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:03.119026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:03.134001 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bae1ad3-44e1-41f4-9d48-c6d6b3bd09b7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1391 microversion: 2.1 time: 0.197484 Oct 27 09:43:03.135285 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3173/6414] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:02 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1391 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:03.225239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:03.225805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:03.233364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:03.233885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:03.234347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:03.235098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:03.235644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:03.236080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:03.266899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:43:03.358612 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-045f0b74-448a-449f-95a1-1b8c21bba5ae tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 204 len: 0 microversion: 2.1 time: 0.137779 Oct 27 09:43:03.359511 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3242/6415] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:43:03 2022] DELETE /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:43:03.372605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:03.373722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:03.385670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:03.386369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:03.387147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:03.388476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:03.389300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:03.390065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:03.549109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:03.564306 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66c5610d-d0a3-4e42-b5c8-070fff25d2b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1397 microversion: 2.1 time: 0.199502 Oct 27 09:43:03.565400 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3174/6416] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:03 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1397 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:04.594519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:04.595440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:04.603190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:04.603783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:04.604332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:04.606193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:04.607054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:04.607884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:04.780368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:04.789666 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72513469-8100-4249-bb00-a28c1e79fd27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1397 microversion: 2.1 time: 0.200766 Oct 27 09:43:04.790217 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3243/6417] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:04 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1397 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:05.691171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-adc7eedc-013f-4e8f-ab5d-d17e1532e4a5 req-dd4af50c-ba39-4ef7-a50d-6c6fd3c90a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab544dc-02bd-4536-8376-6e4f7e4f2bc4", "name": "network-vif-deleted", "tag": "1ae38424-1773-446c-ba75-0193a4a7f012"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:05.731999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-adc7eedc-013f-4e8f-ab5d-d17e1532e4a5 req-dd4af50c-ba39-4ef7-a50d-6c6fd3c90a6f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:05.732900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-adc7eedc-013f-4e8f-ab5d-d17e1532e4a5 req-dd4af50c-ba39-4ef7-a50d-6c6fd3c90a6f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:05.733693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-adc7eedc-013f-4e8f-ab5d-d17e1532e4a5 req-dd4af50c-ba39-4ef7-a50d-6c6fd3c90a6f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:05.754348 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-adc7eedc-013f-4e8f-ab5d-d17e1532e4a5 req-dd4af50c-ba39-4ef7-a50d-6c6fd3c90a6f service nova] Creating event network-vif-deleted:1ae38424-1773-446c-ba75-0193a4a7f012 for instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 on n-h2-858383-16 Oct 27 09:43:05.763373 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-adc7eedc-013f-4e8f-ab5d-d17e1532e4a5 req-dd4af50c-ba39-4ef7-a50d-6c6fd3c90a6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080729 Oct 27 09:43:05.765415 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3175/6418] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:05.815422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:05.816378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:05.823449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:05.824271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:05.824716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:05.825452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:05.825915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:05.826344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:05.969318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:05.986557 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-44f16250-50b8-4bf4-85ef-908048ccfe15 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1188 microversion: 2.1 time: 0.174402 Oct 27 09:43:05.987742 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3244/6419] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:05 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1188 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:07.030189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:07.031032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:07.039318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.040263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.041059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.043602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.044204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.045075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.151017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:07.167812 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b1043a4-9667-4ea2-a632-e72e9ea14e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1188 microversion: 2.1 time: 0.141365 Oct 27 09:43:07.169217 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3176/6420] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:07 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1188 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:07.169429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-adab2a19-691a-43aa-91b5-4acb07a6c4dd tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:07.170601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-adab2a19-691a-43aa-91b5-4acb07a6c4dd tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:07.185027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adab2a19-691a-43aa-91b5-4acb07a6c4dd tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.186459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adab2a19-691a-43aa-91b5-4acb07a6c4dd tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.187268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adab2a19-691a-43aa-91b5-4acb07a6c4dd tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.188696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adab2a19-691a-43aa-91b5-4acb07a6c4dd tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.189765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adab2a19-691a-43aa-91b5-4acb07a6c4dd tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.190483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adab2a19-691a-43aa-91b5-4acb07a6c4dd tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.622191 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-adab2a19-691a-43aa-91b5-4acb07a6c4dd tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1835 microversion: 2.1 time: 0.462907 Oct 27 09:43:07.624754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3245/6421] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:07 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1835 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:07.653630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:07.654894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:07.667064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.668727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.669382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.670483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.672020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.672020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.953850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:07.969801 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f807a5f3-965c-40df-9c9e-dd220883f7e2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1682 microversion: 2.1 time: 0.325517 Oct 27 09:43:07.971764 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3177/6422] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:07 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1682 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:08.134010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d0ed9bee-122c-48f3-8157-8f3e6c0a1cf2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:08.137622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d0ed9bee-122c-48f3-8157-8f3e6c0a1cf2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:08.146779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ed9bee-122c-48f3-8157-8f3e6c0a1cf2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.147553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ed9bee-122c-48f3-8157-8f3e6c0a1cf2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.148243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ed9bee-122c-48f3-8157-8f3e6c0a1cf2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.149231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ed9bee-122c-48f3-8157-8f3e6c0a1cf2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.150044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ed9bee-122c-48f3-8157-8f3e6c0a1cf2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.150860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d0ed9bee-122c-48f3-8157-8f3e6c0a1cf2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.200859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:08.201809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:08.211731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.212529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.213267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.215017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.216185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.223130 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d0ed9bee-122c-48f3-8157-8f3e6c0a1cf2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action" status: 200 len: 32638 microversion: 2.1 time: 0.094472 Oct 27 09:43:08.223946 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3246/6423] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:43:08 2022] POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action => generated 32638 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:43:08.225243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.385858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:08.391013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:08.392708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:08.405022 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a88cc3c8-a7ee-4a51-b6ba-9b6dfe896678 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1188 microversion: 2.1 time: 0.208144 Oct 27 09:43:08.406223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.406958 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3178/6424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:08 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1188 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:08.407956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.409137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.410799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.412026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.413130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.502757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '361df34afb8c4d0f9c424676793e3ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3c8646e85f4cc28f07514807032f04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:08.503880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] flavor_id is None. Assuming migration. {{(pid=120602) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 27 09:43:08.504731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120602) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 09:43:08.811037 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f81a1cbd-62ee-4781-8cf1-a493c6610373 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action" status: 202 len: 0 microversion: 2.1 time: 0.427244 Oct 27 09:43:08.815953 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3247/6425] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:43:08 2022] POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:43:08.826329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:08.827215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:08.847996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.848634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.849181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.850089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.850726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.851281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:09.068026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:09.082723 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef76723a-9ddd-406d-9fc7-1ce360ce66e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1691 microversion: 2.1 time: 0.261761 Oct 27 09:43:09.083829 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3179/6426] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:08 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1691 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:09.448199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:09.449253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:09.460666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:09.461943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:09.462962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:09.464638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:09.465477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:09.466502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:09.547021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:09.555935 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f4018b7-5e4a-49c1-a1f2-015c6cfc7ba1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1188 microversion: 2.1 time: 0.113353 Oct 27 09:43:09.556818 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3248/6427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:09 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1188 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:10.110026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:10.110779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:10.119371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.120317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.120948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.121901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.122519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.123297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.325056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:10.346836 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c81b0c7-1b1d-4750-8b99-898072e03c1c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1691 microversion: 2.1 time: 0.240343 Oct 27 09:43:10.347546 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3180/6428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:10 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:10.581610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:10.582307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:10.591554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.592417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.592931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.593736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.594348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.595101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.602834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:10.737064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:10.751812 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c64f333d-57ab-4afe-8503-3a0cdf9330e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 200 len: 1188 microversion: 2.1 time: 0.174798 Oct 27 09:43:10.752592 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3249/6429] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:10 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 1188 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:11.373349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:11.374388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:11.383869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:11.384541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:11.385378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:11.386973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:11.387791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:11.388378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:11.671161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:11.699603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f66841c-bd0d-430b-b7fe-5e7c501375a4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1691 microversion: 2.1 time: 0.329488 Oct 27 09:43:11.700613 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3181/6430] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:11 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1691 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:11.795120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:11.797596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:11.810663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:11.811921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:11.813055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:11.814400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:11.815527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:11.816635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:11.843889 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 HTTP/1.1 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4ab544dc-02bd-4536-8376-6e4f7e4f2bc4'} Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:11.846836 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85ab4765-b86a-4a57-bbd8-10ef50aa812d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 404 len: 111 microversion: 2.1 time: 0.061402 Oct 27 09:43:11.858056 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3250/6431] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:11 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:12.733140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:12.734158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:12.747258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:12.748188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:12.748976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:12.750228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:12.751076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:12.751889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:12.950870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:12.960952 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cff23fa1-bc75-42f5-8927-29a7badfc04e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.234954 Oct 27 09:43:12.961544 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3182/6432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:12 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:13.995654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:13.996750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:14.005727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:14.006482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:14.007023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:14.007999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:14.008652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:14.009216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:14.205085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:14.215272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1b83ddf4-7ec2-4c02-b3ce-29344726431f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.226341 Oct 27 09:43:14.216181 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3251/6433] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:13 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:15.166929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:15.168224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:15.177628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.178313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.178749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.179488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.180003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.180441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.187195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:15.200385 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 HTTP/1.1 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '4ab544dc-02bd-4536-8376-6e4f7e4f2bc4'} Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:43:15.202169 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5953ab89-aa3a-407a-ad08-7a603c814532 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 404 len: 111 microversion: 2.1 time: 0.041003 Oct 27 09:43:15.210454 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3183/6434] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:43:15 2022] DELETE /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:15.222431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:15.223696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:15.235519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.236439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.237223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.238522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.239391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.240291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.241674 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:43:15.241906 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 09:43:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 (ip 10.222.0.25) !!! Oct 27 09:43:15.253271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:15.254667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:15.263967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.264627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.265180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.266339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.266979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.267425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.274277 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 HTTP/1.1 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4ab544dc-02bd-4536-8376-6e4f7e4f2bc4'} Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:15.280040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.288229 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:15.288229 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:15.288229 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:15.288229 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:15.288229 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:15.288229 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. Oct 27 09:43:15.288229 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:43:15.288229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:15.289320 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8e85741-12b0-4bb3-8470-6c0a0a0f7e82 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4" status: 404 len: 111 microversion: 2.1 time: 0.073722 Oct 27 09:43:15.297836 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3252/6435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:15 2022] GET /compute/v2.1/servers/4ab544dc-02bd-4536-8376-6e4f7e4f2bc4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:15.557180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:15.579247 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4d9d1cd-dc89-4bf9-b9e3-b3c202f853d3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.333416 Oct 27 09:43:15.580757 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3184/6436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:15 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:16.623261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:16.625038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:16.639670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:16.641137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:16.642198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:16.643440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:16.644469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:16.648018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:16.861646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:16.871015 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18897af3-16f1-4b30-b4b2-7135863de45f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.254128 Oct 27 09:43:16.871686 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3253/6437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:16 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:17.895400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:17.896258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:17.904675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.905205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.905655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:17.906416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.907612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.908063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:18.065518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:18.076031 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-74bf6c29-5648-4e21-8d42-800f8bc8997a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.184903 Oct 27 09:43:18.076638 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3185/6438] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:17 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:19.105696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:19.106711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:19.119054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:19.119815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:19.121051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:19.122490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:19.123328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:19.124120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:19.311327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:19.321009 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-75f706c0-1091-41ce-9251-bad5748f704c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.223703 Oct 27 09:43:19.321777 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3254/6439] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:19 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:20.360838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:20.361865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:20.370875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:20.371611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:20.372198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:20.373095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:20.373710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:20.374269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:20.597843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:20.608969 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a428c5a-c49c-4581-9acc-209a692e9c7b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.252348 Oct 27 09:43:20.609829 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3186/6440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:20 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:21.650704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:21.651373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:21.659027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:21.659524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:21.660012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:21.661116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:21.661493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:21.661684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:21.846616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:21.865292 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-60fce49d-9142-45eb-bbf5-cac28606238c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.220829 Oct 27 09:43:21.866328 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3255/6441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:21 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:22.910351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:22.911343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:22.920929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:22.921598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:22.922198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:22.923098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:22.923746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:22.924259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:23.125004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:23.133756 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8bbe191d-1b32-4074-9431-72b1680e2cd5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.230509 Oct 27 09:43:23.134376 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3187/6442] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:22 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:24.159354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:24.160457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:24.170772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:24.171607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:24.172406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:24.173733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:24.174603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:24.175403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:24.374807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:24.384276 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-92c1c4df-3d6f-4266-9b4d-a2c3f6949089 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.229933 Oct 27 09:43:24.384880 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3256/6443] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:24 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:25.419162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:25.420030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:25.428875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:25.429463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:25.430443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:25.432191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:25.432962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:25.433513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:25.647059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:25.657224 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd4717be-1d28-4303-af64-5d3845696b6c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.242402 Oct 27 09:43:25.657844 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3188/6444] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:25 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:26.697455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:26.698663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:26.700847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:26.707602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:26.708801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:26.709455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:26.710424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:26.711178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:26.711830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:26.904038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:26.920550 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86acbe73-de96-40d3-821c-b0a931c21cb6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.227224 Oct 27 09:43:26.922131 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3257/6445] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:26 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:27.965292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:27.966642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:27.970761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=42 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:27.981156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.981996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.982763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:27.984146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.984953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.985656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:28.176896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:28.186277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cea805f8-b306-434b-95e2-9a16207d522e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.228377 Oct 27 09:43:28.186883 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3189/6446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:27 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:29.230918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:29.231901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:29.242857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:29.243824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:29.244623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:29.246843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:29.247830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:29.248395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:29.898508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:29.909242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c433f9b-bb35-430e-9d73-26e367238ee1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1696 microversion: 2.1 time: 0.683421 Oct 27 09:43:29.911776 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3258/6447] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:29 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1696 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:30.858762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-aabebea0-5db6-41f8-8863-99281614d5cf req-e5b3894b-0b94-4689-9ffd-a165d7fcf9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7130735-fb19-49f2-bdf1-8663e83fdd4a", "name": "network-vif-unplugged", "status": "completed", "tag": "57f84ee8-9ac4-4791-84fd-24e83244d60b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:30.876984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aabebea0-5db6-41f8-8863-99281614d5cf req-e5b3894b-0b94-4689-9ffd-a165d7fcf9c5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:30.878232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aabebea0-5db6-41f8-8863-99281614d5cf req-e5b3894b-0b94-4689-9ffd-a165d7fcf9c5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:30.879258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aabebea0-5db6-41f8-8863-99281614d5cf req-e5b3894b-0b94-4689-9ffd-a165d7fcf9c5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:30.901861 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-aabebea0-5db6-41f8-8863-99281614d5cf req-e5b3894b-0b94-4689-9ffd-a165d7fcf9c5 service nova] Creating event network-vif-unplugged:57f84ee8-9ac4-4791-84fd-24e83244d60b for instance c7130735-fb19-49f2-bdf1-8663e83fdd4a on n-h2-858383-16 Oct 27 09:43:30.912946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-aabebea0-5db6-41f8-8863-99281614d5cf req-e5b3894b-0b94-4689-9ffd-a165d7fcf9c5 service nova] Instance c7130735-fb19-49f2-bdf1-8663e83fdd4a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:43:30.935622 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-aabebea0-5db6-41f8-8863-99281614d5cf req-e5b3894b-0b94-4689-9ffd-a165d7fcf9c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080582 Oct 27 09:43:30.937593 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3190/6448] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:30.943436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:30.945145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:30.964608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:30.965224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:30.966011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:30.967323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:30.968485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:30.969592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:31.282450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:31.295304 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-12c9abe6-a740-4b70-80ca-b5f7cb6e0cb5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1695 microversion: 2.1 time: 0.360935 Oct 27 09:43:31.296429 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3259/6449] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:30 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1695 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:32.347877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:32.349470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:32.360078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:32.360830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:32.361531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:32.362847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:32.363335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:32.363802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:32.590245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:32.606009 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-151875f4-2858-4852-b43f-cf26adcfb7bf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1695 microversion: 2.1 time: 0.263769 Oct 27 09:43:32.607092 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3191/6450] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:32 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1695 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:32.978339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-39c81ee7-31be-42d3-aa80-e8d2dfe6a63b req-fa2e6088-8b1a-4c37-bd53-c742e363e932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7130735-fb19-49f2-bdf1-8663e83fdd4a", "tag": "57f84ee8-9ac4-4791-84fd-24e83244d60b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:32.989799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-39c81ee7-31be-42d3-aa80-e8d2dfe6a63b req-fa2e6088-8b1a-4c37-bd53-c742e363e932 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:32.990276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-39c81ee7-31be-42d3-aa80-e8d2dfe6a63b req-fa2e6088-8b1a-4c37-bd53-c742e363e932 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:32.990747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-39c81ee7-31be-42d3-aa80-e8d2dfe6a63b req-fa2e6088-8b1a-4c37-bd53-c742e363e932 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:33.005185 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-39c81ee7-31be-42d3-aa80-e8d2dfe6a63b req-fa2e6088-8b1a-4c37-bd53-c742e363e932 service nova] Creating event network-changed:57f84ee8-9ac4-4791-84fd-24e83244d60b for instance c7130735-fb19-49f2-bdf1-8663e83fdd4a on n-h2-858383-16 Oct 27 09:43:33.012511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-39c81ee7-31be-42d3-aa80-e8d2dfe6a63b req-fa2e6088-8b1a-4c37-bd53-c742e363e932 service nova] Instance c7130735-fb19-49f2-bdf1-8663e83fdd4a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:43:33.024584 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-39c81ee7-31be-42d3-aa80-e8d2dfe6a63b req-fa2e6088-8b1a-4c37-bd53-c742e363e932 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050430 Oct 27 09:43:33.025477 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3260/6451] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:33.637361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:33.638659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:33.651775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:33.652661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:33.653488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:33.654724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:33.655545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:33.656377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:33.844392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:33.854045 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ce34701-b457-4564-be4c-f0dc56e11361 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1693 microversion: 2.1 time: 0.224857 Oct 27 09:43:33.854919 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3192/6452] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:33 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1693 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:34.882680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:34.883384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:34.891604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:34.892098 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:34.892539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:34.893263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:34.893722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:34.894178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:35.080450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:35.093911 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f9adcb03-01c0-472c-aa8f-132cf1418517 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1693 microversion: 2.1 time: 0.216368 Oct 27 09:43:35.094959 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3261/6453] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:34 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1693 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:36.136386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:36.137572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:36.151064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:36.152271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:36.153182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:36.154485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:36.155659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:36.156473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:36.387644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:36.403330 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-463f28d7-b175-4b05-a158-bed7b620ab7d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1690 microversion: 2.1 time: 0.274271 Oct 27 09:43:36.404440 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3193/6454] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:36 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1690 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:36.432499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14f7d4f9-62c0-41db-9a7e-a6f701944afd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:36.433820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-14f7d4f9-62c0-41db-9a7e-a6f701944afd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:36.446917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14f7d4f9-62c0-41db-9a7e-a6f701944afd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:36.448278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14f7d4f9-62c0-41db-9a7e-a6f701944afd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:36.449361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14f7d4f9-62c0-41db-9a7e-a6f701944afd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:36.451400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14f7d4f9-62c0-41db-9a7e-a6f701944afd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:36.452189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14f7d4f9-62c0-41db-9a7e-a6f701944afd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:36.453223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14f7d4f9-62c0-41db-9a7e-a6f701944afd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:36.537252 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-14f7d4f9-62c0-41db-9a7e-a6f701944afd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action" status: 204 len: 0 microversion: 2.1 time: 0.110384 Oct 27 09:43:36.538642 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3262/6455] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:43:36 2022] POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:43:36.555809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:36.557120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:36.569593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:36.570382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:36.570999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:36.572080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:36.572935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:36.573531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:36.914622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:36.928793 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a58d7c76-6aa0-46e7-b168-3bd512a0a3e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1690 microversion: 2.1 time: 0.381309 Oct 27 09:43:36.930107 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3194/6456] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:36 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1690 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:37.966515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:37.967791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:37.984820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:37.985947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:37.988737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:37.991314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:37.993270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:37.994771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:38.304003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:38.316372 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e20462a-0e53-4e5a-8e5c-0375553856f4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1690 microversion: 2.1 time: 0.355351 Oct 27 09:43:38.318114 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3263/6457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:37 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1690 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:39.358371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:39.359410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:39.370053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:39.371085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:39.372261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:39.373381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:39.374159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:39.374890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:39.892026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-161e4c68-e9f9-475b-a9b2-2e42f6409896 req-3de00a11-aadc-47fc-9b5a-3984e2f75505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7130735-fb19-49f2-bdf1-8663e83fdd4a", "name": "network-vif-plugged", "status": "completed", "tag": "57f84ee8-9ac4-4791-84fd-24e83244d60b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:39.908585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-161e4c68-e9f9-475b-a9b2-2e42f6409896 req-3de00a11-aadc-47fc-9b5a-3984e2f75505 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:39.909048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-161e4c68-e9f9-475b-a9b2-2e42f6409896 req-3de00a11-aadc-47fc-9b5a-3984e2f75505 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:39.910108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-161e4c68-e9f9-475b-a9b2-2e42f6409896 req-3de00a11-aadc-47fc-9b5a-3984e2f75505 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:39.918649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:39.929665 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-161e4c68-e9f9-475b-a9b2-2e42f6409896 req-3de00a11-aadc-47fc-9b5a-3984e2f75505 service nova] Creating event network-vif-plugged:57f84ee8-9ac4-4791-84fd-24e83244d60b for instance c7130735-fb19-49f2-bdf1-8663e83fdd4a on n-h2-858383-16 Oct 27 09:43:39.935921 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aac7cd26-1c21-4b2a-9a91-c084662605b2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1682 microversion: 2.1 time: 0.581618 Oct 27 09:43:39.937449 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3195/6458] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:39 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1682 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:39.939649 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-161e4c68-e9f9-475b-a9b2-2e42f6409896 req-3de00a11-aadc-47fc-9b5a-3984e2f75505 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053987 Oct 27 09:43:39.940646 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3264/6459] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:43:40.201235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-763868298", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "98d04f0e-b47f-4358-8c0b-be94327c9e40", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c8f250b0-c481-437b-8054-ee4c9ca61f10"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:40.268615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] validate_networks() for [('c8f250b0-c481-437b-8054-ee4c9ca61f10', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:43:40.795547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:43:40.796634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:43:40.797236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:43:40.798007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:43:40.798760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:43:40.815419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:40.816112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:40.816609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:40.817420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:40.817930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:40.818413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:40.838769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:43:40.845779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for user 9ab30747d0444c32bbc058a522262b62 and project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:43:40.916663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:43:40.919108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98d04f0e-b47f-4358-8c0b-be94327c9e40',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:43:41.112778 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-407fa244-6bbc-4af7-bfbc-4adbd99eae27 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915590 Oct 27 09:43:41.113833 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3196/6460] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:43:41.137950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb28abae-975a-4005-bef9-b6960e3778b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:41.139165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb28abae-975a-4005-bef9-b6960e3778b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:41.220289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb28abae-975a-4005-bef9-b6960e3778b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:41.233286 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb28abae-975a-4005-bef9-b6960e3778b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1070 microversion: 2.1 time: 0.105333 Oct 27 09:43:41.234171 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3265/6461] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:41 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1070 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:42.266902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:42.268211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:42.280389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:42.281312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:42.282130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:42.283628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:42.284585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:42.285344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:42.724353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:42.737821 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c7577f77-11f2-4f25-92e1-9ce7bcea7b3f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1176 microversion: 2.1 time: 0.480963 Oct 27 09:43:42.738801 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3197/6462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:42 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1176 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:43.769455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:43.770220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:43.782210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:43.783900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:43.785063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:43.786864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:43.788136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:43.789236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:43.813256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:44.049605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:44.065563 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6fff3ad8-313b-4746-8b52-b8f3acdfc2be tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1228 microversion: 2.1 time: 0.299752 Oct 27 09:43:44.066801 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3266/6463] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:43 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1228 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:44.568957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-afcf9c75-94c8-4933-9e48-b6b2eb6c3a1c req-fbfa1ca6-8b0f-456d-9654-d24625a4ea35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7ecc11-b969-4850-972e-83db119b2a9c", "tag": "84c51b77-612a-49fb-ac25-0b925a37469d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:44.588294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afcf9c75-94c8-4933-9e48-b6b2eb6c3a1c req-fbfa1ca6-8b0f-456d-9654-d24625a4ea35 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:44.600532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afcf9c75-94c8-4933-9e48-b6b2eb6c3a1c req-fbfa1ca6-8b0f-456d-9654-d24625a4ea35 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:44.601479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afcf9c75-94c8-4933-9e48-b6b2eb6c3a1c req-fbfa1ca6-8b0f-456d-9654-d24625a4ea35 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:44.635267 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-afcf9c75-94c8-4933-9e48-b6b2eb6c3a1c req-fbfa1ca6-8b0f-456d-9654-d24625a4ea35 service nova] Creating event network-changed:84c51b77-612a-49fb-ac25-0b925a37469d for instance 7a7ecc11-b969-4850-972e-83db119b2a9c on n-h2-858383-16 Oct 27 09:43:44.649158 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-afcf9c75-94c8-4933-9e48-b6b2eb6c3a1c req-fbfa1ca6-8b0f-456d-9654-d24625a4ea35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083875 Oct 27 09:43:44.650952 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3198/6464] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:45.103303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:45.107233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:45.123420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:45.124719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:45.126029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:45.128229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:45.130226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:45.131496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:45.424085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:45.433234 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c245e4a8-da60-445d-b848-1544b962ff8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1228 microversion: 2.1 time: 0.337145 Oct 27 09:43:45.444236 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3267/6465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:45 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1228 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:46.461266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:46.462233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:46.469616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:46.470125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:46.470577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:46.471311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:46.471821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:46.472451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:46.475750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=81 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:46.630951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:46.640950 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1a12d0a-8c23-4d29-8d22-d2a5183342a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1228 microversion: 2.1 time: 0.185491 Oct 27 09:43:46.641449 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3199/6466] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:46 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1228 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:47.666884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:47.668086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:47.676226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:47.676727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:47.677169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:47.677892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:47.678351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:47.678787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:47.842788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:47.851442 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-716348cd-3502-4db0-a466-41b18c798a6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1228 microversion: 2.1 time: 0.188525 Oct 27 09:43:47.852090 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3268/6467] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:47 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1228 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:48.875830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:48.876487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:48.883859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:48.884368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:48.884871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:48.885621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:48.886088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:48.887073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:49.032873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:49.041499 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ef8b1b2-943e-4e4a-a305-9383e53aec8d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.169507 Oct 27 09:43:49.042125 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3200/6468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:48 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:50.067863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:50.068895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:50.077292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:50.077783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:50.078229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:50.078969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:50.079439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:50.079944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:50.286921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:50.296422 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e23b7d12-704a-4d1f-876e-46fb76c6aa37 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.234069 Oct 27 09:43:50.296933 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3269/6469] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:50 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:51.322016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:51.323192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:51.327294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:51.328394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:51.336161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:51.336831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:51.337443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:51.338307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:51.338994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:51.340234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:51.509410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:51.518593 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d61e5c05-e7c9-4aa9-ac86-7b405bd14418 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.201130 Oct 27 09:43:51.519215 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3201/6470] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:51 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:52.544590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:52.545388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:52.548167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:52.557458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:52.558915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:52.559735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:52.561272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:52.562109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:52.562904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:52.742812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:52.757876 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e1e66b7-7b96-4f78-971f-65a27593b023 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.217108 Oct 27 09:43:52.758889 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3270/6471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:52 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:53.794091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:53.794893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:53.802404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:53.802899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:53.803339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:53.804097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:53.804566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:53.804994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:53.971960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:53.986692 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c84de053-f33b-4ad0-8eb5-2b089f969ee7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.196136 Oct 27 09:43:53.987796 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3202/6472] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:53 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:55.016772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:55.017904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:55.031119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:55.031996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:55.032777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:55.034074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:55.034909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:55.035703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:55.234327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:55.243702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c908efb6-4a2b-4729-ac0a-95138ec8f6ac tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.234771 Oct 27 09:43:55.244312 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3271/6473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:55 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:56.269283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:56.270420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:56.280920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:56.281777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:56.282531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:56.283799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:56.284482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:56.285048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:56.445376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:56.457328 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd81ddb2-1bdf-44d1-a6e8-2d8367d30b96 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.192922 Oct 27 09:43:56.458404 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3203/6474] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:56 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:57.485293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:57.486239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:57.489201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=32 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:57.497466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:57.497989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:57.498432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:57.499180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:57.499686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:57.500111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:57.669435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:57.678768 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d01ce375-5175-4a48-baa1-fef4ee262eb2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.198027 Oct 27 09:43:57.679423 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3272/6475] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:57 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:58.706206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:58.706851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:58.709784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:58.717190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:58.717762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:58.718552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:58.719515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:58.720135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:58.720664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:58.905923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:58.918308 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c7f2a5a-b2b9-48aa-b9cc-8aa586eef7b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.216117 Oct 27 09:43:58.918915 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3204/6476] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:58 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:59.945813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:59.947172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:59.959261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:59.959968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:59.960532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:59.961599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:59.962231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:59.962851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:59.972361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a47f17ba-74c7-4efe-9341-3cabe7deb97d req-11984bf7-7fb4-4345-a955-0d01f38316b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7ecc11-b969-4850-972e-83db119b2a9c", "name": "network-vif-plugged", "status": "completed", "tag": "84c51b77-612a-49fb-ac25-0b925a37469d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:59.992963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a47f17ba-74c7-4efe-9341-3cabe7deb97d req-11984bf7-7fb4-4345-a955-0d01f38316b5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:59.994284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a47f17ba-74c7-4efe-9341-3cabe7deb97d req-11984bf7-7fb4-4345-a955-0d01f38316b5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:59.995370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a47f17ba-74c7-4efe-9341-3cabe7deb97d req-11984bf7-7fb4-4345-a955-0d01f38316b5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:00.020449 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a47f17ba-74c7-4efe-9341-3cabe7deb97d req-11984bf7-7fb4-4345-a955-0d01f38316b5 service nova] Creating event network-vif-plugged:84c51b77-612a-49fb-ac25-0b925a37469d for instance 7a7ecc11-b969-4850-972e-83db119b2a9c on n-h2-858383-16 Oct 27 09:44:00.029745 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a47f17ba-74c7-4efe-9341-3cabe7deb97d req-11984bf7-7fb4-4345-a955-0d01f38316b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062205 Oct 27 09:44:00.031473 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3205/6477] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:44:00.233699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:00.242324 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c3db097-84f1-4d18-b74a-cd15020b6a91 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.304224 Oct 27 09:44:00.242923 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3273/6478] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:59 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:01.270354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:01.271098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:01.279410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:01.279947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:01.280395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:01.281131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:01.281603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:01.282065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:01.466685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:01.476196 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ee34149-14b3-4f01-b769-f4b610ea27e0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1216 microversion: 2.1 time: 0.210555 Oct 27 09:44:01.476808 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3206/6479] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:01 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1216 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:02.501822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:02.502527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:02.510412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:02.510919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:02.511413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:02.512187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:02.512655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:02.513087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:02.674659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:02.683450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7338cf5-318f-4181-8ee7-09c9b2adc65a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1403 microversion: 2.1 time: 0.185895 Oct 27 09:44:02.684215 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3274/6480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:02 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1403 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:02.708490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:02.709141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:02.717808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:02.718429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:02.718966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:02.719821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:02.720330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:02.720822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:02.880721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:02.890138 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c865eaaa-9195-4f1b-8a3b-cfb3a4a1ca20 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1403 microversion: 2.1 time: 0.185760 Oct 27 09:44:02.890737 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3207/6481] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:02 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1403 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:02.914791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-106807246"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:02.917470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:02.924493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:02.925036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:02.925744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:02.926543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:02.927066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:02.927549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:03.042895 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.api [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Attempting to quiesce instance before volume snapshot. Oct 27 09:44:03.106206 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.api [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 27 09:44:03.187074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Creating snapshot from volume 98d04f0e-b47f-4358-8c0b-be94327c9e40. {{(pid=120602) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 27 09:44:04.485629 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cb01fcb6-7633-4797-84a5-62e0e9d5430a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c/action" status: 202 len: 0 microversion: 2.1 time: 1.575013 Oct 27 09:44:04.486510 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3275/6482] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:44:02 2022] POST /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c/action => generated 0 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 09:44:05.661127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1113773050", "imageRef": "f21787cb-d8a8-4a3b-aa32-014b30e08de5", "flavorRef": "452", "networks": [{"uuid": "c8f250b0-c481-437b-8054-ee4c9ca61f10"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:05.725859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] validate_networks() for [('c8f250b0-c481-437b-8054-ee4c9ca61f10', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:44:06.274255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:44:06.274833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:44:06.275455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:44:06.276014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:44:06.276542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:44:06.287923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:06.288582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:06.289207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:06.290145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:06.290746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:06.291340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:06.312339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:44:06.318749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for user 9ab30747d0444c32bbc058a522262b62 and project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:44:06.334342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:44:06.337206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='94c3d047-6143-4ae2-b5be-8bc486fca1e8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:44:06.426365 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9aa0a503-1a88-42d2-ac1b-116e303d1df1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768834 Oct 27 09:44:06.427532 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3208/6483] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:44:06.449200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5ae4d56a-dadd-457a-90e9-130d1e502579 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:06.451141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5ae4d56a-dadd-457a-90e9-130d1e502579 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:06.531295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5ae4d56a-dadd-457a-90e9-130d1e502579 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:06.542371 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5ae4d56a-dadd-457a-90e9-130d1e502579 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1230 microversion: 2.1 time: 0.100844 Oct 27 09:44:06.544293 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3276/6484] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:06 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:07.571529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:07.572543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:07.581611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:07.582107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:07.582546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:07.583262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:07.583757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:07.584183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:07.669542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:07.684845 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0b165de-3345-4a31-ba6a-1bf1f016f935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1282 microversion: 2.1 time: 0.120525 Oct 27 09:44:07.686292 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3209/6485] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:07 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:08.245365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f4d0ab24-15b6-41ea-b3d6-15570af05685 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:08.252426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f4d0ab24-15b6-41ea-b3d6-15570af05685 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:08.268528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d0ab24-15b6-41ea-b3d6-15570af05685 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:08.269589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d0ab24-15b6-41ea-b3d6-15570af05685 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:08.270507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d0ab24-15b6-41ea-b3d6-15570af05685 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:08.271834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d0ab24-15b6-41ea-b3d6-15570af05685 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:08.272663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d0ab24-15b6-41ea-b3d6-15570af05685 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:08.274461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4d0ab24-15b6-41ea-b3d6-15570af05685 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:08.378849 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f4d0ab24-15b6-41ea-b3d6-15570af05685 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action" status: 200 len: 24582 microversion: 2.1 time: 0.141101 Oct 27 09:44:08.381030 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3277/6486] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:44:08 2022] POST /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a/action => generated 24582 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:44:08.728618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:08.733601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:08.749679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:08.750922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:08.752130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:08.753879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:08.755120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:08.756268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:09.335642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:09.357306 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1e03763-edb9-4c80-b8b5-6ef42fc9b76f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.637139 Oct 27 09:44:09.359445 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3210/6487] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:08 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:10.402807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:10.404541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:10.419246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:10.421697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:10.422637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:10.424135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:10.425169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:10.426124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:10.737212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:10.755513 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d2bee834-fa5d-49f5-b1d8-d88e7cd45b0b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.362597 Oct 27 09:44:10.771641 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3278/6488] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:10 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:10.816949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6fc66bed-25af-4cb5-a92c-c5b06b5c08bb req-0d646e42-c13a-4155-be9a-5dee8d7c20c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fae2d04-d65a-415e-8e38-5531aed6b2f0", "tag": "832a7c2e-ee99-4d48-8eb3-87367a6b678c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:10.830463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6fc66bed-25af-4cb5-a92c-c5b06b5c08bb req-0d646e42-c13a-4155-be9a-5dee8d7c20c7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:10.831250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6fc66bed-25af-4cb5-a92c-c5b06b5c08bb req-0d646e42-c13a-4155-be9a-5dee8d7c20c7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:10.831927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6fc66bed-25af-4cb5-a92c-c5b06b5c08bb req-0d646e42-c13a-4155-be9a-5dee8d7c20c7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:10.861249 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6fc66bed-25af-4cb5-a92c-c5b06b5c08bb req-0d646e42-c13a-4155-be9a-5dee8d7c20c7 service nova] Creating event network-changed:832a7c2e-ee99-4d48-8eb3-87367a6b678c for instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 on n-h1-858383-16 Oct 27 09:44:10.868721 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6fc66bed-25af-4cb5-a92c-c5b06b5c08bb req-0d646e42-c13a-4155-be9a-5dee8d7c20c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056509 Oct 27 09:44:10.871730 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3211/6489] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:44:11.799544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:11.800628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:11.810752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:11.811544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:11.812826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:11.813760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:11.814354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:11.815038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:12.086320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:12.099733 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d89156d1-9b66-4e25-988b-88c2574d14c3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.304863 Oct 27 09:44:12.100818 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3279/6490] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:11 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:13.141375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:13.143034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:13.154734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.155910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.156691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.158215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.159207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.160151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.290842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-435b5293-d5c0-45d5-aeff-ecba0e6b2017 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:13.297033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-435b5293-d5c0-45d5-aeff-ecba0e6b2017 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:13.316809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-435b5293-d5c0-45d5-aeff-ecba0e6b2017 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.318044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-435b5293-d5c0-45d5-aeff-ecba0e6b2017 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.318871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-435b5293-d5c0-45d5-aeff-ecba0e6b2017 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.320694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-435b5293-d5c0-45d5-aeff-ecba0e6b2017 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.321618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-435b5293-d5c0-45d5-aeff-ecba0e6b2017 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.322650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-435b5293-d5c0-45d5-aeff-ecba0e6b2017 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.392848 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-435b5293-d5c0-45d5-aeff-ecba0e6b2017 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18/ips" status: 200 len: 150 microversion: 2.1 time: 0.112868 Oct 27 09:44:13.394133 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3280/6491] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:44:13 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18/ips => generated 150 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:13.413857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85bee3c1-8d41-45ea-8a37-c402f2b75f44"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:13.420330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:13.434153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.435203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.437966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.440344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.441592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.448378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.454661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:13.468609 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab1a578a-be17-416e-9381-f700c92ec4a5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.340948 Oct 27 09:44:13.469944 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3212/6492] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:13 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:13.581403 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Invalid volume: volume 85bee3c1-8d41-45ea-8a37-c402f2b75f44 is already attached to instances: af38803d-9721-430f-82f0-b4d1d5ac1bda Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18/os-volume_attachments HTTP/1.1 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 74 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: {"volumeAttachment": {"volumeId": "85bee3c1-8d41-45ea-8a37-c402f2b75f44"}} Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid volume: volume 85bee3c1-8d41-45ea-8a37-c402f2b75f44 is already attached to instances: af38803d-9721-430f-82f0-b4d1d5ac1bda Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'server_id': 'dcea22af-75e3-48e1-b4ab-0ea49995bb18', 'body': {'volumeAttachment': {'volumeId': '85bee3c1-8d41-45ea-8a37-c402f2b75f44'}}} Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in attach_volume Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4971, in _check_volume_already_attached Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 85bee3c1-8d41-45ea-8a37-c402f2b75f44 is already attached to instances: af38803d-9721-430f-82f0-b4d1d5ac1bda Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:44:13.585030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 85bee3c1-8d41-45ea-8a37-c402f2b75f44 is already attached to instances: af38803d-9721-430f-82f0-b4d1d5ac1bda Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 85bee3c1-8d41-45ea-8a37-c402f2b75f44 is already attached to instances: af38803d-9721-430f-82f0-b4d1d5ac1bda Oct 27 09:44:13.590962 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:13.593783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 400 to user: Invalid volume: volume 85bee3c1-8d41-45ea-8a37-c402f2b75f44 is already attached to instances: af38803d-9721-430f-82f0-b4d1d5ac1bda {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:13.594757 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c21817f-8a02-4abf-9802-9a2b28eaf5bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.190729 Oct 27 09:44:13.596215 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3281/6493] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:44:13 2022] POST /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18/os-volume_attachments => generated 174 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:44:13.610665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:13.611235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:13.618189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.618744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.619237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.620062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.620589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.621621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.663589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:44:13.854750 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4232e71e-d3d6-4c68-a98b-22c8cc298279 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 204 len: 0 microversion: 2.1 time: 0.245452 Oct 27 09:44:13.858347 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3213/6494] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:13 2022] DELETE /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:44:13.869817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:13.870598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:13.882169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.882961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.883717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.885909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.885909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.887233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.891796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:14.162655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:14.187497 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57d2db8c-2174-4994-aa77-900a9f860df5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1682 microversion: 2.1 time: 0.323391 Oct 27 09:44:14.198281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3282/6495] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:13 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1682 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:14.533527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:14.534833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:14.551401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.552975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.554432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:14.555370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.556318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.556622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:14.822853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:14.840955 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc853248-0b7b-45be-bf5c-cf429a044239 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.309274 Oct 27 09:44:14.842089 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3214/6496] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:14 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:15.222165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:15.222165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:15.236712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:15.238119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:15.239004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:15.241004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:15.242089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:15.243558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:15.696117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:15.737149 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99c3510a-52e9-412d-be0c-258fcd261cfa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1682 microversion: 2.1 time: 0.520379 Oct 27 09:44:15.738465 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3283/6497] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:15 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1682 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:15.881844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:15.882927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:15.895877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:15.897076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:15.897789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:15.899283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:15.900500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:15.901546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:16.301104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:16.327271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:16.345338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:16.363207 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e9b65c82-98c6-45a8-b07e-b6fa2377d088 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.484561 Oct 27 09:44:16.365549 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3215/6498] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:15 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:16.776738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:16.783062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:16.783894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:16.800500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:16.801463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:16.802196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:16.804261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:16.805753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:16.806506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:17.007718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:17.021285 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-426f72ee-5b1d-4159-bde3-cc14399f74bb tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1615 microversion: 2.1 time: 0.246087 Oct 27 09:44:17.021873 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3284/6499] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:16 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1615 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:17.397170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:17.402686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:17.418591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:17.419932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:17.421238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:17.422811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:17.423969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:17.425030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:17.434646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:17.513502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-957b9c0b-9104-44c3-9228-a3db0979999e req-83b7eb10-9446-4d58-a2b0-b83f216277d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcea22af-75e3-48e1-b4ab-0ea49995bb18", "name": "network-vif-deleted", "tag": "6b316f6c-6e06-4b5c-92e8-bed68a4d8540"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:17.532750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-957b9c0b-9104-44c3-9228-a3db0979999e req-83b7eb10-9446-4d58-a2b0-b83f216277d2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:17.533421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-957b9c0b-9104-44c3-9228-a3db0979999e req-83b7eb10-9446-4d58-a2b0-b83f216277d2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:17.534242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-957b9c0b-9104-44c3-9228-a3db0979999e req-83b7eb10-9446-4d58-a2b0-b83f216277d2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:17.557653 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-957b9c0b-9104-44c3-9228-a3db0979999e req-83b7eb10-9446-4d58-a2b0-b83f216277d2 service nova] Creating event network-vif-deleted:6b316f6c-6e06-4b5c-92e8-bed68a4d8540 for instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 on n-h1-858383-16 Oct 27 09:44:17.567697 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-957b9c0b-9104-44c3-9228-a3db0979999e req-83b7eb10-9446-4d58-a2b0-b83f216277d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061689 Oct 27 09:44:17.570084 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3285/6500] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:17.739667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:17.754653 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ed94adc-ffa9-4547-a934-c88afe81ac5f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.365623 Oct 27 09:44:17.763626 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3216/6501] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:17 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:18.076594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:18.078620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:18.094032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:18.094667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:18.095464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:18.096518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:18.097279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:18.097951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:18.177646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:18.179321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:18.179677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:18.181466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lazy-loading 'fault' on Instance uuid dcea22af-75e3-48e1-b4ab-0ea49995bb18 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:44:18.282144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:18.300649 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d8563848-9c7a-4ceb-aac9-5e6d263cfd09 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 200 len: 1332 microversion: 2.1 time: 0.233364 Oct 27 09:44:18.301653 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3286/6502] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:18 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 1332 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:18.800255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:18.802763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:18.818116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:18.819980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:18.820897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:18.822753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:18.824113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:18.825583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:19.154089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:19.165341 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0157daff-e3c6-4543-a5cf-e27c41ad8ac7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.374543 Oct 27 09:44:19.196273 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3217/6503] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:18 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:19.353981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:19.357892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:19.374338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:19.375386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:19.376447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:19.378201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:19.379528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:19.380403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:19.402893 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 HTTP/1.1 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'dcea22af-75e3-48e1-b4ab-0ea49995bb18'} Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:19.405224 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.410000 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:19.410000 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:19.410000 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:19.410000 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:19.410000 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:19.410000 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:44:19.410000 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.412906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:19.422351 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a94aa215-695b-4a32-bcc9-a14145901cb9 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 404 len: 111 microversion: 2.1 time: 0.070786 Oct 27 09:44:19.423550 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3287/6504] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:19 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:19.443119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-da045a36-44d8-44db-82f3-149a7e05eb90 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '.version_select at 0x7f31a8ee3ee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:19.499434 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-da045a36-44d8-44db-82f3-149a7e05eb90 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568324395" status: 202 len: 0 microversion: 2.1 time: 0.066458 Oct 27 09:44:19.505921 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3218/6505] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 09:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568324395 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:44:20.202303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:20.202969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:20.210294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:20.210802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:20.211254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:20.212030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:20.212507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:20.212943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:20.565663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:20.574666 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b7fd9a00-454e-4a82-a73c-ab08c48a67a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.376101 Oct 27 09:44:20.575391 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3288/6506] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:20 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:20.877243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:20.878114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:20.885349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:20.886090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:20.886547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:20.887851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:20.888442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:20.888913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:20.974502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lazy-loading 'services' on Instance uuid af38803d-9721-430f-82f0-b4d1d5ac1bda {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:44:21.068306 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f7ed9b2-2a05-4ba0-b43a-11ed32870ed7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments/85bee3c1-8d41-45ea-8a37-c402f2b75f44" status: 202 len: 0 microversion: 2.1 time: 0.195719 Oct 27 09:44:21.069337 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3219/6507] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:44:20 2022] DELETE /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments/85bee3c1-8d41-45ea-8a37-c402f2b75f44 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:44:21.079278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7cbc0dd8-6cb8-4b08-b1e4-d08929e2dc6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:21.082882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7cbc0dd8-6cb8-4b08-b1e4-d08929e2dc6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:21.090167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cbc0dd8-6cb8-4b08-b1e4-d08929e2dc6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.090705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cbc0dd8-6cb8-4b08-b1e4-d08929e2dc6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.091163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cbc0dd8-6cb8-4b08-b1e4-d08929e2dc6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.091949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cbc0dd8-6cb8-4b08-b1e4-d08929e2dc6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.092429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cbc0dd8-6cb8-4b08-b1e4-d08929e2dc6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.092875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7cbc0dd8-6cb8-4b08-b1e4-d08929e2dc6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.131295 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7cbc0dd8-6cb8-4b08-b1e4-d08929e2dc6f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057165 Oct 27 09:44:21.135669 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3289/6508] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:44:21 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:21.604610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:21.606878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:21.617272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.617778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.618422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.619153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.619642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.620079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.835463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:21.852476 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc76b412-0b2d-4717-875d-9acba449d9f5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.255874 Oct 27 09:44:21.853364 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3220/6509] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:21 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:22.149373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64797fce-5c32-4cfb-a3f5-73643e484ddc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:22.153857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64797fce-5c32-4cfb-a3f5-73643e484ddc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:22.165211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64797fce-5c32-4cfb-a3f5-73643e484ddc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.166325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64797fce-5c32-4cfb-a3f5-73643e484ddc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.167012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64797fce-5c32-4cfb-a3f5-73643e484ddc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.168665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64797fce-5c32-4cfb-a3f5-73643e484ddc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.169533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64797fce-5c32-4cfb-a3f5-73643e484ddc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.170467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64797fce-5c32-4cfb-a3f5-73643e484ddc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.232458 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64797fce-5c32-4cfb-a3f5-73643e484ddc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089175 Oct 27 09:44:22.237618 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3290/6510] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:44:22 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:22.889139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:22.889676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:22.897370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.897873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.898550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.899342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.899970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.900405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.092646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:23.106618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-98e64dc5-840a-4490-93ec-cf61d1779be5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.220614 Oct 27 09:44:23.107695 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3221/6511] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:22 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:23.246052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-54ad6833-ddc0-4943-a847-89301beb4e7f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:23.248349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-54ad6833-ddc0-4943-a847-89301beb4e7f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:23.255942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54ad6833-ddc0-4943-a847-89301beb4e7f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.256453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54ad6833-ddc0-4943-a847-89301beb4e7f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.256938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54ad6833-ddc0-4943-a847-89301beb4e7f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.257673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54ad6833-ddc0-4943-a847-89301beb4e7f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.258271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54ad6833-ddc0-4943-a847-89301beb4e7f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.258750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54ad6833-ddc0-4943-a847-89301beb4e7f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.296802 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-54ad6833-ddc0-4943-a847-89301beb4e7f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055021 Oct 27 09:44:23.297438 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3291/6512] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:44:23 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:24.142539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:24.143796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:24.156229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:24.157132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:24.157952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:24.159260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:24.160166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:24.161028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:24.318217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f8a09225-c0bc-47db-8a23-94bf8eafabd8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:24.323150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f8a09225-c0bc-47db-8a23-94bf8eafabd8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:24.337152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8a09225-c0bc-47db-8a23-94bf8eafabd8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:24.338258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8a09225-c0bc-47db-8a23-94bf8eafabd8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:24.339848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8a09225-c0bc-47db-8a23-94bf8eafabd8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:24.341494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8a09225-c0bc-47db-8a23-94bf8eafabd8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:24.342486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8a09225-c0bc-47db-8a23-94bf8eafabd8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:24.343483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8a09225-c0bc-47db-8a23-94bf8eafabd8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:24.400539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:24.413368 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f8a09225-c0bc-47db-8a23-94bf8eafabd8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104516 Oct 27 09:44:24.415561 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3292/6513] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:44:24 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:24.419683 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b19c9e9d-a613-4c47-ad1e-7a690f61f657 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.285855 Oct 27 09:44:24.420752 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3222/6514] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:24 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:24.591153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bf859e2a-802f-4cb0-b006-a0038e203f64 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:24.592054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bf859e2a-802f-4cb0-b006-a0038e203f64 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:24.600211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf859e2a-802f-4cb0-b006-a0038e203f64 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:24.600853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf859e2a-802f-4cb0-b006-a0038e203f64 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:24.601424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf859e2a-802f-4cb0-b006-a0038e203f64 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:24.602579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf859e2a-802f-4cb0-b006-a0038e203f64 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:24.603714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf859e2a-802f-4cb0-b006-a0038e203f64 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:24.604534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf859e2a-802f-4cb0-b006-a0038e203f64 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:24.843010 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bf859e2a-802f-4cb0-b006-a0038e203f64 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1835 microversion: 2.1 time: 0.256113 Oct 27 09:44:24.844199 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3293/6515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:24 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1835 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:25.428162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91c0f586-63c1-42d1-924c-bd8e691e0331 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:25.431697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91c0f586-63c1-42d1-924c-bd8e691e0331 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:25.440219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91c0f586-63c1-42d1-924c-bd8e691e0331 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.440941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91c0f586-63c1-42d1-924c-bd8e691e0331 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.441398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91c0f586-63c1-42d1-924c-bd8e691e0331 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.442323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91c0f586-63c1-42d1-924c-bd8e691e0331 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.442806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91c0f586-63c1-42d1-924c-bd8e691e0331 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.443442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91c0f586-63c1-42d1-924c-bd8e691e0331 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.459182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:25.461413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:25.476085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.477060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.477492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.480079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.482719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.483520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.489039 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91c0f586-63c1-42d1-924c-bd8e691e0331 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065309 Oct 27 09:44:25.494673 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3223/6516] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:44:25 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:25.686660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:25.695729 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7ee0c8cb-b056-4001-92e1-8bcb49c31482 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.240662 Oct 27 09:44:25.708712 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3294/6517] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:25 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:26.180440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-60a80742-d17f-4373-b0d4-e018e8e2fb4f req-7b437243-063f-4de2-ad47-c9ce488307f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7130735-fb19-49f2-bdf1-8663e83fdd4a", "tag": "57f84ee8-9ac4-4791-84fd-24e83244d60b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:26.187172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:26.189882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:26.192264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-60a80742-d17f-4373-b0d4-e018e8e2fb4f req-7b437243-063f-4de2-ad47-c9ce488307f8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.192765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-60a80742-d17f-4373-b0d4-e018e8e2fb4f req-7b437243-063f-4de2-ad47-c9ce488307f8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.193218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-60a80742-d17f-4373-b0d4-e018e8e2fb4f req-7b437243-063f-4de2-ad47-c9ce488307f8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.204602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.205625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.206744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.207344 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-60a80742-d17f-4373-b0d4-e018e8e2fb4f req-7b437243-063f-4de2-ad47-c9ce488307f8 service nova] Creating event network-changed:57f84ee8-9ac4-4791-84fd-24e83244d60b for instance c7130735-fb19-49f2-bdf1-8663e83fdd4a on n-h2-858383-16 Oct 27 09:44:26.208242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.209385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.210885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.213309 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-60a80742-d17f-4373-b0d4-e018e8e2fb4f req-7b437243-063f-4de2-ad47-c9ce488307f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036786 Oct 27 09:44:26.217759 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3295/6518] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:44:26.278760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:44:26.507331 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db4f12f3-6aa3-4344-a6a5-d56213d476bd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 204 len: 0 microversion: 2.1 time: 0.332282 Oct 27 09:44:26.508021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e69b39a-1f6a-4aeb-bea0-538216775b75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:26.511545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e69b39a-1f6a-4aeb-bea0-538216775b75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:26.517160 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3224/6519] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:26 2022] DELETE /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:44:26.523735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e69b39a-1f6a-4aeb-bea0-538216775b75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.524505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e69b39a-1f6a-4aeb-bea0-538216775b75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.525036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e69b39a-1f6a-4aeb-bea0-538216775b75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.526178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e69b39a-1f6a-4aeb-bea0-538216775b75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.526973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e69b39a-1f6a-4aeb-bea0-538216775b75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.527876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e69b39a-1f6a-4aeb-bea0-538216775b75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.542003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:26.543966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:26.562054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.563246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.564202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.565557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.566425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.567263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.578237 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e69b39a-1f6a-4aeb-bea0-538216775b75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077528 Oct 27 09:44:26.579257 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3296/6520] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:44:26 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:26.737170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:26.738211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:26.747474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.748334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.749988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.752270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.753537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.754224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.935943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:26.945935 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebfbf88d-f1b5-4d94-8b03-6c83fd067531 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1688 microversion: 2.1 time: 0.423846 Oct 27 09:44:26.946825 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3225/6521] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:26 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1688 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:27.009160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:27.020248 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8a93d227-6b5c-4a40-83c8-5b9e6c74d1cc tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.289753 Oct 27 09:44:27.038009 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3297/6522] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:26 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:27.595916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd673f71-0437-45c6-9fc5-48aa44b7a6c6 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:27.598387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd673f71-0437-45c6-9fc5-48aa44b7a6c6 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:27.610134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd673f71-0437-45c6-9fc5-48aa44b7a6c6 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:27.610645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd673f71-0437-45c6-9fc5-48aa44b7a6c6 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:27.611115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd673f71-0437-45c6-9fc5-48aa44b7a6c6 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:27.611888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd673f71-0437-45c6-9fc5-48aa44b7a6c6 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:27.612373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd673f71-0437-45c6-9fc5-48aa44b7a6c6 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:27.612816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd673f71-0437-45c6-9fc5-48aa44b7a6c6 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:27.664925 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd673f71-0437-45c6-9fc5-48aa44b7a6c6 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073142 Oct 27 09:44:27.668911 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3226/6523] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:44:27 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:44:27.799039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:27.799870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:27.805652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=56 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:27.817354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:27.818264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:27.819084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:27.820644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:27.821340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:27.822162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:27.879793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:44:27.975097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:27.976296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:27.981935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:28.000529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.001388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.002186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.003546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.004379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.005169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.036924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3498d51f-905c-4f48-8f40-80747d9b734c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 204 len: 0 microversion: 2.1 time: 0.245631 Oct 27 09:44:28.038574 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3298/6524] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:27 2022] DELETE /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:44:28.057186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:28.059003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:28.069533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.070554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.071224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.072581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.073453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.074790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.792413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:28.808200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:28.826253 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9b390c56-df53-4994-8d3e-6ce9d6db675d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.780328 Oct 27 09:44:28.827511 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3299/6525] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:28 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:28.843146 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f7fe20c8-bf4a-49f2-9a5d-0c9240536f6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 200 len: 1688 microversion: 2.1 time: 0.873626 Oct 27 09:44:28.845069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:28.846366 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3227/6526] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:27 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 1688 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:28.849436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:28.866957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.868255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.869179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.871471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.873039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.874376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.881484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5b3536ed-0995-4642-9a46-d3862eb91ced req-6620f1dc-ac35-4518-9ab7-ed85465032a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7130735-fb19-49f2-bdf1-8663e83fdd4a", "name": "network-vif-deleted", "tag": "57f84ee8-9ac4-4791-84fd-24e83244d60b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:28.899891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:28.905367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5b3536ed-0995-4642-9a46-d3862eb91ced req-6620f1dc-ac35-4518-9ab7-ed85465032a2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.907925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5b3536ed-0995-4642-9a46-d3862eb91ced req-6620f1dc-ac35-4518-9ab7-ed85465032a2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.909636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5b3536ed-0995-4642-9a46-d3862eb91ced req-6620f1dc-ac35-4518-9ab7-ed85465032a2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.940523 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5b3536ed-0995-4642-9a46-d3862eb91ced req-6620f1dc-ac35-4518-9ab7-ed85465032a2 service nova] Creating event network-vif-deleted:57f84ee8-9ac4-4791-84fd-24e83244d60b for instance c7130735-fb19-49f2-bdf1-8663e83fdd4a on n-h2-858383-16 Oct 27 09:44:28.954399 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5b3536ed-0995-4642-9a46-d3862eb91ced req-6620f1dc-ac35-4518-9ab7-ed85465032a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083408 Oct 27 09:44:28.958440 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3228/6527] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:29.171385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:29.187718 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-396bead9-e3ef-4559-80ce-e99a5916e7ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1681 microversion: 2.1 time: 0.357660 Oct 27 09:44:29.191777 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3300/6528] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:28 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1681 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:29.861963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:29.863558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:29.878744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:29.879254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:29.879740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:29.880264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:29.881249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:29.881722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: c7130735-fb19-49f2-bdf1-8663e83fdd4a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:29.882196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:29.882831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:29.895642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:29.897303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:29.899018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:29.901067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:29.903228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:29.905791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:29.937284 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] HTTP exception thrown: Instance c7130735-fb19-49f2-bdf1-8663e83fdd4a could not be found. Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Request method failure captured: Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a HTTP/1.1 Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlJDSDr1-dsqc3eIUxJ-ieGNeGuhoA4wiY87ragx5kgzDbmJPZslaWdKO1pfCvcYDg6uLTzYhdhl4rSHxTWFf8hu3m-L8rwhHSJeogWLh_KnZWQIRCt2iFkzdspz6TyfdjSpyMD7SVxi8wkEcfqhvYbzSnsfNPvnknwpLkoqydKNQL4 Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: f7fdcfbb223c44e693f100b3717522cf Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7fdcfbb223c44e693f100b3717522cf"}]}] Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: f7fdcfbb223c44e693f100b3717522cf Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestNetworkAdvancedServerOps-476394632-project Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0d83fee6e4854240b13a10c262453b32 Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestNetworkAdvancedServerOps-476394632-project Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance c7130735-fb19-49f2-bdf1-8663e83fdd4a could not be found. Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'c7130735-fb19-49f2-bdf1-8663e83fdd4a'} Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7130735-fb19-49f2-bdf1-8663e83fdd4a could not be found. Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7130735-fb19-49f2-bdf1-8663e83fdd4a could not be found. Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.941547 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7130735-fb19-49f2-bdf1-8663e83fdd4a could not be found. Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Returning 404 to user: Instance c7130735-fb19-49f2-bdf1-8663e83fdd4a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0a8580e-745c-4442-a799-3dad63fea0a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a" status: 404 len: 111 microversion: 2.1 time: 0.071517 Oct 27 09:44:29.952083 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3301/6529] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:29 2022] GET /compute/v2.1/servers/c7130735-fb19-49f2-bdf1-8663e83fdd4a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:44:30.230525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:30.231523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:30.242684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:30.244320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:30.245178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:30.246547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:30.249257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:30.250359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:30.259460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:30.271182 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-539ca184-c9ae-4e8a-bbdc-9854e2033cdf tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.420081 Oct 27 09:44:30.272899 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3229/6530] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:29 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:30.696096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:30.711595 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-449505ba-8238-45af-9f0a-033bccb89c5e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1681 microversion: 2.1 time: 0.488325 Oct 27 09:44:30.713406 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3302/6531] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:30 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1681 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:31.299881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:31.300938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:31.315530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:31.316626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:31.317358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:31.318507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:31.319469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:31.320322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:31.755438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:31.756920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:31.783748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:31.784663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:31.785484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:31.786945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:31.800059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:31.801153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:32.040605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:32.078928 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5dab4dd1-6fa6-416c-9192-dd90c4908037 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 200 len: 1614 microversion: 2.1 time: 0.343171 Oct 27 09:44:32.085339 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3303/6532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:31 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 1614 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:32.099040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-79600ca7-7e83-436e-9a7f-450d2eae8754 req-08dd8367-605c-4f8b-b4b6-c347f8e171e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af38803d-9721-430f-82f0-b4d1d5ac1bda", "name": "network-vif-deleted", "tag": "0ba8a8fb-0ceb-4ac4-bb71-e336f8cc31b7"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:32.141317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-79600ca7-7e83-436e-9a7f-450d2eae8754 req-08dd8367-605c-4f8b-b4b6-c347f8e171e7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:32.151556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-79600ca7-7e83-436e-9a7f-450d2eae8754 req-08dd8367-605c-4f8b-b4b6-c347f8e171e7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:32.152763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-79600ca7-7e83-436e-9a7f-450d2eae8754 req-08dd8367-605c-4f8b-b4b6-c347f8e171e7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:32.157220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:32.175076 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-79600ca7-7e83-436e-9a7f-450d2eae8754 req-08dd8367-605c-4f8b-b4b6-c347f8e171e7 service nova] Creating event network-vif-deleted:0ba8a8fb-0ceb-4ac4-bb71-e336f8cc31b7 for instance af38803d-9721-430f-82f0-b4d1d5ac1bda on n-h1-858383-16 Oct 27 09:44:32.178231 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1d35f73-bdb9-4faa-ad9f-3a820481c8bb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1342 microversion: 2.1 time: 0.885586 Oct 27 09:44:32.180358 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3230/6533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:31 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1342 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:32.207444 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-79600ca7-7e83-436e-9a7f-450d2eae8754 req-08dd8367-605c-4f8b-b4b6-c347f8e171e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111705 Oct 27 09:44:32.210803 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3304/6534] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:33.134930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:33.138915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:33.181109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.189328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.192169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.207625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.209217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.210360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.221254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:33.222589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:33.239858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.243435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.244254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.245391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.248305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.249078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.270640 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda HTTP/1.1 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'af38803d-9721-430f-82f0-b4d1d5ac1bda'} Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.275543 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.286889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.286889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.286889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.286889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:33.286889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:33.286889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:44:33.286889 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.298570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:33.305675 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-de44d137-e518-47d5-9ed4-46494a67d525 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 404 len: 111 microversion: 2.1 time: 0.182463 Oct 27 09:44:33.307243 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3231/6535] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:33 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:44:33.322796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-da535817-26f6-451a-aed1-605d68b2e7fc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '.version_select at 0x7f31aa13f8b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:33.415941 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-da535817-26f6-451a-aed1-605d68b2e7fc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671538543" status: 202 len: 0 microversion: 2.1 time: 0.100099 Oct 27 09:44:33.430258 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3232/6536] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 09:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671538543 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:44:33.660240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:33.684408 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a7d3cc05-f799-4c9c-a497-1bf4f1496540 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1388 microversion: 2.1 time: 0.465275 Oct 27 09:44:33.685443 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3305/6537] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:33 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1388 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:34.628696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc75bf26-e755-4427-a40a-d201a30d192f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: .version_select at 0x7f31a8f52550>, body: {"keypair": {"name": "tempest-keypair-830277233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAlr8M/9mWSMOstAV65xDJb5EjqYq1n9HECymrCpreqFeiT+/4XIvdzLi7yiWkveIW021zcfyUcfYspBwkm0qKyWaRW+Q06hnQTpTr/1XJVpcrCf3+9cHNFaQWDKBfK6g=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:34.653543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-cc75bf26-e755-4427-a40a-d201a30d192f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for project a82209ade47d45dfa83c52c24366f737. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:44:34.660059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-cc75bf26-e755-4427-a40a-d201a30d192f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for user 485ee99d7fbd4f359824aff38966a868 and project a82209ade47d45dfa83c52c24366f737. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:44:34.693156 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc75bf26-e755-4427-a40a-d201a30d192f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076005 Oct 27 09:44:34.694103 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3233/6538] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:44:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:34.725448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:34.727054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:34.735622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:34.736589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:34.737375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:34.738489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:34.739203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:34.739960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:35.039901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:35.059968 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6845db6d-6b0c-42a8-bade-9de40470a4ce tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.338324 Oct 27 09:44:35.071646 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3306/6539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:34 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:36.090832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:36.092617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:36.102554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:36.103401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:36.104376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:36.105947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:36.107056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:36.107904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:36.432030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:36.462807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:36.467311 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e071bb8c-f3b9-4d18-a11f-0c3911d2bb58 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.382663 Oct 27 09:44:36.470389 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3234/6540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:36 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:36.757611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98e367bf-e6f6-417b-85bd-414b3e4ff7f7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '.version_select at 0x7f31aa18da60>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:36.800619 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98e367bf-e6f6-417b-85bd-414b3e4ff7f7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-143302509" status: 202 len: 0 microversion: 2.1 time: 0.047326 Oct 27 09:44:36.802094 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3307/6541] 10.222.0.25 () {58 vars in 1281 bytes} [Thu Oct 27 09:44:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-143302509 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:44:36.836694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74892c3b-cbd7-4032-816f-58d6d74650e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'create', calling method: .version_select at 0x7f31aa7709d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-313269589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGZoGgBQwZ0c/k09fdQZx/mG1Gkdxab//n/JFpLeNjjQpIUO0FB6+vtVtcvVfVna3QF5Rxl8ql+Q+iTWKgJfa6InrjvgZbwqeWCf8UGqVB+mBGVm6mXbQCc+GDSxkoNZQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:36.860885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-74892c3b-cbd7-4032-816f-58d6d74650e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for project f7fdcfbb223c44e693f100b3717522cf. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:44:36.868147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-74892c3b-cbd7-4032-816f-58d6d74650e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for user 0d83fee6e4854240b13a10c262453b32 and project f7fdcfbb223c44e693f100b3717522cf. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:44:36.902862 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-74892c3b-cbd7-4032-816f-58d6d74650e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.072178 Oct 27 09:44:36.904107 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3235/6542] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:44:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:37.321472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-253838549", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0dbda36-c7d7-4d8b-8839-e59a3043c05d"}], "security_groups": [{"name": "tempest-securitygroup--1376007526"}], "key_name": "tempest-keypair-830277233", "user_data": "}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:37.499271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:37.500384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:37.508230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:37.508828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:37.509375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:37.510207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:37.510744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:37.511628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:37.521847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] validate_networks() for [('d0dbda36-c7d7-4d8b-8839-e59a3043c05d', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:44:37.861528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:37.874547 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91ff2eca-8793-4c16-bea4-a80c3fe9facb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.382379 Oct 27 09:44:37.876158 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3236/6543] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:37 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:38.307633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:44:38.308708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:44:38.309480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:44:38.310566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:44:38.311291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:44:38.324290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:38.325652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:38.326889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:38.328566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:38.329399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:38.330053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:38.364581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for project a82209ade47d45dfa83c52c24366f737. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:44:38.376012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for user 485ee99d7fbd4f359824aff38966a868 and project a82209ade47d45dfa83c52c24366f737. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:44:38.401437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:44:38.405718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:44:38.495831 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3e2c3c4e-7a86-4a6a-8a63-a3d529454af0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.177939 Oct 27 09:44:38.497747 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3308/6544] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:44:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:44:38.515833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c3aa2ec-e212-445d-a6f5-de9ac2324556 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:38.517959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c3aa2ec-e212-445d-a6f5-de9ac2324556 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:38.700513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c3aa2ec-e212-445d-a6f5-de9ac2324556 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:38.725125 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c3aa2ec-e212-445d-a6f5-de9ac2324556 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1240 microversion: 2.1 time: 0.219020 Oct 27 09:44:38.726091 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3237/6545] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:38 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1240 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:38.903217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:38.904149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:38.917467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:38.918305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:38.918835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:38.919994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:38.920605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:38.921456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:39.197867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:39.211216 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f1d03ef-e360-4d2e-a466-ad72633da8a3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.313757 Oct 27 09:44:39.212376 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3309/6546] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:38 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:39.751156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:39.752083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:39.762823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:39.763328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:39.763994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:39.764710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:39.765352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:39.765820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:39.870023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:39.886526 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8876be0d-05a2-4212-8512-624231d7bd23 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1292 microversion: 2.1 time: 0.139920 Oct 27 09:44:39.888219 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3238/6547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:39 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1292 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:40.240461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:40.241615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:40.253104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:40.254072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:40.254660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:40.255733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:40.256345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:40.257044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:40.431467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:40.445163 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1815eee7-a866-4840-884c-dea5df8afb2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.211099 Oct 27 09:44:40.446180 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3310/6548] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:40 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:40.918269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:40.919415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:40.929596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:40.930342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:40.931077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:40.932096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:40.934080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:40.935096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:41.033620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:41.044337 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29156d26-16f3-46aa-8258-41d30085350c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1298 microversion: 2.1 time: 0.132209 Oct 27 09:44:41.044979 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3239/6549] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:40 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:41.471090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:41.472191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:41.480063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:41.481184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:41.481720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:41.482477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:41.482963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:41.483404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:41.666516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:41.682455 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33c6a1e9-42de-4fcf-9d1d-378fe9f6ecd2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.215503 Oct 27 09:44:41.684440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3311/6550] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:41 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:42.094327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:42.098029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:42.117377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:42.119074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:42.120309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:42.124144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:42.126254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:42.128933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:42.733562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:42.759640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:42.764748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:42.796392 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa5e2e10-9f07-4023-992b-5226260f9c35 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1366 microversion: 2.1 time: 0.713191 Oct 27 09:44:42.797612 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3240/6551] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:42 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1366 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:42.801016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:42.802423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:42.803666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:42.805470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:42.806635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:42.807779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:43.230052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:43.255012 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-704860db-d310-469d-834a-13a2ff1a5fa0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.530585 Oct 27 09:44:43.257169 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3312/6552] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:42 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:43.504024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f1a2a07f-22d2-4293-88c4-caf5052386e0 req-32f47f8c-bbbd-4954-95ea-d27eeb0c961d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e65655e-5c79-4a4c-a5bb-f1d9ae55c471", "tag": "d6829278-2f28-4bca-b1a9-9428e14f924e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:43.527838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f1a2a07f-22d2-4293-88c4-caf5052386e0 req-32f47f8c-bbbd-4954-95ea-d27eeb0c961d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:43.528635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f1a2a07f-22d2-4293-88c4-caf5052386e0 req-32f47f8c-bbbd-4954-95ea-d27eeb0c961d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:43.529238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f1a2a07f-22d2-4293-88c4-caf5052386e0 req-32f47f8c-bbbd-4954-95ea-d27eeb0c961d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:43.547243 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f1a2a07f-22d2-4293-88c4-caf5052386e0 req-32f47f8c-bbbd-4954-95ea-d27eeb0c961d service nova] Creating event network-changed:d6829278-2f28-4bca-b1a9-9428e14f924e for instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 on n-h2-858383-16 Oct 27 09:44:43.555463 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f1a2a07f-22d2-4293-88c4-caf5052386e0 req-32f47f8c-bbbd-4954-95ea-d27eeb0c961d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060907 Oct 27 09:44:43.556807 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3241/6553] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:43.845205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:43.847658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:43.863427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:43.864903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:43.866946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:43.868744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:43.870789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:43.872674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:44.214267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:44.224730 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-140c5e3e-e77e-4338-a6e3-03603f7ffa15 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1366 microversion: 2.1 time: 0.387950 Oct 27 09:44:44.239008 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3313/6554] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:43 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:44.283847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:44.284998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:44.301312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:44.302147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:44.302785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:44.303740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:44.304545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:44.305677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:44.930328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:44.948439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b83c4a25-3561-4dcb-bb77-f883a57328b2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.670542 Oct 27 09:44:44.950440 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3242/6555] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:44 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:45.251628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:45.252481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:45.261382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:45.264022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:45.265075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:45.266095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:45.268379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:45.269183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:45.928628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:45.970898 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f31af273-bedf-4a8c-97b0-b785f4ab84ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1366 microversion: 2.1 time: 0.712899 Oct 27 09:44:46.014704 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3314/6556] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:45 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1366 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:46.019788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:46.020595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:46.029906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:46.030414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:46.030891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:46.031881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:46.032366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:46.032865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:46.232512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-9addc585-70fb-4f73-9ad1-16aabaaa5807 req-6a20937b-4603-46e3-a9f4-62869edd9e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fae2d04-d65a-415e-8e38-5531aed6b2f0", "name": "network-vif-plugged", "status": "completed", "tag": "832a7c2e-ee99-4d48-8eb3-87367a6b678c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:46.252164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9addc585-70fb-4f73-9ad1-16aabaaa5807 req-6a20937b-4603-46e3-a9f4-62869edd9e87 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:46.253768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9addc585-70fb-4f73-9ad1-16aabaaa5807 req-6a20937b-4603-46e3-a9f4-62869edd9e87 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:46.255136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-9addc585-70fb-4f73-9ad1-16aabaaa5807 req-6a20937b-4603-46e3-a9f4-62869edd9e87 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:46.281750 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-9addc585-70fb-4f73-9ad1-16aabaaa5807 req-6a20937b-4603-46e3-a9f4-62869edd9e87 service nova] Creating event network-vif-plugged:832a7c2e-ee99-4d48-8eb3-87367a6b678c for instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 on n-h1-858383-16 Oct 27 09:44:46.293506 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-9addc585-70fb-4f73-9ad1-16aabaaa5807 req-6a20937b-4603-46e3-a9f4-62869edd9e87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079800 Oct 27 09:44:46.294816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3315/6557] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:46.437434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:46.456917 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4eeb3dd1-ecfb-40cf-ab9a-41ad64d04e7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.457051 Oct 27 09:44:46.458767 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3243/6558] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:45 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:47.046828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:47.055352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:47.068076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:47.069445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:47.070384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:47.071668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:47.072841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:47.073678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:47.489293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:47.490716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:47.505020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:47.506345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:47.507162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:47.509051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:47.509997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:47.511025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:47.565302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:47.578358 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8551eb6-9cce-40d6-929e-f4f9d82b51ba tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1366 microversion: 2.1 time: 0.544876 Oct 27 09:44:47.579040 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3316/6559] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:47 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:47.998384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-12185815", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "39879a0d-e697-493b-af6e-838e6fd84ef7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-313269589", "security_groups": [{"name": "tempest-secgroup-smoke-311808023"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:48.119012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:48.150378 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-24eb4073-9564-4f7b-99e4-512a8b8d89c8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1376 microversion: 2.1 time: 0.666520 Oct 27 09:44:48.156447 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3244/6560] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:47 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1376 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:48.230275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] validate_networks() for [('39879a0d-e697-493b-af6e-838e6fd84ef7', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:44:48.346114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:48.389430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:48.615960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:48.617517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:48.625927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:48.626720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:48.627367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:48.628343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:48.629006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:48.629614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:48.713580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:49.088800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:49.102038 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19b4dc28-9cc8-40b1-bc9b-2c2643f640bc tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1366 microversion: 2.1 time: 0.489811 Oct 27 09:44:49.104223 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3245/6561] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:48 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:49.189049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:49.195315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:49.223200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:49.226375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:49.227904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:49.230215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:49.232478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:49.233597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:49.257860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:44:49.258786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:44:49.260229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:44:49.261850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:44:49.265022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:44:49.294227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:49.295741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:49.297993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:49.299981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:49.301383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:49.302432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:49.353589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for project f7fdcfbb223c44e693f100b3717522cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:44:49.360661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for user 0d83fee6e4854240b13a10c262453b32 and project f7fdcfbb223c44e693f100b3717522cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:44:49.375918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:44:49.378735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:44:49.441329 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-343b8ade-03d2-4cec-9cec-d11ead0aa88e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.447129 Oct 27 09:44:49.442395 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3317/6562] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:44:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:44:49.460262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59e69dbb-ee87-4834-8564-e667e03f0d5f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:49.461623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-59e69dbb-ee87-4834-8564-e667e03f0d5f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:49.557156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-59e69dbb-ee87-4834-8564-e667e03f0d5f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:49.570380 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59e69dbb-ee87-4834-8564-e667e03f0d5f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1264 microversion: 2.1 time: 0.114226 Oct 27 09:44:49.571681 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3318/6563] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:49 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1264 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:49.606627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:49.628019 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b865dd0-b9ee-43f8-b25a-05352fb9acfb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1564 microversion: 2.1 time: 0.447567 Oct 27 09:44:49.639683 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3246/6564] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:49 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1564 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:49.671893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:49.672770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:49.688825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:49.690005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:49.691456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:49.693571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:49.694743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:49.695601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:49.999057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:50.016290 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b07a11e9-459b-44cf-b144-c6e6e4c3ab32 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1564 microversion: 2.1 time: 0.349003 Oct 27 09:44:50.017458 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3319/6565] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:49 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1564 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:50.138789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:50.139353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:50.144505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:50.145700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:50.152542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.154472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.155485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.156386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.157116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.158623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.159456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.160714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.161639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.162989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.163496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.164619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.235372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:44:50.407774 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a6fe0c1-2f11-46d0-95c0-06b68dd7fff5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 204 len: 0 microversion: 2.1 time: 0.274279 Oct 27 09:44:50.409305 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3247/6566] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:50 2022] DELETE /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:44:50.424151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:50.425391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:50.435234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.436991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.437889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.439653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.440457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.441125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.474425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:50.476896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:50.486362 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f79b15a1-f7ac-464e-bdcf-49d7c28dc1e7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1366 microversion: 2.1 time: 0.346004 Oct 27 09:44:50.487327 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3320/6567] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:50 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:50.576413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-72baca46-491c-4317-8a2d-1210d16cc0a3 req-323dd84e-7bf1-4e21-a093-c7b16bfa23d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e65655e-5c79-4a4c-a5bb-f1d9ae55c471", "name": "network-vif-plugged", "status": "completed", "tag": "d6829278-2f28-4bca-b1a9-9428e14f924e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:50.596224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-72baca46-491c-4317-8a2d-1210d16cc0a3 req-323dd84e-7bf1-4e21-a093-c7b16bfa23d7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.597017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-72baca46-491c-4317-8a2d-1210d16cc0a3 req-323dd84e-7bf1-4e21-a093-c7b16bfa23d7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.597834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-72baca46-491c-4317-8a2d-1210d16cc0a3 req-323dd84e-7bf1-4e21-a093-c7b16bfa23d7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.615528 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-72baca46-491c-4317-8a2d-1210d16cc0a3 req-323dd84e-7bf1-4e21-a093-c7b16bfa23d7 service nova] Creating event network-vif-plugged:d6829278-2f28-4bca-b1a9-9428e14f924e for instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 on n-h2-858383-16 Oct 27 09:44:50.624999 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-72baca46-491c-4317-8a2d-1210d16cc0a3 req-323dd84e-7bf1-4e21-a093-c7b16bfa23d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064411 Oct 27 09:44:50.625954 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3321/6568] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:50.633417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:50.633417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:50.642097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.642931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.643635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.644676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.645312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.645968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.680869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:50.698844 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95651e2e-ab41-4183-829b-ad2ac5c7fe0a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1570 microversion: 2.1 time: 0.281251 Oct 27 09:44:50.712147 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3248/6569] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:50 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1570 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:50.775541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:50.794854 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0dd9072a-bf0b-446a-94d5-ae830a3c39fd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1268 microversion: 2.1 time: 0.166642 Oct 27 09:44:50.796895 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3322/6570] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:50 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:51.540581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:51.541740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:51.549985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:51.550521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:51.551336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:51.552161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:51.552648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:51.553094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:51.750778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:51.756556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:51.772527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:51.775443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:51.777984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:51.779946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:51.781043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:51.782113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:51.834765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:51.865878 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5fbc177-f6d3-483b-af75-b61d0205311a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1366 microversion: 2.1 time: 0.329841 Oct 27 09:44:51.867789 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3249/6571] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:51 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:51.882391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:51.885818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:51.905965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:51.907273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:51.907819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:51.912548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:51.913784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:51.915297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:52.045901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:52.056588 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fb9080f-ee51-4b2a-a45a-96bb9d935829 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1316 microversion: 2.1 time: 0.186991 Oct 27 09:44:52.058350 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3250/6572] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:51 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:52.134895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:52.157002 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1181441e-0a14-48fd-b244-5695a94a5295 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1570 microversion: 2.1 time: 0.433226 Oct 27 09:44:52.157942 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3323/6573] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:51 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1570 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:52.904732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:52.905891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:52.922018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:52.923297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:52.924887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:52.927121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:52.928549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:52.929836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.023545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d32e95c0-291d-423a-a7e7-8627242b18ab req-733669ee-da76-4d13-b85f-f965b9153456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fae2d04-d65a-415e-8e38-5531aed6b2f0", "name": "network-vif-deleted", "tag": "832a7c2e-ee99-4d48-8eb3-87367a6b678c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:53.053019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d32e95c0-291d-423a-a7e7-8627242b18ab req-733669ee-da76-4d13-b85f-f965b9153456 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:53.053912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d32e95c0-291d-423a-a7e7-8627242b18ab req-733669ee-da76-4d13-b85f-f965b9153456 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:53.054355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d32e95c0-291d-423a-a7e7-8627242b18ab req-733669ee-da76-4d13-b85f-f965b9153456 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.077524 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d32e95c0-291d-423a-a7e7-8627242b18ab req-733669ee-da76-4d13-b85f-f965b9153456 service nova] Creating event network-vif-deleted:832a7c2e-ee99-4d48-8eb3-87367a6b678c for instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 on n-h1-858383-16 Oct 27 09:44:53.083871 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d32e95c0-291d-423a-a7e7-8627242b18ab req-733669ee-da76-4d13-b85f-f965b9153456 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064952 Oct 27 09:44:53.085134 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3324/6574] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:44:53.095828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:53.096875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:53.111451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:53.112280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:53.112942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.113896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:53.114560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:53.115193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.323990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:53.364213 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-61447e7e-e958-4d7f-820c-593ffe532b6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1322 microversion: 2.1 time: 0.272300 Oct 27 09:44:53.366181 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3325/6575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:53 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:53.383505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:53.384756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:53.404513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:53.408695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:53.409825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.413914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:53.415244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:53.416419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.486844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:53.506212 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-57d5f52e-1aed-4808-b3e2-5e9112b5a90e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1555 microversion: 2.1 time: 0.615355 Oct 27 09:44:53.507743 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3251/6576] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:52 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1555 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:53.535307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a21182c9-b62e-434e-9f6d-f9f7eef999c8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:53.536689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a21182c9-b62e-434e-9f6d-f9f7eef999c8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:53.549301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21182c9-b62e-434e-9f6d-f9f7eef999c8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:53.550245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21182c9-b62e-434e-9f6d-f9f7eef999c8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:53.551259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21182c9-b62e-434e-9f6d-f9f7eef999c8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.552723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21182c9-b62e-434e-9f6d-f9f7eef999c8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:53.553634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21182c9-b62e-434e-9f6d-f9f7eef999c8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:53.554430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a21182c9-b62e-434e-9f6d-f9f7eef999c8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.586304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:53.622006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:53.653001 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2b7d9e0a-55b4-4b40-a916-c480cb11136b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1361 microversion: 2.1 time: 0.283861 Oct 27 09:44:53.669583 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3326/6577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:53 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:53.771274 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a21182c9-b62e-434e-9f6d-f9f7eef999c8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.240670 Oct 27 09:44:53.774212 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3252/6578] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:44:53 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-interface => generated 284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:44:54.419233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:54.421692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:54.429667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:54.439292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:54.440752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:54.441970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:54.444038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:54.445466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:54.446813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:54.615789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:54.640607 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99864b43-f3f9-454c-9cb0-f42ca594173d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1322 microversion: 2.1 time: 0.229188 Oct 27 09:44:54.642520 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3327/6579] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:54 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:54.702211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:54.703933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:54.712233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:54.713564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:54.714325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:54.716111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:54.716843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:54.717562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:54.832520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:54.845140 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-062fe98a-3c76-438d-97ae-d6ed3d6c4cde tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1361 microversion: 2.1 time: 0.153248 Oct 27 09:44:54.860567 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3253/6580] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:54 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:55.426603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3bfd718e-dfc9-4d6b-b3b2-2c3afe5d14cb req-e222c5d8-134b-4a63-a730-a35ff8643928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e65655e-5c79-4a4c-a5bb-f1d9ae55c471", "tag": "d6829278-2f28-4bca-b1a9-9428e14f924e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:55.447551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3bfd718e-dfc9-4d6b-b3b2-2c3afe5d14cb req-e222c5d8-134b-4a63-a730-a35ff8643928 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:55.448559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3bfd718e-dfc9-4d6b-b3b2-2c3afe5d14cb req-e222c5d8-134b-4a63-a730-a35ff8643928 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:55.449853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3bfd718e-dfc9-4d6b-b3b2-2c3afe5d14cb req-e222c5d8-134b-4a63-a730-a35ff8643928 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:55.463264 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3bfd718e-dfc9-4d6b-b3b2-2c3afe5d14cb req-e222c5d8-134b-4a63-a730-a35ff8643928 service nova] Creating event network-changed:d6829278-2f28-4bca-b1a9-9428e14f924e for instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 on n-h2-858383-16 Oct 27 09:44:55.469971 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3bfd718e-dfc9-4d6b-b3b2-2c3afe5d14cb req-e222c5d8-134b-4a63-a730-a35ff8643928 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048910 Oct 27 09:44:55.471502 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3328/6581] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:44:55.667341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:55.668060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:55.684425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:55.684964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:55.690841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:55.693016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:55.693568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:55.694031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:55.874345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:55.875064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:55.887727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:55.888283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:55.895682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:55.896766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:55.897286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:55.897985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:56.056688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:56.078558 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7644a7b-8cab-40ce-ba1d-837c3c434179 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1361 microversion: 2.1 time: 0.211813 Oct 27 09:44:56.091607 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3329/6582] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:55 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:56.106784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:56.120364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-caed700f-2609-4343-aacf-da101c92a8ae tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1389 microversion: 2.1 time: 0.458294 Oct 27 09:44:56.136965 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3254/6583] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:55 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1389 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:56.352943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ffb25f95-94c2-4675-958a-7c29cfc80e26 req-4d5499d0-43fd-4215-93e6-6d38d9280b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:56.385451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ffb25f95-94c2-4675-958a-7c29cfc80e26 req-4d5499d0-43fd-4215-93e6-6d38d9280b6c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:56.385986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ffb25f95-94c2-4675-958a-7c29cfc80e26 req-4d5499d0-43fd-4215-93e6-6d38d9280b6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:56.389354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ffb25f95-94c2-4675-958a-7c29cfc80e26 req-4d5499d0-43fd-4215-93e6-6d38d9280b6c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:56.413672 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ffb25f95-94c2-4675-958a-7c29cfc80e26 req-4d5499d0-43fd-4215-93e6-6d38d9280b6c service nova] Creating event network-changed:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h1-858383-16 Oct 27 09:44:56.429791 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ffb25f95-94c2-4675-958a-7c29cfc80e26 req-4d5499d0-43fd-4215-93e6-6d38d9280b6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082618 Oct 27 09:44:56.430858 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3330/6584] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:57.110070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:57.111127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:57.123685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:57.124866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:57.125500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:57.126650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:57.127350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:57.128150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:57.147761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:57.148858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:57.157706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:57.158600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:57.159292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:57.160270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:57.160958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:57.161605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:57.298085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:57.311087 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92fa24d5-a6cc-4bbe-9c03-53be4db002f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1361 microversion: 2.1 time: 0.203050 Oct 27 09:44:57.313362 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3255/6585] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:57 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:57.476760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:57.489189 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7be8642-26c0-489a-890b-1ceb8d1ece0b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1389 microversion: 2.1 time: 0.345843 Oct 27 09:44:57.496737 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3331/6586] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:57 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1389 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:58.354548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:58.357128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:58.365711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:58.366211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:58.366687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:58.367406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:58.367898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:58.368332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:58.450468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:58.459639 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af1ef377-988d-4c6b-b6cd-1512051b6bbe tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1361 microversion: 2.1 time: 0.110504 Oct 27 09:44:58.460614 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3256/6587] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:58 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1361 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:58.515351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:58.516290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:58.524452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:58.524974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:58.525433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:58.526204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:58.526689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:58.527139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:58.715868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:58.724530 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e000ed07-a78f-4358-85d7-4c491792e363 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1389 microversion: 2.1 time: 0.213985 Oct 27 09:44:58.725140 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3332/6588] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:58 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1389 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:59.483776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:59.484699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:59.501460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.502068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.502517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:59.503299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.510807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.511246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:59.577973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.578848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.579828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:59.580558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lazy-loading 'fault' on Instance uuid 2fae2d04-d65a-415e-8e38-5531aed6b2f0 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:44:59.734932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:59.746441 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7358f0e1-f91d-414b-8574-52761a023f39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 200 len: 1366 microversion: 2.1 time: 0.266418 Oct 27 09:44:59.747501 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3257/6589] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:59 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:59.753808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:59.754941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:59.758573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:59.762316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:59.774871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.775812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.776913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:59.779194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.780093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.780899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:00.234506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:00.253898 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e3f04958-37b5-4116-9bf4-c87003846749 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1389 microversion: 2.1 time: 0.507369 Oct 27 09:45:00.257767 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3333/6590] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:59 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1389 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:00.772288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:00.773748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:00.778490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:00.790574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:00.791307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:00.791992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:00.793680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:00.794816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:00.795467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:00.825976 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 HTTP/1.1 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '2fae2d04-d65a-415e-8e38-5531aed6b2f0'} Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:00.830097 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:00.841858 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:00.841858 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:00.841858 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:00.841858 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:45:00.841858 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:45:00.841858 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:00.841858 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:00.847625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:45:00.847625 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80e9114c-40b6-4ee1-b804-981a854d468d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 404 len: 111 microversion: 2.1 time: 0.077471 Oct 27 09:45:00.850403 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3258/6591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:00 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:45:01.280052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:01.280691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:01.288358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:01.288865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:01.289324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:01.290050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:01.290522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:01.290960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:01.474211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:01.482826 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be55713e-a49c-4572-9615-fcf3433aeb26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1389 microversion: 2.1 time: 0.207241 Oct 27 09:45:01.483540 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3334/6592] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:01 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1389 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:02.083893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fa19df28-3b3e-4983-942d-3255d0c962af req-2664c1dd-8f65-41bf-bec1-ef1933fecbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "name": "network-vif-plugged", "status": "completed", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:45:02.097900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fa19df28-3b3e-4983-942d-3255d0c962af req-2664c1dd-8f65-41bf-bec1-ef1933fecbc9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:02.098377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fa19df28-3b3e-4983-942d-3255d0c962af req-2664c1dd-8f65-41bf-bec1-ef1933fecbc9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:02.098891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fa19df28-3b3e-4983-942d-3255d0c962af req-2664c1dd-8f65-41bf-bec1-ef1933fecbc9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:02.113110 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fa19df28-3b3e-4983-942d-3255d0c962af req-2664c1dd-8f65-41bf-bec1-ef1933fecbc9 service nova] Creating event network-vif-plugged:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h1-858383-16 Oct 27 09:45:02.118736 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fa19df28-3b3e-4983-942d-3255d0c962af req-2664c1dd-8f65-41bf-bec1-ef1933fecbc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038659 Oct 27 09:45:02.119538 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3259/6593] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:45:02.506764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:02.507501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:02.515086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:02.515626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:02.516092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:02.516841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:02.517320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:02.517791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:02.683170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:02.692708 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7eff44d3-73cd-440a-a1f0-f1384b50db16 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1389 microversion: 2.1 time: 0.189916 Oct 27 09:45:02.693337 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3335/6594] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:02 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1389 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:03.719845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:03.721264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:03.729663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:03.730594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:03.731477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:03.732613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:03.734782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:03.735500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:03.953342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:03.968960 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3283abed-5e2f-4b5e-b8f9-99596c7813ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1389 microversion: 2.1 time: 0.255353 Oct 27 09:45:03.970613 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3260/6595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:03 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1389 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:45:05.008184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:05.008763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:05.016588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.017105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.017568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.018307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.018786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.019272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.176634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:05.186032 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d2eb4570-2516-4c42-8032-4d50ac6f6bfb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1560 microversion: 2.1 time: 0.181810 Oct 27 09:45:05.186695 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3336/6596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:05 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:05.210139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:05.210848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:05.218515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.219022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.219474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.220235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.220696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.221132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.236486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:05.237289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:05.245256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.246730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.247295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.248209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.248794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.249332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.279730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:45:05.386150 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99894a2b-ed2e-4a22-a443-fb79c9c2c3e4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 204 len: 0 microversion: 2.1 time: 0.153832 Oct 27 09:45:05.387859 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3337/6597] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:45:05 2022] DELETE /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:45:05.399146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:05.399943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:05.402280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:05.406465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.407001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.407525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.408486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.408969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.409420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.413538 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efcf2f46-b301-46c0-9820-8e9f531f5c82 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1560 microversion: 2.1 time: 0.207451 Oct 27 09:45:05.414508 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3261/6598] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:05 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:05.427492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:05.586081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:05.602968 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e9245271-6d7b-46eb-b83b-b023509aead0 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1409 microversion: 2.1 time: 0.208952 Oct 27 09:45:05.607625 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3338/6599] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:05 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1409 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:45:06.644483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:06.645424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:06.656642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:06.657432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:06.658183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:06.659192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:06.659776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:06.660377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:06.848471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:06.858024 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3feba182-8c4d-47af-8a6c-bfd6cdf71324 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1409 microversion: 2.1 time: 0.218530 Oct 27 09:45:06.858646 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3262/6600] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:06 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1409 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:45:07.556560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:07.557981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:07.563293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-def4e7f6-1b0a-44e1-8d8e-d1d20f3c1c8e req-b41dc2d9-b0f0-4049-8438-7ab5035dffba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:45:07.568945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:07.569617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:07.570187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:07.571130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:07.571883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:07.572787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:07.587020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-def4e7f6-1b0a-44e1-8d8e-d1d20f3c1c8e req-b41dc2d9-b0f0-4049-8438-7ab5035dffba service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:07.588219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-def4e7f6-1b0a-44e1-8d8e-d1d20f3c1c8e req-b41dc2d9-b0f0-4049-8438-7ab5035dffba service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:07.589248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-def4e7f6-1b0a-44e1-8d8e-d1d20f3c1c8e req-b41dc2d9-b0f0-4049-8438-7ab5035dffba service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:07.616745 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-def4e7f6-1b0a-44e1-8d8e-d1d20f3c1c8e req-b41dc2d9-b0f0-4049-8438-7ab5035dffba service nova] Creating event network-changed:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h1-858383-16 Oct 27 09:45:07.628430 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-def4e7f6-1b0a-44e1-8d8e-d1d20f3c1c8e req-b41dc2d9-b0f0-4049-8438-7ab5035dffba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072193 Oct 27 09:45:07.630307 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3263/6601] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:45:07.800891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:07.817604 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-663d2dbe-cf6a-47dc-8bc8-39409349a52e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1560 microversion: 2.1 time: 0.268403 Oct 27 09:45:07.819038 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3339/6602] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:07 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1560 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:07.888172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:07.890623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:07.902976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:07.904413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:07.905568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:07.907249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:07.908738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:07.909914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:08.100883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:08.130765 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc2d7359-c45f-4015-bbec-b0dc872ee0b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1367 microversion: 2.1 time: 0.250462 Oct 27 09:45:08.132987 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3264/6603] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:07 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:09.185288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:09.187684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:09.202907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:09.203863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:09.204709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:09.206142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:09.207305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:09.208336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:09.327955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:09.337406 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3eff5b7a-aad8-44a7-87e1-66a49d9c6a9d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1201 microversion: 2.1 time: 0.161040 Oct 27 09:45:09.338077 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3340/6604] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:09 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1201 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:09.666547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7990ec9b-3327-4900-aff4-1361b4537719 req-62d61339-7a5f-41bb-aa3f-10b690022a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7ecc11-b969-4850-972e-83db119b2a9c", "name": "network-vif-deleted", "tag": "84c51b77-612a-49fb-ac25-0b925a37469d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:45:09.678727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7990ec9b-3327-4900-aff4-1361b4537719 req-62d61339-7a5f-41bb-aa3f-10b690022a8d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:09.679205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7990ec9b-3327-4900-aff4-1361b4537719 req-62d61339-7a5f-41bb-aa3f-10b690022a8d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:09.679745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7990ec9b-3327-4900-aff4-1361b4537719 req-62d61339-7a5f-41bb-aa3f-10b690022a8d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:09.693072 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7990ec9b-3327-4900-aff4-1361b4537719 req-62d61339-7a5f-41bb-aa3f-10b690022a8d service nova] Creating event network-vif-deleted:84c51b77-612a-49fb-ac25-0b925a37469d for instance 7a7ecc11-b969-4850-972e-83db119b2a9c on n-h2-858383-16 Oct 27 09:45:09.698417 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7990ec9b-3327-4900-aff4-1361b4537719 req-62d61339-7a5f-41bb-aa3f-10b690022a8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035723 Oct 27 09:45:09.699113 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3265/6605] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:45:10.364176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:10.364767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:10.375200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:10.375641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:10.376119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:10.376898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:10.377389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:10.377844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:10.473432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:10.488636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-35dfee3f-5fae-4b45-8392-e41d5d153c79 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1201 microversion: 2.1 time: 0.130742 Oct 27 09:45:10.489713 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3341/6606] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:10 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1201 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:11.531727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:11.532715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:11.542575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:11.543501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:11.544248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:11.545079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:11.545804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:11.546309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:11.620441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:11.629104 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65d4f620-e228-4ba4-bf97-31c90f06673c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1201 microversion: 2.1 time: 0.105686 Oct 27 09:45:11.629722 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3266/6607] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:11 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1201 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:12.663116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:12.664441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:12.673436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:12.674049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:12.674521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:12.675285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:12.675809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:12.676260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:12.774681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:12.785663 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-494cae37-7717-40b2-b76b-f0548ae1a935 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 200 len: 1201 microversion: 2.1 time: 0.126843 Oct 27 09:45:12.787028 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3342/6608] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:12 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 1201 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:13.811503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:13.812173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:13.820207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:13.820714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:13.821161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:13.821886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:13.822348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:13.822791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:13.838074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c HTTP/1.1 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7a7ecc11-b969-4850-972e-83db119b2a9c'} Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:13.840105 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d248b3ab-e790-4fbb-9dfc-1f80a7416361 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 404 len: 111 microversion: 2.1 time: 0.034975 Oct 27 09:45:13.849082 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3267/6609] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:13 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:45:16.015187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:16.016125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:16.024821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:16.025487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:16.026088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:16.027104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:16.028451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:16.029050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:16.050392 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 HTTP/1.1 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '2fae2d04-d65a-415e-8e38-5531aed6b2f0'} Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:45:16.053843 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e96850d0-68c1-4fdd-b68e-f908d446c316 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 404 len: 111 microversion: 2.1 time: 0.046184 Oct 27 09:45:16.058786 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3343/6610] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:45:16 2022] DELETE /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:45:16.068763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:16.069952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 2fae2d04-d65a-415e-8e38-5531aed6b2f0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:16.078736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:16.079456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:16.080212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:16.081109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:16.081771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:16.082561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:16.100402 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 HTTP/1.1 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '2fae2d04-d65a-415e-8e38-5531aed6b2f0'} Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:16.102740 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 2fae2d04-d65a-415e-8e38-5531aed6b2f0 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79c10815-2943-4b0a-a70d-61c33e7b7172 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0" status: 404 len: 111 microversion: 2.1 time: 0.041429 Oct 27 09:45:16.109339 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3268/6611] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:16 2022] GET /compute/v2.1/servers/2fae2d04-d65a-415e-8e38-5531aed6b2f0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:45:16.696879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:16.698523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:16.713574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:16.715724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:16.716849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:16.718696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:16.720102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:16.721276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:16.750453 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c HTTP/1.1 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7a7ecc11-b969-4850-972e-83db119b2a9c'} Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:45:16.754394 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.763445 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.764838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:45:16.765749 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-32d62f38-d2fd-4bd4-a860-4e61979b2a06 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 404 len: 111 microversion: 2.1 time: 0.076475 Oct 27 09:45:16.766858 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3344/6612] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:45:16 2022] DELETE /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:45:16.781320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:16.782380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 7a7ecc11-b969-4850-972e-83db119b2a9c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:16.795014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:16.797277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:16.798233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:16.799594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:16.800458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:16.801269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:16.832847 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c HTTP/1.1 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7a7ecc11-b969-4850-972e-83db119b2a9c'} Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:16.835973 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 7a7ecc11-b969-4850-972e-83db119b2a9c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e35e4ea-a068-43c2-8a29-bbf5562a6008 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c" status: 404 len: 111 microversion: 2.1 time: 0.067283 Oct 27 09:45:16.845794 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3269/6613] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:16 2022] GET /compute/v2.1/servers/7a7ecc11-b969-4850-972e-83db119b2a9c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:45:16.972500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-41a420f8-a2d9-4387-8f47-e564e4e81ab4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'create', calling method: .version_select at 0x7f31a94708b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2030933275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMgUHPb6Mjd/cBQ9sxqc7uxzHiuSf16SRuEM18KDUFRcpcxmi+sp39ZASodd03SqS92Vo2ZXI7cmcDIVoQ1qp7qZ4Fygbb2GbN1uZAR2Z6ePW5VOfdQUK5BbEkzQIBorQ=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:45:17.002039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-41a420f8-a2d9-4387-8f47-e564e4e81ab4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:45:17.014075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-41a420f8-a2d9-4387-8f47-e564e4e81ab4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for user 9ab30747d0444c32bbc058a522262b62 and project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:45:17.061938 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-41a420f8-a2d9-4387-8f47-e564e4e81ab4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.093955 Oct 27 09:45:17.062773 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3345/6614] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:45:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:45:36.357720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1212465643", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2030933275", "security_groups": [{"name": "tempest-secgroup-smoke-1368785454"}], "block_device_mapping_v2": [{"uuid": "92ef0488-ada2-47e8-94eb-a8739ce53680", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8f250b0-c481-437b-8054-ee4c9ca61f10"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:45:36.371742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=23 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:36.372420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=77 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:36.496234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] validate_networks() for [('c8f250b0-c481-437b-8054-ee4c9ca61f10', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:45:36.945044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:45:36.945474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:45:36.945967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:45:36.946384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:45:36.946835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:45:36.957771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:36.958278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:36.958725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:36.959480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:36.959973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:36.960410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:36.979707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:45:36.988813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for user 9ab30747d0444c32bbc058a522262b62 and project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:45:37.055447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:45:37.058261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92ef0488-ada2-47e8-94eb-a8739ce53680',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:45:37.226684 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8a6da7f-1938-4cbe-ba57-f1cb50a4f315 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874654 Oct 27 09:45:37.227360 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3270/6615] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:45:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:45:37.247169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d1043327-41e3-42f0-93dc-a830db87dd56 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:37.248359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d1043327-41e3-42f0-93dc-a830db87dd56 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:37.253804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=31 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:37.254826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:37.255611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:37.326085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d1043327-41e3-42f0-93dc-a830db87dd56 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:37.341410 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1043327-41e3-42f0-93dc-a830db87dd56 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1095 microversion: 2.1 time: 0.102938 Oct 27 09:45:37.341832 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3346/6616] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:37 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:38.371286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:38.372670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:38.381576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:38.382081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:38.382584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:38.383369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:38.383956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:38.384396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:38.461008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:38.473707 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-419b03dd-3d9d-4aff-ae3a-cc5006bb0ec1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1193 microversion: 2.1 time: 0.107080 Oct 27 09:45:38.474780 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3271/6617] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:38 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:45:39.592807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:39.594326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:39.608915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:39.609755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:39.610424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:39.611663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:39.612280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:39.612870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:39.895375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:39.907693 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-70c4d958-a9f9-4f85-bd32-3f0b8f2712b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1279 microversion: 2.1 time: 0.410283 Oct 27 09:45:39.908690 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3347/6618] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:39 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1279 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:40.481954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ec02dd8d-2b37-4620-8a72-f1e6c6d65837 req-e359d95c-ee28-473a-9cf0-1c1546d2a3ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e14bab2-c5b6-42c5-8498-b885f872e12c", "tag": "0a70c909-3d94-40dd-8373-b806a40373ea"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:45:40.503825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ec02dd8d-2b37-4620-8a72-f1e6c6d65837 req-e359d95c-ee28-473a-9cf0-1c1546d2a3ab service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:40.505468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ec02dd8d-2b37-4620-8a72-f1e6c6d65837 req-e359d95c-ee28-473a-9cf0-1c1546d2a3ab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:40.506184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ec02dd8d-2b37-4620-8a72-f1e6c6d65837 req-e359d95c-ee28-473a-9cf0-1c1546d2a3ab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:40.525643 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ec02dd8d-2b37-4620-8a72-f1e6c6d65837 req-e359d95c-ee28-473a-9cf0-1c1546d2a3ab service nova] Creating event network-changed:0a70c909-3d94-40dd-8373-b806a40373ea for instance 4e14bab2-c5b6-42c5-8498-b885f872e12c on n-h1-858383-16 Oct 27 09:45:40.538411 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ec02dd8d-2b37-4620-8a72-f1e6c6d65837 req-e359d95c-ee28-473a-9cf0-1c1546d2a3ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062327 Oct 27 09:45:40.538411 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3272/6619] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:45:40.932017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:40.933692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:40.942222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:40.943182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:40.943914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:40.944965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:40.945709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:40.946391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:41.457294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:41.465916 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dacf10b6-e60e-4748-a38e-41a51dc740e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1279 microversion: 2.1 time: 0.537965 Oct 27 09:45:41.466505 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3348/6620] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:40 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1279 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:42.494714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:42.495758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:42.503921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:42.504574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:42.505144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:42.506001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:42.506680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:42.507227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:42.706074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:42.717015 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2ee447b-0f8b-4347-9a66-cefb01e46b14 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1279 microversion: 2.1 time: 0.229224 Oct 27 09:45:42.717841 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3273/6621] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:42 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1279 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:43.741873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:43.742997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:43.751895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:43.752550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:43.753106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:43.753997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:43.754573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:43.755072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:43.931758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:43.942951 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-acf351d7-72ea-4141-8a7e-49a827f64594 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1279 microversion: 2.1 time: 0.205571 Oct 27 09:45:43.943562 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3349/6622] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:43 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1279 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:44.966936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:44.967947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:44.979061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:44.979909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:44.980752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:44.982165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:44.983321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:44.984208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:45.182280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:45.198872 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9176f8fc-e9f9-4668-85ca-2ec8a20c0006 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.236254 Oct 27 09:45:45.200505 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3274/6623] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:44 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:46.226243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:46.227024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:46.235443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:46.236122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:46.236697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:46.237600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:46.238123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:46.238755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:46.395974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:46.405398 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc22309e-d9d7-48e5-9421-4f3224d975da tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.182754 Oct 27 09:45:46.406022 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3350/6624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:46 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:46.435237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f491a7be-01dc-4965-89b7-c63538ac9637 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:45:46.437730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f491a7be-01dc-4965-89b7-c63538ac9637 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:46.446641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f491a7be-01dc-4965-89b7-c63538ac9637 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:46.447392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f491a7be-01dc-4965-89b7-c63538ac9637 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:46.447998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f491a7be-01dc-4965-89b7-c63538ac9637 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:46.448952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f491a7be-01dc-4965-89b7-c63538ac9637 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:46.450105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f491a7be-01dc-4965-89b7-c63538ac9637 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:46.450698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f491a7be-01dc-4965-89b7-c63538ac9637 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:46.516763 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f491a7be-01dc-4965-89b7-c63538ac9637 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action" status: 200 len: 24574 microversion: 2.1 time: 0.086051 Oct 27 09:45:46.517465 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3275/6625] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:45:46 2022] POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action => generated 24574 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:45:47.430703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:47.431351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:47.434520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:47.442073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:47.442628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:47.443127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:47.443956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:47.444471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:47.444954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:47.630282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:47.639490 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f5e4d6b-294e-4241-b6a5-ea0487eb8547 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.212759 Oct 27 09:45:47.640218 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3351/6626] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:47 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:48.678335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:48.679113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:48.681797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:48.682532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:48.692126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:48.692634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:48.693088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:48.693840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:48.694314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:48.694752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:48.885507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:48.894067 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3091260e-707f-44a3-86cb-41b022f6c93b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.220650 Oct 27 09:45:48.894684 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3276/6627] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:48 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:49.919822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:49.920444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:49.927999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:49.928519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:49.928986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:49.929748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:49.930280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:49.930735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:50.089411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:50.099264 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bec32636-f12c-41e4-96b8-e368c20f881a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.184541 Oct 27 09:45:50.100081 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3352/6628] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:49 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:45:51.125920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:51.126596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:51.134174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:51.134914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:51.135652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:51.137263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:51.137994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:51.138623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:51.304860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:51.314594 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9ec217fb-1e62-41ed-82ac-67fcd0dbb02f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.193412 Oct 27 09:45:51.315192 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3277/6629] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:51 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:45:52.354904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:52.356252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:52.363949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:52.364706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:52.365367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:52.366308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:52.366962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:52.367536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:52.565662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:52.575962 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2814fb38-5357-4b63-9004-4135b72ccb02 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.226091 Oct 27 09:45:52.576584 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3353/6630] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:52 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:45:53.615724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:53.616721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:53.625377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:53.625880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:53.626325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:53.627053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:53.627523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:53.627991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:53.793850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:53.803231 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dbd6e08e-4c38-4ebb-ba7d-dae1590d60b6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.192163 Oct 27 09:45:53.803995 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3278/6631] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:53 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:54.386840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7feec7e6-5906-4c7f-a5d3-b9ddef22d181 req-92a0a21e-4469-4793-921c-9858536e3fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e14bab2-c5b6-42c5-8498-b885f872e12c", "name": "network-vif-plugged", "status": "completed", "tag": "0a70c909-3d94-40dd-8373-b806a40373ea"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:45:54.398908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7feec7e6-5906-4c7f-a5d3-b9ddef22d181 req-92a0a21e-4469-4793-921c-9858536e3fbd service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:54.399481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7feec7e6-5906-4c7f-a5d3-b9ddef22d181 req-92a0a21e-4469-4793-921c-9858536e3fbd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:54.400014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7feec7e6-5906-4c7f-a5d3-b9ddef22d181 req-92a0a21e-4469-4793-921c-9858536e3fbd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:54.413129 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7feec7e6-5906-4c7f-a5d3-b9ddef22d181 req-92a0a21e-4469-4793-921c-9858536e3fbd service nova] Creating event network-vif-plugged:0a70c909-3d94-40dd-8373-b806a40373ea for instance 4e14bab2-c5b6-42c5-8498-b885f872e12c on n-h1-858383-16 Oct 27 09:45:54.419843 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7feec7e6-5906-4c7f-a5d3-b9ddef22d181 req-92a0a21e-4469-4793-921c-9858536e3fbd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037930 Oct 27 09:45:54.420747 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3354/6632] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:45:54.827808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:54.828431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:54.836434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:54.836922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:54.837365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:54.838084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:54.838544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:54.838999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:55.032901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:55.041701 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-717a0232-a75b-48b1-b8cd-b4c144020f22 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.218099 Oct 27 09:45:55.042398 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3279/6633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:54 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:56.068899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:56.069705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:56.077149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:56.077665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:56.078113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:56.078838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:56.079303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:56.079778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:56.245928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:56.256897 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-95d55bf7-75c5-46ae-812f-b801b3581063 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1267 microversion: 2.1 time: 0.194144 Oct 27 09:45:56.257745 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3355/6634] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:56 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:57.282247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:57.283101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:57.290346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:57.290847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:57.291296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:57.292066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:57.292528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:57.293019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:57.447729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:57.456789 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-376459fc-e18c-4c11-9fcd-954540d9692b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1454 microversion: 2.1 time: 0.179304 Oct 27 09:45:57.457401 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3280/6635] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:57 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:57.481033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:57.482030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:57.490059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:57.490635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:57.491217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:57.492041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:57.492555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:57.493031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:57.672017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:57.681395 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f6167e85-9f0b-46e8-9c7b-296b3e18ac63 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1454 microversion: 2.1 time: 0.204755 Oct 27 09:45:57.682065 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3356/6636] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:57 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:45:58.917340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83bfca2c-6cc4-49e8-84d5-51964b42b4b5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:58.918291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83bfca2c-6cc4-49e8-84d5-51964b42b4b5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:58.925414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83bfca2c-6cc4-49e8-84d5-51964b42b4b5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:58.925916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83bfca2c-6cc4-49e8-84d5-51964b42b4b5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:58.926367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83bfca2c-6cc4-49e8-84d5-51964b42b4b5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:58.927166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83bfca2c-6cc4-49e8-84d5-51964b42b4b5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:58.927748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83bfca2c-6cc4-49e8-84d5-51964b42b4b5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:58.928192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83bfca2c-6cc4-49e8-84d5-51964b42b4b5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:58.967437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83bfca2c-6cc4-49e8-84d5-51964b42b4b5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/ips" status: 200 len: 148 microversion: 2.1 time: 0.133743 Oct 27 09:45:58.968600 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3281/6637] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:45:58 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/ips => generated 148 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:00.576992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6e364442-354e-4f8b-bd47-019a6ff15c16 req-1f75cf52-3ca9-478e-8f41-4974eb62ac4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e14bab2-c5b6-42c5-8498-b885f872e12c", "tag": "0a70c909-3d94-40dd-8373-b806a40373ea"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:00.589327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6e364442-354e-4f8b-bd47-019a6ff15c16 req-1f75cf52-3ca9-478e-8f41-4974eb62ac4b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:00.589760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6e364442-354e-4f8b-bd47-019a6ff15c16 req-1f75cf52-3ca9-478e-8f41-4974eb62ac4b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:00.591113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6e364442-354e-4f8b-bd47-019a6ff15c16 req-1f75cf52-3ca9-478e-8f41-4974eb62ac4b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:00.613414 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6e364442-354e-4f8b-bd47-019a6ff15c16 req-1f75cf52-3ca9-478e-8f41-4974eb62ac4b service nova] Creating event network-changed:0a70c909-3d94-40dd-8373-b806a40373ea for instance 4e14bab2-c5b6-42c5-8498-b885f872e12c on n-h1-858383-16 Oct 27 09:46:00.624868 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6e364442-354e-4f8b-bd47-019a6ff15c16 req-1f75cf52-3ca9-478e-8f41-4974eb62ac4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051468 Oct 27 09:46:00.626422 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3357/6638] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:46:01.632036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45e14188-32a5-4cde-967e-bb36b8e518ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87050322-1ba1-42f4-b350-d2f2b414a9b1"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:01.634955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45e14188-32a5-4cde-967e-bb36b8e518ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:01.642407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e14188-32a5-4cde-967e-bb36b8e518ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:01.642920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e14188-32a5-4cde-967e-bb36b8e518ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:01.643366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e14188-32a5-4cde-967e-bb36b8e518ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:01.644125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e14188-32a5-4cde-967e-bb36b8e518ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:01.644595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e14188-32a5-4cde-967e-bb36b8e518ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:01.645096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45e14188-32a5-4cde-967e-bb36b8e518ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:02.000378 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45e14188-32a5-4cde-967e-bb36b8e518ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372901 Oct 27 09:46:02.008092 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3282/6639] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:46:01 2022] POST /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:14.055366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=26 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:14.056333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=58 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:14.061631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87050322-1ba1-42f4-b350-d2f2b414a9b1"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:14.064356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:14.072188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:14.072694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:14.073145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:14.073879 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:14.074465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:14.074914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:14.173503 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Invalid volume: volume 87050322-1ba1-42f4-b350-d2f2b414a9b1 is already attached to instances: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments HTTP/1.1 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 74 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: {"volumeAttachment": {"volumeId": "87050322-1ba1-42f4-b350-d2f2b414a9b1"}} Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid volume: volume 87050322-1ba1-42f4-b350-d2f2b414a9b1 is already attached to instances: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'server_id': '7e65655e-5c79-4a4c-a5bb-f1d9ae55c471', 'body': {'volumeAttachment': {'volumeId': '87050322-1ba1-42f4-b350-d2f2b414a9b1'}}} Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in attach_volume Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4971, in _check_volume_already_attached Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 87050322-1ba1-42f4-b350-d2f2b414a9b1 is already attached to instances: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:46:14.176365 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 87050322-1ba1-42f4-b350-d2f2b414a9b1 is already attached to instances: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 87050322-1ba1-42f4-b350-d2f2b414a9b1 is already attached to instances: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 400 to user: Invalid volume: volume 87050322-1ba1-42f4-b350-d2f2b414a9b1 is already attached to instances: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6474cafc-21be-4442-92c8-ffe4cda94cf4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125259 Oct 27 09:46:14.184739 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3358/6640] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:46:14 2022] POST /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:46:14.260572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:14.261293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:14.264023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:14.264731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:14.272398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:14.272909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:14.273360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:14.274128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:14.274593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:14.275031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:14.380122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lazy-loading 'services' on Instance uuid 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:46:14.461752 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04882f7d-918d-4b52-9486-53d429ef66dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments/87050322-1ba1-42f4-b350-d2f2b414a9b1" status: 202 len: 0 microversion: 2.1 time: 0.206076 Oct 27 09:46:14.462676 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3283/6641] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:46:14 2022] DELETE /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments/87050322-1ba1-42f4-b350-d2f2b414a9b1 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:46:14.476363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-143b7940-6d7f-44d3-9be4-cf43c9f05c73 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:14.480319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-143b7940-6d7f-44d3-9be4-cf43c9f05c73 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:14.489755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143b7940-6d7f-44d3-9be4-cf43c9f05c73 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:14.490515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143b7940-6d7f-44d3-9be4-cf43c9f05c73 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:14.491239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143b7940-6d7f-44d3-9be4-cf43c9f05c73 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:14.492350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143b7940-6d7f-44d3-9be4-cf43c9f05c73 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:14.492937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143b7940-6d7f-44d3-9be4-cf43c9f05c73 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:14.493472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143b7940-6d7f-44d3-9be4-cf43c9f05c73 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:14.535711 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-143b7940-6d7f-44d3-9be4-cf43c9f05c73 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066588 Oct 27 09:46:14.541765 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3359/6642] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:46:14 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:15.553276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7542784b-2056-4645-8f7c-2d503b99a65b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:15.556338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7542784b-2056-4645-8f7c-2d503b99a65b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:15.565546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7542784b-2056-4645-8f7c-2d503b99a65b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:15.566206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7542784b-2056-4645-8f7c-2d503b99a65b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:15.567033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7542784b-2056-4645-8f7c-2d503b99a65b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:15.568099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7542784b-2056-4645-8f7c-2d503b99a65b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:15.568754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7542784b-2056-4645-8f7c-2d503b99a65b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:15.569243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7542784b-2056-4645-8f7c-2d503b99a65b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:15.614102 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7542784b-2056-4645-8f7c-2d503b99a65b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066763 Oct 27 09:46:15.614732 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3284/6643] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:46:15 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:16.634371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7fd8277e-7f32-4bce-bb6d-a7b54be78c75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:16.639088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7fd8277e-7f32-4bce-bb6d-a7b54be78c75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:16.650874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd8277e-7f32-4bce-bb6d-a7b54be78c75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:16.651801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd8277e-7f32-4bce-bb6d-a7b54be78c75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:16.652469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd8277e-7f32-4bce-bb6d-a7b54be78c75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:16.653715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd8277e-7f32-4bce-bb6d-a7b54be78c75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:16.654476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd8277e-7f32-4bce-bb6d-a7b54be78c75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:16.655199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd8277e-7f32-4bce-bb6d-a7b54be78c75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:16.713033 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7fd8277e-7f32-4bce-bb6d-a7b54be78c75 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086611 Oct 27 09:46:16.713978 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3360/6644] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:46:16 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:17.732051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c6b973c-e9c8-48a0-9bff-f2950cbf1735 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:17.736345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c6b973c-e9c8-48a0-9bff-f2950cbf1735 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:17.749793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6b973c-e9c8-48a0-9bff-f2950cbf1735 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:17.750680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6b973c-e9c8-48a0-9bff-f2950cbf1735 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:17.751718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6b973c-e9c8-48a0-9bff-f2950cbf1735 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:17.753069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6b973c-e9c8-48a0-9bff-f2950cbf1735 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:17.753902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6b973c-e9c8-48a0-9bff-f2950cbf1735 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:17.754624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c6b973c-e9c8-48a0-9bff-f2950cbf1735 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:17.816228 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c6b973c-e9c8-48a0-9bff-f2950cbf1735 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091839 Oct 27 09:46:17.817761 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3285/6645] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:46:17 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:18.834974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a85ada51-3b21-4c39-b6c1-4a46b88a7bad tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:18.839041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a85ada51-3b21-4c39-b6c1-4a46b88a7bad tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:18.853036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85ada51-3b21-4c39-b6c1-4a46b88a7bad tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:18.853952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85ada51-3b21-4c39-b6c1-4a46b88a7bad tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:18.854786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85ada51-3b21-4c39-b6c1-4a46b88a7bad tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:18.856735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85ada51-3b21-4c39-b6c1-4a46b88a7bad tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:18.857627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85ada51-3b21-4c39-b6c1-4a46b88a7bad tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:18.858429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85ada51-3b21-4c39-b6c1-4a46b88a7bad tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:18.904327 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a85ada51-3b21-4c39-b6c1-4a46b88a7bad tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076737 Oct 27 09:46:18.905587 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3361/6646] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:46:18 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:19.922876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f110479d-fbb5-4aa2-9565-90e41d10ff9c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:19.926770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f110479d-fbb5-4aa2-9565-90e41d10ff9c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:19.939768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f110479d-fbb5-4aa2-9565-90e41d10ff9c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:19.940620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f110479d-fbb5-4aa2-9565-90e41d10ff9c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:19.941391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f110479d-fbb5-4aa2-9565-90e41d10ff9c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:19.942966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f110479d-fbb5-4aa2-9565-90e41d10ff9c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:19.943785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f110479d-fbb5-4aa2-9565-90e41d10ff9c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:19.944508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f110479d-fbb5-4aa2-9565-90e41d10ff9c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:20.002010 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f110479d-fbb5-4aa2-9565-90e41d10ff9c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086417 Oct 27 09:46:20.003777 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3286/6647] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:46:19 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:21.023151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f8725195-59a5-4408-85c1-7954aa801c50 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:21.026915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f8725195-59a5-4408-85c1-7954aa801c50 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:21.038962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8725195-59a5-4408-85c1-7954aa801c50 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:21.039876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8725195-59a5-4408-85c1-7954aa801c50 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:21.040645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8725195-59a5-4408-85c1-7954aa801c50 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:21.041870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8725195-59a5-4408-85c1-7954aa801c50 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:21.042681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8725195-59a5-4408-85c1-7954aa801c50 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:21.043466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8725195-59a5-4408-85c1-7954aa801c50 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:21.102464 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f8725195-59a5-4408-85c1-7954aa801c50 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086601 Oct 27 09:46:21.103539 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3362/6648] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:46:21 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:46:21.194381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:21.195233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:21.203661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:21.204160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:21.204604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:21.205319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:21.205775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:21.206202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:21.237096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:46:21.338359 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5fdab488-cb00-44d3-bd25-0539fd2f5bd7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 204 len: 0 microversion: 2.1 time: 0.148801 Oct 27 09:46:21.338610 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3287/6649] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:46:21 2022] DELETE /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:46:21.351475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:21.352433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:21.360701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:21.361219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:21.361681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:21.362430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:21.362904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:21.363350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:21.535379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:21.545662 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cc2ae564-214b-4c31-a4d2-f43492dba7c0 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1679 microversion: 2.1 time: 0.199346 Oct 27 09:46:21.546334 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3363/6650] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:21 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:22.572259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:22.573145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:22.582197 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:22.582628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:22.583074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:22.584094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:22.584658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:22.585290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:22.753514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:22.768555 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-126e4936-24cb-4fbd-9c99-6d4d65a4b172 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1679 microversion: 2.1 time: 0.200887 Oct 27 09:46:22.769598 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3288/6651] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:22 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:23.800288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:23.801744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:23.812377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:23.813297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:23.814429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:23.815636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:23.816450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:23.817679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:23.932423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:23.944608 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cef554c6-2515-4d5f-8c54-0c32fe43d33c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 200 len: 1611 microversion: 2.1 time: 0.148695 Oct 27 09:46:23.945330 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3364/6652] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:23 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 1611 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:24.295789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-75dd5344-496f-42cd-bdc7-e4c7f60a30b2 req-ec2e1835-0b43-4edd-ba50-f55c8cb790e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e65655e-5c79-4a4c-a5bb-f1d9ae55c471", "name": "network-vif-deleted", "tag": "d6829278-2f28-4bca-b1a9-9428e14f924e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:24.325907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-75dd5344-496f-42cd-bdc7-e4c7f60a30b2 req-ec2e1835-0b43-4edd-ba50-f55c8cb790e2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:24.326861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-75dd5344-496f-42cd-bdc7-e4c7f60a30b2 req-ec2e1835-0b43-4edd-ba50-f55c8cb790e2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:24.327479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-75dd5344-496f-42cd-bdc7-e4c7f60a30b2 req-ec2e1835-0b43-4edd-ba50-f55c8cb790e2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:24.342537 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-75dd5344-496f-42cd-bdc7-e4c7f60a30b2 req-ec2e1835-0b43-4edd-ba50-f55c8cb790e2 service nova] Creating event network-vif-deleted:d6829278-2f28-4bca-b1a9-9428e14f924e for instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 on n-h2-858383-16 Oct 27 09:46:24.353785 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-75dd5344-496f-42cd-bdc7-e4c7f60a30b2 req-ec2e1835-0b43-4edd-ba50-f55c8cb790e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064397 Oct 27 09:46:24.354570 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3289/6653] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:24.982114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:24.983781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:24.994266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:24.995214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:24.996672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:24.998320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:25.007998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:25.009256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:25.031655 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 HTTP/1.1 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7e65655e-5c79-4a4c-a5bb-f1d9ae55c471'} Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:46:25.033398 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9db9c557-793a-45f5-845e-41662e96d06f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 404 len: 111 microversion: 2.1 time: 0.061525 Oct 27 09:46:25.042007 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3365/6654] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:24 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:46:25.048988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8d88f3f-49b4-46ae-9ddf-2e9b455b1636 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '.version_select at 0x7f31a8f52310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:25.079284 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8d88f3f-49b4-46ae-9ddf-2e9b455b1636 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830277233" status: 202 len: 0 microversion: 2.1 time: 0.037375 Oct 27 09:46:25.080269 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3290/6655] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:46:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830277233 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:46:25.560180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2c46af34-3526-4ef9-9c0a-6538c0f0df47 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:25.560913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2c46af34-3526-4ef9-9c0a-6538c0f0df47 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:25.573633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c46af34-3526-4ef9-9c0a-6538c0f0df47 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:25.575159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c46af34-3526-4ef9-9c0a-6538c0f0df47 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:25.575681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c46af34-3526-4ef9-9c0a-6538c0f0df47 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:25.576755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c46af34-3526-4ef9-9c0a-6538c0f0df47 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:25.577759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c46af34-3526-4ef9-9c0a-6538c0f0df47 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:25.578826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2c46af34-3526-4ef9-9c0a-6538c0f0df47 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:25.851267 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2c46af34-3526-4ef9-9c0a-6538c0f0df47 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1832 microversion: 2.1 time: 0.300207 Oct 27 09:46:25.853043 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3366/6656] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:25 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1832 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:25.981716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:25.982880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:25.992782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:25.994075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:25.994575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:25.995465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:25.996064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:25.996503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:26.043637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3a19a82-4491-4fd2-9eb5-a726ee1235ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: .version_select at 0x7f31a8133f70>, body: {"keypair": {"name": "tempest-keypair-894180251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkNUd8nOkH1XoYkN02jSuGvcBOo65MYN/yV3qxR7gfsSGZB4vi53Hv3RSyOgTSfu/vmUHeibMH0G1OSEOs6uM5tA6U2H8Hlr+5JhGU8oDrIIsvCwmZeu8KBAPP19MFYug=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:26.064899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-c3a19a82-4491-4fd2-9eb5-a726ee1235ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for project a82209ade47d45dfa83c52c24366f737. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:46:26.077476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-c3a19a82-4491-4fd2-9eb5-a726ee1235ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for user 485ee99d7fbd4f359824aff38966a868 and project a82209ade47d45dfa83c52c24366f737. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:46:26.134114 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c3a19a82-4491-4fd2-9eb5-a726ee1235ff tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096396 Oct 27 09:46:26.134756 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3367/6657] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:46:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:26.294604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:26.304504 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8536b14f-e0fd-427d-950d-87458da02562 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1679 microversion: 2.1 time: 0.414415 Oct 27 09:46:26.305114 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3291/6658] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:25 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1679 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:26.505146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1a154892-844f-4627-9a69-93086df1ffcf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:26.507733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1a154892-844f-4627-9a69-93086df1ffcf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:26.514923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a154892-844f-4627-9a69-93086df1ffcf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:26.515432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a154892-844f-4627-9a69-93086df1ffcf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:26.515917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a154892-844f-4627-9a69-93086df1ffcf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:26.516634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a154892-844f-4627-9a69-93086df1ffcf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:26.517278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a154892-844f-4627-9a69-93086df1ffcf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:26.517721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1a154892-844f-4627-9a69-93086df1ffcf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:26.602774 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1a154892-844f-4627-9a69-93086df1ffcf tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action" status: 200 len: 32637 microversion: 2.1 time: 0.101612 Oct 27 09:46:26.609329 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3368/6659] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:46:26 2022] POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action => generated 32637 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:46:26.853426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:26.854079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:26.864933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:26.865618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:26.866211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:26.867129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:26.867978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:26.868592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:26.931661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '361df34afb8c4d0f9c424676793e3ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3c8646e85f4cc28f07514807032f04', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:26.932517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] flavor_id is None. Assuming migration. {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 27 09:46:26.933146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 09:46:27.212997 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-44a25405-702e-419d-b49b-26be269892fe tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action" status: 202 len: 0 microversion: 2.1 time: 0.364250 Oct 27 09:46:27.215500 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3292/6660] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:46:26 2022] POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:46:27.230550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:27.231943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:27.248399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:27.249658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:27.250284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:27.251153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:27.252646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:27.253180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:27.474668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:27.490867 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-96671c2f-e53a-4dda-aff4-8258b645b5fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1688 microversion: 2.1 time: 0.269252 Oct 27 09:46:27.492409 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3369/6661] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:27 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1688 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:28.462953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-246086551", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0dbda36-c7d7-4d8b-8839-e59a3043c05d"}], "security_groups": [{"name": "tempest-securitygroup--193722101"}], "key_name": "tempest-keypair-894180251", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:28.535646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:28.537136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:28.550606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:28.551320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:28.552631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:28.555440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:28.556533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:28.557188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:28.696445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] validate_networks() for [('d0dbda36-c7d7-4d8b-8839-e59a3043c05d', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:46:28.861299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:28.872850 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a718ab92-54a6-4ca5-b01c-ff1997c156eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1688 microversion: 2.1 time: 0.343574 Oct 27 09:46:28.874333 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3370/6662] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:28 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1688 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:29.309346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:46:29.309788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:46:29.310293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:46:29.310706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:46:29.311127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:46:29.322467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:29.329144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:29.329619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:29.330564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:29.331780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:29.331780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:29.352805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for project a82209ade47d45dfa83c52c24366f737. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:46:29.359507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Getting quotas for user 485ee99d7fbd4f359824aff38966a868 and project a82209ade47d45dfa83c52c24366f737. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:46:29.382692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:46:29.385785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:46:29.454329 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f19305d7-766d-4533-8ef9-ae5039a94233 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.996289 Oct 27 09:46:29.463308 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3293/6663] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:46:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:46:29.471518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-534cadc2-217f-4f13-9842-8de5285549f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:29.472804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-534cadc2-217f-4f13-9842-8de5285549f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:29.570363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-534cadc2-217f-4f13-9842-8de5285549f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:29.579676 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-534cadc2-217f-4f13-9842-8de5285549f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1240 microversion: 2.1 time: 0.113321 Oct 27 09:46:29.596489 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3371/6664] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:29 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:29.917554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:29.919642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:29.933992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:29.935664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:29.936468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:29.938444 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:29.940179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:29.941002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:30.204072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:30.216444 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6baafca-3a5b-4b13-a46f-086124cf3460 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1688 microversion: 2.1 time: 0.317571 Oct 27 09:46:30.217305 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3294/6665] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:29 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1688 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:30.607728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:30.608344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:30.616934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:30.617586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:30.617802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:30.618636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:30.619149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:30.619593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:30.696637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:30.712026 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f1886684-b4ac-46a3-941f-1d3eebd59407 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1292 microversion: 2.1 time: 0.108509 Oct 27 09:46:30.713106 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3372/6666] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:30 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1292 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:31.245683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:31.248192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:31.262897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:31.264228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:31.265084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:31.266734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:31.267657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:31.268482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:31.472183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:31.483366 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-deab91df-9911-4a53-bb64-f350a9c0d12a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.246004 Oct 27 09:46:31.484370 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3295/6667] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:31 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:31.741108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:31.742524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:31.752202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:31.753032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:31.753803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:31.754799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:31.755335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:31.756135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:31.987314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:32.005336 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f01dcb47-d712-4758-9c7e-b108c7f815dd tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1365 microversion: 2.1 time: 0.267752 Oct 27 09:46:32.006605 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3373/6668] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:31 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:32.518559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:32.519966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:32.533495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:32.534400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:32.535210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:32.536571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:32.537632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:32.539340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:32.724610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:32.734293 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f5e65f9-75dd-4942-ae63-cc1cf04f32a0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.223707 Oct 27 09:46:32.734941 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3296/6669] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:32 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:32.991008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-68284f74-5890-4368-a4aa-7e39c1422910 req-669c002f-da30-4845-90f5-6cfd42d42cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbbba24-84e1-4f2b-b125-bec73c4bad65", "tag": "6cab64a7-5eac-455f-bcef-d7b0f4795a19"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:33.010447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-68284f74-5890-4368-a4aa-7e39c1422910 req-669c002f-da30-4845-90f5-6cfd42d42cbf service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:33.011311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-68284f74-5890-4368-a4aa-7e39c1422910 req-669c002f-da30-4845-90f5-6cfd42d42cbf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:33.012161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-68284f74-5890-4368-a4aa-7e39c1422910 req-669c002f-da30-4845-90f5-6cfd42d42cbf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:33.034931 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-68284f74-5890-4368-a4aa-7e39c1422910 req-669c002f-da30-4845-90f5-6cfd42d42cbf service nova] Creating event network-changed:6cab64a7-5eac-455f-bcef-d7b0f4795a19 for instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 on n-h2-858383-16 Oct 27 09:46:33.038953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:33.045243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:33.046695 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-68284f74-5890-4368-a4aa-7e39c1422910 req-669c002f-da30-4845-90f5-6cfd42d42cbf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062642 Oct 27 09:46:33.047818 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3374/6670] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:33.059582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:33.060750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:33.061732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:33.063042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:33.063537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:33.064200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:33.282957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:33.287629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:33.295616 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-853e9f29-d638-4cbc-8a6c-b2e05202647b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1365 microversion: 2.1 time: 0.267692 Oct 27 09:46:33.296385 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3297/6671] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:33 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:33.766974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:33.767847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:33.774807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:33.775326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:33.775843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:33.776614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:33.777107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:33.777560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:33.933912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:33.949751 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c37ade0-1ace-4c68-89f0-28baef95db90 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.187170 Oct 27 09:46:33.950763 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3375/6672] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:33 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:34.321231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:34.322112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:34.333539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:34.334879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:34.335728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:34.337049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:34.337928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:34.338659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:34.525892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:34.535936 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a96e92b5-4825-4848-b3e4-d8848ce8e4ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1365 microversion: 2.1 time: 0.219351 Oct 27 09:46:34.536551 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3298/6673] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:34 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:34.988551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:34.989430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:34.996746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:34.997251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:34.997705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:34.998466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:34.998917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:34.999360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:35.155294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:35.170163 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-29556cd1-8fab-4b88-be63-5a0ee4642cf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.185639 Oct 27 09:46:35.171235 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3376/6674] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:34 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:35.574876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:35.576175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:35.585301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:35.586019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:35.586681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:35.587825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:35.588433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:35.588977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:35.780256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:35.795724 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-013e26b5-92c5-4512-85c9-59b9d5d8c7f5 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1365 microversion: 2.1 time: 0.224714 Oct 27 09:46:35.796828 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3299/6675] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:35 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:36.210034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:36.210740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:36.218987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:36.219504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:36.220006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:36.220749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:36.221228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:36.221675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:36.386503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:36.395716 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4871d930-ac12-4003-8f5c-a9e557cf45b0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.189631 Oct 27 09:46:36.396332 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3377/6676] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:36 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:36.821099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:36.822008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:36.830051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:36.830558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:36.831175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:36.832000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:36.832484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:36.832924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:36.999791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:37.009133 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd35e1ba-ee6d-484f-b457-8b3622cf1cd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1365 microversion: 2.1 time: 0.192715 Oct 27 09:46:37.009755 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3300/6677] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:36 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:37.420483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:37.421162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:37.429910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:37.430464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:37.430967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:37.431790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:37.432368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:37.432863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:37.438683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:37.948871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:37.958398 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94e11f24-7023-4a87-bb87-69a3a78adcc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.542001 Oct 27 09:46:37.959028 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3378/6678] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:37 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:38.047030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:38.048207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:38.060733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:38.061607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:38.062376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:38.063669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:38.064489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:38.065247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:38.254398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:38.263314 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45cfcee3-d44d-4dbb-a039-77495732f6c3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1365 microversion: 2.1 time: 0.223398 Oct 27 09:46:38.263959 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3301/6679] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:38 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:38.984049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:38.984807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:38.995763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:38.995763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:38.995763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:38.996737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:38.997278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:38.997777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:39.195251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:39.209788 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d797c72e-67e0-4923-a4f3-d5be242f6fcc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.230172 Oct 27 09:46:39.210977 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3379/6680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:38 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:39.290074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:39.291497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:39.304056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:39.304960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:39.305760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:39.307075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:39.307984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:39.308810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:39.341025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:39.373741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:39.535426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:39.546010 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50a5bc2f-5f24-418b-b073-a1c54734bf33 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1365 microversion: 2.1 time: 0.261569 Oct 27 09:46:39.546908 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3302/6681] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:39 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:40.236261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:40.236937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:40.238952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:40.246974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:40.247533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:40.248096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:40.249110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:40.249985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:40.250537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:40.416245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:40.425707 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a1d6212d-5a1a-4d1b-b1fa-61fe21dcfaf0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.193465 Oct 27 09:46:40.426321 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3380/6682] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:40 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:40.573417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:40.575279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:40.587526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:40.588609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:40.589424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:40.591452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:40.592381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:40.593179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:40.814345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:40.831982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f4d32a45-59c5-4cd4-a963-00fb6fda0b42 req-1f13d18b-6191-418b-bd00-4e97d9926be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbbba24-84e1-4f2b-b125-bec73c4bad65", "name": "network-vif-plugged", "status": "completed", "tag": "6cab64a7-5eac-455f-bcef-d7b0f4795a19"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:40.854281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f4d32a45-59c5-4cd4-a963-00fb6fda0b42 req-1f13d18b-6191-418b-bd00-4e97d9926be4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:40.855120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f4d32a45-59c5-4cd4-a963-00fb6fda0b42 req-1f13d18b-6191-418b-bd00-4e97d9926be4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:40.855958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f4d32a45-59c5-4cd4-a963-00fb6fda0b42 req-1f13d18b-6191-418b-bd00-4e97d9926be4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:40.862868 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3b28070-c2ad-4ce0-923a-53cda862722f tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1365 microversion: 2.1 time: 0.294817 Oct 27 09:46:40.863991 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3303/6683] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:40 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:40.884129 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f4d32a45-59c5-4cd4-a963-00fb6fda0b42 req-1f13d18b-6191-418b-bd00-4e97d9926be4 service nova] Creating event network-vif-plugged:6cab64a7-5eac-455f-bcef-d7b0f4795a19 for instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 on n-h2-858383-16 Oct 27 09:46:40.894020 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f4d32a45-59c5-4cd4-a963-00fb6fda0b42 req-1f13d18b-6191-418b-bd00-4e97d9926be4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070243 Oct 27 09:46:40.895118 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3381/6684] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:46:41.450207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:41.451456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:41.457990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:41.458541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:41.459051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:41.459903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:41.460422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:41.460934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:41.644785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:41.658602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2940c7ef-8ace-4c62-957e-da003eb02044 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.212249 Oct 27 09:46:41.659427 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3304/6685] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:41 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:41.893111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:41.894090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:41.902974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:41.903748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:41.904331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:41.905496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:41.906260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:41.906763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:42.086881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:42.101361 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f27521df-de67-4f34-9b4e-5ea3715f8227 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1365 microversion: 2.1 time: 0.213753 Oct 27 09:46:42.102473 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3382/6686] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:41 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:42.689783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:42.690409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:42.698381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:42.698889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:42.699389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:42.700186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:42.700664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:42.701104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:42.867410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:42.876329 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0cc9099b-2f25-4ff3-bdab-8bb20bc55d66 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.190834 Oct 27 09:46:42.876939 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3305/6687] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:42 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:43.126937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:43.127664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:43.135607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:43.136114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:43.137081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:43.137907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:43.138390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:43.138848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:43.296620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:43.305112 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e6467600-fa27-4e33-82e7-85517185b150 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1555 microversion: 2.1 time: 0.182467 Oct 27 09:46:43.305723 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3383/6688] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:43 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:43.332566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67d770f9-8470-4977-b836-25a44817c497 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:43.333816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67d770f9-8470-4977-b836-25a44817c497 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:43.344348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d770f9-8470-4977-b836-25a44817c497 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:43.345629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d770f9-8470-4977-b836-25a44817c497 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:43.346272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d770f9-8470-4977-b836-25a44817c497 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:43.347207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d770f9-8470-4977-b836-25a44817c497 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:43.347793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d770f9-8470-4977-b836-25a44817c497 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:43.348285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67d770f9-8470-4977-b836-25a44817c497 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:43.440469 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67d770f9-8470-4977-b836-25a44817c497 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113842 Oct 27 09:46:43.441251 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3306/6689] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 09:46:43 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:43.901468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:43.902352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:43.911145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:43.911869 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:43.912595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:43.913512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:43.914052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:43.914551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:44.104505 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:44.118740 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c0df3146-8543-48b5-bb5c-392cdad69c0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.221395 Oct 27 09:46:44.119744 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3384/6690] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:43 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:45.168712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:45.169827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:45.181409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:45.193057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:45.194361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:45.195511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:45.197987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:45.199968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:45.201503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:45.213027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-cd19f5c0-d438-41b2-9666-abbfa842d863 req-d0f0ff76-bbf2-49bd-b319-3cfe30c0980c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbbba24-84e1-4f2b-b125-bec73c4bad65", "tag": "6cab64a7-5eac-455f-bcef-d7b0f4795a19"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:45.229952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:45.235240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cd19f5c0-d438-41b2-9666-abbfa842d863 req-d0f0ff76-bbf2-49bd-b319-3cfe30c0980c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:45.236603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cd19f5c0-d438-41b2-9666-abbfa842d863 req-d0f0ff76-bbf2-49bd-b319-3cfe30c0980c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:45.237847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cd19f5c0-d438-41b2-9666-abbfa842d863 req-d0f0ff76-bbf2-49bd-b319-3cfe30c0980c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:45.278702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-cd19f5c0-d438-41b2-9666-abbfa842d863 req-d0f0ff76-bbf2-49bd-b319-3cfe30c0980c service nova] Creating event network-changed:6cab64a7-5eac-455f-bcef-d7b0f4795a19 for instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 on n-h2-858383-16 Oct 27 09:46:45.294444 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-cd19f5c0-d438-41b2-9666-abbfa842d863 req-d0f0ff76-bbf2-49bd-b319-3cfe30c0980c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084391 Oct 27 09:46:45.296488 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3385/6691] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:46:45.486749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:45.499037 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2146f437-a3a3-4677-8483-a03121b2d1df tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.343019 Oct 27 09:46:45.500445 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3307/6692] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:45 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:46.542778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:46.545260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:46.557679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:46.558290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:46.559410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:46.561023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:46.561655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:46.562233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:46.768372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:46.779793 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bc7427a0-accc-4f7a-aefe-8345675b3ba4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1693 microversion: 2.1 time: 0.245017 Oct 27 09:46:46.780813 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3386/6693] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:46 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1693 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:47.812966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:47.814600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:47.828728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:47.830538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:47.831380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:47.832765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:47.833657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:47.834488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:48.066352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-49cb6786-d081-4749-8e63-5416a8d7f9f9 req-654d1f8b-1dbd-471c-9052-2808f431dd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "name": "network-vif-unplugged", "status": "completed", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:48.071633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:48.082398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-49cb6786-d081-4749-8e63-5416a8d7f9f9 req-654d1f8b-1dbd-471c-9052-2808f431dd8f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:48.083558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-49cb6786-d081-4749-8e63-5416a8d7f9f9 req-654d1f8b-1dbd-471c-9052-2808f431dd8f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:48.084585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-49cb6786-d081-4749-8e63-5416a8d7f9f9 req-654d1f8b-1dbd-471c-9052-2808f431dd8f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:48.087211 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21d84785-713e-4e61-abae-6a99ebe8165c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1692 microversion: 2.1 time: 0.281764 Oct 27 09:46:48.088534 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3308/6694] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:47 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1692 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:48.116455 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-49cb6786-d081-4749-8e63-5416a8d7f9f9 req-654d1f8b-1dbd-471c-9052-2808f431dd8f service nova] Creating event network-vif-unplugged:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h2-858383-16 Oct 27 09:46:48.127650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-49cb6786-d081-4749-8e63-5416a8d7f9f9 req-654d1f8b-1dbd-471c-9052-2808f431dd8f service nova] Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:46:48.150801 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-49cb6786-d081-4749-8e63-5416a8d7f9f9 req-654d1f8b-1dbd-471c-9052-2808f431dd8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090467 Oct 27 09:46:48.152018 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3387/6695] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:49.121027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:49.122218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:49.131454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:49.132270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:49.132875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:49.133913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:49.134616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:49.135187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:49.321587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:49.332715 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5dc2c42-243b-4d20-b55e-e84e139c632b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1692 microversion: 2.1 time: 0.216130 Oct 27 09:46:49.333600 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3309/6696] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:49 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1692 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:50.174668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-cdc533be-01e0-4d23-9844-811d639fb1bd req-b45d70f2-531e-41be-abc9-f084537194c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:50.185292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cdc533be-01e0-4d23-9844-811d639fb1bd req-b45d70f2-531e-41be-abc9-f084537194c4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:50.185787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cdc533be-01e0-4d23-9844-811d639fb1bd req-b45d70f2-531e-41be-abc9-f084537194c4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:50.186242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cdc533be-01e0-4d23-9844-811d639fb1bd req-b45d70f2-531e-41be-abc9-f084537194c4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:50.199692 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-cdc533be-01e0-4d23-9844-811d639fb1bd req-b45d70f2-531e-41be-abc9-f084537194c4 service nova] Creating event network-changed:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h2-858383-16 Oct 27 09:46:50.205943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-cdc533be-01e0-4d23-9844-811d639fb1bd req-b45d70f2-531e-41be-abc9-f084537194c4 service nova] Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:46:50.217951 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-cdc533be-01e0-4d23-9844-811d639fb1bd req-b45d70f2-531e-41be-abc9-f084537194c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048480 Oct 27 09:46:50.218575 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3388/6697] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:50.358663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:50.359710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:50.374711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:50.375651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:50.376466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:50.377812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:50.378608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:50.379069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:50.750070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:50.760297 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9d24383d-b387-434f-9855-330b810349ca tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1690 microversion: 2.1 time: 0.406505 Oct 27 09:46:50.761037 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3310/6698] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:50 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1690 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:51.794776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:51.795513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:51.803676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:51.805651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:51.806504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:51.807682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:51.808206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:51.809201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:52.022602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:52.037454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ad155cc-9382-42f9-9ee3-3f91c98c677e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1690 microversion: 2.1 time: 0.247766 Oct 27 09:46:52.038586 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3389/6699] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:51 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1690 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:53.065410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:53.066040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:53.073860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:53.074422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:53.074865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:53.075642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:53.076105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:53.076563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:53.228201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:53.242657 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-783fe8df-c5c8-434c-a303-9a875ba654d4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1687 microversion: 2.1 time: 0.180852 Oct 27 09:46:53.243824 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3311/6700] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:53 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:53.271114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a0730ffa-3210-47cd-8239-70dbaefe30a2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:53.272302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a0730ffa-3210-47cd-8239-70dbaefe30a2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:53.284428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0730ffa-3210-47cd-8239-70dbaefe30a2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:53.286336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0730ffa-3210-47cd-8239-70dbaefe30a2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:53.287122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0730ffa-3210-47cd-8239-70dbaefe30a2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:53.288557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0730ffa-3210-47cd-8239-70dbaefe30a2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:53.289454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0730ffa-3210-47cd-8239-70dbaefe30a2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:53.290018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a0730ffa-3210-47cd-8239-70dbaefe30a2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:53.446229 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a0730ffa-3210-47cd-8239-70dbaefe30a2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action" status: 202 len: 0 microversion: 2.1 time: 0.180832 Oct 27 09:46:53.447683 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3390/6701] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:46:53 2022] POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:46:53.466037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:53.468091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:53.478464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:53.479250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:53.479977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:53.481046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:53.481819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:53.482424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:53.730292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:53.738656 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-513aa6c0-cdb2-4b3c-9b29-1645bd90123b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1686 microversion: 2.1 time: 0.285333 Oct 27 09:46:53.739265 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3312/6702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:53 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1686 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:54.768959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:54.770972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:54.781291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:54.782226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:54.782776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:54.783636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:54.784236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:54.785012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:54.875615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c3416c64-f113-4574-8b7e-51d4becc9a51 req-520be58d-df46-4928-94ea-9418e80101b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "name": "network-vif-plugged", "status": "completed", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:54.894329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c3416c64-f113-4574-8b7e-51d4becc9a51 req-520be58d-df46-4928-94ea-9418e80101b8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:54.895529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c3416c64-f113-4574-8b7e-51d4becc9a51 req-520be58d-df46-4928-94ea-9418e80101b8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:54.896324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c3416c64-f113-4574-8b7e-51d4becc9a51 req-520be58d-df46-4928-94ea-9418e80101b8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:54.923240 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c3416c64-f113-4574-8b7e-51d4becc9a51 req-520be58d-df46-4928-94ea-9418e80101b8 service nova] Creating event network-vif-plugged:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h2-858383-16 Oct 27 09:46:54.937564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-c3416c64-f113-4574-8b7e-51d4becc9a51 req-520be58d-df46-4928-94ea-9418e80101b8 service nova] Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:46:54.958443 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c3416c64-f113-4574-8b7e-51d4becc9a51 req-520be58d-df46-4928-94ea-9418e80101b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087734 Oct 27 09:46:54.959880 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3313/6703] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:55.014658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:55.024726 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8df47295-4f04-4bb4-a196-d28d2a8881a3 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1686 microversion: 2.1 time: 0.264603 Oct 27 09:46:55.025352 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3391/6704] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:54 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1686 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:56.050614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:56.051708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:56.060061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:56.060573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:56.061026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:56.061779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:56.062245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:56.062684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:56.253465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:56.262567 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67057479-52c6-4597-98f9-6499ad4d82be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1686 microversion: 2.1 time: 0.216707 Oct 27 09:46:56.263166 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3314/6705] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:56 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1686 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:57.286672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:57.287532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:57.296727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:57.297377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:57.297763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:57.298728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:57.299254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:57.299752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:57.364463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-dda7ecd3-8477-4af6-8ade-7b262084a03c req-57a63723-a45d-475a-bc5a-2d38b0ecdb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "name": "network-vif-unplugged", "status": "completed", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:57.379490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-dda7ecd3-8477-4af6-8ade-7b262084a03c req-57a63723-a45d-475a-bc5a-2d38b0ecdb3b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:57.380300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-dda7ecd3-8477-4af6-8ade-7b262084a03c req-57a63723-a45d-475a-bc5a-2d38b0ecdb3b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:57.381000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-dda7ecd3-8477-4af6-8ade-7b262084a03c req-57a63723-a45d-475a-bc5a-2d38b0ecdb3b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:57.386815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:57.399471 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-dda7ecd3-8477-4af6-8ade-7b262084a03c req-57a63723-a45d-475a-bc5a-2d38b0ecdb3b service nova] Creating event network-vif-unplugged:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h1-858383-16 Oct 27 09:46:57.408341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-dda7ecd3-8477-4af6-8ade-7b262084a03c req-57a63723-a45d-475a-bc5a-2d38b0ecdb3b service nova] Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:46:57.423173 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-dda7ecd3-8477-4af6-8ade-7b262084a03c req-57a63723-a45d-475a-bc5a-2d38b0ecdb3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063289 Oct 27 09:46:57.424326 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3315/6706] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:46:57.660464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:57.671422 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6e0f3d1e-62b0-4154-9755-1b77901df29c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1686 microversion: 2.1 time: 0.388921 Oct 27 09:46:57.678081 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3392/6707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:57 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1686 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:58.710298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:58.711619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:58.725079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:58.725995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:58.726799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:58.728032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:58.728941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:58.729748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:58.897051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:58.907679 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0d94273b-ac33-481c-a625-9bc2c1fd8b4d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1686 microversion: 2.1 time: 0.212135 Oct 27 09:46:58.908449 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3316/6708] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:58 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1686 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:59.444616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f3afbe6e-56a7-4686-92e8-1aee9a28e90f req-923ecf37-49e1-44aa-97c2-48130e7dd375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:59.456841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f3afbe6e-56a7-4686-92e8-1aee9a28e90f req-923ecf37-49e1-44aa-97c2-48130e7dd375 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:59.457469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f3afbe6e-56a7-4686-92e8-1aee9a28e90f req-923ecf37-49e1-44aa-97c2-48130e7dd375 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:59.457972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f3afbe6e-56a7-4686-92e8-1aee9a28e90f req-923ecf37-49e1-44aa-97c2-48130e7dd375 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:59.472586 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f3afbe6e-56a7-4686-92e8-1aee9a28e90f req-923ecf37-49e1-44aa-97c2-48130e7dd375 service nova] Creating event network-changed:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h1-858383-16 Oct 27 09:46:59.479090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-f3afbe6e-56a7-4686-92e8-1aee9a28e90f req-923ecf37-49e1-44aa-97c2-48130e7dd375 service nova] Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 09:46:59.491401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f3afbe6e-56a7-4686-92e8-1aee9a28e90f req-923ecf37-49e1-44aa-97c2-48130e7dd375 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050758 Oct 27 09:46:59.492189 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3393/6709] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:59.932136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:59.933054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:59.941927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:59.942675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:59.943479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:59.944594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:59.945362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:59.945897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:00.133584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:47:00.143632 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7151cd93-1628-4622-9056-cde3791cf5fe tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1686 microversion: 2.1 time: 0.215718 Oct 27 09:47:00.144298 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3317/6710] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:59 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1686 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:47:01.170378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:47:01.171185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:47:01.178200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:01.178714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:01.179171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:01.179958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:01.180434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:01.180871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:01.561212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:47:01.573505 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1c42ed0-2865-47ea-a855-8a2fd81be386 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1686 microversion: 2.1 time: 0.408470 Oct 27 09:47:01.574327 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3394/6711] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:47:01 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1686 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:47:02.599204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:47:02.599893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:47:02.608280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:02.608787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:02.609246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:02.609991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:02.610472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:02.610916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:02.772476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:47:02.787904 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b358c10-b9df-4341-b367-6a817a6ea27d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1679 microversion: 2.1 time: 0.192664 Oct 27 09:47:02.789105 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3318/6712] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:47:02 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:47:04.721655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-520702bc-1148-4a54-a06d-75e9c96bd452 req-4d540fd5-508e-4239-b23e-b05b7cb7912b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "name": "network-vif-plugged", "status": "completed", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:47:04.738741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-520702bc-1148-4a54-a06d-75e9c96bd452 req-4d540fd5-508e-4239-b23e-b05b7cb7912b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:04.739656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-520702bc-1148-4a54-a06d-75e9c96bd452 req-4d540fd5-508e-4239-b23e-b05b7cb7912b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:04.740479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-520702bc-1148-4a54-a06d-75e9c96bd452 req-4d540fd5-508e-4239-b23e-b05b7cb7912b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:04.762370 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-520702bc-1148-4a54-a06d-75e9c96bd452 req-4d540fd5-508e-4239-b23e-b05b7cb7912b service nova] Creating event network-vif-plugged:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h1-858383-16 Oct 27 09:47:04.772016 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-520702bc-1148-4a54-a06d-75e9c96bd452 req-4d540fd5-508e-4239-b23e-b05b7cb7912b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055450 Oct 27 09:47:04.773305 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3395/6713] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:47:37.073357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9707bece-e6e8-4368-a962-a9576631bc42 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:47:37.076699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9707bece-e6e8-4368-a962-a9576631bc42 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:47:37.080965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=23 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:37.082141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=20 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:37.090891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9707bece-e6e8-4368-a962-a9576631bc42 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:37.091523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9707bece-e6e8-4368-a962-a9576631bc42 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:37.092291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9707bece-e6e8-4368-a962-a9576631bc42 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:37.093541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9707bece-e6e8-4368-a962-a9576631bc42 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:37.094399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9707bece-e6e8-4368-a962-a9576631bc42 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:37.095157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9707bece-e6e8-4368-a962-a9576631bc42 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:37.168095 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9707bece-e6e8-4368-a962-a9576631bc42 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action" status: 200 len: 63054 microversion: 2.1 time: 0.099855 Oct 27 09:47:37.168889 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3319/6714] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:47:37 2022] POST /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92/action => generated 63054 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:47:48.059388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=25 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:48.060341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:48.065459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-463c6915-1340-4585-9cbc-93b5bdf54cbe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:47:48.066063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-463c6915-1340-4585-9cbc-93b5bdf54cbe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:47:48.075560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-463c6915-1340-4585-9cbc-93b5bdf54cbe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:48.076097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-463c6915-1340-4585-9cbc-93b5bdf54cbe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:48.076553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-463c6915-1340-4585-9cbc-93b5bdf54cbe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:48.077432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-463c6915-1340-4585-9cbc-93b5bdf54cbe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:48.077908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-463c6915-1340-4585-9cbc-93b5bdf54cbe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:48.078382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-463c6915-1340-4585-9cbc-93b5bdf54cbe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:48.107478 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-463c6915-1340-4585-9cbc-93b5bdf54cbe tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/ips" status: 200 len: 150 microversion: 2.1 time: 0.051145 Oct 27 09:47:48.108206 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3396/6715] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:47:48 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:47:50.658950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-799e6fb2-5b10-4004-8b9a-4aa0fcd8f00b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c79e1002-f6d3-4668-9e3b-f40744e736f1"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:47:50.661596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-799e6fb2-5b10-4004-8b9a-4aa0fcd8f00b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:47:50.664275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:50.664949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:50.673105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-799e6fb2-5b10-4004-8b9a-4aa0fcd8f00b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:50.673643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-799e6fb2-5b10-4004-8b9a-4aa0fcd8f00b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:50.674088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-799e6fb2-5b10-4004-8b9a-4aa0fcd8f00b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:50.674851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-799e6fb2-5b10-4004-8b9a-4aa0fcd8f00b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:50.675293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-799e6fb2-5b10-4004-8b9a-4aa0fcd8f00b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:50.675772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-799e6fb2-5b10-4004-8b9a-4aa0fcd8f00b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:51.014805 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-799e6fb2-5b10-4004-8b9a-4aa0fcd8f00b tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "POST /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360142 Oct 27 09:47:51.016995 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3320/6716] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:47:50 2022] POST /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:47:59.924506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91e8a669-350e-4787-b786-e637ddc154c2 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:47:59.925458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91e8a669-350e-4787-b786-e637ddc154c2 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:47:59.927484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:59.928222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:59.936449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e8a669-350e-4787-b786-e637ddc154c2 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:59.937019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e8a669-350e-4787-b786-e637ddc154c2 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:59.937483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e8a669-350e-4787-b786-e637ddc154c2 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:59.938213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e8a669-350e-4787-b786-e637ddc154c2 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:59.938741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e8a669-350e-4787-b786-e637ddc154c2 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:59.939193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91e8a669-350e-4787-b786-e637ddc154c2 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:59.940557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:47:59.941511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:47:59.951514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:59.952266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:59.952826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:59.953822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:47:59.954463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:47:59.955001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:47:59.990510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:48:00.114271 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f450ea64-fa64-4fa0-bf25-6bb0172ada64 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 204 len: 0 microversion: 2.1 time: 0.178981 Oct 27 09:48:00.115153 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3321/6717] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:47:59 2022] DELETE /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:48:00.124382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:00.125168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:00.132146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:00.132650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:00.133114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:00.133838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:00.134305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:00.134740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:00.140736 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91e8a669-350e-4787-b786-e637ddc154c2 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1832 microversion: 2.1 time: 0.220075 Oct 27 09:48:00.142022 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3397/6718] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:47:59 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1832 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:48:00.301552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:00.311023 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb935811-876b-4513-89d1-8a7270686972 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1578 microversion: 2.1 time: 0.191340 Oct 27 09:48:00.311663 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3322/6719] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:00 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:01.207312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:01.208756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:01.219956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:01.220720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:01.221190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:01.222786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:01.223285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:01.223776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:01.278368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:48:01.347169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9c51cdb3-b242-4555-8e7f-0c3754ab7e13 req-8fcb49a4-13cf-4071-8b49-9bc27b2ce9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:01.360073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9c51cdb3-b242-4555-8e7f-0c3754ab7e13 req-8fcb49a4-13cf-4071-8b49-9bc27b2ce9e5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:01.360569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9c51cdb3-b242-4555-8e7f-0c3754ab7e13 req-8fcb49a4-13cf-4071-8b49-9bc27b2ce9e5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:01.361017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9c51cdb3-b242-4555-8e7f-0c3754ab7e13 req-8fcb49a4-13cf-4071-8b49-9bc27b2ce9e5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:01.373898 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9c51cdb3-b242-4555-8e7f-0c3754ab7e13 req-8fcb49a4-13cf-4071-8b49-9bc27b2ce9e5 service nova] Creating event network-changed:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h1-858383-16 Oct 27 09:48:01.379534 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9c51cdb3-b242-4555-8e7f-0c3754ab7e13 req-8fcb49a4-13cf-4071-8b49-9bc27b2ce9e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172890 Oct 27 09:48:01.380638 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3323/6720] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:01.387256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:01.388011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:01.394814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:01.395396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:01.395989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:01.397183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:01.397810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:01.398353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:01.405188 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4212a6e9-2af3-4e51-adfd-27d5d9ae93a8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 204 len: 0 microversion: 2.1 time: 0.203965 Oct 27 09:48:01.406007 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3398/6721] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:48:01 2022] DELETE /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:48:01.418675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:01.419402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:01.426384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:01.426961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:01.427421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:01.428254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:01.428884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:01.429553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:01.982217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:02.002209 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eeaa6eee-8347-4735-a7ec-91d173d8b29e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1578 microversion: 2.1 time: 0.619742 Oct 27 09:48:02.004247 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3324/6722] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:01 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1578 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:02.035519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:02.045022 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ba22fe93-4936-4d5f-bd41-61b63a47e0b4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1685 microversion: 2.1 time: 0.631172 Oct 27 09:48:02.045641 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3399/6723] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:01 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1685 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:03.040216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:03.041032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:03.049590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:03.050167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:03.050608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:03.051355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:03.051839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:03.052277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:03.075103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:03.076558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:03.084599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:03.085192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:03.085647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:03.086625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:03.087096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:03.087537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:03.554564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:03.572016 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-446cda0f-42e8-4112-9e10-44bfdb6cd6af tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1578 microversion: 2.1 time: 0.535574 Oct 27 09:48:03.573082 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3325/6724] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:03 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1578 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:48:03.582936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:03.584204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:03.599199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:03.600157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:03.600949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:03.602260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:03.603108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:03.603964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:03.620990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:03.637289 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c8e52cea-dad1-4b53-bec3-72f928c80176 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 200 len: 1685 microversion: 2.1 time: 0.568343 Oct 27 09:48:03.652154 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3400/6725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:03 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 1685 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:03.733258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lazy-loading 'services' on Instance uuid bcbbba24-84e1-4f2b-b125-bec73c4bad65 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:48:03.824622 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d38e74c7-2a76-46af-975f-855662d5edd2 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments/c79e1002-f6d3-4668-9e3b-f40744e736f1" status: 202 len: 0 microversion: 2.1 time: 0.249099 Oct 27 09:48:03.825643 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3326/6726] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:48:03 2022] DELETE /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments/c79e1002-f6d3-4668-9e3b-f40744e736f1 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:48:03.846095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b44a5bc6-eae1-45d5-941f-a5bcabd3f8f8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:03.851660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b44a5bc6-eae1-45d5-941f-a5bcabd3f8f8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:03.875636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44a5bc6-eae1-45d5-941f-a5bcabd3f8f8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:03.876178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44a5bc6-eae1-45d5-941f-a5bcabd3f8f8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:03.876603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44a5bc6-eae1-45d5-941f-a5bcabd3f8f8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:03.877564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44a5bc6-eae1-45d5-941f-a5bcabd3f8f8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:03.877923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44a5bc6-eae1-45d5-941f-a5bcabd3f8f8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:03.878410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b44a5bc6-eae1-45d5-941f-a5bcabd3f8f8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:03.932402 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b44a5bc6-eae1-45d5-941f-a5bcabd3f8f8 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098628 Oct 27 09:48:03.933381 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3401/6727] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:48:03 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:03.961508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-93cfef55-684e-43b2-bf69-1bf9cb32546d req-d25da0fd-4859-49ee-be00-1f281d02b4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d36c89-d926-4eb2-8ce4-fd22337d2c92", "name": "network-vif-deleted", "tag": "5b6a8727-2204-4bb9-a82c-e02c25ed0940"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:03.981753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-93cfef55-684e-43b2-bf69-1bf9cb32546d req-d25da0fd-4859-49ee-be00-1f281d02b4f9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:03.983236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-93cfef55-684e-43b2-bf69-1bf9cb32546d req-d25da0fd-4859-49ee-be00-1f281d02b4f9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:03.984189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-93cfef55-684e-43b2-bf69-1bf9cb32546d req-d25da0fd-4859-49ee-be00-1f281d02b4f9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:04.001415 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-93cfef55-684e-43b2-bf69-1bf9cb32546d req-d25da0fd-4859-49ee-be00-1f281d02b4f9 service nova] Creating event network-vif-deleted:5b6a8727-2204-4bb9-a82c-e02c25ed0940 for instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 on n-h1-858383-16 Oct 27 09:48:04.008741 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-93cfef55-684e-43b2-bf69-1bf9cb32546d req-d25da0fd-4859-49ee-be00-1f281d02b4f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062537 Oct 27 09:48:04.009719 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3327/6728] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:04.608029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:04.612396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:04.632405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:04.635039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:04.639054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:04.641248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:04.643441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:04.645017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:04.690849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:04.692273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 06d36c89-d926-4eb2-8ce4-fd22337d2c92] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:04.709740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:04.710637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:04.711454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:04.712426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:04.713159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:04.713689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:04.732199 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] HTTP exception thrown: Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 could not be found. Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Request method failure captured: Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 HTTP/1.1 Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlJDSDr1-dsqc3eIUxJ-ieGNeGuhoA4wiY87ragx5kgzDbmJPZslaWdKO1pfCvcYDg6uLTzYhdhl4rSHxTWFf8hu3m-L8rwhHSJeogWLh_KnZWQIRCt2iFkzdspz6TyfdjSpyMD7SVxi8wkEcfqhvYbzSnsfNPvnknwpLkoqydKNQL4 Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: f7fdcfbb223c44e693f100b3717522cf Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7fdcfbb223c44e693f100b3717522cf"}]}] Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: f7fdcfbb223c44e693f100b3717522cf Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestNetworkAdvancedServerOps-476394632-project Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0d83fee6e4854240b13a10c262453b32 Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestNetworkAdvancedServerOps-476394632-project Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 could not be found. Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '06d36c89-d926-4eb2-8ce4-fd22337d2c92'} Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 could not be found. Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 could not be found. Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:04.734291 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 could not be found. Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Returning 404 to user: Instance 06d36c89-d926-4eb2-8ce4-fd22337d2c92 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a6077e1-4dce-47f6-bef9-604efb3c49ad tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92" status: 404 len: 111 microversion: 2.1 time: 0.061188 Oct 27 09:48:04.742391 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3328/6729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:04 2022] GET /compute/v2.1/servers/06d36c89-d926-4eb2-8ce4-fd22337d2c92 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:48:04.869120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:04.894979 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9835c9b0-ef75-48b2-af87-dba9596308f2 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1510 microversion: 2.1 time: 0.297729 Oct 27 09:48:04.896031 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3402/6730] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:04 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1510 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:04.949452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a62cbab2-00b9-4802-8bf9-2c83fc98660a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:04.954116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a62cbab2-00b9-4802-8bf9-2c83fc98660a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:04.972431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62cbab2-00b9-4802-8bf9-2c83fc98660a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:04.972938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62cbab2-00b9-4802-8bf9-2c83fc98660a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:04.973930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62cbab2-00b9-4802-8bf9-2c83fc98660a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:04.974927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62cbab2-00b9-4802-8bf9-2c83fc98660a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:04.978104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62cbab2-00b9-4802-8bf9-2c83fc98660a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:04.978823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a62cbab2-00b9-4802-8bf9-2c83fc98660a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:05.064208 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a62cbab2-00b9-4802-8bf9-2c83fc98660a tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119807 Oct 27 09:48:05.065426 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3329/6731] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:48:04 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:48:05.332186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b48fc55b-ea39-4b10-9650-22b5e527654b req-0f8b4d8f-bc31-4907-b247-7ad18b48e4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e14bab2-c5b6-42c5-8498-b885f872e12c", "name": "network-vif-deleted", "tag": "0a70c909-3d94-40dd-8373-b806a40373ea"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:05.346370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b48fc55b-ea39-4b10-9650-22b5e527654b req-0f8b4d8f-bc31-4907-b247-7ad18b48e4bf service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:05.347273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b48fc55b-ea39-4b10-9650-22b5e527654b req-0f8b4d8f-bc31-4907-b247-7ad18b48e4bf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:05.348937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b48fc55b-ea39-4b10-9650-22b5e527654b req-0f8b4d8f-bc31-4907-b247-7ad18b48e4bf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:05.365264 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b48fc55b-ea39-4b10-9650-22b5e527654b req-0f8b4d8f-bc31-4907-b247-7ad18b48e4bf service nova] Creating event network-vif-deleted:0a70c909-3d94-40dd-8373-b806a40373ea for instance 4e14bab2-c5b6-42c5-8498-b885f872e12c on n-h1-858383-16 Oct 27 09:48:05.371298 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b48fc55b-ea39-4b10-9650-22b5e527654b req-0f8b4d8f-bc31-4907-b247-7ad18b48e4bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130842 Oct 27 09:48:05.372261 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3403/6732] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:05.923942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:05.925615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:05.935252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:05.936134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:05.936835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:05.937959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:05.938836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:05.939432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:06.053497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:06.073373 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0fea05dd-7b16-44c4-aa54-d187f351ff8e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1226 microversion: 2.1 time: 0.155724 Oct 27 09:48:06.079338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f881129a-60f5-41b6-a161-3a3605d9b01c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:06.083628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f881129a-60f5-41b6-a161-3a3605d9b01c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:06.089423 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3330/6733] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:05 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1226 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:06.101396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f881129a-60f5-41b6-a161-3a3605d9b01c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:06.104509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f881129a-60f5-41b6-a161-3a3605d9b01c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:06.105180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f881129a-60f5-41b6-a161-3a3605d9b01c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:06.106110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f881129a-60f5-41b6-a161-3a3605d9b01c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:06.106961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f881129a-60f5-41b6-a161-3a3605d9b01c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:06.107553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f881129a-60f5-41b6-a161-3a3605d9b01c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:06.187436 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f881129a-60f5-41b6-a161-3a3605d9b01c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114355 Oct 27 09:48:06.189286 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3404/6734] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:48:06 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:07.111822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:07.112395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:07.124181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:07.131764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:07.137542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:07.138628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:07.140929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:07.141428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:07.212933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-234eb8ca-1001-4822-bd39-8e28bf09f983 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:07.218459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-234eb8ca-1001-4822-bd39-8e28bf09f983 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:07.234223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-234eb8ca-1001-4822-bd39-8e28bf09f983 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:07.235750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-234eb8ca-1001-4822-bd39-8e28bf09f983 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:07.236936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-234eb8ca-1001-4822-bd39-8e28bf09f983 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:07.238638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-234eb8ca-1001-4822-bd39-8e28bf09f983 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:07.239932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-234eb8ca-1001-4822-bd39-8e28bf09f983 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:07.241106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-234eb8ca-1001-4822-bd39-8e28bf09f983 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:07.268704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:07.290821 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cee06a6f-ef25-4666-bc3c-c1d0d5ec3626 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1226 microversion: 2.1 time: 0.182528 Oct 27 09:48:07.304755 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3331/6735] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:07 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1226 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:48:07.349394 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-234eb8ca-1001-4822-bd39-8e28bf09f983 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144146 Oct 27 09:48:07.350566 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3405/6736] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:48:07 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:08.329159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:08.329733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:08.349587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:08.350105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:08.350564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:08.351323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:08.351822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:08.352463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:08.366061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8000231a-9c6f-47c3-b4a3-c1501a41b5d4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:08.368533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8000231a-9c6f-47c3-b4a3-c1501a41b5d4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:08.385067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8000231a-9c6f-47c3-b4a3-c1501a41b5d4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:08.385919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8000231a-9c6f-47c3-b4a3-c1501a41b5d4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:08.388478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8000231a-9c6f-47c3-b4a3-c1501a41b5d4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:08.392697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8000231a-9c6f-47c3-b4a3-c1501a41b5d4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:08.393352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8000231a-9c6f-47c3-b4a3-c1501a41b5d4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:08.394719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8000231a-9c6f-47c3-b4a3-c1501a41b5d4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:08.437674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:08.447445 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19a937ce-38bd-4354-a148-de88c2b8612c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1226 microversion: 2.1 time: 0.122252 Oct 27 09:48:08.449261 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3332/6737] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:08 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:08.472672 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8000231a-9c6f-47c3-b4a3-c1501a41b5d4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110258 Oct 27 09:48:08.472672 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3406/6738] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:48:08 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:09.473615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:09.474906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:09.485437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e39fab5-a880-4e1d-b537-c29f01d1e870 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:09.487780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9e39fab5-a880-4e1d-b537-c29f01d1e870 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:09.498587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:09.499087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:09.499542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:09.500324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:09.500801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:09.501239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:09.503288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e39fab5-a880-4e1d-b537-c29f01d1e870 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:09.504291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e39fab5-a880-4e1d-b537-c29f01d1e870 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:09.504946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e39fab5-a880-4e1d-b537-c29f01d1e870 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:09.505907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e39fab5-a880-4e1d-b537-c29f01d1e870 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:09.509871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e39fab5-a880-4e1d-b537-c29f01d1e870 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:09.510344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e39fab5-a880-4e1d-b537-c29f01d1e870 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:09.576842 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9e39fab5-a880-4e1d-b537-c29f01d1e870 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096088 Oct 27 09:48:09.577460 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3407/6739] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:48:09 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:48:09.626086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:09.634811 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d4b778f-924b-4af8-8779-81ea45961e6d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1226 microversion: 2.1 time: 0.166406 Oct 27 09:48:09.637326 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3333/6740] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:09 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1226 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:09.779951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9d7ac55-86ba-4d84-b753-3e280ad239be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '.version_select at 0x7f31a93c3820>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:09.812105 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9d7ac55-86ba-4d84-b753-3e280ad239be tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-313269589" status: 202 len: 0 microversion: 2.1 time: 0.035599 Oct 27 09:48:09.819427 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3408/6741] 10.222.0.25 () {58 vars in 1281 bytes} [Thu Oct 27 09:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-313269589 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:48:09.869006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1caae8a4-ce91-42e9-8a1e-23cb4d533cba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'create', calling method: .version_select at 0x7f31a8c8ee50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-405938096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq4zZRtkbs93yMBHSIq1s/2TET/es3a51O5MPuz/DNC6W44TOCY8d2RwCOpzsV2XJUj/Tv4U9brenZHOS8i9BeDeyNgjf8p3Lr/Be9vKgcmbQlMPt6S+pV70Zo8xvsXcQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:09.909801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1caae8a4-ce91-42e9-8a1e-23cb4d533cba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for project f7fdcfbb223c44e693f100b3717522cf. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:48:09.916889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1caae8a4-ce91-42e9-8a1e-23cb4d533cba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for user 0d83fee6e4854240b13a10c262453b32 and project f7fdcfbb223c44e693f100b3717522cf. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:48:09.951533 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1caae8a4-ce91-42e9-8a1e-23cb4d533cba tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.088616 Oct 27 09:48:09.952196 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3334/6742] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:48:09 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:48:10.597680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9dc36ad8-7245-4229-88ab-09b6b4d9c6c4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:10.603359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9dc36ad8-7245-4229-88ab-09b6b4d9c6c4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:10.653910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dc36ad8-7245-4229-88ab-09b6b4d9c6c4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:10.654822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dc36ad8-7245-4229-88ab-09b6b4d9c6c4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:10.656111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dc36ad8-7245-4229-88ab-09b6b4d9c6c4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:10.657653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dc36ad8-7245-4229-88ab-09b6b4d9c6c4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:10.659183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dc36ad8-7245-4229-88ab-09b6b4d9c6c4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:10.660454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9dc36ad8-7245-4229-88ab-09b6b4d9c6c4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:10.664647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:10.665727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:10.689734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:10.690596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:10.691383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:10.705047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:10.705871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:10.706639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:10.790895 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9dc36ad8-7245-4229-88ab-09b6b4d9c6c4 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.202736 Oct 27 09:48:10.796080 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3409/6743] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 09:48:10 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65/os-volume_attachments => generated 25 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:48:10.887160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:10.893235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:10.894692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:10.895375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:10.897448 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f0f2e8a-4a94-4d55-a500-9d654b9d5654 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1226 microversion: 2.1 time: 0.239701 Oct 27 09:48:10.901322 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3335/6744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:10 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1226 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:10.908659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:10.909817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:10.912493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:10.913847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:10.916585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:10.918600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:10.976935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:48:11.143339 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a555b078-9543-4599-a646-62fb9e891003 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 204 len: 0 microversion: 2.1 time: 0.255745 Oct 27 09:48:11.144641 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3410/6745] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:48:10 2022] DELETE /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:48:11.159383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:11.160587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:11.174745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:11.175915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:11.176385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:11.177948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:11.178667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:11.179162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:11.436563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:11.449402 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-17d56121-9216-4cf1-968f-8d05a5736128 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1680 microversion: 2.1 time: 0.297759 Oct 27 09:48:11.450385 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3336/6746] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:11 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1680 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:11.925138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:11.926388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:11.937145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:11.937905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:11.938698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:11.940163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:11.940805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:11.941539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:12.045555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:12.052547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:12.064631 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8114a707-3a76-456d-8ee4-1433650ae051 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1226 microversion: 2.1 time: 0.145384 Oct 27 09:48:12.066909 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3411/6747] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:11 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1226 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:12.488812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:12.489898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:12.504617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:12.505952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:12.507008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:12.508652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:12.509806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:12.511220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:12.795257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:12.804642 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8daa1192-0349-4a97-9174-c1575cb87e0c tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1680 microversion: 2.1 time: 0.323303 Oct 27 09:48:12.805262 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3337/6748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:12 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1680 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:13.107785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:13.110223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:13.126145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:13.127070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:13.127950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:13.129304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:13.130193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:13.131004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:13.263298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:13.280447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b8af4f4-1ad4-44b1-b3e4-23e0951529e9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1226 microversion: 2.1 time: 0.180242 Oct 27 09:48:13.281538 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3412/6749] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:13 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:13.845846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:13.847140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:13.859355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:13.860215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:13.860853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:13.862831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:13.864078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:13.865165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:14.142938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:14.162358 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef0dab36-fc72-4bd3-8f29-f06cc111b3ca tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1680 microversion: 2.1 time: 0.323169 Oct 27 09:48:14.172656 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3338/6750] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:13 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1680 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:14.335102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:14.335102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:14.350339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:14.351208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:14.351208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:14.351208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:14.351208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:14.356033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:14.445963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:14.455760 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fde2c766-363b-471e-a1eb-84946048849e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1226 microversion: 2.1 time: 0.132984 Oct 27 09:48:14.456626 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3413/6751] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:14 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1226 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:15.157575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-68f65177-44e5-4068-9feb-c734ed073340 req-0c83607a-6c67-4b2b-8f74-5f80802c8cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbbba24-84e1-4f2b-b125-bec73c4bad65", "name": "network-vif-deleted", "tag": "6cab64a7-5eac-455f-bcef-d7b0f4795a19"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:15.176093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-68f65177-44e5-4068-9feb-c734ed073340 req-0c83607a-6c67-4b2b-8f74-5f80802c8cd5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:15.176516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-68f65177-44e5-4068-9feb-c734ed073340 req-0c83607a-6c67-4b2b-8f74-5f80802c8cd5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:15.176969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-68f65177-44e5-4068-9feb-c734ed073340 req-0c83607a-6c67-4b2b-8f74-5f80802c8cd5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:15.203642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:15.204181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:15.213820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:15.214464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:15.214936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:15.215726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:15.216202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:15.220163 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-68f65177-44e5-4068-9feb-c734ed073340 req-0c83607a-6c67-4b2b-8f74-5f80802c8cd5 service nova] Creating event network-vif-deleted:6cab64a7-5eac-455f-bcef-d7b0f4795a19 for instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 on n-h2-858383-16 Oct 27 09:48:15.228480 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-68f65177-44e5-4068-9feb-c734ed073340 req-0c83607a-6c67-4b2b-8f74-5f80802c8cd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074161 Oct 27 09:48:15.230520 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3339/6752] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:15.231678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:15.326847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485ee99d7fbd4f359824aff38966a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82209ade47d45dfa83c52c24366f737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:15.340887 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-11bd6ca5-e0ab-4a70-9a92-a9efb5586127 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 200 len: 1325 microversion: 2.1 time: 0.141379 Oct 27 09:48:15.343046 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3414/6753] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:15 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 1325 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:48:15.484243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:15.485733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:15.494881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:15.498124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:15.498982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:15.500057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:15.501349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:15.501979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:15.614737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:15.627245 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b236dce-e05a-441c-bc88-a89cdeab4e30 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1226 microversion: 2.1 time: 0.148903 Oct 27 09:48:15.649316 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3340/6754] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:15 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1226 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:16.369661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:16.371274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:16.395859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:16.396768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:16.397587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:16.398896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:16.399796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:16.400591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:16.432259 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 HTTP/1.1 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'bcbbba24-84e1-4f2b-b125-bec73c4bad65'} Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:16.434599 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-467f8232-3f9d-4262-99a5-5fec42beda11 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 404 len: 111 microversion: 2.1 time: 0.073809 Oct 27 09:48:16.445726 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3415/6755] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:16 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:16.447170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa6679f7-33e1-4d37-b355-f1e7879484d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '.version_select at 0x7f31aa4a3a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:16.480328 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa6679f7-33e1-4d37-b355-f1e7879484d7 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894180251" status: 202 len: 0 microversion: 2.1 time: 0.038275 Oct 27 09:48:16.486733 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3341/6756] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Oct 27 09:48:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894180251 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:48:16.659250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:16.660957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:16.680338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:16.682232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:16.687437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:16.691546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:16.692697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:16.693468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:16.800058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:16.800662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:16.801135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:16.801745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lazy-loading 'fault' on Instance uuid 4e14bab2-c5b6-42c5-8498-b885f872e12c {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:48:17.067777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:17.091415 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0bf9c5fb-24de-4f6d-a188-79b21a760783 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 200 len: 1185 microversion: 2.1 time: 0.441850 Oct 27 09:48:17.093782 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3416/6757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:16 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 1185 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:18.131692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:18.137868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:18.168410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:18.172767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:18.177046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:18.178703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:18.180759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:18.181766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:18.223467 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c HTTP/1.1 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '4e14bab2-c5b6-42c5-8498-b885f872e12c'} Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:18.227211 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:18.236274 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:18.236274 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:18.236274 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:18.236274 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:18.236274 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:18.236274 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:48:18.236274 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:18.238540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:18.240679 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-98cc6b4e-7801-4371-9867-48befa8710df tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 404 len: 111 microversion: 2.1 time: 0.116744 Oct 27 09:48:18.256304 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3342/6758] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:18 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:18.331449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-698246155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2030933275", "security_groups": [{"name": "tempest-secgroup-smoke-1368785454"}], "block_device_mapping_v2": [{"uuid": "92ef0488-ada2-47e8-94eb-a8739ce53680", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8f250b0-c481-437b-8054-ee4c9ca61f10"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:18.514797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] validate_networks() for [('c8f250b0-c481-437b-8054-ee4c9ca61f10', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:48:19.661510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:48:19.664072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:48:19.665292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:48:19.666343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:48:19.667418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:48:19.690572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:19.691836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:19.692746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:19.694593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:19.696109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:19.696927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:19.737928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:48:19.752893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for user 9ab30747d0444c32bbc058a522262b62 and project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:48:19.873774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:48:19.885000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92ef0488-ada2-47e8-94eb-a8739ce53680',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:48:20.159294 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b36c69b-07a4-4e9d-87d6-f7972b1b5278 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.834930 Oct 27 09:48:20.162177 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3417/6759] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:48:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:48:20.177914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-400be5a3-d41f-4c78-9173-bd5bec41bc5c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:20.178728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-400be5a3-d41f-4c78-9173-bd5bec41bc5c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:20.185999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:20.312096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-400be5a3-d41f-4c78-9173-bd5bec41bc5c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:20.329168 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-400be5a3-d41f-4c78-9173-bd5bec41bc5c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1094 microversion: 2.1 time: 0.155847 Oct 27 09:48:20.346967 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3343/6760] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:20 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1094 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:21.090638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2061350563", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "9a121726-b058-4fe4-bc3a-062896cde45c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-405938096", "security_groups": [{"name": "tempest-secgroup-smoke-140017614"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:21.252576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] validate_networks() for [('9a121726-b058-4fe4-bc3a-062896cde45c', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:48:21.353472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c499b44-1c0a-46a3-9297-38ec16fdcf23 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:21.354230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c499b44-1c0a-46a3-9297-38ec16fdcf23 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:21.368087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:21.525642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c499b44-1c0a-46a3-9297-38ec16fdcf23 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:21.533971 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c499b44-1c0a-46a3-9297-38ec16fdcf23 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1094 microversion: 2.1 time: 0.184464 Oct 27 09:48:21.534813 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3344/6761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:21 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1094 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:22.115773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:48:22.116742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:48:22.117722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:48:22.118489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:48:22.119265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:48:22.140231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:22.141517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:22.142570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:22.144398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:22.145780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:22.146874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:22.189314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for project f7fdcfbb223c44e693f100b3717522cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:48:22.204811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for user 0d83fee6e4854240b13a10c262453b32 and project f7fdcfbb223c44e693f100b3717522cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:48:22.233992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:48:22.237106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:48:22.313866 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9285c834-88a8-4df2-aea0-3554cb86b6e9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.232230 Oct 27 09:48:22.321745 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3418/6762] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:48:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:48:22.340985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67b006fb-4b0f-4a90-9a88-ca5423ea35c2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:22.342069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67b006fb-4b0f-4a90-9a88-ca5423ea35c2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:22.565082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-67b006fb-4b0f-4a90-9a88-ca5423ea35c2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:22.576344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:22.580040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:22.587603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67b006fb-4b0f-4a90-9a88-ca5423ea35c2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1266 microversion: 2.1 time: 0.257996 Oct 27 09:48:22.593046 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3345/6763] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:22 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:22.612347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:22.614334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:22.618547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:22.620618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:22.624726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:22.626292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:22.798583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:22.807914 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de7963db-5637-4b21-bc5f-9c8cc43ecbc4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1210 microversion: 2.1 time: 0.248050 Oct 27 09:48:22.812650 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3419/6764] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:22 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1210 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:23.628160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:23.628801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:23.641159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:23.644730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:23.648194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:23.649267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:23.656826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:23.658114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:23.826774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:23.842193 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9137f527-67a5-4ab7-9442-283a09159520 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1270 microversion: 2.1 time: 0.218186 Oct 27 09:48:23.842811 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3346/6765] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:23 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:48:23.860215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:23.860215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:23.878974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:23.878974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:23.878974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:23.878974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:23.878974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:23.878974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:24.139516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:24.140061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:24.161462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:24.162418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:24.163520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:24.166760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:24.169777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:24.170761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:24.301230 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 HTTP/1.1 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'bcbbba24-84e1-4f2b-b125-bec73c4bad65'} Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:24.302880 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.307428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:24.309646 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-06044760-0ace-4997-8070-532966aaf518 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 404 len: 111 microversion: 2.1 time: 0.183480 Oct 27 09:48:24.312667 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3347/6766] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:48:24 2022] DELETE /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:24.328350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:24.329417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: bcbbba24-84e1-4f2b-b125-bec73c4bad65] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:24.347291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:24.347939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:24.355680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:24.356159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:24.357512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:24.360207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:24.361035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:24.387923 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7f56bfda-6027-425d-9cde-d8d2561daa2a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1278 microversion: 2.1 time: 0.535938 Oct 27 09:48:24.392877 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3420/6767] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:23 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1278 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:24.412519 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 HTTP/1.1 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'bcbbba24-84e1-4f2b-b125-bec73c4bad65'} Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:24.414166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.419817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:24.419817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:24.419817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:24.419817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:24.419817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:24.419817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. Oct 27 09:48:24.419817 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:24.424739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance bcbbba24-84e1-4f2b-b125-bec73c4bad65 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:24.430870 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b7efe62-135c-42b4-b2ef-6ce7108f745e tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65" status: 404 len: 111 microversion: 2.1 time: 0.111549 Oct 27 09:48:24.432100 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3348/6768] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:24 2022] GET /compute/v2.1/servers/bcbbba24-84e1-4f2b-b125-bec73c4bad65 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:48:24.915126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:24.916362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:24.945021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:24.945544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:24.946286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:24.950777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:24.954622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:24.956656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:25.137059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:25.147802 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d73f4bc4-8567-4fd8-baf9-5d000589a270 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1326 microversion: 2.1 time: 0.260286 Oct 27 09:48:25.164913 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3421/6769] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:24 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1326 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:25.417667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:25.418462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:25.432148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:25.433100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:25.433570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:25.434327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:25.434794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:25.435235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:25.908509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:25.946397 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10eca02d-8ebb-4ba2-9992-69462ff1fa25 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1278 microversion: 2.1 time: 0.532450 Oct 27 09:48:25.947011 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3349/6770] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:25 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1278 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:26.056994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d48b2861-ef9b-4755-a023-4ef9ca96614e req-033abade-4c8f-4fd1-b3e8-82ff6352cd26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a429296e-3a2f-42ac-bd45-52304aaa316a", "tag": "ec70b13d-e76c-47fa-8e13-66eafb779873"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:26.067826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:26.079249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d48b2861-ef9b-4755-a023-4ef9ca96614e req-033abade-4c8f-4fd1-b3e8-82ff6352cd26 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:26.084391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d48b2861-ef9b-4755-a023-4ef9ca96614e req-033abade-4c8f-4fd1-b3e8-82ff6352cd26 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:26.085130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d48b2861-ef9b-4755-a023-4ef9ca96614e req-033abade-4c8f-4fd1-b3e8-82ff6352cd26 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:26.125663 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d48b2861-ef9b-4755-a023-4ef9ca96614e req-033abade-4c8f-4fd1-b3e8-82ff6352cd26 service nova] Creating event network-changed:ec70b13d-e76c-47fa-8e13-66eafb779873 for instance a429296e-3a2f-42ac-bd45-52304aaa316a on n-h1-858383-16 Oct 27 09:48:26.137931 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d48b2861-ef9b-4755-a023-4ef9ca96614e req-033abade-4c8f-4fd1-b3e8-82ff6352cd26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084818 Oct 27 09:48:26.150200 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3422/6771] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:26.173262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:26.173807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:26.200733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:26.201142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:26.201602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:26.205646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:26.206188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:26.206643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:26.362453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:26.377297 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cdb2095a-d4fd-45d4-8c92-b15ad63bb6cb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1324 microversion: 2.1 time: 0.208088 Oct 27 09:48:26.378287 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3350/6772] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:26 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:26.979604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:26.981516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:26.997662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:26.998860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:27.000055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:27.001963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:27.002986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:27.003975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:27.374703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:27.402125 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-657995cf-bd2b-431c-8e72-4eeeb88a5711 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1278 microversion: 2.1 time: 0.432157 Oct 27 09:48:27.404198 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3423/6773] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:26 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1278 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:27.425214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:27.425995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:27.434941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:27.438456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:27.438927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:27.441819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:27.442956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:27.447964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:28.143280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:28.190901 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eba912b3-b53c-4ce5-af61-7b6ce13d1bc0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1391 microversion: 2.1 time: 0.767795 Oct 27 09:48:28.213630 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3351/6774] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:27 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1391 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:28.279475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-db4c8892-ef1a-4ebd-9680-bc46e5e765e8 req-a8b769bd-8d05-48f1-bb79-21b671ccd592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2ac474-06f5-470a-8243-ea3388cce018", "tag": "e128aa19-5b87-4372-b5ba-7ee900555930"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:28.302249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-db4c8892-ef1a-4ebd-9680-bc46e5e765e8 req-a8b769bd-8d05-48f1-bb79-21b671ccd592 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:28.303540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-db4c8892-ef1a-4ebd-9680-bc46e5e765e8 req-a8b769bd-8d05-48f1-bb79-21b671ccd592 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:28.304863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-db4c8892-ef1a-4ebd-9680-bc46e5e765e8 req-a8b769bd-8d05-48f1-bb79-21b671ccd592 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:28.328322 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-db4c8892-ef1a-4ebd-9680-bc46e5e765e8 req-a8b769bd-8d05-48f1-bb79-21b671ccd592 service nova] Creating event network-changed:e128aa19-5b87-4372-b5ba-7ee900555930 for instance 0a2ac474-06f5-470a-8243-ea3388cce018 on n-h2-858383-16 Oct 27 09:48:28.339728 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-db4c8892-ef1a-4ebd-9680-bc46e5e765e8 req-a8b769bd-8d05-48f1-bb79-21b671ccd592 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066319 Oct 27 09:48:28.341548 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3424/6775] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:28.432480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:28.434218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:28.441881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:28.442643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:28.443331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:28.444112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:28.444572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:28.445226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:28.642653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:28.653900 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7bd0cfff-0713-4e80-bc55-d7f5ec98dad9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1278 microversion: 2.1 time: 0.228703 Oct 27 09:48:28.654851 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3352/6776] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:28 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:29.239793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:29.240518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:29.247640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:29.248150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:29.248602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:29.249497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:29.249970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:29.250413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:29.415437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:29.424581 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-594b8a01-5201-4f9b-863c-87a2dc76b09a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1391 microversion: 2.1 time: 0.189033 Oct 27 09:48:29.425286 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3425/6777] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:29 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:29.683653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:29.685104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:29.698922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:29.700023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:29.700982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:29.702447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:29.703519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:29.704567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:29.899638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:29.918293 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a323104-f7f1-4148-b4b7-6bafea41e797 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1278 microversion: 2.1 time: 0.242286 Oct 27 09:48:29.920918 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3353/6778] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:29 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:30.450906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:30.452605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:30.461881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:30.462557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:30.463112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:30.464186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:30.464767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:30.465329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:30.688124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:30.705780 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-43005c78-a69a-4233-82c1-da66e990d862 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1391 microversion: 2.1 time: 0.260409 Oct 27 09:48:30.707157 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3426/6779] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:30 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:30.960170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:30.961920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:30.974547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:30.975416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:30.976686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:30.977917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:30.981421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:30.982349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:31.188612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:31.213227 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1378b351-fb73-4440-b25d-4d688dbbcca9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1278 microversion: 2.1 time: 0.257190 Oct 27 09:48:31.216229 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3354/6780] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:30 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:48:31.741322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:31.745883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:31.759915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:31.761116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:31.762397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:31.763842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:31.764812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:31.766044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:31.958016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:31.969865 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86eb1dc8-6056-4530-b8d5-4df50789097b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1391 microversion: 2.1 time: 0.235223 Oct 27 09:48:31.970879 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3427/6781] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:31 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:32.244352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:32.245576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:32.258959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.259948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.260289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.261779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.262254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.262709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.427209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:32.428491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:32.432126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:32.434348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:32.449457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.452005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.452867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.454292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.455184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.455915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.462021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:32.478625 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b2dfe28-86f5-4f95-a129-b8906e029dc7 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.241649 Oct 27 09:48:32.479761 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.480204 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3355/6782] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:32 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 HTTP/1.1 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '7e65655e-5c79-4a4c-a5bb-f1d9ae55c471'} Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:32.487849 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d6379f5f-701b-4da0-ad0e-228d5bf3880d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 404 len: 111 microversion: 2.1 time: 0.073250 Oct 27 09:48:32.502276 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3428/6783] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:48:32 2022] DELETE /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:32.507631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:32.508418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:32.516730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.517389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.517956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.518880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.519479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.520075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.539984 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 HTTP/1.1 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7e65655e-5c79-4a4c-a5bb-f1d9ae55c471'} Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:32.542462 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance 7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5b7211b0-e383-4897-988b-e34ad4ad2d8d tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471" status: 404 len: 111 microversion: 2.1 time: 0.045690 Oct 27 09:48:32.553202 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3356/6784] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:32 2022] GET /compute/v2.1/servers/7e65655e-5c79-4a4c-a5bb-f1d9ae55c471 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:32.561283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:32.562208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:32.576660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.577749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.578539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.579781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.580655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.581473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.614005 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 HTTP/1.1 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'dcea22af-75e3-48e1-b4ab-0ea49995bb18'} Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:32.617214 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bcf69388-b9aa-40f1-8410-515e6d76d833 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 404 len: 111 microversion: 2.1 time: 0.066361 Oct 27 09:48:32.625369 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3429/6785] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:48:32 2022] DELETE /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:32.635263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:32.636980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: dcea22af-75e3-48e1-b4ab-0ea49995bb18] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:32.640306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:32.650299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.651225 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.652658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.654005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.654888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.655736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.689195 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 HTTP/1.1 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'dcea22af-75e3-48e1-b4ab-0ea49995bb18'} Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:32.692402 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance dcea22af-75e3-48e1-b4ab-0ea49995bb18 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6a59cd4-2d74-43f2-86cc-8ee8b9dc9caa tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18" status: 404 len: 111 microversion: 2.1 time: 0.067140 Oct 27 09:48:32.700275 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3357/6786] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:32 2022] GET /compute/v2.1/servers/dcea22af-75e3-48e1-b4ab-0ea49995bb18 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:32.996854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:32.997977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:33.009249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:33.010143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:33.011122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:33.012721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:33.013504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:33.014150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:33.241725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:33.251683 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40ad1313-dbe7-47a0-978b-6e75437585ff tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1391 microversion: 2.1 time: 0.259715 Oct 27 09:48:33.267769 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3430/6787] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:32 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1391 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:33.516958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:33.518157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:33.528725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:33.529587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:33.530409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:33.531719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:33.532812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:33.533606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:33.754795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:33.766524 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-621c19fc-118f-4265-b657-3639ebb3cdbb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.254550 Oct 27 09:48:33.767811 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3358/6788] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:33 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:34.277993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:34.279061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:34.287780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:34.288522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:34.289150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:34.290110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:34.290875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:34.291604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:34.503878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:34.519635 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-14458c24-a31f-4d2a-912b-f314eeb3f44b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1391 microversion: 2.1 time: 0.246556 Oct 27 09:48:34.520725 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3431/6789] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:34 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:34.801679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:34.802779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:34.816066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:34.816974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:34.817840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:34.819151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:34.820079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:34.821113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:35.048406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:35.058080 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8bed6203-1e4c-44ea-bbb7-4d8f002c1606 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.263807 Oct 27 09:48:35.058628 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3359/6790] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:34 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:35.526529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1eec700d-5f46-4a9b-87ea-b02772ca6084 req-74e2b54d-7e7e-4481-8da5-4a0c0f66d4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2ac474-06f5-470a-8243-ea3388cce018", "name": "network-vif-plugged", "status": "completed", "tag": "e128aa19-5b87-4372-b5ba-7ee900555930"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:35.545183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1eec700d-5f46-4a9b-87ea-b02772ca6084 req-74e2b54d-7e7e-4481-8da5-4a0c0f66d4bf service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:35.546059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1eec700d-5f46-4a9b-87ea-b02772ca6084 req-74e2b54d-7e7e-4481-8da5-4a0c0f66d4bf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:35.546866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1eec700d-5f46-4a9b-87ea-b02772ca6084 req-74e2b54d-7e7e-4481-8da5-4a0c0f66d4bf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:35.562962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:35.576303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:35.582223 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1eec700d-5f46-4a9b-87ea-b02772ca6084 req-74e2b54d-7e7e-4481-8da5-4a0c0f66d4bf service nova] Creating event network-vif-plugged:e128aa19-5b87-4372-b5ba-7ee900555930 for instance 0a2ac474-06f5-470a-8243-ea3388cce018 on n-h2-858383-16 Oct 27 09:48:35.589017 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1eec700d-5f46-4a9b-87ea-b02772ca6084 req-74e2b54d-7e7e-4481-8da5-4a0c0f66d4bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175392 Oct 27 09:48:35.589393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:35.589878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:35.591023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:35.591265 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3432/6791] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:35.593023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:35.593892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:35.595025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:35.630300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:35.857240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:35.872974 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-17f6ea72-54e8-487d-8d88-197c7b584957 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1391 microversion: 2.1 time: 0.317648 Oct 27 09:48:35.873925 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3360/6792] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:35 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:36.088178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:36.089802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:36.090728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:36.091427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:36.097769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.098624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.099261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:36.100301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.100975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.101748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:36.104078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.105688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.106768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:36.107980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.108816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.109526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:36.135830 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.136080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda HTTP/1.1 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'af38803d-9721-430f-82f0-b4d1d5ac1bda'} Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:36.139593 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e75a5e3-f6c7-4dc7-ac6f-01890ddecef3 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 404 len: 111 microversion: 2.1 time: 0.059222 Oct 27 09:48:36.145289 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3361/6793] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:48:36 2022] DELETE /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:36.161303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:36.162312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] [instance: af38803d-9721-430f-82f0-b4d1d5ac1bda] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:36.173327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.173731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.174181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:36.174932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.175394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.175863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:36.194373 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] HTTP exception thrown: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Request method failure captured: Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda HTTP/1.1 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIc-IIyu9rgV1QjKBHCEjEV_U37UCcKqjZrXH4zQVLt63lirfvmcwdtgbRzY-Jt2VdF6xxTigI3J5GjVA_9xx1MjYkQBWdzfOYOVYMU9cAkmttYHm7rlVftNRbd3p96BuLCyXmB6CxWhigoJiwRMjzpfJUwP44xQ1M0L7BdZIrb1y4 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a82209ade47d45dfa83c52c24366f737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a82209ade47d45dfa83c52c24366f737"}]}] Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: a82209ade47d45dfa83c52c24366f737 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1505902056 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 485ee99d7fbd4f359824aff38966a868 Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1505902056-project Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'af38803d-9721-430f-82f0-b4d1d5ac1bda'} Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:36.196385 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] Returning 404 to user: Instance af38803d-9721-430f-82f0-b4d1d5ac1bda could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c32fa72-ea1f-40c7-9550-fa6c350df562 tempest-AttachVolumeNegativeTest-1505902056 tempest-AttachVolumeNegativeTest-1505902056-project] 10.222.0.25 "GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda" status: 404 len: 111 microversion: 2.1 time: 0.045731 Oct 27 09:48:36.201452 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3362/6794] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:36 2022] GET /compute/v2.1/servers/af38803d-9721-430f-82f0-b4d1d5ac1bda => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:36.331909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:36.353161 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-df2d4638-da7e-49b2-8449-266dcc339774 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.269540 Oct 27 09:48:36.354469 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3433/6795] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:36 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:48:36.899936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:36.901131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:36.911018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.911523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.912043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:36.912798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.913264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.913703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:37.140526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:37.163898 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04ba2f1b-d4fb-42f9-b751-53970756b7d8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1391 microversion: 2.1 time: 0.267342 Oct 27 09:48:37.166095 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3363/6796] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:36 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1391 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:37.384998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:37.386369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:37.400952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:37.402611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:37.404492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:37.405905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:37.406761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:37.407560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:37.609724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:37.626590 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-39eb29cb-e852-491b-af12-fdcc23f45f53 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.250425 Oct 27 09:48:37.627889 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3434/6797] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:37 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:38.210895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:38.212433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:38.222006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:38.222782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:38.223351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:38.224265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:38.224858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:38.226209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:38.411472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:38.422431 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f41ab623-dd3e-46b3-bb45-b586069c7854 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1564 microversion: 2.1 time: 0.216799 Oct 27 09:48:38.423859 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3364/6798] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:38 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1564 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:38.448933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:38.449814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:38.467343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:38.468356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:38.469162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:38.470526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:38.471440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:38.472194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:38.668207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:38.669007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:38.677941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:38.678897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:38.679642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:38.680685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:38.681406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:38.682065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:38.707082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:38.731080 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-20949d16-00a3-4d72-9826-18c5c6e17bb0 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1564 microversion: 2.1 time: 0.286533 Oct 27 09:48:38.732943 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3435/6799] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:38 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1564 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:39.247669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:39.268674 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83735211-0132-4ab4-a5ed-83544f81475a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.606648 Oct 27 09:48:39.271159 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3365/6800] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:38 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:40.300210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:40.302142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:40.329118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:40.330447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:40.336558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:40.338239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:40.340786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:40.341885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:40.722054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:40.736824 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eae5183c-c50f-4026-be60-90384d695c31 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.444607 Oct 27 09:48:40.738159 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3436/6801] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:40 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:41.530076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:41.530722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:41.543700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:41.544718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:41.545495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:41.546520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:41.547870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:41.548546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:41.567235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-759b9402-1f71-40f4-ba79-e36f9c74ee9b req-a717dcd2-b647-4575-8f58-075ff37d7700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2ac474-06f5-470a-8243-ea3388cce018", "tag": "e128aa19-5b87-4372-b5ba-7ee900555930"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:41.596384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-759b9402-1f71-40f4-ba79-e36f9c74ee9b req-a717dcd2-b647-4575-8f58-075ff37d7700 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:41.597337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-759b9402-1f71-40f4-ba79-e36f9c74ee9b req-a717dcd2-b647-4575-8f58-075ff37d7700 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:41.597951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-759b9402-1f71-40f4-ba79-e36f9c74ee9b req-a717dcd2-b647-4575-8f58-075ff37d7700 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:41.620723 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-759b9402-1f71-40f4-ba79-e36f9c74ee9b req-a717dcd2-b647-4575-8f58-075ff37d7700 service nova] Creating event network-changed:e128aa19-5b87-4372-b5ba-7ee900555930 for instance 0a2ac474-06f5-470a-8243-ea3388cce018 on n-h2-858383-16 Oct 27 09:48:41.632282 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-759b9402-1f71-40f4-ba79-e36f9c74ee9b req-a717dcd2-b647-4575-8f58-075ff37d7700 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089282 Oct 27 09:48:41.633760 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3437/6802] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:41.794442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:41.797107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:41.820140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:41.821561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:41.822814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:41.830969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:41.833558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:41.834916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:41.906598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:41.917665 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b74b560c-200f-48f0-b06f-d8b2a2b835dd tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1564 microversion: 2.1 time: 0.391017 Oct 27 09:48:41.922518 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3366/6803] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:41 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1564 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:42.198561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:42.208180 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3d2fc077-d46f-4e6a-a05d-9669e9c4ece9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.433572 Oct 27 09:48:42.217423 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3438/6804] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:41 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:43.237826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:43.239891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:43.253858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:43.254745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:43.255554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:43.256920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:43.257797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:43.258611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:43.455749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:43.467672 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2cc27639-f22a-4581-8d5b-e1aa8fe0115b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.238775 Oct 27 09:48:43.468641 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3367/6805] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:43 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:43.837720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-185678d8-8e6f-4b2a-a261-4721514f523a req-ad53688f-f544-4119-b2cc-06a25ef56ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a429296e-3a2f-42ac-bd45-52304aaa316a", "name": "network-vif-plugged", "status": "completed", "tag": "ec70b13d-e76c-47fa-8e13-66eafb779873"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:43.859275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-185678d8-8e6f-4b2a-a261-4721514f523a req-ad53688f-f544-4119-b2cc-06a25ef56ee8 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:43.860043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-185678d8-8e6f-4b2a-a261-4721514f523a req-ad53688f-f544-4119-b2cc-06a25ef56ee8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:43.860630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-185678d8-8e6f-4b2a-a261-4721514f523a req-ad53688f-f544-4119-b2cc-06a25ef56ee8 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:43.876601 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-185678d8-8e6f-4b2a-a261-4721514f523a req-ad53688f-f544-4119-b2cc-06a25ef56ee8 service nova] Creating event network-vif-plugged:ec70b13d-e76c-47fa-8e13-66eafb779873 for instance a429296e-3a2f-42ac-bd45-52304aaa316a on n-h1-858383-16 Oct 27 09:48:43.883136 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-185678d8-8e6f-4b2a-a261-4721514f523a req-ad53688f-f544-4119-b2cc-06a25ef56ee8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053391 Oct 27 09:48:43.884143 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3368/6806] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:48:43.973313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-359d8e59-b05f-443c-8d25-28ff64d9e2ed tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Action: 'create', calling method: .version_select at 0x7f31a8134790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1587012925"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:44.493866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:44.494742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:44.513560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:44.515070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:44.516261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:44.518448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:44.520068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:44.520657 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-359d8e59-b05f-443c-8d25-28ff64d9e2ed tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.703873 Oct 27 09:48:44.521381 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3439/6807] 10.222.0.25 () {60 vars in 1155 bytes} [Thu Oct 27 09:48:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 706 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 27 09:48:44.522155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:44.541235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1308276c-7d3d-4f05-a8c2-aad4a23a46c5 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a808e5e0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:44.652960 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1308276c-7d3d-4f05-a8c2-aad4a23a46c5 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00" status: 200 len: 345 microversion: 2.1 time: 0.118595 Oct 27 09:48:44.653532 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3440/6808] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:48:44 2022] GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:48:44.826539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:44.840155 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b3c45a50-a4cc-404f-9933-136482150367 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1266 microversion: 2.1 time: 0.350052 Oct 27 09:48:44.841673 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3369/6809] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:44 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:48:45.674701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7fd7491c-5b2d-49f5-a2f5-9ff50a6e775d tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a9166c10>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:45.732685 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7fd7491c-5b2d-49f5-a2f5-9ff50a6e775d tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00" status: 200 len: 345 microversion: 2.1 time: 0.067324 Oct 27 09:48:45.733282 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3441/6810] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:48:45 2022] GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:45.867291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:45.868187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:45.875871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:45.876373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:45.876814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:45.877581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:45.878043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:45.878470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:46.048183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:46.057003 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7cfa592b-bba1-4d2d-b9d6-41c256434f8b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1453 microversion: 2.1 time: 0.195486 Oct 27 09:48:46.057789 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3370/6811] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:45 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:46.098137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:46.099258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:46.111211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:46.112160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:46.112963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:46.114169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:46.114994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:46.115764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:46.301060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:46.310173 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b237a84-b7be-4abe-a7f8-595b000e653b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1453 microversion: 2.1 time: 0.219411 Oct 27 09:48:46.310770 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3442/6812] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:46 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:46.752611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61a58e35-c609-4f57-807a-70da6fab0540 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31ae5f7310>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:46.849529 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61a58e35-c609-4f57-807a-70da6fab0540 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00" status: 200 len: 346 microversion: 2.1 time: 0.105398 Oct 27 09:48:46.850327 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3371/6813] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:48:46 2022] GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:46.868499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9fc961ac-11a1-44aa-9cd0-8e15b5d6e36f tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Action: 'create', calling method: .version_select at 0x7f31a9166d30>, body: {"snapshot": {"volume_id": "66c3f3d4-aeac-43a9-919e-b31f76339e00", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2139437176"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:47.138883 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9fc961ac-11a1-44aa-9cd0-8e15b5d6e36f tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.273932 Oct 27 09:48:47.140526 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3443/6814] 10.222.0.25 () {60 vars in 1162 bytes} [Thu Oct 27 09:48:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:48:47.164272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6297280b-944e-478f-8ced-6d87d1a1607b tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31aa826280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:47.224210 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6297280b-944e-478f-8ced-6d87d1a1607b tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235" status: 200 len: 287 microversion: 2.1 time: 0.070106 Oct 27 09:48:47.227637 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3372/6815] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:48:47 2022] GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:47.241350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3388c607-7ebd-4f8a-a67c-bc7aa91bf565 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a8133700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:47.288668 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3388c607-7ebd-4f8a-a67c-bc7aa91bf565 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.053838 Oct 27 09:48:47.289713 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3444/6816] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Oct 27 09:48:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:47.302953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-860cd7d2-29d0-4395-b2f9-76a0880d3da7 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31aa1aeca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:47.346096 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-860cd7d2-29d0-4395-b2f9-76a0880d3da7 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235" status: 200 len: 287 microversion: 2.1 time: 0.047405 Oct 27 09:48:47.347487 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3373/6817] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:48:47 2022] GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:48:48.366370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-407ca28f-1077-4066-afe2-41c70796bf85 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a808e3a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:48.421541 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-407ca28f-1077-4066-afe2-41c70796bf85 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235" status: 200 len: 287 microversion: 2.1 time: 0.063681 Oct 27 09:48:48.427510 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3445/6818] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:48:48 2022] GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:49.053443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e75d0043-a039-4f65-95a8-3e6b4d11a20b req-fa65b796-d326-4fea-a549-13bc09cdf66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a429296e-3a2f-42ac-bd45-52304aaa316a", "tag": "ec70b13d-e76c-47fa-8e13-66eafb779873"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:49.073488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e75d0043-a039-4f65-95a8-3e6b4d11a20b req-fa65b796-d326-4fea-a549-13bc09cdf66b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:49.074111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e75d0043-a039-4f65-95a8-3e6b4d11a20b req-fa65b796-d326-4fea-a549-13bc09cdf66b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:49.074862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e75d0043-a039-4f65-95a8-3e6b4d11a20b req-fa65b796-d326-4fea-a549-13bc09cdf66b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:49.103213 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e75d0043-a039-4f65-95a8-3e6b4d11a20b req-fa65b796-d326-4fea-a549-13bc09cdf66b service nova] Creating event network-changed:ec70b13d-e76c-47fa-8e13-66eafb779873 for instance a429296e-3a2f-42ac-bd45-52304aaa316a on n-h1-858383-16 Oct 27 09:48:49.114165 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e75d0043-a039-4f65-95a8-3e6b4d11a20b req-fa65b796-d326-4fea-a549-13bc09cdf66b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068560 Oct 27 09:48:49.115650 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3374/6819] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:49.440290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3858a24d-0048-43a1-982e-72dfec307f85 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a8095280>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:49.474555 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3858a24d-0048-43a1-982e-72dfec307f85 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235" status: 200 len: 288 microversion: 2.1 time: 0.039285 Oct 27 09:48:49.475117 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3446/6820] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:48:49 2022] GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:48:49.503329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a31b3a2a-1c75-4b30-a9ed-e46f2874c24e tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31aa8493a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:49.605809 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a31b3a2a-1c75-4b30-a9ed-e46f2874c24e tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235" status: 202 len: 0 microversion: 2.1 time: 0.115823 Oct 27 09:48:49.626367 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3375/6821] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Oct 27 09:48:49 2022] DELETE /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:48:49.627261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c2da48fe-db61-4092-a944-064ee7a4ccf0 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a808e1f0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:49.693935 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c2da48fe-db61-4092-a944-064ee7a4ccf0 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235" status: 200 len: 287 microversion: 2.1 time: 0.077946 Oct 27 09:48:49.695520 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3447/6822] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:48:49 2022] GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:50.714252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04123e27-9acb-44ee-a466-c96883d07454 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31aa730e50>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:50.774952 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04123e27-9acb-44ee-a466-c96883d07454 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235" status: 200 len: 287 microversion: 2.1 time: 0.068261 Oct 27 09:48:50.777657 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3376/6823] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:48:50 2022] GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:51.793907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26cee0df-1a7c-4f21-85c0-22f7b6930188 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a8095dc0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:51.833557 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-26cee0df-1a7c-4f21-85c0-22f7b6930188 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] HTTP exception thrown: Snapshot 233bb6a4-a117-4b2e-8d88-796af20ab235 could not be found. Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26cee0df-1a7c-4f21-85c0-22f7b6930188 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Request method failure captured: Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235 HTTP/1.1 Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlP7bvJ2xwUt4WkMEcmHYNguqddl8bIHvNHZYPW4Pw93CMHc342VwP6cNBbUq_4h6WiR2SrTYvN4DrJKTXvoETmURHnB1NJlEEHHPdnAFzTxk7rbDxdbIDpmiIJ_fdJvWgQsC7addrUEiABvdRbUYn3uwYQSqQHSeGBLmmG7cLiUi7Y Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7c9b7c8962f948f9be4a2db7880770f1 Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c9b7c8962f948f9be4a2db7880770f1"}]}] Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7c9b7c8962f948f9be4a2db7880770f1 Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesSnapshotsTestJSON-1743348018-project Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8241d8e5a9394c66972367e70c0ba2dc Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1743348018-project Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: exception: Snapshot 233bb6a4-a117-4b2e-8d88-796af20ab235 could not be found. Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '233bb6a4-a117-4b2e-8d88-796af20ab235'} Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 233bb6a4-a117-4b2e-8d88-796af20ab235 could not be found. (HTTP 404) (Request-ID: req-3cc765d2-7238-4d84-a980-384c39d8aaa2) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:48:51.845951 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 233bb6a4-a117-4b2e-8d88-796af20ab235 could not be found. Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 233bb6a4-a117-4b2e-8d88-796af20ab235 could not be found. Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 233bb6a4-a117-4b2e-8d88-796af20ab235 could not be found. Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26cee0df-1a7c-4f21-85c0-22f7b6930188 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Returning 404 to user: Snapshot 233bb6a4-a117-4b2e-8d88-796af20ab235 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-26cee0df-1a7c-4f21-85c0-22f7b6930188 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235" status: 404 len: 111 microversion: 2.1 time: 0.059528 Oct 27 09:48:51.854526 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3448/6824] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:48:51 2022] GET /compute/v2.1/os-snapshots/233bb6a4-a117-4b2e-8d88-796af20ab235 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:48:51.863498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45d521c0-2639-4d90-a90b-2997e0bb184c tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31aa857a60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:51.952015 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45d521c0-2639-4d90-a90b-2997e0bb184c tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00" status: 202 len: 0 microversion: 2.1 time: 0.095152 Oct 27 09:48:51.952791 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3377/6825] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:48:51 2022] DELETE /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:48:51.965138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2593990a-7337-422d-871a-11444a3cad3b tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a8109d30>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:52.038076 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2593990a-7337-422d-871a-11444a3cad3b tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00" status: 200 len: 345 microversion: 2.1 time: 0.079852 Oct 27 09:48:52.038607 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3449/6826] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:48:51 2022] GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:53.063824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10ed85c0-5bcd-4d71-99bd-8dacddd07fc6 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a9fe4040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:53.125307 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10ed85c0-5bcd-4d71-99bd-8dacddd07fc6 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00" status: 200 len: 345 microversion: 2.1 time: 0.070257 Oct 27 09:48:53.125893 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3378/6827] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:48:53 2022] GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:54.145524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-270c6056-0930-4a74-8470-520585dc93ef tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a808b430>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:54.189473 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-270c6056-0930-4a74-8470-520585dc93ef tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] HTTP exception thrown: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-270c6056-0930-4a74-8470-520585dc93ef tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Request method failure captured: Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 HTTP/1.1 Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlP7bvJ2xwUt4WkMEcmHYNguqddl8bIHvNHZYPW4Pw93CMHc342VwP6cNBbUq_4h6WiR2SrTYvN4DrJKTXvoETmURHnB1NJlEEHHPdnAFzTxk7rbDxdbIDpmiIJ_fdJvWgQsC7addrUEiABvdRbUYn3uwYQSqQHSeGBLmmG7cLiUi7Y Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7c9b7c8962f948f9be4a2db7880770f1 Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c9b7c8962f948f9be4a2db7880770f1"}]}] Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7c9b7c8962f948f9be4a2db7880770f1 Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesSnapshotsTestJSON-1743348018-project Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8241d8e5a9394c66972367e70c0ba2dc Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1743348018-project Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: exception: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '66c3f3d4-aeac-43a9-919e-b31f76339e00'} Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. (HTTP 404) (Request-ID: req-2d34b673-895d-4669-8e47-8a3fecb74fbb) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:48:54.191428 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-270c6056-0930-4a74-8470-520585dc93ef tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Returning 404 to user: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-270c6056-0930-4a74-8470-520585dc93ef tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00" status: 404 len: 109 microversion: 2.1 time: 0.056326 Oct 27 09:48:54.201030 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3450/6828] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:48:54 2022] GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:54.205601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5bf3c933-f046-48b5-b5c6-29d179711c76 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31ae5f7040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:54.235100 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5bf3c933-f046-48b5-b5c6-29d179711c76 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] HTTP exception thrown: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5bf3c933-f046-48b5-b5c6-29d179711c76 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Request method failure captured: Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 HTTP/1.1 Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlP7bvJ2xwUt4WkMEcmHYNguqddl8bIHvNHZYPW4Pw93CMHc342VwP6cNBbUq_4h6WiR2SrTYvN4DrJKTXvoETmURHnB1NJlEEHHPdnAFzTxk7rbDxdbIDpmiIJ_fdJvWgQsC7addrUEiABvdRbUYn3uwYQSqQHSeGBLmmG7cLiUi7Y Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 7c9b7c8962f948f9be4a2db7880770f1 Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c9b7c8962f948f9be4a2db7880770f1"}]}] Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 7c9b7c8962f948f9be4a2db7880770f1 Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotsTestJSON-1743348018-project Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 8241d8e5a9394c66972367e70c0ba2dc Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1743348018-project Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: method: Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: exception: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '66c3f3d4-aeac-43a9-919e-b31f76339e00'} Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. (HTTP 404) (Request-ID: req-bfe11e01-21cd-49b0-a514-60efeb242cc9) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:48:54.237476 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5bf3c933-f046-48b5-b5c6-29d179711c76 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Returning 404 to user: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:54.242376 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5bf3c933-f046-48b5-b5c6-29d179711c76 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00" status: 404 len: 109 microversion: 2.1 time: 0.041163 Oct 27 09:48:54.248742 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3379/6829] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Oct 27 09:48:54 2022] DELETE /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:48:54.253657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b8a74f1-8540-43c9-a1ba-c8523b9aa714 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Calling method '.version_select at 0x7f31a808e940>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:54.285135 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-0b8a74f1-8540-43c9-a1ba-c8523b9aa714 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] HTTP exception thrown: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b8a74f1-8540-43c9-a1ba-c8523b9aa714 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Request method failure captured: Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 HTTP/1.1 Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlP7bvJ2xwUt4WkMEcmHYNguqddl8bIHvNHZYPW4Pw93CMHc342VwP6cNBbUq_4h6WiR2SrTYvN4DrJKTXvoETmURHnB1NJlEEHHPdnAFzTxk7rbDxdbIDpmiIJ_fdJvWgQsC7addrUEiABvdRbUYn3uwYQSqQHSeGBLmmG7cLiUi7Y Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 7c9b7c8962f948f9be4a2db7880770f1 Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c9b7c8962f948f9be4a2db7880770f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c9b7c8962f948f9be4a2db7880770f1"}]}] Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 7c9b7c8962f948f9be4a2db7880770f1 Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1743348018 Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-VolumesSnapshotsTestJSON-1743348018-project Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 8241d8e5a9394c66972367e70c0ba2dc Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1743348018-project Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: method: Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: exception: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '66c3f3d4-aeac-43a9-919e-b31f76339e00'} Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. (HTTP 404) (Request-ID: req-4ba10a01-f5e2-4405-abc5-318b7a788937) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:48:54.287172 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. Oct 27 09:48:54.292623 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:48:54.296870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b8a74f1-8540-43c9-a1ba-c8523b9aa714 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] Returning 404 to user: Volume 66c3f3d4-aeac-43a9-919e-b31f76339e00 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:48:54.297793 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b8a74f1-8540-43c9-a1ba-c8523b9aa714 tempest-VolumesSnapshotsTestJSON-1743348018 tempest-VolumesSnapshotsTestJSON-1743348018-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00" status: 404 len: 109 microversion: 2.1 time: 0.049199 Oct 27 09:48:54.298432 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3451/6830] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Oct 27 09:48:54 2022] GET /compute/v2.1/os-volumes/66c3f3d4-aeac-43a9-919e-b31f76339e00 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:49:10.459719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-faa0c0c4-2647-4ae6-a5cd-12eac5c0407f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:49:10.463609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-faa0c0c4-2647-4ae6-a5cd-12eac5c0407f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:10.468570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=59 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:49:10.469672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=52 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:49:10.480687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa0c0c4-2647-4ae6-a5cd-12eac5c0407f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:10.481329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa0c0c4-2647-4ae6-a5cd-12eac5c0407f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:10.481927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa0c0c4-2647-4ae6-a5cd-12eac5c0407f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:10.483142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa0c0c4-2647-4ae6-a5cd-12eac5c0407f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:10.483970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa0c0c4-2647-4ae6-a5cd-12eac5c0407f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:10.484680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-faa0c0c4-2647-4ae6-a5cd-12eac5c0407f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:10.573787 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-faa0c0c4-2647-4ae6-a5cd-12eac5c0407f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018/action" status: 200 len: 24564 microversion: 2.1 time: 0.120138 Oct 27 09:49:10.574502 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3380/6831] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:49:10 2022] POST /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018/action => generated 24564 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:49:40.780881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=34 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:49:40.781722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=34 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:49:40.787235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:40.787931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:40.798920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:40.799438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:40.799941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:40.800699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:40.801174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:40.801619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:41.228005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:41.236728 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f34648a-8029-46fa-8245-034543fec805 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1683 microversion: 2.1 time: 0.457937 Oct 27 09:49:41.237393 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3452/6832] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:40 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1683 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:49:41.373792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7fe0ff3-6ca5-4ec4-bfaf-653dad3f1c0c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:49:41.377748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7fe0ff3-6ca5-4ec4-bfaf-653dad3f1c0c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:41.382618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:49:41.383942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:49:41.393207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0ff3-6ca5-4ec4-bfaf-653dad3f1c0c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:41.393869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0ff3-6ca5-4ec4-bfaf-653dad3f1c0c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:41.394426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0ff3-6ca5-4ec4-bfaf-653dad3f1c0c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:41.395361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0ff3-6ca5-4ec4-bfaf-653dad3f1c0c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:41.396084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0ff3-6ca5-4ec4-bfaf-653dad3f1c0c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:41.396635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7fe0ff3-6ca5-4ec4-bfaf-653dad3f1c0c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:41.485728 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7fe0ff3-6ca5-4ec4-bfaf-653dad3f1c0c tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018/action" status: 200 len: 32630 microversion: 2.1 time: 0.118931 Oct 27 09:49:41.487073 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3381/6833] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:49:41 2022] POST /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018/action => generated 32630 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:49:41.665404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc6d76a6-3669-4785-9dd0-ab4bb4737ac6 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:41.665939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc6d76a6-3669-4785-9dd0-ab4bb4737ac6 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:41.672717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc6d76a6-3669-4785-9dd0-ab4bb4737ac6 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:41.673226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc6d76a6-3669-4785-9dd0-ab4bb4737ac6 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:41.673682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc6d76a6-3669-4785-9dd0-ab4bb4737ac6 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:41.674420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc6d76a6-3669-4785-9dd0-ab4bb4737ac6 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:41.674891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc6d76a6-3669-4785-9dd0-ab4bb4737ac6 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:41.675385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc6d76a6-3669-4785-9dd0-ab4bb4737ac6 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:41.849289 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc6d76a6-3669-4785-9dd0-ab4bb4737ac6 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1836 microversion: 2.1 time: 0.187712 Oct 27 09:49:41.850068 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3453/6834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:41 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1836 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:49:41.884195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:49:41.887220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:41.895198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:41.895737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:41.896186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:41.896907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:41.897373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:41.897804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:41.926954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lazy-loading 'flavor' on Instance uuid 0a2ac474-06f5-470a-8243-ea3388cce018 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:49:41.942262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Going to try to live migrate instance to another host {{(pid=120603) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 27 09:49:44.014392 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bcd2c3ef-5092-4fd7-a3d5-de947a513e75 tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018/action" status: 202 len: 0 microversion: 2.1 time: 2.134313 Oct 27 09:49:44.015872 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3382/6835] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:49:41 2022] POST /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018/action => generated 0 bytes in 2137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:49:44.029681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:44.031957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:44.064563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:44.065703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:44.067044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:44.068717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:44.069896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:44.070800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:44.271122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:44.289086 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ab4e2381-57c6-4c55-b04d-f8197964787d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.266369 Oct 27 09:49:44.290543 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3454/6836] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:44 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:49:45.319859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:45.321025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:45.360725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:45.361962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:45.363300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:45.364729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:45.368299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:45.370112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:45.966785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:45.976781 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-581f6ee8-f4f8-40d6-85e7-c6b251fecbd6 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.665178 Oct 27 09:49:45.977579 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3383/6837] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:45 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:49:45.984320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6f7dda16-73e2-4a5e-867d-b1499515bce7 req-10a04323-41bb-4b67-9460-57062303ba2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2ac474-06f5-470a-8243-ea3388cce018", "name": "network-vif-unplugged", "status": "completed", "tag": "e128aa19-5b87-4372-b5ba-7ee900555930"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:49:46.004538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6f7dda16-73e2-4a5e-867d-b1499515bce7 req-10a04323-41bb-4b67-9460-57062303ba2a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:46.005447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6f7dda16-73e2-4a5e-867d-b1499515bce7 req-10a04323-41bb-4b67-9460-57062303ba2a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:46.006266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6f7dda16-73e2-4a5e-867d-b1499515bce7 req-10a04323-41bb-4b67-9460-57062303ba2a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:46.029682 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6f7dda16-73e2-4a5e-867d-b1499515bce7 req-10a04323-41bb-4b67-9460-57062303ba2a service nova] Creating event network-vif-unplugged:e128aa19-5b87-4372-b5ba-7ee900555930 for instance 0a2ac474-06f5-470a-8243-ea3388cce018 on n-h2-858383-16 Oct 27 09:49:46.040258 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6f7dda16-73e2-4a5e-867d-b1499515bce7 req-10a04323-41bb-4b67-9460-57062303ba2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063889 Oct 27 09:49:46.041357 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3455/6838] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:49:47.029271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:47.030442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:47.045052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:47.045934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:47.047126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:47.053254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:47.054526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:47.057467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:47.312362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:47.328587 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71c14ed4-046a-429e-8a65-85db3ba1185f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.308748 Oct 27 09:49:47.329528 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3384/6839] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:47 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:49:48.086243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c4b1f01c-a147-416b-b4a9-833cca78e1f7 req-efe23ca9-94de-4436-9222-21283f5ce64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2ac474-06f5-470a-8243-ea3388cce018", "tag": "e128aa19-5b87-4372-b5ba-7ee900555930"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:49:48.096627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c4b1f01c-a147-416b-b4a9-833cca78e1f7 req-efe23ca9-94de-4436-9222-21283f5ce64a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:48.097263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c4b1f01c-a147-416b-b4a9-833cca78e1f7 req-efe23ca9-94de-4436-9222-21283f5ce64a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:48.098357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c4b1f01c-a147-416b-b4a9-833cca78e1f7 req-efe23ca9-94de-4436-9222-21283f5ce64a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:48.111891 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c4b1f01c-a147-416b-b4a9-833cca78e1f7 req-efe23ca9-94de-4436-9222-21283f5ce64a service nova] Creating event network-changed:e128aa19-5b87-4372-b5ba-7ee900555930 for instance 0a2ac474-06f5-470a-8243-ea3388cce018 on n-h2-858383-16 Oct 27 09:49:48.117865 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c4b1f01c-a147-416b-b4a9-833cca78e1f7 req-efe23ca9-94de-4436-9222-21283f5ce64a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036321 Oct 27 09:49:48.118921 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3456/6840] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:49:48.370757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:48.371646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:48.382595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:48.383356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:48.384178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:48.385353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:48.386133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:48.386705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:48.903659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:48.916039 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-86a1acc4-fe26-4153-b9b7-ee03d6ce8d9a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.550540 Oct 27 09:49:48.916892 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3385/6841] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:48 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:49:49.942728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:49.943660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:49.952027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:49.952820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:49.953293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:49.954734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:49.955228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:49.955708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:50.383346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:50.392620 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e7397f7e-e038-4bc6-ae8a-357fa6fd2408 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.455236 Oct 27 09:49:50.393222 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3457/6842] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:49 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:49:51.423252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:51.424387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:51.437534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:51.438366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:51.439141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:51.440397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:51.441184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:51.441908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:51.652606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:51.666500 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e9542f42-f109-4c11-b93d-9232d3c1aeed tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.249622 Oct 27 09:49:51.667832 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3386/6843] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:51 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:49:52.701544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:52.702573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:52.715754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:52.717099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:52.717942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:52.719283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:52.720224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:52.721034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:53.004053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:53.017021 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-54c6ddbc-ddb9-4866-8ebd-480cd74267eb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.323604 Oct 27 09:49:53.018525 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3458/6844] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:52 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:49:54.053011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:54.054190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:54.067157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:54.068181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:54.069168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:54.070266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:54.071075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:54.071900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:54.251824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:54.262672 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10426c88-ea03-4d63-a234-e0b1abf2fce5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.214760 Oct 27 09:49:54.263280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3387/6845] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:54 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:49:55.290485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:55.292546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:55.303305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:55.304450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:55.305045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:55.306112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:55.307163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:55.307890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:55.560066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:55.571639 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e994840-6a7d-41bc-be78-b6196dff20f1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.287313 Oct 27 09:49:55.573126 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3459/6846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:55 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:49:56.617653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:56.619382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:56.633312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:56.634719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:56.635742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:56.637301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:56.638446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:56.639474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:56.930924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:56.950479 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71c2184c-13c7-4715-a574-93d88c807bf1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1693 microversion: 2.1 time: 0.341863 Oct 27 09:49:56.953179 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3388/6847] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:56 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1693 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:49:57.984493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:57.986048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:57.995302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:57.996015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:57.996511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:57.997388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:57.997918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:57.998618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:58.193721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:58.207307 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c717880-4661-42fb-b960-a4ff75860e6d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1683 microversion: 2.1 time: 0.226915 Oct 27 09:49:58.208173 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3460/6848] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:57 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:49:58.245238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bcd68090-e442-4368-bbd0-22d6c572af1f tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:58.245852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bcd68090-e442-4368-bbd0-22d6c572af1f tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:58.254508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd68090-e442-4368-bbd0-22d6c572af1f tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:58.254909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd68090-e442-4368-bbd0-22d6c572af1f tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:58.255972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd68090-e442-4368-bbd0-22d6c572af1f tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:58.256915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd68090-e442-4368-bbd0-22d6c572af1f tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:58.257389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd68090-e442-4368-bbd0-22d6c572af1f tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:58.257830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bcd68090-e442-4368-bbd0-22d6c572af1f tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:58.489277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bcd68090-e442-4368-bbd0-22d6c572af1f tempest-TestNetworkAdvancedServerOps-1269800220 tempest-TestNetworkAdvancedServerOps-1269800220-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1836 microversion: 2.1 time: 0.248071 Oct 27 09:49:58.491972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3389/6849] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:58 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1836 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:49:58.534250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:49:58.539498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:49:58.547518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:58.548088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:58.548524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:58.549501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:49:58.549945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:49:58.550605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:49:58.753892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:49:58.768953 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db802683-bc2c-4c1d-aef5-2c184125d2da tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1683 microversion: 2.1 time: 0.238755 Oct 27 09:49:58.770363 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3461/6850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:49:58 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1683 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:00.931591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0b4968bd-e767-467e-9619-b566bbc74fc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:00.935364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0b4968bd-e767-467e-9619-b566bbc74fc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:00.948526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4968bd-e767-467e-9619-b566bbc74fc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:00.949422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4968bd-e767-467e-9619-b566bbc74fc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:00.950218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4968bd-e767-467e-9619-b566bbc74fc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:00.951466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4968bd-e767-467e-9619-b566bbc74fc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:00.952402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4968bd-e767-467e-9619-b566bbc74fc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:00.953170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0b4968bd-e767-467e-9619-b566bbc74fc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:01.025422 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0b4968bd-e767-467e-9619-b566bbc74fc2 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018/action" status: 200 len: 38656 microversion: 2.1 time: 0.101070 Oct 27 09:50:01.035616 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3390/6851] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:50:00 2022] POST /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018/action => generated 38656 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:50:02.969310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:02.969990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b48a52e3-d477-40e5-9d4a-0624c031b3c3 req-2869795f-01a5-4572-b22d-b320264ff354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2ac474-06f5-470a-8243-ea3388cce018", "tag": "e128aa19-5b87-4372-b5ba-7ee900555930"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:02.971201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:02.982956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b48a52e3-d477-40e5-9d4a-0624c031b3c3 req-2869795f-01a5-4572-b22d-b320264ff354 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:02.983438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b48a52e3-d477-40e5-9d4a-0624c031b3c3 req-2869795f-01a5-4572-b22d-b320264ff354 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:02.984352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b48a52e3-d477-40e5-9d4a-0624c031b3c3 req-2869795f-01a5-4572-b22d-b320264ff354 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:02.989694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:02.990693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:02.991940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:02.993562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:02.995331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:02.996500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:02.999971 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b48a52e3-d477-40e5-9d4a-0624c031b3c3 req-2869795f-01a5-4572-b22d-b320264ff354 service nova] Creating event network-changed:e128aa19-5b87-4372-b5ba-7ee900555930 for instance 0a2ac474-06f5-470a-8243-ea3388cce018 on n-h1-858383-16 Oct 27 09:50:03.009085 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b48a52e3-d477-40e5-9d4a-0624c031b3c3 req-2869795f-01a5-4572-b22d-b320264ff354 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042902 Oct 27 09:50:03.022584 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3391/6852] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:03.061758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:50:03.207249 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d33623e7-1205-4447-a04c-de21d043da5a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 204 len: 0 microversion: 2.1 time: 0.242151 Oct 27 09:50:03.209090 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3462/6853] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:50:02 2022] DELETE /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:50:03.229401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:03.237170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:03.253205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:03.254683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:03.256384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:03.258428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:03.259929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:03.261105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:03.669642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:03.700512 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cff6e424-a19e-4b82-9383-490d3fd56930 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1689 microversion: 2.1 time: 0.482330 Oct 27 09:50:03.711292 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3392/6854] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:03 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1689 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:04.735007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:04.736749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:04.745621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:04.746867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:04.747388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:04.748220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:04.748713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:04.749172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:04.825203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:04.834605 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-243b2639-9746-40b8-967a-f0e31cf8abdc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 200 len: 1503 microversion: 2.1 time: 0.106715 Oct 27 09:50:04.835806 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3463/6855] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:04 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 1503 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:05.038456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2864663e-91a5-43f3-a3b1-2974ddba03f1 req-bcfcad8d-074f-45cd-bb97-ce4ba3be8d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2ac474-06f5-470a-8243-ea3388cce018", "name": "network-vif-deleted", "tag": "e128aa19-5b87-4372-b5ba-7ee900555930"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:05.055891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2864663e-91a5-43f3-a3b1-2974ddba03f1 req-bcfcad8d-074f-45cd-bb97-ce4ba3be8d84 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:05.056719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2864663e-91a5-43f3-a3b1-2974ddba03f1 req-bcfcad8d-074f-45cd-bb97-ce4ba3be8d84 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:05.057493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2864663e-91a5-43f3-a3b1-2974ddba03f1 req-bcfcad8d-074f-45cd-bb97-ce4ba3be8d84 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:05.075065 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2864663e-91a5-43f3-a3b1-2974ddba03f1 req-bcfcad8d-074f-45cd-bb97-ce4ba3be8d84 service nova] Creating event network-vif-deleted:e128aa19-5b87-4372-b5ba-7ee900555930 for instance 0a2ac474-06f5-470a-8243-ea3388cce018 on n-h1-858383-16 Oct 27 09:50:05.081933 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2864663e-91a5-43f3-a3b1-2974ddba03f1 req-bcfcad8d-074f-45cd-bb97-ce4ba3be8d84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048325 Oct 27 09:50:05.083839 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3393/6856] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:05.886997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:05.888238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 0a2ac474-06f5-470a-8243-ea3388cce018] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:05.896025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:05.896669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:05.897217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:05.898132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:05.898775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:05.899157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:05.915720 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] HTTP exception thrown: Instance 0a2ac474-06f5-470a-8243-ea3388cce018 could not be found. Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Request method failure captured: Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 HTTP/1.1 Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlJDSDr1-dsqc3eIUxJ-ieGNeGuhoA4wiY87ragx5kgzDbmJPZslaWdKO1pfCvcYDg6uLTzYhdhl4rSHxTWFf8hu3m-L8rwhHSJeogWLh_KnZWQIRCt2iFkzdspz6TyfdjSpyMD7SVxi8wkEcfqhvYbzSnsfNPvnknwpLkoqydKNQL4 Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: f7fdcfbb223c44e693f100b3717522cf Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7fdcfbb223c44e693f100b3717522cf"}]}] Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: f7fdcfbb223c44e693f100b3717522cf Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestNetworkAdvancedServerOps-476394632-project Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0d83fee6e4854240b13a10c262453b32 Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestNetworkAdvancedServerOps-476394632-project Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 0a2ac474-06f5-470a-8243-ea3388cce018 could not be found. Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '0a2ac474-06f5-470a-8243-ea3388cce018'} Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2ac474-06f5-470a-8243-ea3388cce018 could not be found. Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2ac474-06f5-470a-8243-ea3388cce018 could not be found. Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:50:05.917513 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2ac474-06f5-470a-8243-ea3388cce018 could not be found. Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Returning 404 to user: Instance 0a2ac474-06f5-470a-8243-ea3388cce018 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9925f03f-36f9-4504-9ce3-94ca2afa30c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018" status: 404 len: 111 microversion: 2.1 time: 0.037053 Oct 27 09:50:05.926680 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3464/6857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:05 2022] GET /compute/v2.1/servers/0a2ac474-06f5-470a-8243-ea3388cce018 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:50:10.400842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a59ea342-561f-48ae-8adf-1fdce3b33295 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '.version_select at 0x7f31a9fd3b80>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:10.450864 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a59ea342-561f-48ae-8adf-1fdce3b33295 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-405938096" status: 202 len: 0 microversion: 2.1 time: 0.058573 Oct 27 09:50:10.452616 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3394/6858] 10.222.0.25 () {58 vars in 1281 bytes} [Thu Oct 27 09:50:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-405938096 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:50:10.495314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f9602a23-17d1-4264-ac49-24d112802ca4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'create', calling method: .version_select at 0x7f31ae4e1820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-33215108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/1zudtp8RQyAo7Ox2y7vwPL/y6Cg52qlKg9NqwBkcbIFUI5rC+oKGhOiYio95QQY6OjbIm6E0wVqmEBTR8KYAP8+hScmllILKUoblJgzqtwDRHIVnye5bWgj1facT8lg=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:10.527720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f9602a23-17d1-4264-ac49-24d112802ca4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for project f7fdcfbb223c44e693f100b3717522cf. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:50:10.538494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f9602a23-17d1-4264-ac49-24d112802ca4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for user 0d83fee6e4854240b13a10c262453b32 and project f7fdcfbb223c44e693f100b3717522cf. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:50:10.583989 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f9602a23-17d1-4264-ac49-24d112802ca4 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.094505 Oct 27 09:50:10.584908 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3465/6859] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:50:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:22.026042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1067835324", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "54d9a2f2-45f6-498c-aee3-ca02c912355f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-33215108", "security_groups": [{"name": "tempest-secgroup-smoke-950900573"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:22.073222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:22.075171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:22.218759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] validate_networks() for [('54d9a2f2-45f6-498c-aee3-ca02c912355f', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:50:23.148554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:50:23.149525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:50:23.150732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:50:23.151428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:50:23.151984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:50:23.174389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:23.178165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:23.179123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:23.181229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:23.182095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:23.183127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:23.208142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for project f7fdcfbb223c44e693f100b3717522cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:50:23.218616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Getting quotas for user 0d83fee6e4854240b13a10c262453b32 and project f7fdcfbb223c44e693f100b3717522cf. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:50:23.235754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:50:23.238874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:50:23.299497 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33d03e41-0ca4-48b0-9ba0-68127e60d0e8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.281927 Oct 27 09:50:23.300577 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3395/6860] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:50:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:50:23.317661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:23.320105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:23.353873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:23.369828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0636ad96-45d8-4dff-a4e3-0b6de0be1d78 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:23.373846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0636ad96-45d8-4dff-a4e3-0b6de0be1d78 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:23.560502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0636ad96-45d8-4dff-a4e3-0b6de0be1d78 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:23.579997 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0636ad96-45d8-4dff-a4e3-0b6de0be1d78 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1265 microversion: 2.1 time: 0.264602 Oct 27 09:50:23.581123 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3466/6861] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:23 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:24.646917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:24.661736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:24.686523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:24.687279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:24.687984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:24.689133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:24.689874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:24.690604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:24.850154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:24.863072 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36031137-0856-4c95-94dc-2fe93530726f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1261 microversion: 2.1 time: 0.242188 Oct 27 09:50:24.871479 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3396/6862] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:24 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1261 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:25.894803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:25.896342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:25.905744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:25.906693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:25.907421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:25.908490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:25.909245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:25.909944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:25.992812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:26.005746 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-70ee5a46-0f66-4d90-a354-56ea9072d4e1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1323 microversion: 2.1 time: 0.113438 Oct 27 09:50:26.008682 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3467/6863] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:25 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1323 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:27.034555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:27.036233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:27.048941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:27.049399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:27.049893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:27.070128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:27.070851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:27.071328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:27.209826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:27.225755 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8becf3e4-0c3a-45a7-8f04-4aa4b39546bb tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1323 microversion: 2.1 time: 0.195039 Oct 27 09:50:27.226798 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3397/6864] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:27 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:28.273138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:28.276389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:28.289489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:28.291426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:28.292650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:28.294238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:28.296276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:28.297626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:28.694573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:28.708251 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-518735e7-00cd-4b14-a63b-24bfd1d98b81 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1390 microversion: 2.1 time: 0.444095 Oct 27 09:50:28.710675 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3468/6865] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:28 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1390 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:29.601758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-163dfd33-a5e3-40c9-8cfe-3ba9dc0a86f3 req-8379495c-4fe0-4f66-b2c6-4005b6359bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97", "tag": "c9b91c34-1868-43d3-bf87-2a055f05c867"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:29.646072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-163dfd33-a5e3-40c9-8cfe-3ba9dc0a86f3 req-8379495c-4fe0-4f66-b2c6-4005b6359bf4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:29.647413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-163dfd33-a5e3-40c9-8cfe-3ba9dc0a86f3 req-8379495c-4fe0-4f66-b2c6-4005b6359bf4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:29.648267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-163dfd33-a5e3-40c9-8cfe-3ba9dc0a86f3 req-8379495c-4fe0-4f66-b2c6-4005b6359bf4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:29.685793 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-163dfd33-a5e3-40c9-8cfe-3ba9dc0a86f3 req-8379495c-4fe0-4f66-b2c6-4005b6359bf4 service nova] Creating event network-changed:c9b91c34-1868-43d3-bf87-2a055f05c867 for instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 on n-h2-858383-16 Oct 27 09:50:29.695836 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-163dfd33-a5e3-40c9-8cfe-3ba9dc0a86f3 req-8379495c-4fe0-4f66-b2c6-4005b6359bf4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101156 Oct 27 09:50:29.699202 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3398/6866] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:29.759430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:29.760793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:29.781761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:29.783217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:29.788432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:29.790383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:29.791586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:29.792815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:30.187555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:30.216314 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-01706538-ead3-443f-8a7a-7b8162a59f9b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1390 microversion: 2.1 time: 0.464958 Oct 27 09:50:30.217869 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3469/6867] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:29 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1390 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:31.291275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:31.293105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:31.304863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:31.305364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:31.305840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:31.306572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:31.307040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:31.307475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:31.680979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:31.706539 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34ba8125-c2b2-4f99-9123-1d3ad24e5067 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1390 microversion: 2.1 time: 0.428879 Oct 27 09:50:31.708467 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3399/6868] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:31 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1390 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:32.785291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:32.786473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:32.813968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:32.816616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:32.823104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:32.826883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:32.828449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:32.830330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:33.367387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:33.400805 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-642def18-52d1-4c22-8bf5-4021511779b8 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1390 microversion: 2.1 time: 0.621697 Oct 27 09:50:33.402890 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3470/6869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:32 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1390 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:34.497012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:34.498581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:34.507889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:34.511476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:34.526002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:34.527164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:34.527907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:34.529058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:34.529712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:34.530160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:34.770554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:34.793597 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b20c93f-1176-4951-9a14-b022b1619387 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1390 microversion: 2.1 time: 0.345718 Oct 27 09:50:34.794673 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3400/6870] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:34 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1390 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:35.838428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:35.840785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:35.845394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:35.872552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:35.873399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:35.876452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:35.881062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:35.881957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:35.883297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:36.482110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3b37b56c-5d75-4dac-a65e-2d321861f8e6 req-a51676d4-1c4a-4cbd-a4e7-11f9091ddc30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97", "name": "network-vif-plugged", "status": "completed", "tag": "c9b91c34-1868-43d3-bf87-2a055f05c867"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:36.510608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b37b56c-5d75-4dac-a65e-2d321861f8e6 req-a51676d4-1c4a-4cbd-a4e7-11f9091ddc30 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:36.511877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b37b56c-5d75-4dac-a65e-2d321861f8e6 req-a51676d4-1c4a-4cbd-a4e7-11f9091ddc30 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:36.512905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b37b56c-5d75-4dac-a65e-2d321861f8e6 req-a51676d4-1c4a-4cbd-a4e7-11f9091ddc30 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:36.555175 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3b37b56c-5d75-4dac-a65e-2d321861f8e6 req-a51676d4-1c4a-4cbd-a4e7-11f9091ddc30 service nova] Creating event network-vif-plugged:c9b91c34-1868-43d3-bf87-2a055f05c867 for instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 on n-h2-858383-16 Oct 27 09:50:36.578807 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3b37b56c-5d75-4dac-a65e-2d321861f8e6 req-a51676d4-1c4a-4cbd-a4e7-11f9091ddc30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095196 Oct 27 09:50:36.580827 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3401/6871] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:50:36.808143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:36.824084 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d12a941-6fe4-419c-8f61-bd42233e87d7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1390 microversion: 2.1 time: 0.990656 Oct 27 09:50:36.826908 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3471/6872] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:35 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1390 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:37.859054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:37.860543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:37.872570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:37.873563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:37.874471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:37.875983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:37.876941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:37.877835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:38.078745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-540130366", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2030933275", "security_groups": [{"name": "tempest-secgroup-smoke-1368785454"}], "block_device_mapping_v2": [{"uuid": "d9329f33-6939-44ad-a73a-33b92bf709d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8f250b0-c481-437b-8054-ee4c9ca61f10"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:38.174487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:38.193270 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cbca7df5-85f2-41b8-9426-fd92856a5858 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1390 microversion: 2.1 time: 0.345794 Oct 27 09:50:38.205695 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3402/6873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:37 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1390 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:38.276646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] validate_networks() for [('c8f250b0-c481-437b-8054-ee4c9ca61f10', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:50:38.967814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:50:38.969328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:50:38.970502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:50:38.971363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:50:38.972450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:50:38.990907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:38.993956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:38.993956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:38.994932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:38.995874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:38.996855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:39.026137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:50:39.035202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Getting quotas for user 9ab30747d0444c32bbc058a522262b62 and project 0f4e16a0d19b4decbfe0ac60397b4113. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:50:39.124046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:50:39.127159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9329f33-6939-44ad-a73a-33b92bf709d4',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:50:39.228677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:39.229940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:39.242669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:39.243633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:39.245177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:39.247232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:39.248560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:39.249177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:39.335464 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-90f00405-88bd-41b1-b221-9c27d2f85dd9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.259613 Oct 27 09:50:39.335464 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3472/6874] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:50:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:50:39.360204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-abd84031-7325-4c7f-8f5c-0c6eb98c829f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:39.362050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-abd84031-7325-4c7f-8f5c-0c6eb98c829f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:39.474192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-abd84031-7325-4c7f-8f5c-0c6eb98c829f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:39.485861 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-abd84031-7325-4c7f-8f5c-0c6eb98c829f tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1094 microversion: 2.1 time: 0.133483 Oct 27 09:50:39.486890 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3473/6875] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:39 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:39.582505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:39.601321 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5894bf9-082b-4079-a640-6936ec6f63fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1562 microversion: 2.1 time: 0.380992 Oct 27 09:50:39.603962 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3403/6876] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:39 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1562 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:39.647356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:39.648617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:39.666886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:39.668456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:39.669574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:39.671085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:39.671947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:39.673200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:39.905139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:39.921652 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9089dc05-21d7-417f-9ec6-b96a1c5fa939 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1562 microversion: 2.1 time: 0.282233 Oct 27 09:50:39.923227 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3474/6877] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:39 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1562 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:41.055146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:41.073012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:41.189734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:41.190812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:41.200786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:41.202876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:41.203831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:41.204676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:41.452394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:41.487001 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78ba5a08-4914-41c8-a49b-3359dea10da3 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1210 microversion: 2.1 time: 0.974515 Oct 27 09:50:41.488308 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3404/6878] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:40 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1210 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:42.531430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:42.532432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:42.611877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:42.613284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:42.614369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:42.617467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:42.619203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:42.642401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:43.021369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:43.035918 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c8750f7-c389-4c0f-9d6a-c23f4294910d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1210 microversion: 2.1 time: 0.510436 Oct 27 09:50:43.050325 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3475/6879] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:42 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1210 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:44.070814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:44.084322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:44.113099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:44.115242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:44.116580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:44.119942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:44.121901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:44.122871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:44.768425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:44.780184 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-09df4d41-2f04-4060-8657-332dd08d47db tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1278 microversion: 2.1 time: 0.716589 Oct 27 09:50:44.781482 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3405/6880] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:44 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1278 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:45.624585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:45.628683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:45.655151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-64b4240a-c08b-4c51-8027-ec1fd2a3de30 req-37413b9e-c896-4308-9fb1-5f86e754ff60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97", "tag": "c9b91c34-1868-43d3-bf87-2a055f05c867"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:45.656002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:45.660034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:45.665944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:45.667650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:45.672804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:45.673875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:45.738951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-64b4240a-c08b-4c51-8027-ec1fd2a3de30 req-37413b9e-c896-4308-9fb1-5f86e754ff60 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:45.738951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-64b4240a-c08b-4c51-8027-ec1fd2a3de30 req-37413b9e-c896-4308-9fb1-5f86e754ff60 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:45.745929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-64b4240a-c08b-4c51-8027-ec1fd2a3de30 req-37413b9e-c896-4308-9fb1-5f86e754ff60 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:45.821966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-64b4240a-c08b-4c51-8027-ec1fd2a3de30 req-37413b9e-c896-4308-9fb1-5f86e754ff60 service nova] Creating event network-changed:c9b91c34-1868-43d3-bf87-2a055f05c867 for instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 on n-h2-858383-16 Oct 27 09:50:45.846398 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-64b4240a-c08b-4c51-8027-ec1fd2a3de30 req-37413b9e-c896-4308-9fb1-5f86e754ff60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199851 Oct 27 09:50:45.848370 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3406/6881] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:50:45.878859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:45.882056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:45.912782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:45.919183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:45.922783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:45.927553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:45.931554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:45.935405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:46.375463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:46.399237 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99c34ea5-187c-4f83-b1c9-7ff12a74915e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1562 microversion: 2.1 time: 0.782645 Oct 27 09:50:46.407031 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3476/6882] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:45 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1562 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:46.604058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:46.619279 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7554599e-a0b9-4aa0-8275-aed819418ecd tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1278 microversion: 2.1 time: 0.767238 Oct 27 09:50:46.620576 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3407/6883] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:45 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1278 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:47.659071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:47.662496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:47.683750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:47.685508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:47.686832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:47.689531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:47.691510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:47.693044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:47.942381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b8aad2ce-5021-452b-ae07-dfb9cd572d29 req-4cd47c37-9e48-4bc2-bcc8-fc843ceb3915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1ebed3-7b13-4e64-9896-dc4e4b477d4e", "tag": "cb263a86-61e1-4451-809f-213664e9ad74"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:47.958542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b8aad2ce-5021-452b-ae07-dfb9cd572d29 req-4cd47c37-9e48-4bc2-bcc8-fc843ceb3915 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:47.960343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b8aad2ce-5021-452b-ae07-dfb9cd572d29 req-4cd47c37-9e48-4bc2-bcc8-fc843ceb3915 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:47.964550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b8aad2ce-5021-452b-ae07-dfb9cd572d29 req-4cd47c37-9e48-4bc2-bcc8-fc843ceb3915 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:48.014765 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b8aad2ce-5021-452b-ae07-dfb9cd572d29 req-4cd47c37-9e48-4bc2-bcc8-fc843ceb3915 service nova] Creating event network-changed:cb263a86-61e1-4451-809f-213664e9ad74 for instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e on n-h1-858383-16 Oct 27 09:50:48.027203 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b8aad2ce-5021-452b-ae07-dfb9cd572d29 req-4cd47c37-9e48-4bc2-bcc8-fc843ceb3915 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091410 Oct 27 09:50:48.029057 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3408/6884] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:48.216846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:48.225483 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-db4e61a4-52c3-43a2-b973-9acec3622666 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1278 microversion: 2.1 time: 0.581404 Oct 27 09:50:48.226362 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3477/6885] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:47 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1278 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:49.270815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:49.272334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:49.282498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:49.283238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:49.283951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:49.284981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:49.285887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:49.286677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:49.543292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:49.564704 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f6169098-489c-4819-a28f-ef432e64caec tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1278 microversion: 2.1 time: 0.302438 Oct 27 09:50:49.565470 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3409/6886] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:49 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1278 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:50.610997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:50.612027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:50.619033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:50.620441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:50.627742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:50.628716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:50.629591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:50.630867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:50.631760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:50.632562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:50.871648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:50.889174 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-385a5e76-1064-4687-b58d-5715ecc2900c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.285584 Oct 27 09:50:50.890249 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3478/6887] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:50 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:51.933672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:51.934738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:51.945742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:51.947041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:51.947867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:51.949418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:51.950262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:51.951241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:52.248338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:52.253022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=75 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:52.262476 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d0de1e2-de87-438c-b019-d89f7d81d97d tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.337409 Oct 27 09:50:52.263118 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3410/6888] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:51 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:53.301192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:53.302257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:53.323960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:53.326800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:53.327662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:53.329021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:53.329909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:53.330715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:53.673504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:53.676769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=67 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:53.687680 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-78445ace-d705-4f2c-8e05-fbc9cc94af39 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.394841 Oct 27 09:50:53.689016 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3479/6889] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:53 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:54.730519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:54.731882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:54.736535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:54.750341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:54.751776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:54.752892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:54.754916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:54.756227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:54.757438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:55.215060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:55.231264 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-24522963-a103-4984-95e4-4e186a127c57 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.506660 Oct 27 09:50:55.232399 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3411/6890] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:54 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:56.257711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:56.258956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:56.262616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:56.272708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:56.274300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:56.275432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:56.276928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:56.277983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:56.278906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:56.595263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:56.609960 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-469c603a-83ab-4a71-8779-d191fb3315de tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.357927 Oct 27 09:50:56.611947 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3480/6891] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:56 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:57.652890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:57.654008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:57.668002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:57.668867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:57.669695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:57.671022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:57.671921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:57.672713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:57.886437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:57.895272 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-563597fb-35b3-4d0c-a442-f8850a02b61c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.250186 Oct 27 09:50:57.895932 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3412/6892] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:57 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:58.921496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:58.922634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:58.934348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:58.935216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:58.935867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:58.936694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:58.937465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:58.938259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:59.139330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:59.150518 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d91b3ba-5f10-454a-a463-d373a5b5d1c9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.234535 Oct 27 09:50:59.151390 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3481/6893] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:58 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:00.183385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:00.184742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:00.197781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:00.198920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:00.200157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:00.201524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:00.202695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:00.203611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:00.434726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:00.448876 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8616697-9460-4692-ae93-f7e9e94d896c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.273897 Oct 27 09:51:00.463705 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3413/6894] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:00 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:01.487108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:01.488267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:01.501792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:01.502714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:01.503561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:01.504959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:01.505862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:01.506695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:01.725399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:01.739648 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dbb03c7c-1082-4545-8d28-976958aec9ba tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.260225 Oct 27 09:51:01.741414 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3482/6895] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:01 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:02.759410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c579c420-adc7-453c-8a20-4a31551e3675 req-2079816a-416c-4943-b5bf-df0681208fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1ebed3-7b13-4e64-9896-dc4e4b477d4e", "name": "network-vif-plugged", "status": "completed", "tag": "cb263a86-61e1-4451-809f-213664e9ad74"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:51:02.773608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:02.774818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:02.777640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c579c420-adc7-453c-8a20-4a31551e3675 req-2079816a-416c-4943-b5bf-df0681208fa6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:02.780592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c579c420-adc7-453c-8a20-4a31551e3675 req-2079816a-416c-4943-b5bf-df0681208fa6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:02.786676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c579c420-adc7-453c-8a20-4a31551e3675 req-2079816a-416c-4943-b5bf-df0681208fa6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:02.788859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:02.789973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:02.791248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:02.792928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:02.794061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:02.795172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:02.822993 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c579c420-adc7-453c-8a20-4a31551e3675 req-2079816a-416c-4943-b5bf-df0681208fa6 service nova] Creating event network-vif-plugged:cb263a86-61e1-4451-809f-213664e9ad74 for instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e on n-h1-858383-16 Oct 27 09:51:02.834255 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c579c420-adc7-453c-8a20-4a31551e3675 req-2079816a-416c-4943-b5bf-df0681208fa6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079024 Oct 27 09:51:02.836195 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3414/6896] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:51:03.175263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:03.192294 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ce7615cd-6630-4427-85e2-5a80315b803e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.426157 Oct 27 09:51:03.194129 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3483/6897] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:02 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:04.240649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:04.241838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:04.252830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:04.253491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:04.254063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:04.254942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:04.255507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:04.256103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:04.574484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:04.583430 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b7098a5-b963-425f-9b5b-bd34799f2354 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1266 microversion: 2.1 time: 0.351323 Oct 27 09:51:04.600210 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3415/6898] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:04 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:05.609228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:05.610700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:05.622497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:05.623538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:05.624426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:05.625509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:05.626311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:05.627063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:05.837074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:05.866632 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b054725c-317f-4ed8-8940-e9849713a207 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1454 microversion: 2.1 time: 0.262119 Oct 27 09:51:05.868683 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3484/6899] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:05 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1454 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:05.890842 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:05.892253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:05.900687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:05.905284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:05.905839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:05.906582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:05.907064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:05.907508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:06.106577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:06.121881 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d4eb53d9-3473-466c-8e6c-1911860865d9 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1454 microversion: 2.1 time: 0.234514 Oct 27 09:51:06.122924 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3416/6900] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:05 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1454 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:09.136992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-da5786a7-7634-475b-9366-60c29d2e0316 req-c7783647-b2f1-46ce-a78c-6afae87f036a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1ebed3-7b13-4e64-9896-dc4e4b477d4e", "tag": "cb263a86-61e1-4451-809f-213664e9ad74"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:51:09.166774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-da5786a7-7634-475b-9366-60c29d2e0316 req-c7783647-b2f1-46ce-a78c-6afae87f036a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:09.168385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-da5786a7-7634-475b-9366-60c29d2e0316 req-c7783647-b2f1-46ce-a78c-6afae87f036a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:09.169565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-da5786a7-7634-475b-9366-60c29d2e0316 req-c7783647-b2f1-46ce-a78c-6afae87f036a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:09.209886 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-da5786a7-7634-475b-9366-60c29d2e0316 req-c7783647-b2f1-46ce-a78c-6afae87f036a service nova] Creating event network-changed:cb263a86-61e1-4451-809f-213664e9ad74 for instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e on n-h1-858383-16 Oct 27 09:51:09.222240 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-da5786a7-7634-475b-9366-60c29d2e0316 req-c7783647-b2f1-46ce-a78c-6afae87f036a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093454 Oct 27 09:51:09.223388 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3485/6901] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:51:13.377290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dccb2070-5893-4049-a7ab-d9717ec18e6b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:51:13.381423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dccb2070-5893-4049-a7ab-d9717ec18e6b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:13.392576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccb2070-5893-4049-a7ab-d9717ec18e6b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:13.393190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccb2070-5893-4049-a7ab-d9717ec18e6b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:13.393664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccb2070-5893-4049-a7ab-d9717ec18e6b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:13.394486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccb2070-5893-4049-a7ab-d9717ec18e6b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:13.394977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccb2070-5893-4049-a7ab-d9717ec18e6b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:13.395757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dccb2070-5893-4049-a7ab-d9717ec18e6b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:13.484689 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dccb2070-5893-4049-a7ab-d9717ec18e6b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97/action" status: 200 len: 24553 microversion: 2.1 time: 0.111797 Oct 27 09:51:13.486977 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3417/6902] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:51:13 2022] POST /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97/action => generated 24553 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:51:43.722782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=11 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:51:43.724430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=33 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:51:43.939795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:51:43.945389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:43.958822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:43.959621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:43.960448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:43.962350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:43.963177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:43.964021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:44.108838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:51:44.109494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:51:44.110165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:51:44.110904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:51:44.111518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:51:44.220620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:44.233680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:44.236128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:44.237407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:44.238826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:44.239812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:44.240662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:44.306299 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b72ea5c3-ed93-469f-92fc-59e201d27cfc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97/action" status: 202 len: 1138 microversion: 2.1 time: 0.585466 Oct 27 09:51:44.307888 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3486/6903] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:51:43 2022] POST /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97/action => generated 1138 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 27 09:51:44.336953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:44.342499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:44.346541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=13 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:51:44.353376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=37 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:51:44.364037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:44.365139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:44.366123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:44.370505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:44.372341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:44.372934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:44.570864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:44.588520 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-93655319-9369-4321-8661-426ac292d881 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1690 microversion: 2.1 time: 0.261912 Oct 27 09:51:44.589629 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3418/6904] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:44 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:45.619518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:45.621785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:45.633863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:45.635037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:45.636268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:45.637950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:45.639420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:45.640241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:45.867500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:45.883801 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4ad116a2-f88d-4f05-a8a0-99ee5cadfc26 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1690 microversion: 2.1 time: 0.271629 Oct 27 09:51:45.885560 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3487/6905] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:45 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1690 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:46.924919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:46.926090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:46.937410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:46.938087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:46.938667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:46.939552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:46.940260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:46.940765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:47.202133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:47.212796 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37d212cc-254a-4dfe-a4f1-7a58f33cfed7 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1690 microversion: 2.1 time: 0.293501 Oct 27 09:51:47.213474 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3419/6906] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:46 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1690 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:48.257092 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:48.258439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:48.273751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:48.276289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:48.277714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:48.279409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:48.280619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:48.281701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:48.545228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:48.560475 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-533b3d06-40e2-46e2-924f-1ce1ef5fc3af tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1690 microversion: 2.1 time: 0.311715 Oct 27 09:51:48.562709 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3488/6907] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:48 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1690 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:49.607313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:49.609819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:49.632654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:49.633667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:49.634519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:49.636228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:49.637128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:49.638035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:49.953923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:49.964840 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e59b8b53-86e5-4755-9acb-bd5a021d0bd1 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1690 microversion: 2.1 time: 0.363645 Oct 27 09:51:49.965767 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3420/6908] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:49 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1690 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:51.011796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:51.012530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:51.038362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:51.043710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:51.044596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:51.045632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:51.046462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:51.048940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:51.886468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:51.924084 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4212b9eb-d0f3-49d0-8440-15fa6298929d tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1690 microversion: 2.1 time: 0.914418 Oct 27 09:51:51.928860 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3489/6909] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:51 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1690 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:52.976529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:52.979098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:52.995861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:52.997118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:52.998469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:53.000923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:53.002191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:53.003333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:53.486600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:53.500708 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-daad33c5-34f7-4429-ba39-dcd2a8d18d5e tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1690 microversion: 2.1 time: 0.532525 Oct 27 09:51:53.501811 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3421/6910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:52 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1690 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:51:54.533389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:54.534758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:54.548859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:54.549959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:54.550960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:54.552538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:54.553604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:54.555047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:54.911487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:54.926480 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d8b85dc3-32d5-4791-bf59-5744ff1f86a5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1690 microversion: 2.1 time: 0.400778 Oct 27 09:51:54.927700 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3490/6911] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:54 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1690 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:51:55.955932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:55.957069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:55.967412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:55.968398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:55.969098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:55.970056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:55.970955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:55.971832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:56.293031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:56.311345 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c235d3f1-00fb-471e-9652-9f2a65b1116f tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1690 microversion: 2.1 time: 0.360573 Oct 27 09:51:56.312567 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3422/6912] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:55 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1690 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:51:57.361684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:57.362736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:57.374146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:57.375055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:57.375928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:57.377279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:57.378179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:57.379009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:57.669622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:57.686123 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-38751a93-5f4f-40cb-9ef5-186926102052 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1696 microversion: 2.1 time: 0.331639 Oct 27 09:51:57.687176 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3491/6913] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:57 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1696 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:51:58.732407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:51:58.733789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:51:58.745332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:58.746190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:58.746961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:58.749186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:51:58.750101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:51:58.750936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:51:59.027341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:51:59.040974 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01b5fc14-f24b-4ab9-954b-61abad0f6e60 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1696 microversion: 2.1 time: 0.317209 Oct 27 09:51:59.042706 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3423/6914] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:51:58 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1696 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:52:00.073467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:00.074786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:00.089099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:00.090575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:00.091634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:00.093813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:00.095068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:00.096744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:00.358055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:52:00.369999 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-beea7586-ce01-41ab-b0c5-b7dc96e8972a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1696 microversion: 2.1 time: 0.304701 Oct 27 09:52:00.371236 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3492/6915] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:52:00 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1696 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:52:01.149333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8af91df8-0616-496e-b4b6-1aebf5d58b13 req-9ea0f102-dce8-45df-a104-12d421f63a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97", "name": "network-vif-unplugged", "status": "completed", "tag": "c9b91c34-1868-43d3-bf87-2a055f05c867"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:52:01.165961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8af91df8-0616-496e-b4b6-1aebf5d58b13 req-9ea0f102-dce8-45df-a104-12d421f63a86 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:01.166928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8af91df8-0616-496e-b4b6-1aebf5d58b13 req-9ea0f102-dce8-45df-a104-12d421f63a86 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:01.168029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8af91df8-0616-496e-b4b6-1aebf5d58b13 req-9ea0f102-dce8-45df-a104-12d421f63a86 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:01.194248 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8af91df8-0616-496e-b4b6-1aebf5d58b13 req-9ea0f102-dce8-45df-a104-12d421f63a86 service nova] Creating event network-vif-unplugged:c9b91c34-1868-43d3-bf87-2a055f05c867 for instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 on n-h2-858383-16 Oct 27 09:52:01.208006 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8af91df8-0616-496e-b4b6-1aebf5d58b13 req-9ea0f102-dce8-45df-a104-12d421f63a86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066297 Oct 27 09:52:01.211520 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3424/6916] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:52:01.402475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:01.403757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:01.417455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:01.418474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:01.419819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:01.421873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:01.423162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:01.424277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:01.786820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:52:01.802919 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94aeb7ea-1cdc-47c3-8f9b-d5718142f4fc tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1681 microversion: 2.1 time: 0.409035 Oct 27 09:52:01.805208 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3493/6917] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:52:01 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1681 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:52:04.729866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-11e165e9-8666-4832-adb8-fa89c5bb9793 req-153846a0-5b0e-496d-ba84-7e7d415a6415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97", "name": "network-vif-plugged", "status": "completed", "tag": "c9b91c34-1868-43d3-bf87-2a055f05c867"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:52:04.752146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-11e165e9-8666-4832-adb8-fa89c5bb9793 req-153846a0-5b0e-496d-ba84-7e7d415a6415 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:04.752977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-11e165e9-8666-4832-adb8-fa89c5bb9793 req-153846a0-5b0e-496d-ba84-7e7d415a6415 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:04.753848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-11e165e9-8666-4832-adb8-fa89c5bb9793 req-153846a0-5b0e-496d-ba84-7e7d415a6415 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:04.783312 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-11e165e9-8666-4832-adb8-fa89c5bb9793 req-153846a0-5b0e-496d-ba84-7e7d415a6415 service nova] Creating event network-vif-plugged:c9b91c34-1868-43d3-bf87-2a055f05c867 for instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 on n-h2-858383-16 Oct 27 09:52:04.795228 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-11e165e9-8666-4832-adb8-fa89c5bb9793 req-153846a0-5b0e-496d-ba84-7e7d415a6415 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072220 Oct 27 09:52:04.797340 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3425/6918] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:52:34.146149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd170204-b6c5-4ac3-94e1-581cdd40d9c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:52:34.148900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd170204-b6c5-4ac3-94e1-581cdd40d9c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:34.160960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=20 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:34.172932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:34.183659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd170204-b6c5-4ac3-94e1-581cdd40d9c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:34.184637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd170204-b6c5-4ac3-94e1-581cdd40d9c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:34.185938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd170204-b6c5-4ac3-94e1-581cdd40d9c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:34.187347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd170204-b6c5-4ac3-94e1-581cdd40d9c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:34.188121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd170204-b6c5-4ac3-94e1-581cdd40d9c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:34.188736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd170204-b6c5-4ac3-94e1-581cdd40d9c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:34.273470 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd170204-b6c5-4ac3-94e1-581cdd40d9c5 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "POST /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97/action" status: 200 len: 24572 microversion: 2.1 time: 0.131201 Oct 27 09:52:34.275433 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3494/6919] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 09:52:34 2022] POST /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97/action => generated 24572 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:52:51.690096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:51.691508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:51.696976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0e1adc06-8f02-4c8f-a704-6c4db40c5fcc req-ff0e3ab1-edb2-4a0f-892c-cb0ced25a8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1ebed3-7b13-4e64-9896-dc4e4b477d4e", "tag": "cb263a86-61e1-4451-809f-213664e9ad74"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:52:51.698827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=16 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:51.699683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=40 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:51.701684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:51.702402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:51.702871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:51.703721 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:51.704544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:51.705005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:51.705476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:51.705807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:51.721550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0e1adc06-8f02-4c8f-a704-6c4db40c5fcc req-ff0e3ab1-edb2-4a0f-892c-cb0ced25a8cb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:51.725034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0e1adc06-8f02-4c8f-a704-6c4db40c5fcc req-ff0e3ab1-edb2-4a0f-892c-cb0ced25a8cb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:51.725712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0e1adc06-8f02-4c8f-a704-6c4db40c5fcc req-ff0e3ab1-edb2-4a0f-892c-cb0ced25a8cb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:51.740621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0e1adc06-8f02-4c8f-a704-6c4db40c5fcc req-ff0e3ab1-edb2-4a0f-892c-cb0ced25a8cb service nova] Creating event network-changed:cb263a86-61e1-4451-809f-213664e9ad74 for instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e on n-h1-858383-16 Oct 27 09:52:51.744290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:52:51.749521 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0e1adc06-8f02-4c8f-a704-6c4db40c5fcc req-ff0e3ab1-edb2-4a0f-892c-cb0ced25a8cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059261 Oct 27 09:52:51.750475 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3495/6920] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:52:51.875603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c08e829c-52e4-4a7c-9e69-8cea281b0781 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 204 len: 0 microversion: 2.1 time: 0.190049 Oct 27 09:52:51.877473 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3426/6921] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:52:51 2022] DELETE /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:52:51.895214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:51.897403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:51.911363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:51.913196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:51.914208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:51.916875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:51.918182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:51.919339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:52.242287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:52:52.254319 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f0df058-5ece-4a60-8627-5e6c3c934e29 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1579 microversion: 2.1 time: 0.368343 Oct 27 09:52:52.255667 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3496/6922] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:52:51 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1579 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:52:53.299014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:53.299765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:53.316045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:53.316561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:53.317023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:53.317773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:53.318244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:53.318702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:53.671447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:52:53.682803 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5cf94821-67e0-4451-aa37-d1bf69527e95 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1579 microversion: 2.1 time: 0.388705 Oct 27 09:52:53.684868 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3427/6923] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:52:53 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1579 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:52:54.719018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:54.719911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:54.728134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:54.728640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:54.729308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:54.730235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:54.730717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:54.731162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:55.137735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-440db4ea-4947-4241-a333-75a68220459e req-7a7b43a4-5010-42bc-aba9-cffe7a513fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1ebed3-7b13-4e64-9896-dc4e4b477d4e", "name": "network-vif-deleted", "tag": "cb263a86-61e1-4451-809f-213664e9ad74"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:52:55.139866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:52:55.153557 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-39c22414-f923-4383-977b-94f0b6b9a057 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1460 microversion: 2.1 time: 0.438423 Oct 27 09:52:55.163960 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3497/6924] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:52:54 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1460 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:52:55.180591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-440db4ea-4947-4241-a333-75a68220459e req-7a7b43a4-5010-42bc-aba9-cffe7a513fd1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:55.182190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-440db4ea-4947-4241-a333-75a68220459e req-7a7b43a4-5010-42bc-aba9-cffe7a513fd1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:55.184602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-440db4ea-4947-4241-a333-75a68220459e req-7a7b43a4-5010-42bc-aba9-cffe7a513fd1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:55.230616 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-440db4ea-4947-4241-a333-75a68220459e req-7a7b43a4-5010-42bc-aba9-cffe7a513fd1 service nova] Creating event network-vif-deleted:cb263a86-61e1-4451-809f-213664e9ad74 for instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e on n-h1-858383-16 Oct 27 09:52:55.240929 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-440db4ea-4947-4241-a333-75a68220459e req-7a7b43a4-5010-42bc-aba9-cffe7a513fd1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109333 Oct 27 09:52:55.242491 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3428/6925] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:52:56.184387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:56.185535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:56.197230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:56.198091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:56.198901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:56.200241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:56.201072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:56.203009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:56.362720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:52:56.373547 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-223fd39d-d68b-45a0-891f-a010850a4ef5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1225 microversion: 2.1 time: 0.197555 Oct 27 09:52:56.374152 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3498/6926] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:52:56 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1225 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:52:57.407147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:57.411245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:57.432616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:57.435256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:57.436780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:57.438575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:57.439782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:57.441685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:57.652679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:52:57.690706 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68fc3dea-388e-48c5-9a4d-f3eeb1cbb397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1225 microversion: 2.1 time: 0.289943 Oct 27 09:52:57.691486 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3429/6927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:52:57 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1225 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:52:58.724096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:58.725331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:58.739165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:58.740118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:58.741455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:58.742812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:58.743721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:58.744525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:58.879677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:52:58.896965 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0eb7672d-7585-4828-9b4b-b1c0326720a4 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1225 microversion: 2.1 time: 0.180419 Oct 27 09:52:58.926728 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3499/6928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:52:58 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1225 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:52:59.942076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:52:59.943851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:52:59.962340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:59.963457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:59.964640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:52:59.966710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:52:59.967761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:52:59.968823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:00.083306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:00.093026 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-16154312-71a7-4526-b9ac-facea0109f7e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1225 microversion: 2.1 time: 0.159554 Oct 27 09:53:00.093738 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3430/6929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:52:59 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1225 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:01.118656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:01.120099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:01.134175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:01.135034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:01.135736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:01.137434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:01.138402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:01.139299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:01.197368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:01.200076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:01.201528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:01.202698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lazy-loading 'fault' on Instance uuid 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:53:01.278478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:01.287609 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cdfdfe89-297f-4f30-9911-b5281b00413e tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 200 len: 1230 microversion: 2.1 time: 0.173960 Oct 27 09:53:01.288239 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3500/6930] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:01 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 1230 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:02.324096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:02.325967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:02.337712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:02.338598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:02.339308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:02.340610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:02.341430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:02.342192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:02.361995 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e could not be found. Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e HTTP/1.1 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e could not be found. Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '6f1ebed3-7b13-4e64-9896-dc4e4b477d4e'} Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e could not be found. Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e could not be found. Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:02.363990 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e could not be found. Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 6f1ebed3-7b13-4e64-9896-dc4e4b477d4e could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49109258-5189-428b-925b-c82645b59552 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e" status: 404 len: 111 microversion: 2.1 time: 0.047220 Oct 27 09:53:02.372439 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3431/6931] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:02 2022] GET /compute/v2.1/servers/6f1ebed3-7b13-4e64-9896-dc4e4b477d4e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:53:06.282164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:06.282164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:06.310572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:06.313035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:06.313972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:06.315336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:06.316237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:06.317048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:06.500061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:53:06.759191 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-71d09d61-ac3b-4f22-bdb3-9914687a954b tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 204 len: 0 microversion: 2.1 time: 0.488502 Oct 27 09:53:06.765300 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3501/6932] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:53:06 2022] DELETE /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:53:06.807854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d9bad211-f6e1-47aa-b127-0fd0909e261b req-fdcdbb77-7e56-4723-820d-e2084f04c9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97", "tag": "c9b91c34-1868-43d3-bf87-2a055f05c867"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:53:06.812347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:06.813253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:06.829273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:06.832099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d9bad211-f6e1-47aa-b127-0fd0909e261b req-fdcdbb77-7e56-4723-820d-e2084f04c9b5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:06.832856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:06.833564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:06.835270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:06.835813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:06.836266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:06.837847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d9bad211-f6e1-47aa-b127-0fd0909e261b req-fdcdbb77-7e56-4723-820d-e2084f04c9b5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:06.838352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d9bad211-f6e1-47aa-b127-0fd0909e261b req-fdcdbb77-7e56-4723-820d-e2084f04c9b5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:06.866239 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d9bad211-f6e1-47aa-b127-0fd0909e261b req-fdcdbb77-7e56-4723-820d-e2084f04c9b5 service nova] Creating event network-changed:c9b91c34-1868-43d3-bf87-2a055f05c867 for instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 on n-h2-858383-16 Oct 27 09:53:06.880163 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d9bad211-f6e1-47aa-b127-0fd0909e261b req-fdcdbb77-7e56-4723-820d-e2084f04c9b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.574640 Oct 27 09:53:06.884721 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3432/6933] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:53:07.070034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:07.078977 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3920eeff-8d0f-4f70-9823-f92be7498a01 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1687 microversion: 2.1 time: 0.302019 Oct 27 09:53:07.079607 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3502/6934] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:06 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1687 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:08.137698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:08.141758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:08.178361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:08.178977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:08.179431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:08.181531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:08.182026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:08.182467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:08.524343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:08.561566 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3984d16a-4740-40e5-b972-90f6f1ceab0a tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1687 microversion: 2.1 time: 0.445700 Oct 27 09:53:08.563294 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3433/6935] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:08 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1687 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:09.162364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-06eafe45-8bb7-47a7-9b82-bdf4eaa21f7e req-3b853b5f-fb94-4515-a3ca-d30adbeda522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97", "name": "network-vif-deleted", "tag": "c9b91c34-1868-43d3-bf87-2a055f05c867"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:53:09.173931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06eafe45-8bb7-47a7-9b82-bdf4eaa21f7e req-3b853b5f-fb94-4515-a3ca-d30adbeda522 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:09.174445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06eafe45-8bb7-47a7-9b82-bdf4eaa21f7e req-3b853b5f-fb94-4515-a3ca-d30adbeda522 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:09.174905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-06eafe45-8bb7-47a7-9b82-bdf4eaa21f7e req-3b853b5f-fb94-4515-a3ca-d30adbeda522 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:09.189493 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-06eafe45-8bb7-47a7-9b82-bdf4eaa21f7e req-3b853b5f-fb94-4515-a3ca-d30adbeda522 service nova] Creating event network-vif-deleted:c9b91c34-1868-43d3-bf87-2a055f05c867 for instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 on n-h2-858383-16 Oct 27 09:53:09.197744 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-06eafe45-8bb7-47a7-9b82-bdf4eaa21f7e req-3b853b5f-fb94-4515-a3ca-d30adbeda522 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038947 Oct 27 09:53:09.198528 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3503/6936] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:53:09.590624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:09.592163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:09.603121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:09.603923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:09.604684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:09.605600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:09.606070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:09.606800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:09.650460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:09.650958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:09.651779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:09.652426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lazy-loading 'fault' on Instance uuid 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:53:09.724231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d83fee6e4854240b13a10c262453b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fdcfbb223c44e693f100b3717522cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:09.741206 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-167d6cf9-88d0-49d2-a0e6-5b6df22fac77 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 200 len: 1355 microversion: 2.1 time: 0.154876 Oct 27 09:53:09.742723 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3434/6937] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:09 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 1355 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:53:10.789516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:10.792071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [instance: 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:10.804031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:10.805034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:10.806241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:10.808020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:10.809006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:10.809921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:10.836698 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] HTTP exception thrown: Instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 could not be found. Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Request method failure captured: Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 HTTP/1.1 Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlJDSDr1-dsqc3eIUxJ-ieGNeGuhoA4wiY87ragx5kgzDbmJPZslaWdKO1pfCvcYDg6uLTzYhdhl4rSHxTWFf8hu3m-L8rwhHSJeogWLh_KnZWQIRCt2iFkzdspz6TyfdjSpyMD7SVxi8wkEcfqhvYbzSnsfNPvnknwpLkoqydKNQL4 Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: f7fdcfbb223c44e693f100b3717522cf Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fdcfbb223c44e693f100b3717522cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7fdcfbb223c44e693f100b3717522cf"}]}] Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: f7fdcfbb223c44e693f100b3717522cf Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-476394632 Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestNetworkAdvancedServerOps-476394632-project Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0d83fee6e4854240b13a10c262453b32 Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestNetworkAdvancedServerOps-476394632-project Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 could not be found. Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97'} Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 could not be found. Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 could not be found. Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:10.839037 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:10.844555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:10.844555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:10.844555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:10.844555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:10.844555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:53:10.844555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:53:10.844555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 could not be found. Oct 27 09:53:10.844555 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:10.844555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Returning 404 to user: Instance 8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:53:10.846549 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94797631-de0b-425a-97ad-93d39d5c89ce tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97" status: 404 len: 111 microversion: 2.1 time: 0.065206 Oct 27 09:53:10.851891 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3504/6938] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:10 2022] GET /compute/v2.1/servers/8e4c9dd9-8c1d-4ee3-8881-953d6b69ed97 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:53:12.276360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:12.281087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:12.300265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:12.312518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c28821e4-9cec-454c-9b8d-1c02fda4ab1e req-c51211f7-81bf-4ba3-91b0-45a3b1c3c88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a429296e-3a2f-42ac-bd45-52304aaa316a", "tag": "ec70b13d-e76c-47fa-8e13-66eafb779873"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:53:12.315472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:12.316133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:12.324628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:12.327996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:12.329319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:12.394389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c28821e4-9cec-454c-9b8d-1c02fda4ab1e req-c51211f7-81bf-4ba3-91b0-45a3b1c3c88d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:12.398268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c28821e4-9cec-454c-9b8d-1c02fda4ab1e req-c51211f7-81bf-4ba3-91b0-45a3b1c3c88d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:12.402036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c28821e4-9cec-454c-9b8d-1c02fda4ab1e req-c51211f7-81bf-4ba3-91b0-45a3b1c3c88d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:12.445406 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c28821e4-9cec-454c-9b8d-1c02fda4ab1e req-c51211f7-81bf-4ba3-91b0-45a3b1c3c88d service nova] Creating event network-changed:ec70b13d-e76c-47fa-8e13-66eafb779873 for instance a429296e-3a2f-42ac-bd45-52304aaa316a on n-h1-858383-16 Oct 27 09:53:12.456646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:53:12.478485 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c28821e4-9cec-454c-9b8d-1c02fda4ab1e req-c51211f7-81bf-4ba3-91b0-45a3b1c3c88d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172231 Oct 27 09:53:12.479219 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3505/6939] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:53:12.654333 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c26b8c54-f0c0-4c53-beff-58342dec0bd6 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 204 len: 0 microversion: 2.1 time: 0.386901 Oct 27 09:53:12.655796 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3435/6940] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:53:12 2022] DELETE /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:53:12.691861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:12.697241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:12.720755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:12.722202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:12.723041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:12.725052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:12.727916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:12.729838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:12.988067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:13.001936 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94a2838b-7255-43a7-9221-786accc590ca tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1578 microversion: 2.1 time: 0.335687 Oct 27 09:53:13.002791 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3506/6941] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:12 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1578 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:53:14.043821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:14.044648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:14.059850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:14.060838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:14.061596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:14.062753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:14.063791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:14.064682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:14.540356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:14.550033 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-47b84807-6c62-4a43-a2cf-f4a78079b84c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1578 microversion: 2.1 time: 0.510837 Oct 27 09:53:14.557026 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3436/6942] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:14 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1578 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:15.585168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:15.594824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:15.612619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:15.613201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:15.613766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:15.617846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:15.621519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:15.622973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:15.744058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:15.754865 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-098635ed-ffcf-4fff-b51f-76b7a2ec186a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1391 microversion: 2.1 time: 0.176385 Oct 27 09:53:15.756830 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3507/6943] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:15 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:15.821100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-49c0e0c2-5187-4717-a308-f4170c472b36 req-61d17310-7a12-47a8-8ea0-09f41aad9651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a429296e-3a2f-42ac-bd45-52304aaa316a", "name": "network-vif-deleted", "tag": "ec70b13d-e76c-47fa-8e13-66eafb779873"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:53:15.843080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-49c0e0c2-5187-4717-a308-f4170c472b36 req-61d17310-7a12-47a8-8ea0-09f41aad9651 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:15.843898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-49c0e0c2-5187-4717-a308-f4170c472b36 req-61d17310-7a12-47a8-8ea0-09f41aad9651 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:15.844908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-49c0e0c2-5187-4717-a308-f4170c472b36 req-61d17310-7a12-47a8-8ea0-09f41aad9651 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:15.870097 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-49c0e0c2-5187-4717-a308-f4170c472b36 req-61d17310-7a12-47a8-8ea0-09f41aad9651 service nova] Creating event network-vif-deleted:ec70b13d-e76c-47fa-8e13-66eafb779873 for instance a429296e-3a2f-42ac-bd45-52304aaa316a on n-h1-858383-16 Oct 27 09:53:15.880008 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-49c0e0c2-5187-4717-a308-f4170c472b36 req-61d17310-7a12-47a8-8ea0-09f41aad9651 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064764 Oct 27 09:53:15.882099 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3437/6944] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:53:16.790078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:16.796132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:16.829113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:16.830030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:16.831192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:16.833101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:16.834857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:16.835980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:17.031943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:17.062134 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa9d8ffe-717d-4334-a5c6-536532ba5397 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1225 microversion: 2.1 time: 0.284743 Oct 27 09:53:17.065027 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3508/6945] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:16 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1225 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:17.888104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88a84cfd-eb30-439e-9e86-99bc9882d3a9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] Calling method '.version_select at 0x7f31aa8493a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:17.893165 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [None req-88a84cfd-eb30-439e-9e86-99bc9882d3a9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [12add418-71b3-44ec-8361-2be2532364fd] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 09:53:18.092735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:18.094061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:18.107786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:18.109095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:18.110010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:18.111497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:18.112695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:18.113506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:18.227613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:18.245467 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-151ac0c3-5350-403b-92c6-00357345efe1 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1225 microversion: 2.1 time: 0.159704 Oct 27 09:53:18.247201 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3509/6946] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:18 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1225 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:18.919935 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [None req-88a84cfd-eb30-439e-9e86-99bc9882d3a9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] [12add418-71b3-44ec-8361-2be2532364fd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58140. Oct 27 09:53:18.957344 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88a84cfd-eb30-439e-9e86-99bc9882d3a9 tempest-TestNetworkAdvancedServerOps-476394632 tempest-TestNetworkAdvancedServerOps-476394632-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-33215108" status: 202 len: 0 microversion: 2.1 time: 1.074619 Oct 27 09:53:18.959150 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3438/6947] 10.222.0.25 () {58 vars in 1278 bytes} [Thu Oct 27 09:53:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-33215108 => generated 0 bytes in 1077 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:53:19.284488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:19.285733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:19.299312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:19.300982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:19.304099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:19.305934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:19.307122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:19.308251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:19.456650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:19.476819 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b42dcb87-2f9d-47a0-bda2-1c21676283e8 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1225 microversion: 2.1 time: 0.197431 Oct 27 09:53:19.479080 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3510/6948] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:19 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1225 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:53:20.535990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:20.541164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:20.563281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:20.564796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:20.566053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:20.567978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:20.569669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:20.570476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:20.700350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:20.724574 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-28f8c5b3-8460-425c-9262-cbf82f345d1b tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1225 microversion: 2.1 time: 0.203796 Oct 27 09:53:20.725280 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3439/6949] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:20 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1225 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:21.776562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:21.779732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:21.785453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:21.803517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:21.804822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:21.805943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:21.808171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:21.809776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:21.811103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:21.822266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:21.939411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab30747d0444c32bbc058a522262b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4e16a0d19b4decbfe0ac60397b4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:21.956404 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e36c3454-fffb-40bb-8a9f-d04887f0c3fb tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 200 len: 1225 microversion: 2.1 time: 0.192755 Oct 27 09:53:21.959904 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3511/6950] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:21 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 1225 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:23.009614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:23.011278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: a429296e-3a2f-42ac-bd45-52304aaa316a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:23.015715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:23.024614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:23.025538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:23.026404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:23.027692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:23.028281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:23.028923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:23.034739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:23.068483 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance a429296e-3a2f-42ac-bd45-52304aaa316a could not be found. Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a HTTP/1.1 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance a429296e-3a2f-42ac-bd45-52304aaa316a could not be found. Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'a429296e-3a2f-42ac-bd45-52304aaa316a'} Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a429296e-3a2f-42ac-bd45-52304aaa316a could not be found. Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a429296e-3a2f-42ac-bd45-52304aaa316a could not be found. Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:23.070784 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.076380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:23.076380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:23.076380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:23.076380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:53:23.076380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:53:23.076380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a429296e-3a2f-42ac-bd45-52304aaa316a could not be found. Oct 27 09:53:23.076380 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.079822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance a429296e-3a2f-42ac-bd45-52304aaa316a could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:53:23.081451 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-861e9f8c-3463-433d-9d39-8631c9dfc539 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a" status: 404 len: 111 microversion: 2.1 time: 0.081036 Oct 27 09:53:23.086558 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3440/6951] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:22 2022] GET /compute/v2.1/servers/a429296e-3a2f-42ac-bd45-52304aaa316a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:53:23.889253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:23.891118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:23.905998 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:53:23.906476 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 09:53:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c (ip 10.222.0.25) !!! Oct 27 09:53:23.910817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:23.912633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:23.913792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:23.915647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:23.916825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:23.917938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:23.959126 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c HTTP/1.1 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '4e14bab2-c5b6-42c5-8498-b885f872e12c'} Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:53:23.961303 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e3f793eb-3a9a-4beb-a6d7-2250cbb57e9c tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 404 len: 111 microversion: 2.1 time: 0.087409 Oct 27 09:53:23.970725 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3512/6952] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:53:23 2022] DELETE /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:53:23.987409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:23.988633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] [instance: 4e14bab2-c5b6-42c5-8498-b885f872e12c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:24.008540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:24.009678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:24.010644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:24.015917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:24.017047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:24.018081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:24.062068 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] HTTP exception thrown: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Request method failure captured: Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c HTTP/1.1 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlIN3AAJSIYSF9Gesw3aRZJ7iSKIKiWt_ARpT8bgP5x0nSj3XABP-rxt_y6v8wz6wE7SsR6H8pyzO3uJ1X89ph-s4Gl6pTeZkeS3Biansb6jyHMEaxabVquRzHsCwK-r2wF683e87rXxo6qljA2euwmgUc6f4oWhkrR2nTvCkzBm20k Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f4e16a0d19b4decbfe0ac60397b4113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f4e16a0d19b4decbfe0ac60397b4113"}]}] Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 0f4e16a0d19b4decbfe0ac60397b4113 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1205606377 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 9ab30747d0444c32bbc058a522262b62 Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-1205606377-project Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '4e14bab2-c5b6-42c5-8498-b885f872e12c'} Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:53:24.065166 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:24.073896 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:53:24.073896 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:53:24.073896 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:53:24.073896 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:53:24.073896 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:53:24.073896 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. Oct 27 09:53:24.073896 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:53:24.091663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Returning 404 to user: Instance 4e14bab2-c5b6-42c5-8498-b885f872e12c could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:53:24.099784 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1536dfc6-0f56-4158-8b66-06726888ae7a tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c" status: 404 len: 111 microversion: 2.1 time: 0.121369 Oct 27 09:53:24.105573 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3441/6953] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:23 2022] GET /compute/v2.1/servers/4e14bab2-c5b6-42c5-8498-b885f872e12c => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:53:29.473315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59671793-4f57-45c6-a6ea-82685958a4b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] Calling method '.version_select at 0x7f31a949f3a0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:29.563073 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59671793-4f57-45c6-a6ea-82685958a4b5 tempest-TestVolumeBootPattern-1205606377 tempest-TestVolumeBootPattern-1205606377-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2030933275" status: 202 len: 0 microversion: 2.1 time: 0.099634 Oct 27 09:53:29.565712 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3513/6954] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Oct 27 09:53:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2030933275 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:53:43.382353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:43.385309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:43.750949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c182b4e-c63d-46ad-b2ab-2bd6bf1ed1fe tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Action: 'create', calling method: .version_select at 0x7f31aa25ab80>, body: {"keypair": {"name": "tempest-TestServerBasicOps-886297882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwq/LHECy753nvkJgNWmdiDMoO0t28of/ZrO7mTne2YanDqOr4TDHfYNwOsKulz7W1J6Es3K2VoCYzywo0CBwICqv41AO5ey4kxGfZ+qPGJmOF+mqxMSjsZByF/lmNi8Q=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:53:43.798986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-7c182b4e-c63d-46ad-b2ab-2bd6bf1ed1fe tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Getting quotas for project fd49360ffb8b4070811314f81fe865aa. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:53:43.808378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-7c182b4e-c63d-46ad-b2ab-2bd6bf1ed1fe tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Getting quotas for user 478a3f9b954a4c2c9ff0072093d20d1f and project fd49360ffb8b4070811314f81fe865aa. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:53:43.869381 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c182b4e-c63d-46ad-b2ab-2bd6bf1ed1fe tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.493134 Oct 27 09:53:43.870680 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3442/6955] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 09:53:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:53:47.076253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=7 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:47.080746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:47.093235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1425471478", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-886297882", "security_groups": [{"name": "tempest-secgroup-smoke-749843490"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "9bf41fbc-1411-4338-b3ef-c0663111716a"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:53:47.393025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] validate_networks() for [('9bf41fbc-1411-4338-b3ef-c0663111716a', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:53:48.930016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Getting quotas for project fd49360ffb8b4070811314f81fe865aa. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:53:48.939284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Getting quotas for user 478a3f9b954a4c2c9ff0072093d20d1f and project fd49360ffb8b4070811314f81fe865aa. Resources: dict_keys(['metadata_items']) {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:53:48.958357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:53:48.958967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:53:48.959910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:53:48.960605 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:53:48.961376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:53:48.975361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:48.975908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:48.976401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:48.977194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:48.977693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:48.978192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:49.000417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Getting quotas for project fd49360ffb8b4070811314f81fe865aa. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:53:49.010064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Getting quotas for user 478a3f9b954a4c2c9ff0072093d20d1f and project fd49360ffb8b4070811314f81fe865aa. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:53:49.029958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:53:49.032983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:53:49.099104 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9e21065-a7c2-4ca2-b44d-5ff76666c1cb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.025387 Oct 27 09:53:49.101349 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3514/6956] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:53:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:53:49.118443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e1fa71a-be5c-4c51-9237-fd7b12b4e4a0 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:49.119283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e1fa71a-be5c-4c51-9237-fd7b12b4e4a0 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:49.126479 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:53:49.128538 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 09:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 (ip 10.222.0.25) !!! Oct 27 09:53:49.348271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3e1fa71a-be5c-4c51-9237-fd7b12b4e4a0 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:49.359740 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e1fa71a-be5c-4c51-9237-fd7b12b4e4a0 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1302 microversion: 2.1 time: 0.245350 Oct 27 09:53:49.363238 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3443/6957] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:49 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1302 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:50.409193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cdae865c-159c-4d30-8c5f-5149822df127 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:50.410657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cdae865c-159c-4d30-8c5f-5149822df127 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:50.524960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cdae865c-159c-4d30-8c5f-5149822df127 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:50.543345 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cdae865c-159c-4d30-8c5f-5149822df127 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1302 microversion: 2.1 time: 0.140403 Oct 27 09:53:50.545378 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3515/6958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:50 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1302 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:51.570767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:51.571399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:51.581922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:51.582434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:51.584822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:51.585593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:51.587285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:51.587766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:51.773204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:51.804880 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60ed78be-640c-450f-9baa-39ff9b78db4f tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1362 microversion: 2.1 time: 0.238665 Oct 27 09:53:51.806114 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3444/6959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:51 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:52.859052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:52.862775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:52.883636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:52.900169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:52.901863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:52.903419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:52.904612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:52.905715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:53.306003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:53.317434 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7abae348-6cd5-4e8d-94ea-89012b39a941 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1427 microversion: 2.1 time: 0.465606 Oct 27 09:53:53.334468 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3516/6960] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:52 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1427 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:53.979989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9ddf209b-2381-4ab5-83f2-1f636a519ecb req-c8d19609-3b8c-4e5e-9a10-bac4d75d6fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484f46d1-0ee8-489b-84f6-dab4960dd9d0", "tag": "aa44d6eb-3f2a-4078-a029-e82f2e8f616f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:53:53.992657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9ddf209b-2381-4ab5-83f2-1f636a519ecb req-c8d19609-3b8c-4e5e-9a10-bac4d75d6fb7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:53.993261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9ddf209b-2381-4ab5-83f2-1f636a519ecb req-c8d19609-3b8c-4e5e-9a10-bac4d75d6fb7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:53.993787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9ddf209b-2381-4ab5-83f2-1f636a519ecb req-c8d19609-3b8c-4e5e-9a10-bac4d75d6fb7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:54.009382 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9ddf209b-2381-4ab5-83f2-1f636a519ecb req-c8d19609-3b8c-4e5e-9a10-bac4d75d6fb7 service nova] Creating event network-changed:aa44d6eb-3f2a-4078-a029-e82f2e8f616f for instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 on n-h2-858383-16 Oct 27 09:53:54.015267 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9ddf209b-2381-4ab5-83f2-1f636a519ecb req-c8d19609-3b8c-4e5e-9a10-bac4d75d6fb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041468 Oct 27 09:53:54.018566 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3445/6961] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:53:54.371989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:54.372922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:54.381289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:54.382137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:54.382831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:54.383826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:54.384382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:54.385029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:54.685996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:54.697692 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf042584-6787-40d5-bcaa-16ecedd22c3c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1427 microversion: 2.1 time: 0.329618 Oct 27 09:53:54.699142 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3517/6962] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:54 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1427 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:55.742423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:55.743215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:55.751898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:55.752734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:55.753462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:55.754653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:55.755833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:55.756560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:56.001971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:56.018131 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-05015ddd-d6cc-4b1d-a179-da0a38c6c2bb tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1427 microversion: 2.1 time: 0.283170 Oct 27 09:53:56.019351 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3446/6963] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:55 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1427 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:57.065683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:57.067167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:57.087967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:57.092321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:57.093406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:57.095357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:57.096431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:57.097364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:57.411864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:57.426718 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91382598-687b-476c-b057-6fe7edf55956 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1427 microversion: 2.1 time: 0.368716 Oct 27 09:53:57.428183 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3518/6964] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:57 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1427 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:53:58.468121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:58.469129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:58.478744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:58.479470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:58.480123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:58.481232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:58.481827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:58.482361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:58.676262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:58.693891 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c36cf751-ab68-470a-995b-7475f0e8f5dc tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1427 microversion: 2.1 time: 0.231851 Oct 27 09:53:58.694988 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3447/6965] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:58 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1427 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:53:59.723008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:53:59.723860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:53:59.726912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:59.733960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:59.734477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:59.735294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:59.736255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:53:59.737046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:53:59.737339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:53:59.966665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:53:59.985214 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64c1fcbb-10ab-4ece-8223-e83e80efcecf tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1427 microversion: 2.1 time: 0.266153 Oct 27 09:53:59.986119 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3519/6966] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:53:59 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1427 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:54:01.034525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:54:01.035728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:54:01.040158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:01.053059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:01.054687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:01.055532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:01.056906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:01.057744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:01.059358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:01.184420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:01.244164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:54:01.258360 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a806e16-1151-4335-80e2-1b08b8653a71 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1427 microversion: 2.1 time: 0.231253 Oct 27 09:54:01.259620 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3448/6967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:54:01 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1427 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:54:01.411743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-7317e3e6-de28-4b64-8eae-0cdf5bf4d06d req-67b0be36-404c-4218-9ab1-c888ed48f77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484f46d1-0ee8-489b-84f6-dab4960dd9d0", "name": "network-vif-plugged", "status": "completed", "tag": "aa44d6eb-3f2a-4078-a029-e82f2e8f616f"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:54:01.421732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7317e3e6-de28-4b64-8eae-0cdf5bf4d06d req-67b0be36-404c-4218-9ab1-c888ed48f77f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:01.422489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7317e3e6-de28-4b64-8eae-0cdf5bf4d06d req-67b0be36-404c-4218-9ab1-c888ed48f77f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:01.423158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-7317e3e6-de28-4b64-8eae-0cdf5bf4d06d req-67b0be36-404c-4218-9ab1-c888ed48f77f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:01.438032 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-7317e3e6-de28-4b64-8eae-0cdf5bf4d06d req-67b0be36-404c-4218-9ab1-c888ed48f77f service nova] Creating event network-vif-plugged:aa44d6eb-3f2a-4078-a029-e82f2e8f616f for instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 on n-h2-858383-16 Oct 27 09:54:01.447024 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-7317e3e6-de28-4b64-8eae-0cdf5bf4d06d req-67b0be36-404c-4218-9ab1-c888ed48f77f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271631 Oct 27 09:54:01.447839 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3520/6968] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:54:02.300048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:54:02.301059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:54:02.309760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:02.310370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:02.311044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:02.312016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:02.312685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:02.313243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:02.542349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:54:02.552001 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab9f4edd-ccb2-4ade-b6a6-9dd550fb0955 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1427 microversion: 2.1 time: 0.255728 Oct 27 09:54:02.553060 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3449/6969] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:54:02 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1427 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:54:03.577739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:54:03.578566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:54:03.585319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:03.585833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:03.586304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:03.587057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:03.587532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:03.588019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:03.737514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:54:03.746338 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-13374c0a-5e38-47c0-b1ad-269181b03529 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1607 microversion: 2.1 time: 0.174258 Oct 27 09:54:03.746932 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3521/6970] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:54:03 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1607 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:54:03.769103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:54:03.769683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:54:03.777521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:03.778027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:03.778474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:03.779202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:03.779719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:03.780204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:03.934324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:54:03.943181 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-93a4cb2e-24c3-4f76-8a1b-196c86e3fb7e tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1607 microversion: 2.1 time: 0.178021 Oct 27 09:54:03.943859 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3450/6971] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:54:03 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1607 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:54:03.981414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:54:03.982057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:54:03.988846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:03.989356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:03.989815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:03.990542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:03.991012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:03.991453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:04.182796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:54:04.191536 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ab4c8775-240b-48fe-99c5-eac9b31896b7 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1607 microversion: 2.1 time: 0.214046 Oct 27 09:54:04.192192 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3522/6972] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:54:03 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1607 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:54:07.117739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-abdd45bb-4640-47a6-b5e2-057239da357f req-cb792428-85bb-4148-adf1-c78794fb12f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484f46d1-0ee8-489b-84f6-dab4960dd9d0", "tag": "aa44d6eb-3f2a-4078-a029-e82f2e8f616f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:54:07.138251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-abdd45bb-4640-47a6-b5e2-057239da357f req-cb792428-85bb-4148-adf1-c78794fb12f5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:54:07.139177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-abdd45bb-4640-47a6-b5e2-057239da357f req-cb792428-85bb-4148-adf1-c78794fb12f5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:54:07.140051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-abdd45bb-4640-47a6-b5e2-057239da357f req-cb792428-85bb-4148-adf1-c78794fb12f5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:54:07.165135 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-abdd45bb-4640-47a6-b5e2-057239da357f req-cb792428-85bb-4148-adf1-c78794fb12f5 service nova] Creating event network-changed:aa44d6eb-3f2a-4078-a029-e82f2e8f616f for instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 on n-h2-858383-16 Oct 27 09:54:07.174448 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-abdd45bb-4640-47a6-b5e2-057239da357f req-cb792428-85bb-4148-adf1-c78794fb12f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063998 Oct 27 09:54:07.176059 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3451/6973] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:55:35.691941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:35.693308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=40 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:35.700052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0fa92244-c776-47b2-a860-33e069a7a2ca tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:55:35.700763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0fa92244-c776-47b2-a860-33e069a7a2ca tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:55:35.710062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fa92244-c776-47b2-a860-33e069a7a2ca tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:55:35.710685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fa92244-c776-47b2-a860-33e069a7a2ca tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:55:35.711256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fa92244-c776-47b2-a860-33e069a7a2ca tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:55:35.712292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fa92244-c776-47b2-a860-33e069a7a2ca tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:55:35.713044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fa92244-c776-47b2-a860-33e069a7a2ca tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:55:35.713828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fa92244-c776-47b2-a860-33e069a7a2ca tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:55:35.747092 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0fa92244-c776-47b2-a860-33e069a7a2ca tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.058614 Oct 27 09:55:35.748449 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3523/6974] 10.222.0.25 () {58 vars in 1293 bytes} [Thu Oct 27 09:55:35 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0/os-server-password => generated 116 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:56:21.306329 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 09:56:21.309074 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 09:56:21.309900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:21.311048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=40 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:21.313051 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 09:56:21.313745 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 09:56:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 27 09:56:21.316985 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 09:56:21.317216 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 09:56:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 27 09:56:21.333706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-374432319", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:56:21.709680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:56:22.038047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:56:22.038782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:56:22.039699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:56:22.040481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:56:22.041205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:56:22.057638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:22.058524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:22.059302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:22.060653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:22.061463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:22.062236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:22.097472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Getting quotas for project d148b01c17b14c55a9afe326d2335d9a. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:56:22.108011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Getting quotas for user e1f400d179f544ecba3f591dd9bf299e and project d148b01c17b14c55a9afe326d2335d9a. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:56:22.132731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:56:22.137254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:56:22.215646 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70773db7-bc3c-4577-9559-5b34dd46f2ec tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912601 Oct 27 09:56:22.216568 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3452/6975] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 09:56:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:56:22.229578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-15b5845d-9b14-4099-9123-7aadb169b11a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:22.230303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15b5845d-9b14-4099-9123-7aadb169b11a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:22.233721 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 09:56:22.234322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:22.235180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:22.440711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-15b5845d-9b14-4099-9123-7aadb169b11a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:22.448108 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-15b5845d-9b14-4099-9123-7aadb169b11a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1213 microversion: 2.1 time: 0.223108 Oct 27 09:56:22.448714 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3524/6976] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:22 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1213 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:23.475692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-856620d3-ba3c-4d90-8046-4c8aa0959114 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:23.476512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-856620d3-ba3c-4d90-8046-4c8aa0959114 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:23.493108 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 32916. Oct 27 09:56:23.497746 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 32918. Oct 27 09:56:23.544942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-856620d3-ba3c-4d90-8046-4c8aa0959114 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:23.553548 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-856620d3-ba3c-4d90-8046-4c8aa0959114 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1213 microversion: 2.1 time: 0.085808 Oct 27 09:56:23.554160 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3453/6977] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:23 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:24.585825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7eec5776-e86d-4258-9ffe-4f530fbd6bcf tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:24.586957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7eec5776-e86d-4258-9ffe-4f530fbd6bcf tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:24.611993 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 32926. Oct 27 09:56:24.670794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7eec5776-e86d-4258-9ffe-4f530fbd6bcf tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:24.681422 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7eec5776-e86d-4258-9ffe-4f530fbd6bcf tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1213 microversion: 2.1 time: 0.103188 Oct 27 09:56:24.682223 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3525/6978] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:24 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:25.718926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b97afd3-98ed-45e6-a73a-74ca483c9ea1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:25.719618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b97afd3-98ed-45e6-a73a-74ca483c9ea1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:25.788190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b97afd3-98ed-45e6-a73a-74ca483c9ea1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:25.800796 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b97afd3-98ed-45e6-a73a-74ca483c9ea1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1213 microversion: 2.1 time: 0.086111 Oct 27 09:56:25.812340 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3454/6979] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:25 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:26.842824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:26.843485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:26.851063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:26.851599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:26.852076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:26.852831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:26.853317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:26.853768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:26.966979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:26.981795 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6494ad10-f1eb-4adc-abe5-1ff1478b795d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1271 microversion: 2.1 time: 0.143216 Oct 27 09:56:26.982935 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3526/6980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:26 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:28.030399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:28.032704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:28.046545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:28.047266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:28.047915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:28.048832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:28.049555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:28.050353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:28.318970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:28.343357 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0deefb40-0592-47b5-85f3-b86df47c4930 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1313 microversion: 2.1 time: 0.322110 Oct 27 09:56:28.357417 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3455/6981] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:28 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:28.993319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1d3827c5-7daf-478a-a9ed-c1a17395046b req-bfa934cc-32f8-49cd-885f-df1bee4b9451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73240325-2e4b-40ca-8039-c75a41f13250", "tag": "fb986533-bccc-4318-9224-3e8fca473fd0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:56:29.013531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1d3827c5-7daf-478a-a9ed-c1a17395046b req-bfa934cc-32f8-49cd-885f-df1bee4b9451 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:29.014795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1d3827c5-7daf-478a-a9ed-c1a17395046b req-bfa934cc-32f8-49cd-885f-df1bee4b9451 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:29.015633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1d3827c5-7daf-478a-a9ed-c1a17395046b req-bfa934cc-32f8-49cd-885f-df1bee4b9451 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:29.033774 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1d3827c5-7daf-478a-a9ed-c1a17395046b req-bfa934cc-32f8-49cd-885f-df1bee4b9451 service nova] Creating event network-changed:fb986533-bccc-4318-9224-3e8fca473fd0 for instance 73240325-2e4b-40ca-8039-c75a41f13250 on n-h1-858383-16 Oct 27 09:56:29.041294 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1d3827c5-7daf-478a-a9ed-c1a17395046b req-bfa934cc-32f8-49cd-885f-df1bee4b9451 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054702 Oct 27 09:56:29.043523 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3527/6982] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:56:29.369719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:29.370538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:29.380228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:29.380827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:29.381568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:29.382539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:29.383162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:29.383854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:29.670660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:29.685707 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d586411-cee0-4ec5-bc1d-e6591c1b09de tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1313 microversion: 2.1 time: 0.320726 Oct 27 09:56:29.686341 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3456/6983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:29 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:56:30.712691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:30.713783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:30.721610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:30.722122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:30.722571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:30.723308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:30.723808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:30.724258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:30.879424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:30.888090 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c6a3433-93e5-442d-b5ea-a80a3cc8076b tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1313 microversion: 2.1 time: 0.180794 Oct 27 09:56:30.888835 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3528/6984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:30 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:31.912703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:31.913476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:31.921439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:31.921938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:31.922441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:31.923186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:31.923686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:31.924125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:32.073751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:32.279656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:32.290661 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec97c2a0-404d-4ee9-9a6f-1666eb38b67a tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1313 microversion: 2.1 time: 0.381716 Oct 27 09:56:32.291816 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3457/6985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:31 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:33.319384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:33.320089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:33.327895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:33.328416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:33.329217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:33.329964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:33.330448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:33.331184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:33.493636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:33.503972 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4164fbea-8470-4998-a7c4-65bdb0752b72 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1313 microversion: 2.1 time: 0.188113 Oct 27 09:56:33.505032 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3529/6986] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:33 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:34.534433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:34.535333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:34.544093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:34.544972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:34.545776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:34.548605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:34.549446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:34.550290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:34.731646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:34.740867 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee24164b-81ff-488b-9f1c-426f302f1640 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1313 microversion: 2.1 time: 0.211338 Oct 27 09:56:34.741547 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3458/6987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:34 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:35.703521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3776143b-2194-4322-ba2c-c6c0ed3c0038 req-b7b67265-a5ca-45ac-9c80-50d9eb6aed73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73240325-2e4b-40ca-8039-c75a41f13250", "name": "network-vif-plugged", "status": "completed", "tag": "fb986533-bccc-4318-9224-3e8fca473fd0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:56:35.712705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:35.723186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3776143b-2194-4322-ba2c-c6c0ed3c0038 req-b7b67265-a5ca-45ac-9c80-50d9eb6aed73 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:35.723817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3776143b-2194-4322-ba2c-c6c0ed3c0038 req-b7b67265-a5ca-45ac-9c80-50d9eb6aed73 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:35.724365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3776143b-2194-4322-ba2c-c6c0ed3c0038 req-b7b67265-a5ca-45ac-9c80-50d9eb6aed73 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:35.739323 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3776143b-2194-4322-ba2c-c6c0ed3c0038 req-b7b67265-a5ca-45ac-9c80-50d9eb6aed73 service nova] Creating event network-vif-plugged:fb986533-bccc-4318-9224-3e8fca473fd0 for instance 73240325-2e4b-40ca-8039-c75a41f13250 on n-h1-858383-16 Oct 27 09:56:35.747523 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3776143b-2194-4322-ba2c-c6c0ed3c0038 req-b7b67265-a5ca-45ac-9c80-50d9eb6aed73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047779 Oct 27 09:56:35.748581 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3530/6988] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:56:35.765640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:35.767099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:35.774608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:35.775174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:35.775907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:35.777476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:35.777476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:35.777875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:35.796990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:36.010373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:36.019324 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92ce8e66-5e62-4473-aeb4-0d3733ff38b1 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1313 microversion: 2.1 time: 0.257511 Oct 27 09:56:36.020032 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3459/6989] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:35 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:56:37.044178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:37.045148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:37.053897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:37.054441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:37.054918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:37.055690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:37.056172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:37.056618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:37.210699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:37.221244 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-42d55571-40e7-4768-8061-1988470a6ef8 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1313 microversion: 2.1 time: 0.181394 Oct 27 09:56:37.221979 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3531/6990] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:37 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:38.246298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:56:38.247009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:38.255182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:38.255725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:38.256192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:38.256992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:38.257489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:38.257931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:38.441734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:56:38.450758 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-803042d5-2131-4aad-ac12-6d5df20f85c0 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1462 microversion: 2.1 time: 0.208689 Oct 27 09:56:38.451376 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3460/6991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:56:38 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1462 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:56:38.475519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-77ee308f-9d0b-4af3-b5e5-7be89386be0d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "284607f2-d457-405f-acd5-3be2e68f9770", "device": "/dev/sdb"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:56:38.478075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-77ee308f-9d0b-4af3-b5e5-7be89386be0d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:56:38.485781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77ee308f-9d0b-4af3-b5e5-7be89386be0d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:38.486299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77ee308f-9d0b-4af3-b5e5-7be89386be0d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:38.486756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77ee308f-9d0b-4af3-b5e5-7be89386be0d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:38.487502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77ee308f-9d0b-4af3-b5e5-7be89386be0d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:56:38.488001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77ee308f-9d0b-4af3-b5e5-7be89386be0d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:56:38.488566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-77ee308f-9d0b-4af3-b5e5-7be89386be0d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:56:38.975310 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-77ee308f-9d0b-4af3-b5e5-7be89386be0d tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "POST /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503782 Oct 27 09:56:38.976146 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3532/6992] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 09:56:38 2022] POST /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:57:50.671789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:50.672559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=38 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:50.676850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:57:50.677358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:57:50.684952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:50.685489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:50.686449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:50.687174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:50.687661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:50.688095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:50.948479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lazy-loading 'services' on Instance uuid 73240325-2e4b-40ca-8039-c75a41f13250 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:57:51.036416 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-396c55ff-ba1f-4b5f-a719-0a217bc80172 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250/os-volume_attachments/284607f2-d457-405f-acd5-3be2e68f9770" status: 202 len: 0 microversion: 2.1 time: 0.366271 Oct 27 09:57:51.037050 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3461/6993] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 09:57:50 2022] DELETE /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250/os-volume_attachments/284607f2-d457-405f-acd5-3be2e68f9770 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:57:56.514320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=22 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:56.515528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:56.517139 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:57:56.517343 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 09:57:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 (ip 10.222.0.25) !!! Oct 27 09:57:56.518847 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:57:56.519039 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 09:57:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 (ip 10.222.0.25) !!! Oct 27 09:57:56.527188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:57:56.527958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:57:56.540789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:56.541301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:56.541753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:56.542485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:56.542958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:56.543397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:56.573126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:57:56.693719 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd9cf4e7-243b-49ff-a094-6d5dcde871db tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 204 len: 0 microversion: 2.1 time: 0.181887 Oct 27 09:57:56.694740 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3533/6994] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:57:56 2022] DELETE /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:57:56.705286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:57:56.706124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:57:56.713180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:56.713781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:56.714273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:56.715074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:56.715872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:56.716449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:56.879162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:57:56.887965 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8dd6ea95-f803-4c91-adb0-1e8e82e93fb4 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1468 microversion: 2.1 time: 0.188289 Oct 27 09:57:56.889284 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3462/6995] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:57:56 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1468 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:57:57.914031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:57:57.914761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:57:57.922790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:57.923360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:57.923877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:57.924697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:57.925169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:57.925608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:58.203936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:57:58.212848 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5d7728a7-66a6-4702-ba2e-3d6aea941918 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1468 microversion: 2.1 time: 0.303219 Oct 27 09:57:58.213974 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3534/6996] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:57:57 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1468 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:57:58.973854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-171c0d68-90a8-4539-9fd8-15210bb518bd req-597a4493-a9d4-4854-9351-830af16b3b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73240325-2e4b-40ca-8039-c75a41f13250", "name": "network-vif-deleted", "tag": "fb986533-bccc-4318-9224-3e8fca473fd0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:57:58.987148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-171c0d68-90a8-4539-9fd8-15210bb518bd req-597a4493-a9d4-4854-9351-830af16b3b28 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:58.987855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-171c0d68-90a8-4539-9fd8-15210bb518bd req-597a4493-a9d4-4854-9351-830af16b3b28 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:58.988621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-171c0d68-90a8-4539-9fd8-15210bb518bd req-597a4493-a9d4-4854-9351-830af16b3b28 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:59.008221 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-171c0d68-90a8-4539-9fd8-15210bb518bd req-597a4493-a9d4-4854-9351-830af16b3b28 service nova] Creating event network-vif-deleted:fb986533-bccc-4318-9224-3e8fca473fd0 for instance 73240325-2e4b-40ca-8039-c75a41f13250 on n-h1-858383-16 Oct 27 09:57:59.014695 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-171c0d68-90a8-4539-9fd8-15210bb518bd req-597a4493-a9d4-4854-9351-830af16b3b28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044969 Oct 27 09:57:59.015301 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3463/6997] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:57:59.238602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:57:59.239255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:57:59.247290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:59.247867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:59.249107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:59.249718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:59.250355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:59.250687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:59.292388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:57:59.292909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:57:59.293383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:57:59.293906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lazy-loading 'fault' on Instance uuid 73240325-2e4b-40ca-8039-c75a41f13250 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:57:59.342703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f400d179f544ecba3f591dd9bf299e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148b01c17b14c55a9afe326d2335d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:57:59.351302 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e623aec1-992d-456a-a13b-9b190acdc747 tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 200 len: 1303 microversion: 2.1 time: 0.116735 Oct 27 09:57:59.351957 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3535/6998] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:57:59 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:58:00.394232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:58:00.395094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] [instance: 73240325-2e4b-40ca-8039-c75a41f13250] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:58:00.402558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:58:00.403071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:58:00.403524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:58:00.404304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:58:00.404775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:58:00.405214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:58:00.420558 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] HTTP exception thrown: Instance 73240325-2e4b-40ca-8039-c75a41f13250 could not be found. Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Request method failure captured: Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 HTTP/1.1 Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlXCWu7X7xBY8HX3lzlVJbdK6DCPsq_-voCI--87tibKjvPfFQeTjVidAZtgGPCTglr5V4sF2WwifB1ukAISW4bXfdppNH4RCZ2Lh1EZe5r391UwHkGDikAS349t3oP0O1q7Y14vcDqRhemdHr6I3zG5LizI_FkqQgT9gbmWJagNRyI Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d148b01c17b14c55a9afe326d2335d9a Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesBackupsTest-1149626589 Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d148b01c17b14c55a9afe326d2335d9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d148b01c17b14c55a9afe326d2335d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d148b01c17b14c55a9afe326d2335d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d148b01c17b14c55a9afe326d2335d9a"}]}] Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-VolumesBackupsTest-1149626589 Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d148b01c17b14c55a9afe326d2335d9a Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesBackupsTest-1149626589 Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-VolumesBackupsTest-1149626589-project Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: e1f400d179f544ecba3f591dd9bf299e Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-VolumesBackupsTest-1149626589-project Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 73240325-2e4b-40ca-8039-c75a41f13250 could not be found. Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '73240325-2e4b-40ca-8039-c75a41f13250'} Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73240325-2e4b-40ca-8039-c75a41f13250 could not be found. Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73240325-2e4b-40ca-8039-c75a41f13250 could not be found. Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:58:00.422301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73240325-2e4b-40ca-8039-c75a41f13250 could not be found. Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] Returning 404 to user: Instance 73240325-2e4b-40ca-8039-c75a41f13250 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-52ed5488-548b-489c-986b-b138c22c31ff tempest-VolumesBackupsTest-1149626589 tempest-VolumesBackupsTest-1149626589-project] 10.222.0.25 "GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250" status: 404 len: 111 microversion: 2.1 time: 0.035609 Oct 27 09:58:00.428581 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3464/6999] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:58:00 2022] GET /compute/v2.1/servers/73240325-2e4b-40ca-8039-c75a41f13250 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:59:39.201965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:39.203244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:39.408689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:39.409217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:59:39.419249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:39.419852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:39.420323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:39.421087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:39.421594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:39.422036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:39.465268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:59:39.587511 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-398d6a72-0b48-4253-bfed-cbba6cc4321b tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "DELETE /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 204 len: 0 microversion: 2.1 time: 0.388304 Oct 27 09:59:39.588210 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3536/7000] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:59:39 2022] DELETE /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:59:39.602290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:39.603488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:59:39.610010 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 09:59:39.610306 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 09:59:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 (ip 10.222.0.25) !!! Oct 27 09:59:39.612874 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 09:59:39.613372 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 09:59:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 (ip 10.222.0.25) !!! Oct 27 09:59:39.615633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:39.617684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:39.630235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:39.631134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:39.632106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:39.633413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:39.634263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:39.635052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:39.849073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:59:39.859400 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-55dff481-188d-4efc-8a52-1b79f6b2a3c1 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1732 microversion: 2.1 time: 0.265385 Oct 27 09:59:39.860046 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3465/7001] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:59:39 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1732 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:59:40.898955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:40.900267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:59:40.917810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:40.918797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:40.919616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:40.920954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:40.921822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:40.922623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:41.285274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:59:41.293815 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-727ed995-54de-4b4d-bf88-0a772b283426 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1732 microversion: 2.1 time: 0.402935 Oct 27 09:59:41.294738 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3537/7002] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:59:40 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1732 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:59:42.350729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:42.353618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:59:42.389579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:42.390096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:42.390547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:42.391473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:42.392138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:42.392743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:42.520289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1def85a2-9fc9-4ef5-8318-2c00ddfae184 req-72e84e63-c0f6-4f02-9a79-7736c478668b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484f46d1-0ee8-489b-84f6-dab4960dd9d0", "name": "network-vif-deleted", "tag": "aa44d6eb-3f2a-4078-a029-e82f2e8f616f"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:59:42.560922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1def85a2-9fc9-4ef5-8318-2c00ddfae184 req-72e84e63-c0f6-4f02-9a79-7736c478668b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:42.562202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1def85a2-9fc9-4ef5-8318-2c00ddfae184 req-72e84e63-c0f6-4f02-9a79-7736c478668b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:42.563290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1def85a2-9fc9-4ef5-8318-2c00ddfae184 req-72e84e63-c0f6-4f02-9a79-7736c478668b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:42.592576 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1def85a2-9fc9-4ef5-8318-2c00ddfae184 req-72e84e63-c0f6-4f02-9a79-7736c478668b service nova] Creating event network-vif-deleted:aa44d6eb-3f2a-4078-a029-e82f2e8f616f for instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 on n-h2-858383-16 Oct 27 09:59:42.593608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a3f9b954a4c2c9ff0072093d20d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd49360ffb8b4070811314f81fe865aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:59:42.603406 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1def85a2-9fc9-4ef5-8318-2c00ddfae184 req-72e84e63-c0f6-4f02-9a79-7736c478668b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240190 Oct 27 09:59:42.604883 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3538/7003] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 09:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:59:42.608091 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-288e5a27-8c6a-47d4-9ace-bb19682885d6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 200 len: 1383 microversion: 2.1 time: 0.289443 Oct 27 09:59:42.608787 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3466/7004] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:59:42 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 1383 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:59:43.636571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:43.642069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:59:43.650312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:43.651764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:43.652518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:43.653624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:43.654112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:43.654699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:43.671835 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] HTTP exception thrown: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Request method failure captured: Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 HTTP/1.1 Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlUcwVnllQgwyPRv7Za54kJmjj6K0VKiQ-69ocU98h-xtxfF22TbgMu9rJahMaVj8_ZdnS5QnAs34jZVU4Nk_JU4-I6BqCN-4n06Iej1fAmiD00KjiHMCBZMN-cRh0O_TBFAGeqn4a-9thhaMZGzmlg0QcYv6TVBR8bsUUMXU9ZyRE4 Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: fd49360ffb8b4070811314f81fe865aa Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestServerBasicOps-2142687816 Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd49360ffb8b4070811314f81fe865aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd49360ffb8b4070811314f81fe865aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd49360ffb8b4070811314f81fe865aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd49360ffb8b4070811314f81fe865aa"}]}] Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestServerBasicOps-2142687816 Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: fd49360ffb8b4070811314f81fe865aa Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestServerBasicOps-2142687816 Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestServerBasicOps-2142687816-project Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 478a3f9b954a4c2c9ff0072093d20d1f Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestServerBasicOps-2142687816-project Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '484f46d1-0ee8-489b-84f6-dab4960dd9d0'} Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:43.673780 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:43.677641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:43.677641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:43.677641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:43.677641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:59:43.677641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:59:43.677641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:43.677641 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:43.679939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Returning 404 to user: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:59:43.681885 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e42eb6bf-85cb-42c6-8406-66879d7f73a6 tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 404 len: 111 microversion: 2.1 time: 0.053555 Oct 27 09:59:43.682637 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3539/7005] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:59:43 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:59:44.293900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:44.294767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:59:44.308630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:44.309516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:44.310288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:44.311875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:44.312722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:44.313520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:44.346783 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] HTTP exception thrown: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Request method failure captured: Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 HTTP/1.1 Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlUcwVnllQgwyPRv7Za54kJmjj6K0VKiQ-69ocU98h-xtxfF22TbgMu9rJahMaVj8_ZdnS5QnAs34jZVU4Nk_JU4-I6BqCN-4n06Iej1fAmiD00KjiHMCBZMN-cRh0O_TBFAGeqn4a-9thhaMZGzmlg0QcYv6TVBR8bsUUMXU9ZyRE4 Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: fd49360ffb8b4070811314f81fe865aa Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestServerBasicOps-2142687816 Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd49360ffb8b4070811314f81fe865aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd49360ffb8b4070811314f81fe865aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd49360ffb8b4070811314f81fe865aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd49360ffb8b4070811314f81fe865aa"}]}] Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestServerBasicOps-2142687816 Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: fd49360ffb8b4070811314f81fe865aa Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestServerBasicOps-2142687816 Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestServerBasicOps-2142687816-project Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 478a3f9b954a4c2c9ff0072093d20d1f Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestServerBasicOps-2142687816-project Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '484f46d1-0ee8-489b-84f6-dab4960dd9d0'} Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:59:44.350403 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Returning 404 to user: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-de6359fb-c53c-4b9e-a266-7ed94581451c tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "DELETE /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 404 len: 111 microversion: 2.1 time: 0.066610 Oct 27 09:59:44.359072 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3467/7006] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 09:59:44 2022] DELETE /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:59:44.366911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:44.368461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] [instance: 484f46d1-0ee8-489b-84f6-dab4960dd9d0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:59:44.380850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:44.382056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:44.383146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:44.384715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:59:44.386432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:59:44.387429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:59:44.408910 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] HTTP exception thrown: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Request method failure captured: Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 HTTP/1.1 Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlUcwVnllQgwyPRv7Za54kJmjj6K0VKiQ-69ocU98h-xtxfF22TbgMu9rJahMaVj8_ZdnS5QnAs34jZVU4Nk_JU4-I6BqCN-4n06Iej1fAmiD00KjiHMCBZMN-cRh0O_TBFAGeqn4a-9thhaMZGzmlg0QcYv6TVBR8bsUUMXU9ZyRE4 Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: fd49360ffb8b4070811314f81fe865aa Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestServerBasicOps-2142687816 Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd49360ffb8b4070811314f81fe865aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd49360ffb8b4070811314f81fe865aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd49360ffb8b4070811314f81fe865aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd49360ffb8b4070811314f81fe865aa"}]}] Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestServerBasicOps-2142687816 Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: fd49360ffb8b4070811314f81fe865aa Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestServerBasicOps-2142687816 Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestServerBasicOps-2142687816-project Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 478a3f9b954a4c2c9ff0072093d20d1f Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestServerBasicOps-2142687816-project Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '484f46d1-0ee8-489b-84f6-dab4960dd9d0'} Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:59:44.414573 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.428429 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:59:44.428429 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:59:44.428429 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:59:44.428429 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:59:44.428429 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:59:44.428429 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. Oct 27 09:59:44.428429 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 09:59:44.428429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Returning 404 to user: Instance 484f46d1-0ee8-489b-84f6-dab4960dd9d0 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:59:44.428429 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de701216-968b-421c-989d-306100c97c3a tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0" status: 404 len: 111 microversion: 2.1 time: 0.056816 Oct 27 09:59:44.432853 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3540/7007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 09:59:44 2022] GET /compute/v2.1/servers/484f46d1-0ee8-489b-84f6-dab4960dd9d0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:59:44.721298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63a541d7-6de1-452f-86da-6f28b64d238d tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] Calling method '.version_select at 0x7f31a9282550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:59:44.784105 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63a541d7-6de1-452f-86da-6f28b64d238d tempest-TestServerBasicOps-2142687816 tempest-TestServerBasicOps-2142687816-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-886297882" status: 202 len: 0 microversion: 2.1 time: 0.066743 Oct 27 09:59:44.787676 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3468/7008] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 09:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-886297882 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:02:01.565574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:01.566450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:01.568202 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:02:01.568699 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:02:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 27 10:02:01.569900 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:02:01.570088 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:02:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 27 10:02:01.571220 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:02:01.571390 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:02:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 27 10:02:01.792618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1739953596", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:01.870973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] validate_networks() for None {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:02:02.135583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:02:02.136097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:02:02.136661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:02:02.137139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:02:02.137673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:02:02.153123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:02.153921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:02.154524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:02.155648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:02.156295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:02.156769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:02.185415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Getting quotas for project 05a722b24a7c48ffa0b51d3b4e13f0fd. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:02:02.192785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Getting quotas for user 3750f21faa0642a8bd47185139043112 and project 05a722b24a7c48ffa0b51d3b4e13f0fd. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:02:02.210325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:02:02.213488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:02:02.274430 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-272993b1-1d67-45ba-b65f-e9493b624766 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711120 Oct 27 10:02:02.275224 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3541/7009] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:02:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:02:02.293883 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 10:02:02.295709 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 10:02:02.297873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=14 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:02.300142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:02.301059 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:02:02.301275 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:02:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 (ip 10.222.0.25) !!! Oct 27 10:02:02.314227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5582c2b-525e-4316-9fb5-03cb595e930d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:02.315103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5582c2b-525e-4316-9fb5-03cb595e930d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:02.391862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5582c2b-525e-4316-9fb5-03cb595e930d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:02.403713 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5582c2b-525e-4316-9fb5-03cb595e930d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1222 microversion: 2.1 time: 0.113764 Oct 27 10:02:02.404321 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3469/7010] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:02 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:03.430835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:03.431512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:03.438128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:03.438706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:03.439229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:03.440141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:03.440670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:03.441163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:03.514552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:03.530631 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-035173ee-f01e-4326-b6a2-4025d25be0d3 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1274 microversion: 2.1 time: 0.104777 Oct 27 10:02:03.531650 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3542/7011] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:03 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:04.557680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:04.558506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:04.575539 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37282. Oct 27 10:02:04.579673 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37284. Oct 27 10:02:04.585566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:04.586091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:04.586526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:04.587259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:04.587770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:04.588214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:04.712506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:04.721585 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f717ef8-a8b2-4b1f-8547-5e4c2623be6d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1280 microversion: 2.1 time: 0.170143 Oct 27 10:02:04.722206 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3470/7012] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:04 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:05.755125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:05.756389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:05.764012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:05.764539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:05.765007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:05.765775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:05.766258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:05.766707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:05.996439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:06.005521 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-072e8c44-44f5-4fc1-a3d9-e8b55fd42a45 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1322 microversion: 2.1 time: 0.254688 Oct 27 10:02:06.006664 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3543/7013] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:05 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:06.048623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8355dded-296e-41b7-b0ef-9c8e08a9c2e5 req-e533e296-2094-43f1-8870-1d5e7009d9ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8efa661-f82d-4885-bc6b-60f3d1d71ea6", "tag": "d283864b-b32c-4834-acb8-9d57dd2dcbdc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:06.065799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8355dded-296e-41b7-b0ef-9c8e08a9c2e5 req-e533e296-2094-43f1-8870-1d5e7009d9ab service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:06.066425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8355dded-296e-41b7-b0ef-9c8e08a9c2e5 req-e533e296-2094-43f1-8870-1d5e7009d9ab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:06.067113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8355dded-296e-41b7-b0ef-9c8e08a9c2e5 req-e533e296-2094-43f1-8870-1d5e7009d9ab service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:06.084333 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8355dded-296e-41b7-b0ef-9c8e08a9c2e5 req-e533e296-2094-43f1-8870-1d5e7009d9ab service nova] Creating event network-changed:d283864b-b32c-4834-acb8-9d57dd2dcbdc for instance e8efa661-f82d-4885-bc6b-60f3d1d71ea6 on n-h1-858383-16 Oct 27 10:02:06.092480 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8355dded-296e-41b7-b0ef-9c8e08a9c2e5 req-e533e296-2094-43f1-8870-1d5e7009d9ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050475 Oct 27 10:02:06.093965 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3471/7014] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:02:07.030386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:07.030983 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:07.038878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:07.039391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:07.039895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:07.040630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:07.041105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:07.041549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:07.186244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:07.195723 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3ed10b11-8a0f-4844-b1a9-435be066b8ab tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1322 microversion: 2.1 time: 0.169405 Oct 27 10:02:07.196326 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3544/7015] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:07 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:08.221339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:08.222059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:08.228962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:08.229513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:08.229937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:08.230645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:08.231144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:08.231605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:08.391223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:08.399950 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-15adf1dc-6298-4b65-afc5-1bdb489e8923 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1322 microversion: 2.1 time: 0.184169 Oct 27 10:02:08.400572 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3472/7016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:08 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:09.428000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:09.429504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:09.437766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:09.438279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:09.438754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:09.439511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:09.440031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:09.440515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:09.602139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:09.617369 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb64f3eb-5444-4399-99b2-1ca92e911f54 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1322 microversion: 2.1 time: 0.197172 Oct 27 10:02:09.618480 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3545/7017] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:09 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:10.655420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:10.656203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:10.664100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:10.664600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:10.665047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:10.665772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:10.666239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:10.666676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:10.815613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:10.824622 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9fae8614-7260-4903-99f2-267ddd6ac8ca tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1322 microversion: 2.1 time: 0.173235 Oct 27 10:02:10.825203 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3473/7018] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:10 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:11.354368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2822ada7-8592-45f7-9f46-c0af1398f4bc req-b55d70de-95df-480d-bd0d-b4c71675733d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8efa661-f82d-4885-bc6b-60f3d1d71ea6", "name": "network-vif-plugged", "status": "completed", "tag": "d283864b-b32c-4834-acb8-9d57dd2dcbdc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:11.365050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2822ada7-8592-45f7-9f46-c0af1398f4bc req-b55d70de-95df-480d-bd0d-b4c71675733d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:11.365554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2822ada7-8592-45f7-9f46-c0af1398f4bc req-b55d70de-95df-480d-bd0d-b4c71675733d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:11.366009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2822ada7-8592-45f7-9f46-c0af1398f4bc req-b55d70de-95df-480d-bd0d-b4c71675733d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:11.378912 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2822ada7-8592-45f7-9f46-c0af1398f4bc req-b55d70de-95df-480d-bd0d-b4c71675733d service nova] Creating event network-vif-plugged:d283864b-b32c-4834-acb8-9d57dd2dcbdc for instance e8efa661-f82d-4885-bc6b-60f3d1d71ea6 on n-h1-858383-16 Oct 27 10:02:11.386211 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2822ada7-8592-45f7-9f46-c0af1398f4bc req-b55d70de-95df-480d-bd0d-b4c71675733d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104600 Oct 27 10:02:11.387066 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3546/7019] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:02:11.849674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:11.850353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:11.858110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:11.858621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:11.859080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:11.859881 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:11.860366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:11.860808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:12.017806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:12.026805 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9cca92a-b3d0-40a4-8eeb-e92065507d61 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1322 microversion: 2.1 time: 0.182018 Oct 27 10:02:12.027420 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3474/7020] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:11 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:13.051731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:13.052765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:13.055980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:13.056735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:13.062548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:13.063064 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:13.063529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:13.064315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:13.064800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:13.065259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:13.222123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:13.236202 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e020cb7-ccc8-49aa-a7a0-9611fd382855 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1472 microversion: 2.1 time: 0.188803 Oct 27 10:02:13.237329 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3547/7021] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:13 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:13.276786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:13.365115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-371333e1-69a4-4f6b-974b-5dcd782b6045 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Calling method '.version_select at 0x7f31a9fe40d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:13.440430 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-371333e1-69a4-4f6b-974b-5dcd782b6045 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/aab78033f96640febd00f6d7d4a6dbce" status: 200 len: 371 microversion: 2.1 time: 0.178475 Oct 27 10:02:13.441313 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3475/7022] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 10:02:13 2022] GET /compute/v2.1/os-quota-sets/aab78033f96640febd00f6d7d4a6dbce => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:02:13.454176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-377b8cb7-f8c1-471a-8cc4-aaf4f3ff52ad tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1797843492", "id": 489197263, "os-flavor-access:is_public": "True"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:13.475050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-377b8cb7-f8c1-471a-8cc4-aaf4f3ff52ad tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.024105 Oct 27 10:02:13.475702 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3548/7023] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:02:13 2022] POST /compute/v2.1/flavors => generated 435 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:02:13.489031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "489197263"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:13.491984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:13.499400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:13.499930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:13.500376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:13.501108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:13.501575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:13.502008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:13.678969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0dbc361bb453489b9881810f7404beb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab78033f96640febd00f6d7d4a6dbce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:13.685951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1797843492 {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:02:13.695452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:13.695985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:13.696431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:13.697176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:13.697641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:13.698076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:13.730980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Getting quotas for project 05a722b24a7c48ffa0b51d3b4e13f0fd. Resources: {'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:02:13.737063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Getting quotas for user 3750f21faa0642a8bd47185139043112 and project 05a722b24a7c48ffa0b51d3b4e13f0fd. Resources: {'cores', 'ram'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:02:13.751895 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.compute.api [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] ram quota exceeded for aab78033f96640febd00f6d7d4a6dbce, tried to resize instance. Oct 27 10:02:13.752784 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Request method failure captured: Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6/action HTTP/1.1 Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 38 Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlcZ__kXU5GwpwsmN9RdCYhnTwJ37BhiXpgxNpEsu9yUOkzEZLAJDvrR6hX0QhjgYPgVNzRcfiRpGRTPJkdxCvw0S7_fzQByrZFd_Hyqn0RIK_vXVau2Ii6EgJpcT81uKIFqMeH3Pxy4iRTiomRQoBV-1y-dHKOgpYCXZFuvJ-cx4mM Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: aab78033f96640febd00f6d7d4a6dbce Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-280150461 Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Role: admin,member,reader Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: admin,member,reader Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aab78033f96640febd00f6d7d4a6dbce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aab78033f96640febd00f6d7d4a6dbce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aab78033f96640febd00f6d7d4a6dbce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aab78033f96640febd00f6d7d4a6dbce"}]}] Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersAdminNegativeTestJSON-280150461 Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: aab78033f96640febd00f6d7d4a6dbce Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-280150461 Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersAdminNegativeTestJSON-280150461-project-admin Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0dbc361bb453489b9881810f7404beb3 Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersAdminNegativeTestJSON-280150461-project-admin Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: {"resize": {"flavorRef": "489197263"}} Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'e8efa661-f82d-4885-bc6b-60f3d1d71ea6', 'body': {'resize': {'flavorRef': '489197263'}}} Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3879, in _check_quota_for_upsize Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:02:13.757719 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4245, in resize Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3897, in _check_quota_for_upsize Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0d32ea3f-df0f-4f7c-ac8b-bf9524ca52a1 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6/action" status: 403 len: 118 microversion: 2.1 time: 0.274840 Oct 27 10:02:13.764113 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3476/7024] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:02:13 2022] POST /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6/action => generated 118 bytes in 276 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:02:13.773100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56c9942e-41c3-4019-ba01-d66d46219936 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:13.793870 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56c9942e-41c3-4019-ba01-d66d46219936 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/489197263" status: 202 len: 0 microversion: 2.1 time: 0.026118 Oct 27 10:02:13.794614 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3549/7025] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 10:02:13 2022] DELETE /compute/v2.1/flavors/489197263 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:02:13.804117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-497dd708-2bd7-4d3f-9a27-c0108929f86c tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:13.826081 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-497dd708-2bd7-4d3f-9a27-c0108929f86c tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026413 Oct 27 10:02:13.826704 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3477/7026] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 10:02:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:13.848336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4f5bcd6f-f1d8-49ea-844b-c888edbc5ca6 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Calling method '.version_select at 0x7f31a9c78040>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:13.942236 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4f5bcd6f-f1d8-49ea-844b-c888edbc5ca6 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/aab78033f96640febd00f6d7d4a6dbce" status: 200 len: 371 microversion: 2.1 time: 0.097571 Oct 27 10:02:13.943320 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3550/7027] 10.222.0.25 () {58 vars in 1242 bytes} [Thu Oct 27 10:02:13 2022] GET /compute/v2.1/os-quota-sets/aab78033f96640febd00f6d7d4a6dbce => generated 371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:02:13.955637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2fdf331-2131-4c6e-935d-52002fd0ea91 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1320906752", "id": 430355771, "os-flavor-access:is_public": "True"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:13.981702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2fdf331-2131-4c6e-935d-52002fd0ea91 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.029256 Oct 27 10:02:13.982835 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3478/7028] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:02:13 2022] POST /compute/v2.1/flavors => generated 434 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:02:13.996527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "430355771"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:13.999033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:14.005710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:14.006243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:14.006689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:14.007432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:14.007975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:14.008543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:14.214903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0dbc361bb453489b9881810f7404beb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab78033f96640febd00f6d7d4a6dbce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:14.226155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1320906752 {{(pid=120602) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:02:14.239492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:14.240925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:14.241761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:14.243128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:14.243980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:14.244763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:14.285826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Getting quotas for project 05a722b24a7c48ffa0b51d3b4e13f0fd. Resources: {'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:02:14.297457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Getting quotas for user 3750f21faa0642a8bd47185139043112 and project 05a722b24a7c48ffa0b51d3b4e13f0fd. Resources: {'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:02:14.322699 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.api [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] cores quota exceeded for aab78033f96640febd00f6d7d4a6dbce, tried to resize instance. Oct 27 10:02:14.323796 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Request method failure captured: Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6/action HTTP/1.1 Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 38 Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlcZ__kXU5GwpwsmN9RdCYhnTwJ37BhiXpgxNpEsu9yUOkzEZLAJDvrR6hX0QhjgYPgVNzRcfiRpGRTPJkdxCvw0S7_fzQByrZFd_Hyqn0RIK_vXVau2Ii6EgJpcT81uKIFqMeH3Pxy4iRTiomRQoBV-1y-dHKOgpYCXZFuvJ-cx4mM Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: aab78033f96640febd00f6d7d4a6dbce Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-280150461 Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Role: admin,member,reader Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: admin,member,reader Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aab78033f96640febd00f6d7d4a6dbce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aab78033f96640febd00f6d7d4a6dbce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aab78033f96640febd00f6d7d4a6dbce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aab78033f96640febd00f6d7d4a6dbce"}]}] Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdminNegativeTestJSON-280150461 Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: aab78033f96640febd00f6d7d4a6dbce Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-280150461 Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdminNegativeTestJSON-280150461-project-admin Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0dbc361bb453489b9881810f7404beb3 Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdminNegativeTestJSON-280150461-project-admin Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: {"resize": {"flavorRef": "430355771"}} Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'e8efa661-f82d-4885-bc6b-60f3d1d71ea6', 'body': {'resize': {'flavorRef': '430355771'}}} Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3879, in _check_quota_for_upsize Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:02:14.328212 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4245, in resize Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3897, in _check_quota_for_upsize Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8afdaf35-12c4-45c6-951c-6cfe91f66268 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6/action" status: 403 len: 113 microversion: 2.1 time: 0.338023 Oct 27 10:02:14.336220 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3551/7029] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:02:13 2022] POST /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6/action => generated 113 bytes in 341 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:02:14.347138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8b8854c5-8070-410f-b223-55f3dcb5d1cd tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:14.372525 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8b8854c5-8070-410f-b223-55f3dcb5d1cd tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/430355771" status: 202 len: 0 microversion: 2.1 time: 0.033253 Oct 27 10:02:14.373125 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3479/7030] 10.222.0.25 () {58 vars in 1158 bytes} [Thu Oct 27 10:02:14 2022] DELETE /compute/v2.1/flavors/430355771 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:02:14.386909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0dca9a43-f954-4a8c-a164-8d9af1159fb5 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:14.425988 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0dca9a43-f954-4a8c-a164-8d9af1159fb5 tempest-ServersAdminNegativeTestJSON-280150461 tempest-ServersAdminNegativeTestJSON-280150461-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046935 Oct 27 10:02:14.427589 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3552/7031] 10.222.0.25 () {58 vars in 1146 bytes} [Thu Oct 27 10:02:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:14.450466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:14.451092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:14.459069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:14.459534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:14.460152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:14.461057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:14.461581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:14.462057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:14.492138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:02:14.603475 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d77608f-6575-467d-acf7-499118f0e411 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 204 len: 0 microversion: 2.1 time: 0.156733 Oct 27 10:02:14.604142 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3480/7032] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:02:14 2022] DELETE /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:02:14.618380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:14.619488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:14.629888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:14.631143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:14.631844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:14.632998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:14.633809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:14.634588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:14.810793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:14.819883 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ac4333a8-f978-4b59-9132-73360e29bdb5 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1478 microversion: 2.1 time: 0.210022 Oct 27 10:02:14.820491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3553/7033] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:14 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1478 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:15.846483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:15.847196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:15.854626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:15.855124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:15.855604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:15.856402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:15.856862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:15.857292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:16.025609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:16.034417 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5734f490-b606-4d25-a8f8-ff39a6080427 tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1478 microversion: 2.1 time: 0.192330 Oct 27 10:02:16.035119 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3481/7034] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:15 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1478 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:16.828206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ca1750c9-fef6-4e74-a88b-72fb1815c88c req-128dfd90-21bf-452a-8157-5a98c316e0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8efa661-f82d-4885-bc6b-60f3d1d71ea6", "name": "network-vif-deleted", "tag": "d283864b-b32c-4834-acb8-9d57dd2dcbdc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:16.849620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ca1750c9-fef6-4e74-a88b-72fb1815c88c req-128dfd90-21bf-452a-8157-5a98c316e0c1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:16.850896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ca1750c9-fef6-4e74-a88b-72fb1815c88c req-128dfd90-21bf-452a-8157-5a98c316e0c1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:16.851968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ca1750c9-fef6-4e74-a88b-72fb1815c88c req-128dfd90-21bf-452a-8157-5a98c316e0c1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:16.880678 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ca1750c9-fef6-4e74-a88b-72fb1815c88c req-128dfd90-21bf-452a-8157-5a98c316e0c1 service nova] Creating event network-vif-deleted:d283864b-b32c-4834-acb8-9d57dd2dcbdc for instance e8efa661-f82d-4885-bc6b-60f3d1d71ea6 on n-h1-858383-16 Oct 27 10:02:16.888082 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ca1750c9-fef6-4e74-a88b-72fb1815c88c req-128dfd90-21bf-452a-8157-5a98c316e0c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067759 Oct 27 10:02:16.889198 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3554/7035] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:02:17.060269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:17.061411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:17.069397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:17.069907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:17.070363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:17.071104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:17.071609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:17.072058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:17.108000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:17.108498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:17.108944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:17.109413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lazy-loading 'fault' on Instance uuid e8efa661-f82d-4885-bc6b-60f3d1d71ea6 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:02:17.155709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3750f21faa0642a8bd47185139043112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a722b24a7c48ffa0b51d3b4e13f0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:17.164803 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bbe731bc-b25d-40db-bb2d-9585ad85b13d tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 200 len: 1312 microversion: 2.1 time: 0.109287 Oct 27 10:02:17.165548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3482/7036] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:17 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:18.191133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:18.192034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] [instance: e8efa661-f82d-4885-bc6b-60f3d1d71ea6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:18.199479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:18.200019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:18.200479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:18.201221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:18.201694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:18.202138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:18.217987 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] HTTP exception thrown: Instance e8efa661-f82d-4885-bc6b-60f3d1d71ea6 could not be found. Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Request method failure captured: Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 HTTP/1.1 Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlcYEkpQqZoKTQPer0ceARJODOiIXnNW4_BUEJQqCMrr18oAQsfo8j5Z6jw7aHRUe-7wPeo04R-QdQWETuMdEQsk-60VU3FqKro7umYCYVAO93i6UAb_iJuQYeQ4d4SCoE7w06-uJVgptrF-u3qHmDj8Q7q5gzjXAk9J2xMV7nOJuZo Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 05a722b24a7c48ffa0b51d3b4e13f0fd Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1917950908 Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05a722b24a7c48ffa0b51d3b4e13f0fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_05a722b24a7c48ffa0b51d3b4e13f0fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05a722b24a7c48ffa0b51d3b4e13f0fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/05a722b24a7c48ffa0b51d3b4e13f0fd"}]}] Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1917950908 Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 05a722b24a7c48ffa0b51d3b4e13f0fd Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1917950908 Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersAdminNegativeTestJSON-1917950908-project Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 3750f21faa0642a8bd47185139043112 Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1917950908-project Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance e8efa661-f82d-4885-bc6b-60f3d1d71ea6 could not be found. Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'e8efa661-f82d-4885-bc6b-60f3d1d71ea6'} Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8efa661-f82d-4885-bc6b-60f3d1d71ea6 could not be found. Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8efa661-f82d-4885-bc6b-60f3d1d71ea6 could not be found. Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:18.219921 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8efa661-f82d-4885-bc6b-60f3d1d71ea6 could not be found. Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] Returning 404 to user: Instance e8efa661-f82d-4885-bc6b-60f3d1d71ea6 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:02:18.227040 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f46d20f9-6718-42ae-afb3-50d261c221aa tempest-ServersAdminNegativeTestJSON-1917950908 tempest-ServersAdminNegativeTestJSON-1917950908-project] 10.222.0.25 "GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6" status: 404 len: 111 microversion: 2.1 time: 0.036085 Oct 27 10:02:18.228247 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3555/7037] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:18 2022] GET /compute/v2.1/servers/e8efa661-f82d-4885-bc6b-60f3d1d71ea6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:02:26.977846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:26.979250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:27.106466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:27.122395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-31099816", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "5a48e78e-f854-4d0f-99ca-5cc4e94af6ba"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:27.161808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:27.222667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] validate_networks() for [('5a48e78e-f854-4d0f-99ca-5cc4e94af6ba', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:02:27.754358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:02:27.755015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:02:27.755695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:02:27.756291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:02:27.756981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:02:27.767826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:27.768431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:27.768974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:27.769854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:27.770918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:27.771760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:27.792561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Getting quotas for project 8549c0102d6b4524932c0e8ad312c762. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:02:27.799436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Getting quotas for user 6fab0062f1e04e3ea417c06a648ca800 and project 8549c0102d6b4524932c0e8ad312c762. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:02:27.815535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:02:27.818107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:02:27.884089 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef62bf40-dce6-490f-82ce-8b9d666c46d3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907932 Oct 27 10:02:27.897282 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3483/7038] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:02:27.906060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b088b346-f927-4df0-a132-38b69d862483 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:27.908362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b088b346-f927-4df0-a132-38b69d862483 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:27.915426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:27.917234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:28.028035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b088b346-f927-4df0-a132-38b69d862483 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:28.045135 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b088b346-f927-4df0-a132-38b69d862483 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1213 microversion: 2.1 time: 0.146662 Oct 27 10:02:28.047330 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3556/7039] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:27 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:29.094927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:29.096241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:29.110749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:29.111795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:29.112321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:29.113412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:29.114794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:29.115826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:29.220161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:29.231474 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f66580d6-f4ba-458a-a519-86626406393d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1265 microversion: 2.1 time: 0.146260 Oct 27 10:02:29.232281 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3484/7040] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:29 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:30.272248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:30.273440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:30.276167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=57 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:30.288668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:30.289372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:30.289934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:30.290968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:30.291537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:30.292093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:30.559348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:30.571080 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-54df99b7-7a5d-488a-9839-8f56ffa29577 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1313 microversion: 2.1 time: 0.304482 Oct 27 10:02:30.572506 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3557/7041] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:30 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:31.518928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-080266b4-6b99-4282-b578-988f74a26e28 req-9db9330f-797b-42bc-b6cb-cce536196e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34a7dd5-22e8-453e-8f36-a92edaed70ba", "tag": "1b1b3777-26f1-4c2c-b884-2332f49cee0c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:31.540751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-080266b4-6b99-4282-b578-988f74a26e28 req-9db9330f-797b-42bc-b6cb-cce536196e69 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:31.541766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-080266b4-6b99-4282-b578-988f74a26e28 req-9db9330f-797b-42bc-b6cb-cce536196e69 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:31.542556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-080266b4-6b99-4282-b578-988f74a26e28 req-9db9330f-797b-42bc-b6cb-cce536196e69 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:31.566466 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-080266b4-6b99-4282-b578-988f74a26e28 req-9db9330f-797b-42bc-b6cb-cce536196e69 service nova] Creating event network-changed:1b1b3777-26f1-4c2c-b884-2332f49cee0c for instance d34a7dd5-22e8-453e-8f36-a92edaed70ba on n-h1-858383-16 Oct 27 10:02:31.576297 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-080266b4-6b99-4282-b578-988f74a26e28 req-9db9330f-797b-42bc-b6cb-cce536196e69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064899 Oct 27 10:02:31.577589 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3485/7042] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:02:31.602447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:31.603616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:31.608460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:31.621408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:31.622144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:31.623022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:31.624391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:31.625313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:31.626127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:31.891634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:31.902324 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e321b13d-2cd1-4137-b6e3-e0320f0a2f4d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1313 microversion: 2.1 time: 0.307952 Oct 27 10:02:31.903149 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3558/7043] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:31 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:32.933235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:32.934377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:32.947863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:32.948680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:32.949409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:32.950627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:32.951397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:32.952155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:33.163656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:33.178237 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-702eb467-7ba1-4ed1-b94a-fb6c1bf8d6ab tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1313 microversion: 2.1 time: 0.252754 Oct 27 10:02:33.179357 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3486/7044] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:32 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:34.211850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:34.212971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:34.221288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:34.222113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:34.222731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:34.224273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:34.224948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:34.225564 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:34.479035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:34.494653 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3a91b70f-6f8f-4b4a-8957-06211bdc8f2f tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1313 microversion: 2.1 time: 0.286787 Oct 27 10:02:34.501452 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3559/7045] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:34 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:35.528210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:35.528831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:35.536427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:35.536925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:35.537365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:35.538086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:35.538548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:35.538975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:35.694168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:35.704837 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-07816419-01c4-4310-a1ff-c935f7757a61 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1313 microversion: 2.1 time: 0.180713 Oct 27 10:02:35.707370 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3487/7046] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:35 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:36.743199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:36.743863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:36.751318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:36.751793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:36.752258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:36.752995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:36.753467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:36.753910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:36.919513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:36.928984 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f1173169-5294-4443-afd0-59216560f8cc tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1313 microversion: 2.1 time: 0.189668 Oct 27 10:02:36.929717 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3560/7047] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:36 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:37.339501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-37af9711-8642-4f76-a7fa-3c66bfdb284c req-a963f3d4-4979-443b-9470-fb35e95c550e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34a7dd5-22e8-453e-8f36-a92edaed70ba", "name": "network-vif-plugged", "status": "completed", "tag": "1b1b3777-26f1-4c2c-b884-2332f49cee0c"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:37.357954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-37af9711-8642-4f76-a7fa-3c66bfdb284c req-a963f3d4-4979-443b-9470-fb35e95c550e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:37.358724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-37af9711-8642-4f76-a7fa-3c66bfdb284c req-a963f3d4-4979-443b-9470-fb35e95c550e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:37.359897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-37af9711-8642-4f76-a7fa-3c66bfdb284c req-a963f3d4-4979-443b-9470-fb35e95c550e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:37.383200 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-37af9711-8642-4f76-a7fa-3c66bfdb284c req-a963f3d4-4979-443b-9470-fb35e95c550e service nova] Creating event network-vif-plugged:1b1b3777-26f1-4c2c-b884-2332f49cee0c for instance d34a7dd5-22e8-453e-8f36-a92edaed70ba on n-h1-858383-16 Oct 27 10:02:37.393196 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-37af9711-8642-4f76-a7fa-3c66bfdb284c req-a963f3d4-4979-443b-9470-fb35e95c550e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061203 Oct 27 10:02:37.394152 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3488/7048] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:02:37.958200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:37.959381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:37.970948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:37.971738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:37.972451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:37.974249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:37.975081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:37.975895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:38.037382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:38.159925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:38.168636 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-855e9115-ad27-4c39-a28d-e4f81db93572 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1313 microversion: 2.1 time: 0.219037 Oct 27 10:02:38.169298 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3561/7049] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:37 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:39.189843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:39.190634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:39.196378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:39.197110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:39.204887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:39.205421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:39.206232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:39.207004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:39.207604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:39.208139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:39.383633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:39.391989 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38db02af-7c70-4c12-81dd-2709096830b2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1501 microversion: 2.1 time: 0.202971 Oct 27 10:02:39.392602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3489/7050] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:39 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1501 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:39.416339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:02:39.419121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:39.427713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:39.428240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:39.428710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:39.429473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:39.429958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:39.430411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:39.513274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:39.520220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Old instance type m1.heat2, new instance type m1.heat {{(pid=120602) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:02:39.528644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:02:39.529180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:02:39.529736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:02:39.530209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:02:39.530732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:02:39.663328 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2b13a0b4-6aca-462a-bea7-914ee7cbce30 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "POST /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba/action" status: 202 len: 0 microversion: 2.1 time: 0.252004 Oct 27 10:02:39.664422 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3562/7051] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:02:39 2022] POST /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:02:39.673234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:39.673861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:39.681076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:39.681586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:39.682032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:39.682761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:39.683229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:39.683694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:39.907182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:39.917540 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6435d933-1f63-466a-a347-d3234f4d1f9a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1510 microversion: 2.1 time: 0.248316 Oct 27 10:02:39.918398 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3490/7052] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:39 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:40.955024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:40.955816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:40.967889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:40.969180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:40.970001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:40.971645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:40.972554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:40.973646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:41.157929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:41.167320 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a7b3ee9-a8d5-4cb6-921a-8fd721a82559 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1510 microversion: 2.1 time: 0.219661 Oct 27 10:02:41.167992 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3563/7053] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:40 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:42.193494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:42.194262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:42.202048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:42.202556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:42.203004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:42.203790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:42.204267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:42.204705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:42.370262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:42.379183 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-05c588d8-42d4-4df9-bf0e-c8a6b9df377c tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.190340 Oct 27 10:02:42.379814 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3491/7054] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:42 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:43.403501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:43.404192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:43.412520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:43.413033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:43.413490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:43.414235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:43.414707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:43.415151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:43.562070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:43.571530 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4c9cc7cc-1992-41ae-b2e1-5c8646975681 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.171938 Oct 27 10:02:43.572433 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3564/7055] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:43 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:44.597560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:44.598792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:44.607405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:44.608076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:44.608687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:44.609574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:44.610144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:44.610624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:44.802861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:44.817504 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ebb1705-4d6f-4194-9956-7bd27ea3e1d7 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.223793 Oct 27 10:02:44.818598 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3492/7056] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:44 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:45.855389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:45.856091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:45.863476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:45.864012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:45.864473 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:45.865280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:45.865760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:45.866211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:46.013509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:46.028794 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d11689a-6284-4728-9cf6-c4e5ae8abce0 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.177078 Oct 27 10:02:46.029902 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3565/7057] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:45 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:47.068080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:47.068773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:47.076253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:47.076767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:47.077227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:47.077955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:47.078421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:47.078984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:47.242953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:47.252498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a2fc696e-62e4-418a-a677-242370057e64 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.188553 Oct 27 10:02:47.253246 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3493/7058] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:47 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:48.277448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:48.278074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:48.286508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:48.287019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:48.287492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:48.288267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:48.288744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:48.289187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:48.459386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:48.468196 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6d6def6-836a-4b6e-806f-8971f53ff54e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.194724 Oct 27 10:02:48.468800 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3566/7059] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:48 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:49.506640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:49.507353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:49.515489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:49.516039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:49.516489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:49.517223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:49.517690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:49.518127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:49.764837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:49.774077 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ab65b6b-6274-4d12-877e-d6d20f1a6c6d tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.271857 Oct 27 10:02:49.774687 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3494/7060] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:49 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:50.813853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:50.814915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:50.823407 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:50.824112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:50.824678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:50.825917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:50.826696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:50.827299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:51.027836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:51.036953 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8876028e-2363-4c9c-b438-77f1eca19ca8 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.227281 Oct 27 10:02:51.037533 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3567/7061] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:50 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:52.061760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:52.062537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:52.071236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:52.071858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:52.072354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:52.073223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:52.073833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:52.074320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:52.225402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:52.233832 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a10ff15-b85c-4e03-b6c9-d89359c90eac tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.176463 Oct 27 10:02:52.234502 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3495/7062] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:52 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:53.262281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:53.263475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:53.277265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:53.278131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:53.278954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:53.280349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:53.281224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:53.282048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:53.482717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:53.492085 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c48b24ba-673b-4112-a17e-b00722d54107 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.237140 Oct 27 10:02:53.492726 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3568/7063] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:53 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:54.516921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:54.517575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:54.525417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:54.525922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:54.526377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:54.527230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:54.527877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:54.528319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:54.672001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:54.680944 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-943ddecc-6245-467f-b15f-c58e8eccd992 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.168037 Oct 27 10:02:54.681650 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3496/7064] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:54 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:55.706156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:55.706832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:55.714386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:55.715184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:55.715683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:55.716432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:55.716920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:55.717381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:55.867853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:55.876399 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d8c8c00e-6333-491b-9f9e-90da701c2c79 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.174705 Oct 27 10:02:55.877008 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3569/7065] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:55 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:02:56.902401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:56.903044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:56.910853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:56.911359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:56.911834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:56.912563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:56.913027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:56.913462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:57.409628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:57.412826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=77 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:57.421075 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d343284f-1323-4979-9601-17b1f592fc05 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.522777 Oct 27 10:02:57.421819 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3497/7066] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:56 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:58.444916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:58.445709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:58.460130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:58.461082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:58.461888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:58.463218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:58.464212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:58.464891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:58.712388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:58.721639 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8eba9c49-2413-453f-8496-7ffd944d0d8b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.280648 Oct 27 10:02:58.722245 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3570/7067] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:58 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:02:59.758556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:02:59.759365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:02:59.762201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:59.767803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:59.768309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:59.768757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:59.770091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:02:59.770560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:02:59.770994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:02:59.928708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:02:59.937638 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1afa17ee-23a8-4fd7-b634-a8b69eaf8e53 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.183538 Oct 27 10:02:59.938241 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3498/7068] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:02:59 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:03:00.962285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:00.963192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:00.970422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:00.970949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:00.971420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:00.972213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:00.972830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:00.973146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:00.976573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:01.125739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:01.138079 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-78dd2614-9711-4239-828e-418d8a94dd3e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.179464 Oct 27 10:03:01.139114 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3571/7069] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:00 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:02.165769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:02.166410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:02.174310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:02.174815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:02.175271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:02.176584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:02.177056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:02.177501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:02.361199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:02.370188 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60865516-1016-4166-8528-7b869c3d1805 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.210928 Oct 27 10:03:02.370804 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3499/7070] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:02 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:03.395272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:03.396032 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:03.398755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=32 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:03.407556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:03.408568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:03.409333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:03.410379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:03.411063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:03.411707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:03.562245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:03.577286 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e4e76cf2-ede8-49c3-ac43-2f32a0d1b66b tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.186231 Oct 27 10:03:03.578404 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3572/7071] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:03 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:04.619460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:04.620122 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:04.627473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:04.628007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:04.628519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:04.629759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:04.630252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:04.630671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:04.783849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:04.793496 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-05467680-2a91-40d4-a06d-16e6d22f9613 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.178903 Oct 27 10:03:04.794259 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3500/7072] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:04 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:05.819613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:05.820298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:05.829293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:05.829844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:05.830403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:05.831440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:05.832593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:05.833046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:05.985864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:06.000992 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c68136a2-7270-4f48-9b1e-42c0a3ac0040 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.185608 Oct 27 10:03:06.002080 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3573/7073] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:05 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:07.026036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:07.026839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:07.035367 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:07.035962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:07.036457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:07.037429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:07.037997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:07.038486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:07.190732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:07.205321 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e151294e-a0f2-4f39-8a9b-d45433f6f360 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.183224 Oct 27 10:03:07.206686 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3501/7074] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:07 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:08.245853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:08.246621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:08.255267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:08.255963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:08.256477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:08.257468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:08.258013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:08.258498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:08.419183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:08.428665 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f59559e-b2d0-4640-a255-bd736089b5c4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1515 microversion: 2.1 time: 0.186817 Oct 27 10:03:08.429275 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3574/7075] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:08 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:03:09.454127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:09.454973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:09.463024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:09.463339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:09.463841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:09.464595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:09.465069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:09.465514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:09.750261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:09.758723 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9aa31825-db2e-4932-b98e-81582199c62a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1514 microversion: 2.1 time: 0.308709 Oct 27 10:03:09.759549 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3502/7076] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:09 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:09.855717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ca8d4ff0-a269-416a-a43a-24168c8795e3 req-aa4115d5-cbdc-4e54-b9da-ceb012f057c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34a7dd5-22e8-453e-8f36-a92edaed70ba", "name": "network-vif-unplugged", "status": "completed", "tag": "1b1b3777-26f1-4c2c-b884-2332f49cee0c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:03:09.865820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ca8d4ff0-a269-416a-a43a-24168c8795e3 req-aa4115d5-cbdc-4e54-b9da-ceb012f057c7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:09.866311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ca8d4ff0-a269-416a-a43a-24168c8795e3 req-aa4115d5-cbdc-4e54-b9da-ceb012f057c7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:09.866820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ca8d4ff0-a269-416a-a43a-24168c8795e3 req-aa4115d5-cbdc-4e54-b9da-ceb012f057c7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:09.884902 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ca8d4ff0-a269-416a-a43a-24168c8795e3 req-aa4115d5-cbdc-4e54-b9da-ceb012f057c7 service nova] Creating event network-vif-unplugged:1b1b3777-26f1-4c2c-b884-2332f49cee0c for instance d34a7dd5-22e8-453e-8f36-a92edaed70ba on n-h2-858383-16 Oct 27 10:03:09.891377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-ca8d4ff0-a269-416a-a43a-24168c8795e3 req-aa4115d5-cbdc-4e54-b9da-ceb012f057c7 service nova] Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:03:09.905762 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ca8d4ff0-a269-416a-a43a-24168c8795e3 req-aa4115d5-cbdc-4e54-b9da-ceb012f057c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054792 Oct 27 10:03:09.906658 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3575/7077] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:03:10.783193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:10.783859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:10.792156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:10.792677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:10.793107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:10.793827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:10.794287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:10.794720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:10.946040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:10.954162 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d0cfd4a1-4c72-4b14-a9a3-6253e8d9e8f3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1514 microversion: 2.1 time: 0.175102 Oct 27 10:03:10.954771 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3503/7078] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:10 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:11.936806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-45458fa3-31e7-4542-aee6-6e355f39420d req-aed3ad7b-88a5-406e-9a5c-df0cc061e6da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34a7dd5-22e8-453e-8f36-a92edaed70ba", "tag": "1b1b3777-26f1-4c2c-b884-2332f49cee0c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:03:11.948465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-45458fa3-31e7-4542-aee6-6e355f39420d req-aed3ad7b-88a5-406e-9a5c-df0cc061e6da service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:11.949094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-45458fa3-31e7-4542-aee6-6e355f39420d req-aed3ad7b-88a5-406e-9a5c-df0cc061e6da service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:11.949511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-45458fa3-31e7-4542-aee6-6e355f39420d req-aed3ad7b-88a5-406e-9a5c-df0cc061e6da service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:11.963525 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-45458fa3-31e7-4542-aee6-6e355f39420d req-aed3ad7b-88a5-406e-9a5c-df0cc061e6da service nova] Creating event network-changed:1b1b3777-26f1-4c2c-b884-2332f49cee0c for instance d34a7dd5-22e8-453e-8f36-a92edaed70ba on n-h2-858383-16 Oct 27 10:03:11.969826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-45458fa3-31e7-4542-aee6-6e355f39420d req-aed3ad7b-88a5-406e-9a5c-df0cc061e6da service nova] Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:03:11.983492 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-45458fa3-31e7-4542-aee6-6e355f39420d req-aed3ad7b-88a5-406e-9a5c-df0cc061e6da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051647 Oct 27 10:03:11.984293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:11.985059 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3576/7079] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:03:11.990499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:11.999804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:12.000571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:12.001148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:12.002042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:12.002728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:12.003362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:12.274872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:12.284514 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fad8441-c125-453f-9c4d-c7b4bb498be4 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1512 microversion: 2.1 time: 0.307831 Oct 27 10:03:12.285844 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3504/7080] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:11 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:03:13.326760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:13.327594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:13.335045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:13.335800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:13.336350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:13.337163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:13.337716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:13.338265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:13.615558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:13.627875 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cde28926-e2c6-44eb-a6ac-9b66ee0915d9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1512 microversion: 2.1 time: 0.306893 Oct 27 10:03:13.629439 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3577/7081] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:13 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:14.657535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:14.658480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:14.666669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:14.667180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:14.667688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:14.668418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:14.668960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:14.669402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:14.845997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:14.855687 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91096fe9-6965-4594-a99a-50209db91057 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1509 microversion: 2.1 time: 0.202734 Oct 27 10:03:14.856305 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3505/7082] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:14 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:03:14.879344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:14.880119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:14.888224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:14.888786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:14.889377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:14.890283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:14.891016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:14.891744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:14.921932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:03:14.994006 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.api [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Found an unconfirmed migration during delete, id: 16, status: finished Oct 27 10:03:16.651068 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7100f4e4-eaf5-4e44-a75e-aa538157ea5e tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 204 len: 0 microversion: 2.1 time: 1.775892 Oct 27 10:03:16.652147 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3578/7083] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:03:14 2022] DELETE /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 0 bytes in 1778 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:03:16.662786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:16.664492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:16.673912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:16.674566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:16.675279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:16.676200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:16.676722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:16.677222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:16.835319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:16.843540 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa96bd5c-9332-4f13-bab8-6aedb7d1373a tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1501 microversion: 2.1 time: 0.186855 Oct 27 10:03:16.844186 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3506/7084] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:16 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:17.491244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-82c4ae77-857b-4ef8-be64-16ec9bea79a5 req-7e53c475-d63c-4dc3-b9d0-d36a266815d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34a7dd5-22e8-453e-8f36-a92edaed70ba", "name": "network-vif-plugged", "status": "completed", "tag": "1b1b3777-26f1-4c2c-b884-2332f49cee0c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:03:17.505374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-82c4ae77-857b-4ef8-be64-16ec9bea79a5 req-7e53c475-d63c-4dc3-b9d0-d36a266815d6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:17.506071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-82c4ae77-857b-4ef8-be64-16ec9bea79a5 req-7e53c475-d63c-4dc3-b9d0-d36a266815d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:17.507008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-82c4ae77-857b-4ef8-be64-16ec9bea79a5 req-7e53c475-d63c-4dc3-b9d0-d36a266815d6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:17.526450 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-82c4ae77-857b-4ef8-be64-16ec9bea79a5 req-7e53c475-d63c-4dc3-b9d0-d36a266815d6 service nova] Creating event network-vif-plugged:1b1b3777-26f1-4c2c-b884-2332f49cee0c for instance d34a7dd5-22e8-453e-8f36-a92edaed70ba on n-h2-858383-16 Oct 27 10:03:17.536114 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-82c4ae77-857b-4ef8-be64-16ec9bea79a5 req-7e53c475-d63c-4dc3-b9d0-d36a266815d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048544 Oct 27 10:03:17.537274 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3579/7085] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:03:17.866856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:17.867704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:17.879750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:17.880632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:17.881417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:17.882728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:17.883836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:17.884632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:18.051049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fab0062f1e04e3ea417c06a648ca800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8549c0102d6b4524932c0e8ad312c762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:18.061180 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d5a7f5a-e686-411b-b227-187813ea08e3 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 200 len: 1501 microversion: 2.1 time: 0.198439 Oct 27 10:03:18.061789 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3507/7086] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:17 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:18.765710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ce8c6f7a-cfe5-4bbb-a358-6caad5935c6b req-7f0f8e6d-6584-4f7d-9ec6-8566e369329f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34a7dd5-22e8-453e-8f36-a92edaed70ba", "name": "network-vif-deleted", "tag": "1b1b3777-26f1-4c2c-b884-2332f49cee0c"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:03:18.776560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ce8c6f7a-cfe5-4bbb-a358-6caad5935c6b req-7f0f8e6d-6584-4f7d-9ec6-8566e369329f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:18.777059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ce8c6f7a-cfe5-4bbb-a358-6caad5935c6b req-7f0f8e6d-6584-4f7d-9ec6-8566e369329f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:18.777765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ce8c6f7a-cfe5-4bbb-a358-6caad5935c6b req-7f0f8e6d-6584-4f7d-9ec6-8566e369329f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:18.794668 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ce8c6f7a-cfe5-4bbb-a358-6caad5935c6b req-7f0f8e6d-6584-4f7d-9ec6-8566e369329f service nova] Creating event network-vif-deleted:1b1b3777-26f1-4c2c-b884-2332f49cee0c for instance d34a7dd5-22e8-453e-8f36-a92edaed70ba on n-h2-858383-16 Oct 27 10:03:18.805637 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ce8c6f7a-cfe5-4bbb-a358-6caad5935c6b req-7f0f8e6d-6584-4f7d-9ec6-8566e369329f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046032 Oct 27 10:03:18.807188 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3580/7087] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:03:19.090277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:19.091357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:19.102012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:19.102739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:19.103303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:19.104244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:19.104867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:19.105392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:19.121508 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] HTTP exception thrown: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Request method failure captured: Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba HTTP/1.1 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlcykKA9VF_cl2Px9nYwA33kQv33KUl2W3_nBjHmu9oLpgJQZ2NUHks3H_dLpvweIZsf0WtW0-Kny2bcCgZvwdLsN9c7uAz2Qb5yUNY04yPIwLPf3f6sCA1cWb2mn2G_iiHQfx_z39LaKJ0q_Zn22G5aRPopjuBwAarOsXzJxDP7Nlw Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 8549c0102d6b4524932c0e8ad312c762 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-431288253 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8549c0102d6b4524932c0e8ad312c762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8549c0102d6b4524932c0e8ad312c762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8549c0102d6b4524932c0e8ad312c762"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8549c0102d6b4524932c0e8ad312c762"}]}] Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-431288253 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 8549c0102d6b4524932c0e8ad312c762 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-431288253 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-431288253-project Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 6fab0062f1e04e3ea417c06a648ca800 Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-431288253-project Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd34a7dd5-22e8-453e-8f36-a92edaed70ba'} Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:03:19.123219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Returning 404 to user: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c2bdfd7-ee99-4193-8b3c-10e7a81ee4f2 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 404 len: 111 microversion: 2.1 time: 0.042078 Oct 27 10:03:19.131007 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3508/7088] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:19 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:03:19.146335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:19.146963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:19.153886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:19.154395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:19.154883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:19.155664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:19.156144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:19.156587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:19.172159 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] HTTP exception thrown: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Request method failure captured: Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba HTTP/1.1 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlcykKA9VF_cl2Px9nYwA33kQv33KUl2W3_nBjHmu9oLpgJQZ2NUHks3H_dLpvweIZsf0WtW0-Kny2bcCgZvwdLsN9c7uAz2Qb5yUNY04yPIwLPf3f6sCA1cWb2mn2G_iiHQfx_z39LaKJ0q_Zn22G5aRPopjuBwAarOsXzJxDP7Nlw Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 8549c0102d6b4524932c0e8ad312c762 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-DeleteServersTestJSON-431288253 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8549c0102d6b4524932c0e8ad312c762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8549c0102d6b4524932c0e8ad312c762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8549c0102d6b4524932c0e8ad312c762"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8549c0102d6b4524932c0e8ad312c762"}]}] Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-DeleteServersTestJSON-431288253 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 8549c0102d6b4524932c0e8ad312c762 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-DeleteServersTestJSON-431288253 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-DeleteServersTestJSON-431288253-project Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 6fab0062f1e04e3ea417c06a648ca800 Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-DeleteServersTestJSON-431288253-project Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'd34a7dd5-22e8-453e-8f36-a92edaed70ba'} Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:03:19.173915 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Returning 404 to user: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9772ac2e-330e-49f5-90aa-3ca91bd72ee9 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 404 len: 111 microversion: 2.1 time: 0.035832 Oct 27 10:03:19.178982 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3581/7089] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:03:19 2022] DELETE /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:03:19.185933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:19.186554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] [instance: d34a7dd5-22e8-453e-8f36-a92edaed70ba] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:19.193186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:19.193682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:19.194143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:19.194852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:19.195312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:19.195782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:19.211065 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] HTTP exception thrown: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Request method failure captured: Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba HTTP/1.1 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlcykKA9VF_cl2Px9nYwA33kQv33KUl2W3_nBjHmu9oLpgJQZ2NUHks3H_dLpvweIZsf0WtW0-Kny2bcCgZvwdLsN9c7uAz2Qb5yUNY04yPIwLPf3f6sCA1cWb2mn2G_iiHQfx_z39LaKJ0q_Zn22G5aRPopjuBwAarOsXzJxDP7Nlw Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 8549c0102d6b4524932c0e8ad312c762 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-431288253 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8549c0102d6b4524932c0e8ad312c762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8549c0102d6b4524932c0e8ad312c762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8549c0102d6b4524932c0e8ad312c762"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8549c0102d6b4524932c0e8ad312c762"}]}] Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-431288253 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 8549c0102d6b4524932c0e8ad312c762 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-431288253 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-431288253-project Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 6fab0062f1e04e3ea417c06a648ca800 Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-431288253-project Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'd34a7dd5-22e8-453e-8f36-a92edaed70ba'} Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:03:19.212677 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] Returning 404 to user: Instance d34a7dd5-22e8-453e-8f36-a92edaed70ba could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2edd2c56-e495-4ca4-ace9-5a22df4cde09 tempest-DeleteServersTestJSON-431288253 tempest-DeleteServersTestJSON-431288253-project] 10.222.0.25 "GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba" status: 404 len: 111 microversion: 2.1 time: 0.032703 Oct 27 10:03:19.217346 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3509/7090] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:19 2022] GET /compute/v2.1/servers/d34a7dd5-22e8-453e-8f36-a92edaed70ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:03:30.962557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:30.969896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:31.168100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1958044936", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "973f00cf-a86f-47cb-a528-d2443a46d08b"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:03:31.266989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] validate_networks() for [('973f00cf-a86f-47cb-a528-d2443a46d08b', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:03:31.778390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:03:31.778856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:03:31.779708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:03:31.780167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:03:31.780657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:03:31.791073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:31.791600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:31.792060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:31.793111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:31.793624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:31.794071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:31.819331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Getting quotas for project 433b439c632e421ead863dfe056cd739. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:03:31.830356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Getting quotas for user de859cd28fee4674a5e40723d42afb9e and project 433b439c632e421ead863dfe056cd739. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:03:31.849475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:03:31.852039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:03:31.925339 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c5069bd2-756c-41aa-817d-600502bf1a64 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969117 Oct 27 10:03:31.927140 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3582/7091] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:03:31.948399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a55706c-564e-4fcc-b13c-abfd5fd7c0e3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:31.949541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a55706c-564e-4fcc-b13c-abfd5fd7c0e3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:31.954549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=23 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:31.956701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=65 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:32.039681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a55706c-564e-4fcc-b13c-abfd5fd7c0e3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:32.051222 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a55706c-564e-4fcc-b13c-abfd5fd7c0e3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1218 microversion: 2.1 time: 0.111465 Oct 27 10:03:32.052999 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3510/7092] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:31 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:33.091597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:33.092499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:33.100245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:33.100908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:33.101586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:33.102449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:33.103011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:33.103528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:33.181072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:33.192640 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b3b34f4-b321-4b8e-be82-e9cd300426da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1270 microversion: 2.1 time: 0.105726 Oct 27 10:03:33.193302 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3583/7093] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:33 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:34.220528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:34.222082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:34.234016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:34.234659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:34.235310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:34.236230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:34.237510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:34.238167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:34.653339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:34.665861 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c10969a8-0c6b-4d0a-84b0-04c3c83a8dbf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1276 microversion: 2.1 time: 0.451168 Oct 27 10:03:34.667215 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3511/7094] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:34 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1276 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:35.696740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:35.697761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:35.709678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:35.711088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:35.712388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:35.713543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:35.714445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:35.715355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:36.060288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:36.069732 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3ab159d9-278e-4d07-8870-9a6e2a4e01da tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1318 microversion: 2.1 time: 0.379150 Oct 27 10:03:36.070137 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3584/7095] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:35 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:36.120617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f4d6cb0c-2091-452f-b9ff-d9c60becc9aa req-187db058-71b0-482b-b60a-427960c39b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e3abfbb-ec16-4469-8381-d5e6bcc990bd", "tag": "6898b160-0a28-4383-818e-a522c773f71b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:03:36.138758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f4d6cb0c-2091-452f-b9ff-d9c60becc9aa req-187db058-71b0-482b-b60a-427960c39b0e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:36.139989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f4d6cb0c-2091-452f-b9ff-d9c60becc9aa req-187db058-71b0-482b-b60a-427960c39b0e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:36.140922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f4d6cb0c-2091-452f-b9ff-d9c60becc9aa req-187db058-71b0-482b-b60a-427960c39b0e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:36.168666 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f4d6cb0c-2091-452f-b9ff-d9c60becc9aa req-187db058-71b0-482b-b60a-427960c39b0e service nova] Creating event network-changed:6898b160-0a28-4383-818e-a522c773f71b for instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd on n-h1-858383-16 Oct 27 10:03:36.185752 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f4d6cb0c-2091-452f-b9ff-d9c60becc9aa req-187db058-71b0-482b-b60a-427960c39b0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068866 Oct 27 10:03:36.187539 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3512/7096] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:03:37.103447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:37.104249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:37.112400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:37.112915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:37.113437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:37.114213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:37.114714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:37.115157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:37.273345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:37.286584 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2df84d01-dc91-4327-aab3-c7e325fa99cd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1318 microversion: 2.1 time: 0.186733 Oct 27 10:03:37.287705 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3585/7097] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:37 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:38.312123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:38.312955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:38.320233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:38.320719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:38.321158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:38.321875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:38.322356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:38.322788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:38.475615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:38.483503 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62328619-088b-4fed-b44f-8484e8bcca78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1318 microversion: 2.1 time: 0.176632 Oct 27 10:03:38.484135 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3513/7098] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:38 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:39.509867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:39.510860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:39.519989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:39.520604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:39.521081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:39.521858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:39.522351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:39.522799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:39.678211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:39.686665 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-397ff2a5-d7b2-4ee2-8d18-ba40dea7af72 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1318 microversion: 2.1 time: 0.181659 Oct 27 10:03:39.687277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3586/7099] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:39 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:03:40.710870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:40.711929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:40.719591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:40.720086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:40.720529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:40.721258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:40.721719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:40.722155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:40.879903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:40.888570 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51c498c2-b3dc-44ea-a59a-9974bc5b2d8e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1318 microversion: 2.1 time: 0.181680 Oct 27 10:03:40.889192 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3514/7100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:40 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:41.913517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:41.914206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:41.917855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:41.918630 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:41.926562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:41.927311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:41.927915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:41.928691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:41.929176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:41.929629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:42.121971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:42.132588 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33b0f71c-f2d9-47fe-944f-e8277bb9dfb0 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1318 microversion: 2.1 time: 0.223905 Oct 27 10:03:42.133433 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3587/7101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:41 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:43.156768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:43.157636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:43.160933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:43.161818 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:03:43.162037 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:03:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd (ip 10.222.0.25) !!! Oct 27 10:03:43.173712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:43.174781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:43.175235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:43.176002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:43.176462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:43.176896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:43.336237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:43.346325 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29ae84e1-6570-435d-8666-1edcbaedc0cf tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1318 microversion: 2.1 time: 0.193064 Oct 27 10:03:43.346958 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3515/7102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:43 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:43.618053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2f1eb238-2915-4860-9014-04c015eb69e3 req-00a983ca-7983-43dd-aee9-9282ac7393e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3abfbb-ec16-4469-8381-d5e6bcc990bd", "name": "network-vif-plugged", "status": "completed", "tag": "6898b160-0a28-4383-818e-a522c773f71b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:03:43.631674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2f1eb238-2915-4860-9014-04c015eb69e3 req-00a983ca-7983-43dd-aee9-9282ac7393e4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:43.632323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2f1eb238-2915-4860-9014-04c015eb69e3 req-00a983ca-7983-43dd-aee9-9282ac7393e4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:43.632907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2f1eb238-2915-4860-9014-04c015eb69e3 req-00a983ca-7983-43dd-aee9-9282ac7393e4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:43.648731 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2f1eb238-2915-4860-9014-04c015eb69e3 req-00a983ca-7983-43dd-aee9-9282ac7393e4 service nova] Creating event network-vif-plugged:6898b160-0a28-4383-818e-a522c773f71b for instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd on n-h1-858383-16 Oct 27 10:03:43.654207 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2f1eb238-2915-4860-9014-04c015eb69e3 req-00a983ca-7983-43dd-aee9-9282ac7393e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040536 Oct 27 10:03:43.655016 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3588/7103] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:03:44.374710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:44.376113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:44.390359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:44.391780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:44.392632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:44.394157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:44.395005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:44.395886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:44.596708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:44.611537 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dddcb72c-0308-4c84-bad8-63c7cbf6d70c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1318 microversion: 2.1 time: 0.244094 Oct 27 10:03:44.621556 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3516/7104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:44 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:45.654571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:45.655303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:45.662810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:45.663322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:45.663825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:45.664571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:45.665043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:45.665516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:45.861319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:45.869757 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7df0acf2-8db1-4788-9541-47ce2ba5f626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1508 microversion: 2.1 time: 0.220553 Oct 27 10:03:45.870433 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3589/7105] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:45 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:45.894770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:45.895646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:45.903243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:45.903815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:45.904266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:45.905023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:45.905490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:45.905926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.075845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:46.085135 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-10545e23-cc4f-4184-b5f6-f678b51f5391 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1508 microversion: 2.1 time: 0.195355 Oct 27 10:03:46.085902 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3517/7106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:45 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:46.109109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7eb1ebc4-9e07-4a77-9c0c-104b8cb8ee7a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:03:46.112451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7eb1ebc4-9e07-4a77-9c0c-104b8cb8ee7a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:46.119010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb1ebc4-9e07-4a77-9c0c-104b8cb8ee7a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.119604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb1ebc4-9e07-4a77-9c0c-104b8cb8ee7a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.120112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb1ebc4-9e07-4a77-9c0c-104b8cb8ee7a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.120961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb1ebc4-9e07-4a77-9c0c-104b8cb8ee7a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.121492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb1ebc4-9e07-4a77-9c0c-104b8cb8ee7a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.121981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7eb1ebc4-9e07-4a77-9c0c-104b8cb8ee7a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.193501 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7eb1ebc4-9e07-4a77-9c0c-104b8cb8ee7a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "PUT /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1080 microversion: 2.1 time: 0.088790 Oct 27 10:03:46.194172 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3590/7107] 10.222.0.25 () {60 vars in 1256 bytes} [Thu Oct 27 10:03:46 2022] PUT /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1080 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:03:46.229836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:46.231006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:46.242557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.243417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.244206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.245500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.246327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.247099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.422828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:46.432782 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9e4eda3-f16f-4dd7-a525-5076d957f1ad tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1506 microversion: 2.1 time: 0.210345 Oct 27 10:03:46.433399 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3518/7108] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:46 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:46.456385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:46.457038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:46.463874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.464394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.464861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.465611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.466087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.466541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.640012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:46.649254 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-53c1aa3b-c1bf-4e55-810f-a018d2a96973 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1506 microversion: 2.1 time: 0.197774 Oct 27 10:03:46.649858 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3591/7109] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:46 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:03:46.672341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:03:46.675827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:46.682758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.683259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.683743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.684481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.684948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.685384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.719974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:46.726840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Old instance type m1.heat2, new instance type m1.heat {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:03:46.735160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:03:46.735617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:03:46.736116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:03:46.737082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:03:46.737502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:03:46.810652 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45766ab7-fb62-45e9-a7cf-707912c97ce1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "POST /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd/action" status: 202 len: 0 microversion: 2.1 time: 0.142955 Oct 27 10:03:46.811286 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3519/7110] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:03:46 2022] POST /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:03:46.824996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:46.825971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:46.838265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.839188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.839854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:46.840718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:46.841255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:46.841755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:47.017481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:47.034234 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-63693e2e-8fd6-4d59-a121-9da7e0465d3a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1517 microversion: 2.1 time: 0.215882 Oct 27 10:03:47.035429 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3592/7111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:46 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1517 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:48.073482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:48.074283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:48.082807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:48.083318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:48.083819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:48.084550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:48.085018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:48.085462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:48.280212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:48.298168 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7db5fb11-3d33-4689-8e48-da50c38f326e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1517 microversion: 2.1 time: 0.228459 Oct 27 10:03:48.299279 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3520/7112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:48 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1517 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:49.342255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:49.343422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:49.357155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:49.358198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:49.358980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:49.360581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:49.362049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:49.362867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:49.552675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:49.561546 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-36950778-48eb-44ab-9a5f-3e8987b90c17 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.227030 Oct 27 10:03:49.562154 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3593/7113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:49 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:50.587983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:50.588958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:50.596572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:50.597096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:50.597511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:50.598234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:50.598695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:50.599130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:50.750503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:50.759790 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f0e56fe-8b49-404f-afb4-22aa4eb70b16 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.175708 Oct 27 10:03:50.760407 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3521/7114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:50 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:51.784035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:51.784766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:51.792303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:51.792818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:51.793279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:51.794022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:51.794499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:51.794973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:51.945958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:51.955055 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-76fe2d6c-00a9-4027-9793-2338e29e66f9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.175009 Oct 27 10:03:51.955766 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3594/7115] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:51 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:52.979207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:52.980315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:52.987976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:52.988482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:52.988936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:52.989669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:52.990137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:52.990567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:53.148096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:53.156904 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bb854eda-b2b5-4fe2-885b-d6266e09a3f4 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.181862 Oct 27 10:03:53.157519 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3522/7116] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:52 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:54.185063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:54.186200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:54.199957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:54.200841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:54.201535 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:54.202708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:54.203595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:54.204356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:54.386048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:54.395288 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d4ea8eaa-4800-4c9d-8e0d-c1e72af4e83f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.217547 Oct 27 10:03:54.396105 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3595/7117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:54 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:55.420260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:55.420928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:55.428988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:55.429478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:55.429921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:55.430649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:55.431112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:55.431547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:55.603761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:55.612333 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14d65c3a-db85-4f56-ac48-8d8248c8aa38 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.196021 Oct 27 10:03:55.612934 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3523/7118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:55 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:03:56.653607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:56.654355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:56.661493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:56.661997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:56.662459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:56.663223 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:56.663793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:56.664249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:56.815984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:56.826082 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ece5471a-7c83-4d81-b9c1-cc43e321f764 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.176742 Oct 27 10:03:56.826688 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3596/7119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:56 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:57.850926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:57.851603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:57.859312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:57.859725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:57.860176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:57.860901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:57.861878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:57.862320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:58.018411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:58.033677 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88f72abf-ce27-470f-9eb9-700b0dc68430 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.185658 Oct 27 10:03:58.034544 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3524/7120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:57 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:03:59.057990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:03:59.058836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:03:59.067304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:59.067858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:59.068324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:59.069084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:03:59.069568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:03:59.070016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:03:59.222173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:03:59.231526 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-588e2ffc-fe00-4920-bd6f-2799b6eed18a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.177593 Oct 27 10:03:59.232261 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3597/7121] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:03:59 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:00.256460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:00.257165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:00.264650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:00.265156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:00.265607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:00.266400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:00.266867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:00.267352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:00.458548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:00.467547 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a8c62a7-5199-450f-9824-f9126b5e00e6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.215563 Oct 27 10:04:00.468201 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3525/7122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:00 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:01.491920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:01.492734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:01.495691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:01.503333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:01.503842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:01.504305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:01.505058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:01.505539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:01.505989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:01.509753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:01.665916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:01.675201 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-476e3ac4-c1ba-4a3d-bf17-361e4cfd7022 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.187711 Oct 27 10:04:01.675853 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3598/7123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:01 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:02.700437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:02.701030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:02.704044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=39 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:02.710150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:02.710653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:02.711100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:02.711894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:02.712361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:02.712795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:02.716147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:02.876632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:02.891306 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-343bba78-fd22-4420-83b1-626166824c68 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.194528 Oct 27 10:04:02.892513 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3526/7124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:02 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:03.916678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:03.917396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:03.925275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:03.925916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:03.926427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:03.927220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:03.927808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:03.928301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:04.082046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:04.091172 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-641ba95e-f93c-4cca-a6e9-9f155dec8d81 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.178506 Oct 27 10:04:04.092167 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3599/7125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:03 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:05.116818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:05.117436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:05.124437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:05.124930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:05.125376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:05.126109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:05.126611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:05.127045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:05.290599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:05.305507 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b68258ee-5f5c-4774-809f-dda78b7c2772 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.192344 Oct 27 10:04:05.306572 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3527/7126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:05 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:06.332034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:06.332721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:06.343829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:06.344740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:06.346188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:06.347180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:06.347829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:06.348376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:06.493904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:06.503498 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9db25eab-440d-4186-8117-227e22e455ce tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.176019 Oct 27 10:04:06.504315 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3600/7127] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:06 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:07.530049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:07.530685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:07.539318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:07.539865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:07.540315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:07.541047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:07.541513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:07.541948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:07.693004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:07.702269 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d99c2c0-6f76-4937-b609-02b1ec34b560 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.176146 Oct 27 10:04:07.703016 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3528/7128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:07 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:08.727937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:08.728688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:08.736115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:08.736623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:08.737074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:08.737804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:08.738268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:08.738703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:08.890414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:08.900463 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bcc2d3d8-758f-4867-a2de-cd3ee0544150 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.176602 Oct 27 10:04:08.901083 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3601/7129] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:08 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:09.934982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:09.935683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:09.943949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:09.944441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:09.945676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:09.946420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:09.946886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:09.947314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:10.107732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:10.116989 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-57b76bf9-653e-4775-ad6c-29f942e7bf86 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.185888 Oct 27 10:04:10.117620 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3529/7130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:09 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:11.140515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:11.141282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:11.149128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:11.149728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:11.150183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:11.150908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:11.151376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:11.151836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:11.307661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:11.316260 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8552ce1e-36f8-4f11-ab89-2cd52985be00 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.179997 Oct 27 10:04:11.317050 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3602/7131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:11 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:12.342346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:12.343389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:12.352323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:12.352825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:12.353278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:12.354006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:12.354470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:12.354903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:12.514359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:12.528680 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33568483-3721-4505-ae7d-c1deef8538c3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.190224 Oct 27 10:04:12.529769 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3530/7132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:12 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:13.555649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:13.556462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:13.563921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:13.564427 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:13.564886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:13.565633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:13.566106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:13.566626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:13.728230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:13.737471 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c496c71-236e-42b8-9a95-0ed5b783f56b tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.186502 Oct 27 10:04:13.738211 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3603/7133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:13 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:14.763265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:14.764333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:14.773005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:14.773547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:14.774062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:14.775009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:14.775523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:14.776037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:14.929353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:14.939150 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c68c1646-0b59-4954-b1cb-8f7aee968356 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1522 microversion: 2.1 time: 0.179449 Oct 27 10:04:14.939834 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3531/7134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:14 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:15.980203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:15.981106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:15.991966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:15.992842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:15.993675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:15.994857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:15.995495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:15.996066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:16.260242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:16.269412 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ef9f29f7-8906-4a76-8e2b-c5781bd79ba3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1521 microversion: 2.1 time: 0.295981 Oct 27 10:04:16.270056 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3604/7135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:15 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:16.573499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-387e740d-bd75-45c7-bc56-91a78af1c65e req-b7cca197-ce5f-4752-beda-6c754f7f9fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3abfbb-ec16-4469-8381-d5e6bcc990bd", "name": "network-vif-unplugged", "status": "completed", "tag": "6898b160-0a28-4383-818e-a522c773f71b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:16.587405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-387e740d-bd75-45c7-bc56-91a78af1c65e req-b7cca197-ce5f-4752-beda-6c754f7f9fa5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:16.588306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-387e740d-bd75-45c7-bc56-91a78af1c65e req-b7cca197-ce5f-4752-beda-6c754f7f9fa5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:16.588863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-387e740d-bd75-45c7-bc56-91a78af1c65e req-b7cca197-ce5f-4752-beda-6c754f7f9fa5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:16.606683 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-387e740d-bd75-45c7-bc56-91a78af1c65e req-b7cca197-ce5f-4752-beda-6c754f7f9fa5 service nova] Creating event network-vif-unplugged:6898b160-0a28-4383-818e-a522c773f71b for instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd on n-h2-858383-16 Oct 27 10:04:16.615695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-387e740d-bd75-45c7-bc56-91a78af1c65e req-b7cca197-ce5f-4752-beda-6c754f7f9fa5 service nova] Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:04:16.631268 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-387e740d-bd75-45c7-bc56-91a78af1c65e req-b7cca197-ce5f-4752-beda-6c754f7f9fa5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061895 Oct 27 10:04:16.632187 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3532/7136] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:04:17.298355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:17.299689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:17.314004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:17.314816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:17.315660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:17.316986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:17.317900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:17.318702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:17.580729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:17.589723 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99d9028e-b6f2-43bb-b15b-becf0496f519 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1521 microversion: 2.1 time: 0.298320 Oct 27 10:04:17.590512 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3605/7137] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:17 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:18.631099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:18.631783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:18.640490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:18.640995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:18.641454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:18.642926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:18.643370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:18.643995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:18.652829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-97a8aad5-e1c5-49a6-921c-d5130f67f6e1 req-ab956a62-852b-4dd4-a221-52638ae609b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e3abfbb-ec16-4469-8381-d5e6bcc990bd", "tag": "6898b160-0a28-4383-818e-a522c773f71b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:18.665533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-97a8aad5-e1c5-49a6-921c-d5130f67f6e1 req-ab956a62-852b-4dd4-a221-52638ae609b9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:18.666163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-97a8aad5-e1c5-49a6-921c-d5130f67f6e1 req-ab956a62-852b-4dd4-a221-52638ae609b9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:18.666799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-97a8aad5-e1c5-49a6-921c-d5130f67f6e1 req-ab956a62-852b-4dd4-a221-52638ae609b9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:18.688064 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-97a8aad5-e1c5-49a6-921c-d5130f67f6e1 req-ab956a62-852b-4dd4-a221-52638ae609b9 service nova] Creating event network-changed:6898b160-0a28-4383-818e-a522c773f71b for instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd on n-h2-858383-16 Oct 27 10:04:18.698430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-97a8aad5-e1c5-49a6-921c-d5130f67f6e1 req-ab956a62-852b-4dd4-a221-52638ae609b9 service nova] Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:04:18.712113 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-97a8aad5-e1c5-49a6-921c-d5130f67f6e1 req-ab956a62-852b-4dd4-a221-52638ae609b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064241 Oct 27 10:04:18.712911 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3606/7138] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:04:18.916771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:18.933409 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d40ffe84-09f7-4e32-857c-61ddb1751626 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1519 microversion: 2.1 time: 0.307212 Oct 27 10:04:18.934379 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3533/7139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:18 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1519 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:19.963015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:19.963688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:19.971946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:19.972469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:19.972929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:19.973669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:19.974149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:19.974597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:20.133033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:20.141598 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5f769310-0b82-48dd-b682-2c4b440b2277 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1519 microversion: 2.1 time: 0.183028 Oct 27 10:04:20.142545 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3607/7140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:19 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:21.167481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:21.168526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:21.176844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:21.177354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:21.177809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:21.178682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:21.179154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:21.179643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:21.340045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:21.352077 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d2852dd-9e09-411b-acd3-2ebe5435fd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1516 microversion: 2.1 time: 0.189023 Oct 27 10:04:21.352832 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3534/7141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:21 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:21.376761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-019dc885-ee75-47d7-a696-2cc54304ad48 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:21.377348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-019dc885-ee75-47d7-a696-2cc54304ad48 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:21.384964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-019dc885-ee75-47d7-a696-2cc54304ad48 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:21.385393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-019dc885-ee75-47d7-a696-2cc54304ad48 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:21.385865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-019dc885-ee75-47d7-a696-2cc54304ad48 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:21.386615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-019dc885-ee75-47d7-a696-2cc54304ad48 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:21.387096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-019dc885-ee75-47d7-a696-2cc54304ad48 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:21.387541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-019dc885-ee75-47d7-a696-2cc54304ad48 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:21.470083 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-019dc885-ee75-47d7-a696-2cc54304ad48 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "POST /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd/action" status: 204 len: 0 microversion: 2.1 time: 0.097012 Oct 27 10:04:21.470963 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3608/7142] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:04:21 2022] POST /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd/action => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:04:21.481297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:21.482166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:21.491600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:21.492333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:21.492911 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:21.493813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:21.494549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:21.495136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:21.876629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:21.889983 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b1edfa0-a2ab-4c5e-aa28-67aa15be5477 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1516 microversion: 2.1 time: 0.413511 Oct 27 10:04:21.891113 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3535/7143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:21 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1516 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:22.934256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:22.935600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:22.949246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:22.950167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:22.950989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:22.952365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:22.953185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:22.954587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:23.145737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:23.161071 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b509487d-0f10-456f-91f9-222b81d77dec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1516 microversion: 2.1 time: 0.234436 Oct 27 10:04:23.162125 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3609/7144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:22 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:23.825171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-33cb8ecd-cfaa-4665-898c-5e5a7de42df3 req-08bd1d05-97dc-4567-9fd5-3ac4d33a4e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3abfbb-ec16-4469-8381-d5e6bcc990bd", "name": "network-vif-plugged", "status": "completed", "tag": "6898b160-0a28-4383-818e-a522c773f71b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:23.838660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-33cb8ecd-cfaa-4665-898c-5e5a7de42df3 req-08bd1d05-97dc-4567-9fd5-3ac4d33a4e74 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:23.839324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-33cb8ecd-cfaa-4665-898c-5e5a7de42df3 req-08bd1d05-97dc-4567-9fd5-3ac4d33a4e74 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:23.839833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-33cb8ecd-cfaa-4665-898c-5e5a7de42df3 req-08bd1d05-97dc-4567-9fd5-3ac4d33a4e74 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:23.859702 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-33cb8ecd-cfaa-4665-898c-5e5a7de42df3 req-08bd1d05-97dc-4567-9fd5-3ac4d33a4e74 service nova] Creating event network-vif-plugged:6898b160-0a28-4383-818e-a522c773f71b for instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd on n-h2-858383-16 Oct 27 10:04:23.866393 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-33cb8ecd-cfaa-4665-898c-5e5a7de42df3 req-08bd1d05-97dc-4567-9fd5-3ac4d33a4e74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044811 Oct 27 10:04:23.868213 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3536/7145] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:04:24.201624 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:24.202253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:24.210344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:24.210860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:24.211325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:24.212115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:24.212591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:24.213040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:24.388397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:24.405930 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c674ff14-9746-4a00-8317-d9e17d62856f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1508 microversion: 2.1 time: 0.207963 Oct 27 10:04:24.406998 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3610/7146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:24 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:24.449814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:24.451397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:24.463757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:24.464546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:24.465326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:24.466569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:24.467410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:24.468246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:24.659706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:24.668264 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0d448473-808a-4f57-95ac-7d82238c50dd tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1508 microversion: 2.1 time: 0.226479 Oct 27 10:04:24.668869 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3537/7147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:24 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:24.695304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3535d1c5-ec4b-4962-9d59-537bee804e36 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Action: 'create', calling method: .version_select at 0x7f31aa3441f0>, body: {"keypair": {"name": "tempest-keypair-1836528528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+IVNcvTIQZP4SRoSCaGXPVnh9HtpjF8ITT3j4bmUZv+sYe5HdSwWIzJh0MDHfKHF3n25AmanREDK9nymxsv2lLSrgcHy4/lS+bN9Z62S9TrY9vGE8PnbvFZ49Q1ykl9A=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:24.717030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-3535d1c5-ec4b-4962-9d59-537bee804e36 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Getting quotas for project 433b439c632e421ead863dfe056cd739. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:04:24.726855 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-3535d1c5-ec4b-4962-9d59-537bee804e36 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Getting quotas for user de859cd28fee4674a5e40723d42afb9e and project 433b439c632e421ead863dfe056cd739. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:04:24.769827 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3535d1c5-ec4b-4962-9d59-537bee804e36 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078596 Oct 27 10:04:24.770455 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3611/7148] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:04:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:04:26.310467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:26.311313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:26.319307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:26.320009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:26.320747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:26.321906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:26.322691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:26.323211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:26.479620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:26.488291 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0fb934b-a3d3-4c60-89da-81165f1c4b4a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 200 len: 1508 microversion: 2.1 time: 0.182149 Oct 27 10:04:26.488900 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3538/7149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:26 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:26.512236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:26.512921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:26.520713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:26.521222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:26.521679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:26.522437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:26.522921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:26.523367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:26.553388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:04:26.651412 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-544bfed6-fcb7-4d92-9c37-a50619c3aeec tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 204 len: 0 microversion: 2.1 time: 0.143649 Oct 27 10:04:26.652570 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3612/7150] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:04:26 2022] DELETE /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:04:26.722601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-183276116", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "973f00cf-a86f-47cb-a528-d2443a46d08b"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:26.785339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] validate_networks() for [('973f00cf-a86f-47cb-a528-d2443a46d08b', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:04:27.253704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:04:27.254132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:04:27.254611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:04:27.255024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:04:27.255438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:04:27.265334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:27.265731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:27.266220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:27.266923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:27.267385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:27.267845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:27.287797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Getting quotas for project 433b439c632e421ead863dfe056cd739. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:04:27.294533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Getting quotas for user de859cd28fee4674a5e40723d42afb9e and project 433b439c632e421ead863dfe056cd739. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:04:27.311385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:04:27.313864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:04:27.364458 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7cfe296a-6774-40f0-8ac0-2f565049675a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645832 Oct 27 10:04:27.365132 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3539/7151] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:04:27.377690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-847086cb-4a2f-4ee9-b942-eda79896266f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:27.378607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-847086cb-4a2f-4ee9-b942-eda79896266f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:27.443685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-847086cb-4a2f-4ee9-b942-eda79896266f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:27.451356 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-847086cb-4a2f-4ee9-b942-eda79896266f tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1217 microversion: 2.1 time: 0.078364 Oct 27 10:04:27.452055 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3613/7152] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:27 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:28.484541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:28.487123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:28.501316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:28.502483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:28.503508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:28.505780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:28.507341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:28.508759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:28.736560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:28.746350 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bec773b5-5d38-4a93-86cb-dff947d3d23d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1277 microversion: 2.1 time: 0.273683 Oct 27 10:04:28.746991 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3540/7153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:28 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:29.397112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-039cd5f9-57fa-44f0-a2dc-39794eed49c7 req-c7ed23ec-883f-4842-a047-a8b4b835bdca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3abfbb-ec16-4469-8381-d5e6bcc990bd", "name": "network-vif-deleted", "tag": "6898b160-0a28-4383-818e-a522c773f71b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:29.436987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-039cd5f9-57fa-44f0-a2dc-39794eed49c7 req-c7ed23ec-883f-4842-a047-a8b4b835bdca service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:29.438073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-039cd5f9-57fa-44f0-a2dc-39794eed49c7 req-c7ed23ec-883f-4842-a047-a8b4b835bdca service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:29.439479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-039cd5f9-57fa-44f0-a2dc-39794eed49c7 req-c7ed23ec-883f-4842-a047-a8b4b835bdca service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:29.461187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:29.466209 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-039cd5f9-57fa-44f0-a2dc-39794eed49c7 req-c7ed23ec-883f-4842-a047-a8b4b835bdca service nova] Creating event network-vif-deleted:6898b160-0a28-4383-818e-a522c773f71b for instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd on n-h2-858383-16 Oct 27 10:04:29.477258 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-039cd5f9-57fa-44f0-a2dc-39794eed49c7 req-c7ed23ec-883f-4842-a047-a8b4b835bdca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089630 Oct 27 10:04:29.479268 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3614/7154] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:04:29.777337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:29.778463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:29.788450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:29.789749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:29.790478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:29.791453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:29.792466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:29.793297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:29.904783 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:29.915106 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aaceb5fd-fcb2-456f-affb-31b3b0704702 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1275 microversion: 2.1 time: 0.143967 Oct 27 10:04:29.916060 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3541/7155] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:29 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:30.960277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:30.961637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:30.977859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:30.978785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:30.979956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:30.992491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:30.993614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:30.996347 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:31.271559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:31.287036 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2bb67018-5f79-488e-a853-02914c6e77f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1317 microversion: 2.1 time: 0.335216 Oct 27 10:04:31.288222 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3615/7156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:30 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:31.508447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7b819626-f44c-4e8a-890e-7478dd347928 req-109159e1-eb88-42da-869f-2626733b5fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c2389b1-753c-48fa-8d3f-8af171429f5a", "tag": "0e41ad63-22fd-4519-86b0-b770fff9a8f5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:31.531554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7b819626-f44c-4e8a-890e-7478dd347928 req-109159e1-eb88-42da-869f-2626733b5fcc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:31.533012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7b819626-f44c-4e8a-890e-7478dd347928 req-109159e1-eb88-42da-869f-2626733b5fcc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:31.533836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7b819626-f44c-4e8a-890e-7478dd347928 req-109159e1-eb88-42da-869f-2626733b5fcc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:31.556943 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7b819626-f44c-4e8a-890e-7478dd347928 req-109159e1-eb88-42da-869f-2626733b5fcc service nova] Creating event network-changed:0e41ad63-22fd-4519-86b0-b770fff9a8f5 for instance 5c2389b1-753c-48fa-8d3f-8af171429f5a on n-h1-858383-16 Oct 27 10:04:31.566212 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7b819626-f44c-4e8a-890e-7478dd347928 req-109159e1-eb88-42da-869f-2626733b5fcc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064600 Oct 27 10:04:31.567322 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3542/7157] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:04:32.325280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:32.326069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:32.329534 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:32.335722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:32.336235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:32.336717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:32.337455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:32.337922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:32.338357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:32.491355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:32.499781 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f62addcb-7fe2-478a-ae0a-4d5a3e6c60f6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1317 microversion: 2.1 time: 0.178433 Oct 27 10:04:32.500394 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3616/7158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:32 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:33.525047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:33.525902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:33.527977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:33.535138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:33.535667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:33.536116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:33.536863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:33.537327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:33.537794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:33.541812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=88 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:33.775561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:33.785157 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1db69ea5-eb7d-4d30-acb4-68897269c68d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1317 microversion: 2.1 time: 0.265479 Oct 27 10:04:33.786368 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3543/7159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:33 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:34.824501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:34.825687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:34.835235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:34.835906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:34.836382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:34.837209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:34.837694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:34.838143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:35.019642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:35.028242 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-496c8a48-fbae-4c21-8b43-5d37c461c0b1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1317 microversion: 2.1 time: 0.207826 Oct 27 10:04:35.028842 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3617/7160] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:34 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:36.053247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:36.054032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:36.061017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:36.061562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:36.062052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:36.063463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:36.064002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:36.064480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:36.234377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:36.251409 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9a7f3816-c3a0-4509-bdf2-dc6381215fa6 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1317 microversion: 2.1 time: 0.201269 Oct 27 10:04:36.252567 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3544/7161] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:36 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:37.288906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:37.289657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:37.297085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:37.298115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:37.298574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:37.299308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:37.299819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:37.300267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:37.448167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:37.453874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:37.463267 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-762be301-e1d5-4de2-ada4-74afcc6d0e78 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1317 microversion: 2.1 time: 0.178189 Oct 27 10:04:37.464133 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3618/7162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:37 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:37.902834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c55900f9-aca8-4415-81d8-947ef943cb7f req-866300f7-8746-4e4d-94f3-6c45c675cf11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2389b1-753c-48fa-8d3f-8af171429f5a", "name": "network-vif-plugged", "status": "completed", "tag": "0e41ad63-22fd-4519-86b0-b770fff9a8f5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:37.910257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:37.911276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:37.922155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c55900f9-aca8-4415-81d8-947ef943cb7f req-866300f7-8746-4e4d-94f3-6c45c675cf11 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:37.922874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c55900f9-aca8-4415-81d8-947ef943cb7f req-866300f7-8746-4e4d-94f3-6c45c675cf11 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:37.923461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c55900f9-aca8-4415-81d8-947ef943cb7f req-866300f7-8746-4e4d-94f3-6c45c675cf11 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:37.939995 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c55900f9-aca8-4415-81d8-947ef943cb7f req-866300f7-8746-4e4d-94f3-6c45c675cf11 service nova] Creating event network-vif-plugged:0e41ad63-22fd-4519-86b0-b770fff9a8f5 for instance 5c2389b1-753c-48fa-8d3f-8af171429f5a on n-h1-858383-16 Oct 27 10:04:37.947364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c55900f9-aca8-4415-81d8-947ef943cb7f req-866300f7-8746-4e4d-94f3-6c45c675cf11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048651 Oct 27 10:04:37.948150 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3545/7163] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:04:38.489052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:38.490276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:38.501692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:38.502214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:38.502671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:38.503401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:38.503907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:38.504829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:38.699688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:38.710341 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d62f51f0-5075-4441-b585-ae1f85a069a5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1317 microversion: 2.1 time: 0.226686 Oct 27 10:04:38.711355 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3619/7164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:38 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:39.738648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:39.739411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:39.746527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:39.747027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:39.747473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:39.748241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:39.748704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:39.749135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:39.946313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:39.954736 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1cc56db2-6358-4af5-86b7-8285d0e5bf0d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1508 microversion: 2.1 time: 0.221432 Oct 27 10:04:39.955375 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3546/7165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:39 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:39.979220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:39.980090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:39.988440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:39.989001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:39.989444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:39.990178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:39.990657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:39.991105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:40.192397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:40.201062 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83096b45-9337-471f-ba3c-3d473adabc5e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1508 microversion: 2.1 time: 0.225804 Oct 27 10:04:40.201666 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3620/7166] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:39 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:40.242265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:04:40.246566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:40.257288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:40.258157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:40.258971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:40.260237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:40.261065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:40.261830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:40.298797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:40.306291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:04:40.315211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:04:40.315633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:04:40.316114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:04:40.316529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:04:40.316949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:04:40.403866 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9e106178-2c8b-4c82-bddb-ac4edb63d91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "POST /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a/action" status: 202 len: 0 microversion: 2.1 time: 0.169825 Oct 27 10:04:40.404854 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3547/7167] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:04:40 2022] POST /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:04:40.414272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:40.414911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:40.421738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:40.422898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:40.423363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:40.424174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:40.424657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:40.425416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:40.633592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:40.647734 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86418199-90f6-4149-b18a-3df1a0fbc666 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1515 microversion: 2.1 time: 0.236996 Oct 27 10:04:40.649053 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3621/7168] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:40 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:41.675979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:41.676821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:41.686026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:41.686546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:41.686989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:41.688250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:41.688713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:41.689148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:41.857100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:41.870282 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-22e14f48-7be4-4f49-9f28-3813c1d94007 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1515 microversion: 2.1 time: 0.198901 Oct 27 10:04:41.871258 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3548/7169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:41 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:42.902759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:42.903507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:42.912313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:42.912929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:42.913453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:42.914256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:42.914917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:42.915478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:43.076179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:43.084879 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18f5ff65-18df-40c1-be87-b16f83aecf06 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.186239 Oct 27 10:04:43.085483 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3622/7170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:42 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:44.110310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:44.111280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:44.118821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:44.119319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:44.119792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:44.120514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:44.120974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:44.121406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:44.299436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:44.314155 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ea8c67c-4bd2-4105-aaf6-a534d83e9e19 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.208275 Oct 27 10:04:44.315221 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3549/7171] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:44 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:45.355955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:45.357114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:45.370621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:45.371496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:45.372374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:45.373708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:45.374546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:45.375354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:45.577276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:45.587372 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1875e7b4-ed48-46e4-96b3-e706bf81cb58 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.238704 Oct 27 10:04:45.587962 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3623/7172] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:45 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:46.611400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:46.612089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:46.622916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:46.623460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:46.623967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:46.624731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:46.625312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:46.625780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:46.783435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:46.792517 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e3df2dd-e4a7-472b-9f23-f8c81eb91782 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.185369 Oct 27 10:04:46.793321 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3550/7173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:46 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:47.817736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:47.818381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:47.826406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:47.826933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:47.827408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:47.828826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:47.829315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:47.829766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:47.988409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:47.996929 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8740a233-32ff-46c5-99fa-a0a4d219f91a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.183285 Oct 27 10:04:47.997539 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3624/7174] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:47 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:49.022296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:49.022984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:49.032200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:49.032758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:49.033247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:49.034068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:49.034592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:49.035086 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:49.188795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:49.197415 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12ada8e9-0f15-4109-9034-fe692c765245 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.179128 Oct 27 10:04:49.198071 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3551/7175] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:49 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:50.222858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:50.223739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:50.231498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:50.232050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:50.232511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:50.233251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:50.233729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:50.234230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:50.391499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:50.400770 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0b21a544-93a7-4709-8330-d6d2a88b3acc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.182428 Oct 27 10:04:50.401376 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3625/7176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:50 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:51.424838 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:51.425494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:51.433907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:51.434491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:51.434935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:51.435781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:51.436246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:51.436729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:51.613317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:51.621676 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1307e4f-22ee-45b8-b43c-cb6958291cfe tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.201464 Oct 27 10:04:51.622281 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3552/7177] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:51 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:52.647167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:52.647937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:52.655408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:52.655966 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:52.656425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:52.657206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:52.657721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:52.658169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:52.850256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:52.858872 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b3a6a3c4-9700-493f-8435-a0d7ee042b5a tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.216272 Oct 27 10:04:52.859476 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3626/7178] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:52 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:53.883313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:53.884060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:53.891939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:53.892443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:53.892895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:53.893629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:53.894094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:53.894529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:54.047930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:54.056423 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-32d6ac87-1b8c-48d0-9a29-85c870fdbd4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.177537 Oct 27 10:04:54.057043 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3553/7179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:53 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:55.081047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:55.082329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:55.089783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:55.090284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:55.090738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:55.091459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:55.091963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:55.092401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:55.246735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:55.255933 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e73e55a-9024-4c9d-8f36-826cfc440dcb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.179834 Oct 27 10:04:55.256530 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3627/7180] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:55 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:04:56.295452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:56.296192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:56.304242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:56.304790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:56.305441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:56.306472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:56.307145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:56.307702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:56.459771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:56.468265 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0268ad5f-e12b-45d5-a38d-2d9cf0a5033d tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.176794 Oct 27 10:04:56.468867 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3554/7181] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:56 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:57.491426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:57.492318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:57.500311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:57.500945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:57.501502 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:57.502318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:57.502884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:57.503433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:57.656322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:57.664800 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5cbf52bb-b8c8-469e-92b6-a75a5a81ec13 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.177447 Oct 27 10:04:57.665454 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3628/7182] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:57 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:58.690160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:58.690795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:58.697905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:58.698392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:58.698830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:58.699861 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:58.700321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:58.700748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:58.847340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:04:58.855735 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-64f78324-57cd-4cda-b9fc-3d4546a09d37 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.169758 Oct 27 10:04:58.856348 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3555/7183] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:58 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:04:59.879842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:04:59.880488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:04:59.888203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:59.888721 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:59.889179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:04:59.889927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:04:59.890991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:04:59.891497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:00.050769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:00.061546 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-88cab524-0b1f-47c5-b3fe-fe7208e7b3a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.185699 Oct 27 10:05:00.062181 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3629/7184] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:04:59 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:05:01.086990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:01.087708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:01.096586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:01.097076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:01.097516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:01.098244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:01.098705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:01.099129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:01.250193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:01.264789 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe91b387-2ab7-44a6-8d2c-949898bcea4e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.181552 Oct 27 10:05:01.265888 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3556/7185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:01 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:02.289876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:02.290542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:02.298202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:02.298715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:02.299206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:02.299996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:02.300467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:02.300919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:02.304031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=91 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:02.455946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:02.464548 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-55a55dae-d69b-4c60-8adc-166bee8192b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.178609 Oct 27 10:05:02.465152 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3630/7186] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:02 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:03.493591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:03.494692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:03.506787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:03.507845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:03.508608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:03.509957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:03.510750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:03.511510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:03.668361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:03.672499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:03.680388 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97071162-e9d4-4c3f-8fab-64af8f649884 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.193954 Oct 27 10:05:03.681148 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3557/7187] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:03 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:04.706637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:04.707264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:04.710155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=30 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:04.715709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:04.716226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:04.716678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:04.717409 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:04.717880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:04.718368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:04.878247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:04.890228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f4168a7b-fcbc-45b6-85aa-37355f9c583e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.188161 Oct 27 10:05:04.891180 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3631/7188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:04 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:05.914970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:05.915648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:05.918532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=34 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:05.925234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:05.925977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:05.926427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:05.927145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:05.927630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:05.928073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:06.080419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:06.089209 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c7297110-70cd-4819-a1f6-b6ce9614e6b9 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.178472 Oct 27 10:05:06.089858 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3558/7189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:05 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:07.115435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:07.116228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:07.123429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:07.125052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:07.125052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:07.125463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:07.125934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:07.126430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:07.288176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:07.296812 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f7424315-4657-4136-847d-671ecc53a8db tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.186666 Oct 27 10:05:07.297492 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3632/7190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:07 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:05:08.322281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:08.323187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:08.334587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:08.335491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:08.336354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:08.337707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:08.338594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:08.339451 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:08.536573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:08.545059 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3f545fe-840d-44cd-9706-81310dd0ce69 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1520 microversion: 2.1 time: 0.227229 Oct 27 10:05:08.545677 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3559/7191] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:08 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:09.571705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:09.572566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:09.581114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:09.581861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:09.582410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:09.583289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:09.584097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:09.584584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:09.834950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:09.846718 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f92ada31-736c-413c-a30a-012fdd35568c tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1519 microversion: 2.1 time: 0.280106 Oct 27 10:05:09.847457 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3633/7192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:09 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:10.364916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1969a796-99a5-4238-a248-ca90302934f2 req-22aee9bb-544f-498d-b60b-ac77d05898f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2389b1-753c-48fa-8d3f-8af171429f5a", "name": "network-vif-unplugged", "status": "completed", "tag": "0e41ad63-22fd-4519-86b0-b770fff9a8f5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:10.381887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1969a796-99a5-4238-a248-ca90302934f2 req-22aee9bb-544f-498d-b60b-ac77d05898f9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:10.382642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1969a796-99a5-4238-a248-ca90302934f2 req-22aee9bb-544f-498d-b60b-ac77d05898f9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:10.383248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1969a796-99a5-4238-a248-ca90302934f2 req-22aee9bb-544f-498d-b60b-ac77d05898f9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:10.402219 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1969a796-99a5-4238-a248-ca90302934f2 req-22aee9bb-544f-498d-b60b-ac77d05898f9 service nova] Creating event network-vif-unplugged:0e41ad63-22fd-4519-86b0-b770fff9a8f5 for instance 5c2389b1-753c-48fa-8d3f-8af171429f5a on n-h2-858383-16 Oct 27 10:05:10.409620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-1969a796-99a5-4238-a248-ca90302934f2 req-22aee9bb-544f-498d-b60b-ac77d05898f9 service nova] Instance 5c2389b1-753c-48fa-8d3f-8af171429f5a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:05:10.427521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1969a796-99a5-4238-a248-ca90302934f2 req-22aee9bb-544f-498d-b60b-ac77d05898f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166439 Oct 27 10:05:10.428692 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3560/7193] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:05:10.892395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:10.893607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:10.902072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:10.902587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:10.903043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:10.903829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:10.904304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:10.904746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:11.262804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:11.276426 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-154dd77c-4139-40d8-8369-32cc2f92f069 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1519 microversion: 2.1 time: 0.392930 Oct 27 10:05:11.277108 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3634/7194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:10 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1519 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:12.314615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:12.315349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:12.322101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:12.322619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:12.323064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:12.323821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:12.324285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:12.324718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:12.450213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a93d28d0-c265-406e-a25f-e6d8f048013e req-cca0fe1b-2782-4f11-b80b-eec71b5ce7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c2389b1-753c-48fa-8d3f-8af171429f5a", "tag": "0e41ad63-22fd-4519-86b0-b770fff9a8f5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:12.463204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a93d28d0-c265-406e-a25f-e6d8f048013e req-cca0fe1b-2782-4f11-b80b-eec71b5ce7d1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:12.463917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a93d28d0-c265-406e-a25f-e6d8f048013e req-cca0fe1b-2782-4f11-b80b-eec71b5ce7d1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:12.464662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a93d28d0-c265-406e-a25f-e6d8f048013e req-cca0fe1b-2782-4f11-b80b-eec71b5ce7d1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:12.490013 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a93d28d0-c265-406e-a25f-e6d8f048013e req-cca0fe1b-2782-4f11-b80b-eec71b5ce7d1 service nova] Creating event network-changed:0e41ad63-22fd-4519-86b0-b770fff9a8f5 for instance 5c2389b1-753c-48fa-8d3f-8af171429f5a on n-h2-858383-16 Oct 27 10:05:12.494507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:12.498425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-a93d28d0-c265-406e-a25f-e6d8f048013e req-cca0fe1b-2782-4f11-b80b-eec71b5ce7d1 service nova] Instance 5c2389b1-753c-48fa-8d3f-8af171429f5a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:05:12.505229 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac6f693b-750d-41dd-a3d1-be0b4ce47da5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1517 microversion: 2.1 time: 0.195927 Oct 27 10:05:12.506113 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3561/7195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:12 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:12.523331 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a93d28d0-c265-406e-a25f-e6d8f048013e req-cca0fe1b-2782-4f11-b80b-eec71b5ce7d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076873 Oct 27 10:05:12.524361 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3635/7196] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:05:13.531814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:13.532494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:13.540129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:13.540629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:13.541071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:13.541798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:13.542263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:13.542694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:13.691446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:13.700054 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e9a1cdfd-5cff-4d68-82f1-72a3120c2120 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1517 microversion: 2.1 time: 0.172891 Oct 27 10:05:13.700680 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3562/7197] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:13 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:14.731858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:14.733160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:14.743476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:14.744370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:14.745152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:14.746412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:14.747248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:14.748045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:14.912380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:14.920949 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86e29157-44a5-41a1-9260-bd3fc3061aa1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1514 microversion: 2.1 time: 0.198414 Oct 27 10:05:14.921570 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3636/7198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:14 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:14.946371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4d564d0d-29c2-4fa6-9094-321b156c46e2 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:14.947260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4d564d0d-29c2-4fa6-9094-321b156c46e2 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:14.955297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d564d0d-29c2-4fa6-9094-321b156c46e2 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:14.955823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d564d0d-29c2-4fa6-9094-321b156c46e2 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:14.956537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d564d0d-29c2-4fa6-9094-321b156c46e2 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:14.957295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d564d0d-29c2-4fa6-9094-321b156c46e2 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:14.957773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d564d0d-29c2-4fa6-9094-321b156c46e2 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:14.958215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4d564d0d-29c2-4fa6-9094-321b156c46e2 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:15.028395 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4d564d0d-29c2-4fa6-9094-321b156c46e2 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "POST /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a/action" status: 204 len: 0 microversion: 2.1 time: 0.086303 Oct 27 10:05:15.029462 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3563/7199] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:05:14 2022] POST /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:05:15.042097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:15.043479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:15.053883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:15.054330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:15.054935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:15.055961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:15.056525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:15.057005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:15.305957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:15.316476 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-26fd10b5-7ab5-4468-8236-906ac0f620a8 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1514 microversion: 2.1 time: 0.281466 Oct 27 10:05:15.317065 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3637/7200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:15 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1514 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:16.344192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:16.345898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:16.353020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:16.353528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:16.353973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:16.354698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:16.355161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:16.355615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:16.552215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:16.564521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9fd922e0-1f39-409b-a8c7-a6e786b797bc tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1514 microversion: 2.1 time: 0.226125 Oct 27 10:05:16.574368 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3564/7201] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:16 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:17.591625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:17.592592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:17.601320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:17.601981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:17.602540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:17.603418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:17.604263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:17.604809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:17.761963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:17.770600 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a5af6580-f4ff-4d24-8935-4506a966e6b3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1506 microversion: 2.1 time: 0.183398 Oct 27 10:05:17.771198 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3638/7202] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:17 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:05:17.810467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:17.811112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:17.819002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:17.819630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:17.820120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:17.820990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:17.821529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:17.822015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:17.987405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:17.996125 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aec0d3e2-d0dd-4ab9-bf18-8d6b0c0f48b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1506 microversion: 2.1 time: 0.189503 Oct 27 10:05:17.996910 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3565/7203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:17 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:18.020555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:18.021310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:18.028111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:18.028724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:18.029293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:18.030664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:18.031154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:18.031695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:18.167000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-17fc94cd-2b17-46a0-be12-1f39b81c9cc2 req-647ea50e-763e-477e-846b-f58c3cb2206a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2389b1-753c-48fa-8d3f-8af171429f5a", "name": "network-vif-plugged", "status": "completed", "tag": "0e41ad63-22fd-4519-86b0-b770fff9a8f5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:18.181354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-17fc94cd-2b17-46a0-be12-1f39b81c9cc2 req-647ea50e-763e-477e-846b-f58c3cb2206a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:18.181354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-17fc94cd-2b17-46a0-be12-1f39b81c9cc2 req-647ea50e-763e-477e-846b-f58c3cb2206a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:18.182093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-17fc94cd-2b17-46a0-be12-1f39b81c9cc2 req-647ea50e-763e-477e-846b-f58c3cb2206a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:18.196213 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-17fc94cd-2b17-46a0-be12-1f39b81c9cc2 req-647ea50e-763e-477e-846b-f58c3cb2206a service nova] Creating event network-vif-plugged:0e41ad63-22fd-4519-86b0-b770fff9a8f5 for instance 5c2389b1-753c-48fa-8d3f-8af171429f5a on n-h2-858383-16 Oct 27 10:05:18.202004 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-17fc94cd-2b17-46a0-be12-1f39b81c9cc2 req-647ea50e-763e-477e-846b-f58c3cb2206a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040185 Oct 27 10:05:18.202941 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3566/7204] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:05:18.230570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:18.241260 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f14e888-e543-4470-9d32-d429add830a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1506 microversion: 2.1 time: 0.224603 Oct 27 10:05:18.242421 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3639/7205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:18 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:18.265297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:18.266051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:18.276074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:18.277003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:18.277902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:18.280506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:18.280830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:18.281608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:18.315508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:05:18.411379 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c850206-f68b-41f5-8b6c-ac319d8f92f3 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 204 len: 0 microversion: 2.1 time: 0.150159 Oct 27 10:05:18.411997 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3567/7206] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:05:18 2022] DELETE /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:05:18.436279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:18.437001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:18.445808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:18.446412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:18.447002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:18.447881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:18.448455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:18.448930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:18.479874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:05:18.535331 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.compute.api [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Instance is already in deleting state, ignoring this request Oct 27 10:05:18.536230 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-187c4470-d950-4a47-9a1d-0f6c8f660171 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 204 len: 0 microversion: 2.1 time: 0.107918 Oct 27 10:05:18.536824 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3640/7207] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:05:18 2022] DELETE /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:05:18.546430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:18.547140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:18.553650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:18.554150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:18.554591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:18.555315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:18.555797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:18.556227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:18.722459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:18.730930 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f7cd01ee-31d7-40ac-adc5-8522a39c85a1 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1512 microversion: 2.1 time: 0.189409 Oct 27 10:05:18.731530 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3568/7208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:18 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:19.770566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:19.771312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:19.780638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:19.781549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:19.782353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:19.783774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:19.784645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:19.785466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:19.943997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859cd28fee4674a5e40723d42afb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b439c632e421ead863dfe056cd739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:19.953639 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49469a96-d415-49d5-9141-77dcd491b2fb tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 200 len: 1512 microversion: 2.1 time: 0.187029 Oct 27 10:05:19.954243 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3641/7209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:19 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:20.581094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-42612545-4073-4ce8-8203-c6f72cdd18fc req-cdfd56c1-30d8-4f4f-9e67-67aae0049eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2389b1-753c-48fa-8d3f-8af171429f5a", "name": "network-vif-deleted", "tag": "0e41ad63-22fd-4519-86b0-b770fff9a8f5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:20.601386 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-42612545-4073-4ce8-8203-c6f72cdd18fc req-cdfd56c1-30d8-4f4f-9e67-67aae0049eee service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:20.602241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-42612545-4073-4ce8-8203-c6f72cdd18fc req-cdfd56c1-30d8-4f4f-9e67-67aae0049eee service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:20.603024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-42612545-4073-4ce8-8203-c6f72cdd18fc req-cdfd56c1-30d8-4f4f-9e67-67aae0049eee service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:20.623135 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-42612545-4073-4ce8-8203-c6f72cdd18fc req-cdfd56c1-30d8-4f4f-9e67-67aae0049eee service nova] Creating event network-vif-deleted:0e41ad63-22fd-4519-86b0-b770fff9a8f5 for instance 5c2389b1-753c-48fa-8d3f-8af171429f5a on n-h2-858383-16 Oct 27 10:05:20.631815 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-42612545-4073-4ce8-8203-c6f72cdd18fc req-cdfd56c1-30d8-4f4f-9e67-67aae0049eee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058782 Oct 27 10:05:20.632843 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3569/7210] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:05:20.989490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:20.990116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 5c2389b1-753c-48fa-8d3f-8af171429f5a] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:20.997961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:20.998479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:20.999485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:21.000442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:21.001177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:21.001984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:21.020763 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] HTTP exception thrown: Instance 5c2389b1-753c-48fa-8d3f-8af171429f5a could not be found. Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Request method failure captured: Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a HTTP/1.1 Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWldyRBZ4jlDhzrlFKkRl-mqoFfbqSlWVdcl5byBwnAUSPfYr8LFa7YiTE0cpvTIzGRsZ_FzxRNzBBiSQuyNpqkM6GFxAywl1zb4r3CX5O-sN-asH1pImGL1JegcNfQ9jlEwlc5qWdWQP7ePxnCxVwq6Fp6TpBsTOaBugXVDT3mBBv7U Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 433b439c632e421ead863dfe056cd739 Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerDiskConfigTestJSON-184652561 Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/433b439c632e421ead863dfe056cd739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_433b439c632e421ead863dfe056cd739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/433b439c632e421ead863dfe056cd739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/433b439c632e421ead863dfe056cd739"}]}] Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerDiskConfigTestJSON-184652561 Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 433b439c632e421ead863dfe056cd739 Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-184652561 Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerDiskConfigTestJSON-184652561-project Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: de859cd28fee4674a5e40723d42afb9e Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerDiskConfigTestJSON-184652561-project Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 5c2389b1-753c-48fa-8d3f-8af171429f5a could not be found. Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '5c2389b1-753c-48fa-8d3f-8af171429f5a'} Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c2389b1-753c-48fa-8d3f-8af171429f5a could not be found. Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c2389b1-753c-48fa-8d3f-8af171429f5a could not be found. Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:05:21.022467 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c2389b1-753c-48fa-8d3f-8af171429f5a could not be found. Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Returning 404 to user: Instance 5c2389b1-753c-48fa-8d3f-8af171429f5a could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84828698-3d95-4923-8fd8-7a3ddedc5f9e tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a" status: 404 len: 111 microversion: 2.1 time: 0.038934 Oct 27 10:05:21.029296 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3642/7211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:20 2022] GET /compute/v2.1/servers/5c2389b1-753c-48fa-8d3f-8af171429f5a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:05:21.036286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1bc5102-0726-473f-9126-82ce8defb091 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '.version_select at 0x7f31a8d1f040>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:21.068615 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1bc5102-0726-473f-9126-82ce8defb091 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836528528" status: 202 len: 0 microversion: 2.1 time: 0.036536 Oct 27 10:05:21.069652 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3570/7212] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 10:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836528528 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:05:22.174913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:22.175524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:22.183755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:22.184264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:22.184712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:22.185451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:22.185925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:22.186529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:22.203478 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] HTTP exception thrown: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Request method failure captured: Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd HTTP/1.1 Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWldyRBZ4jlDhzrlFKkRl-mqoFfbqSlWVdcl5byBwnAUSPfYr8LFa7YiTE0cpvTIzGRsZ_FzxRNzBBiSQuyNpqkM6GFxAywl1zb4r3CX5O-sN-asH1pImGL1JegcNfQ9jlEwlc5qWdWQP7ePxnCxVwq6Fp6TpBsTOaBugXVDT3mBBv7U Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 433b439c632e421ead863dfe056cd739 Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerDiskConfigTestJSON-184652561 Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/433b439c632e421ead863dfe056cd739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_433b439c632e421ead863dfe056cd739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/433b439c632e421ead863dfe056cd739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/433b439c632e421ead863dfe056cd739"}]}] Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerDiskConfigTestJSON-184652561 Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 433b439c632e421ead863dfe056cd739 Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-184652561 Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerDiskConfigTestJSON-184652561-project Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: de859cd28fee4674a5e40723d42afb9e Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerDiskConfigTestJSON-184652561-project Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '0e3abfbb-ec16-4469-8381-d5e6bcc990bd'} Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:05:22.205130 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Returning 404 to user: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-111caf20-a79c-42d7-8c69-72199ce1f7b5 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 404 len: 111 microversion: 2.1 time: 0.035817 Oct 27 10:05:22.213250 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3643/7213] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:05:22 2022] DELETE /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:05:22.221459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:22.222323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] [instance: 0e3abfbb-ec16-4469-8381-d5e6bcc990bd] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:22.229891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:22.230394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:22.230846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:22.231599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:22.232376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:22.232822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:22.248243 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] HTTP exception thrown: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Request method failure captured: Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd HTTP/1.1 Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWldyRBZ4jlDhzrlFKkRl-mqoFfbqSlWVdcl5byBwnAUSPfYr8LFa7YiTE0cpvTIzGRsZ_FzxRNzBBiSQuyNpqkM6GFxAywl1zb4r3CX5O-sN-asH1pImGL1JegcNfQ9jlEwlc5qWdWQP7ePxnCxVwq6Fp6TpBsTOaBugXVDT3mBBv7U Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 433b439c632e421ead863dfe056cd739 Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerDiskConfigTestJSON-184652561 Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/433b439c632e421ead863dfe056cd739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_433b439c632e421ead863dfe056cd739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/433b439c632e421ead863dfe056cd739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/433b439c632e421ead863dfe056cd739"}]}] Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerDiskConfigTestJSON-184652561 Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 433b439c632e421ead863dfe056cd739 Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-184652561 Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerDiskConfigTestJSON-184652561-project Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: de859cd28fee4674a5e40723d42afb9e Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerDiskConfigTestJSON-184652561-project Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '0e3abfbb-ec16-4469-8381-d5e6bcc990bd'} Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:05:22.250830 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] Returning 404 to user: Instance 0e3abfbb-ec16-4469-8381-d5e6bcc990bd could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cfbb1277-f497-47c3-8e9b-5321ea3b3c11 tempest-ServerDiskConfigTestJSON-184652561 tempest-ServerDiskConfigTestJSON-184652561-project] 10.222.0.25 "GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd" status: 404 len: 111 microversion: 2.1 time: 0.037681 Oct 27 10:05:22.259237 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3571/7214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:22 2022] GET /compute/v2.1/servers/0e3abfbb-ec16-4469-8381-d5e6bcc990bd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:05:34.027494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=25 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:34.028967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:34.228284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2e628796-0ca1-4361-b24f-f2cf4c7e2a90 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'create', calling method: .version_select at 0x7f31a9fdb160>, body: {"keypair": {"name": "tempest-keypair-1599840349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAQWvuhGygAIuR0JkGwR6YaAphlHfvU5dFiECrlAsX9XYclJHCckVJVQvbxKNEVAAn6h6BPhu1dYIHpXi1HvgTBirUPEbTBKtaoSdrhUwza9zRo/NN4ad6Uh0iE3zBjOg=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:34.249748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-2e628796-0ca1-4361-b24f-f2cf4c7e2a90 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for project bc03f7e3259b405482d57eafb0b76a49. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:05:34.256144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-2e628796-0ca1-4361-b24f-f2cf4c7e2a90 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for user 5d7ab761c99040c4927b7eb498440e4a and project bc03f7e3259b405482d57eafb0b76a49. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:05:34.294472 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2e628796-0ca1-4361-b24f-f2cf4c7e2a90 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.275522 Oct 27 10:05:34.296238 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3644/7215] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:05:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:05:35.934737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-959853753", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd251ce3-4f3f-4d84-8c9d-6f9b640cf476"}], "security_groups": [{"name": "tempest-securitygroup--896108089"}], "key_name": "tempest-keypair-1599840349", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:35.946294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:35.947058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:36.073700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] validate_networks() for [('dd251ce3-4f3f-4d84-8c9d-6f9b640cf476', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:05:36.544179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:05:36.544599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:05:36.545593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:05:36.546108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:05:36.546535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:05:36.558990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:36.560327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:36.560739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:36.562681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:36.563518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:36.564418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:36.602465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:05:36.614021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for user 5d7ab761c99040c4927b7eb498440e4a and project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:05:36.639193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:05:36.643687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:05:36.733025 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c669fdba-33fb-4c7f-abb8-6d3442cc76c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.802972 Oct 27 10:05:36.734482 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3572/7216] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:05:35 2022] POST /compute/v2.1/servers => generated 408 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:05:36.751875 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-12de2c13-90a5-4983-a828-69bb4c99956f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:36.752805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-12de2c13-90a5-4983-a828-69bb4c99956f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:36.834569 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-12de2c13-90a5-4983-a828-69bb4c99956f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:36.844853 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-12de2c13-90a5-4983-a828-69bb4c99956f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1238 microversion: 2.1 time: 0.098278 Oct 27 10:05:36.845749 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3645/7217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:36 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:05:37.887806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:37.889799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:37.896498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:37.897005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:37.897448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:37.898181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:37.898648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:37.899079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:37.970183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:37.981430 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f2bb762-4488-4df0-84c3-c25d703b0316 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1290 microversion: 2.1 time: 0.099166 Oct 27 10:05:37.982492 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3573/7218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:37 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:39.020686 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:39.022036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:39.035615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:39.036759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:39.037729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:39.039548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:39.040578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:39.041578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:39.188093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:39.203804 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e8bd2fd3-a4d6-4c7d-9e14-b20e9b330e0b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1296 microversion: 2.1 time: 0.188169 Oct 27 10:05:39.204865 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3646/7219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:39 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1296 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:40.232030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:40.233535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:40.242948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:40.243623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:40.244153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:40.245109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:40.245637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:40.246107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:40.555166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:40.565682 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-55495912-695e-4c6d-9d5d-dee181ce452c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1363 microversion: 2.1 time: 0.338394 Oct 27 10:05:40.579865 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3574/7220] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:40 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:05:40.700851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-700d47a7-858f-400a-a5ba-7b154cbc0dc6 req-3e95acf7-7f3f-4114-aab2-1716306713e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ea2e80-86b9-4942-93b9-59d082c82285", "tag": "4044812d-610a-46c8-9ce5-36c498270fd0"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:40.719718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-700d47a7-858f-400a-a5ba-7b154cbc0dc6 req-3e95acf7-7f3f-4114-aab2-1716306713e6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:40.720714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-700d47a7-858f-400a-a5ba-7b154cbc0dc6 req-3e95acf7-7f3f-4114-aab2-1716306713e6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:40.721321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-700d47a7-858f-400a-a5ba-7b154cbc0dc6 req-3e95acf7-7f3f-4114-aab2-1716306713e6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:40.739398 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-700d47a7-858f-400a-a5ba-7b154cbc0dc6 req-3e95acf7-7f3f-4114-aab2-1716306713e6 service nova] Creating event network-changed:4044812d-610a-46c8-9ce5-36c498270fd0 for instance 86ea2e80-86b9-4942-93b9-59d082c82285 on n-h1-858383-16 Oct 27 10:05:40.746318 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-700d47a7-858f-400a-a5ba-7b154cbc0dc6 req-3e95acf7-7f3f-4114-aab2-1716306713e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051416 Oct 27 10:05:40.747065 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3647/7221] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:05:41.596954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:41.597631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:41.605147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:41.605648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:41.606097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:41.606818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:41.607305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:41.607780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:41.766369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:41.775068 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c8ba8b0-c443-469a-ab7a-e2d759bdca00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1363 microversion: 2.1 time: 0.182959 Oct 27 10:05:41.775806 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3575/7222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:41 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:05:42.800659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:42.801376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:42.808125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:42.808638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:42.809094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:42.809844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:42.810830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:42.811274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:42.964360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:42.973248 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-23b1c32a-6aea-4117-85e6-0a92e39b7730 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1363 microversion: 2.1 time: 0.178252 Oct 27 10:05:42.973857 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3648/7223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:42 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:05:43.996581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:43.997326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:44.005299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:44.005857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:44.006337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:44.007094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:44.007635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:44.008117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:44.154872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:44.163420 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d01b1123-f1ed-41e0-a678-9a968c8bc9e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1363 microversion: 2.1 time: 0.170847 Oct 27 10:05:44.164132 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3576/7224] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:43 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:05:45.188545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:45.189384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:45.197836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:45.198543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:45.199083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:45.200134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:45.200688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:45.201327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:45.413944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:45.422623 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-51f7a1a2-bd23-4459-8264-e77c7caee9ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1363 microversion: 2.1 time: 0.238637 Oct 27 10:05:45.423482 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3649/7225] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:45 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:46.445883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:46.446609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:46.454625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:46.455117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:46.455562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:46.456560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:46.457037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:46.457482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:46.581212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:46.614174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:46.624483 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-450a1dfc-b253-4173-a3ea-c2a199c276e1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1363 microversion: 2.1 time: 0.182510 Oct 27 10:05:46.625089 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3577/7226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:46 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:47.650083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:47.650834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:47.654063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:47.660333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:47.661121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:47.661685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:47.662540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:47.663261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:47.663831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:47.817313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:47.826055 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0476a76b-251c-4e0a-b2a6-1d3bd40e51f7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1363 microversion: 2.1 time: 0.179938 Oct 27 10:05:47.826729 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3650/7227] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:47 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:48.302759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-624ab521-1c7c-4b39-8908-d1f635c61cac req-78c01b4a-5de6-488f-89e5-de062958cd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ea2e80-86b9-4942-93b9-59d082c82285", "name": "network-vif-plugged", "status": "completed", "tag": "4044812d-610a-46c8-9ce5-36c498270fd0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:48.309516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:48.319351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-624ab521-1c7c-4b39-8908-d1f635c61cac req-78c01b4a-5de6-488f-89e5-de062958cd09 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:48.320082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-624ab521-1c7c-4b39-8908-d1f635c61cac req-78c01b4a-5de6-488f-89e5-de062958cd09 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:48.320885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-624ab521-1c7c-4b39-8908-d1f635c61cac req-78c01b4a-5de6-488f-89e5-de062958cd09 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:48.343830 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-624ab521-1c7c-4b39-8908-d1f635c61cac req-78c01b4a-5de6-488f-89e5-de062958cd09 service nova] Creating event network-vif-plugged:4044812d-610a-46c8-9ce5-36c498270fd0 for instance 86ea2e80-86b9-4942-93b9-59d082c82285 on n-h1-858383-16 Oct 27 10:05:48.350205 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-624ab521-1c7c-4b39-8908-d1f635c61cac req-78c01b4a-5de6-488f-89e5-de062958cd09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052330 Oct 27 10:05:48.350848 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3578/7228] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:05:48.851288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:48.852070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:48.859434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:48.859982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:48.860435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:48.861171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:48.861645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:48.862089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:49.022797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:49.031512 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a525e1a1-a979-4f6d-a4e1-f8632f1c6fdb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1363 microversion: 2.1 time: 0.184283 Oct 27 10:05:49.032172 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3651/7229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:48 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:05:50.057822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:50.058574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:50.066094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:50.066593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:50.067063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:50.067803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:50.068275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:50.068718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:50.230529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:05:50.241913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-298b8706-2a24-49f9-830b-bc67840c8d92 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1549 microversion: 2.1 time: 0.189224 Oct 27 10:05:50.242735 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3579/7230] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:05:50 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1549 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:05:50.268027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1205808-4007-4a7b-b620-64ae0a8a332a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:05:50.268651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1205808-4007-4a7b-b620-64ae0a8a332a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:05:50.276379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1205808-4007-4a7b-b620-64ae0a8a332a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:50.276886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1205808-4007-4a7b-b620-64ae0a8a332a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:50.277341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1205808-4007-4a7b-b620-64ae0a8a332a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:50.278113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1205808-4007-4a7b-b620-64ae0a8a332a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:50.278582 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1205808-4007-4a7b-b620-64ae0a8a332a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:50.279674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1205808-4007-4a7b-b620-64ae0a8a332a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:50.375305 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1205808-4007-4a7b-b620-64ae0a8a332a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111319 Oct 27 10:05:50.376153 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3652/7231] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 10:05:50 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:05:51.532939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9581d8f6-081d-4315-8e11-aaf262e8caab req-d926db89-a8e9-4287-a9a5-119ed628e4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ea2e80-86b9-4942-93b9-59d082c82285", "tag": "4044812d-610a-46c8-9ce5-36c498270fd0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:05:51.547045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9581d8f6-081d-4315-8e11-aaf262e8caab req-d926db89-a8e9-4287-a9a5-119ed628e4e9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:05:51.547673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9581d8f6-081d-4315-8e11-aaf262e8caab req-d926db89-a8e9-4287-a9a5-119ed628e4e9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:05:51.548191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9581d8f6-081d-4315-8e11-aaf262e8caab req-d926db89-a8e9-4287-a9a5-119ed628e4e9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:05:51.561475 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9581d8f6-081d-4315-8e11-aaf262e8caab req-d926db89-a8e9-4287-a9a5-119ed628e4e9 service nova] Creating event network-changed:4044812d-610a-46c8-9ce5-36c498270fd0 for instance 86ea2e80-86b9-4942-93b9-59d082c82285 on n-h1-858383-16 Oct 27 10:05:51.567401 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9581d8f6-081d-4315-8e11-aaf262e8caab req-d926db89-a8e9-4287-a9a5-119ed628e4e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038506 Oct 27 10:05:51.568424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3580/7232] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:06:55.847549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:55.848469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=36 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:55.854036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:55.854750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:06:55.863219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:55.863791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:55.864261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:55.865005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:55.865483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:55.865922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:56.040810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:06:56.049969 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-987cb51b-bac8-4dfc-a2e9-15415d37cb4a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1667 microversion: 2.1 time: 0.205298 Oct 27 10:06:56.050569 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3653/7233] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:06:55 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1667 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:06:56.074945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:56.076318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=42 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:56.085153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:56.086474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:06:56.100065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:56.101104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:56.101754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:56.103004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:56.103864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:56.105171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:56.260746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:06:56.269762 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e7cb9fb-bb3c-4fdf-888d-86cab79eadb7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1667 microversion: 2.1 time: 0.199461 Oct 27 10:06:56.270364 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3581/7234] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:06:56 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1667 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:06:56.293946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:56.294575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:06:56.301587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:56.302174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:56.302712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:56.303510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:56.304168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:56.304678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:56.464151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:06:56.473052 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8ccd0b09-6842-476f-abbf-c3ef9fa48045 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1667 microversion: 2.1 time: 0.183056 Oct 27 10:06:56.473679 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3654/7235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:06:56 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1667 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:06:56.496886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:06:56.499292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:06:56.506031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:56.506531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:56.506970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:56.507737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:56.508255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:56.508753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:56.545148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:06:56.551980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Old instance type m1.heat2, new instance type m1.heat {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:06:56.560547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:06:56.560969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:06:56.561448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:06:56.561859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:06:56.562270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:06:56.637890 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af6f80fe-c77d-41d0-9e36-3995854b07e4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285/action" status: 202 len: 0 microversion: 2.1 time: 0.145294 Oct 27 10:06:56.639026 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3582/7236] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:06:56 2022] POST /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:06:56.648952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:56.649786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:06:56.658861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:56.659546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:56.660340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:56.661263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:56.661856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:56.662475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:56.862538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:06:56.878515 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0808137-7d02-4721-9763-610a2120dae7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1676 microversion: 2.1 time: 0.233858 Oct 27 10:06:56.879620 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3655/7237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:06:56 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:06:57.917406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:57.918053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:06:57.926492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:57.927047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:57.927535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:57.928368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:57.928885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:57.929474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:58.095191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:06:58.107422 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71413135-b21c-4217-89db-cc0d93547048 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1676 microversion: 2.1 time: 0.195365 Oct 27 10:06:58.108516 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3583/7238] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:06:57 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:06:59.138074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:06:59.139209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:06:59.151873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:59.152845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:59.153619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:59.154762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:06:59.155613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:06:59.156280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:06:59.317934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:06:59.326447 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b7ab6afd-981d-4f73-8f30-fab48e1bef5a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.195953 Oct 27 10:06:59.327054 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3656/7239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:06:59 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:00.353676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:00.354316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:00.361681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:00.362178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:00.362627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:00.363401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:00.363909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:00.364342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:00.517701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:00.527555 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d8c1e10-bcc9-4088-abfb-66900b093973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.177317 Oct 27 10:07:00.528195 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3584/7240] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:00 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:01.552540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:01.553215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:01.561237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:01.561746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:01.562213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:01.562947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:01.563420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:01.563897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:01.719772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:01.728854 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd22110e-0a12-4f5e-ac57-8a79561dae1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.180186 Oct 27 10:07:01.729484 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3657/7241] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:01 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:02.753117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:02.753723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:02.760993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:02.761491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:02.761945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:02.762672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:02.763137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:02.763596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:02.959924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:02.968975 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c3688bf9-a91a-4386-89f3-dd86dcb37e51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.219945 Oct 27 10:07:02.969591 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3585/7242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:02 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:03.997337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:03.998482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:04.012877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:04.013762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:04.014561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:04.015756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:04.016573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:04.017341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:04.170753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:04.183056 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-68ceceb3-a099-475b-85b3-2b493235ffe3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.192789 Oct 27 10:07:04.184145 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3658/7243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:03 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:05.225524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:05.226165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:05.233966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:05.234648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:05.235115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:05.235882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:05.236354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:05.236800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:05.393203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:05.402348 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1bea8e72-80a3-4a50-9203-656fd749cfc5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.181173 Oct 27 10:07:05.402948 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3586/7244] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:05 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:07:06.442587 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:06.443666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:06.452238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:06.452751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:06.453210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:06.453948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:06.454413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:06.454850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:06.608907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:06.617559 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8b9dd83d-1703-48ea-bcde-3046d1f1169c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.179698 Oct 27 10:07:06.618237 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3659/7245] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:06 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:07.642154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:07.642909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:07.650948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:07.652029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:07.652470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:07.653186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:07.653641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:07.654066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:07.804565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:07.813433 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-497201d6-e8a4-479c-9e6c-0e8426fc5f5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.175323 Oct 27 10:07:07.814040 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3587/7246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:07 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:08.855851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:08.856866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:08.867397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:08.868360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:08.869179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:08.871103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:08.871990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:08.872790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:09.073733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:09.082572 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7785b7d7-4282-4be0-99c8-a9bd50d6eb23 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.232043 Oct 27 10:07:09.083175 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3660/7247] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:08 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:10.109140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:10.109931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:10.117577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:10.118074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:10.118520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:10.119231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:10.119755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:10.120695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:10.295217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:10.306682 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6784d824-1209-4669-99b5-be28733350b7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1681 microversion: 2.1 time: 0.201911 Oct 27 10:07:10.308244 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3588/7248] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:10 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:07:11.352042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:11.353292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:11.363166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:11.364012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:11.364578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:11.365764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:11.366384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:11.367180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:11.660506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:11.675132 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d099be07-70e4-45b6-891f-29c6a5eb85b8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1680 microversion: 2.1 time: 0.332286 Oct 27 10:07:11.676400 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3661/7249] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:11 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1680 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:11.784624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3bc98ce8-a8cb-4141-9718-2d33b99d5ed5 req-f386ffd2-5810-41a2-89ff-ca83cb8398f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ea2e80-86b9-4942-93b9-59d082c82285", "name": "network-vif-unplugged", "status": "completed", "tag": "4044812d-610a-46c8-9ce5-36c498270fd0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:11.798162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3bc98ce8-a8cb-4141-9718-2d33b99d5ed5 req-f386ffd2-5810-41a2-89ff-ca83cb8398f6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:11.798709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3bc98ce8-a8cb-4141-9718-2d33b99d5ed5 req-f386ffd2-5810-41a2-89ff-ca83cb8398f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:11.799418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3bc98ce8-a8cb-4141-9718-2d33b99d5ed5 req-f386ffd2-5810-41a2-89ff-ca83cb8398f6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:11.820171 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3bc98ce8-a8cb-4141-9718-2d33b99d5ed5 req-f386ffd2-5810-41a2-89ff-ca83cb8398f6 service nova] Creating event network-vif-unplugged:4044812d-610a-46c8-9ce5-36c498270fd0 for instance 86ea2e80-86b9-4942-93b9-59d082c82285 on n-h2-858383-16 Oct 27 10:07:11.828161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-3bc98ce8-a8cb-4141-9718-2d33b99d5ed5 req-f386ffd2-5810-41a2-89ff-ca83cb8398f6 service nova] Instance 86ea2e80-86b9-4942-93b9-59d082c82285 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:07:11.843887 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3bc98ce8-a8cb-4141-9718-2d33b99d5ed5 req-f386ffd2-5810-41a2-89ff-ca83cb8398f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063666 Oct 27 10:07:11.845227 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3589/7250] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:07:12.718522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:12.719603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:12.728087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:12.728610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:12.729125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:12.729873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:12.730355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:12.730807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:13.021669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:13.033213 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6e6f444f-3740-405e-8d43-cc9286a1391b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1680 microversion: 2.1 time: 0.321694 Oct 27 10:07:13.034107 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3662/7251] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:12 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:13.874919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9b62672b-f5c6-445f-a4db-28c774235a12 req-51514bac-e5dd-4992-986f-914732c439bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ea2e80-86b9-4942-93b9-59d082c82285", "tag": "4044812d-610a-46c8-9ce5-36c498270fd0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:13.885037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9b62672b-f5c6-445f-a4db-28c774235a12 req-51514bac-e5dd-4992-986f-914732c439bd service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:13.886056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9b62672b-f5c6-445f-a4db-28c774235a12 req-51514bac-e5dd-4992-986f-914732c439bd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:13.886497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9b62672b-f5c6-445f-a4db-28c774235a12 req-51514bac-e5dd-4992-986f-914732c439bd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:13.900428 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9b62672b-f5c6-445f-a4db-28c774235a12 req-51514bac-e5dd-4992-986f-914732c439bd service nova] Creating event network-changed:4044812d-610a-46c8-9ce5-36c498270fd0 for instance 86ea2e80-86b9-4942-93b9-59d082c82285 on n-h2-858383-16 Oct 27 10:07:13.907475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-9b62672b-f5c6-445f-a4db-28c774235a12 req-51514bac-e5dd-4992-986f-914732c439bd service nova] Instance 86ea2e80-86b9-4942-93b9-59d082c82285 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:07:13.919173 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9b62672b-f5c6-445f-a4db-28c774235a12 req-51514bac-e5dd-4992-986f-914732c439bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049242 Oct 27 10:07:13.919873 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3590/7252] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:14.076755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:14.077912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:14.090830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:14.091770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:14.092421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:14.093589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:14.094452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:14.096208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:14.336257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:14.352405 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59c641f5-3ca3-470b-a1d0-bec87b14796a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1678 microversion: 2.1 time: 0.282741 Oct 27 10:07:14.354024 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3663/7253] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:14 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1678 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:07:15.382561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:15.383262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:15.390618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:15.391243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:15.391833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:15.392584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:15.393229 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:15.393747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:15.553131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:15.563217 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-75319666-eadb-460a-bad0-2c261e599c50 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1678 microversion: 2.1 time: 0.185802 Oct 27 10:07:15.563895 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3591/7254] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:15 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:16.594388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:16.595265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:16.605806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:16.606618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:16.607242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:16.608498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:16.608990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:16.609554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:16.828216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:16.837645 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d964d76d-6859-460d-afb5-0af282fc37ca tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1675 microversion: 2.1 time: 0.251655 Oct 27 10:07:16.838916 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3664/7255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:16 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1675 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:16.862797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-177df2fd-08fd-4cf0-aa4d-bcf9b31e15e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:16.863422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-177df2fd-08fd-4cf0-aa4d-bcf9b31e15e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:16.871382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-177df2fd-08fd-4cf0-aa4d-bcf9b31e15e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:16.871918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-177df2fd-08fd-4cf0-aa4d-bcf9b31e15e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:16.872357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-177df2fd-08fd-4cf0-aa4d-bcf9b31e15e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:16.873078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-177df2fd-08fd-4cf0-aa4d-bcf9b31e15e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:16.873538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-177df2fd-08fd-4cf0-aa4d-bcf9b31e15e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:16.873968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-177df2fd-08fd-4cf0-aa4d-bcf9b31e15e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:16.942322 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-177df2fd-08fd-4cf0-aa4d-bcf9b31e15e7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285/action" status: 204 len: 0 microversion: 2.1 time: 0.083377 Oct 27 10:07:16.942991 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3592/7256] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:07:16 2022] POST /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:07:16.958690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:16.959896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:16.972041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:16.972934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:16.973868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:16.975171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:16.976060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:16.976858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:17.235808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:17.251365 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27bde60e-bca1-495b-a86e-351fc6ae8b83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1675 microversion: 2.1 time: 0.300312 Oct 27 10:07:17.252907 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3665/7257] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:16 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1675 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:18.296526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:18.298087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:18.307653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:18.308168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:18.308872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:18.309723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:18.310279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:18.310720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:18.466403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:18.476673 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-93c227f8-51e5-43e1-891e-52c0ecf76bb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1667 microversion: 2.1 time: 0.186283 Oct 27 10:07:18.477516 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3593/7258] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:18 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1667 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:18.516615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:18.518886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:18.531844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:18.532738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:18.533551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:18.534882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:18.535916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:18.536689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:18.732216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:18.747746 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-591c338c-ab3f-4b48-ab08-995d55f7f9f0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1667 microversion: 2.1 time: 0.238651 Oct 27 10:07:18.749742 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3666/7259] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:18 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1667 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:18.795710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:18.796430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:18.802624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-4a6fcbb5-510f-4655-b91d-3aeb62484cae req-1375033d-b66b-47be-9b67-c892ca55e136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ea2e80-86b9-4942-93b9-59d082c82285", "name": "network-vif-plugged", "status": "completed", "tag": "4044812d-610a-46c8-9ce5-36c498270fd0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:18.802985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:18.803503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:18.803996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:18.804743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:18.805216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:18.805658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:18.820055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4a6fcbb5-510f-4655-b91d-3aeb62484cae req-1375033d-b66b-47be-9b67-c892ca55e136 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:18.820917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4a6fcbb5-510f-4655-b91d-3aeb62484cae req-1375033d-b66b-47be-9b67-c892ca55e136 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:18.821835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4a6fcbb5-510f-4655-b91d-3aeb62484cae req-1375033d-b66b-47be-9b67-c892ca55e136 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:18.843974 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-4a6fcbb5-510f-4655-b91d-3aeb62484cae req-1375033d-b66b-47be-9b67-c892ca55e136 service nova] Creating event network-vif-plugged:4044812d-610a-46c8-9ce5-36c498270fd0 for instance 86ea2e80-86b9-4942-93b9-59d082c82285 on n-h2-858383-16 Oct 27 10:07:18.853103 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-4a6fcbb5-510f-4655-b91d-3aeb62484cae req-1375033d-b66b-47be-9b67-c892ca55e136 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160679 Oct 27 10:07:18.854747 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3594/7260] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:18.966738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:18.975944 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28b2652c-d0f8-4dc7-bfa0-26fdcb3a9ca9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1667 microversion: 2.1 time: 0.192119 Oct 27 10:07:18.976953 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3667/7261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:18 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1667 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:07:19.001228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:19.001823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:19.008966 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:19.009653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:19.010756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:19.011637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:19.012223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:19.012780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:19.045158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:07:19.074198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:19.144415 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ec34f93-51f7-4d54-a58e-8a66c46e3478 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 204 len: 0 microversion: 2.1 time: 0.147138 Oct 27 10:07:19.145561 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3595/7262] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:07:18 2022] DELETE /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:07:19.155744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:19.156568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:19.163511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:19.164069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:19.164536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:19.165284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:19.165765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:19.166762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:19.313961 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:19.323368 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2d8caf6e-171d-4fdb-9b93-e1c44588e3b1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1673 microversion: 2.1 time: 0.171507 Oct 27 10:07:19.324102 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3668/7263] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:19 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:20.355918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:20.357199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:20.372110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:20.372965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:20.373748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:20.375072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:20.375993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:20.376756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:20.565349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:20.574913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0faa51f9-ae22-4b8b-8430-c71cd8cc9d46 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1673 microversion: 2.1 time: 0.228838 Oct 27 10:07:20.575513 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3596/7264] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:20 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1673 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:21.603509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:21.605235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:21.618110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:21.619022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:21.620002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:21.621363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:21.622294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:21.623086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:21.664530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=100 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:21.886909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:21.905467 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64308832-3bfa-4664-ac65-a136e5a5d53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 200 len: 1673 microversion: 2.1 time: 0.308031 Oct 27 10:07:21.907290 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3669/7265] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:21 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 1673 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:07:22.262865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-dedb6158-402a-4770-b6de-f224080fa99a req-6f6de6b4-5815-4bd0-b69d-376bc5a31287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ea2e80-86b9-4942-93b9-59d082c82285", "name": "network-vif-deleted", "tag": "4044812d-610a-46c8-9ce5-36c498270fd0"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:22.282115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-dedb6158-402a-4770-b6de-f224080fa99a req-6f6de6b4-5815-4bd0-b69d-376bc5a31287 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:22.283617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-dedb6158-402a-4770-b6de-f224080fa99a req-6f6de6b4-5815-4bd0-b69d-376bc5a31287 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:22.284736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-dedb6158-402a-4770-b6de-f224080fa99a req-6f6de6b4-5815-4bd0-b69d-376bc5a31287 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:22.305714 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-dedb6158-402a-4770-b6de-f224080fa99a req-6f6de6b4-5815-4bd0-b69d-376bc5a31287 service nova] Creating event network-vif-deleted:4044812d-610a-46c8-9ce5-36c498270fd0 for instance 86ea2e80-86b9-4942-93b9-59d082c82285 on n-h2-858383-16 Oct 27 10:07:22.312323 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-dedb6158-402a-4770-b6de-f224080fa99a req-6f6de6b4-5815-4bd0-b69d-376bc5a31287 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056751 Oct 27 10:07:22.313626 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3597/7266] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:22.947138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:22.948808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:22.961873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:22.962785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:22.966117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:22.967480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:22.968452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:22.969183 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:22.995499 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 HTTP/1.1 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '86ea2e80-86b9-4942-93b9-59d082c82285'} Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:22.999042 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e9346a48-72ae-4d8c-aeb7-2afaa77607ef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 404 len: 111 microversion: 2.1 time: 0.062552 Oct 27 10:07:23.007760 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3670/7267] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:22 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:07:23.021922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:23.022853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:23.030801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:23.031319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:23.031821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:23.032571 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:23.033047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:23.033487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:23.049924 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 HTTP/1.1 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '86ea2e80-86b9-4942-93b9-59d082c82285'} Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:07:23.051686 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00e3e3c5-658f-45a9-9258-73be89a34fbd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 404 len: 111 microversion: 2.1 time: 0.037660 Oct 27 10:07:23.063592 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3598/7268] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:23 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:07:23.125891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1257045819", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "dd251ce3-4f3f-4d84-8c9d-6f9b640cf476"}], "security_groups": [{"name": "tempest-securitygroup--896108089"}], "key_name": "tempest-keypair-1599840349", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:23.268423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] validate_networks() for [('dd251ce3-4f3f-4d84-8c9d-6f9b640cf476', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:07:23.910386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:07:23.910943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:07:23.911483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:07:23.912003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:07:23.912557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:07:23.923876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:23.924386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:23.924851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:23.925592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:23.926062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:23.926500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:23.946255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:07:23.952852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for user 5d7ab761c99040c4927b7eb498440e4a and project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:07:23.970713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:07:23.973219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:07:24.028480 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-86671a66-8c22-494e-9b78-53a387cdca72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.909434 Oct 27 10:07:24.029144 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3671/7269] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:07:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:07:24.041782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b94a322-2ada-444d-96c5-a294221faca5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:24.042748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b94a322-2ada-444d-96c5-a294221faca5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:24.115614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b94a322-2ada-444d-96c5-a294221faca5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:24.124514 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b94a322-2ada-444d-96c5-a294221faca5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1239 microversion: 2.1 time: 0.086979 Oct 27 10:07:24.125104 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3599/7270] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:24 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:25.149903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:25.151061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:25.158087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:25.158592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:25.159045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:25.159833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:25.160308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:25.160750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:25.232967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:25.241639 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-574534b8-35d3-4ec9-897b-6bf8cfa88394 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1235 microversion: 2.1 time: 0.096783 Oct 27 10:07:25.242368 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3672/7271] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:25 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:07:26.284038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:26.285151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:26.290192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:26.300622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:26.301492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:26.302301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:26.303633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:26.304483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:26.305262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:26.419658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:26.430101 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5bebcb7c-cf4d-4df8-92bd-cb7f52feed3e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1297 microversion: 2.1 time: 0.153172 Oct 27 10:07:26.430972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3600/7272] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:26 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1297 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:27.469846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:27.470695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:27.473774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:27.480103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:27.480797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:27.481362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:27.482387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:27.483281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:27.483906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:27.545269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-228837d5-fa03-466b-a89b-bd21e85c2d3a req-ebfb441f-80a8-4bea-997e-9850bf7edcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a99b597-8a5f-4c0e-8ade-11dc7e48817f", "tag": "c9df1a74-5c7a-4315-a4cb-f3f6654a4c52"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:27.559955 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-228837d5-fa03-466b-a89b-bd21e85c2d3a req-ebfb441f-80a8-4bea-997e-9850bf7edcb0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:27.560652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-228837d5-fa03-466b-a89b-bd21e85c2d3a req-ebfb441f-80a8-4bea-997e-9850bf7edcb0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:27.561366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-228837d5-fa03-466b-a89b-bd21e85c2d3a req-ebfb441f-80a8-4bea-997e-9850bf7edcb0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:27.577772 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-228837d5-fa03-466b-a89b-bd21e85c2d3a req-ebfb441f-80a8-4bea-997e-9850bf7edcb0 service nova] Creating event network-changed:c9df1a74-5c7a-4315-a4cb-f3f6654a4c52 for instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f on n-h1-858383-16 Oct 27 10:07:27.585460 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-228837d5-fa03-466b-a89b-bd21e85c2d3a req-ebfb441f-80a8-4bea-997e-9850bf7edcb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046544 Oct 27 10:07:27.586475 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3601/7273] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:07:27.825239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:27.835700 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eef902f2-46d5-4361-b567-460191e95325 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1364 microversion: 2.1 time: 0.370453 Oct 27 10:07:27.836752 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3673/7274] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:27 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1364 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:28.862972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:28.863727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:28.871335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:28.871867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:28.872317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:28.873060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:28.873529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:28.873965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:29.028561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:29.038157 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ddb3426-0c5b-4147-a6bf-3444ff3fce60 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1364 microversion: 2.1 time: 0.180600 Oct 27 10:07:29.038840 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3602/7275] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:28 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:07:30.063646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:30.064274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:30.071724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:30.072239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:30.072698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:30.073444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:30.073924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:30.074373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:30.315339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:30.334326 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9eb26ee3-a952-4df6-bd67-8804d57f49c1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1364 microversion: 2.1 time: 0.274404 Oct 27 10:07:30.335966 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3674/7276] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:30 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:31.365790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:31.366488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:31.374404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:31.374892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:31.375330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:31.376087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:31.376545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:31.376979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:31.544906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:31.553935 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a951b200-659d-41ef-9556-04b06ef10df1 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1364 microversion: 2.1 time: 0.192053 Oct 27 10:07:31.554552 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3603/7277] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:31 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:32.582995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:32.584418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:32.597683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:32.598599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:32.599414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:32.601267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:32.602184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:32.602984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:32.812071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:32.827053 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ea10ba25-8490-4ac1-9aff-9f0261e9222f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1364 microversion: 2.1 time: 0.251452 Oct 27 10:07:32.828465 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3675/7278] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:32 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:33.870661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:33.871319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:33.878874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:33.879390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:33.879867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:33.880603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:33.881068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:33.881506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:34.027991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:34.037149 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b8df79b1-031a-4489-9346-47fbb877d29d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1364 microversion: 2.1 time: 0.170670 Oct 27 10:07:34.037753 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3604/7279] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:33 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:34.736908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2143bfc2-4822-4cf0-8097-b27d747eede2 req-f6201aa2-97a5-4e5b-9dce-e83a243d394f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a99b597-8a5f-4c0e-8ade-11dc7e48817f", "name": "network-vif-plugged", "status": "completed", "tag": "c9df1a74-5c7a-4315-a4cb-f3f6654a4c52"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:34.745384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:34.746692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:34.754970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2143bfc2-4822-4cf0-8097-b27d747eede2 req-f6201aa2-97a5-4e5b-9dce-e83a243d394f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:34.755873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2143bfc2-4822-4cf0-8097-b27d747eede2 req-f6201aa2-97a5-4e5b-9dce-e83a243d394f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:34.756522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2143bfc2-4822-4cf0-8097-b27d747eede2 req-f6201aa2-97a5-4e5b-9dce-e83a243d394f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:34.771255 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2143bfc2-4822-4cf0-8097-b27d747eede2 req-f6201aa2-97a5-4e5b-9dce-e83a243d394f service nova] Creating event network-vif-plugged:c9df1a74-5c7a-4315-a4cb-f3f6654a4c52 for instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f on n-h1-858383-16 Oct 27 10:07:34.777609 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2143bfc2-4822-4cf0-8097-b27d747eede2 req-f6201aa2-97a5-4e5b-9dce-e83a243d394f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046140 Oct 27 10:07:34.778230 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3676/7280] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:07:35.080654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:35.081956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:35.085925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:35.096497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:35.097210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:35.097993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:35.099280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:35.100156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:35.100948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:35.254411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:35.263189 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea099f70-22de-49fd-a294-ba6e66229185 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1364 microversion: 2.1 time: 0.189995 Oct 27 10:07:35.263924 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3605/7281] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:35 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:07:36.292082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:36.292924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:36.314561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:36.315379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:36.316029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:36.317198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:36.317817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:36.318360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:36.484751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:07:36.493359 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f2a70d82-9cc8-44c6-9391-0f2cae69da45 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1550 microversion: 2.1 time: 0.208098 Oct 27 10:07:36.493954 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3677/7282] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:07:36 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1550 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:07:36.534312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c13921e-5fca-40ce-b49d-675ad2b5c5ce tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:07:36.534971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c13921e-5fca-40ce-b49d-675ad2b5c5ce tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:07:36.544080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c13921e-5fca-40ce-b49d-675ad2b5c5ce tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:36.544892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c13921e-5fca-40ce-b49d-675ad2b5c5ce tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:36.545694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c13921e-5fca-40ce-b49d-675ad2b5c5ce tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:36.546964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c13921e-5fca-40ce-b49d-675ad2b5c5ce tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:36.547827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c13921e-5fca-40ce-b49d-675ad2b5c5ce tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:36.548536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c13921e-5fca-40ce-b49d-675ad2b5c5ce tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:36.644526 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c13921e-5fca-40ce-b49d-675ad2b5c5ce tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114094 Oct 27 10:07:36.645473 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3606/7283] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 10:07:36 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:07:38.019147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-42fd5ba9-22cf-4d89-898d-3849b892510f req-7fed891c-b7b9-4d97-9ea0-5ed86b87334a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a99b597-8a5f-4c0e-8ade-11dc7e48817f", "tag": "c9df1a74-5c7a-4315-a4cb-f3f6654a4c52"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:07:38.032087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-42fd5ba9-22cf-4d89-898d-3849b892510f req-7fed891c-b7b9-4d97-9ea0-5ed86b87334a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:07:38.032712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-42fd5ba9-22cf-4d89-898d-3849b892510f req-7fed891c-b7b9-4d97-9ea0-5ed86b87334a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:07:38.033222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-42fd5ba9-22cf-4d89-898d-3849b892510f req-7fed891c-b7b9-4d97-9ea0-5ed86b87334a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:07:38.048851 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-42fd5ba9-22cf-4d89-898d-3849b892510f req-7fed891c-b7b9-4d97-9ea0-5ed86b87334a service nova] Creating event network-changed:c9df1a74-5c7a-4315-a4cb-f3f6654a4c52 for instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f on n-h1-858383-16 Oct 27 10:07:38.053915 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-42fd5ba9-22cf-4d89-898d-3849b892510f req-7fed891c-b7b9-4d97-9ea0-5ed86b87334a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095161 Oct 27 10:07:38.055083 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3678/7284] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:08:51.967530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=13 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:51.968432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:51.976524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ccb4aad-dea0-4a73-852c-52ffde714c97 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:08:51.990646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ccb4aad-dea0-4a73-852c-52ffde714c97 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:51.991201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ccb4aad-dea0-4a73-852c-52ffde714c97 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:51.991748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ccb4aad-dea0-4a73-852c-52ffde714c97 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:52.019349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ccb4aad-dea0-4a73-852c-52ffde714c97 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Going to try to stop instance {{(pid=120603) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:08:52.071301 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ccb4aad-dea0-4a73-852c-52ffde714c97 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/action" status: 202 len: 0 microversion: 2.1 time: 0.106320 Oct 27 10:08:52.072009 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3607/7285] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:08:51 2022] POST /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:08:52.079669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=11 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:52.080482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=40 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:08:52.081906 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:08:52.082157 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f (ip 10.222.0.25) !!! Oct 27 10:08:52.090192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:52.090942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:52.101079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:52.101621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:52.102148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:52.102942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:52.103439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:52.103934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:52.365267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:52.379468 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0be161c7-10d3-4c25-817a-29223f5ef495 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.302082 Oct 27 10:08:52.380568 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3679/7286] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:52 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:53.421640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:53.422533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:53.429699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.430201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.430654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:53.431381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:53.431876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:53.432309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:53.668178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:53.677281 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2096f02-78a6-4763-9292-cd4e9ec8876e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.260897 Oct 27 10:08:53.677887 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3608/7287] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:53 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:54.719877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:54.720977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:54.729883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:54.730471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:54.730973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:54.732049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:54.732807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:54.733410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:54.898487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:54.907593 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49166cd4-53a9-4394-8d26-68d0fe8f8269 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.191891 Oct 27 10:08:54.908532 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3680/7288] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:54 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:55.932644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:55.933438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:55.940621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.941124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.941576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:55.942322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:55.942793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:55.943292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:56.091899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:56.105722 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d82322ff-eae9-4040-b7de-c012121e3ba8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.177412 Oct 27 10:08:56.106809 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3609/7289] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:55 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:57.130825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:57.131597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:57.138718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:57.139230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:57.139723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:57.140481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:57.140963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:57.141411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:57.290748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:57.299463 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-065ef6d0-2f85-4f7d-a91e-25f5925eee56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.172827 Oct 27 10:08:57.300079 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3681/7290] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:57 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:08:58.322575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:58.323308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:58.332126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:58.332632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:58.333088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:58.333817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:58.334269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:58.334889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:58.493188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:58.501811 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1b58c16-664c-4b52-9168-43a64873aa83 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.183176 Oct 27 10:08:58.502459 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3610/7291] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:58 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:08:59.527361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:08:59.528116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:08:59.535398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:59.535948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:59.536406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:59.537143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:08:59.538131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:08:59.538583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:08:59.693829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:08:59.706175 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2d6d2b98-4a00-4e24-9da3-ae053094e19e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.182375 Oct 27 10:08:59.707413 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3682/7292] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:08:59 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:00.747209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:00.748209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:00.757720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.758316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.758816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.759931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:00.760563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:00.761047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:00.917076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:00.925498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6211c8ba-d314-4d05-b6e1-4e133616765f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.183739 Oct 27 10:09:00.926117 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3611/7293] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:00 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:01.948964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:01.949677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:01.957765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:01.958275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:01.958735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:01.959558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:01.960095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:01.960554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:02.128667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:02.137756 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98e5d923-4e0f-4d15-acef-b45e0d153537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.192781 Oct 27 10:09:02.138397 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3683/7294] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:01 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:03.163894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:03.164726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:03.172291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:03.172918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:03.173376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:03.174110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:03.174579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:03.175016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:03.323839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:03.333309 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a90ecc25-2c13-4297-9671-4531633d7157 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1655 microversion: 2.1 time: 0.174155 Oct 27 10:09:03.333921 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3612/7295] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:03 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1655 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:03.362611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:03.365123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:03.372761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:03.373274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:03.373737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:03.374478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:03.374959 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:03.375481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:03.407474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:03.414217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120602) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:09:03.422028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:03.422466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:03.422965 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:03.423390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:03.423897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:03.500454 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-477b3fc7-d4f4-4cc7-88b4-2508af0129fe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/action" status: 202 len: 0 microversion: 2.1 time: 0.141551 Oct 27 10:09:03.504957 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3684/7296] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:09:03 2022] POST /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:03.512510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:03.513401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:03.521263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:03.522456 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:03.523028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:03.524152 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:03.524687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:03.525261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:03.701226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:03.712616 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc04b006-41d3-4df5-a506-d9a406ac0ff8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.205714 Oct 27 10:09:03.713629 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3613/7297] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:03 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:04.740179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:04.741390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:04.749003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:04.749518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:04.749985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:04.751543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:04.752206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:04.752910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:04.943738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:04.952575 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4255a77d-77b5-4d4d-ba0b-f6c15820571a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.218972 Oct 27 10:09:04.953287 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3685/7298] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:04 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:05.979339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:05.980376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:05.988840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.989702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.990150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:05.991432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:05.991938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:05.992576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:06.158904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:06.168552 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8844746e-1d76-4537-be35-99bbe740ee00 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1678 microversion: 2.1 time: 0.194474 Oct 27 10:09:06.169239 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3614/7299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:05 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:07.193276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:07.194665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:07.202453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:07.203051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:07.203515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:07.204290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:07.204763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:07.205212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:07.404872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:07.414537 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c6b8fcd-d152-4b21-ae97-dc160ff0a728 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1683 microversion: 2.1 time: 0.225114 Oct 27 10:09:07.415241 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3686/7300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:07 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:08.438961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:08.439852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:08.447723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:08.448233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:08.448690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:08.449428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:08.449883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:08.450310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:08.542327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2a762c3f-bdd4-45e7-8279-291050dcf655 req-f67a5522-e366-4b8a-bb42-bf53a07814bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a99b597-8a5f-4c0e-8ade-11dc7e48817f", "name": "network-vif-unplugged", "status": "completed", "tag": "c9df1a74-5c7a-4315-a4cb-f3f6654a4c52"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:08.557432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2a762c3f-bdd4-45e7-8279-291050dcf655 req-f67a5522-e366-4b8a-bb42-bf53a07814bb service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:08.558133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2a762c3f-bdd4-45e7-8279-291050dcf655 req-f67a5522-e366-4b8a-bb42-bf53a07814bb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:08.558776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2a762c3f-bdd4-45e7-8279-291050dcf655 req-f67a5522-e366-4b8a-bb42-bf53a07814bb service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:08.579209 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2a762c3f-bdd4-45e7-8279-291050dcf655 req-f67a5522-e366-4b8a-bb42-bf53a07814bb service nova] Creating event network-vif-unplugged:c9df1a74-5c7a-4315-a4cb-f3f6654a4c52 for instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f on n-h2-858383-16 Oct 27 10:09:08.587499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-2a762c3f-bdd4-45e7-8279-291050dcf655 req-f67a5522-e366-4b8a-bb42-bf53a07814bb service nova] Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:09:08.602630 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2a762c3f-bdd4-45e7-8279-291050dcf655 req-f67a5522-e366-4b8a-bb42-bf53a07814bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065355 Oct 27 10:09:08.603730 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3687/7301] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:09:08.742930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:08.751915 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-93c3d9bf-2660-4386-b5dd-471bcbb218f8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1682 microversion: 2.1 time: 0.316892 Oct 27 10:09:08.752536 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3615/7302] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:08 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1682 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:09.784495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:09.786087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:09.798739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:09.799710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:09.800580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:09.801940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:09.802902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:09.803771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:09.987442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:09.997805 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-41e2c382-d871-4094-b0d2-b2e80091a5fa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1682 microversion: 2.1 time: 0.223149 Oct 27 10:09:09.998518 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3688/7303] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:09 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:10.628057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-4865e662-66df-4f2b-97a1-5130061600b1 req-d48c2ac6-4ac9-4183-8541-6dbb46fb5ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a99b597-8a5f-4c0e-8ade-11dc7e48817f", "tag": "c9df1a74-5c7a-4315-a4cb-f3f6654a4c52"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:10.647497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4865e662-66df-4f2b-97a1-5130061600b1 req-d48c2ac6-4ac9-4183-8541-6dbb46fb5ce2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:10.648389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4865e662-66df-4f2b-97a1-5130061600b1 req-d48c2ac6-4ac9-4183-8541-6dbb46fb5ce2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:10.649175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4865e662-66df-4f2b-97a1-5130061600b1 req-d48c2ac6-4ac9-4183-8541-6dbb46fb5ce2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:10.672766 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-4865e662-66df-4f2b-97a1-5130061600b1 req-d48c2ac6-4ac9-4183-8541-6dbb46fb5ce2 service nova] Creating event network-changed:c9df1a74-5c7a-4315-a4cb-f3f6654a4c52 for instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f on n-h2-858383-16 Oct 27 10:09:10.684077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-4865e662-66df-4f2b-97a1-5130061600b1 req-d48c2ac6-4ac9-4183-8541-6dbb46fb5ce2 service nova] Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:09:10.701165 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-4865e662-66df-4f2b-97a1-5130061600b1 req-d48c2ac6-4ac9-4183-8541-6dbb46fb5ce2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080150 Oct 27 10:09:10.701894 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3616/7304] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:11.026718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:11.028396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:11.039916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:11.040659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:11.041328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:11.042370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:11.042936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:11.043517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:11.341586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:11.351779 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-069e6081-759e-4bcf-8bee-ba175b598ca0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1680 microversion: 2.1 time: 0.332060 Oct 27 10:09:11.352385 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3689/7305] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:11 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1680 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:12.378393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:12.379158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:12.386544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.387064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.387557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.388331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.388822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.389254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.667160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:12.679406 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b06118c-e2de-4892-b273-e5ed059225f4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1676 microversion: 2.1 time: 0.305765 Oct 27 10:09:12.680586 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3617/7306] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:12 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1676 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:12.711344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7fed6514-86f2-4aca-9693-e99f6b1ca0f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:12.712358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7fed6514-86f2-4aca-9693-e99f6b1ca0f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:12.725061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fed6514-86f2-4aca-9693-e99f6b1ca0f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.725998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fed6514-86f2-4aca-9693-e99f6b1ca0f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.726846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fed6514-86f2-4aca-9693-e99f6b1ca0f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.728241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fed6514-86f2-4aca-9693-e99f6b1ca0f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.729129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fed6514-86f2-4aca-9693-e99f6b1ca0f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.729933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fed6514-86f2-4aca-9693-e99f6b1ca0f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.816584 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7fed6514-86f2-4aca-9693-e99f6b1ca0f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/action" status: 204 len: 0 microversion: 2.1 time: 0.113131 Oct 27 10:09:12.817307 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3690/7307] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:09:12 2022] POST /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/action => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:09:12.827828 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:12.828951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:12.839496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.841089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.842271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:12.843617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:12.844682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:12.845455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:13.221028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:13.252848 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf7e4da0-6b8d-433f-8439-5f246bc49afc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1676 microversion: 2.1 time: 0.429742 Oct 27 10:09:13.254133 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3618/7308] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:12 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1676 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:14.293677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:14.294399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:14.301765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:14.302179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:14.302638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:14.303374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:14.303883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:14.304332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:14.475936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:14.488359 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de6da7e3-3c5d-4b7b-9dc3-4267ebd5a106 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1676 microversion: 2.1 time: 0.200614 Oct 27 10:09:14.489424 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3691/7309] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:14 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:15.307038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b39f852d-0378-46d6-870e-af3f0be6064c req-f541dfcc-f7ce-4fb8-a4c3-f14f5fe1d0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a99b597-8a5f-4c0e-8ade-11dc7e48817f", "name": "network-vif-plugged", "status": "completed", "tag": "c9df1a74-5c7a-4315-a4cb-f3f6654a4c52"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:15.318060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b39f852d-0378-46d6-870e-af3f0be6064c req-f541dfcc-f7ce-4fb8-a4c3-f14f5fe1d0e5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.319103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b39f852d-0378-46d6-870e-af3f0be6064c req-f541dfcc-f7ce-4fb8-a4c3-f14f5fe1d0e5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.319539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b39f852d-0378-46d6-870e-af3f0be6064c req-f541dfcc-f7ce-4fb8-a4c3-f14f5fe1d0e5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:15.333711 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b39f852d-0378-46d6-870e-af3f0be6064c req-f541dfcc-f7ce-4fb8-a4c3-f14f5fe1d0e5 service nova] Creating event network-vif-plugged:c9df1a74-5c7a-4315-a4cb-f3f6654a4c52 for instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f on n-h2-858383-16 Oct 27 10:09:15.344993 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b39f852d-0378-46d6-870e-af3f0be6064c req-f541dfcc-f7ce-4fb8-a4c3-f14f5fe1d0e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041331 Oct 27 10:09:15.346373 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3619/7310] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:15.516087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:15.517137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:15.528046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.528640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.529193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:15.530078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.530708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.531317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:15.684046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:15.693812 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2a0976e6-a91a-4d7a-9699-cdede59af585 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1655 microversion: 2.1 time: 0.182341 Oct 27 10:09:15.694449 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3692/7311] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:15 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1655 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:15.718182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:15.718927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:15.725878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.726381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.726831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:15.727630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.728106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.728532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:15.878393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:15.888716 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4df58ad1-cd30-4ed8-933c-5eda1519caaf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1655 microversion: 2.1 time: 0.174830 Oct 27 10:09:15.889319 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3620/7312] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:15 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1655 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:15.914240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ede39792-6fc0-418a-8408-40dc4330a3d2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:15.921039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ede39792-6fc0-418a-8408-40dc4330a3d2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:15.921557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ede39792-6fc0-418a-8408-40dc4330a3d2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:15.922014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ede39792-6fc0-418a-8408-40dc4330a3d2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:15.940698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:15.952021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ede39792-6fc0-418a-8408-40dc4330a3d2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Going to try to start instance {{(pid=120602) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 10:09:16.009470 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ede39792-6fc0-418a-8408-40dc4330a3d2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/action" status: 202 len: 0 microversion: 2.1 time: 0.099905 Oct 27 10:09:16.010288 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3693/7313] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:09:15 2022] POST /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:09:16.023656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:16.024976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:16.035601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:16.036442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:16.037821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:16.038935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:16.039776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:16.040383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:16.211168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:16.220455 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9e547f4-973a-44a7-9503-3b433c4d7770 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1664 microversion: 2.1 time: 0.204628 Oct 27 10:09:16.220921 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3621/7314] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:16 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1664 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:17.251081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:17.252710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:17.264369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:17.265199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:17.266033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:17.267375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:17.268325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:17.269108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:17.497241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:17.505847 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8d5e8a4-0fc4-43b3-90df-0b7ce53612a0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1664 microversion: 2.1 time: 0.264405 Oct 27 10:09:17.506440 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3694/7315] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:17 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1664 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:18.530277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:18.530883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:18.539766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:18.540267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:18.540719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:18.541442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:18.541909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:18.542341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:19.045804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:19.054545 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b1b3df6-c33f-45c4-93cb-779ffde05b0f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1668 microversion: 2.1 time: 0.528332 Oct 27 10:09:19.055369 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3622/7316] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:18 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1668 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:19.079234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.079924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:19.088834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:19.089397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:19.089955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:19.090777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:19.091400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:19.091930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:19.121911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:09:19.213125 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-40ce0223-a83f-48bb-a09f-a078ec040aa6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 204 len: 0 microversion: 2.1 time: 0.137479 Oct 27 10:09:19.214011 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3695/7317] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:09:19 2022] DELETE /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:09:19.224099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:19.225145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:19.232082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:19.232649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:19.233190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:19.234018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:19.234580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:19.235107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:19.256249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:19.389361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:19.398968 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97303e63-f2f7-480e-98a7-d588549e77d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1674 microversion: 2.1 time: 0.179537 Oct 27 10:09:19.399582 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3623/7318] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:19 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:20.423738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:20.424460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:20.433462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:20.433974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:20.434507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:20.435251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:20.435773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:20.436228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:20.588726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:20.597669 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0dc073f1-9020-4655-864c-05ed62bddd4c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1674 microversion: 2.1 time: 0.178644 Oct 27 10:09:20.598351 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3696/7319] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:20 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:21.625859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:21.627876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:21.639244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:21.640068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:21.640629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:21.641566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:21.642157 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:21.642781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:21.682561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d00cbe78-917a-4a0f-b4d8-3a92b0f8415b req-4a6845cc-9c35-4ad1-8e53-ef5b1ea1be7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a99b597-8a5f-4c0e-8ade-11dc7e48817f", "name": "network-vif-deleted", "tag": "c9df1a74-5c7a-4315-a4cb-f3f6654a4c52"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:21.704937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d00cbe78-917a-4a0f-b4d8-3a92b0f8415b req-4a6845cc-9c35-4ad1-8e53-ef5b1ea1be7b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:21.705991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d00cbe78-917a-4a0f-b4d8-3a92b0f8415b req-4a6845cc-9c35-4ad1-8e53-ef5b1ea1be7b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:21.707515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d00cbe78-917a-4a0f-b4d8-3a92b0f8415b req-4a6845cc-9c35-4ad1-8e53-ef5b1ea1be7b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:21.734762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:21.737180 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d00cbe78-917a-4a0f-b4d8-3a92b0f8415b req-4a6845cc-9c35-4ad1-8e53-ef5b1ea1be7b service nova] Creating event network-vif-deleted:c9df1a74-5c7a-4315-a4cb-f3f6654a4c52 for instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f on n-h2-858383-16 Oct 27 10:09:21.744820 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ae8f4db-ca76-4a4e-a13c-136acada8611 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 200 len: 1607 microversion: 2.1 time: 0.123208 Oct 27 10:09:21.752148 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d00cbe78-917a-4a0f-b4d8-3a92b0f8415b req-4a6845cc-9c35-4ad1-8e53-ef5b1ea1be7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073783 Oct 27 10:09:21.754073 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3697/7320] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:09:21.760134 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3624/7321] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:21 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 1607 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:22.770279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:22.771816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:22.774944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:22.780903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:22.781398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:22.781880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:22.782603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:22.783070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:22.783506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:22.800553 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f HTTP/1.1 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '2a99b597-8a5f-4c0e-8ade-11dc7e48817f'} Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:22.802236 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-17bfc489-fc24-4da1-87a6-a9d07c3909f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 404 len: 111 microversion: 2.1 time: 0.038130 Oct 27 10:09:22.811123 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3698/7322] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:22 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:09:22.826453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:22.827634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:22.831447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=37 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:22.841096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:22.841959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:22.842703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:22.844110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:22.844959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:22.845851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:22.863617 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f HTTP/1.1 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '2a99b597-8a5f-4c0e-8ade-11dc7e48817f'} Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:09:22.865510 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ede779d6-f8fe-4b66-8d5d-791767a5f6c7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 404 len: 111 microversion: 2.1 time: 0.049384 Oct 27 10:09:22.873808 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3625/7323] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:22 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:09:22.925403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2100759230", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "dd251ce3-4f3f-4d84-8c9d-6f9b640cf476"}], "security_groups": [{"name": "tempest-securitygroup--896108089"}], "key_name": "tempest-keypair-1599840349", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:23.043843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] validate_networks() for [('dd251ce3-4f3f-4d84-8c9d-6f9b640cf476', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:09:23.566290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:09:23.566798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:09:23.567337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:09:23.568663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:09:23.569129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:09:23.579501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:23.580047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:23.580510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:23.581297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:23.582034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:23.582476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:23.602387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:09:23.608755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for user 5d7ab761c99040c4927b7eb498440e4a and project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:09:23.623488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:09:23.625975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:09:23.681583 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b7ef604b-bd87-4494-8ebd-3479f4f69bc4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760069 Oct 27 10:09:23.685393 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3699/7324] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:09:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:09:23.700652 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc4b1461-6f1d-4a6a-a167-744da50d3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:23.701497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fc4b1461-6f1d-4a6a-a167-744da50d3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:23.773965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fc4b1461-6f1d-4a6a-a167-744da50d3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:23.786965 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc4b1461-6f1d-4a6a-a167-744da50d3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1239 microversion: 2.1 time: 0.091417 Oct 27 10:09:23.788056 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3626/7325] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:23 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:24.825916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:24.826540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:24.833712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:24.834213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:24.834662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:24.835382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:24.835880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:24.836317 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:24.908018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:24.917620 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ab9f7bfe-22fa-4c65-b9d8-3587344ef853 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1291 microversion: 2.1 time: 0.096595 Oct 27 10:09:24.918279 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3700/7326] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:24 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1291 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:25.956148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:25.957723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:25.992507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:25.993684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:25.994339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:25.999636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:25.999636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:25.999636 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:26.399466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:26.415845 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e9f71ce5-b4a6-462d-9301-d9858ca9dafa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1364 microversion: 2.1 time: 0.475208 Oct 27 10:09:26.417224 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3627/7327] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:25 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1364 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:26.987046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2103ae18-2bd6-4544-9b60-cfca5cb5aeb4 req-1de81521-0546-4c0b-97f5-14e866373f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:27.030004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2103ae18-2bd6-4544-9b60-cfca5cb5aeb4 req-1de81521-0546-4c0b-97f5-14e866373f86 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:27.031181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2103ae18-2bd6-4544-9b60-cfca5cb5aeb4 req-1de81521-0546-4c0b-97f5-14e866373f86 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:27.033802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2103ae18-2bd6-4544-9b60-cfca5cb5aeb4 req-1de81521-0546-4c0b-97f5-14e866373f86 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:27.058341 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2103ae18-2bd6-4544-9b60-cfca5cb5aeb4 req-1de81521-0546-4c0b-97f5-14e866373f86 service nova] Creating event network-changed:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h1-858383-16 Oct 27 10:09:27.067833 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2103ae18-2bd6-4544-9b60-cfca5cb5aeb4 req-1de81521-0546-4c0b-97f5-14e866373f86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085953 Oct 27 10:09:27.068979 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3701/7328] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:09:27.445662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:27.446736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:27.456309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:27.457316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:27.458170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:27.459896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:27.460490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:27.461230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:27.630919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:27.639621 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c77d4841-f248-4931-9bb8-d29f9536985c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1364 microversion: 2.1 time: 0.200973 Oct 27 10:09:27.640231 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3628/7329] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:27 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:28.666928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:28.667558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:28.674433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:28.674945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:28.675405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:28.676181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:28.676658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:28.677639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:28.837277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:28.850698 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79b4e9a3-b682-4c2a-a517-2f7aeefc930b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1364 microversion: 2.1 time: 0.189064 Oct 27 10:09:28.851753 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3702/7330] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:28 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:29.890394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:29.892682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:29.900144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:29.900645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:29.901092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:29.901813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:29.902277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:29.902709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:30.247626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:30.257110 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-538a6be7-eb49-45be-9989-bb6258bb67f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1364 microversion: 2.1 time: 0.370941 Oct 27 10:09:30.258097 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3629/7331] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:29 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:31.283058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:31.283751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:31.291754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:31.292269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:31.292737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:31.293478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:31.293957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:31.294412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:31.483269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:31.498178 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5c4ce70-6232-44c6-8d6f-9406c4df5136 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1364 microversion: 2.1 time: 0.220134 Oct 27 10:09:31.499202 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3703/7332] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:31 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:32.524851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:32.525744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:32.534250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:32.534943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:32.535705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:32.537276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:32.537979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:32.538566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:32.697251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:32.705590 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-804f3105-d282-401b-a953-10ef9ab76347 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1364 microversion: 2.1 time: 0.186080 Oct 27 10:09:32.706207 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3630/7333] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:32 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:33.266789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-ea0e4499-8001-4d82-b561-f43535e02172 req-25b6b27d-fac2-418e-bf67-df1a1798444e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "name": "network-vif-plugged", "status": "completed", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:33.283941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ea0e4499-8001-4d82-b561-f43535e02172 req-25b6b27d-fac2-418e-bf67-df1a1798444e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:33.284804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ea0e4499-8001-4d82-b561-f43535e02172 req-25b6b27d-fac2-418e-bf67-df1a1798444e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:33.285637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-ea0e4499-8001-4d82-b561-f43535e02172 req-25b6b27d-fac2-418e-bf67-df1a1798444e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:33.304278 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-ea0e4499-8001-4d82-b561-f43535e02172 req-25b6b27d-fac2-418e-bf67-df1a1798444e service nova] Creating event network-vif-plugged:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h1-858383-16 Oct 27 10:09:33.311291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-ea0e4499-8001-4d82-b561-f43535e02172 req-25b6b27d-fac2-418e-bf67-df1a1798444e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050054 Oct 27 10:09:33.312505 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3704/7334] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:09:33.730275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:33.730928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:33.738685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:33.739101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:33.739545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:33.740292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:33.740755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:33.741201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:33.781345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:33.897476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:33.907775 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff69caee-bc06-4f16-b6ee-d7e7dfa87f2b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1364 microversion: 2.1 time: 0.181199 Oct 27 10:09:33.908631 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3631/7335] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:33 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:09:34.934014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:34.935023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:34.936885 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:34.937574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:09:34.945214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:34.945720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:34.946179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:34.946921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:34.947390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:34.947861 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:35.104706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:09:35.113672 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c14512d7-c3fb-4cbb-958b-e902a3e5a551 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1551 microversion: 2.1 time: 0.183895 Oct 27 10:09:35.114328 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3705/7336] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:09:34 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1551 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:09:35.138187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9bafa7b1-24c8-432c-bfa0-092ad00ae06a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:09:35.138869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9bafa7b1-24c8-432c-bfa0-092ad00ae06a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:09:35.145555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafa7b1-24c8-432c-bfa0-092ad00ae06a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:35.146058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafa7b1-24c8-432c-bfa0-092ad00ae06a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:35.146499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafa7b1-24c8-432c-bfa0-092ad00ae06a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:35.147215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafa7b1-24c8-432c-bfa0-092ad00ae06a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:35.147716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafa7b1-24c8-432c-bfa0-092ad00ae06a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:35.148145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bafa7b1-24c8-432c-bfa0-092ad00ae06a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:35.248628 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9bafa7b1-24c8-432c-bfa0-092ad00ae06a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114526 Oct 27 10:09:35.249434 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3632/7337] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 10:09:35 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:09:36.686990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3d6d7714-3b23-4cc6-ab30-501a4100a461 req-c06bee9b-3e13-4f8c-a53e-4b00c3308d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:09:36.698545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3d6d7714-3b23-4cc6-ab30-501a4100a461 req-c06bee9b-3e13-4f8c-a53e-4b00c3308d54 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:09:36.699046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3d6d7714-3b23-4cc6-ab30-501a4100a461 req-c06bee9b-3e13-4f8c-a53e-4b00c3308d54 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:09:36.699503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3d6d7714-3b23-4cc6-ab30-501a4100a461 req-c06bee9b-3e13-4f8c-a53e-4b00c3308d54 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:09:36.712922 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3d6d7714-3b23-4cc6-ab30-501a4100a461 req-c06bee9b-3e13-4f8c-a53e-4b00c3308d54 service nova] Creating event network-changed:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h1-858383-16 Oct 27 10:09:36.718274 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3d6d7714-3b23-4cc6-ab30-501a4100a461 req-c06bee9b-3e13-4f8c-a53e-4b00c3308d54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035022 Oct 27 10:09:36.718912 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3706/7338] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:10:51.002676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=17 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:51.003754 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=44 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:51.005498 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:10:51.005695 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:10:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524/action (ip 10.222.0.25) !!! Oct 27 10:10:51.099530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:10:51.101995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:51.108851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.109354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.109796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.110519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.110986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.111443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.144609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:51.151345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Old instance type m1.heat2, new instance type m1.heat {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:10:51.160259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:10:51.160680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:10:51.161160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:10:51.161573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:10:51.161982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:10:51.237204 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8470da2c-60d8-4a34-aa7a-83ddfcc22eb9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524/action" status: 202 len: 0 microversion: 2.1 time: 0.236563 Oct 27 10:10:51.238152 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3633/7339] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:10:50 2022] POST /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:10:51.248901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:51.250131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:51.259985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:51.261004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:51.272586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.273342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.273960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.275090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:51.275870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:51.276449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:51.452356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:51.463321 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d6847a4-c394-4952-839c-2f0697a96da5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1678 microversion: 2.1 time: 0.219523 Oct 27 10:10:51.463973 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3707/7340] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:51 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:52.490029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:52.490660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:52.499259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:52.499794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:52.500242 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:52.500981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:52.501440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:52.501875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:52.689560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:52.698739 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ddd243ad-6fe5-4fea-9f2b-402d3ae27eb4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1678 microversion: 2.1 time: 0.213437 Oct 27 10:10:52.707144 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3634/7341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:52 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:53.724828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:53.725763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:53.736359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.737585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.738679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.739009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:53.739497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:53.740050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:53.891419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:53.901939 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9899f8d5-0bfd-4a42-89a8-70603172d11c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.182640 Oct 27 10:10:53.902690 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3708/7342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:53 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:10:54.927393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:54.928208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:54.936001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.936501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.936947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:54.937676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:54.938140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:54.938567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:55.101040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:55.110946 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff46dfea-8f41-46cf-9ced-a0735108f35c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.188073 Oct 27 10:10:55.112216 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3635/7343] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:54 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:56.153299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:56.154240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:56.162101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:56.162742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:56.163288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:56.164274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:56.164845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:56.165379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:56.314727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:56.324202 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b531395-aa96-4fce-abc3-cb1138a3ac1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.175245 Oct 27 10:10:56.324905 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3709/7344] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:56 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:57.353119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:57.354002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:57.361769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:57.362315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:57.362764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:57.363498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:57.363993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:57.364428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:57.517290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:57.526474 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8a45300f-0154-40b8-ac22-ef107f728b9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.177217 Oct 27 10:10:57.527082 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3636/7345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:57 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:58.551411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:58.552109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:58.560161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.560574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.561038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:58.561795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:58.562274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:58.562720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:58.723037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:58.731908 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-565be88f-bf74-4325-bc3f-818d77b27319 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.185061 Oct 27 10:10:58.732518 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3710/7346] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:58 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:10:59.757211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:10:59.757849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:10:59.765137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:59.765658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:59.766096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:59.766810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:10:59.767270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:10:59.768271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:10:59.920397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:10:59.930431 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd759cd4-46ca-4704-9f3b-7fe763bb233d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.177372 Oct 27 10:10:59.931120 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3637/7347] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:10:59 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:00.955979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:00.956881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:00.964654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:00.965339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:00.965893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:00.966732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:00.967384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:00.967967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:01.131695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:01.140562 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bb98ed16-4b81-4ba7-a8cb-1597c4538a7c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.189059 Oct 27 10:11:01.141254 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3711/7348] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:00 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:02.166166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:02.166807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:02.175391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:02.175930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:02.176379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:02.177118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:02.177589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:02.178054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:02.347072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:02.357795 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e85a5530-38ef-4736-81c9-abab95148bc3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.195394 Oct 27 10:11:02.358718 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3638/7349] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:02 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:03.385304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:03.385963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:03.393908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:03.394421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:03.394878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:03.395657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:03.396138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:03.396589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:03.552999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:03.561839 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6237e0c8-0a15-447a-8248-7db8cd25a1de tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.180446 Oct 27 10:11:03.562438 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3712/7350] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:03 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:04.587014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:04.587892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:04.596238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:04.596886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:04.597438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:04.598363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:04.598922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:04.599638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:04.779797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:04.788929 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61b211e9-2cd0-4e09-9bc3-d25bd943462b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.206316 Oct 27 10:11:04.789545 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3639/7351] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:04 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:05.813892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:05.814669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:05.822234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:05.822740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:05.823196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:05.823968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:05.824442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:05.824883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:05.988160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:05.996853 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8bb68c3a-506a-404d-9c36-86d10be6d09f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.187101 Oct 27 10:11:05.997609 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3713/7352] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:05 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:07.021730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:07.022389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:07.029656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:07.030153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:07.030597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:07.031315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:07.031818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:07.032253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:07.229127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:07.237876 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5686d837-5aaa-466e-bfa1-9e8b593a3d16 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.220507 Oct 27 10:11:07.238544 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3640/7353] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:07 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:08.266561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:08.267831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:08.280229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:08.280794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:08.281305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:08.282088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:08.282602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:08.283705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:08.434421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:08.444388 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a2e803b-2369-4e47-bf62-c591f1aeafdf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.181818 Oct 27 10:11:08.445136 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3714/7354] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:08 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:09.469665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:09.470432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:09.478448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:09.478944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:09.479395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:09.480177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:09.480643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:09.481079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:09.637833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:09.648480 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a417e2ea-659e-4b45-b5f4-0a160aee38da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1683 microversion: 2.1 time: 0.182691 Oct 27 10:11:09.649259 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3641/7355] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:09 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:10.673609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:10.674709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:10.687399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.688377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.690363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.691750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:10.692612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:10.693401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:10.940391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:10.949197 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b4f9b1d-4528-4362-b40a-bf84fa30b62e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1682 microversion: 2.1 time: 0.280204 Oct 27 10:11:10.949800 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3715/7356] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:10 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1682 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:11.416574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d1981384-a94a-4770-b0a8-7f0653a5e5a1 req-80c96384-3050-471e-851e-0b5701fa549f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "name": "network-vif-unplugged", "status": "completed", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:11.427714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d1981384-a94a-4770-b0a8-7f0653a5e5a1 req-80c96384-3050-471e-851e-0b5701fa549f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:11.428209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d1981384-a94a-4770-b0a8-7f0653a5e5a1 req-80c96384-3050-471e-851e-0b5701fa549f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:11.428699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d1981384-a94a-4770-b0a8-7f0653a5e5a1 req-80c96384-3050-471e-851e-0b5701fa549f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:11.442694 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d1981384-a94a-4770-b0a8-7f0653a5e5a1 req-80c96384-3050-471e-851e-0b5701fa549f service nova] Creating event network-vif-unplugged:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h2-858383-16 Oct 27 10:11:11.451240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-d1981384-a94a-4770-b0a8-7f0653a5e5a1 req-80c96384-3050-471e-851e-0b5701fa549f service nova] Instance 822fb60d-ebc4-4812-9fed-e470c2375524 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:11:11.466115 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d1981384-a94a-4770-b0a8-7f0653a5e5a1 req-80c96384-3050-471e-851e-0b5701fa549f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165308 Oct 27 10:11:11.467111 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3642/7357] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:11:11.976020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:11.976985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:11.988939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:11.989495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:11.990846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:11.992157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:11.992655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:11.993097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:12.227844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:12.237944 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b8054902-fee6-4b95-aeb6-547d573c18f3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1682 microversion: 2.1 time: 0.267664 Oct 27 10:11:12.238802 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3716/7358] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:11 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1682 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:13.266913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:13.274129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:13.276070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:13.276574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:13.277018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.277736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:13.278220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:13.278648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.434046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:13.442332 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4257cfbd-2912-4c21-b507-46513959dd4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1680 microversion: 2.1 time: 0.181006 Oct 27 10:11:13.442932 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3643/7359] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:13 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:13.485517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-de5aa7d7-2ece-4a1a-b8aa-b69c9773fe37 req-d235e5f4-10e5-4260-9e0e-cfd78debb7da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:13.496733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-de5aa7d7-2ece-4a1a-b8aa-b69c9773fe37 req-d235e5f4-10e5-4260-9e0e-cfd78debb7da service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:13.497224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-de5aa7d7-2ece-4a1a-b8aa-b69c9773fe37 req-d235e5f4-10e5-4260-9e0e-cfd78debb7da service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:13.497669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-de5aa7d7-2ece-4a1a-b8aa-b69c9773fe37 req-d235e5f4-10e5-4260-9e0e-cfd78debb7da service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:13.511171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-de5aa7d7-2ece-4a1a-b8aa-b69c9773fe37 req-d235e5f4-10e5-4260-9e0e-cfd78debb7da service nova] Creating event network-changed:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h2-858383-16 Oct 27 10:11:13.518300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-de5aa7d7-2ece-4a1a-b8aa-b69c9773fe37 req-d235e5f4-10e5-4260-9e0e-cfd78debb7da service nova] Instance 822fb60d-ebc4-4812-9fed-e470c2375524 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:11:13.530583 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-de5aa7d7-2ece-4a1a-b8aa-b69c9773fe37 req-d235e5f4-10e5-4260-9e0e-cfd78debb7da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048756 Oct 27 10:11:13.531211 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3717/7360] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:14.468486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:14.469080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:14.477012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:14.477535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:14.477975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:14.478702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:14.479158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:14.479629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:14.663897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:14.672603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3529b12-f75d-4316-b634-4e52be63fd9c tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1680 microversion: 2.1 time: 0.208348 Oct 27 10:11:14.673907 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3644/7361] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:14 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:15.703196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:15.705062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:15.719546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.721723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.722900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:15.724568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:15.725820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:15.726958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:16.112972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:16.130352 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7a899c92-2411-4247-a09e-6c8c9976b137 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1680 microversion: 2.1 time: 0.435005 Oct 27 10:11:16.131178 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3718/7362] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:15 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1680 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:17.170429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:17.171342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:17.180793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.181376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.181923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.182855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.183411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.184044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.358618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.372434 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ac720835-5588-488c-8c5b-244b6e94a0c2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1677 microversion: 2.1 time: 0.205984 Oct 27 10:11:17.373483 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3645/7363] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:17 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:17.397228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:17.398271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:17.406176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.406766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.407232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.408256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.408780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.409273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.455764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.456090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.456539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.457567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.458043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.458481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.482037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:17.490400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for user 5d7ab761c99040c4927b7eb498440e4a and project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:17.638565 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0fc43005-7755-4640-80a1-e08afb44e8f2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524/action" status: 202 len: 0 microversion: 2.1 time: 0.245312 Oct 27 10:11:17.639399 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3719/7364] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:11:17 2022] POST /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:11:17.651132 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:17.652353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:17.661584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.662711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.663509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.664879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.665704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.666454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.918476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:17.938377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-325d0756-ace9-4c25-af93-d07668fab16c req-d3bee1f2-6527-4d6b-84fa-1790e7a10e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "name": "network-vif-plugged", "status": "completed", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:17.939364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bdc5235-fa54-424d-8dc2-371eda7603ea tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1676 microversion: 2.1 time: 0.292226 Oct 27 10:11:17.952862 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3646/7365] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:17 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1676 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:17.958515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-325d0756-ace9-4c25-af93-d07668fab16c req-d3bee1f2-6527-4d6b-84fa-1790e7a10e66 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:17.959217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-325d0756-ace9-4c25-af93-d07668fab16c req-d3bee1f2-6527-4d6b-84fa-1790e7a10e66 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:17.960224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-325d0756-ace9-4c25-af93-d07668fab16c req-d3bee1f2-6527-4d6b-84fa-1790e7a10e66 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:17.978926 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-325d0756-ace9-4c25-af93-d07668fab16c req-d3bee1f2-6527-4d6b-84fa-1790e7a10e66 service nova] Creating event network-vif-plugged:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h2-858383-16 Oct 27 10:11:17.987981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-325d0756-ace9-4c25-af93-d07668fab16c req-d3bee1f2-6527-4d6b-84fa-1790e7a10e66 service nova] Instance 822fb60d-ebc4-4812-9fed-e470c2375524 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:11:18.004730 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-325d0756-ace9-4c25-af93-d07668fab16c req-d3bee1f2-6527-4d6b-84fa-1790e7a10e66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074326 Oct 27 10:11:18.005541 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3720/7366] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:11:18.985214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:18.986035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:18.994126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.994621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.995216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:18.995982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:18.996441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:18.996872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:19.159596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:19.168498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e75d4d04-ff60-4246-bc71-223d29b30c85 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1676 microversion: 2.1 time: 0.187847 Oct 27 10:11:19.169101 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3647/7367] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:18 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:20.207273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:20.208043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:20.215040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.215597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.216054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.216789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:20.217254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:20.217691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:20.222536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:20.381365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:20.391020 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d7d9c539-8752-4b58-b6e7-cfbf3432c426 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1676 microversion: 2.1 time: 0.189264 Oct 27 10:11:20.391895 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3721/7368] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:20 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:21.231282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6315cf42-a354-40ea-bb7b-347196d37adf req-c29c9642-d0a2-4c84-94ea-d4f104f84ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "name": "network-vif-unplugged", "status": "completed", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:21.240696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=35 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:21.247259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6315cf42-a354-40ea-bb7b-347196d37adf req-c29c9642-d0a2-4c84-94ea-d4f104f84ff1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:21.247761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6315cf42-a354-40ea-bb7b-347196d37adf req-c29c9642-d0a2-4c84-94ea-d4f104f84ff1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:21.248198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6315cf42-a354-40ea-bb7b-347196d37adf req-c29c9642-d0a2-4c84-94ea-d4f104f84ff1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:21.252856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:21.263522 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6315cf42-a354-40ea-bb7b-347196d37adf req-c29c9642-d0a2-4c84-94ea-d4f104f84ff1 service nova] Creating event network-vif-unplugged:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h1-858383-16 Oct 27 10:11:21.271785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-6315cf42-a354-40ea-bb7b-347196d37adf req-c29c9642-d0a2-4c84-94ea-d4f104f84ff1 service nova] Instance 822fb60d-ebc4-4812-9fed-e470c2375524 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:11:21.284485 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6315cf42-a354-40ea-bb7b-347196d37adf req-c29c9642-d0a2-4c84-94ea-d4f104f84ff1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057150 Oct 27 10:11:21.285116 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3648/7369] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:21.417827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:21.418585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:21.421703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:21.428506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:21.429113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:21.429641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:21.430402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:21.430878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:21.431363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:21.930659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:21.940225 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7c9d9f43-d04c-45e4-9e2d-6b3223cb96dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1676 microversion: 2.1 time: 0.526328 Oct 27 10:11:21.941060 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3722/7370] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:21 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1676 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:22.968276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:22.969181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:22.976766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:22.977256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:22.977699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:22.978411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:22.978873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:22.979334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:23.132644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:23.141384 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-22f7ab80-2888-40b9-acdc-b7238f96ce9a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1676 microversion: 2.1 time: 0.178258 Oct 27 10:11:23.142762 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3649/7371] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:22 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:23.301170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-c5307863-7ad8-44b0-afd3-2b260b7f78c3 req-2b2e09d2-48bd-4318-b969-7eab8bf83b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:23.313245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c5307863-7ad8-44b0-afd3-2b260b7f78c3 req-2b2e09d2-48bd-4318-b969-7eab8bf83b14 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:23.313873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c5307863-7ad8-44b0-afd3-2b260b7f78c3 req-2b2e09d2-48bd-4318-b969-7eab8bf83b14 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:23.314378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-c5307863-7ad8-44b0-afd3-2b260b7f78c3 req-2b2e09d2-48bd-4318-b969-7eab8bf83b14 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:23.329710 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-c5307863-7ad8-44b0-afd3-2b260b7f78c3 req-2b2e09d2-48bd-4318-b969-7eab8bf83b14 service nova] Creating event network-changed:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h1-858383-16 Oct 27 10:11:23.338485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-c5307863-7ad8-44b0-afd3-2b260b7f78c3 req-2b2e09d2-48bd-4318-b969-7eab8bf83b14 service nova] Instance 822fb60d-ebc4-4812-9fed-e470c2375524 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:11:23.356091 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-c5307863-7ad8-44b0-afd3-2b260b7f78c3 req-2b2e09d2-48bd-4318-b969-7eab8bf83b14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058844 Oct 27 10:11:23.356716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3723/7372] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:11:24.170045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:24.171201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:24.184356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.185326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.186284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:24.187599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:24.189159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:24.189945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:24.386262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:24.395661 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4690468b-d4dc-4a80-94fe-fdc644c7e973 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1676 microversion: 2.1 time: 0.232854 Oct 27 10:11:24.396355 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3650/7373] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:24 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:25.424705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:25.425854 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:25.434904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.435606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.436138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.436984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:25.437540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:25.438111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:25.735181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:25.747504 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5e9a9b69-42a9-45c8-8429-5b74b15cfa02 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1676 microversion: 2.1 time: 0.330527 Oct 27 10:11:25.760789 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3724/7374] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:25 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1676 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:26.775104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:26.776270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:26.786506 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.787155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.787914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:26.788702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:26.789211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:26.789792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.013653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:27.030136 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4176fdf0-e646-4687-89e1-d17ca5ffce5f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1669 microversion: 2.1 time: 0.259503 Oct 27 10:11:27.043627 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3651/7375] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:26 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1669 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:27.089380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:27.091166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:27.111601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.111601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.111601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.111601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.111601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.111601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.296894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:27.305881 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-94c4f93d-e2bf-4d82-a156-62aab7d6407a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1669 microversion: 2.1 time: 0.231675 Oct 27 10:11:27.306476 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3725/7376] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:27 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1669 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:27.332650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:27.334128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:27.343379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.344263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.344971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.345779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.346228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.346851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.511978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:27.521818 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04e9c185-9089-44ac-a34c-ec1d51926c81 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1669 microversion: 2.1 time: 0.195364 Oct 27 10:11:27.522482 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3652/7377] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:27 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1669 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:27.547010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:27.548519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:27.550657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:27.558147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.558809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.559476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.560511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.561102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.561656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.613720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:11:27.735872 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-04df4a1a-0b79-4d6c-b727-736ef434c462 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 204 len: 0 microversion: 2.1 time: 0.192991 Oct 27 10:11:27.736637 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3726/7378] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:11:27 2022] DELETE /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:11:27.749306 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:27.750318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:27.758893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.759587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.760262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.761447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.762236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.762826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.792691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-279baf2a-6cc9-477c-a371-78d3c9ebed8e req-6ea6fbb5-08e7-48a9-b7a7-16e2facd10f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "name": "network-vif-plugged", "status": "completed", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:27.815067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-279baf2a-6cc9-477c-a371-78d3c9ebed8e req-6ea6fbb5-08e7-48a9-b7a7-16e2facd10f7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:27.816116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-279baf2a-6cc9-477c-a371-78d3c9ebed8e req-6ea6fbb5-08e7-48a9-b7a7-16e2facd10f7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:27.816994 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-279baf2a-6cc9-477c-a371-78d3c9ebed8e req-6ea6fbb5-08e7-48a9-b7a7-16e2facd10f7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:27.840104 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-279baf2a-6cc9-477c-a371-78d3c9ebed8e req-6ea6fbb5-08e7-48a9-b7a7-16e2facd10f7 service nova] Creating event network-vif-plugged:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h1-858383-16 Oct 27 10:11:27.851064 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-279baf2a-6cc9-477c-a371-78d3c9ebed8e req-6ea6fbb5-08e7-48a9-b7a7-16e2facd10f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066919 Oct 27 10:11:27.851953 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3727/7379] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:11:27.942869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:27.952059 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-afecfb76-8a54-4698-b2de-1444171767e0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1675 microversion: 2.1 time: 0.207970 Oct 27 10:11:27.952673 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3653/7380] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:27 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:28.977701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:28.979070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:28.988449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:28.989113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:28.989797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:28.990639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:28.991301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:28.992030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:29.150206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:29.158899 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-33a1b4b5-563e-4a08-a5e7-278597868f26 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1675 microversion: 2.1 time: 0.185554 Oct 27 10:11:29.159618 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3728/7381] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:28 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:30.189761 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:30.192042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:30.202338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:30.203226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:30.204051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:30.205538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:30.206339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:30.207289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:30.342864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:30.358074 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5ba9559-86ee-4828-8b75-1b899ff774ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 200 len: 1608 microversion: 2.1 time: 0.175831 Oct 27 10:11:30.358884 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3654/7382] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:30 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 1608 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:30.525057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-70be92ae-adf6-4ad6-8a51-0eddc1c95060 req-69102857-db6d-4e36-b90f-f5114d4ee922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822fb60d-ebc4-4812-9fed-e470c2375524", "name": "network-vif-deleted", "tag": "7325cbf1-ef2b-422b-b7cb-b7de30832358"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:30.546306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-70be92ae-adf6-4ad6-8a51-0eddc1c95060 req-69102857-db6d-4e36-b90f-f5114d4ee922 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:30.546968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-70be92ae-adf6-4ad6-8a51-0eddc1c95060 req-69102857-db6d-4e36-b90f-f5114d4ee922 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:30.547602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-70be92ae-adf6-4ad6-8a51-0eddc1c95060 req-69102857-db6d-4e36-b90f-f5114d4ee922 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:30.565167 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-70be92ae-adf6-4ad6-8a51-0eddc1c95060 req-69102857-db6d-4e36-b90f-f5114d4ee922 service nova] Creating event network-vif-deleted:7325cbf1-ef2b-422b-b7cb-b7de30832358 for instance 822fb60d-ebc4-4812-9fed-e470c2375524 on n-h1-858383-16 Oct 27 10:11:30.575258 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-70be92ae-adf6-4ad6-8a51-0eddc1c95060 req-69102857-db6d-4e36-b90f-f5114d4ee922 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054754 Oct 27 10:11:30.578275 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3729/7383] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:31.385703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:31.386542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:31.394640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.395178 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.395637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.396398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.397375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.397375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.413420 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 HTTP/1.1 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '822fb60d-ebc4-4812-9fed-e470c2375524'} Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:11:31.415133 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-babb4ad3-2040-438c-88f8-235c171a78dd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 404 len: 111 microversion: 2.1 time: 0.035100 Oct 27 10:11:31.425882 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3655/7384] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:31 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:11:31.441900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:31.442794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:31.450848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.451358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.451870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.452627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:31.453103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:31.453556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:31.470331 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 HTTP/1.1 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '822fb60d-ebc4-4812-9fed-e470c2375524'} Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:11:31.473549 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-93699cbb-9d2f-4ecd-b42c-bf632e8b7772 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 404 len: 111 microversion: 2.1 time: 0.042208 Oct 27 10:11:31.478527 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3730/7385] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:31 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:11:31.532815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1436281339", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "dd251ce3-4f3f-4d84-8c9d-6f9b640cf476"}], "security_groups": [{"name": "tempest-securitygroup--896108089"}], "key_name": "tempest-keypair-1599840349", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:31.669226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] validate_networks() for [('dd251ce3-4f3f-4d84-8c9d-6f9b640cf476', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:11:32.288364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:11:32.288789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:11:32.289268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:11:32.289797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:11:32.290216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:11:32.300241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.300737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.301180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.301937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:32.302404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:32.302836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:32.325050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:11:32.337528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for user 5d7ab761c99040c4927b7eb498440e4a and project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:11:32.364259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:11:32.368934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:11:32.461693 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b7d5f683-583d-4c9f-aa17-4856a421b45b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.932368 Oct 27 10:11:32.462802 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3656/7386] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:11:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:11:32.477069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c6bf00b-bfb8-4ec2-9ea2-0d2aa8f74508 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:32.480495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c6bf00b-bfb8-4ec2-9ea2-0d2aa8f74508 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:32.564046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c6bf00b-bfb8-4ec2-9ea2-0d2aa8f74508 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:32.572941 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c6bf00b-bfb8-4ec2-9ea2-0d2aa8f74508 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1239 microversion: 2.1 time: 0.100564 Oct 27 10:11:32.573635 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3731/7387] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:32 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:33.620810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:33.622206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:33.633610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.634253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.634815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.635777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:33.636371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:33.636898 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:33.737357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:33.753024 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b1a8817d-c1d1-4c24-a2f4-e1af745ad2d8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1291 microversion: 2.1 time: 0.141183 Oct 27 10:11:33.754107 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3657/7388] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:33 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1291 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:34.798424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:34.799287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:34.807795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.808394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.808920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:34.809811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:34.810449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:34.811048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:35.213653 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:35.230621 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9d7b2d70-bebf-4ad6-a345-66e30f7d5ae2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1364 microversion: 2.1 time: 0.436712 Oct 27 10:11:35.248331 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3732/7389] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:34 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1364 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:36.049288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-51ec4623-8a1d-4d5a-8d0c-e494d21cfb89 req-013fe2b7-bdd1-44d2-8163-74e87a1c5da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:36.068278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51ec4623-8a1d-4d5a-8d0c-e494d21cfb89 req-013fe2b7-bdd1-44d2-8163-74e87a1c5da9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.069391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51ec4623-8a1d-4d5a-8d0c-e494d21cfb89 req-013fe2b7-bdd1-44d2-8163-74e87a1c5da9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.070109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51ec4623-8a1d-4d5a-8d0c-e494d21cfb89 req-013fe2b7-bdd1-44d2-8163-74e87a1c5da9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.089094 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-51ec4623-8a1d-4d5a-8d0c-e494d21cfb89 req-013fe2b7-bdd1-44d2-8163-74e87a1c5da9 service nova] Creating event network-changed:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h2-858383-16 Oct 27 10:11:36.099418 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-51ec4623-8a1d-4d5a-8d0c-e494d21cfb89 req-013fe2b7-bdd1-44d2-8163-74e87a1c5da9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055823 Oct 27 10:11:36.100528 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3658/7390] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:36.271240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:36.272135 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:36.285595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.286501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.287329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.288701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:36.289232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:36.289738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:36.644929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:36.654363 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6519d6d0-a974-4fce-8f78-4d6a25672aef tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1364 microversion: 2.1 time: 0.388553 Oct 27 10:11:36.655273 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3733/7391] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:36 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1364 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:37.684497 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:37.685295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:37.692210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.692714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.693162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.693886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:37.694345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:37.694772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:37.845300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:37.854780 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-521f335e-e170-4fee-8da4-be0a0b98df72 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1364 microversion: 2.1 time: 0.175739 Oct 27 10:11:37.855376 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3659/7392] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:37 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:38.879464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:38.880627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:38.888902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.889562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.891321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:38.892687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:38.893588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:38.894437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:39.195262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:39.209229 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-08552a77-5d31-42cc-8fba-74b398984f1a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1364 microversion: 2.1 time: 0.333724 Oct 27 10:11:39.211212 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3734/7393] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:38 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:40.249810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:40.250993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:40.259708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.260258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.260739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.261504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:40.262061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:40.262565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:40.464458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:40.479618 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4aa98d9c-4672-445e-a9d6-c85db4566edb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1364 microversion: 2.1 time: 0.234679 Oct 27 10:11:40.480510 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3660/7394] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:40 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:41.508640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:41.509285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:41.517703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.518242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.518695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.519422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.519923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.520359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.672880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:41.681850 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b6a0ebc5-e93e-4b9f-96c9-1b4e143dc0c8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1364 microversion: 2.1 time: 0.178207 Oct 27 10:11:41.682453 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3735/7395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:41 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:41.942253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-41401d65-24a5-4aaa-87b2-642e2bebdf6e req-2d17d408-9da7-477a-82af-3aaebf2d4cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "name": "network-vif-plugged", "status": "completed", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:41.961782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-41401d65-24a5-4aaa-87b2-642e2bebdf6e req-2d17d408-9da7-477a-82af-3aaebf2d4cd6 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:41.962632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-41401d65-24a5-4aaa-87b2-642e2bebdf6e req-2d17d408-9da7-477a-82af-3aaebf2d4cd6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:41.963417 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-41401d65-24a5-4aaa-87b2-642e2bebdf6e req-2d17d408-9da7-477a-82af-3aaebf2d4cd6 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:41.986860 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-41401d65-24a5-4aaa-87b2-642e2bebdf6e req-2d17d408-9da7-477a-82af-3aaebf2d4cd6 service nova] Creating event network-vif-plugged:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h2-858383-16 Oct 27 10:11:41.996454 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-41401d65-24a5-4aaa-87b2-642e2bebdf6e req-2d17d408-9da7-477a-82af-3aaebf2d4cd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061596 Oct 27 10:11:41.997573 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3661/7396] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:42.721537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:42.722294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:42.725204 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:42.731790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.732314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.732776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.733536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:42.734014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:42.734958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:42.895426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:42.905337 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5412f2d-477b-424d-bd42-eb41e4463a11 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1364 microversion: 2.1 time: 0.187792 Oct 27 10:11:42.905899 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3736/7397] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:42 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:11:43.929167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:43.930297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:11:43.936638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:43.938087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:43.946782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.947495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.948094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:43.948890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:43.949410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:43.950143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.108630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:11:44.124695 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c649eb2-c7de-4593-85b2-8fb88bb71a93 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1550 microversion: 2.1 time: 0.196302 Oct 27 10:11:44.125793 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3662/7398] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:11:43 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1550 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:11:44.157119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4d100e41-c578-42a6-9966-df742a307b5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:11:44.158014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4d100e41-c578-42a6-9966-df742a307b5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:11:44.170723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d100e41-c578-42a6-9966-df742a307b5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.171655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d100e41-c578-42a6-9966-df742a307b5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.173058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d100e41-c578-42a6-9966-df742a307b5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.174403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d100e41-c578-42a6-9966-df742a307b5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:44.175266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d100e41-c578-42a6-9966-df742a307b5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:44.176221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4d100e41-c578-42a6-9966-df742a307b5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:44.350469 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4d100e41-c578-42a6-9966-df742a307b5e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200790 Oct 27 10:11:44.351714 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3737/7399] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 10:11:44 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:11:45.844925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ca688ec6-429e-4ad2-bf61-2dc837d504d7 req-638e8324-a6e6-44a6-85c4-ebc043f08212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:11:45.858906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ca688ec6-429e-4ad2-bf61-2dc837d504d7 req-638e8324-a6e6-44a6-85c4-ebc043f08212 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:11:45.860277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ca688ec6-429e-4ad2-bf61-2dc837d504d7 req-638e8324-a6e6-44a6-85c4-ebc043f08212 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:11:45.861133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ca688ec6-429e-4ad2-bf61-2dc837d504d7 req-638e8324-a6e6-44a6-85c4-ebc043f08212 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:11:45.881452 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ca688ec6-429e-4ad2-bf61-2dc837d504d7 req-638e8324-a6e6-44a6-85c4-ebc043f08212 service nova] Creating event network-changed:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h2-858383-16 Oct 27 10:11:45.888512 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ca688ec6-429e-4ad2-bf61-2dc837d504d7 req-638e8324-a6e6-44a6-85c4-ebc043f08212 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051107 Oct 27 10:11:45.889404 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3663/7400] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:12:51.717815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:51.718881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:51.720412 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:12:51.720649 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 (ip 10.222.0.25) !!! Oct 27 10:12:51.722933 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:12:51.723151 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 (ip 10.222.0.25) !!! Oct 27 10:12:51.734022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:12:51.735096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:51.756694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:51.757578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:51.758378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:51.759707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:51.760580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:51.761394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:51.946615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:12:51.956478 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-22526512-791d-4336-b428-8d04fd0c5c88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1668 microversion: 2.1 time: 0.243567 Oct 27 10:12:51.957350 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3738/7401] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:12:51 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1668 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:12:51.998404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:51.999255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=73 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:12:52.005811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f4d20e9a-4470-4d64-a715-386c812d2448 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c726e626-8316-4528-9223-9b069381ebd6"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:12:52.008467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f4d20e9a-4470-4d64-a715-386c812d2448 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:12:52.017695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d20e9a-4470-4d64-a715-386c812d2448 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:52.018196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d20e9a-4470-4d64-a715-386c812d2448 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:52.018645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d20e9a-4470-4d64-a715-386c812d2448 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:52.019370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d20e9a-4470-4d64-a715-386c812d2448 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:12:52.019887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d20e9a-4470-4d64-a715-386c812d2448 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:12:52.020343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f4d20e9a-4470-4d64-a715-386c812d2448 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:12:52.363532 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f4d20e9a-4470-4d64-a715-386c812d2448 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368201 Oct 27 10:12:52.364315 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3664/7402] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 10:12:51 2022] POST /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:04.402573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:04.405102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:04.407224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:04.407942 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:04.414010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:04.414520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:04.414974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:04.415743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:04.416217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:04.416662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:04.505986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:04.513027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120602) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:13:04.521134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:13:04.521440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:13:04.521921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:13:04.522338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:13:04.522757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:13:04.599262 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-966866ac-7406-4438-acf5-c7a1ff601d1e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/action" status: 202 len: 0 microversion: 2.1 time: 0.201006 Oct 27 10:13:04.600216 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3739/7403] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:13:04 2022] POST /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:04.611275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:04.613293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:04.616223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:04.617276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:04.630230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:04.631200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:04.631853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:04.632821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:04.633629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:04.634196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:04.812816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:04.829021 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ef4f110-773b-4c21-90ad-2d933706c6d5 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1723 microversion: 2.1 time: 0.223325 Oct 27 10:13:04.830123 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3665/7404] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:04 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:05.869797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:05.870414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:05.879827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:05.880590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:05.881284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:05.882326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:05.882905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:05.883393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:06.089201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:06.098994 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f6bed105-5699-4c37-a2ae-d65ee367ddf0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1723 microversion: 2.1 time: 0.233966 Oct 27 10:13:06.099625 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3740/7405] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:05 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:07.123348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:07.124083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:07.135922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.136815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.138475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.139804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:07.140655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:07.141425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:07.334994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:07.344870 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0ebf5e8-146b-4996-b071-f3d701bebcd6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.225920 Oct 27 10:13:07.345565 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3666/7406] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:07 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:08.371076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:08.371803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:08.379373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.379920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.380414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.381158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:08.381637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:08.382082 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:08.532891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:08.541943 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c80e093a-627f-4d08-8123-93305b972ffc tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.175091 Oct 27 10:13:08.542545 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3741/7407] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:08 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:09.566446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:09.567219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:09.574917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:09.575515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:09.576050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:09.576821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:09.577399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:09.577876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:09.729970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:09.739195 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-90cb4504-7e93-410b-9156-101dd5b60e32 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.176760 Oct 27 10:13:09.739834 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3667/7408] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:09 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:10.763311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:10.764054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:10.771263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:10.771807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:10.772265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:10.772996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:10.773466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:10.773906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:10.942637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:10.952277 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-32859c9f-ff62-4b66-b2fb-856bccbfa894 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.193530 Oct 27 10:13:10.952889 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3742/7409] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:10 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:11.977352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:11.978078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:11.986147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:11.986651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:11.987104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:11.987883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:11.988358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:11.988793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:12.155378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:12.164332 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a94cc45-b826-40a5-9c23-071b34ee7677 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.191062 Oct 27 10:13:12.164953 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3668/7410] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:11 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:13.204625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:13.205297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:13.213791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.214307 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.214777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.215548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:13.216089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:13.216596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:13.392112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:13.401068 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0894b359-361f-4545-907c-d0a37160f5e9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.201196 Oct 27 10:13:13.401687 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3743/7411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:13 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:14.426359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:14.427274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:14.435330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:14.435872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:14.436362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:14.437036 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:14.437499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:14.437932 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:14.588655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:14.598627 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f7cab081-0ec9-462d-a846-46fdba202fec tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.176212 Oct 27 10:13:14.599593 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3669/7412] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:14 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:15.624814 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:15.625530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:15.633562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.634072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.634536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.635272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:15.635784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:15.636234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:15.830413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:15.839842 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c4bce965-32fd-498d-833c-3ae6cb30431a tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.219521 Oct 27 10:13:15.840584 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3744/7413] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:15 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:16.866940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:16.867820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:16.875151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:16.875766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:16.876216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:16.876942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:16.877400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:16.877829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:17.023803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:17.033640 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab61f578-84cf-480a-b3bc-90dc112024ee tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.170724 Oct 27 10:13:17.034245 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3670/7414] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:16 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:18.058080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:18.058778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:18.067478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:18.068080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:18.068576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:18.069449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:18.069975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:18.070461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:18.222067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:18.237869 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1d1b2d78-b440-4864-b646-c076a03f3037 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.183322 Oct 27 10:13:18.238972 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3745/7415] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:18 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:19.266574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:19.267676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:19.278693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.279504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.280223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.281418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:19.282196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:19.282770 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:19.484794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:19.501262 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7444fad-a2b4-4fdc-95c7-2465be18ba2f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.241835 Oct 27 10:13:19.502476 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3671/7416] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:19 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:20.540465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:20.541504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:20.551161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.551887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.552466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.553319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:20.554137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:20.554826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:20.736493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:20.747325 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-36443252-ce38-4485-82dd-0ec759e05ccd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1728 microversion: 2.1 time: 0.210547 Oct 27 10:13:20.748097 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3746/7417] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:20 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:21.773956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:21.774880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:21.784080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.784602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.785312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:21.786270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:21.787076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:21.787690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:22.079795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:22.096885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f985f06-3f06-4279-abd7-f748fe63cf6d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1727 microversion: 2.1 time: 0.327085 Oct 27 10:13:22.097945 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3672/7418] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:21 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1727 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:22.218995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-efc98d21-3e8d-469a-99e4-816d6abb9ceb req-2d52b3d4-1498-46db-8d53-6362b00b3720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "name": "network-vif-unplugged", "status": "completed", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:22.240574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-efc98d21-3e8d-469a-99e4-816d6abb9ceb req-2d52b3d4-1498-46db-8d53-6362b00b3720 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:22.241406 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-efc98d21-3e8d-469a-99e4-816d6abb9ceb req-2d52b3d4-1498-46db-8d53-6362b00b3720 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:22.242417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-efc98d21-3e8d-469a-99e4-816d6abb9ceb req-2d52b3d4-1498-46db-8d53-6362b00b3720 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:22.268269 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-efc98d21-3e8d-469a-99e4-816d6abb9ceb req-2d52b3d4-1498-46db-8d53-6362b00b3720 service nova] Creating event network-vif-unplugged:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h1-858383-16 Oct 27 10:13:22.281101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-efc98d21-3e8d-469a-99e4-816d6abb9ceb req-2d52b3d4-1498-46db-8d53-6362b00b3720 service nova] Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:13:22.310671 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-efc98d21-3e8d-469a-99e4-816d6abb9ceb req-2d52b3d4-1498-46db-8d53-6362b00b3720 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099231 Oct 27 10:13:22.312779 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3747/7419] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:23.127323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:23.128315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:23.138062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.138752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.139457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.140403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:23.140999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:23.141529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:23.644673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:23.655752 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ede5c2c1-9123-4070-9177-24b6f3f56e08 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1727 microversion: 2.1 time: 0.532820 Oct 27 10:13:23.656533 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3673/7420] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:23 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1727 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:24.334448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6d53cadb-ac9b-4682-8d00-8c37ded68fe2 req-b43f1bf9-f1df-4b85-a19a-36c5337f5ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:24.354596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d53cadb-ac9b-4682-8d00-8c37ded68fe2 req-b43f1bf9-f1df-4b85-a19a-36c5337f5ccf service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:24.355500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d53cadb-ac9b-4682-8d00-8c37ded68fe2 req-b43f1bf9-f1df-4b85-a19a-36c5337f5ccf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:24.356382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6d53cadb-ac9b-4682-8d00-8c37ded68fe2 req-b43f1bf9-f1df-4b85-a19a-36c5337f5ccf service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:24.381681 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6d53cadb-ac9b-4682-8d00-8c37ded68fe2 req-b43f1bf9-f1df-4b85-a19a-36c5337f5ccf service nova] Creating event network-changed:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h1-858383-16 Oct 27 10:13:24.393431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-6d53cadb-ac9b-4682-8d00-8c37ded68fe2 req-b43f1bf9-f1df-4b85-a19a-36c5337f5ccf service nova] Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:13:24.415258 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6d53cadb-ac9b-4682-8d00-8c37ded68fe2 req-b43f1bf9-f1df-4b85-a19a-36c5337f5ccf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089735 Oct 27 10:13:24.416408 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3748/7421] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:24.685256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:24.686493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:24.695172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:24.695964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:24.696587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:24.697597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:24.698398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:24.699073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:25.085978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:25.101016 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8e7b7aa-cd6d-4d06-b6cc-34b277e52ba7 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.421866 Oct 27 10:13:25.120216 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3674/7422] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:24 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:26.140010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:26.141252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:26.153376 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:26.154261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:26.155071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:26.156432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:26.157282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:26.158068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:26.389102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:26.405824 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-72a7dd8c-237f-4e37-9feb-33efe1953b35 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.275574 Oct 27 10:13:26.406819 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3749/7423] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:26 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:27.446864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:27.447787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:27.456880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.457473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.457986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:27.458974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:27.459525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:27.460282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:27.709959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:27.734481 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b4d94f3-22b7-4055-939d-b352e5453c63 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.291760 Oct 27 10:13:27.735604 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3675/7424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:27 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:28.775375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:28.776649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:28.789423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.790332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.791221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.792593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:28.793528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:28.794242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:28.999201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:29.012745 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9aab0cbd-aaaf-497d-befc-3dada7cd7d4e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.244386 Oct 27 10:13:29.013552 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3750/7425] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:28 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:30.038730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:30.039385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:30.047127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.047650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.048124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.048862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:30.049332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:30.049762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:30.205856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:30.216129 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35d59554-49c0-4010-94a2-1b7f4fdb8b5d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.181333 Oct 27 10:13:30.216752 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3676/7426] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:30 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:31.240575 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:31.241328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:31.249552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:31.250216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:31.250778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:31.251718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:31.252182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:31.252702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:31.408828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:31.417724 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8cf83fe8-cbe6-4321-87a0-b7bb4f3d95c4 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.181556 Oct 27 10:13:31.418801 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3751/7427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:31 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:32.444079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:32.444887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:32.453922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:32.454517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:32.455199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:32.456252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:32.457183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:32.457723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:32.621803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:32.631286 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c62c1ab4-f440-4e7a-b176-d8cd6e6ff98b tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.191725 Oct 27 10:13:32.632043 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3677/7428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:32 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:33.674669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:33.675902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:33.688431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:33.689324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:33.690134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:33.691419 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:33.692394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:33.693191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:33.853079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:33.863654 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-afb16537-7d7d-4747-8df1-df1836cef5ff tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.196575 Oct 27 10:13:33.864329 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3752/7429] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:33 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:34.894005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:34.895167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:34.898530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=27 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:34.907515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:34.908402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:34.909171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:34.910442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:34.911292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:34.912121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:34.921543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=79 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:35.192223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:35.203593 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70e44c6c-ce6a-45d0-a153-ad01899ef7a9 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.317827 Oct 27 10:13:35.204505 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3678/7430] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:34 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:36.243820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:36.244735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:36.248362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=33 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:36.254521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.255006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.255468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:36.256233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:36.256710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:36.257157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:36.260294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:36.422874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:36.433112 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cd179066-bd53-4984-b9b3-64c5f818dca6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.193402 Oct 27 10:13:36.433823 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3753/7431] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:36 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:37.459223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:37.459968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:37.468474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.468988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.469446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.470199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:37.470673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:37.471108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:37.631740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:37.641318 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab749c6e-f511-4fdd-a914-e78cd65bbedd tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.186346 Oct 27 10:13:37.642012 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3679/7432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:37 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:38.669009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:38.669925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:38.679650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:38.680645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:38.681379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:38.682393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:38.683072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:38.683868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:38.881475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:38.899057 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-484c1275-d450-4975-8798-6aaf37c6ca2d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1725 microversion: 2.1 time: 0.234380 Oct 27 10:13:38.900208 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3754/7433] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:38 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:39.924421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:39.925346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:39.933997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:39.934500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:39.934953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:39.935706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:39.936175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:39.936608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.125433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:40.136260 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4300cbf6-f929-4adc-8250-b1637c0c6bfb tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1722 microversion: 2.1 time: 0.215932 Oct 27 10:13:40.136878 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3680/7434] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:39 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:40.161096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:40.161906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:40.171058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:40.172018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:40.173240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.174179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:40.175105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:40.175706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.224150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:40.224654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:40.225107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.225882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:40.226413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:40.226914 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.262800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:13:40.270556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Getting quotas for user 5d7ab761c99040c4927b7eb498440e4a and project bc03f7e3259b405482d57eafb0b76a49. Resources: {'cores', 'ram'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:13:40.425085 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a758d24f-9508-42fb-83aa-8413bc293350 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "POST /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/action" status: 202 len: 0 microversion: 2.1 time: 0.268172 Oct 27 10:13:40.426527 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3755/7435] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:13:40 2022] POST /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:13:40.442163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:40.443829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:40.457024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:40.457894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:40.460012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.461446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:40.462654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:40.463550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.572450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0164215b-46e5-40c4-986f-c67f7cedaebd req-fd9e6ebe-1a47-4a94-8a0c-fae3459c9bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "name": "network-vif-plugged", "status": "completed", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:40.585880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0164215b-46e5-40c4-986f-c67f7cedaebd req-fd9e6ebe-1a47-4a94-8a0c-fae3459c9bda service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:40.586503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0164215b-46e5-40c4-986f-c67f7cedaebd req-fd9e6ebe-1a47-4a94-8a0c-fae3459c9bda service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:40.587006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0164215b-46e5-40c4-986f-c67f7cedaebd req-fd9e6ebe-1a47-4a94-8a0c-fae3459c9bda service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:40.603785 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0164215b-46e5-40c4-986f-c67f7cedaebd req-fd9e6ebe-1a47-4a94-8a0c-fae3459c9bda service nova] Creating event network-vif-plugged:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h1-858383-16 Oct 27 10:13:40.612216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-0164215b-46e5-40c4-986f-c67f7cedaebd req-fd9e6ebe-1a47-4a94-8a0c-fae3459c9bda service nova] Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:13:40.630753 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0164215b-46e5-40c4-986f-c67f7cedaebd req-fd9e6ebe-1a47-4a94-8a0c-fae3459c9bda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208550 Oct 27 10:13:40.631714 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3681/7436] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:40.742210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:40.751730 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c1c6ad6e-cfbc-4c0b-9a67-469904280608 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.319679 Oct 27 10:13:40.752343 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3756/7437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:40 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:41.785292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:41.786023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:41.793504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:41.794002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:41.794448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:41.795171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:41.795666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:41.796096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:41.952953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:41.962832 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01a87b91-c0d2-49b2-8644-fbe6ce27f537 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.182674 Oct 27 10:13:41.963555 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3682/7438] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:41 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:42.988286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:42.989130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:42.997044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.997558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.998016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:42.998740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:42.999212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:42.999690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:43.152795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:43.162910 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ce28dfb1-baf8-46f1-b5aa-a6344a55fd6f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.178526 Oct 27 10:13:43.163735 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3757/7439] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:42 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:44.189867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:44.190892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:44.199774 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.200418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.200979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.201845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:44.202441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:44.203016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:44.453325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:44.469435 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2bdc7be-817d-45f8-bf23-b9e15e5cf37f tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.283919 Oct 27 10:13:44.470439 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3683/7440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:44 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:45.496415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:45.497288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:45.507462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:45.508338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:45.509239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:45.510178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:45.510992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:45.512354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:45.697598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:45.713845 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d6bb15d6-cb11-4699-95b9-e30ca0b0b1ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.222907 Oct 27 10:13:45.714898 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3758/7441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:45 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:46.370053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b7b17efb-3e60-4e2d-8e52-a5c8535d8830 req-5563698e-5ea7-49b3-ae83-7dec450049be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "name": "network-vif-unplugged", "status": "completed", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:46.395735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b7b17efb-3e60-4e2d-8e52-a5c8535d8830 req-5563698e-5ea7-49b3-ae83-7dec450049be service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:46.397189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b7b17efb-3e60-4e2d-8e52-a5c8535d8830 req-5563698e-5ea7-49b3-ae83-7dec450049be service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:46.398244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b7b17efb-3e60-4e2d-8e52-a5c8535d8830 req-5563698e-5ea7-49b3-ae83-7dec450049be service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:46.426379 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b7b17efb-3e60-4e2d-8e52-a5c8535d8830 req-5563698e-5ea7-49b3-ae83-7dec450049be service nova] Creating event network-vif-unplugged:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h2-858383-16 Oct 27 10:13:46.438299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-b7b17efb-3e60-4e2d-8e52-a5c8535d8830 req-5563698e-5ea7-49b3-ae83-7dec450049be service nova] Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:13:46.469971 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b7b17efb-3e60-4e2d-8e52-a5c8535d8830 req-5563698e-5ea7-49b3-ae83-7dec450049be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108424 Oct 27 10:13:46.471859 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3684/7442] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:46.748354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:46.749609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:46.759394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:46.760129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:46.760741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:46.762067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:46.762680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:46.763386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:47.128181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:47.144525 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-99b25af6-0f80-4e88-a93e-54da73224105 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.401403 Oct 27 10:13:47.145405 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3759/7443] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:46 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:47.583607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3fb9ea8a-1691-401b-92ca-7a86d7cc5401 req-03d971f2-49fc-4eba-877a-2516eb628586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:13:47.605315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3fb9ea8a-1691-401b-92ca-7a86d7cc5401 req-03d971f2-49fc-4eba-877a-2516eb628586 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:47.607066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3fb9ea8a-1691-401b-92ca-7a86d7cc5401 req-03d971f2-49fc-4eba-877a-2516eb628586 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:47.608192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3fb9ea8a-1691-401b-92ca-7a86d7cc5401 req-03d971f2-49fc-4eba-877a-2516eb628586 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:47.631946 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3fb9ea8a-1691-401b-92ca-7a86d7cc5401 req-03d971f2-49fc-4eba-877a-2516eb628586 service nova] Creating event network-changed:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h2-858383-16 Oct 27 10:13:47.644300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-3fb9ea8a-1691-401b-92ca-7a86d7cc5401 req-03d971f2-49fc-4eba-877a-2516eb628586 service nova] Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:13:47.661773 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3fb9ea8a-1691-401b-92ca-7a86d7cc5401 req-03d971f2-49fc-4eba-877a-2516eb628586 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084505 Oct 27 10:13:47.662845 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3685/7444] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:13:48.174828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:48.175831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:48.185372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:48.186149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:48.186785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:48.187738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:48.188401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:48.189132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:48.736094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:48.748773 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-21632819-0292-41fc-b8a5-947f815f118d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.581980 Oct 27 10:13:48.749730 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3760/7445] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:48 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:49.790013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:49.791319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:49.803125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:49.803894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:49.804979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:49.806230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:49.807014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:49.808536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:50.056633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:50.070161 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0f3f5ce-42ba-41d9-b3b4-a0edc74549bf tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.289219 Oct 27 10:13:50.071462 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3686/7446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:49 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:51.097283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:51.098379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:51.104373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:13:51.112291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.113538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.114559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.116095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:51.116870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:51.117647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:51.348174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:51.358700 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-243cd498-57f6-4ad0-801c-a798409c1e7d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.265714 Oct 27 10:13:51.359808 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3761/7447] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:51 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:13:52.390512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:52.391550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:52.405111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:52.405732 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:52.406473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:52.407862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:52.408691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:52.409490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:52.648179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:52.660629 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa3874cc-9663-466a-9a85-c6e1467ee75e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.278126 Oct 27 10:13:52.661614 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3687/7448] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:52 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:53.689300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:53.690083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:53.697506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:53.697989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:53.698485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:53.699329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:53.699850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:53.700361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:53.916012 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:53.926233 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c96b284-0bbe-4a63-bf7f-9b0b28c6d506 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.240980 Oct 27 10:13:53.926848 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3762/7449] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:53 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:55.013935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:55.014574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:55.022246 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:55.022781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:55.023556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:55.024623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:55.025223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:55.025698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:55.240294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:55.250406 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-853b50e2-76dc-465e-9239-0bcbb91f36e2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.240678 Oct 27 10:13:55.251021 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3688/7450] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:55 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:56.275615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:56.276304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:56.288744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:56.289273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:56.289801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:56.290922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:56.291435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:56.292463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:56.451167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:56.461456 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8b2bc38-84af-4c5e-b0db-5d2a7e8f6abe tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.190595 Oct 27 10:13:56.462136 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3763/7451] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:56 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:57.486467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:57.487154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:57.494956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:57.495517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:57.496031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:57.496843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:57.497345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:57.497817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:57.654837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:57.663747 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b136ee67-0385-4a1d-8cf8-66f44bdb7376 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.181359 Oct 27 10:13:57.664528 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3689/7452] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:57 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:58.690423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:58.691113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:58.698389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:58.698908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:58.699362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:58.700152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:58.700623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:58.701061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:58.879559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:13:58.893676 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f4fca04-dc33-42b1-83ee-69f690f96307 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.207035 Oct 27 10:13:58.894796 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3764/7453] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:58 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:13:59.918736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:13:59.919403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:13:59.927119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:59.927786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:59.928400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:13:59.929330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:13:59.930008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:13:59.930484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:00.085961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:00.096107 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29231d2e-fce9-4194-b51b-81b96b0a48ac tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.182036 Oct 27 10:14:00.096789 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3690/7454] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:13:59 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:01.121154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:01.121816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:01.129387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.129933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.130392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.131134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:01.131637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:01.132089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:01.289292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:01.298586 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7fd142dd-d992-4507-a5f9-bf316f5f0af3 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.181868 Oct 27 10:14:01.299191 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3765/7455] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:01 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:02.324907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:02.326183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:02.335890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:02.336565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:02.337150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:02.338004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:02.338714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:02.339258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:02.504591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:02.513706 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dca17dbd-e041-442e-8738-f13094c50c1d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1721 microversion: 2.1 time: 0.192955 Oct 27 10:14:02.514318 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3691/7456] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:02 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:03.538707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:03.539356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:03.547372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.547932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.548396 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.549139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.549619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.550079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.708510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:03.710893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:03.721217 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5c40dffa-3b39-46fc-b351-684ab3d8643e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1714 microversion: 2.1 time: 0.186450 Oct 27 10:14:03.721838 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3766/7457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:03 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1714 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:03.749280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:03.750416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:03.764111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.764983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.765676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:03.767003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:03.767854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:03.768593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.215238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:04.224713 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db91e50d-8cfb-44b5-80a3-f510f3c73f88 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1714 microversion: 2.1 time: 0.482899 Oct 27 10:14:04.225309 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3692/7458] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:03 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1714 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:04.250286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:04.251060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:04.260226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.261522 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.262060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.262997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.263553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.264291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.429382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:04.440262 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c48d6f39-13d6-4299-b6a3-cae00e4904c6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1714 microversion: 2.1 time: 0.195366 Oct 27 10:14:04.441120 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3767/7459] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:04 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1714 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:04.470749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:04.471859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:04.483329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.484431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.485249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.486600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.487395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.488160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.533817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:14:04.652537 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-284936db-d287-4d83-a2ff-43aa0af04bd2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 204 len: 0 microversion: 2.1 time: 0.188739 Oct 27 10:14:04.653987 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3693/7460] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:04 2022] DELETE /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:14:04.667187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:04.668074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:04.676874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.677597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.678335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.679398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:04.680368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:04.681184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:04.865401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:04.874947 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e8c3a02e-0398-4d7f-959c-58236dad354d tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1720 microversion: 2.1 time: 0.213168 Oct 27 10:14:04.875856 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3768/7461] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:04 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:05.901872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:05.902513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:05.905462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:05.911885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:05.912397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:05.912872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.913575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:05.914047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:05.914483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:05.919340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:06.097821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:06.110188 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dabae1e7-bccc-49dd-b12f-e12ca6eb4919 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1720 microversion: 2.1 time: 0.214027 Oct 27 10:14:06.110842 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3694/7462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:05 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:06.884261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-99d11b89-fb13-43b2-9acb-fbed2ac60220 req-a865b7bf-76d3-4482-9fc1-a71b92712fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "name": "network-vif-plugged", "status": "completed", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:06.897943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:06.911279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-99d11b89-fb13-43b2-9acb-fbed2ac60220 req-a865b7bf-76d3-4482-9fc1-a71b92712fb4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:06.912340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-99d11b89-fb13-43b2-9acb-fbed2ac60220 req-a865b7bf-76d3-4482-9fc1-a71b92712fb4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:06.913227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-99d11b89-fb13-43b2-9acb-fbed2ac60220 req-a865b7bf-76d3-4482-9fc1-a71b92712fb4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:06.937078 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-99d11b89-fb13-43b2-9acb-fbed2ac60220 req-a865b7bf-76d3-4482-9fc1-a71b92712fb4 service nova] Creating event network-vif-plugged:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h2-858383-16 Oct 27 10:14:06.947241 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-99d11b89-fb13-43b2-9acb-fbed2ac60220 req-a865b7bf-76d3-4482-9fc1-a71b92712fb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070986 Oct 27 10:14:06.948643 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3769/7463] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:07.135649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:07.136433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:07.145799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:07.146425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:07.147188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:07.148040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:07.148596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:07.149116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:07.477430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:07.487053 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0ead790f-fba9-4dbf-a55b-3fde845a9be0 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1720 microversion: 2.1 time: 0.355718 Oct 27 10:14:07.487857 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3695/7464] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:07 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1720 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:07.915454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-227b92a1-69a1-49f6-8f27-b56c92c2e8c4 req-42ad0335-260e-4a76-b37d-612b34a22bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74aff575-6148-4e9d-b570-1eb880ded0d9", "name": "network-vif-deleted", "tag": "3743c226-bf3a-4867-b1a6-166ccf08380a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:07.938830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-227b92a1-69a1-49f6-8f27-b56c92c2e8c4 req-42ad0335-260e-4a76-b37d-612b34a22bd9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:07.939531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-227b92a1-69a1-49f6-8f27-b56c92c2e8c4 req-42ad0335-260e-4a76-b37d-612b34a22bd9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:07.940258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-227b92a1-69a1-49f6-8f27-b56c92c2e8c4 req-42ad0335-260e-4a76-b37d-612b34a22bd9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:07.958421 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-227b92a1-69a1-49f6-8f27-b56c92c2e8c4 req-42ad0335-260e-4a76-b37d-612b34a22bd9 service nova] Creating event network-vif-deleted:3743c226-bf3a-4867-b1a6-166ccf08380a for instance 74aff575-6148-4e9d-b570-1eb880ded0d9 on n-h2-858383-16 Oct 27 10:14:07.964979 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-227b92a1-69a1-49f6-8f27-b56c92c2e8c4 req-42ad0335-260e-4a76-b37d-612b34a22bd9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053679 Oct 27 10:14:07.966006 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3770/7465] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:14:08.518818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:08.520142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:08.532868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:08.534100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:08.534572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:08.536278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:08.537236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:08.538031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:08.661930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:08.671397 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b129c3e6-fd63-4852-9b51-e226f1da4aad tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1370 microversion: 2.1 time: 0.161657 Oct 27 10:14:08.672102 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3696/7466] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:08 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:09.703412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:09.704682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:09.717704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.718658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.719480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.720842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:09.721704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:09.722487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:09.833713 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:09.844493 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-efce4c62-cc7f-40ae-9769-cfc17fc55cc8 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1370 microversion: 2.1 time: 0.152576 Oct 27 10:14:09.845301 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3771/7467] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:09 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:10.873608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:10.874711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:10.887709 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:10.888597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:10.889378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:10.890642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:10.891462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:10.892258 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:10.991192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:11.002690 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c60b12f-5cd8-4369-b8da-587db96aae51 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1370 microversion: 2.1 time: 0.136817 Oct 27 10:14:11.003388 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3697/7468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:10 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1370 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:12.027546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:12.028722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:12.037136 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:12.037821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:12.038379 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:12.039239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:12.039933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:12.040481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:12.115829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:12.126599 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1d80cc12-6586-4c61-aabb-c71abf665352 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1370 microversion: 2.1 time: 0.103222 Oct 27 10:14:12.128157 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3772/7469] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:12 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:13.156458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:13.157552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:13.167148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:13.167859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:13.168568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:13.169781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:13.170598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:13.171328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:13.219381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:13.220323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:13.221143 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:13.221982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lazy-loading 'fault' on Instance uuid 74aff575-6148-4e9d-b570-1eb880ded0d9 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:14:13.300567 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7ab761c99040c4927b7eb498440e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc03f7e3259b405482d57eafb0b76a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:13.317149 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9202a1ee-1d1b-4d6d-a28f-0304239549a2 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 200 len: 1375 microversion: 2.1 time: 0.167255 Oct 27 10:14:13.318443 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3698/7470] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:13 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:14.361701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:14.362631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:14.370634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:14.371140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:14.371638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.372415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:14.372903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:14.373353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.393656 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 HTTP/1.1 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '74aff575-6148-4e9d-b570-1eb880ded0d9'} Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:14.395593 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-de3c8a7e-36a9-476c-b690-895780f7cb0e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 404 len: 111 microversion: 2.1 time: 0.040303 Oct 27 10:14:14.403946 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3773/7471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:14 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:14:14.469659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:14.472012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:14.480350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:14.480913 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:14.481416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.482268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:14.482814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:14.483295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:14.498356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/os-volume_attachments HTTP/1.1 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': '74aff575-6148-4e9d-b570-1eb880ded0d9'} Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:14.500266 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fade5962-3d82-42d0-93ca-281327976a38 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036495 Oct 27 10:14:14.506219 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3699/7472] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:14:14 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:17.907921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:17.908527 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:17.915891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:17.917066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:17.917518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:17.918255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:17.918764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:17.919205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:17.935115 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 HTTP/1.1 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '74aff575-6148-4e9d-b570-1eb880ded0d9'} Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:17.936737 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be036a16-890a-4d0b-b649-574773865a01 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 404 len: 111 microversion: 2.1 time: 0.034707 Oct 27 10:14:17.945167 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3774/7473] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:17 2022] DELETE /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:17.950806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:17.951445 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 74aff575-6148-4e9d-b570-1eb880ded0d9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:17.959264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:17.959815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:17.960257 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:17.960970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:17.961565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:17.962023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:17.977387 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 HTTP/1.1 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '74aff575-6148-4e9d-b570-1eb880ded0d9'} Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:17.979691 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 74aff575-6148-4e9d-b570-1eb880ded0d9 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2cc927e-45b8-4184-b695-b41bcd16b936 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9" status: 404 len: 111 microversion: 2.1 time: 0.036829 Oct 27 10:14:17.987999 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3700/7474] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:17 2022] GET /compute/v2.1/servers/74aff575-6148-4e9d-b570-1eb880ded0d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:14:17.995081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:17.995613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:18.002057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.002636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.003161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.004069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.004600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.005102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.020922 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 HTTP/1.1 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '822fb60d-ebc4-4812-9fed-e470c2375524'} Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:18.022589 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34bbcea9-1220-4ff0-8ad1-7878535b11ae tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 404 len: 111 microversion: 2.1 time: 0.033560 Oct 27 10:14:18.030716 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3775/7475] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:17 2022] DELETE /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:14:18.036491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:18.037264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 822fb60d-ebc4-4812-9fed-e470c2375524] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:18.044700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.045198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.045645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.046358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.046816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.047245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.063120 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 HTTP/1.1 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '822fb60d-ebc4-4812-9fed-e470c2375524'} Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.064801 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.069720 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.069720 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.069720 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.069720 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:18.069720 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:18.069720 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. Oct 27 10:14:18.069720 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.069720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 822fb60d-ebc4-4812-9fed-e470c2375524 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:18.069720 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ea6d5e5-fd41-4db3-840d-719713418d56 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524" status: 404 len: 111 microversion: 2.1 time: 0.035023 Oct 27 10:14:18.070726 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3701/7476] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:18 2022] GET /compute/v2.1/servers/822fb60d-ebc4-4812-9fed-e470c2375524 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:14:18.077128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:18.077645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:18.084576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.085074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.085531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.086247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.086712 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.087147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.101916 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f HTTP/1.1 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '2a99b597-8a5f-4c0e-8ade-11dc7e48817f'} Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:18.104084 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7960aaf4-6166-4070-8ff2-3068fe5680e6 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 404 len: 111 microversion: 2.1 time: 0.034701 Oct 27 10:14:18.111257 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3776/7477] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:18 2022] DELETE /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:18.116923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:18.117549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 2a99b597-8a5f-4c0e-8ade-11dc7e48817f] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:18.125124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.125629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.126064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.126794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.127264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.127725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.143158 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f HTTP/1.1 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '2a99b597-8a5f-4c0e-8ade-11dc7e48817f'} Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.144888 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 2a99b597-8a5f-4c0e-8ade-11dc7e48817f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29a7925f-acf7-4672-aa05-1e4e0fa764da tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f" status: 404 len: 111 microversion: 2.1 time: 0.033553 Oct 27 10:14:18.153272 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3702/7478] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:18 2022] GET /compute/v2.1/servers/2a99b597-8a5f-4c0e-8ade-11dc7e48817f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:14:18.161181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:18.161705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:18.169260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.169769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.170227 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.170982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.171465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.171971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.188022 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 HTTP/1.1 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '86ea2e80-86b9-4942-93b9-59d082c82285'} Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:18.189697 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2db5fc85-24ff-40a2-ac03-f5781afd8b71 tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 404 len: 111 microversion: 2.1 time: 0.034760 Oct 27 10:14:18.195036 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3777/7479] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:18 2022] DELETE /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:18.201903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:18.202677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] [instance: 86ea2e80-86b9-4942-93b9-59d082c82285] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:18.211316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.211947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.212466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.213311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:18.214159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:18.214833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:18.232778 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] HTTP exception thrown: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Request method failure captured: Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 HTTP/1.1 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlftTlkp9PF0zZrwtUEp2jnvlbmbgYYjLk6XLaa_0TdHrHtarW8-QBZc35-HmGCXJczs_1VNn6fPtB0bL0V7PlysZU3hCrNE81Y1kQNjzNiwE050NZtPwIgiou2k6KH0nzlYtg1bzCMxs1x67L4GZ-rn5yY3-PXSztmDAyI6WFxFIP4 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc03f7e3259b405482d57eafb0b76a49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc03f7e3259b405482d57eafb0b76a49"}]}] Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: bc03f7e3259b405482d57eafb0b76a49 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerActionsTestJSON-615707280 Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 5d7ab761c99040c4927b7eb498440e4a Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServerActionsTestJSON-615707280-project Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '86ea2e80-86b9-4942-93b9-59d082c82285'} Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:14:18.234369 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Returning 404 to user: Instance 86ea2e80-86b9-4942-93b9-59d082c82285 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c0a34bb-2520-4e5a-b3dc-c63e455d50aa tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285" status: 404 len: 111 microversion: 2.1 time: 0.038559 Oct 27 10:14:18.246008 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3703/7480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:18 2022] GET /compute/v2.1/servers/86ea2e80-86b9-4942-93b9-59d082c82285 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:14:18.248297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3018f965-5583-43c7-a7e9-fa475b02e53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] Calling method '.version_select at 0x7f31abb86700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:18.277731 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3018f965-5583-43c7-a7e9-fa475b02e53e tempest-ServerActionsTestJSON-615707280 tempest-ServerActionsTestJSON-615707280-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599840349" status: 202 len: 0 microversion: 2.1 time: 0.035798 Oct 27 10:14:18.278752 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3778/7481] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Oct 27 10:14:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599840349 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:14:30.485739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=21 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:30.487093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=41 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:30.720368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2097146242", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "a53c27df-c468-4d0d-9bb2-9d07c303b760"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:30.811402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] validate_networks() for [('a53c27df-c468-4d0d-9bb2-9d07c303b760', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:14:31.462039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:14:31.462797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:14:31.463905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:14:31.464690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:14:31.465788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:14:31.486576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:31.487675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:31.488287 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:31.490037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:31.490917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:31.491992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:31.526835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Getting quotas for project 75429434d61f41e8ac08b01dfbc30393. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:31.538030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Getting quotas for user ef332248a7b347f09587fcc18c7b1ede and project 75429434d61f41e8ac08b01dfbc30393. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:31.564644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:14:31.569379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:14:31.655959 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [c9a4d15b-e645-4f8c-892d-88f7bf5ca849] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:14:32.011890 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:14:32.012174 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:14:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 27 10:14:32.667079 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [c9a4d15b-e645-4f8c-892d-88f7bf5ca849] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39062. Oct 27 10:14:32.673524 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b3b4d3cf-3670-4cee-85b1-ac03b03d85fb tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.193569 Oct 27 10:14:32.681113 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3704/7482] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:14:32.693102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98b2d1a9-c4f5-4b56-bb63-39e427ea0d62 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:32.693102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98b2d1a9-c4f5-4b56-bb63-39e427ea0d62 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:32.697611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=39 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:32.698576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:32.769796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-98b2d1a9-c4f5-4b56-bb63-39e427ea0d62 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:32.777377 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98b2d1a9-c4f5-4b56-bb63-39e427ea0d62 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1217 microversion: 2.1 time: 0.094602 Oct 27 10:14:32.777978 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3779/7483] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:32 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:33.808192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-860f67a1-ce76-4be5-95cc-ae26a5883901 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:33.809593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-860f67a1-ce76-4be5-95cc-ae26a5883901 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:33.916104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-860f67a1-ce76-4be5-95cc-ae26a5883901 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:33.932189 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-860f67a1-ce76-4be5-95cc-ae26a5883901 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1217 microversion: 2.1 time: 0.133708 Oct 27 10:14:33.933418 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3705/7484] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:33 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:34.978844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c970483b-ac18-44ca-ba2a-8cbd94015416 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:34.980159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c970483b-ac18-44ca-ba2a-8cbd94015416 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:35.058638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c970483b-ac18-44ca-ba2a-8cbd94015416 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:35.073057 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c970483b-ac18-44ca-ba2a-8cbd94015416 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1217 microversion: 2.1 time: 0.100793 Oct 27 10:14:35.077210 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3780/7485] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:34 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:36.097476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-69bcf0e3-2b51-4a66-ad18-9575512e951a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:36.098517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-69bcf0e3-2b51-4a66-ad18-9575512e951a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:36.159818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-69bcf0e3-2b51-4a66-ad18-9575512e951a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:36.168187 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-69bcf0e3-2b51-4a66-ad18-9575512e951a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1217 microversion: 2.1 time: 0.074763 Oct 27 10:14:36.168756 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3706/7486] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:36 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:37.195022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:37.196152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:37.209516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:37.210385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:37.211187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:37.213035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:37.213896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:37.214677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:37.286898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:37.296345 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2b62608f-a158-458b-b8a8-fd0dbeee7d20 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1221 microversion: 2.1 time: 0.108366 Oct 27 10:14:37.296966 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3781/7487] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:37 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:38.324748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:38.326849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:38.342705 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:38.343602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:38.344420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:38.345718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:38.346578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:38.347338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:38.455589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:38.466578 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42f8806a-6899-4d63-8aa4-15fa6380b247 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1275 microversion: 2.1 time: 0.150084 Oct 27 10:14:38.468381 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3707/7488] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:38 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:39.497394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:39.498061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:39.505511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:39.506018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:39.506471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:39.507247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:39.507762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:39.508207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:39.767769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:39.781319 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9649c30f-fd46-469c-8e59-270116428e1a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1317 microversion: 2.1 time: 0.289277 Oct 27 10:14:39.782110 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3782/7489] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:39 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:39.990289 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1368b316-7ae6-45b8-875c-59ce982d7c83 req-a001a986-1b5d-4286-8cf3-137bc1a85d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8dd9309-b8fa-4377-ba27-e4c07d7b40b5", "tag": "b2fdb046-92dd-4fcd-a152-c9be3c1d2094"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:40.020803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1368b316-7ae6-45b8-875c-59ce982d7c83 req-a001a986-1b5d-4286-8cf3-137bc1a85d22 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:40.021564 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1368b316-7ae6-45b8-875c-59ce982d7c83 req-a001a986-1b5d-4286-8cf3-137bc1a85d22 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:40.022346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1368b316-7ae6-45b8-875c-59ce982d7c83 req-a001a986-1b5d-4286-8cf3-137bc1a85d22 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:40.051931 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1368b316-7ae6-45b8-875c-59ce982d7c83 req-a001a986-1b5d-4286-8cf3-137bc1a85d22 service nova] Creating event network-changed:b2fdb046-92dd-4fcd-a152-c9be3c1d2094 for instance f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 on n-h1-858383-16 Oct 27 10:14:40.063499 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1368b316-7ae6-45b8-875c-59ce982d7c83 req-a001a986-1b5d-4286-8cf3-137bc1a85d22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080107 Oct 27 10:14:40.064956 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3708/7490] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:14:40.807512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:40.808386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:40.815999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:40.816666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:40.817169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:40.817952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:40.818542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:40.819025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:40.967661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:40.976395 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-27481e2e-616f-4984-9cc2-62a74f6716ed tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1317 microversion: 2.1 time: 0.173524 Oct 27 10:14:40.977373 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3783/7491] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:40 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:41.999352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:42.004531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:42.005344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:42.013055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:42.013609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:42.014207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:42.015023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:42.015530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:42.016054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:42.171604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:42.179885 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53f6fa91-80e1-486f-bc7a-3c70ede44f85 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1317 microversion: 2.1 time: 0.182309 Oct 27 10:14:42.180486 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3709/7492] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:41 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:43.205354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:43.206790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:43.216615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:43.217282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:43.217905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:43.218890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:43.219507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:43.220099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:43.387196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:43.396862 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19ba519f-2bd6-4db3-955d-25bdea8f514a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1317 microversion: 2.1 time: 0.196374 Oct 27 10:14:43.397637 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3784/7493] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:43 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:44.427175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:44.429610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:44.443729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.444702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.445413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.447882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.449961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.450994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.627023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-849f7a61-9b18-4dd0-8549-b95e0cb1c133 req-fbb3fc61-e5e4-4b4c-8632-1a48d77d7f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8dd9309-b8fa-4377-ba27-e4c07d7b40b5", "name": "network-vif-plugged", "status": "completed", "tag": "b2fdb046-92dd-4fcd-a152-c9be3c1d2094"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:44.639547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-849f7a61-9b18-4dd0-8549-b95e0cb1c133 req-fbb3fc61-e5e4-4b4c-8632-1a48d77d7f07 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:44.640498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-849f7a61-9b18-4dd0-8549-b95e0cb1c133 req-fbb3fc61-e5e4-4b4c-8632-1a48d77d7f07 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:44.641216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-849f7a61-9b18-4dd0-8549-b95e0cb1c133 req-fbb3fc61-e5e4-4b4c-8632-1a48d77d7f07 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:44.656411 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-849f7a61-9b18-4dd0-8549-b95e0cb1c133 req-fbb3fc61-e5e4-4b4c-8632-1a48d77d7f07 service nova] Creating event network-vif-plugged:b2fdb046-92dd-4fcd-a152-c9be3c1d2094 for instance f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 on n-h1-858383-16 Oct 27 10:14:44.663428 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-849f7a61-9b18-4dd0-8549-b95e0cb1c133 req-fbb3fc61-e5e4-4b4c-8632-1a48d77d7f07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040332 Oct 27 10:14:44.666828 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3785/7494] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:14:44.684463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:44.700058 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-463e4895-eee3-4c96-b6e6-8372b18259de tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1317 microversion: 2.1 time: 0.281131 Oct 27 10:14:44.717106 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3710/7495] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:44 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:45.739120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:45.745542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:45.746323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:45.759785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:45.760666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:45.761475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:45.762725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:45.763552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:45.764311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:45.922211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:45.931383 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8d00da9e-f43c-48ac-80e6-1fade35915e8 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1317 microversion: 2.1 time: 0.192874 Oct 27 10:14:45.932293 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3786/7496] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:45 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:46.955255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:46.956020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:46.959687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:46.966217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:46.966766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:46.967382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:46.968490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:46.969011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:46.969566 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:47.124804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:47.136568 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-838b249f-32e4-4a6f-8ed5-3291160f547d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1506 microversion: 2.1 time: 0.185258 Oct 27 10:14:47.137164 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3711/7497] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:46 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:47.244386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2105712062", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "a53c27df-c468-4d0d-9bb2-9d07c303b760"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:47.306041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] validate_networks() for [('a53c27df-c468-4d0d-9bb2-9d07c303b760', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:14:48.228297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:14:48.228729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:14:48.229213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:14:48.229632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:14:48.230055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:14:48.239609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:48.240103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:48.240555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:48.241294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:48.241760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:48.242196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:48.261776 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Getting quotas for project 75429434d61f41e8ac08b01dfbc30393. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:14:48.268115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Getting quotas for user ef332248a7b347f09587fcc18c7b1ede and project 75429434d61f41e8ac08b01dfbc30393. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:14:48.282752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:14:48.285352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:14:48.336523 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ff6375a-d4a7-4c8b-ac00-351f2206e363 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096015 Oct 27 10:14:48.337561 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3787/7498] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:14:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:14:48.358372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f2f1061-7797-4eb2-b0c0-b893a1b4076f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:48.359510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f2f1061-7797-4eb2-b0c0-b893a1b4076f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:48.439778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0f2f1061-7797-4eb2-b0c0-b893a1b4076f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:48.452382 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f2f1061-7797-4eb2-b0c0-b893a1b4076f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1217 microversion: 2.1 time: 0.101828 Oct 27 10:14:48.453210 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3712/7499] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:48 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:49.492100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:49.492932 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:49.499479 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:49.500037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:49.500497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:49.501239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:49.501710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:49.502252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:49.588493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:49.597026 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a6c8dff-5a4d-4362-a2ae-99d5c467ecb5 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1269 microversion: 2.1 time: 0.110099 Oct 27 10:14:49.597626 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3788/7500] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:49 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:50.628268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:50.631148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:50.654515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:50.655528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:50.657722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:50.660941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:50.662340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:50.663480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:51.075552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:51.084519 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85fcd2c6-5e33-405f-846b-02af3730cab9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1317 microversion: 2.1 time: 0.464710 Oct 27 10:14:51.085168 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3713/7501] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:50 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:51.635381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-13c51fa0-669f-47d1-b3f1-00e828ff42cc req-96bdc36c-ec60-459e-8552-c8f668b56221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81722f6-03f2-40f0-b2f1-25d3dfd86e72", "tag": "2cea15a4-3b10-48c4-992c-6624d7260aaa"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:51.646882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13c51fa0-669f-47d1-b3f1-00e828ff42cc req-96bdc36c-ec60-459e-8552-c8f668b56221 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:51.647389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13c51fa0-669f-47d1-b3f1-00e828ff42cc req-96bdc36c-ec60-459e-8552-c8f668b56221 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:51.647882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-13c51fa0-669f-47d1-b3f1-00e828ff42cc req-96bdc36c-ec60-459e-8552-c8f668b56221 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:51.661305 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-13c51fa0-669f-47d1-b3f1-00e828ff42cc req-96bdc36c-ec60-459e-8552-c8f668b56221 service nova] Creating event network-changed:2cea15a4-3b10-48c4-992c-6624d7260aaa for instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 on n-h2-858383-16 Oct 27 10:14:51.668726 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-13c51fa0-669f-47d1-b3f1-00e828ff42cc req-96bdc36c-ec60-459e-8552-c8f668b56221 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037055 Oct 27 10:14:51.669802 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3789/7502] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:14:52.109016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:52.109588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:52.117217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:52.117723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:52.118796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:52.119711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:52.120106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:52.120518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:52.285809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:52.294590 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c192988-6d48-42bf-b9fc-5f0dfd207c4e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1317 microversion: 2.1 time: 0.189616 Oct 27 10:14:52.295199 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3714/7503] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:52 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:53.320290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:53.321013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:53.327903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:53.328423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:53.328882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:53.329628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:53.330112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:53.330559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:53.495509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:53.504390 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-645d6a75-7b3b-4074-b4e4-bfbe6174ce35 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1317 microversion: 2.1 time: 0.189338 Oct 27 10:14:53.505028 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3790/7504] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:53 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:54.529794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:54.530476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:54.539182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:54.540486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:54.541001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:54.541845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:54.542457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:54.543012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:54.927084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:54.938206 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae348f10-5843-46ef-9fe0-b94a4bc12743 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1317 microversion: 2.1 time: 0.412918 Oct 27 10:14:54.939444 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3715/7505] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:54 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:55.980229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:55.981160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:55.988477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:55.988981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:55.989442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:55.990192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:55.990661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:55.991094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:56.142771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:56.153661 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5df39931-b0ca-4192-8910-acd253569f15 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1317 microversion: 2.1 time: 0.177520 Oct 27 10:14:56.154187 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3791/7506] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:55 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:56.885019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-814926ee-0bbe-4ee4-8b1a-04cf27c5846a req-c14f9e31-27b6-44d7-8c47-dacbab310549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81722f6-03f2-40f0-b2f1-25d3dfd86e72", "name": "network-vif-plugged", "status": "completed", "tag": "2cea15a4-3b10-48c4-992c-6624d7260aaa"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:14:56.905182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-814926ee-0bbe-4ee4-8b1a-04cf27c5846a req-c14f9e31-27b6-44d7-8c47-dacbab310549 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:56.906088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-814926ee-0bbe-4ee4-8b1a-04cf27c5846a req-c14f9e31-27b6-44d7-8c47-dacbab310549 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:56.906894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-814926ee-0bbe-4ee4-8b1a-04cf27c5846a req-c14f9e31-27b6-44d7-8c47-dacbab310549 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:56.929929 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-814926ee-0bbe-4ee4-8b1a-04cf27c5846a req-c14f9e31-27b6-44d7-8c47-dacbab310549 service nova] Creating event network-vif-plugged:2cea15a4-3b10-48c4-992c-6624d7260aaa for instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 on n-h2-858383-16 Oct 27 10:14:56.939347 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-814926ee-0bbe-4ee4-8b1a-04cf27c5846a req-c14f9e31-27b6-44d7-8c47-dacbab310549 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062132 Oct 27 10:14:56.940315 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3716/7507] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:14:57.178029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:57.178887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:57.187235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:57.187846 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:57.188353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:57.189125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:57.189627 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:57.190103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:57.349404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:57.364776 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dcc2598d-a1cd-4b3f-8a9d-8a854801229c tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1317 microversion: 2.1 time: 0.190649 Oct 27 10:14:57.365816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3792/7508] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:57 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:58.405040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:58.405773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:58.412651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:58.413144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:58.413587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:58.414315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:58.415689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:58.416140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:58.451734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:58.603815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:58.618066 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0c1af62-5ebb-4d8d-8e14-d2f2c25671a1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1317 microversion: 2.1 time: 0.218232 Oct 27 10:14:58.619418 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3717/7509] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:58 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:14:59.649699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:59.650646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:59.654011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:59.655207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:14:59.662124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:59.662847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:59.663592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:59.664497 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:59.665079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:59.665621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:59.818836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:14:59.827790 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-90923a52-d5d0-4b7a-bdd6-75a747adff4f tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1505 microversion: 2.1 time: 0.182748 Oct 27 10:14:59.828402 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3793/7510] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:14:59 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1505 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:14:59.854426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:14:59.855285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:14:59.867325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:59.868762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:59.869559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:59.870845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:14:59.871733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:14:59.872491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:14:59.923599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:15:00.030875 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d7edeec-e983-41a1-8f16-ad8b51b1497a tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 204 len: 0 microversion: 2.1 time: 0.183376 Oct 27 10:15:00.035957 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3718/7511] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:14:59 2022] DELETE /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:15:00.042755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:00.043659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:00.050917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:00.051457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:00.051941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:00.052659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:00.053126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:00.053559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:00.227672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:00.236259 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3aa6187c-a7b8-4134-a643-ca5e971c0a99 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1511 microversion: 2.1 time: 0.198393 Oct 27 10:15:00.236878 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3794/7512] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:00 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:01.275866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:01.276800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:01.280059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:01.291867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:01.292730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:01.293521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:01.294812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:01.295693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:01.296493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:01.306341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:01.490259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:01.499711 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04f4c564-3c89-4ed5-acaa-fc43d0f97b8d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1511 microversion: 2.1 time: 0.228771 Oct 27 10:15:01.500331 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3719/7513] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:01 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:02.157900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2f018557-85c8-47ec-9ead-5080a176a131 req-733d5876-c3d0-42be-9f67-c3e302e7dc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81722f6-03f2-40f0-b2f1-25d3dfd86e72", "name": "network-vif-deleted", "tag": "2cea15a4-3b10-48c4-992c-6624d7260aaa"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:02.193731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2f018557-85c8-47ec-9ead-5080a176a131 req-733d5876-c3d0-42be-9f67-c3e302e7dc7e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:02.194920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2f018557-85c8-47ec-9ead-5080a176a131 req-733d5876-c3d0-42be-9f67-c3e302e7dc7e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:02.197034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2f018557-85c8-47ec-9ead-5080a176a131 req-733d5876-c3d0-42be-9f67-c3e302e7dc7e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:02.222014 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2f018557-85c8-47ec-9ead-5080a176a131 req-733d5876-c3d0-42be-9f67-c3e302e7dc7e service nova] Creating event network-vif-deleted:2cea15a4-3b10-48c4-992c-6624d7260aaa for instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 on n-h2-858383-16 Oct 27 10:15:02.232847 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2f018557-85c8-47ec-9ead-5080a176a131 req-733d5876-c3d0-42be-9f67-c3e302e7dc7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086266 Oct 27 10:15:02.234762 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3795/7514] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:02.541862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:02.542862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:02.554985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:02.555864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:02.556607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:02.557816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:02.558605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:02.559316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:02.609472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:02.609969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:02.610421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:02.610887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lazy-loading 'fault' on Instance uuid a81722f6-03f2-40f0-b2f1-25d3dfd86e72 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:15:02.670376 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:02.684043 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6958cdec-9f90-4574-9967-bf4c12525214 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 200 len: 1307 microversion: 2.1 time: 0.149398 Oct 27 10:15:02.685052 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3720/7515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:02 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:03.713341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:03.714199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:03.717099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:03.723483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.724031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.724486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.725233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.725700 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.726141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.730212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=75 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:03.742982 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] HTTP exception thrown: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Request method failure captured: Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 HTTP/1.1 Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWloG8qWswsSEcMsWRrCIf3u9ZT2ytAK0kd9YuBVcUoApADf5MwglFMc5g6TpYcpgSBboi7f4ZAWQsBKVPj-353LIhrXbtiivzbZKAvHoTtrr-LAv1wwm6wMTIyLA-hY4gkRUly2EtwbA89B6QLlL1kcORF5QSy39qLZJf3bkQGWMFFA Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75429434d61f41e8ac08b01dfbc30393"}]}] Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: ef332248a7b347f09587fcc18c7b1ede Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'a81722f6-03f2-40f0-b2f1-25d3dfd86e72'} Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:03.744817 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Returning 404 to user: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9e20837e-82c2-457b-aa0e-6f4363046c06 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 404 len: 111 microversion: 2.1 time: 0.038161 Oct 27 10:15:03.751956 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3796/7516] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:03 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:03.759279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:03.760079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:03.767794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.768291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.768734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.769455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.769953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.770385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.918153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:03.926597 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ac64e22-ad28-4a1e-ae42-2df2030bfb87 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1506 microversion: 2.1 time: 0.171849 Oct 27 10:15:03.927228 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3721/7517] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:03 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:03.950457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ebe75c5-ca97-4bf3-92a5-3138d9f349a6 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:03.952847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2ebe75c5-ca97-4bf3-92a5-3138d9f349a6 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: c44a6120-b039-4692-8d46-88c4b556b8b0] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:03.959005 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-2ebe75c5-ca97-4bf3-92a5-3138d9f349a6 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] HTTP exception thrown: Instance c44a6120-b039-4692-8d46-88c4b556b8b0 could not be found. Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ebe75c5-ca97-4bf3-92a5-3138d9f349a6 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Request method failure captured: Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/c44a6120-b039-4692-8d46-88c4b556b8b0/action HTTP/1.1 Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 32 Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWloG8qWswsSEcMsWRrCIf3u9ZT2ytAK0kd9YuBVcUoApADf5MwglFMc5g6TpYcpgSBboi7f4ZAWQsBKVPj-353LIhrXbtiivzbZKAvHoTtrr-LAv1wwm6wMTIyLA-hY4gkRUly2EtwbA89B6QLlL1kcORF5QSy39qLZJf3bkQGWMFFA Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75429434d61f41e8ac08b01dfbc30393"}]}] Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: ef332248a7b347f09587fcc18c7b1ede Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: {"resize": {"flavorRef": "452"}} Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance c44a6120-b039-4692-8d46-88c4b556b8b0 could not be found. Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'c44a6120-b039-4692-8d46-88c4b556b8b0', 'body': {'resize': {'flavorRef': '452'}}} Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44a6120-b039-4692-8d46-88c4b556b8b0 could not be found. Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:03.960660 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44a6120-b039-4692-8d46-88c4b556b8b0 could not be found. Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44a6120-b039-4692-8d46-88c4b556b8b0 could not be found. Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2ebe75c5-ca97-4bf3-92a5-3138d9f349a6 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Returning 404 to user: Instance c44a6120-b039-4692-8d46-88c4b556b8b0 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2ebe75c5-ca97-4bf3-92a5-3138d9f349a6 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "POST /compute/v2.1/servers/c44a6120-b039-4692-8d46-88c4b556b8b0/action" status: 404 len: 111 microversion: 2.1 time: 0.016905 Oct 27 10:15:03.966878 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3797/7518] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:15:03 2022] POST /compute/v2.1/servers/c44a6120-b039-4692-8d46-88c4b556b8b0/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:03.973163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:03.973775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:03.980713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.981202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.981656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:03.982382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:03.982846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:03.983279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.126303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:04.135419 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f7e2cc8-0179-4928-9255-9b46f0d5285d tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1506 microversion: 2.1 time: 0.166731 Oct 27 10:15:04.136063 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3722/7519] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:03 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:04.174821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:04.175488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:04.183625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.184144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.184620 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.185362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.185837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.186284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.354988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:04.364480 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-95253d86-a43d-429f-91ed-b687d69b4bef tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1506 microversion: 2.1 time: 0.193542 Oct 27 10:15:04.365216 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3798/7520] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:04 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:04.389039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "9b243b72-65c2-4a51-9c5a-ea90b5f0dbbb"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:04.391523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:04.398659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.399354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.399947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.400830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.401401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.401940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.449846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:04.457203 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] HTTP exception thrown: Flavor 9b243b72-65c2-4a51-9c5a-ea90b5f0dbbb could not be found. Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Request method failure captured: Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5/action HTTP/1.1 Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 65 Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWloG8qWswsSEcMsWRrCIf3u9ZT2ytAK0kd9YuBVcUoApADf5MwglFMc5g6TpYcpgSBboi7f4ZAWQsBKVPj-353LIhrXbtiivzbZKAvHoTtrr-LAv1wwm6wMTIyLA-hY4gkRUly2EtwbA89B6QLlL1kcORF5QSy39qLZJf3bkQGWMFFA Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75429434d61f41e8ac08b01dfbc30393"}]}] Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: ef332248a7b347f09587fcc18c7b1ede Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: {"resize": {"flavorRef": "9b243b72-65c2-4a51-9c5a-ea90b5f0dbbb"}} Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: exception: Flavor 9b243b72-65c2-4a51-9c5a-ea90b5f0dbbb could not be found. Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f8dd9309-b8fa-4377-ba27-e4c07d7b40b5', 'body': {'resize': {'flavorRef': '9b243b72-65c2-4a51-9c5a-ea90b5f0dbbb'}}} Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4201, in resize Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:04.467245 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9b243b72-65c2-4a51-9c5a-ea90b5f0dbbb could not be found. Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 9b243b72-65c2-4a51-9c5a-ea90b5f0dbbb could not be found. Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9b243b72-65c2-4a51-9c5a-ea90b5f0dbbb could not be found. Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Returning 400 to user: Flavor 9b243b72-65c2-4a51-9c5a-ea90b5f0dbbb could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df407f56-5709-41cf-8f74-5ddb2d1db9e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "POST /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5/action" status: 400 len: 107 microversion: 2.1 time: 0.084323 Oct 27 10:15:04.474679 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3723/7521] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:15:04 2022] POST /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5/action => generated 107 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 10:15:04.482886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:04.484053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:04.495127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.496161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.496980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.498301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.499178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.500029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.659476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:04.668687 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b420b86e-ee14-4264-8a2b-a92ad16f71ad tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1506 microversion: 2.1 time: 0.193797 Oct 27 10:15:04.669277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3799/7522] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:04 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:04.697318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:04.698432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:04.710058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.710956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.711835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.712976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.713810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.714583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.877380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:04.886833 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dada2033-a776-4d24-a771-00ff35740601 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1506 microversion: 2.1 time: 0.197126 Oct 27 10:15:04.887451 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3724/7523] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:04 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:04.912068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9262496e-d609-433d-9f9a-6c003a979cd1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9262496e-d609-433d-9f9a-6c003a979cd1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Request method failure captured: Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: request: POST /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5/action HTTP/1.1 Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 29 Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWloG8qWswsSEcMsWRrCIf3u9ZT2ytAK0kd9YuBVcUoApADf5MwglFMc5g6TpYcpgSBboi7f4ZAWQsBKVPj-353LIhrXbtiivzbZKAvHoTtrr-LAv1wwm6wMTIyLA-hY4gkRUly2EtwbA89B6QLlL1kcORF5QSy39qLZJf3bkQGWMFFA Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75429434d61f41e8ac08b01dfbc30393"}]}] Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: ef332248a7b347f09587fcc18c7b1ede Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: {"resize": {"flavorRef": ""}} Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'f8dd9309-b8fa-4377-ba27-e4c07d7b40b5', 'body': {'resize': {'flavorRef': ''}}} Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise error Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi '' Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.916108 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9262496e-d609-433d-9f9a-6c003a979cd1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9262496e-d609-433d-9f9a-6c003a979cd1 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "POST /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5/action" status: 400 len: 113 microversion: 2.1 time: 0.010000 Oct 27 10:15:04.924180 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3800/7524] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:15:04 2022] POST /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 10:15:04.926949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:04.927607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:04.934753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.935397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.936037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:04.936855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:04.937477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:04.937998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.101667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:05.114596 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c16f0d2-21be-4850-b496-3007b35657e9 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1506 microversion: 2.1 time: 0.191242 Oct 27 10:15:05.115705 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3725/7525] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:04 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:05.142759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:05.143177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:05.151629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.152414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.152867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.153594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.154066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.154507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.182013 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] HTTP exception thrown: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Request method failure captured: Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 HTTP/1.1 Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWloG8qWswsSEcMsWRrCIf3u9ZT2ytAK0kd9YuBVcUoApADf5MwglFMc5g6TpYcpgSBboi7f4ZAWQsBKVPj-353LIhrXbtiivzbZKAvHoTtrr-LAv1wwm6wMTIyLA-hY4gkRUly2EtwbA89B6QLlL1kcORF5QSy39qLZJf3bkQGWMFFA Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75429434d61f41e8ac08b01dfbc30393"}]}] Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: ef332248a7b347f09587fcc18c7b1ede Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'a81722f6-03f2-40f0-b2f1-25d3dfd86e72'} Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:05.185023 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Returning 404 to user: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-90b86ee6-aab9-497f-bca7-c22f4ba8e732 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 404 len: 111 microversion: 2.1 time: 0.049626 Oct 27 10:15:05.191168 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3801/7526] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:15:05 2022] DELETE /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:05.199186 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:05.199844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: a81722f6-03f2-40f0-b2f1-25d3dfd86e72] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:05.206909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.207414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.207894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.208639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.209104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.209537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.225433 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] HTTP exception thrown: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Request method failure captured: Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 HTTP/1.1 Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWloG8qWswsSEcMsWRrCIf3u9ZT2ytAK0kd9YuBVcUoApADf5MwglFMc5g6TpYcpgSBboi7f4ZAWQsBKVPj-353LIhrXbtiivzbZKAvHoTtrr-LAv1wwm6wMTIyLA-hY4gkRUly2EtwbA89B6QLlL1kcORF5QSy39qLZJf3bkQGWMFFA Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75429434d61f41e8ac08b01dfbc30393"}]}] Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: ef332248a7b347f09587fcc18c7b1ede Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'a81722f6-03f2-40f0-b2f1-25d3dfd86e72'} Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:05.227021 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Returning 404 to user: Instance a81722f6-03f2-40f0-b2f1-25d3dfd86e72 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2fa27ad-0b36-4a11-bc67-d2963253a490 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72" status: 404 len: 111 microversion: 2.1 time: 0.034024 Oct 27 10:15:05.234530 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3726/7527] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:05 2022] GET /compute/v2.1/servers/a81722f6-03f2-40f0-b2f1-25d3dfd86e72 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:05.237727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:05.238230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:05.244960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.245525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.245988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.246730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.247210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.247703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.278807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:15:05.377220 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1eac55fe-7d33-490f-b7eb-cbda740220fd tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 204 len: 0 microversion: 2.1 time: 0.142880 Oct 27 10:15:05.378398 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3802/7528] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:15:05 2022] DELETE /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:15:05.391315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:05.392031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:05.400365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.400837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.401411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.402324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:05.402871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:05.403381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:05.554372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:05.563253 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-31db3c3e-e6f2-40c2-87f7-137d19ac4382 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1512 microversion: 2.1 time: 0.178087 Oct 27 10:15:05.563895 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3727/7529] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:05 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:06.590561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:06.591304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:06.598658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.599168 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.599672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:06.600426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:06.600904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:06.601354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:06.762434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:06.777749 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-653f56b7-dbea-47fd-8868-823e2aa3e4ac tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1512 microversion: 2.1 time: 0.192564 Oct 27 10:15:06.778831 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3803/7530] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:06 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:07.662909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-27b217db-28fd-4b9e-afa1-7b463e480ce0 req-5ff85a45-27ce-4cb0-b614-71e301f7975d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8dd9309-b8fa-4377-ba27-e4c07d7b40b5", "name": "network-vif-deleted", "tag": "b2fdb046-92dd-4fcd-a152-c9be3c1d2094"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:07.681340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-27b217db-28fd-4b9e-afa1-7b463e480ce0 req-5ff85a45-27ce-4cb0-b614-71e301f7975d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.682177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-27b217db-28fd-4b9e-afa1-7b463e480ce0 req-5ff85a45-27ce-4cb0-b614-71e301f7975d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.682996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-27b217db-28fd-4b9e-afa1-7b463e480ce0 req-5ff85a45-27ce-4cb0-b614-71e301f7975d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.705772 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-27b217db-28fd-4b9e-afa1-7b463e480ce0 req-5ff85a45-27ce-4cb0-b614-71e301f7975d service nova] Creating event network-vif-deleted:b2fdb046-92dd-4fcd-a152-c9be3c1d2094 for instance f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 on n-h1-858383-16 Oct 27 10:15:07.718454 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-27b217db-28fd-4b9e-afa1-7b463e480ce0 req-5ff85a45-27ce-4cb0-b614-71e301f7975d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059540 Oct 27 10:15:07.720355 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3728/7531] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:07.820309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:07.822018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:07.832443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.833702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.834691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.835896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.836663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.837341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.884469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:07.885015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:07.885496 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:07.885954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lazy-loading 'fault' on Instance uuid f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:15:07.937561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef332248a7b347f09587fcc18c7b1ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75429434d61f41e8ac08b01dfbc30393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:07.946419 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3e833d1d-d7aa-432e-9d5a-892245287d1e tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 200 len: 1307 microversion: 2.1 time: 0.132577 Oct 27 10:15:07.947012 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3804/7532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:07 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 1307 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:08.972265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:08.973029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] [instance: f8dd9309-b8fa-4377-ba27-e4c07d7b40b5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:08.980371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:08.980869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:08.981318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:08.982039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:08.982507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:08.982937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:08.998583 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] HTTP exception thrown: Instance f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 could not be found. Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Request method failure captured: Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 HTTP/1.1 Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWloG8qWswsSEcMsWRrCIf3u9ZT2ytAK0kd9YuBVcUoApADf5MwglFMc5g6TpYcpgSBboi7f4ZAWQsBKVPj-353LIhrXbtiivzbZKAvHoTtrr-LAv1wwm6wMTIyLA-hY4gkRUly2EtwbA89B6QLlL1kcORF5QSy39qLZJf3bkQGWMFFA Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75429434d61f41e8ac08b01dfbc30393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75429434d61f41e8ac08b01dfbc30393"}]}] Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 75429434d61f41e8ac08b01dfbc30393 Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServersNegativeTestJSON-704432930 Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: ef332248a7b347f09587fcc18c7b1ede Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-ServersNegativeTestJSON-704432930-project Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 could not be found. Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'f8dd9309-b8fa-4377-ba27-e4c07d7b40b5'} Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 could not be found. Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 could not be found. Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:15:09.000334 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 could not be found. Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] Returning 404 to user: Instance f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4c449d65-e077-4711-843a-dbfeb6ac8db2 tempest-ServersNegativeTestJSON-704432930 tempest-ServersNegativeTestJSON-704432930-project] 10.222.0.25 "GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5" status: 404 len: 111 microversion: 2.1 time: 0.035414 Oct 27 10:15:09.008753 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3729/7533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:08 2022] GET /compute/v2.1/servers/f8dd9309-b8fa-4377-ba27-e4c07d7b40b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:15:53.679364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:53.684169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:53.952470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ff6e378-5a2b-4e9f-96c0-c6017f89aa7b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Action: 'create', calling method: .version_select at 0x7f31a937ea60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2019452003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxDgesE8WPrQUby2D0Km9RdGrA+5ZoxhsAeyWlDtZpGMFjg1A/maK5KKPmKv3tKv5I26F+1mkQexBT1nk9Q6RagLOaN/f7XOsuIzCGoxQSDXYuJYXU7KC417hfdhx94nQ=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:53.971704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-6ff6e378-5a2b-4e9f-96c0-c6017f89aa7b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for project c919f9668edc414e8fea0457c023a8ce. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:53.978901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-6ff6e378-5a2b-4e9f-96c0-c6017f89aa7b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for user 31c7374ed3b244c18c2796f6859a6566 and project c919f9668edc414e8fea0457c023a8ce. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:54.009759 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ff6e378-5a2b-4e9f-96c0-c6017f89aa7b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.345719 Oct 27 10:15:54.010293 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3805/7534] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:15:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:54.075797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1005492684", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2019452003", "networks": [{"uuid": "c4b72fc7-db93-4d33-a15b-003d3eeda9ae"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:54.094677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=25 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:54.096358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=53 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:15:54.182632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] validate_networks() for [('c4b72fc7-db93-4d33-a15b-003d3eeda9ae', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:15:54.725717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:15:54.726362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:15:54.727095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:15:54.727598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:15:54.728302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:15:54.743877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:54.744719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:54.745486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:54.746583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:54.747046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:54.747706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:54.773814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for project c919f9668edc414e8fea0457c023a8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:15:54.780930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for user 31c7374ed3b244c18c2796f6859a6566 and project c919f9668edc414e8fea0457c023a8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:15:54.795829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:15:54.798415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:15:54.855768 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8a41d8a-ca5b-4bbe-9a49-eb15978fb860 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788765 Oct 27 10:15:54.856432 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3730/7535] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:15:54.875034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3148d466-3c9a-4a00-8c9b-bca71e75959e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:54.876268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3148d466-3c9a-4a00-8c9b-bca71e75959e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:54.971319 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3148d466-3c9a-4a00-8c9b-bca71e75959e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:54.984228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3148d466-3c9a-4a00-8c9b-bca71e75959e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1263 microversion: 2.1 time: 0.116125 Oct 27 10:15:54.985135 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3806/7536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:54 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1263 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:56.023547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:56.025390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:56.041452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:56.042345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:56.043106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:56.044438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:56.045244 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:56.046008 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:56.156216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:56.167203 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f2ffdbc-a645-4325-98b4-9a286f59d924 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1315 microversion: 2.1 time: 0.148244 Oct 27 10:15:56.168925 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3731/7537] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:56 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:57.198087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:57.199979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:57.218499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:57.219921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:57.220881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:57.222572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:57.223919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:57.224848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:57.595763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:57.610622 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a51f5bb7-ee95-4cf3-a2d2-37a6e40754c9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1363 microversion: 2.1 time: 0.416885 Oct 27 10:15:57.612180 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3807/7538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:57 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:15:58.469231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d1802bfa-8d84-405f-a658-f9b180dbe3fd req-d1fc755d-4ce0-4b18-a30d-1b29eed68ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec", "tag": "acbd6c55-e9f5-4d82-a30a-f4ad9cd7f9bf"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:15:58.486596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d1802bfa-8d84-405f-a658-f9b180dbe3fd req-d1fc755d-4ce0-4b18-a30d-1b29eed68ba7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:58.487296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d1802bfa-8d84-405f-a658-f9b180dbe3fd req-d1fc755d-4ce0-4b18-a30d-1b29eed68ba7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:58.488071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d1802bfa-8d84-405f-a658-f9b180dbe3fd req-d1fc755d-4ce0-4b18-a30d-1b29eed68ba7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:58.511200 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d1802bfa-8d84-405f-a658-f9b180dbe3fd req-d1fc755d-4ce0-4b18-a30d-1b29eed68ba7 service nova] Creating event network-changed:acbd6c55-e9f5-4d82-a30a-f4ad9cd7f9bf for instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec on n-h1-858383-16 Oct 27 10:15:58.518975 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d1802bfa-8d84-405f-a658-f9b180dbe3fd req-d1fc755d-4ce0-4b18-a30d-1b29eed68ba7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053386 Oct 27 10:15:58.521054 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3732/7539] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:15:58.650205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:58.651059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:58.658986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:58.659506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:58.660003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:58.660753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:58.661230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:58.661676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:58.910143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:15:58.918980 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-49f8db06-b433-48cf-9617-c5f4bd1fd9b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1363 microversion: 2.1 time: 0.273255 Oct 27 10:15:58.919498 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3808/7540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:58 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:15:59.944107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:15:59.944799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:15:59.953169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:59.953677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:59.954131 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:15:59.954914 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:15:59.955389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:15:59.955886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:00.482618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:00.491947 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1cba0ed8-890f-452e-be56-34a7c79d2a99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1363 microversion: 2.1 time: 0.552696 Oct 27 10:16:00.492548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3733/7541] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:15:59 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1363 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:16:01.517198 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:01.518301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:01.527323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:01.528026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:01.528588 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:01.529550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:01.530212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:01.530755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:01.784827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:01.794565 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9791596f-bbe5-480e-99b0-49b439e5c651 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1363 microversion: 2.1 time: 0.281661 Oct 27 10:16:01.795614 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3809/7542] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:01 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:02.829623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:02.830699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:02.840677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:02.841307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:02.841959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:02.842784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:02.843305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:02.844752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:03.035868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:03.051534 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c97e942b-fe32-4cf7-8b66-8faed80cca74 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1363 microversion: 2.1 time: 0.230605 Oct 27 10:16:03.053431 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3734/7543] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:02 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:16:04.088514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:04.089218 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:04.097005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:04.097515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:04.097972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:04.098705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:04.099185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:04.099726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:04.253916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:04.267893 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f26edb78-61e7-4fe3-a25b-b60d6c31ae64 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1363 microversion: 2.1 time: 0.182711 Oct 27 10:16:04.269011 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3810/7544] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:04 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:05.002081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-fe61ab5f-2e9f-425a-a909-e16d956c8ba4 req-22b46bdb-1c72-4e70-968d-d200870af6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec", "name": "network-vif-plugged", "status": "completed", "tag": "acbd6c55-e9f5-4d82-a30a-f4ad9cd7f9bf"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:05.011214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:05.012124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:05.022639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fe61ab5f-2e9f-425a-a909-e16d956c8ba4 req-22b46bdb-1c72-4e70-968d-d200870af6dc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:05.023483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fe61ab5f-2e9f-425a-a909-e16d956c8ba4 req-22b46bdb-1c72-4e70-968d-d200870af6dc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:05.024045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-fe61ab5f-2e9f-425a-a909-e16d956c8ba4 req-22b46bdb-1c72-4e70-968d-d200870af6dc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:05.047486 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-fe61ab5f-2e9f-425a-a909-e16d956c8ba4 req-22b46bdb-1c72-4e70-968d-d200870af6dc service nova] Creating event network-vif-plugged:acbd6c55-e9f5-4d82-a30a-f4ad9cd7f9bf for instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec on n-h1-858383-16 Oct 27 10:16:05.056946 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-fe61ab5f-2e9f-425a-a909-e16d956c8ba4 req-22b46bdb-1c72-4e70-968d-d200870af6dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061915 Oct 27 10:16:05.058618 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3735/7545] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:05.294778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:05.295613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:05.297662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:05.304812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:05.305323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:05.305773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:05.306493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:05.306960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:05.307395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:05.480625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:05.489479 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bccdcbc0-9a31-4216-94a6-b7ed9245d7f9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1363 microversion: 2.1 time: 0.198440 Oct 27 10:16:05.491184 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3811/7546] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:05 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:06.516756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:06.517654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:06.525470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:06.525981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:06.526443 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:06.527199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:06.527711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:06.528149 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:06.695629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:06.711213 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5dac76f-d0ff-4bc2-95cd-0ea6bb8e1912 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1363 microversion: 2.1 time: 0.199786 Oct 27 10:16:06.712278 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3736/7547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:06 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:07.739390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:07.740265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:07.747990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:07.748703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:07.749215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:07.750059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:07.750622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:07.751111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:07.898417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:07.907617 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2f800296-a5dc-4876-9ea2-2083a68ef82d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1556 microversion: 2.1 time: 0.172087 Oct 27 10:16:07.908209 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3812/7548] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:07 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:07.931154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:07.931859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:07.939689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:07.940193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:07.940649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:07.941378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:07.941846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:07.942285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:08.097523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:08.106115 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12058ee3-3353-4248-8945-de636e36083f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1556 microversion: 2.1 time: 0.179488 Oct 27 10:16:08.106735 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3737/7549] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:07 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:16:09.851063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c2b803b7-8ad5-4f71-ba13-23b8244f806a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "820bea4d-c4f6-48f8-8011-a428ae93aa1e"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:09.853623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c2b803b7-8ad5-4f71-ba13-23b8244f806a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:09.861636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2b803b7-8ad5-4f71-ba13-23b8244f806a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.862338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2b803b7-8ad5-4f71-ba13-23b8244f806a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.862887 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2b803b7-8ad5-4f71-ba13-23b8244f806a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:09.863781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2b803b7-8ad5-4f71-ba13-23b8244f806a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:09.864435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2b803b7-8ad5-4f71-ba13-23b8244f806a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:09.865043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c2b803b7-8ad5-4f71-ba13-23b8244f806a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:10.157022 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c2b803b7-8ad5-4f71-ba13-23b8244f806a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "POST /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310269 Oct 27 10:16:10.157648 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3813/7550] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 10:16:09 2022] POST /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:23.192788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:23.194310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:23.197655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:23.198670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=36 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:23.206650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:23.207466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:23.207994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:23.209438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:23.209910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:23.210347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:23.309318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lazy-loading 'services' on Instance uuid 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:16:23.429034 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40c48717-b42c-4fe2-aabb-3dfa80c5265a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments/820bea4d-c4f6-48f8-8011-a428ae93aa1e" status: 202 len: 0 microversion: 2.1 time: 0.240217 Oct 27 10:16:23.429756 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3738/7551] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:16:23 2022] DELETE /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments/820bea4d-c4f6-48f8-8011-a428ae93aa1e => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:16:23.437996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:23.438931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:23.444681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-05404821-af3d-467c-9d0e-2dd96319a4e8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:23.447905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-05404821-af3d-467c-9d0e-2dd96319a4e8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:23.459859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05404821-af3d-467c-9d0e-2dd96319a4e8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:23.461100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05404821-af3d-467c-9d0e-2dd96319a4e8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:23.461100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05404821-af3d-467c-9d0e-2dd96319a4e8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:23.461827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05404821-af3d-467c-9d0e-2dd96319a4e8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:23.462316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05404821-af3d-467c-9d0e-2dd96319a4e8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:23.462769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05404821-af3d-467c-9d0e-2dd96319a4e8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:23.503198 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-05404821-af3d-467c-9d0e-2dd96319a4e8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068063 Oct 27 10:16:23.503912 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3814/7552] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:16:23 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:24.518974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b7ee916a-7559-4325-a0b6-ba726db796a8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:24.522349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b7ee916a-7559-4325-a0b6-ba726db796a8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:24.529223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7ee916a-7559-4325-a0b6-ba726db796a8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:24.529726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7ee916a-7559-4325-a0b6-ba726db796a8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:24.530177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7ee916a-7559-4325-a0b6-ba726db796a8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:24.530919 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7ee916a-7559-4325-a0b6-ba726db796a8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:24.531403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7ee916a-7559-4325-a0b6-ba726db796a8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:24.531873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7ee916a-7559-4325-a0b6-ba726db796a8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:24.568733 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b7ee916a-7559-4325-a0b6-ba726db796a8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055090 Oct 27 10:16:24.569346 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3739/7553] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:16:24 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:25.582828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-164e48cd-f90c-4f0c-b15f-d56866dcc682 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:25.585257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-164e48cd-f90c-4f0c-b15f-d56866dcc682 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:25.593137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164e48cd-f90c-4f0c-b15f-d56866dcc682 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:25.594263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164e48cd-f90c-4f0c-b15f-d56866dcc682 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:25.594847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164e48cd-f90c-4f0c-b15f-d56866dcc682 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:25.595851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164e48cd-f90c-4f0c-b15f-d56866dcc682 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:25.596570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164e48cd-f90c-4f0c-b15f-d56866dcc682 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:25.597157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-164e48cd-f90c-4f0c-b15f-d56866dcc682 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:25.652627 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-164e48cd-f90c-4f0c-b15f-d56866dcc682 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073661 Oct 27 10:16:25.653609 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3815/7554] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:16:25 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:26.668882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d52324ed-c917-41b5-b499-c19c4f566247 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:26.673735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d52324ed-c917-41b5-b499-c19c4f566247 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:26.686525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52324ed-c917-41b5-b499-c19c4f566247 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:26.687368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52324ed-c917-41b5-b499-c19c4f566247 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:26.688168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52324ed-c917-41b5-b499-c19c4f566247 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:26.689399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52324ed-c917-41b5-b499-c19c4f566247 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:26.690147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52324ed-c917-41b5-b499-c19c4f566247 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:26.690882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52324ed-c917-41b5-b499-c19c4f566247 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:26.750745 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d52324ed-c917-41b5-b499-c19c4f566247 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087694 Oct 27 10:16:26.751353 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3740/7555] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:16:26 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:27.769704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-860ead43-b662-46e0-bf2a-b7c6d3bff8b0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:27.773391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-860ead43-b662-46e0-bf2a-b7c6d3bff8b0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:27.781094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-860ead43-b662-46e0-bf2a-b7c6d3bff8b0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:27.781748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-860ead43-b662-46e0-bf2a-b7c6d3bff8b0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:27.782332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-860ead43-b662-46e0-bf2a-b7c6d3bff8b0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:27.783202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-860ead43-b662-46e0-bf2a-b7c6d3bff8b0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:27.783813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-860ead43-b662-46e0-bf2a-b7c6d3bff8b0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:27.784432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-860ead43-b662-46e0-bf2a-b7c6d3bff8b0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:27.827626 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-860ead43-b662-46e0-bf2a-b7c6d3bff8b0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064640 Oct 27 10:16:27.828233 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3816/7556] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:16:27 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:28.843409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c51f6d83-e29a-4632-a8c8-8611abd6ed78 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:28.846209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c51f6d83-e29a-4632-a8c8-8611abd6ed78 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:28.856656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c51f6d83-e29a-4632-a8c8-8611abd6ed78 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.857236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c51f6d83-e29a-4632-a8c8-8611abd6ed78 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.857683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c51f6d83-e29a-4632-a8c8-8611abd6ed78 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.858425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c51f6d83-e29a-4632-a8c8-8611abd6ed78 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.858894 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c51f6d83-e29a-4632-a8c8-8611abd6ed78 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.859326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c51f6d83-e29a-4632-a8c8-8611abd6ed78 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.909482 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c51f6d83-e29a-4632-a8c8-8611abd6ed78 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071695 Oct 27 10:16:28.910512 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3741/7557] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:16:28 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:16:28.924682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:28.925468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:28.933870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.934371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.935182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:28.935976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:28.936445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:28.937089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:29.063092 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] HTTP exception thrown: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec is not attached to volume 820bea4d-c4f6-48f8-8011-a428ae93aa1e Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Request method failure captured: Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: request: DELETE /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments/820bea4d-c4f6-48f8-8011-a428ae93aa1e HTTP/1.1 Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlpSUk7-hRZvU0oPxGz2Kiv20kU9bMY8zw3_I6Ba4chcLGnBWfAR6XU9bOheF1AF_AR3cx12VZZQhkSr6RudJexsajrKpBlTkyIBF_4a70VZSeYd7hwy-825OA4CByT4AYiUySh-wcVo0Cm72oH4dn300v2zfq1CUP6ZVJz9cNnH7is Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c919f9668edc414e8fea0457c023a8ce"}]}] Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 31c7374ed3b244c18c2796f6859a6566 Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec is not attached to volume 820bea4d-c4f6-48f8-8011-a428ae93aa1e Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'server_id': '9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec', 'id': '820bea4d-c4f6-48f8-8011-a428ae93aa1e'} Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 820bea4d-c4f6-48f8-8011-a428ae93aa1e. Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec is not attached to volume 820bea4d-c4f6-48f8-8011-a428ae93aa1e Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:29.069170 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:29.076401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:29.076401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:29.076401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec is not attached to volume 820bea4d-c4f6-48f8-8011-a428ae93aa1e Oct 27 10:16:29.076401 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:29.076401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Returning 404 to user: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec is not attached to volume 820bea4d-c4f6-48f8-8011-a428ae93aa1e {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:29.076401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f5891208-e5b9-4e60-a28b-6ec9b01f7b8a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments/820bea4d-c4f6-48f8-8011-a428ae93aa1e" status: 404 len: 154 microversion: 2.1 time: 0.152400 Oct 27 10:16:29.076401 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3817/7558] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:16:28 2022] DELETE /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec/os-volume_attachments/820bea4d-c4f6-48f8-8011-a428ae93aa1e => generated 154 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:16:32.629136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:32.629903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:32.637993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.638517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.638934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.639693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.640345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.640779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.670666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:16:32.774402 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe17991c-2485-42fa-b973-f418987e35b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 204 len: 0 microversion: 2.1 time: 0.149078 Oct 27 10:16:32.775816 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3742/7559] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:16:32 2022] DELETE /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:16:32.790436 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:32.792182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:32.804259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.805186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.806293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.807055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:32.807598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:32.808169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:32.971891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:32.982011 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7892bb79-1fe4-4ce7-8f94-3b66a9dc245e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1562 microversion: 2.1 time: 0.199476 Oct 27 10:16:32.982643 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3818/7560] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:32 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1562 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:34.021630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:34.022722 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:34.030477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.030995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.031540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.032411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:34.032954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:34.033557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:34.211811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:34.221939 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71a108fc-07ff-427f-a7e0-6a2fb52c53cd tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1562 microversion: 2.1 time: 0.205019 Oct 27 10:16:34.222959 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3743/7561] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:34 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1562 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:35.248743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:35.249614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:35.261127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:35.261679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:35.262165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:35.262995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:35.263898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:35.264987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:35.399794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:35.415434 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b3c6651b-aaec-47d8-b09d-0df92a578936 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 200 len: 1520 microversion: 2.1 time: 0.171552 Oct 27 10:16:35.416781 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3819/7562] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:35 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:35.510247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9f2860ae-79fe-4400-8150-832f3e27e153 req-c3a09bb4-dd65-4bf2-8203-75038deef29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec", "name": "network-vif-deleted", "tag": "acbd6c55-e9f5-4d82-a30a-f4ad9cd7f9bf"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:35.528730 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9f2860ae-79fe-4400-8150-832f3e27e153 req-c3a09bb4-dd65-4bf2-8203-75038deef29b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:35.532878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9f2860ae-79fe-4400-8150-832f3e27e153 req-c3a09bb4-dd65-4bf2-8203-75038deef29b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:35.532878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9f2860ae-79fe-4400-8150-832f3e27e153 req-c3a09bb4-dd65-4bf2-8203-75038deef29b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:35.557137 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9f2860ae-79fe-4400-8150-832f3e27e153 req-c3a09bb4-dd65-4bf2-8203-75038deef29b service nova] Creating event network-vif-deleted:acbd6c55-e9f5-4d82-a30a-f4ad9cd7f9bf for instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec on n-h1-858383-16 Oct 27 10:16:35.564066 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9f2860ae-79fe-4400-8150-832f3e27e153 req-c3a09bb4-dd65-4bf2-8203-75038deef29b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158592 Oct 27 10:16:35.564898 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3744/7563] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:16:36.443528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:36.444197 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:36.451521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:36.452068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:36.452526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:36.453261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:36.453742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:36.454181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:36.470451 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] HTTP exception thrown: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec could not be found. Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Request method failure captured: Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec HTTP/1.1 Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlpSUk7-hRZvU0oPxGz2Kiv20kU9bMY8zw3_I6Ba4chcLGnBWfAR6XU9bOheF1AF_AR3cx12VZZQhkSr6RudJexsajrKpBlTkyIBF_4a70VZSeYd7hwy-825OA4CByT4AYiUySh-wcVo0Cm72oH4dn300v2zfq1CUP6ZVJz9cNnH7is Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c919f9668edc414e8fea0457c023a8ce"}]}] Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 31c7374ed3b244c18c2796f6859a6566 Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec could not be found. Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec'} Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec could not be found. Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec could not be found. Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:16:36.472352 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec could not be found. Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Returning 404 to user: Instance 9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-657f9fd1-dd41-4170-b35e-8a6a99b5287c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec" status: 404 len: 111 microversion: 2.1 time: 0.034956 Oct 27 10:16:36.478284 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3820/7564] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:36 2022] GET /compute/v2.1/servers/9416dd1e-df7a-4a62-8a09-0b2e2e86d1ec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:16:36.485351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd6a1e89-8cc6-4aea-8f6c-75a08d5a1bcf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '.version_select at 0x7f31a8c5dee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:36.514505 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd6a1e89-8cc6-4aea-8f6c-75a08d5a1bcf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2019452003" status: 202 len: 0 microversion: 2.1 time: 0.033841 Oct 27 10:16:36.516122 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3745/7565] 10.222.0.25 () {58 vars in 1278 bytes} [Thu Oct 27 10:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2019452003 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:16:36.536790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e585ef5-4ff6-40a4-8b58-0100a76a0596 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Action: 'create', calling method: .version_select at 0x7f31a808b430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1696134307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlgn5qKZ0F9dhGP8D20Uc/WV7/D3wLC5tcU0l0tNRP4UM1FPAE9qvSCcNQDiCVDQCxi6UhwgGk+hsXom51jTU3MNB1K5LHSSydTIoTF7I4aRyDK4LRt0opPSt1LEaW98A=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:36.554488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-1e585ef5-4ff6-40a4-8b58-0100a76a0596 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for project c919f9668edc414e8fea0457c023a8ce. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:36.561511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-1e585ef5-4ff6-40a4-8b58-0100a76a0596 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for user 31c7374ed3b244c18c2796f6859a6566 and project c919f9668edc414e8fea0457c023a8ce. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:36.590449 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e585ef5-4ff6-40a4-8b58-0100a76a0596 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.057646 Oct 27 10:16:36.591665 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3821/7566] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:16:36 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:36.647887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2107590712", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1696134307", "networks": [{"uuid": "c4b72fc7-db93-4d33-a15b-003d3eeda9ae"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:36.715960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] validate_networks() for [('c4b72fc7-db93-4d33-a15b-003d3eeda9ae', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:16:37.276125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:16:37.276699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:16:37.277188 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:16:37.277610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:16:37.278032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:16:37.288642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:37.289137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:37.289584 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:37.290331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:37.290796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:37.291227 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:37.310137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for project c919f9668edc414e8fea0457c023a8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:16:37.316099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for user 31c7374ed3b244c18c2796f6859a6566 and project c919f9668edc414e8fea0457c023a8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:16:37.330665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:16:37.334060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:16:37.396682 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0f7f1a62-0758-4fda-be89-c5bd5847072e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752766 Oct 27 10:16:37.405890 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3746/7567] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:16:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:16:37.418594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cfd2c16f-6bd5-4649-a15e-bc91e9454412 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:37.419955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cfd2c16f-6bd5-4649-a15e-bc91e9454412 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:37.492562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cfd2c16f-6bd5-4649-a15e-bc91e9454412 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:37.504233 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cfd2c16f-6bd5-4649-a15e-bc91e9454412 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1263 microversion: 2.1 time: 0.093820 Oct 27 10:16:37.505002 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3822/7568] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:37 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1263 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:38.543515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:38.544716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:38.558340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:38.559255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:38.560138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:38.561432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:38.562248 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:38.563050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:38.679904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:38.694911 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-be7a6c96-f3bc-4f10-a245-3990fbf2ba33 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1323 microversion: 2.1 time: 0.160198 Oct 27 10:16:38.696641 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3747/7569] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:38 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:39.721336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:39.721956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:39.730454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:39.730967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:39.731426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:39.732192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:39.732662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:39.733101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:39.949893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:39.958418 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5b713966-7e43-41fa-ac24-0448baf8fc88 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1363 microversion: 2.1 time: 0.241064 Oct 27 10:16:39.959145 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3823/7570] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:39 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:16:40.259626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e3fa62cc-f467-425e-9aee-0a916be2d6fa req-faa3bfc5-a479-4e0e-a0cc-1048c746335b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6", "tag": "2834509a-8322-4cca-8f94-9870e5c3014e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:40.281465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e3fa62cc-f467-425e-9aee-0a916be2d6fa req-faa3bfc5-a479-4e0e-a0cc-1048c746335b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:40.282460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e3fa62cc-f467-425e-9aee-0a916be2d6fa req-faa3bfc5-a479-4e0e-a0cc-1048c746335b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:40.283337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e3fa62cc-f467-425e-9aee-0a916be2d6fa req-faa3bfc5-a479-4e0e-a0cc-1048c746335b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:40.303534 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e3fa62cc-f467-425e-9aee-0a916be2d6fa req-faa3bfc5-a479-4e0e-a0cc-1048c746335b service nova] Creating event network-changed:2834509a-8322-4cca-8f94-9870e5c3014e for instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 on n-h2-858383-16 Oct 27 10:16:40.311423 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e3fa62cc-f467-425e-9aee-0a916be2d6fa req-faa3bfc5-a479-4e0e-a0cc-1048c746335b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057832 Oct 27 10:16:40.312849 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3748/7571] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:40.985017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:40.985577 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:40.993211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:40.993722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:40.994180 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:40.994909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:40.995485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:40.995859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:41.154492 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:41.169570 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-880bfdbf-c5da-458a-83e8-9ccb209472b7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1363 microversion: 2.1 time: 0.188058 Oct 27 10:16:41.170631 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3824/7572] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:40 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:42.194736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:42.195496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:42.204751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:42.205254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:42.205698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:42.206425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:42.206885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:42.207322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:42.395825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:42.404075 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7080053c-9b26-4e69-beb7-72c9d0ab226d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1363 microversion: 2.1 time: 0.215137 Oct 27 10:16:42.404670 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3749/7573] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:42 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:43.443781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:43.445149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:43.452460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:43.452996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:43.453455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:43.454174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:43.454639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:43.455290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:43.608390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:43.620101 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ddfcb896-f177-41e0-a6ab-53d158e0cd5b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1363 microversion: 2.1 time: 0.182929 Oct 27 10:16:43.621116 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3825/7574] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:43 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:44.653740 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:44.654493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:44.662984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:44.662984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:44.665303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:44.665303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:44.665303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:44.665303 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:44.848155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:44.856624 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d674facc-74f4-477b-9bd3-33dc7d46148e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1363 microversion: 2.1 time: 0.206936 Oct 27 10:16:44.857356 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3750/7575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:44 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:16:45.532438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b6af53e1-599f-47e5-8d16-bbf8c31afc88 req-1a7fe6de-b442-463a-a35e-663409a21b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6", "name": "network-vif-plugged", "status": "completed", "tag": "2834509a-8322-4cca-8f94-9870e5c3014e"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:45.553552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b6af53e1-599f-47e5-8d16-bbf8c31afc88 req-1a7fe6de-b442-463a-a35e-663409a21b1d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:45.554892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b6af53e1-599f-47e5-8d16-bbf8c31afc88 req-1a7fe6de-b442-463a-a35e-663409a21b1d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:45.555708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b6af53e1-599f-47e5-8d16-bbf8c31afc88 req-1a7fe6de-b442-463a-a35e-663409a21b1d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:45.579696 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b6af53e1-599f-47e5-8d16-bbf8c31afc88 req-1a7fe6de-b442-463a-a35e-663409a21b1d service nova] Creating event network-vif-plugged:2834509a-8322-4cca-8f94-9870e5c3014e for instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 on n-h2-858383-16 Oct 27 10:16:45.589507 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b6af53e1-599f-47e5-8d16-bbf8c31afc88 req-1a7fe6de-b442-463a-a35e-663409a21b1d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063996 Oct 27 10:16:45.590626 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3826/7576] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:16:45.896902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:45.897478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:45.904961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:45.905467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:45.905920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:45.906672 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:45.907144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:45.907607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:46.085222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:46.093439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35fedfea-c3d1-42e4-99d2-6f03df513148 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1363 microversion: 2.1 time: 0.201100 Oct 27 10:16:46.094047 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3751/7577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:45 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:47.119338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:47.120117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:47.127056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:47.127560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:47.128045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:47.128789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:47.129259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:47.129693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:47.300280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:47.308586 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c4c02a2-c69b-42ac-990d-b778a3586b72 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1363 microversion: 2.1 time: 0.194726 Oct 27 10:16:47.309177 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3827/7578] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:47 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:48.334598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:48.335601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:48.338893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:48.339630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:48.345777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.346278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.346726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.347448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.347944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.348380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.497361 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:48.506718 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79a9ada1-6abb-4d2b-983c-ad9456e11184 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1555 microversion: 2.1 time: 0.177010 Oct 27 10:16:48.507325 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3752/7579] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:48 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:48.529654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:16:48.530291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:48.532551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:48.539118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.539640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.540095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.540821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:48.541295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:48.541734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:48.690471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:16:48.704851 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be87721c-c60f-4e6c-9479-e026d32c9326 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1555 microversion: 2.1 time: 0.178675 Oct 27 10:16:48.705861 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3828/7580] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:16:48 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:16:50.340001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0c425998-3672-496f-ae1c-556c4ca50ee2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:16:50.343718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0c425998-3672-496f-ae1c-556c4ca50ee2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:16:50.352752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c425998-3672-496f-ae1c-556c4ca50ee2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:50.354307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c425998-3672-496f-ae1c-556c4ca50ee2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:50.354954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c425998-3672-496f-ae1c-556c4ca50ee2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:50.355916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c425998-3672-496f-ae1c-556c4ca50ee2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:16:50.356381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c425998-3672-496f-ae1c-556c4ca50ee2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:16:50.356811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0c425998-3672-496f-ae1c-556c4ca50ee2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:16:50.720596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:16:50.735101 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0c425998-3672-496f-ae1c-556c4ca50ee2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "POST /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398880 Oct 27 10:16:50.736199 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3753/7581] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 10:16:50 2022] POST /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:02.714056 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:02.714726 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:02.716899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:02.717634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=70 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:02.725475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.725980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.726425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.727140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.727633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.728131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.826234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lazy-loading 'services' on Instance uuid ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:17:02.919924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-42575580-5df4-4ee2-9ae3-c368fd59f3fe tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments/ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98" status: 202 len: 0 microversion: 2.1 time: 0.209575 Oct 27 10:17:02.920665 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3829/7582] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:17:02 2022] DELETE /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments/ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:17:02.930147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:02.937701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0528768-dbcc-4ec7-90aa-e1e74d59e27e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:02.941986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0528768-dbcc-4ec7-90aa-e1e74d59e27e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:02.950962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0528768-dbcc-4ec7-90aa-e1e74d59e27e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.951465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0528768-dbcc-4ec7-90aa-e1e74d59e27e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.952047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0528768-dbcc-4ec7-90aa-e1e74d59e27e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.952799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0528768-dbcc-4ec7-90aa-e1e74d59e27e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:02.953266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0528768-dbcc-4ec7-90aa-e1e74d59e27e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:02.953695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0528768-dbcc-4ec7-90aa-e1e74d59e27e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:02.992112 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0528768-dbcc-4ec7-90aa-e1e74d59e27e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066461 Oct 27 10:17:02.992727 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3754/7583] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:02 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:04.008087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-daaa7684-0a02-4b46-965e-6b067043aa99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:04.010621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-daaa7684-0a02-4b46-965e-6b067043aa99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:04.018257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daaa7684-0a02-4b46-965e-6b067043aa99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:04.018924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daaa7684-0a02-4b46-965e-6b067043aa99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:04.019439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daaa7684-0a02-4b46-965e-6b067043aa99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:04.020262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daaa7684-0a02-4b46-965e-6b067043aa99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:04.020913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daaa7684-0a02-4b46-965e-6b067043aa99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:04.022022 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-daaa7684-0a02-4b46-965e-6b067043aa99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:04.061091 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-daaa7684-0a02-4b46-965e-6b067043aa99 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059558 Oct 27 10:17:04.062143 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3830/7584] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:03 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:05.077689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-386075ec-c9e8-4341-bfcd-078b68b888d0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:05.080291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-386075ec-c9e8-4341-bfcd-078b68b888d0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:05.089598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-386075ec-c9e8-4341-bfcd-078b68b888d0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.090179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-386075ec-c9e8-4341-bfcd-078b68b888d0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.090829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-386075ec-c9e8-4341-bfcd-078b68b888d0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.091815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-386075ec-c9e8-4341-bfcd-078b68b888d0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:05.092429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-386075ec-c9e8-4341-bfcd-078b68b888d0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:05.093055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-386075ec-c9e8-4341-bfcd-078b68b888d0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:05.131075 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-386075ec-c9e8-4341-bfcd-078b68b888d0 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059335 Oct 27 10:17:05.131714 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3755/7585] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:05 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:06.148244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1363bbcf-6dea-4eec-bd88-01e28179be38 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:06.151158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1363bbcf-6dea-4eec-bd88-01e28179be38 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:06.159288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1363bbcf-6dea-4eec-bd88-01e28179be38 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:06.159906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1363bbcf-6dea-4eec-bd88-01e28179be38 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:06.160366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1363bbcf-6dea-4eec-bd88-01e28179be38 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:06.161213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1363bbcf-6dea-4eec-bd88-01e28179be38 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:06.162352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1363bbcf-6dea-4eec-bd88-01e28179be38 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:06.162805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1363bbcf-6dea-4eec-bd88-01e28179be38 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:06.197625 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1363bbcf-6dea-4eec-bd88-01e28179be38 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054353 Oct 27 10:17:06.198481 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3831/7586] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:06 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:07.211819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1388e5a-1159-48be-b4e9-53ae22dc7da9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:07.214327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e1388e5a-1159-48be-b4e9-53ae22dc7da9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:07.221392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1388e5a-1159-48be-b4e9-53ae22dc7da9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.222006 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1388e5a-1159-48be-b4e9-53ae22dc7da9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.222514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1388e5a-1159-48be-b4e9-53ae22dc7da9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.223223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1388e5a-1159-48be-b4e9-53ae22dc7da9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:07.223628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1388e5a-1159-48be-b4e9-53ae22dc7da9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:07.224114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1388e5a-1159-48be-b4e9-53ae22dc7da9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:07.258996 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e1388e5a-1159-48be-b4e9-53ae22dc7da9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052406 Oct 27 10:17:07.259619 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3756/7587] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:07 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:08.274014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f1366edf-be9f-4c29-b2e9-fd47ac35f029 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:08.276257 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f1366edf-be9f-4c29-b2e9-fd47ac35f029 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:08.283212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1366edf-be9f-4c29-b2e9-fd47ac35f029 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:08.283741 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1366edf-be9f-4c29-b2e9-fd47ac35f029 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:08.284189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1366edf-be9f-4c29-b2e9-fd47ac35f029 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:08.284906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1366edf-be9f-4c29-b2e9-fd47ac35f029 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:08.285402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1366edf-be9f-4c29-b2e9-fd47ac35f029 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:08.285833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f1366edf-be9f-4c29-b2e9-fd47ac35f029 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:08.316277 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f1366edf-be9f-4c29-b2e9-fd47ac35f029 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046807 Oct 27 10:17:08.316847 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3832/7588] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:08 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:17:08.328651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:08.329366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:08.337366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:08.337903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:08.338351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:08.339074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:08.339533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:08.340119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:08.421554 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] HTTP exception thrown: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 is not attached to volume ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Request method failure captured: Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments/ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98 HTTP/1.1 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlpSUk7-hRZvU0oPxGz2Kiv20kU9bMY8zw3_I6Ba4chcLGnBWfAR6XU9bOheF1AF_AR3cx12VZZQhkSr6RudJexsajrKpBlTkyIBF_4a70VZSeYd7hwy-825OA4CByT4AYiUySh-wcVo0Cm72oH4dn300v2zfq1CUP6ZVJz9cNnH7is Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c919f9668edc414e8fea0457c023a8ce"}]}] Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 31c7374ed3b244c18c2796f6859a6566 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 is not attached to volume ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': 'ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6', 'id': 'ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98'} Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98. Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 is not attached to volume ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98 Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:08.423492 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:08.428573 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:08.428573 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:08.428573 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 is not attached to volume ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98 Oct 27 10:17:08.428573 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:08.428573 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Returning 404 to user: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 is not attached to volume ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:08.428573 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e3ffc7c-2cf1-49d4-a545-b6e3bc7fbbdb tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments/ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98" status: 404 len: 154 microversion: 2.1 time: 0.100852 Oct 27 10:17:08.428573 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3757/7589] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:17:08 2022] DELETE /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6/os-volume_attachments/ef9e2bf4-fd6d-4c6e-acc2-2ec843008f98 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:17:11.898122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:11.898902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:11.906508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:11.907011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:11.907556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:11.908339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:11.908810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:11.909267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:11.938664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:17:12.037298 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-63588be3-8f2c-4097-bf75-ec828bfa03a9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 204 len: 0 microversion: 2.1 time: 0.142612 Oct 27 10:17:12.038514 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3833/7590] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:17:11 2022] DELETE /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 10:17:12.050834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:12.051746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:12.061169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:12.061670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:12.062118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:12.062870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:12.063345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:12.063818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:12.216580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:12.225680 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-236ffa62-27a0-423d-85e8-c5e76c9130a1 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1561 microversion: 2.1 time: 0.181324 Oct 27 10:17:12.226277 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3758/7591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:12 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:13.250315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:13.251130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:13.258504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.259000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.259452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.260235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:13.260707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:13.261176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:13.423454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:13.432182 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-641ad406-9cbb-4740-a451-8900f4baedee tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1561 microversion: 2.1 time: 0.186141 Oct 27 10:17:13.433041 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3834/7592] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:13 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:14.348185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-51ddc8d9-a818-4f63-8c86-de974f23af34 req-e2c181c3-6a2a-44d6-9fc2-6388f8909f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6", "name": "network-vif-deleted", "tag": "2834509a-8322-4cca-8f94-9870e5c3014e"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:14.370669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51ddc8d9-a818-4f63-8c86-de974f23af34 req-e2c181c3-6a2a-44d6-9fc2-6388f8909f24 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.373262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51ddc8d9-a818-4f63-8c86-de974f23af34 req-e2c181c3-6a2a-44d6-9fc2-6388f8909f24 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.374288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-51ddc8d9-a818-4f63-8c86-de974f23af34 req-e2c181c3-6a2a-44d6-9fc2-6388f8909f24 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.394056 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-51ddc8d9-a818-4f63-8c86-de974f23af34 req-e2c181c3-6a2a-44d6-9fc2-6388f8909f24 service nova] Creating event network-vif-deleted:2834509a-8322-4cca-8f94-9870e5c3014e for instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 on n-h2-858383-16 Oct 27 10:17:14.402931 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-51ddc8d9-a818-4f63-8c86-de974f23af34 req-e2c181c3-6a2a-44d6-9fc2-6388f8909f24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063741 Oct 27 10:17:14.404605 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3759/7593] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:14.459514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:14.460656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:14.470326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.470929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.471635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.472919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.473768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.475148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.524055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:14.524573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:14.525042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:14.525533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lazy-loading 'fault' on Instance uuid ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:17:14.589040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:14.600262 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8054df6-fe4a-4fec-9053-9bc047a09071 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 200 len: 1353 microversion: 2.1 time: 0.146862 Oct 27 10:17:14.601018 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3835/7594] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:14 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 1353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:15.626125 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:15.627031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:15.634893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:15.635465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:15.636025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:15.636830 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:15.637397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:15.637834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:15.653324 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] HTTP exception thrown: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 could not be found. Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Request method failure captured: Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 HTTP/1.1 Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlpSUk7-hRZvU0oPxGz2Kiv20kU9bMY8zw3_I6Ba4chcLGnBWfAR6XU9bOheF1AF_AR3cx12VZZQhkSr6RudJexsajrKpBlTkyIBF_4a70VZSeYd7hwy-825OA4CByT4AYiUySh-wcVo0Cm72oH4dn300v2zfq1CUP6ZVJz9cNnH7is Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c919f9668edc414e8fea0457c023a8ce"}]}] Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 31c7374ed3b244c18c2796f6859a6566 Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 could not be found. Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6'} Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 could not be found. Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 could not be found. Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:15.655323 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 could not be found. Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Returning 404 to user: Instance ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9d98110-475f-48d1-ae46-7dcd6b8b04a4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6" status: 404 len: 111 microversion: 2.1 time: 0.035552 Oct 27 10:17:15.662076 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3760/7595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:15 2022] GET /compute/v2.1/servers/ca6fcf3c-4294-45fd-899a-f3f80ac4ddf6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:17:15.669434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-44deee07-8c0c-4e72-907a-875795060a7e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '.version_select at 0x7f31a80aff70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:15.696295 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-44deee07-8c0c-4e72-907a-875795060a7e tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1696134307" status: 202 len: 0 microversion: 2.1 time: 0.032993 Oct 27 10:17:15.697240 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3836/7596] 10.222.0.25 () {58 vars in 1278 bytes} [Thu Oct 27 10:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1696134307 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:17:15.719427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-31af47ec-c0bf-4c1f-ac4b-b23e744520f2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Action: 'create', calling method: .version_select at 0x7f31a8e3f8b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-365759524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqElN3umGJZhWfYNbsPo1n/akbyfypfiqjwF3NSqEjI2nQ6tOFEL/WNKf/0Pc175Q8s9W+S/tUGPM0B0qWG/ECgMbaggW7qYTyShdEvsPHXqwmy2ZVRZ1j6069rIqgG9w=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:15.736083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-31af47ec-c0bf-4c1f-ac4b-b23e744520f2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for project c919f9668edc414e8fea0457c023a8ce. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:15.742827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-31af47ec-c0bf-4c1f-ac4b-b23e744520f2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for user 31c7374ed3b244c18c2796f6859a6566 and project c919f9668edc414e8fea0457c023a8ce. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:15.772112 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-31af47ec-c0bf-4c1f-ac4b-b23e744520f2 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.056722 Oct 27 10:17:15.772833 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3761/7597] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:17:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:17:15.830065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1919863180", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-365759524", "networks": [{"uuid": "c4b72fc7-db93-4d33-a15b-003d3eeda9ae"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:15.908546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] validate_networks() for [('c4b72fc7-db93-4d33-a15b-003d3eeda9ae', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:17:16.336397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:17:16.337132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:17:16.338020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:17:16.338786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:17:16.339547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:17:16.355129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:16.356005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:16.356744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:16.358007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:16.358757 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:16.359480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:16.392321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for project c919f9668edc414e8fea0457c023a8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:17:16.402788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Getting quotas for user 31c7374ed3b244c18c2796f6859a6566 and project c919f9668edc414e8fea0457c023a8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:17:16.426456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:17:16.431649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:17:16.518973 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [d69669f5-5980-4210-99e9-6826d4f5f287] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:17:17.526916 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [d69669f5-5980-4210-99e9-6826d4f5f287] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39790. Oct 27 10:17:17.531389 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1bf32ed-2578-4349-a905-b1a27e7b655a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.708983 Oct 27 10:17:17.532529 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3837/7598] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:17:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:17:17.552426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-851e4a21-9752-488b-b73c-81661f3d767c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:17.553808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-851e4a21-9752-488b-b73c-81661f3d767c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:17.614609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-851e4a21-9752-488b-b73c-81661f3d767c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:17.626349 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-851e4a21-9752-488b-b73c-81661f3d767c tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1262 microversion: 2.1 time: 0.081783 Oct 27 10:17:17.627308 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3762/7599] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:17 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:18.662132 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:18.662874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:18.673572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:18.674477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:18.674941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:18.675856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:18.676189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:18.676781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:18.756126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:18.765873 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0303ae93-b342-47ca-b160-f6bb3e90d045 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1322 microversion: 2.1 time: 0.114710 Oct 27 10:17:18.766862 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3838/7600] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:18 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1322 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:19.791943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:19.792826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:19.803698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:19.804218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:19.804683 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:19.805433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:19.805903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:19.806728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:20.084905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:20.096348 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18f3ba4a-02cf-4c9f-bfa7-9a880efd387a tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1362 microversion: 2.1 time: 0.309397 Oct 27 10:17:20.107718 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3763/7601] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:19 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:20.508829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-d3b6d34b-9ed4-4152-9545-c4f4bd8bf9dd req-c2c3cd5f-2be6-4d1c-8bb2-9f5e1b8569aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eac4d89-9416-4ae3-b5f9-ded79a9303f8", "tag": "c482753b-46d2-4c28-9f38-e7c9392174ab"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:20.521625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d3b6d34b-9ed4-4152-9545-c4f4bd8bf9dd req-c2c3cd5f-2be6-4d1c-8bb2-9f5e1b8569aa service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:20.522417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d3b6d34b-9ed4-4152-9545-c4f4bd8bf9dd req-c2c3cd5f-2be6-4d1c-8bb2-9f5e1b8569aa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:20.523061 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-d3b6d34b-9ed4-4152-9545-c4f4bd8bf9dd req-c2c3cd5f-2be6-4d1c-8bb2-9f5e1b8569aa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:20.535348 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-d3b6d34b-9ed4-4152-9545-c4f4bd8bf9dd req-c2c3cd5f-2be6-4d1c-8bb2-9f5e1b8569aa service nova] Creating event network-changed:c482753b-46d2-4c28-9f38-e7c9392174ab for instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 on n-h1-858383-16 Oct 27 10:17:20.541401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-d3b6d34b-9ed4-4152-9545-c4f4bd8bf9dd req-c2c3cd5f-2be6-4d1c-8bb2-9f5e1b8569aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040897 Oct 27 10:17:20.542308 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3839/7602] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:21.122533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:21.123159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:21.130656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:21.131156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:21.131641 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:21.132401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:21.132878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:21.133310 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:21.284847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:21.293843 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4eba1e2a-45b9-4dfa-8c9c-a38bca8c39ea tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1362 microversion: 2.1 time: 0.175230 Oct 27 10:17:21.294443 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3764/7603] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:21 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:22.319461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:22.320453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:22.329432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:22.330268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:22.331085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:22.332386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:22.334591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:22.334759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:22.487310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:22.495250 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6ffe35ca-8378-47e0-b401-44767514abaf tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1362 microversion: 2.1 time: 0.181260 Oct 27 10:17:22.495902 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3840/7604] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:22 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:23.518513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:23.519165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:23.527121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:23.527664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:23.528087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:23.528795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:23.529250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:23.529677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:23.670777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:23.682692 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9bb61017-2000-4a62-9d7f-9bd078dfacf3 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1362 microversion: 2.1 time: 0.167942 Oct 27 10:17:23.683651 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3765/7605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:23 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:24.715030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:24.715690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:24.722930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:24.723446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:24.724465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:24.725222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:24.725699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:24.726150 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:24.887687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:24.897612 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f0decc9-71e9-491b-9a0a-6768a74226ce tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1362 microversion: 2.1 time: 0.186785 Oct 27 10:17:24.898385 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3841/7606] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:24 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:25.936614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:25.937195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:25.945400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.945900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.946354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:25.947075 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:25.947540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:25.948011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:26.090968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:26.099910 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf001a05-77b7-4d47-9963-f5f06ced8ec7 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1362 microversion: 2.1 time: 0.166737 Oct 27 10:17:26.100512 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3766/7607] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:25 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:27.127413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:27.128134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:27.131477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:27.132253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:27.138832 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:27.139393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:27.140034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:27.140819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:27.141301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:27.141750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:27.332759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:27.342210 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3180c814-559e-4d6f-bbe4-b9bfc74c64d9 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1362 microversion: 2.1 time: 0.218710 Oct 27 10:17:27.342816 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3842/7608] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:27 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:27.438151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-92b572ad-d79e-4e91-a3f7-9f3e1199e72b req-4f9e8f12-b0dd-4a7b-b3a0-8754052a18a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eac4d89-9416-4ae3-b5f9-ded79a9303f8", "name": "network-vif-plugged", "status": "completed", "tag": "c482753b-46d2-4c28-9f38-e7c9392174ab"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:27.449612 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-92b572ad-d79e-4e91-a3f7-9f3e1199e72b req-4f9e8f12-b0dd-4a7b-b3a0-8754052a18a9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:27.450107 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-92b572ad-d79e-4e91-a3f7-9f3e1199e72b req-4f9e8f12-b0dd-4a7b-b3a0-8754052a18a9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:27.450597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-92b572ad-d79e-4e91-a3f7-9f3e1199e72b req-4f9e8f12-b0dd-4a7b-b3a0-8754052a18a9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:27.464848 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-92b572ad-d79e-4e91-a3f7-9f3e1199e72b req-4f9e8f12-b0dd-4a7b-b3a0-8754052a18a9 service nova] Creating event network-vif-plugged:c482753b-46d2-4c28-9f38-e7c9392174ab for instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 on n-h1-858383-16 Oct 27 10:17:27.470481 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-92b572ad-d79e-4e91-a3f7-9f3e1199e72b req-4f9e8f12-b0dd-4a7b-b3a0-8754052a18a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036192 Oct 27 10:17:27.471112 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3767/7609] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:28.366625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:28.367361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:28.374785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:28.375345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:28.376374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:28.377214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:28.377839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:28.378418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:28.541739 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:28.550350 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57d6d7c2-b30b-4c4f-9db3-ece003ca9938 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1362 microversion: 2.1 time: 0.187741 Oct 27 10:17:28.551846 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3843/7610] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:28 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:29.572382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:29.577624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:29.578342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:29.585804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:29.586161 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:29.586609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:29.587326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:29.587831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:29.588262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:29.737453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:29.746494 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-083edbc2-5e9c-4157-b2ce-806fe2730b8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1554 microversion: 2.1 time: 0.175028 Oct 27 10:17:29.747105 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3768/7611] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:29 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:29.769876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:29.770526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:29.778054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:29.778556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:29.779004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:29.779760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:29.780228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:29.780660 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:29.931754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:29.940193 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a4d621d7-97b7-404b-80aa-5406043dc56b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1554 microversion: 2.1 time: 0.174381 Oct 27 10:17:29.940791 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3844/7612] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:29 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:31.560906 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-974478e6-58cb-4629-9726-315272d74d8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3e92fb8-cef4-4078-95e3-9a796d36a0c1"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:31.563374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-974478e6-58cb-4629-9726-315272d74d8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:31.571326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-974478e6-58cb-4629-9726-315272d74d8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:31.571856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-974478e6-58cb-4629-9726-315272d74d8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:31.572291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-974478e6-58cb-4629-9726-315272d74d8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:31.573013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-974478e6-58cb-4629-9726-315272d74d8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:31.573495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-974478e6-58cb-4629-9726-315272d74d8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:31.573926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-974478e6-58cb-4629-9726-315272d74d8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:31.853646 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-974478e6-58cb-4629-9726-315272d74d8d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "POST /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296819 Oct 27 10:17:31.855199 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3769/7613] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 10:17:31 2022] POST /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:43.878354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:43.879194 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:43.882633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:43.883360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:43.890657 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:43.891161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:43.891647 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:43.892559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:43.893074 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:43.893520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:44.007782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lazy-loading 'services' on Instance uuid 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:17:44.114100 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aad9cb09-c611-4ce2-82e2-0fd8081c297f tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments/b3e92fb8-cef4-4078-95e3-9a796d36a0c1" status: 202 len: 0 microversion: 2.1 time: 0.239931 Oct 27 10:17:44.115142 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3845/7614] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:17:43 2022] DELETE /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments/b3e92fb8-cef4-4078-95e3-9a796d36a0c1 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:17:44.122205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:44.123165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:17:44.129779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6f4059ee-e987-4ff6-9b41-7cd38bedc643 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:44.131279 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6f4059ee-e987-4ff6-9b41-7cd38bedc643 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:44.140956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f4059ee-e987-4ff6-9b41-7cd38bedc643 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:44.141585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f4059ee-e987-4ff6-9b41-7cd38bedc643 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:44.142128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f4059ee-e987-4ff6-9b41-7cd38bedc643 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:44.142945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f4059ee-e987-4ff6-9b41-7cd38bedc643 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:44.143493 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f4059ee-e987-4ff6-9b41-7cd38bedc643 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:44.143967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f4059ee-e987-4ff6-9b41-7cd38bedc643 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:44.181557 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f4059ee-e987-4ff6-9b41-7cd38bedc643 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061290 Oct 27 10:17:44.182176 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3770/7615] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:44 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:17:45.202133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-425bcab5-2992-4bbb-8487-286a0e669a4b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:45.208782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-425bcab5-2992-4bbb-8487-286a0e669a4b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:45.223230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-425bcab5-2992-4bbb-8487-286a0e669a4b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:45.224050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-425bcab5-2992-4bbb-8487-286a0e669a4b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:45.224857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-425bcab5-2992-4bbb-8487-286a0e669a4b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:45.226104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-425bcab5-2992-4bbb-8487-286a0e669a4b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:45.226960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-425bcab5-2992-4bbb-8487-286a0e669a4b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:45.227769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-425bcab5-2992-4bbb-8487-286a0e669a4b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:45.290907 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-425bcab5-2992-4bbb-8487-286a0e669a4b tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097859 Oct 27 10:17:45.292225 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3846/7616] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:45 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:46.306029 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfcd80cc-4b29-42fd-9476-598e0d474f39 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:46.308495 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dfcd80cc-4b29-42fd-9476-598e0d474f39 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:46.316261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfcd80cc-4b29-42fd-9476-598e0d474f39 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.317052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfcd80cc-4b29-42fd-9476-598e0d474f39 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.317578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfcd80cc-4b29-42fd-9476-598e0d474f39 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.318309 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfcd80cc-4b29-42fd-9476-598e0d474f39 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:46.318772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfcd80cc-4b29-42fd-9476-598e0d474f39 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:46.319204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfcd80cc-4b29-42fd-9476-598e0d474f39 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:46.354987 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dfcd80cc-4b29-42fd-9476-598e0d474f39 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053019 Oct 27 10:17:46.362878 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3771/7617] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:46 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:47.375480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0bd3e182-ef88-4a06-95d5-11a1148dc166 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:47.379452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0bd3e182-ef88-4a06-95d5-11a1148dc166 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:47.392356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bd3e182-ef88-4a06-95d5-11a1148dc166 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:47.393247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bd3e182-ef88-4a06-95d5-11a1148dc166 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:47.394033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bd3e182-ef88-4a06-95d5-11a1148dc166 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:47.395176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bd3e182-ef88-4a06-95d5-11a1148dc166 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:47.396435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bd3e182-ef88-4a06-95d5-11a1148dc166 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:47.396969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0bd3e182-ef88-4a06-95d5-11a1148dc166 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:47.433525 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0bd3e182-ef88-4a06-95d5-11a1148dc166 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065585 Oct 27 10:17:47.434113 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3847/7618] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:47 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:48.447110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77f2da2f-6732-4fc7-9a31-254babdc8889 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:48.449384 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77f2da2f-6732-4fc7-9a31-254babdc8889 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:48.456480 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f2da2f-6732-4fc7-9a31-254babdc8889 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:48.456979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f2da2f-6732-4fc7-9a31-254babdc8889 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:48.457688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f2da2f-6732-4fc7-9a31-254babdc8889 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:48.459210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f2da2f-6732-4fc7-9a31-254babdc8889 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:48.460204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f2da2f-6732-4fc7-9a31-254babdc8889 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:48.460786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f2da2f-6732-4fc7-9a31-254babdc8889 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:48.499013 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77f2da2f-6732-4fc7-9a31-254babdc8889 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056908 Oct 27 10:17:48.499642 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3772/7619] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:48 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:49.512764 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7c37ad8-56e1-492f-b60e-e360cf472c2d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:49.514900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7c37ad8-56e1-492f-b60e-e360cf472c2d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:49.522645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c37ad8-56e1-492f-b60e-e360cf472c2d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:49.523147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c37ad8-56e1-492f-b60e-e360cf472c2d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:49.523614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c37ad8-56e1-492f-b60e-e360cf472c2d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:49.524337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c37ad8-56e1-492f-b60e-e360cf472c2d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:49.524806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c37ad8-56e1-492f-b60e-e360cf472c2d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:49.525242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7c37ad8-56e1-492f-b60e-e360cf472c2d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:49.556803 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7c37ad8-56e1-492f-b60e-e360cf472c2d tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048253 Oct 27 10:17:49.557388 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3848/7620] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:17:49 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:17:49.568741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:49.569593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:49.576282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:49.576767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:49.577206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:49.577916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:49.578372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:49.578804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:49.659181 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] HTTP exception thrown: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 is not attached to volume b3e92fb8-cef4-4078-95e3-9a796d36a0c1 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Request method failure captured: Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments/b3e92fb8-cef4-4078-95e3-9a796d36a0c1 HTTP/1.1 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlpSUk7-hRZvU0oPxGz2Kiv20kU9bMY8zw3_I6Ba4chcLGnBWfAR6XU9bOheF1AF_AR3cx12VZZQhkSr6RudJexsajrKpBlTkyIBF_4a70VZSeYd7hwy-825OA4CByT4AYiUySh-wcVo0Cm72oH4dn300v2zfq1CUP6ZVJz9cNnH7is Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c919f9668edc414e8fea0457c023a8ce"}]}] Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 31c7374ed3b244c18c2796f6859a6566 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 is not attached to volume b3e92fb8-cef4-4078-95e3-9a796d36a0c1 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': '0eac4d89-9416-4ae3-b5f9-ded79a9303f8', 'id': 'b3e92fb8-cef4-4078-95e3-9a796d36a0c1'} Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b3e92fb8-cef4-4078-95e3-9a796d36a0c1. Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 is not attached to volume b3e92fb8-cef4-4078-95e3-9a796d36a0c1 Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:49.660862 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:49.665301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:49.665301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:49.665301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 is not attached to volume b3e92fb8-cef4-4078-95e3-9a796d36a0c1 Oct 27 10:17:49.665301 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:49.665301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Returning 404 to user: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 is not attached to volume b3e92fb8-cef4-4078-95e3-9a796d36a0c1 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:49.665301 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e9af660b-82f0-4dca-b329-fd7d57850f05 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments/b3e92fb8-cef4-4078-95e3-9a796d36a0c1" status: 404 len: 154 microversion: 2.1 time: 0.098287 Oct 27 10:17:49.665301 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3773/7621] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:17:49 2022] DELETE /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8/os-volume_attachments/b3e92fb8-cef4-4078-95e3-9a796d36a0c1 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:17:53.091304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:53.092249 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:53.105252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:53.106228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:53.106970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:53.108581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:53.109118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:53.109908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:53.139343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:17:53.225892 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0615443d-8b01-478e-b6b8-b543824899ab tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 204 len: 0 microversion: 2.1 time: 0.137956 Oct 27 10:17:53.227885 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3849/7622] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:17:53 2022] DELETE /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:17:53.238441 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:53.240024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:53.252259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:53.253124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:53.253961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:53.255940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:53.256904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:53.257925 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:53.439926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:53.448991 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13badac5-e76a-403a-af52-ba64016aff36 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1560 microversion: 2.1 time: 0.215410 Oct 27 10:17:53.449702 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3774/7623] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:53 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:17:54.473434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:54.474765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:54.482586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:54.483115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:54.483546 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:54.484305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:54.484769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:54.485208 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:54.631752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:54.642924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-480f2358-c3a2-47df-b8e3-a390d3be9141 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1560 microversion: 2.1 time: 0.174180 Oct 27 10:17:54.643526 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3850/7624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:54 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:55.442095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6b9359fb-22fa-4f7c-a0f1-ce39d2d62338 req-55cfb2ad-536e-4f30-92c1-a083ba90ef56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eac4d89-9416-4ae3-b5f9-ded79a9303f8", "name": "network-vif-deleted", "tag": "c482753b-46d2-4c28-9f38-e7c9392174ab"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:17:55.456096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6b9359fb-22fa-4f7c-a0f1-ce39d2d62338 req-55cfb2ad-536e-4f30-92c1-a083ba90ef56 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:55.456597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6b9359fb-22fa-4f7c-a0f1-ce39d2d62338 req-55cfb2ad-536e-4f30-92c1-a083ba90ef56 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:55.457042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6b9359fb-22fa-4f7c-a0f1-ce39d2d62338 req-55cfb2ad-536e-4f30-92c1-a083ba90ef56 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:55.473381 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6b9359fb-22fa-4f7c-a0f1-ce39d2d62338 req-55cfb2ad-536e-4f30-92c1-a083ba90ef56 service nova] Creating event network-vif-deleted:c482753b-46d2-4c28-9f38-e7c9392174ab for instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 on n-h1-858383-16 Oct 27 10:17:55.479355 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6b9359fb-22fa-4f7c-a0f1-ce39d2d62338 req-55cfb2ad-536e-4f30-92c1-a083ba90ef56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040995 Oct 27 10:17:55.480320 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3775/7625] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:17:55.667608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:55.668302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:55.674756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:55.675185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:55.675658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:55.676364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:55.676830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:55.677260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:55.716004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:55.716506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:55.716962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:55.717430 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lazy-loading 'fault' on Instance uuid 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:17:55.765102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c7374ed3b244c18c2796f6859a6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c919f9668edc414e8fea0457c023a8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:17:55.773808 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-669e5dc8-af25-45f5-8fc7-fd1db72d26c8 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 200 len: 1352 microversion: 2.1 time: 0.110927 Oct 27 10:17:55.774401 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3851/7626] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:55 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:17:56.798757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:56.799498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] [instance: 0eac4d89-9416-4ae3-b5f9-ded79a9303f8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:17:56.807141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:56.807668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:56.808117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:56.808831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:17:56.809288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:17:56.809718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:17:56.824336 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] HTTP exception thrown: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 could not be found. Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Request method failure captured: Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 HTTP/1.1 Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlpSUk7-hRZvU0oPxGz2Kiv20kU9bMY8zw3_I6Ba4chcLGnBWfAR6XU9bOheF1AF_AR3cx12VZZQhkSr6RudJexsajrKpBlTkyIBF_4a70VZSeYd7hwy-825OA4CByT4AYiUySh-wcVo0Cm72oH4dn300v2zfq1CUP6ZVJz9cNnH7is Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c919f9668edc414e8fea0457c023a8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c919f9668edc414e8fea0457c023a8ce"}]}] Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: c919f9668edc414e8fea0457c023a8ce Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-120788249 Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 31c7374ed3b244c18c2796f6859a6566 Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestEncryptedCinderVolumes-120788249-project Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 could not be found. Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '0eac4d89-9416-4ae3-b5f9-ded79a9303f8'} Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 could not be found. Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 could not be found. Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:17:56.825998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 could not be found. Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Returning 404 to user: Instance 0eac4d89-9416-4ae3-b5f9-ded79a9303f8 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d9efe0d2-7feb-4bf5-abff-a05c6ecb60fa tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8" status: 404 len: 111 microversion: 2.1 time: 0.033852 Oct 27 10:17:56.831979 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3776/7627] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:17:56 2022] GET /compute/v2.1/servers/0eac4d89-9416-4ae3-b5f9-ded79a9303f8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:17:56.836619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7068e9bb-baed-4e7b-8731-f9c0c9daa3b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] Calling method '.version_select at 0x7f319874c1f0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:17:56.857094 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7068e9bb-baed-4e7b-8731-f9c0c9daa3b4 tempest-TestEncryptedCinderVolumes-120788249 tempest-TestEncryptedCinderVolumes-120788249-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-365759524" status: 202 len: 0 microversion: 2.1 time: 0.024476 Oct 27 10:17:56.857688 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3852/7628] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Oct 27 10:17:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-365759524 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:18:27.690195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b218b26a-d990-48f7-a407-5095655deab7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'create', calling method: .version_select at 0x7f31a8f57d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1626563021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB7SARFM6RMViMVBEjqYaGRygfe885u9KQim4fMO6w/jYma1/CBS8W1j9nT+YBV31Ea7nhhR+0hW4hpG7Jho4rydaLBV5FxmMygCKFJq21yfgrCMUH731dzKs84mBtsTA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:27.696909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=14 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:27.697552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=34 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:27.710018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b218b26a-d990-48f7-a407-5095655deab7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Getting quotas for project d9ea863582054435900efb4cd7710657. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:18:27.715590 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-b218b26a-d990-48f7-a407-5095655deab7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Getting quotas for user 0a5adbe51af8455ea27b847eb8d9b134 and project d9ea863582054435900efb4cd7710657. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:18:27.739063 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b218b26a-d990-48f7-a407-5095655deab7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053007 Oct 27 10:18:27.742425 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3777/7629] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:18:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:27.789728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-9504309", "imageRef": "2946577f-be14-47df-b4ee-18090d305be4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1626563021", "networks": [{"uuid": "f7488c1e-9165-4d02-9a73-db16be6593c3"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:27.800375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:27.801041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:27.846790 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] validate_networks() for [('f7488c1e-9165-4d02-9a73-db16be6593c3', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:18:28.307242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:18:28.307704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:18:28.308188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:18:28.308601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:18:28.309046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:18:28.318408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:28.318897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:28.319341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:28.320102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:28.320566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:28.320997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:28.338928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Getting quotas for project d9ea863582054435900efb4cd7710657. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:18:28.344244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Getting quotas for user 0a5adbe51af8455ea27b847eb8d9b134 and project d9ea863582054435900efb4cd7710657. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:18:28.356736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:18:28.358937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2946577f-be14-47df-b4ee-18090d305be4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:18:28.405396 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c6f86acc-21f3-4c9e-9133-29db232c1fc7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619606 Oct 27 10:18:28.406047 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3853/7630] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:18:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:18:28.417912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f16e090b-fc0c-47db-89a2-28d200ef4c57 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:28.418614 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f16e090b-fc0c-47db-89a2-28d200ef4c57 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:28.479592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f16e090b-fc0c-47db-89a2-28d200ef4c57 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:28.488853 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f16e090b-fc0c-47db-89a2-28d200ef4c57 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1256 microversion: 2.1 time: 0.075178 Oct 27 10:18:28.489938 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3778/7631] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:28 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1256 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:29.512749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:29.513851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:29.531519 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.533549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.534147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.535374 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:29.536171 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:29.536621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:29.723503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:29.735212 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2429d58c-dcba-4f56-abf0-b3f7f155f929 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1326 microversion: 2.1 time: 0.227336 Oct 27 10:18:29.736476 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3854/7632] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:29 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1326 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:30.762554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:30.763144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:30.783984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:30.784565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:30.785087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:30.786215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:30.786687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:30.787207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:30.943043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:30.952004 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7b22747-9e28-40de-b3e8-1f47dc1ddf34 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.193433 Oct 27 10:18:30.963424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3779/7633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:30 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:31.982903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:31.985186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:31.994830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.996186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.997009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:31.998001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:31.998695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:31.999334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:32.158838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:32.167588 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cbf9a269-fc02-447b-bbd8-f0e0aa215766 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.193276 Oct 27 10:18:32.168194 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3855/7634] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:31 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:33.196990 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:33.197956 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:33.206116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.206632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.207126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.208065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:33.208654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:33.209101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:33.393810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:33.403012 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c4c90923-8595-4729-a380-57ec004e3ce4 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.210125 Oct 27 10:18:33.403625 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3780/7635] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:33 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:34.430281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:34.430896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:34.439297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:34.440349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:34.441113 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:34.442043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:34.442547 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:34.442872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:34.623193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:34.631973 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-510cb97f-526d-4317-8f52-7b84ffc06222 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.207690 Oct 27 10:18:34.632770 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3856/7636] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:34 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:35.660087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:35.661428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:35.668189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:35.668685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:35.669136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:35.669847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:35.670308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:35.670735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:35.819849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:35.828047 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-913ac6d6-2d24-47de-8720-b411fdbd7f0e tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.172149 Oct 27 10:18:35.828733 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3781/7637] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:35 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:36.851220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:36.851908 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:36.860778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:36.861163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:36.861716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:36.862469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:36.863073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:36.864283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:37.007990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:37.016057 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a079fb0c-371d-49e9-b946-bad45bffe247 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.169530 Oct 27 10:18:37.016626 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3857/7638] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:36 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:18:38.039093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:38.039743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:38.046716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:38.047207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:38.047676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:38.048381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:38.048835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:38.049261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:38.185200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:38.193827 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61489a48-9a0f-4dff-a53b-e8a758ee2ff9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.159231 Oct 27 10:18:38.194408 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3782/7639] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:38 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:39.217976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:39.218604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:39.221296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:39.222159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:39.228321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.228825 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.229269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.229982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:39.230441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:39.230874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:39.364498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:39.372133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-37ac0469-2a6a-415e-9749-9b446ae00dcc tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.158119 Oct 27 10:18:39.372719 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3858/7640] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:39 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:40.396323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:40.397103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:40.399054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:18:40.405568 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.406067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.406511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.407259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.407777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.408212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.619800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:40.627502 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3e1bd50d-6e65-4334-a17b-34270df14359 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.235730 Oct 27 10:18:40.628131 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3783/7641] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:40 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:40.939736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-26f9b2a1-f561-4780-8e7d-6de9f0943ae4 req-4ee0d9f8-462e-4206-819a-01a6112e1204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664a96cd-3b7c-4f38-afb4-74ba57e6dbfc", "tag": "dc433c9d-5334-41b5-a218-843703c8a5b3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:40.952280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-26f9b2a1-f561-4780-8e7d-6de9f0943ae4 req-4ee0d9f8-462e-4206-819a-01a6112e1204 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:40.952777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-26f9b2a1-f561-4780-8e7d-6de9f0943ae4 req-4ee0d9f8-462e-4206-819a-01a6112e1204 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:40.953238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-26f9b2a1-f561-4780-8e7d-6de9f0943ae4 req-4ee0d9f8-462e-4206-819a-01a6112e1204 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:40.967849 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-26f9b2a1-f561-4780-8e7d-6de9f0943ae4 req-4ee0d9f8-462e-4206-819a-01a6112e1204 service nova] Creating event network-changed:dc433c9d-5334-41b5-a218-843703c8a5b3 for instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc on n-h2-858383-16 Oct 27 10:18:40.973427 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-26f9b2a1-f561-4780-8e7d-6de9f0943ae4 req-4ee0d9f8-462e-4206-819a-01a6112e1204 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037411 Oct 27 10:18:40.974320 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3859/7642] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:41.650499 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:41.651072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:41.658305 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.658795 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.659239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.660000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:41.660460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:41.660889 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:41.805982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:41.813896 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5a4d8589-07ed-4d11-93cd-c32b20d5f788 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.167416 Oct 27 10:18:41.814481 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3784/7643] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:41 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:42.839418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:42.841043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:42.852332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.853341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.854038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.855310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:42.856196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:42.856986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:42.987910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:42.996182 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-85db517b-0114-4353-aedd-b46f8b9acd8d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.162235 Oct 27 10:18:42.996510 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3860/7644] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:42 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:44.019176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:44.020405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:44.028280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.028777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.029219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.029946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:44.030552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:44.030992 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:44.163986 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:44.172032 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f73f309-9a44-4df0-99cc-bc05a6981f08 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.156920 Oct 27 10:18:44.172615 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3785/7645] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:44 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:45.195462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:45.196049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:45.203364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.203901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.204352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.205075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:45.205543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:45.205977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:45.343951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:45.355001 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-522f267b-d471-4751-8eb9-3c846b225ed7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.164228 Oct 27 10:18:45.355718 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3861/7646] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:45 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:46.307516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-838cdc37-97d7-4c9b-a61c-5a42c987acb9 req-77875f5d-7a37-4372-b76d-052e88334829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664a96cd-3b7c-4f38-afb4-74ba57e6dbfc", "name": "network-vif-plugged", "status": "completed", "tag": "dc433c9d-5334-41b5-a218-843703c8a5b3"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:46.319811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-838cdc37-97d7-4c9b-a61c-5a42c987acb9 req-77875f5d-7a37-4372-b76d-052e88334829 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.320294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-838cdc37-97d7-4c9b-a61c-5a42c987acb9 req-77875f5d-7a37-4372-b76d-052e88334829 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.320726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-838cdc37-97d7-4c9b-a61c-5a42c987acb9 req-77875f5d-7a37-4372-b76d-052e88334829 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.333178 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-838cdc37-97d7-4c9b-a61c-5a42c987acb9 req-77875f5d-7a37-4372-b76d-052e88334829 service nova] Creating event network-vif-plugged:dc433c9d-5334-41b5-a218-843703c8a5b3 for instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc on n-h2-858383-16 Oct 27 10:18:46.338700 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-838cdc37-97d7-4c9b-a61c-5a42c987acb9 req-77875f5d-7a37-4372-b76d-052e88334829 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188390 Oct 27 10:18:46.339410 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3786/7647] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:46.379667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:46.380310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:46.388109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.388619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.389073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.389802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:46.390345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:46.390715 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:46.597129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:46.605646 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e2488c3e-0ba1-41f7-9a79-4a641d0beb1a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.231079 Oct 27 10:18:46.606236 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3862/7648] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:46 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:47.630461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:47.631070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:47.637370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.637850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.638284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.638975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:47.639424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:47.639888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:47.783179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:47.791293 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dd1eb804-7ecc-4c8b-a5ff-7ede6efedc6b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1356 microversion: 2.1 time: 0.166065 Oct 27 10:18:47.791975 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3787/7649] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:47 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:48.814819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:48.815472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:48.823106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.823635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.824090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.824811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.825283 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.825729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.955991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:48.964701 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-52b6fd1b-7171-45ce-8da1-4db81250aa15 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1546 microversion: 2.1 time: 0.153899 Oct 27 10:18:48.965283 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3863/7650] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:48 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:48.987004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:48.987640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:48.994847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.995332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.995797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:48.996494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:48.996948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:48.997372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.136550 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:49.144698 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50cca50a-b8c6-412a-8ed0-9d3801fee87c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1546 microversion: 2.1 time: 0.161494 Oct 27 10:18:49.145390 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3788/7651] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:48 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:49.166953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.171730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:49.172510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Searching by: {'deleted': False, 'project_id': 'd9ea863582054435900efb4cd7710657'} {{(pid=120602) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:18:49.178475 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.178967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.179417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.180182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.180652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.181089 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.206119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.multi_cell_list [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:18:49.234575 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c981731-ad6c-46f1-93b9-096822517074 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.071378 Oct 27 10:18:49.235162 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3864/7652] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 10:18:49 2022] GET /compute/v2.1/servers => generated 340 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:18:49.247043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:18:49.247690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:49.253785 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.254438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.254887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.255616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:49.256081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:49.256511 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:49.389750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:18:49.398694 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a3a86469-9c2b-44a0-bbe0-dc7c7f09c5e9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1546 microversion: 2.1 time: 0.155586 Oct 27 10:18:49.399289 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3789/7653] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:18:49 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:18:50.967069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-903c1787-9ff2-4d8c-aafa-51b3275418af tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be01f191-75ec-4c39-850e-746348b4f5d9"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:18:50.969423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-903c1787-9ff2-4d8c-aafa-51b3275418af tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:18:50.976691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-903c1787-9ff2-4d8c-aafa-51b3275418af tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.977179 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-903c1787-9ff2-4d8c-aafa-51b3275418af tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.977628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-903c1787-9ff2-4d8c-aafa-51b3275418af tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:50.978521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-903c1787-9ff2-4d8c-aafa-51b3275418af tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:18:50.978767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-903c1787-9ff2-4d8c-aafa-51b3275418af tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:18:50.979201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-903c1787-9ff2-4d8c-aafa-51b3275418af tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:18:51.250884 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-903c1787-9ff2-4d8c-aafa-51b3275418af tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287506 Oct 27 10:18:51.251512 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3865/7654] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 10:18:50 2022] POST /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:04.365916 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:04.366543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:04.369862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:04.370563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=62 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:04.377176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:04.377749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:04.378942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:04.379073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:04.379518 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:04.379976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:04.613706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:04.622053 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-683a1b7e-335b-4fab-bb53-38aae396e633 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1592 microversion: 2.1 time: 0.260180 Oct 27 10:19:04.622642 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3790/7655] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:04 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1592 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:19:06.710425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:06.715995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:06.716772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:19:06.787702 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f8b6e491-2af0-4ae6-b330-9289732fe6b9 req-f6d0a1f0-b20d-4dd4-931b-f0574bbdf3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664a96cd-3b7c-4f38-afb4-74ba57e6dbfc", "tag": "dc433c9d-5334-41b5-a218-843703c8a5b3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:06.799893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f8b6e491-2af0-4ae6-b330-9289732fe6b9 req-f6d0a1f0-b20d-4dd4-931b-f0574bbdf3b9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:06.800680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f8b6e491-2af0-4ae6-b330-9289732fe6b9 req-f6d0a1f0-b20d-4dd4-931b-f0574bbdf3b9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:06.801401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f8b6e491-2af0-4ae6-b330-9289732fe6b9 req-f6d0a1f0-b20d-4dd4-931b-f0574bbdf3b9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:06.816850 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f8b6e491-2af0-4ae6-b330-9289732fe6b9 req-f6d0a1f0-b20d-4dd4-931b-f0574bbdf3b9 service nova] Creating event network-changed:dc433c9d-5334-41b5-a218-843703c8a5b3 for instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc on n-h2-858383-16 Oct 27 10:19:06.823354 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f8b6e491-2af0-4ae6-b330-9289732fe6b9 req-f6d0a1f0-b20d-4dd4-931b-f0574bbdf3b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119331 Oct 27 10:19:06.824735 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3866/7656] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:08.402430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1912927810"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:08.402972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:08.409752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.410231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.410667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.411362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.412377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.412832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.546769 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.network.security_group_api [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Adding security group c027c82f-be21-4630-93e1-92af85b3b6cd to port dc433c9d-5334-41b5-a218-843703c8a5b3 Oct 27 10:19:08.852798 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04230bc2-09b0-4e13-8ee8-f6301b1e7f6d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/action" status: 202 len: 0 microversion: 2.1 time: 0.454262 Oct 27 10:19:08.853425 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3791/7657] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:19:08 2022] POST /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:19:08.862826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:19:08.863540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:19:08.871374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3b9c17a0-f9ff-4448-9572-99a4dc22d82f req-c06b9cc9-f91e-46b7-91b6-b20238e63db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664a96cd-3b7c-4f38-afb4-74ba57e6dbfc", "tag": "dc433c9d-5334-41b5-a218-843703c8a5b3"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:19:08.872401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.872523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.873124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.873862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.874338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.875972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.881854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b9c17a0-f9ff-4448-9572-99a4dc22d82f req-c06b9cc9-f91e-46b7-91b6-b20238e63db9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:19:08.882351 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b9c17a0-f9ff-4448-9572-99a4dc22d82f req-c06b9cc9-f91e-46b7-91b6-b20238e63db9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:19:08.882793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3b9c17a0-f9ff-4448-9572-99a4dc22d82f req-c06b9cc9-f91e-46b7-91b6-b20238e63db9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:19:08.894804 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3b9c17a0-f9ff-4448-9572-99a4dc22d82f req-c06b9cc9-f91e-46b7-91b6-b20238e63db9 service nova] Creating event network-changed:dc433c9d-5334-41b5-a218-843703c8a5b3 for instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc on n-h2-858383-16 Oct 27 10:19:08.901000 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3b9c17a0-f9ff-4448-9572-99a4dc22d82f req-c06b9cc9-f91e-46b7-91b6-b20238e63db9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033459 Oct 27 10:19:08.902091 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3792/7658] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:19:09.201640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:19:09.210550 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d7d237d8-99e4-408a-989f-ab8ca90c8314 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1758 microversion: 2.1 time: 0.352670 Oct 27 10:19:09.211234 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3867/7659] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:19:08 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1758 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:21.236944 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:21:21.237753 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:21:21.238332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:21.239115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:21.240348 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:21:21.240516 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:21:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/action (ip 10.222.0.25) !!! Oct 27 10:21:21.241634 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:21:21.242046 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:21:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/action (ip 10.222.0.25) !!! Oct 27 10:21:21.249553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-962ac519-08a7-414c-822f-0605898c9615 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:21:21.252070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-962ac519-08a7-414c-822f-0605898c9615 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:21.263226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-962ac519-08a7-414c-822f-0605898c9615 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.263765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-962ac519-08a7-414c-822f-0605898c9615 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.264204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-962ac519-08a7-414c-822f-0605898c9615 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.264924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-962ac519-08a7-414c-822f-0605898c9615 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.265379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-962ac519-08a7-414c-822f-0605898c9615 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.265806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-962ac519-08a7-414c-822f-0605898c9615 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.354918 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-962ac519-08a7-414c-822f-0605898c9615 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/action" status: 202 len: 0 microversion: 2.1 time: 0.119257 Oct 27 10:21:21.355621 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3793/7660] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:21:21 2022] POST /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 10:21:21.369946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:21.371181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:21.375639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:21.376836 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:21:21.378433 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:21:21.378741 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:21:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc (ip 10.222.0.25) !!! Oct 27 10:21:21.380981 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:21:21.381210 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:21:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc (ip 10.222.0.25) !!! Oct 27 10:21:21.394484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.395038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.395524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.396337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:21.396923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:21.397455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:21.676870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:21.687941 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e4df9bc-b05b-4718-ab84-a27c5cb990c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1760 microversion: 2.1 time: 0.327194 Oct 27 10:21:21.689304 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3868/7661] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:21 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1760 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:21:22.716160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:22.716874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:22.731172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:22.731696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:22.732138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:22.732855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:22.733311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:22.733741 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:22.741493 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40336. Oct 27 10:21:22.745378 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40334. Oct 27 10:21:22.931368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:22.940476 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38e211f0-331d-46fc-b9ac-3e9acbe0a43f tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1765 microversion: 2.1 time: 0.229480 Oct 27 10:21:22.941066 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3794/7662] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:22 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1765 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:21:23.966421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:21:23.967051 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:21:23.974369 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:23.974872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:23.975331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:23.976085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:21:23.976566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:21:23.977048 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:21:24.155501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:21:24.164594 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d589c4ef-2bae-4511-b507-9011263fe72a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1758 microversion: 2.1 time: 0.202573 Oct 27 10:21:24.165213 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3869/7663] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:21:23 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:22:55.299256 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:55.300047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:55.304712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1912927810"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:55.305265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:55.313827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.314321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.314759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.315481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.315968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.316393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.460404 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.network.security_group_api [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Removing security group c027c82f-be21-4630-93e1-92af85b3b6cd from port dc433c9d-5334-41b5-a218-843703c8a5b3 Oct 27 10:22:55.811799 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-477234c3-97f9-4303-8f08-80a997a189c3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/action" status: 202 len: 0 microversion: 2.1 time: 0.514282 Oct 27 10:22:55.813171 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3795/7664] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:22:55 2022] POST /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:22:55.819590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:55.820413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:22:55.902601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a0c455f2-b0c4-4d47-abd3-054ef9a16d3c req-d42054ff-2253-464d-8e8b-04b39ecc8c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664a96cd-3b7c-4f38-afb4-74ba57e6dbfc", "tag": "dc433c9d-5334-41b5-a218-843703c8a5b3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:55.917517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a0c455f2-b0c4-4d47-abd3-054ef9a16d3c req-d42054ff-2253-464d-8e8b-04b39ecc8c37 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:55.918420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a0c455f2-b0c4-4d47-abd3-054ef9a16d3c req-d42054ff-2253-464d-8e8b-04b39ecc8c37 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:55.919234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a0c455f2-b0c4-4d47-abd3-054ef9a16d3c req-d42054ff-2253-464d-8e8b-04b39ecc8c37 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:55.944272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a0c455f2-b0c4-4d47-abd3-054ef9a16d3c req-d42054ff-2253-464d-8e8b-04b39ecc8c37 service nova] Creating event network-changed:dc433c9d-5334-41b5-a218-843703c8a5b3 for instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc on n-h2-858383-16 Oct 27 10:22:55.950014 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [req-a0c455f2-b0c4-4d47-abd3-054ef9a16d3c req-d42054ff-2253-464d-8e8b-04b39ecc8c37 service nova] [f29c3a8b-d8ce-40cc-a75f-60b51c592961] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:22:56.956832 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [req-a0c455f2-b0c4-4d47-abd3-054ef9a16d3c req-d42054ff-2253-464d-8e8b-04b39ecc8c37 service nova] [f29c3a8b-d8ce-40cc-a75f-60b51c592961] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40384. Oct 27 10:22:56.962647 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a0c455f2-b0c4-4d47-abd3-054ef9a16d3c req-d42054ff-2253-464d-8e8b-04b39ecc8c37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.145481 Oct 27 10:22:56.964071 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3870/7665] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:57.181512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:57.182552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:57.191789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.192582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.193343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:57.194307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.195082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.196108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:57.330402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lazy-loading 'services' on Instance uuid 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:22:57.444481 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-da11b2ac-e6a5-4bfe-ab89-305b8b7690fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments/be01f191-75ec-4c39-850e-746348b4f5d9" status: 202 len: 0 microversion: 2.1 time: 0.272725 Oct 27 10:22:57.445445 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3796/7666] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:22:57 2022] DELETE /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments/be01f191-75ec-4c39-850e-746348b4f5d9 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:22:57.455978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-adedd68f-543d-4561-b896-3c9e5350dd40 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:57.459030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-adedd68f-543d-4561-b896-3c9e5350dd40 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:57.467866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedd68f-543d-4561-b896-3c9e5350dd40 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.468375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedd68f-543d-4561-b896-3c9e5350dd40 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.469087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedd68f-543d-4561-b896-3c9e5350dd40 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:57.469848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedd68f-543d-4561-b896-3c9e5350dd40 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:57.470516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedd68f-543d-4561-b896-3c9e5350dd40 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:57.471046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-adedd68f-543d-4561-b896-3c9e5350dd40 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:57.520951 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-adedd68f-543d-4561-b896-3c9e5350dd40 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068994 Oct 27 10:22:57.522508 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3871/7667] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:22:57 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:22:58.535717 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5404d198-995b-4879-b3ab-77b74de20e4d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:58.538395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5404d198-995b-4879-b3ab-77b74de20e4d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:58.547344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5404d198-995b-4879-b3ab-77b74de20e4d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.548167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5404d198-995b-4879-b3ab-77b74de20e4d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.548812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5404d198-995b-4879-b3ab-77b74de20e4d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.549728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5404d198-995b-4879-b3ab-77b74de20e4d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:58.550373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5404d198-995b-4879-b3ab-77b74de20e4d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:58.550973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5404d198-995b-4879-b3ab-77b74de20e4d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:58.592057 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5404d198-995b-4879-b3ab-77b74de20e4d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061058 Oct 27 10:22:58.597557 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3797/7668] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:22:58 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:59.030664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2c3cc80d-9ab0-4159-b6b3-4efda0e4002f req-d0cf9c20-08bf-46a4-a3ca-da523fa545e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664a96cd-3b7c-4f38-afb4-74ba57e6dbfc", "tag": "dc433c9d-5334-41b5-a218-843703c8a5b3"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:22:59.045542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2c3cc80d-9ab0-4159-b6b3-4efda0e4002f req-d0cf9c20-08bf-46a4-a3ca-da523fa545e7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.046196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2c3cc80d-9ab0-4159-b6b3-4efda0e4002f req-d0cf9c20-08bf-46a4-a3ca-da523fa545e7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.046709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2c3cc80d-9ab0-4159-b6b3-4efda0e4002f req-d0cf9c20-08bf-46a4-a3ca-da523fa545e7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.062741 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2c3cc80d-9ab0-4159-b6b3-4efda0e4002f req-d0cf9c20-08bf-46a4-a3ca-da523fa545e7 service nova] Creating event network-changed:dc433c9d-5334-41b5-a218-843703c8a5b3 for instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc on n-h2-858383-16 Oct 27 10:22:59.068513 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2c3cc80d-9ab0-4159-b6b3-4efda0e4002f req-d0cf9c20-08bf-46a4-a3ca-da523fa545e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045182 Oct 27 10:22:59.069529 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3872/7669] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:22:59.605756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-692bbb1b-87c8-477f-a672-749e376687d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:22:59.609072 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-692bbb1b-87c8-477f-a672-749e376687d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:22:59.616577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-692bbb1b-87c8-477f-a672-749e376687d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.617175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-692bbb1b-87c8-477f-a672-749e376687d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.617706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-692bbb1b-87c8-477f-a672-749e376687d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.618494 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-692bbb1b-87c8-477f-a672-749e376687d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:22:59.619055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-692bbb1b-87c8-477f-a672-749e376687d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:22:59.619553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-692bbb1b-87c8-477f-a672-749e376687d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:22:59.653670 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-692bbb1b-87c8-477f-a672-749e376687d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052491 Oct 27 10:22:59.658791 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3798/7670] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:22:59 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:23:00.669024 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34c22036-efd9-465b-9255-91c9f3862243 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:00.671444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-34c22036-efd9-465b-9255-91c9f3862243 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:00.678761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34c22036-efd9-465b-9255-91c9f3862243 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.679261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34c22036-efd9-465b-9255-91c9f3862243 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.679761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34c22036-efd9-465b-9255-91c9f3862243 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.680511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34c22036-efd9-465b-9255-91c9f3862243 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:00.680960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34c22036-efd9-465b-9255-91c9f3862243 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:00.681979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34c22036-efd9-465b-9255-91c9f3862243 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:00.715310 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34c22036-efd9-465b-9255-91c9f3862243 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052382 Oct 27 10:23:00.715938 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3873/7671] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:23:00 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:23:01.729308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-caa75b9c-d480-4a36-8ffb-d7e4ed6dd859 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:01.731621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-caa75b9c-d480-4a36-8ffb-d7e4ed6dd859 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:01.739744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caa75b9c-d480-4a36-8ffb-d7e4ed6dd859 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:01.740235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caa75b9c-d480-4a36-8ffb-d7e4ed6dd859 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:01.740677 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caa75b9c-d480-4a36-8ffb-d7e4ed6dd859 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:01.741385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caa75b9c-d480-4a36-8ffb-d7e4ed6dd859 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:01.741840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caa75b9c-d480-4a36-8ffb-d7e4ed6dd859 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:01.742260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caa75b9c-d480-4a36-8ffb-d7e4ed6dd859 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:01.775816 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-caa75b9c-d480-4a36-8ffb-d7e4ed6dd859 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050709 Oct 27 10:23:01.776329 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3799/7672] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:23:01 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:02.788761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bb4b267a-0491-4eb0-8332-827187126c98 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:02.791628 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bb4b267a-0491-4eb0-8332-827187126c98 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:02.799662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb4b267a-0491-4eb0-8332-827187126c98 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.800271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb4b267a-0491-4eb0-8332-827187126c98 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.800722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb4b267a-0491-4eb0-8332-827187126c98 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.801442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb4b267a-0491-4eb0-8332-827187126c98 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.801910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb4b267a-0491-4eb0-8332-827187126c98 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.802351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bb4b267a-0491-4eb0-8332-827187126c98 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.836441 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bb4b267a-0491-4eb0-8332-827187126c98 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051734 Oct 27 10:23:02.837047 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3874/7673] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:23:02 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:23:02.848555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:02.849816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:02.858489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.859041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.859523 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.860426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:02.860941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:02.861418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:02.951601 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] HTTP exception thrown: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc is not attached to volume be01f191-75ec-4c39-850e-746348b4f5d9 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Request method failure captured: Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments/be01f191-75ec-4c39-850e-746348b4f5d9 HTTP/1.1 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlrkEppyidVmAFZtlIHdS8nh59yxidml1uE1YDObuOOc-mOQUcOYNCsyW2bN05Oi9xqPYYIJiI7VadiYg2S4mD-RMz9eKNa3BLfOxXpEAIxczz3cfLSNwBHsXhH5kX7x7ziDDaFW8JpdiK9mIzQ5N6Yj0FKsICnxwxYHVNd8RhXNnJI Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d9ea863582054435900efb4cd7710657 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9ea863582054435900efb4cd7710657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9ea863582054435900efb4cd7710657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9ea863582054435900efb4cd7710657"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9ea863582054435900efb4cd7710657"}]}] Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d9ea863582054435900efb4cd7710657 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestMinimumBasicScenario-1671759918-project Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a5adbe51af8455ea27b847eb8d9b134 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestMinimumBasicScenario-1671759918-project Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc is not attached to volume be01f191-75ec-4c39-850e-746348b4f5d9 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': '664a96cd-3b7c-4f38-afb4-74ba57e6dbfc', 'id': 'be01f191-75ec-4c39-850e-746348b4f5d9'} Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id be01f191-75ec-4c39-850e-746348b4f5d9. Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc is not attached to volume be01f191-75ec-4c39-850e-746348b4f5d9 Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:02.953663 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:02.958113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:23:02.958113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:23:02.958113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc is not attached to volume be01f191-75ec-4c39-850e-746348b4f5d9 Oct 27 10:23:02.958113 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:02.958113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Returning 404 to user: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc is not attached to volume be01f191-75ec-4c39-850e-746348b4f5d9 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:23:02.958113 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ff927ba-3235-4295-a64d-7ad1f9d35670 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments/be01f191-75ec-4c39-850e-746348b4f5d9" status: 404 len: 154 microversion: 2.1 time: 0.111507 Oct 27 10:23:02.958113 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3800/7674] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:23:02 2022] DELETE /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc/os-volume_attachments/be01f191-75ec-4c39-850e-746348b4f5d9 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:23:06.243719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:06.244442 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:06.251425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:06.251972 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:06.252426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:06.253145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:06.253613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:06.254054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:06.282488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:23:06.378885 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-15703d8a-fd3c-4a06-b35c-4227b0d32316 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 204 len: 0 microversion: 2.1 time: 0.138731 Oct 27 10:23:06.379506 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3875/7675] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:23:06 2022] DELETE /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:23:06.388345 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:06.388967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:06.396931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:06.397426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:06.397868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:06.398580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:06.399046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:06.399478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:06.563204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:06.572560 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2037de25-bb50-48e6-b2fa-9c8598fb67bd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1552 microversion: 2.1 time: 0.187512 Oct 27 10:23:06.573166 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3801/7676] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:06 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:07.597733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:07.598481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:07.606394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:07.606950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:07.607433 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:07.608269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:07.608737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:07.609175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:07.762920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:07.771661 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-748d9bc2-bb89-4989-a80b-260a3093e73a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1552 microversion: 2.1 time: 0.178364 Oct 27 10:23:07.772261 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3876/7677] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:07 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1552 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:08.685450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b7b0cf55-44f8-4ac2-b6aa-7bc0059a5ae7 req-c21dcc32-e952-415e-b484-7cd9cc50d571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664a96cd-3b7c-4f38-afb4-74ba57e6dbfc", "name": "network-vif-deleted", "tag": "dc433c9d-5334-41b5-a218-843703c8a5b3"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:08.697483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b7b0cf55-44f8-4ac2-b6aa-7bc0059a5ae7 req-c21dcc32-e952-415e-b484-7cd9cc50d571 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.698067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b7b0cf55-44f8-4ac2-b6aa-7bc0059a5ae7 req-c21dcc32-e952-415e-b484-7cd9cc50d571 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.698508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b7b0cf55-44f8-4ac2-b6aa-7bc0059a5ae7 req-c21dcc32-e952-415e-b484-7cd9cc50d571 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.711025 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b7b0cf55-44f8-4ac2-b6aa-7bc0059a5ae7 req-c21dcc32-e952-415e-b484-7cd9cc50d571 service nova] Creating event network-vif-deleted:dc433c9d-5334-41b5-a218-843703c8a5b3 for instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc on n-h2-858383-16 Oct 27 10:23:08.717026 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b7b0cf55-44f8-4ac2-b6aa-7bc0059a5ae7 req-c21dcc32-e952-415e-b484-7cd9cc50d571 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035671 Oct 27 10:23:08.717647 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3802/7678] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:08.801684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:08.802468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:08.810091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.810600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.811066 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.811820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.812297 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.812743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.846001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:08.846428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:08.846884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:08.847356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lazy-loading 'fault' on Instance uuid 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:23:08.891337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:08.900600 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e200b675-0a45-40e0-9a29-c9743677d719 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 200 len: 1346 microversion: 2.1 time: 0.106881 Oct 27 10:23:08.901148 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3877/7679] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:08 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:09.932921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:09.933674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:09.940010 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:09.940504 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:09.940949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:09.941661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:09.942124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:09.942558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:09.956748 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] HTTP exception thrown: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc could not be found. Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Request method failure captured: Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc HTTP/1.1 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlrkEppyidVmAFZtlIHdS8nh59yxidml1uE1YDObuOOc-mOQUcOYNCsyW2bN05Oi9xqPYYIJiI7VadiYg2S4mD-RMz9eKNa3BLfOxXpEAIxczz3cfLSNwBHsXhH5kX7x7ziDDaFW8JpdiK9mIzQ5N6Yj0FKsICnxwxYHVNd8RhXNnJI Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d9ea863582054435900efb4cd7710657 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9ea863582054435900efb4cd7710657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9ea863582054435900efb4cd7710657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9ea863582054435900efb4cd7710657"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9ea863582054435900efb4cd7710657"}]}] Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d9ea863582054435900efb4cd7710657 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestMinimumBasicScenario-1671759918-project Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a5adbe51af8455ea27b847eb8d9b134 Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestMinimumBasicScenario-1671759918-project Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc could not be found. Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '664a96cd-3b7c-4f38-afb4-74ba57e6dbfc'} Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc could not be found. Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc could not be found. Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:23:09.958400 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc could not be found. Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Returning 404 to user: Instance 664a96cd-3b7c-4f38-afb4-74ba57e6dbfc could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b73509e1-6f9e-46f9-9036-afa2f96021ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc" status: 404 len: 111 microversion: 2.1 time: 0.033079 Oct 27 10:23:09.963194 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3803/7680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:09 2022] GET /compute/v2.1/servers/664a96cd-3b7c-4f38-afb4-74ba57e6dbfc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:23:09.969029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7540c670-24ec-4599-ad8f-8b940cb3428a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '.version_select at 0x7f319874c430>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:09.992735 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7540c670-24ec-4599-ad8f-8b940cb3428a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1626563021" status: 202 len: 0 microversion: 2.1 time: 0.027683 Oct 27 10:23:09.993419 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3878/7681] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Oct 27 10:23:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1626563021 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:23:19.321247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-91a718f8-c878-4b5d-b316-bd6cf463218b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'create', calling method: .version_select at 0x7f31aa79cee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-73629902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGTMMhCpzyvmJqE5+ECDOuuaHcTOnqiydNmjfjt5/rgK9E05zY2XezNV3d0P+D40N8l938fV+k3ZPCQUWjhMkZfWeCY+DMP2s870keQTXpgfThGPXNiUCAOHVBVZb/0dA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:19.338923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-91a718f8-c878-4b5d-b316-bd6cf463218b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Getting quotas for project d9ea863582054435900efb4cd7710657. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:23:19.344608 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-91a718f8-c878-4b5d-b316-bd6cf463218b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Getting quotas for user 0a5adbe51af8455ea27b847eb8d9b134 and project d9ea863582054435900efb4cd7710657. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:23:19.370580 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-91a718f8-c878-4b5d-b316-bd6cf463218b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.099952 Oct 27 10:23:19.371199 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3804/7682] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:23:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:19.425341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:19.429608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1017795240", "imageRef": "4759022b-2ca2-44ae-b743-182ea03da120", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-73629902", "networks": [{"uuid": "f7488c1e-9165-4d02-9a73-db16be6593c3"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:19.482364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] validate_networks() for [('f7488c1e-9165-4d02-9a73-db16be6593c3', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:23:19.854004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:23:19.854345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:23:19.854824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:23:19.855241 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:23:19.855690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:23:19.864392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:19.864880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:19.865323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:19.866050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:19.866511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:19.866945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:19.888277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Getting quotas for project d9ea863582054435900efb4cd7710657. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:23:19.893431 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Getting quotas for user 0a5adbe51af8455ea27b847eb8d9b134 and project d9ea863582054435900efb4cd7710657. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:23:19.905468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:23:19.907723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4759022b-2ca2-44ae-b743-182ea03da120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:23:19.954072 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-da685a29-095d-4e5a-8fce-a7a01688267b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530571 Oct 27 10:23:19.961275 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3879/7683] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:23:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:23:19.964114 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:19.969153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-065ae6ab-0be6-4b1e-b815-e83c0900a6fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:19.970467 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-065ae6ab-0be6-4b1e-b815-e83c0900a6fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:20.031643 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-065ae6ab-0be6-4b1e-b815-e83c0900a6fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:20.038564 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-065ae6ab-0be6-4b1e-b815-e83c0900a6fe tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1257 microversion: 2.1 time: 0.075777 Oct 27 10:23:20.039491 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3805/7684] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:19 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1257 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:21.063116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:21.064432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:21.070515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:21.071016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:21.071471 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:21.072742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:21.073212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:21.073649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:21.154668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:21.162506 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4fb29820-e066-497c-9425-0e1e5c7fab52 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1327 microversion: 2.1 time: 0.104365 Oct 27 10:23:21.164828 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3880/7685] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:21 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:22.189846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:22.190469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:22.198711 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:22.199201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:22.199670 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:22.200373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:22.200829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:22.201253 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:22.366455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:22.375291 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a793912-45ad-4fc1-92d6-ec5adc45fc31 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.192473 Oct 27 10:23:22.375928 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3806/7686] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:22 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:23.398244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:23.399743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:23.408987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:23.409509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:23.409969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:23.410709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:23.411181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:23.411674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:23.561235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:23.569982 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1fa14988-4115-4565-840b-1a437b21f2d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.175446 Oct 27 10:23:23.570582 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3881/7687] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:23 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:24.596712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:24.600285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:24.609660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:24.610317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:24.610820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:24.611433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:24.612144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:24.612959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:24.764009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:24.772140 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54946d2a-4afd-4cf4-8d65-a306092882d3 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.180831 Oct 27 10:23:24.772749 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3807/7688] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:24 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:25.798753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:25.805996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:25.809683 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:23:25.811851 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:23:25.815619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:25.816441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:25.816900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:25.817742 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:25.818119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:25.818636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:25.980244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:25.992259 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6f88ae85-627a-49ac-bbc7-fa6e10d8a917 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.199586 Oct 27 10:23:25.993464 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3882/7689] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:25 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:27.016697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:27.017332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:27.020007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:27.025243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:27.025727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:27.026182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:27.027044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:27.028212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:27.028212 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:27.178042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:27.186797 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-baeac8e5-c226-40e2-b8c0-db9f511ba0aa tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.173850 Oct 27 10:23:27.187383 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3808/7690] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:27 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:28.210144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:28.210772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:28.214543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:28.225472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:28.225982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:28.226437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:28.227161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:28.227666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:28.228629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:28.240432 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40596. Oct 27 10:23:28.253083 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40598. Oct 27 10:23:28.371845 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:28.379615 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c59f36a0-7c39-424e-93e3-7c164f5a5b49 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.173352 Oct 27 10:23:28.380186 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3883/7691] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:28 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:29.402768 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:29.403383 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:29.410397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:29.410886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:29.411329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:29.412058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:29.412516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:29.412944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:29.539680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:29.547365 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b591659-2943-4618-b409-f2b8cc70491c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.148576 Oct 27 10:23:29.547969 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3809/7692] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:29 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:30.573740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:30.574357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:30.577455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:30.578147 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:30.583905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:30.584558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:30.585083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:30.585604 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:30.586119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:30.586603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:30.724930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:30.732656 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-44a72559-bf86-45bb-8f66-7f4b284bfde5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.163413 Oct 27 10:23:30.733233 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3884/7693] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:30 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:31.755380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:31.756020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:31.757857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:31.764466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:31.764951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:31.765396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:31.766089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:31.766546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:31.766977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:31.894859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:31.902591 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abcb59d3-aeda-4aeb-b22c-293347ff540d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.151179 Oct 27 10:23:31.903161 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3810/7694] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:31 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:32.925163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:32.925893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:32.932634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:32.933128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:32.933586 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:32.934508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:32.935233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:32.935613 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:33.067078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:33.075411 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e28c550d-98eb-4ea8-8b09-2c2cd63118b9 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.154198 Oct 27 10:23:33.076012 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3885/7695] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:32 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:34.053069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-511383ae-bdb8-4a9f-91ad-0e6c25d244b4 req-dfe4c105-ec97-4150-8eab-36c10a243c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca12483e-b673-41aa-8d47-1a9b212acdf3", "tag": "1960820b-a668-42ec-95ff-f246dd878f08"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:34.064959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-511383ae-bdb8-4a9f-91ad-0e6c25d244b4 req-dfe4c105-ec97-4150-8eab-36c10a243c80 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:34.065448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-511383ae-bdb8-4a9f-91ad-0e6c25d244b4 req-dfe4c105-ec97-4150-8eab-36c10a243c80 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:34.065892 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-511383ae-bdb8-4a9f-91ad-0e6c25d244b4 req-dfe4c105-ec97-4150-8eab-36c10a243c80 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:34.077911 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-511383ae-bdb8-4a9f-91ad-0e6c25d244b4 req-dfe4c105-ec97-4150-8eab-36c10a243c80 service nova] Creating event network-changed:1960820b-a668-42ec-95ff-f246dd878f08 for instance ca12483e-b673-41aa-8d47-1a9b212acdf3 on n-h1-858383-16 Oct 27 10:23:34.083034 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-511383ae-bdb8-4a9f-91ad-0e6c25d244b4 req-dfe4c105-ec97-4150-8eab-36c10a243c80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033769 Oct 27 10:23:34.083834 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3811/7696] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:34.098513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:34.099145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:34.106033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:34.106591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:34.107052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:34.107802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:34.108269 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:34.108709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:34.324042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:34.332464 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fdcd117e-9c11-4520-9874-13a03bf0c6d6 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.237787 Oct 27 10:23:34.333098 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3886/7697] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:34 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:35.357364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:35.357997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:35.364183 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.364665 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.365105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.365798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:35.366255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:35.366685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:35.496224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:35.504228 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11ffb39a-a341-4fe6-a91d-d1dc682e3a09 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.152094 Oct 27 10:23:35.504818 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3812/7698] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:35 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:36.528464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:36.529084 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:36.536671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:36.537174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:36.537680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:36.538445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:36.539096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:36.539537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:36.707260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:36.715081 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c81848e-7de4-418d-9f63-81762541a164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.191162 Oct 27 10:23:36.715887 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3887/7699] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:36 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:37.738346 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:37.738950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:37.745941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:37.746548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:37.747137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:37.747868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:37.748486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:37.748738 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:37.887120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:37.894790 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ce51645-34e7-469b-b4d2-9eb456a209ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.160453 Oct 27 10:23:37.895370 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3813/7700] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:37 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:38.917321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:38.917952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:38.924796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:38.925291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:38.925744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:38.926453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:38.926935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:38.927358 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:39.057756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:39.065780 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1095430-8581-40a7-a263-33731bba7ff7 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.152487 Oct 27 10:23:39.066358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3888/7701] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:38 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:40.088902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:40.089491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:40.096928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:40.097419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:40.097860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:40.098569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:40.099057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:40.099485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:40.230262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:40.237968 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-13732e77-c779-45c6-a79a-962707fc7fbb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.153516 Oct 27 10:23:40.238545 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3814/7702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:40 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:41.239881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-0a02076f-7693-4d55-be80-0911bfba5d62 req-c3afc442-c6d4-403f-ae29-7ff911327ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca12483e-b673-41aa-8d47-1a9b212acdf3", "name": "network-vif-plugged", "status": "completed", "tag": "1960820b-a668-42ec-95ff-f246dd878f08"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:41.250489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0a02076f-7693-4d55-be80-0911bfba5d62 req-c3afc442-c6d4-403f-ae29-7ff911327ca9 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.250984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0a02076f-7693-4d55-be80-0911bfba5d62 req-c3afc442-c6d4-403f-ae29-7ff911327ca9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.251678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-0a02076f-7693-4d55-be80-0911bfba5d62 req-c3afc442-c6d4-403f-ae29-7ff911327ca9 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.260871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:41.261640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:41.263748 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-0a02076f-7693-4d55-be80-0911bfba5d62 req-c3afc442-c6d4-403f-ae29-7ff911327ca9 service nova] Creating event network-vif-plugged:1960820b-a668-42ec-95ff-f246dd878f08 for instance ca12483e-b673-41aa-8d47-1a9b212acdf3 on n-h1-858383-16 Oct 27 10:23:41.268956 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-0a02076f-7693-4d55-be80-0911bfba5d62 req-c3afc442-c6d4-403f-ae29-7ff911327ca9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032833 Oct 27 10:23:41.269748 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3889/7703] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:41.271459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.271714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.272530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.273446 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:41.274192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:41.275349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:41.478211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:41.485893 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35d2d82c-1e1b-48a3-a6c2-9d01785a3eeb tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.229472 Oct 27 10:23:41.486470 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3815/7704] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:41 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:42.511213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:42.511980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:42.518207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:42.518699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:42.519149 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:42.519891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:42.520366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:42.520809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:42.652638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:42.661301 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd01d930-fb13-4153-a6a6-b16e82068398 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1357 microversion: 2.1 time: 0.155729 Oct 27 10:23:42.661881 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3890/7705] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:42 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:43.684343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:43.684912 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:43.691719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.692202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.692642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.693339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.693790 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.694216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.825142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:43.832837 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ad34959-4dee-41e1-944e-07775ecdadef tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1547 microversion: 2.1 time: 0.152594 Oct 27 10:23:43.833413 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3816/7706] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:43 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:43.855948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:43.856576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:43.863279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.863823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.864282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.864984 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:43.865460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:43.865899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:43.993734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:44.001404 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a5857a59-53c8-4f66-a668-9d7c92dd21dd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1547 microversion: 2.1 time: 0.149900 Oct 27 10:23:44.001974 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3891/7707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:43 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:44.023487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:44.029047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:44.029826 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Searching by: {'deleted': False, 'project_id': 'd9ea863582054435900efb4cd7710657'} {{(pid=120603) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 10:23:44.035273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.035800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.036275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.036999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.037459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.037886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.061210 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.multi_cell_list [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120603) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 10:23:44.088591 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cba1dab1-35cd-4ddf-99f2-89f33e88772d tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068973 Oct 27 10:23:44.089184 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3817/7708] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Oct 27 10:23:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:44.101081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:44.101691 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:44.107771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.108262 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.108706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.109399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:44.109858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:44.110292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:44.239991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:44.247723 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-13502ed2-01a2-4dd1-86c9-81df549aae39 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1547 microversion: 2.1 time: 0.150455 Oct 27 10:23:44.248284 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3892/7709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:44 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:23:45.778450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-25a21bcd-7ec1-49cf-8c9b-d953fb9253bf tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b5ff986-0702-487c-8270-2735fadf3cd8"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:45.780897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-25a21bcd-7ec1-49cf-8c9b-d953fb9253bf tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:45.787840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a21bcd-7ec1-49cf-8c9b-d953fb9253bf tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:45.788330 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a21bcd-7ec1-49cf-8c9b-d953fb9253bf tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:45.788773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a21bcd-7ec1-49cf-8c9b-d953fb9253bf tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:45.789469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a21bcd-7ec1-49cf-8c9b-d953fb9253bf tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:45.789936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a21bcd-7ec1-49cf-8c9b-d953fb9253bf tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:45.790412 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-25a21bcd-7ec1-49cf-8c9b-d953fb9253bf tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:46.026638 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-25a21bcd-7ec1-49cf-8c9b-d953fb9253bf tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252624 Oct 27 10:23:46.027267 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3818/7710] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Oct 27 10:23:45 2022] POST /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:23:56.828690 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:23:56.829343 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:23:56.832371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=19 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:56.833078 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=76 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:56.839591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.840100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.840553 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.841284 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:56.841754 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:56.842457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:56.989618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:23:56.998435 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1dc94bb-fac3-48da-a986-e3339c5b718c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1593 microversion: 2.1 time: 0.173596 Oct 27 10:23:56.999037 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3893/7711] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:23:56 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1593 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:23:58.997358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:58.998808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=21 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:58.999589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:23:59.005187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1474b54b-f2c8-4e84-ab58-755c1e705984 req-f2178668-088b-4a9a-8690-655791d7d17e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca12483e-b673-41aa-8d47-1a9b212acdf3", "tag": "1960820b-a668-42ec-95ff-f246dd878f08"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:23:59.018945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1474b54b-f2c8-4e84-ab58-755c1e705984 req-f2178668-088b-4a9a-8690-655791d7d17e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:23:59.019559 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1474b54b-f2c8-4e84-ab58-755c1e705984 req-f2178668-088b-4a9a-8690-655791d7d17e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:23:59.020096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1474b54b-f2c8-4e84-ab58-755c1e705984 req-f2178668-088b-4a9a-8690-655791d7d17e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:23:59.036825 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1474b54b-f2c8-4e84-ab58-755c1e705984 req-f2178668-088b-4a9a-8690-655791d7d17e service nova] Creating event network-changed:1960820b-a668-42ec-95ff-f246dd878f08 for instance ca12483e-b673-41aa-8d47-1a9b212acdf3 on n-h1-858383-16 Oct 27 10:23:59.043021 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1474b54b-f2c8-4e84-ab58-755c1e705984 req-f2178668-088b-4a9a-8690-655791d7d17e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047763 Oct 27 10:23:59.044232 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3819/7712] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:00.297558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-573272657"}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:00.298140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:00.322765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.323325 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.323865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.324943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:00.325421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:00.325873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:00.740974 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.network.security_group_api [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Adding security group fdd37686-389f-410d-a005-83415b60a892 to port 1960820b-a668-42ec-95ff-f246dd878f08 Oct 27 10:24:01.087453 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-74d197f1-edff-4105-9fef-e2c3eb071592 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/action" status: 202 len: 0 microversion: 2.1 time: 0.793096 Oct 27 10:24:01.092540 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3894/7713] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:24:00 2022] POST /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:24:01.097393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-38ab78af-f949-44fc-814f-ea6be7ec9751 req-931f75f2-811e-4983-8ab9-1ed8984791fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca12483e-b673-41aa-8d47-1a9b212acdf3", "tag": "1960820b-a668-42ec-95ff-f246dd878f08"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:24:01.101452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:24:01.103617 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:24:01.109859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-38ab78af-f949-44fc-814f-ea6be7ec9751 req-931f75f2-811e-4983-8ab9-1ed8984791fd service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:01.110654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-38ab78af-f949-44fc-814f-ea6be7ec9751 req-931f75f2-811e-4983-8ab9-1ed8984791fd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:01.111263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-38ab78af-f949-44fc-814f-ea6be7ec9751 req-931f75f2-811e-4983-8ab9-1ed8984791fd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:01.115728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:01.117291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:01.118595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:01.120252 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:24:01.121345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:24:01.122405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:24:01.123437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-38ab78af-f949-44fc-814f-ea6be7ec9751 req-931f75f2-811e-4983-8ab9-1ed8984791fd service nova] Creating event network-changed:1960820b-a668-42ec-95ff-f246dd878f08 for instance ca12483e-b673-41aa-8d47-1a9b212acdf3 on n-h1-858383-16 Oct 27 10:24:01.128901 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-38ab78af-f949-44fc-814f-ea6be7ec9751 req-931f75f2-811e-4983-8ab9-1ed8984791fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036624 Oct 27 10:24:01.129787 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3820/7714] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:24:01.423220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:24:01.432927 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a6a9c16-c2c1-4a0f-ad29-91f72a013535 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1758 microversion: 2.1 time: 0.339053 Oct 27 10:24:01.437825 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3895/7715] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:24:01 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1758 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:01.966167 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:01.966987 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:01.968310 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:25:01.968507 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/action (ip 10.222.0.25) !!! Oct 27 10:25:01.976261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2fd74c44-1300-45f1-8940-a0ce640d8772 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:25:01.978585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2fd74c44-1300-45f1-8940-a0ce640d8772 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:01.988602 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd74c44-1300-45f1-8940-a0ce640d8772 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.989093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd74c44-1300-45f1-8940-a0ce640d8772 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.989538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd74c44-1300-45f1-8940-a0ce640d8772 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:01.990240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd74c44-1300-45f1-8940-a0ce640d8772 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:01.990703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd74c44-1300-45f1-8940-a0ce640d8772 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:01.991135 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2fd74c44-1300-45f1-8940-a0ce640d8772 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:02.066233 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2fd74c44-1300-45f1-8940-a0ce640d8772 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/action" status: 202 len: 0 microversion: 2.1 time: 0.103036 Oct 27 10:25:02.066916 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3821/7716] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:25:01 2022] POST /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:25:02.076596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:02.077230 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:02.079220 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:02.079911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=16 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:25:02.086770 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:02.087282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:02.087777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:02.088507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:02.088976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:02.089422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:02.409364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:02.417854 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc8fd0b5-33e0-4273-b881-c2eff10b8a2c tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1750 microversion: 2.1 time: 0.346646 Oct 27 10:25:02.418958 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3896/7717] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:02 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1750 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:03.442263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:03.442962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:03.449154 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.450147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.450582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.451272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:03.451750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:03.452179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:03.655454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:03.663691 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-84a6e6d8-76b2-4f13-94e1-d85f8a07ea07 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.226627 Oct 27 10:25:03.664255 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3822/7718] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:03 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:04.687840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:04.688451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:04.695375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.695904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.696362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.697067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:04.697540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:04.697976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:04.844500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:04.853200 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-84a0d658-e2e7-47c1-9653-7a502df4ff66 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.169211 Oct 27 10:25:04.853678 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3897/7719] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:04 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:05.877505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:05.878153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:05.884968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.885458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.885907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:05.886600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:05.887061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:05.887492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:06.032478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:06.040732 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59ecb70d-97bc-4645-95c7-66e73dbde378 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.167222 Oct 27 10:25:06.041302 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3823/7720] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:05 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:07.065268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:07.065953 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:07.072047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:07.072560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:07.073016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:07.073735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:07.074206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:07.074648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:07.216995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:07.225673 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-30995e86-0be2-4d59-9a23-376b4018c49a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.165861 Oct 27 10:25:07.226239 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3898/7721] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:07 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:08.249726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:08.250286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:08.256997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:08.257481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:08.257923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:08.258610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:08.259063 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:08.259486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:08.403022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:08.411540 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92c11ad9-0d5a-451f-8158-f5bfe65a6b82 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.166267 Oct 27 10:25:08.412155 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3824/7722] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:08 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:09.436289 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:09.436915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:09.443708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:09.444210 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:09.444664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:09.445365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:09.445834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:09.446273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:09.592470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:09.601321 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2f373294-7714-4dbf-b3aa-ce33f4e242e1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.169091 Oct 27 10:25:09.601887 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3899/7723] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:09 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:10.623927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:10.624509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:10.639836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:10.640327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:10.640762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:10.641472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:10.641928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:10.642353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:10.787064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:10.795790 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7594c91e-e997-4f1a-82d2-0543d0c0a872 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.175920 Oct 27 10:25:10.796372 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3825/7724] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:10 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:11.820035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:11.820658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:11.827530 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:11.828129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:11.828581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:11.829282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:11.829751 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:11.830189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:11.980632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:11.990923 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-58d241bc-9aad-44a7-9efa-d0156497092a tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.174767 Oct 27 10:25:11.991515 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3900/7725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:11 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:25:13.014599 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:13.015217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:13.022407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:13.022897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:13.023338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:13.024056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:13.024512 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:13.024935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:13.169527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:13.178311 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e621a04-e4a4-4e5c-a1aa-783a32f612ee tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.167705 Oct 27 10:25:13.178880 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3826/7726] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:13 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:14.203187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:14.203769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:14.210560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:14.211053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:14.211501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:14.212246 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:14.212707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:14.213142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:14.358506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:14.366646 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-354e5422-c518-4b08-b772-f44e37f79c9b tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.168128 Oct 27 10:25:14.367216 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3901/7727] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:14 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:15.390882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:15.391487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:15.398334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:15.398814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:15.399255 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:15.399977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:15.400433 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:15.400856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:15.544194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:15.554515 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec3293fb-aa0c-4ce6-9488-d5313ddb2fcd tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.168074 Oct 27 10:25:15.555099 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3827/7728] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:15 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:16.578391 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:16.579018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:16.585903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:16.586342 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:16.586794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:16.587503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:16.588001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:16.588439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:16.729793 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:16.738174 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4872f95c-ab98-421e-8a47-5e2bd8617697 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.164207 Oct 27 10:25:16.738746 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3902/7729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:16 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:17.761615 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:17.762151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:17.769617 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:17.770110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:17.770546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:17.771247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:17.771736 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:17.772160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:18.225886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:18.234819 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-afd5d1b6-a939-4925-b45d-bc5c8971d010 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1755 microversion: 2.1 time: 0.477214 Oct 27 10:25:18.235404 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3828/7730] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:17 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1755 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:25:19.258350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:25:19.258985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:25:19.266398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:19.266903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:19.267359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:19.268105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:25:19.268584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:25:19.269031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:25:19.414472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:25:19.422858 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f8f683eb-e080-479f-8f48-4396bf234eb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1758 microversion: 2.1 time: 0.168456 Oct 27 10:25:19.423426 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3903/7731] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:25:19 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:22.770155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=16 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:22.770852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:22.775771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-573272657"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:22.776313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:22.784832 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:22.785331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:22.785776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:22.786485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:22.786945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:22.787379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:22.925456 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.network.security_group_api [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Removing security group fdd37686-389f-410d-a005-83415b60a892 from port 1960820b-a668-42ec-95ff-f246dd878f08 Oct 27 10:26:23.253117 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-608f4011-5a84-472a-8d31-b0e8e38b40d0 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "POST /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/action" status: 202 len: 0 microversion: 2.1 time: 0.485629 Oct 27 10:26:23.258665 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3829/7732] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:26:22 2022] POST /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:23.262469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=16 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:23.263435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=48 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:23.267397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6899e494-5218-40ff-94ac-b52103144c12 req-c1d3119e-5d10-4c29-afc3-5e26ac8f0712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca12483e-b673-41aa-8d47-1a9b212acdf3", "tag": "1960820b-a668-42ec-95ff-f246dd878f08"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:23.278439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6899e494-5218-40ff-94ac-b52103144c12 req-c1d3119e-5d10-4c29-afc3-5e26ac8f0712 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:23.278940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6899e494-5218-40ff-94ac-b52103144c12 req-c1d3119e-5d10-4c29-afc3-5e26ac8f0712 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:23.279383 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6899e494-5218-40ff-94ac-b52103144c12 req-c1d3119e-5d10-4c29-afc3-5e26ac8f0712 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:23.292603 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6899e494-5218-40ff-94ac-b52103144c12 req-c1d3119e-5d10-4c29-afc3-5e26ac8f0712 service nova] Creating event network-changed:1960820b-a668-42ec-95ff-f246dd878f08 for instance ca12483e-b673-41aa-8d47-1a9b212acdf3 on n-h1-858383-16 Oct 27 10:26:23.295956 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [req-6899e494-5218-40ff-94ac-b52103144c12 req-c1d3119e-5d10-4c29-afc3-5e26ac8f0712 service nova] [f29c3a8b-d8ce-40cc-a75f-60b51c592961] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:26:24.304118 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [req-6899e494-5218-40ff-94ac-b52103144c12 req-c1d3119e-5d10-4c29-afc3-5e26ac8f0712 service nova] [f29c3a8b-d8ce-40cc-a75f-60b51c592961] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40810. Oct 27 10:26:24.309498 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6899e494-5218-40ff-94ac-b52103144c12 req-c1d3119e-5d10-4c29-afc3-5e26ac8f0712 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.048539 Oct 27 10:26:24.310328 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3904/7733] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:24.379034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:24.381075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:24.388386 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:24.389108 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:24.389735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:24.390638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:24.391290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:24.392602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:24.433016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3d1a1fab-9b33-45a1-b875-180cb388b952 req-1feb2477-7f4f-4c9d-a3b6-98163f6cb2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca12483e-b673-41aa-8d47-1a9b212acdf3", "tag": "1960820b-a668-42ec-95ff-f246dd878f08"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:24.445382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3d1a1fab-9b33-45a1-b875-180cb388b952 req-1feb2477-7f4f-4c9d-a3b6-98163f6cb2ff service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:24.446180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3d1a1fab-9b33-45a1-b875-180cb388b952 req-1feb2477-7f4f-4c9d-a3b6-98163f6cb2ff service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:24.446799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3d1a1fab-9b33-45a1-b875-180cb388b952 req-1feb2477-7f4f-4c9d-a3b6-98163f6cb2ff service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:24.459738 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3d1a1fab-9b33-45a1-b875-180cb388b952 req-1feb2477-7f4f-4c9d-a3b6-98163f6cb2ff service nova] Creating event network-changed:1960820b-a668-42ec-95ff-f246dd878f08 for instance ca12483e-b673-41aa-8d47-1a9b212acdf3 on n-h1-858383-16 Oct 27 10:26:24.466168 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3d1a1fab-9b33-45a1-b875-180cb388b952 req-1feb2477-7f4f-4c9d-a3b6-98163f6cb2ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105386 Oct 27 10:26:24.467408 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3830/7734] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:24.497789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lazy-loading 'services' on Instance uuid ca12483e-b673-41aa-8d47-1a9b212acdf3 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:26:24.581513 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f6ec3912-ef81-4b9f-a8a7-54af9dde5195 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments/9b5ff986-0702-487c-8270-2735fadf3cd8" status: 202 len: 0 microversion: 2.1 time: 0.206608 Oct 27 10:26:24.583065 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3905/7735] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:26:24 2022] DELETE /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments/9b5ff986-0702-487c-8270-2735fadf3cd8 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:24.601968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-477c8d1f-41d4-4a28-8b65-e7e56df8e287 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:24.605984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-477c8d1f-41d4-4a28-8b65-e7e56df8e287 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:24.618886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477c8d1f-41d4-4a28-8b65-e7e56df8e287 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:24.620175 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477c8d1f-41d4-4a28-8b65-e7e56df8e287 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:24.620983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477c8d1f-41d4-4a28-8b65-e7e56df8e287 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:24.622462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477c8d1f-41d4-4a28-8b65-e7e56df8e287 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:24.623666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477c8d1f-41d4-4a28-8b65-e7e56df8e287 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:24.624690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-477c8d1f-41d4-4a28-8b65-e7e56df8e287 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:24.663144 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-477c8d1f-41d4-4a28-8b65-e7e56df8e287 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074440 Oct 27 10:26:24.664462 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3831/7736] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:26:24 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:25.688625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-05fb0281-e846-4b55-a6a6-b58efd0bc1c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:25.693708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-05fb0281-e846-4b55-a6a6-b58efd0bc1c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:25.701290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fb0281-e846-4b55-a6a6-b58efd0bc1c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:25.702068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fb0281-e846-4b55-a6a6-b58efd0bc1c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:25.702714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fb0281-e846-4b55-a6a6-b58efd0bc1c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:25.703456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fb0281-e846-4b55-a6a6-b58efd0bc1c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:25.703963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fb0281-e846-4b55-a6a6-b58efd0bc1c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:25.705138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-05fb0281-e846-4b55-a6a6-b58efd0bc1c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:25.739548 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-05fb0281-e846-4b55-a6a6-b58efd0bc1c5 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063513 Oct 27 10:26:25.740533 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3906/7737] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:26:25 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:26.752962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-509b4d32-5d5f-401e-adbe-fe68d8b7b2f2 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:26.755113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-509b4d32-5d5f-401e-adbe-fe68d8b7b2f2 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:26.766389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-509b4d32-5d5f-401e-adbe-fe68d8b7b2f2 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.766891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-509b4d32-5d5f-401e-adbe-fe68d8b7b2f2 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.767335 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-509b4d32-5d5f-401e-adbe-fe68d8b7b2f2 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:26.768097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-509b4d32-5d5f-401e-adbe-fe68d8b7b2f2 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:26.768565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-509b4d32-5d5f-401e-adbe-fe68d8b7b2f2 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:26.769044 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-509b4d32-5d5f-401e-adbe-fe68d8b7b2f2 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:26.803469 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-509b4d32-5d5f-401e-adbe-fe68d8b7b2f2 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054777 Oct 27 10:26:26.804100 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3832/7738] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:26:26 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:27.816261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b315849e-1866-42b6-b502-6573189e9f38 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:27.818504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b315849e-1866-42b6-b502-6573189e9f38 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:27.825296 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b315849e-1866-42b6-b502-6573189e9f38 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:27.825738 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b315849e-1866-42b6-b502-6573189e9f38 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:27.826181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b315849e-1866-42b6-b502-6573189e9f38 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:27.826873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b315849e-1866-42b6-b502-6573189e9f38 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:27.827336 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b315849e-1866-42b6-b502-6573189e9f38 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:27.827797 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b315849e-1866-42b6-b502-6573189e9f38 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:27.857891 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b315849e-1866-42b6-b502-6573189e9f38 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046230 Oct 27 10:26:27.858480 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3907/7739] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:26:27 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:28.870931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3511b045-e765-4465-a486-fa1c619915d8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:28.873071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3511b045-e765-4465-a486-fa1c619915d8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:28.880465 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3511b045-e765-4465-a486-fa1c619915d8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.880962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3511b045-e765-4465-a486-fa1c619915d8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.881409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3511b045-e765-4465-a486-fa1c619915d8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.882129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3511b045-e765-4465-a486-fa1c619915d8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:28.882591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3511b045-e765-4465-a486-fa1c619915d8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:28.883023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3511b045-e765-4465-a486-fa1c619915d8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:28.917364 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3511b045-e765-4465-a486-fa1c619915d8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050626 Oct 27 10:26:28.917962 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3833/7740] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:26:28 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:29.930477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5d55693-44ad-4566-87d6-779c171381a8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:29.932791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5d55693-44ad-4566-87d6-779c171381a8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:29.939798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d55693-44ad-4566-87d6-779c171381a8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:29.940300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d55693-44ad-4566-87d6-779c171381a8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:29.940782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d55693-44ad-4566-87d6-779c171381a8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:29.941508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d55693-44ad-4566-87d6-779c171381a8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:29.941979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d55693-44ad-4566-87d6-779c171381a8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:29.942418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5d55693-44ad-4566-87d6-779c171381a8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:29.975501 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5d55693-44ad-4566-87d6-779c171381a8 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049277 Oct 27 10:26:29.976124 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3908/7741] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Oct 27 10:26:29 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 10:26:29.987624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:29.988228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:29.994978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:29.995462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:29.995933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:29.996659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:29.997094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:29.997528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:30.074677 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] HTTP exception thrown: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 is not attached to volume 9b5ff986-0702-487c-8270-2735fadf3cd8 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Request method failure captured: Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments/9b5ff986-0702-487c-8270-2735fadf3cd8 HTTP/1.1 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlrkEppyidVmAFZtlIHdS8nh59yxidml1uE1YDObuOOc-mOQUcOYNCsyW2bN05Oi9xqPYYIJiI7VadiYg2S4mD-RMz9eKNa3BLfOxXpEAIxczz3cfLSNwBHsXhH5kX7x7ziDDaFW8JpdiK9mIzQ5N6Yj0FKsICnxwxYHVNd8RhXNnJI Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: d9ea863582054435900efb4cd7710657 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9ea863582054435900efb4cd7710657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9ea863582054435900efb4cd7710657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9ea863582054435900efb4cd7710657"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9ea863582054435900efb4cd7710657"}]}] Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: d9ea863582054435900efb4cd7710657 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestMinimumBasicScenario-1671759918-project Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 0a5adbe51af8455ea27b847eb8d9b134 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestMinimumBasicScenario-1671759918-project Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 is not attached to volume 9b5ff986-0702-487c-8270-2735fadf3cd8 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'server_id': 'ca12483e-b673-41aa-8d47-1a9b212acdf3', 'id': '9b5ff986-0702-487c-8270-2735fadf3cd8'} Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9b5ff986-0702-487c-8270-2735fadf3cd8. Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 is not attached to volume 9b5ff986-0702-487c-8270-2735fadf3cd8 Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:30.076312 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:30.082087 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:30.082087 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:30.082087 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 is not attached to volume 9b5ff986-0702-487c-8270-2735fadf3cd8 Oct 27 10:26:30.082087 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:26:30.082087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Returning 404 to user: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 is not attached to volume 9b5ff986-0702-487c-8270-2735fadf3cd8 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:30.082087 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5bba7ce-f6e5-457a-b7a0-a2d01fb49f65 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments/9b5ff986-0702-487c-8270-2735fadf3cd8" status: 404 len: 154 microversion: 2.1 time: 0.094909 Oct 27 10:26:30.082087 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3834/7742] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Oct 27 10:26:29 2022] DELETE /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3/os-volume_attachments/9b5ff986-0702-487c-8270-2735fadf3cd8 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:33.337621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:33.338318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:33.345997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:33.346507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:33.346928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:33.347658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:33.348118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:33.348550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:33.374950 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:26:33.468032 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b6a38f8a-b044-4e3c-bae9-8f02a3175164 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 204 len: 0 microversion: 2.1 time: 0.133954 Oct 27 10:26:33.468681 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3909/7743] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:26:33 2022] DELETE /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:26:33.477825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:33.478455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:33.486240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:33.487060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:33.487516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:33.488288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:33.488748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:33.489189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:33.626971 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:33.634956 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9fed4ee0-cbf2-4ed1-a3e0-c70b758ec682 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1553 microversion: 2.1 time: 0.161070 Oct 27 10:26:33.635524 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3835/7744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:33 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:34.659478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:34.660142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:34.667050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.667557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.668043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.668761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:34.669228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:34.669670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:34.811349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:34.819897 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ebb7ba7e-6d17-4227-973d-c5e5a93d19ad tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1553 microversion: 2.1 time: 0.165451 Oct 27 10:26:34.820486 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3910/7745] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:34 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:35.843332 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:35.845541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:35.854702 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.855202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.855663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.856403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.856859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.857297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.859841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-cf1f24d5-2a08-489c-b455-7ff1d6eeaf7f req-c2628164-1e87-4f31-9ae8-cccb33a72c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca12483e-b673-41aa-8d47-1a9b212acdf3", "name": "network-vif-deleted", "tag": "1960820b-a668-42ec-95ff-f246dd878f08"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:35.870559 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cf1f24d5-2a08-489c-b455-7ff1d6eeaf7f req-c2628164-1e87-4f31-9ae8-cccb33a72c71 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:35.871416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cf1f24d5-2a08-489c-b455-7ff1d6eeaf7f req-c2628164-1e87-4f31-9ae8-cccb33a72c71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:35.871947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-cf1f24d5-2a08-489c-b455-7ff1d6eeaf7f req-c2628164-1e87-4f31-9ae8-cccb33a72c71 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:35.885392 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-cf1f24d5-2a08-489c-b455-7ff1d6eeaf7f req-c2628164-1e87-4f31-9ae8-cccb33a72c71 service nova] Creating event network-vif-deleted:1960820b-a668-42ec-95ff-f246dd878f08 for instance ca12483e-b673-41aa-8d47-1a9b212acdf3 on n-h1-858383-16 Oct 27 10:26:35.890948 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-cf1f24d5-2a08-489c-b455-7ff1d6eeaf7f req-c2628164-1e87-4f31-9ae8-cccb33a72c71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Oct 27 10:26:35.892603 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3911/7746] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:35.932308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5adbe51af8455ea27b847eb8d9b134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ea863582054435900efb4cd7710657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:35.941247 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dc6f71e4-7595-468f-8b34-ebecae9d1368 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 200 len: 1511 microversion: 2.1 time: 0.101791 Oct 27 10:26:35.941847 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3836/7747] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:35 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:36.967311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:36.968075 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [instance: ca12483e-b673-41aa-8d47-1a9b212acdf3] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:36.974826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:36.975339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:36.975829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:36.976551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:36.977019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:36.977457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:36.991817 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] HTTP exception thrown: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 could not be found. Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Request method failure captured: Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 HTTP/1.1 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlrkEppyidVmAFZtlIHdS8nh59yxidml1uE1YDObuOOc-mOQUcOYNCsyW2bN05Oi9xqPYYIJiI7VadiYg2S4mD-RMz9eKNa3BLfOxXpEAIxczz3cfLSNwBHsXhH5kX7x7ziDDaFW8JpdiK9mIzQ5N6Yj0FKsICnxwxYHVNd8RhXNnJI Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: d9ea863582054435900efb4cd7710657 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9ea863582054435900efb4cd7710657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9ea863582054435900efb4cd7710657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9ea863582054435900efb4cd7710657"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9ea863582054435900efb4cd7710657"}]}] Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: d9ea863582054435900efb4cd7710657 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1671759918 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestMinimumBasicScenario-1671759918-project Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 0a5adbe51af8455ea27b847eb8d9b134 Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestMinimumBasicScenario-1671759918-project Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 could not be found. Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': 'ca12483e-b673-41aa-8d47-1a9b212acdf3'} Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 could not be found. Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 could not be found. Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:26:36.993500 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 could not be found. Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Returning 404 to user: Instance ca12483e-b673-41aa-8d47-1a9b212acdf3 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-29446261-1e4f-492f-afd7-252fe7869e74 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3" status: 404 len: 111 microversion: 2.1 time: 0.032770 Oct 27 10:26:36.998228 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3912/7748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:36 2022] GET /compute/v2.1/servers/ca12483e-b673-41aa-8d47-1a9b212acdf3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:26:37.004668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87699855-bb79-4812-8319-c68b969e5bb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] Calling method '.version_select at 0x7f31aaeef160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:37.009111 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [None req-87699855-bb79-4812-8319-c68b969e5bb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [12add418-71b3-44ec-8361-2be2532364fd] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:26:38.017275 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [None req-87699855-bb79-4812-8319-c68b969e5bb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] [12add418-71b3-44ec-8361-2be2532364fd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40876. Oct 27 10:26:38.038935 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87699855-bb79-4812-8319-c68b969e5bb1 tempest-TestMinimumBasicScenario-1671759918 tempest-TestMinimumBasicScenario-1671759918-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-73629902" status: 202 len: 0 microversion: 2.1 time: 1.038871 Oct 27 10:26:38.039531 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3837/7749] 10.222.0.25 () {58 vars in 1266 bytes} [Thu Oct 27 10:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-73629902 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:26:47.627552 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:26:47.628075 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Oct 27 10:26:47.628656 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:26:47.628778 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Oct 27 10:26:47.629718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:47.630449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:47.806552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-715a7f29-d4d9-4cfc-9615-efaea4ea2322 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: .version_select at 0x7f31abb86790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-724127818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLknHVPSuqqWdhclSAog4uZYhwHCZ+cS7Q2m3wE+jUAc+0wdq97brmMYXhQ/OeXGxf6PCxpQnBwvJ7rNpJ7U1J7VEF6uoTk6EYCN6zpfz4TQmIPHJuNYKoCLTp7HUyGjtA=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:47.822234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-715a7f29-d4d9-4cfc-9615-efaea4ea2322 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:47.827291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-715a7f29-d4d9-4cfc-9615-efaea4ea2322 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:47.856059 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-715a7f29-d4d9-4cfc-9615-efaea4ea2322 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.234553 Oct 27 10:26:47.856664 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3913/7750] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:26:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:26:53.320027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=42 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:53.320907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:26:53.325972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1779197613", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "e1137167-d66b-49a5-b2c1-cfabfb7acb94"}], "key_name": "tempest-TestNetworkAdvancedServerOps-724127818", "security_groups": [{"name": "tempest-secgroup-smoke-1079443475"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:53.479491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] validate_networks() for [('e1137167-d66b-49a5-b2c1-cfabfb7acb94', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:26:54.014165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:26:54.014857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:26:54.015729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:26:54.016521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:26:54.017124 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:26:54.027903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.028837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.029800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.030903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:54.031554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:54.032185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:54.053972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:26:54.060012 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:26:54.075207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:26:54.077598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:26:54.135356 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-123b7693-2f33-4c16-bd4a-e09245625643 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.817711 Oct 27 10:26:54.136424 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3838/7751] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:26:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:26:54.148687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dbcfec59-6d44-4d5c-a797-c35af53a17ac tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:54.149554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dbcfec59-6d44-4d5c-a797-c35af53a17ac tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:54.230142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dbcfec59-6d44-4d5c-a797-c35af53a17ac tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:54.239002 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dbcfec59-6d44-4d5c-a797-c35af53a17ac tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1266 microversion: 2.1 time: 0.095200 Oct 27 10:26:54.239700 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3914/7752] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:54 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:26:55.262535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:55.263172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:55.274275 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:55.274786 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:55.275238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:55.275994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:55.276460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:55.276895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:55.725977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:55.740370 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-93459922-bfc8-402a-8717-b14e89479d57 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1318 microversion: 2.1 time: 0.481720 Oct 27 10:26:55.741270 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3839/7753] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:55 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:56.764418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:56.765212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:56.778798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.781494 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.782072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:56.782989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:56.783608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:56.784201 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:57.010429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:57.018772 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-51e12589-2902-40c1-9ef6-fb0083b4f3a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1392 microversion: 2.1 time: 0.258231 Oct 27 10:26:57.019370 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3915/7754] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:56 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1392 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:57.340671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5776250b-3cb7-457a-bbfe-7b4866ba342c req-6861f107-1f43-460a-8253-434696b88c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c03d525-5567-4464-95f6-eb1657c93edf", "tag": "d375401a-6051-4528-9584-5f19b3f2a3cc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:26:57.355146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5776250b-3cb7-457a-bbfe-7b4866ba342c req-6861f107-1f43-460a-8253-434696b88c6f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:57.355935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5776250b-3cb7-457a-bbfe-7b4866ba342c req-6861f107-1f43-460a-8253-434696b88c6f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:57.356688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5776250b-3cb7-457a-bbfe-7b4866ba342c req-6861f107-1f43-460a-8253-434696b88c6f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:57.370195 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5776250b-3cb7-457a-bbfe-7b4866ba342c req-6861f107-1f43-460a-8253-434696b88c6f service nova] Creating event network-changed:d375401a-6051-4528-9584-5f19b3f2a3cc for instance 3c03d525-5567-4464-95f6-eb1657c93edf on n-h1-858383-16 Oct 27 10:26:57.375700 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5776250b-3cb7-457a-bbfe-7b4866ba342c req-6861f107-1f43-460a-8253-434696b88c6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039323 Oct 27 10:26:57.376795 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3840/7755] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:26:58.043517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:58.044178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:58.051841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:58.052357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:58.052819 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:58.053543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:58.054021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:58.054467 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:58.195185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:58.203055 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3014c9c3-823e-4e0d-b6fe-0e7ecc5170b7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1392 microversion: 2.1 time: 0.163483 Oct 27 10:26:58.203653 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3916/7756] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:58 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:26:59.227139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:26:59.227822 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:26:59.234928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:59.235965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:59.236414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:59.237121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:26:59.237585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:26:59.238016 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:26:59.390055 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:26:59.398761 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f87f3961-65c0-461d-8517-cdde1ccc5e18 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1392 microversion: 2.1 time: 0.176023 Oct 27 10:26:59.399362 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3841/7757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:26:59 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:00.422500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:00.423642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:00.429707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.430206 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.430666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.431382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:00.431883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:00.432331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:00.562683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:00.571297 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-82baca8e-2be5-4683-8ca7-915242895923 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1392 microversion: 2.1 time: 0.153026 Oct 27 10:27:00.572147 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3917/7758] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:00 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:01.594050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:01.595482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:01.602182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:01.602673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:01.603113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:01.603835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:01.604296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:01.604725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:01.739490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:01.747321 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cfc676fa-5be5-420a-89bd-fe8996115d73 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1392 microversion: 2.1 time: 0.157179 Oct 27 10:27:01.747918 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3842/7759] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:01 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:02.770232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:02.770807 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:02.777503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:02.777993 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:02.778441 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:02.779137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:02.779625 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:02.780065 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:02.915909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:02.924453 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e11b8a91-9e59-4aee-9234-1eb258a5782c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1392 microversion: 2.1 time: 0.158190 Oct 27 10:27:02.925386 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3918/7760] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:02 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:27:03.947611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:03.948204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:03.956099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:03.956593 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:03.957040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:03.957750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:03.958213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:03.958644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:04.042930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:04.069840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:04.096529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:04.104299 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b23572fd-aae7-49b7-85af-55ec5a10de03 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1392 microversion: 2.1 time: 0.160643 Oct 27 10:27:04.104913 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3843/7761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:03 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:04.419413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:04.483709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-296530e2-59b2-4393-b791-2a187e14b852 req-263fad3b-5a1e-4c61-81e4-82e1ed891aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c03d525-5567-4464-95f6-eb1657c93edf", "name": "network-vif-plugged", "status": "completed", "tag": "d375401a-6051-4528-9584-5f19b3f2a3cc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:04.493722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-296530e2-59b2-4393-b791-2a187e14b852 req-263fad3b-5a1e-4c61-81e4-82e1ed891aa3 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:04.494273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-296530e2-59b2-4393-b791-2a187e14b852 req-263fad3b-5a1e-4c61-81e4-82e1ed891aa3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:04.494668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-296530e2-59b2-4393-b791-2a187e14b852 req-263fad3b-5a1e-4c61-81e4-82e1ed891aa3 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:04.506863 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-296530e2-59b2-4393-b791-2a187e14b852 req-263fad3b-5a1e-4c61-81e4-82e1ed891aa3 service nova] Creating event network-vif-plugged:d375401a-6051-4528-9584-5f19b3f2a3cc for instance 3c03d525-5567-4464-95f6-eb1657c93edf on n-h1-858383-16 Oct 27 10:27:04.512672 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-296530e2-59b2-4393-b791-2a187e14b852 req-263fad3b-5a1e-4c61-81e4-82e1ed891aa3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098768 Oct 27 10:27:04.513294 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3919/7762] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:27:05.127962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:05.128562 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:05.136062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:05.136827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:05.137249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:05.137921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:05.138396 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:05.138833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:05.279430 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:05.287456 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c407b00c-24e8-45ed-91be-ec5b532d824c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1392 microversion: 2.1 time: 0.163650 Oct 27 10:27:05.288098 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3844/7763] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:05 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:06.311079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:06.311866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:06.318487 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:06.319001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:06.319465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:06.320256 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:06.320731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:06.321174 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:06.467059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:06.476094 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1ef4e081-a0eb-4271-83e4-74ef3d08383f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1564 microversion: 2.1 time: 0.170156 Oct 27 10:27:06.476686 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3920/7764] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:06 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:06.499001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:06.499626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:06.506847 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:06.507334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:06.507809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:06.508517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:06.508973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:06.509400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:06.652872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:06.661229 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40377f2b-f8a5-45e8-a168-0134831c055c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1564 microversion: 2.1 time: 0.166575 Oct 27 10:27:06.661806 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3845/7765] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:06 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:08.323900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:27:08.324531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:08.333354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:08.333788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-471e3b1c-94ce-40f2-899a-13a55afcafd5 req-8eff9c13-0432-4b70-8468-94739152f960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c03d525-5567-4464-95f6-eb1657c93edf", "tag": "d375401a-6051-4528-9584-5f19b3f2a3cc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:08.334656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:08.335466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:08.336437 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:08.337103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:08.337734 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:08.346488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-471e3b1c-94ce-40f2-899a-13a55afcafd5 req-8eff9c13-0432-4b70-8468-94739152f960 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:08.346979 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-471e3b1c-94ce-40f2-899a-13a55afcafd5 req-8eff9c13-0432-4b70-8468-94739152f960 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:08.347632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-471e3b1c-94ce-40f2-899a-13a55afcafd5 req-8eff9c13-0432-4b70-8468-94739152f960 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:08.359521 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-471e3b1c-94ce-40f2-899a-13a55afcafd5 req-8eff9c13-0432-4b70-8468-94739152f960 service nova] Creating event network-changed:d375401a-6051-4528-9584-5f19b3f2a3cc for instance 3c03d525-5567-4464-95f6-eb1657c93edf on n-h1-858383-16 Oct 27 10:27:08.364911 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-471e3b1c-94ce-40f2-899a-13a55afcafd5 req-8eff9c13-0432-4b70-8468-94739152f960 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035766 Oct 27 10:27:08.371906 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3846/7766] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:27:08.581549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:27:08.590195 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a6b71eb1-8206-4c11-8eac-1bb315e1d4dd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1564 microversion: 2.1 time: 0.270185 Oct 27 10:27:08.590803 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3921/7767] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:27:08 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1564 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:27:43.894529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:43.895268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=42 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:27:43.900120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23eed1b7-917d-4eb3-90ed-995d3685efc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:27:43.902398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23eed1b7-917d-4eb3-90ed-995d3685efc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:27:43.911342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23eed1b7-917d-4eb3-90ed-995d3685efc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.911853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23eed1b7-917d-4eb3-90ed-995d3685efc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.912297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23eed1b7-917d-4eb3-90ed-995d3685efc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.913011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23eed1b7-917d-4eb3-90ed-995d3685efc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:27:43.913462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23eed1b7-917d-4eb3-90ed-995d3685efc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:27:43.913890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23eed1b7-917d-4eb3-90ed-995d3685efc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:27:43.968516 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23eed1b7-917d-4eb3-90ed-995d3685efc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action" status: 200 len: 24568 microversion: 2.1 time: 0.076528 Oct 27 10:27:43.969190 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3847/7768] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:27:43 2022] POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action => generated 24568 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:28:22.699876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:22.700567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=38 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:22.705157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-56b5516d-3a10-47c7-8c3a-8b4dcc07efd4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:22.705706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-56b5516d-3a10-47c7-8c3a-8b4dcc07efd4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:22.713490 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56b5516d-3a10-47c7-8c3a-8b4dcc07efd4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.713999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56b5516d-3a10-47c7-8c3a-8b4dcc07efd4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.714456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56b5516d-3a10-47c7-8c3a-8b4dcc07efd4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.715170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56b5516d-3a10-47c7-8c3a-8b4dcc07efd4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.715968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56b5516d-3a10-47c7-8c3a-8b4dcc07efd4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.716110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-56b5516d-3a10-47c7-8c3a-8b4dcc07efd4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.789271 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-56b5516d-3a10-47c7-8c3a-8b4dcc07efd4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action" status: 202 len: 0 microversion: 2.1 time: 0.091348 Oct 27 10:28:22.789995 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3922/7769] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:22 2022] POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:28:22.800222 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:22.801022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:22.803156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:22.803976 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:22.811064 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.811552 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.812127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.812831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:22.813284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:22.813706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:22.958501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:22.969674 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3eb8a8e8-4f86-47ba-9168-2b5b12ff2d08 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1688 microversion: 2.1 time: 0.174065 Oct 27 10:28:22.970564 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3848/7770] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:22 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:23.996054 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:23.996756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:24.003354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:24.003960 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:24.004350 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:24.005129 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:24.005650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:24.006209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:24.145275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:24.153662 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3efc2aa1-5d62-420a-a79a-061107921acc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1668 microversion: 2.1 time: 0.163047 Oct 27 10:28:24.154232 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3923/7771] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:23 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:25.253917 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0b4bb87-5dbf-4659-a0a5-8e4c008fb407 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:25.256105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0b4bb87-5dbf-4659-a0a5-8e4c008fb407 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:25.263929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb87-5dbf-4659-a0a5-8e4c008fb407 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.264429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb87-5dbf-4659-a0a5-8e4c008fb407 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.264876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb87-5dbf-4659-a0a5-8e4c008fb407 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.265594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb87-5dbf-4659-a0a5-8e4c008fb407 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.266054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb87-5dbf-4659-a0a5-8e4c008fb407 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.266486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0b4bb87-5dbf-4659-a0a5-8e4c008fb407 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.317387 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0b4bb87-5dbf-4659-a0a5-8e4c008fb407 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action" status: 200 len: 32640 microversion: 2.1 time: 0.067351 Oct 27 10:28:25.318033 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3849/7772] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:25 2022] POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action => generated 32640 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:28:25.329924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa25bb05-f6d0-4833-9746-72707970aa9e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:25.330474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aa25bb05-f6d0-4833-9746-72707970aa9e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:25.337927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa25bb05-f6d0-4833-9746-72707970aa9e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.338434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa25bb05-f6d0-4833-9746-72707970aa9e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.338889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa25bb05-f6d0-4833-9746-72707970aa9e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.339629 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa25bb05-f6d0-4833-9746-72707970aa9e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.340105 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa25bb05-f6d0-4833-9746-72707970aa9e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.340548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa25bb05-f6d0-4833-9746-72707970aa9e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.407338 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aa25bb05-f6d0-4833-9746-72707970aa9e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action" status: 202 len: 0 microversion: 2.1 time: 0.081176 Oct 27 10:28:25.408017 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3924/7773] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:25 2022] POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:28:25.417551 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:25.418299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:25.425474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.425963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.426410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.427117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:25.427596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:25.428043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:25.567204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:25.575285 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b4902c79-130d-4867-9b5a-e75af9ada5db tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1675 microversion: 2.1 time: 0.161978 Oct 27 10:28:25.575901 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3850/7774] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:25 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:26.604038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:26.604673 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:26.611008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:26.611514 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:26.611992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:26.612733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:26.613209 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:26.613651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:27.066452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:27.074240 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6d7f9d40-9b83-4757-a1f8-018cd3d87ac9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1683 microversion: 2.1 time: 0.475433 Oct 27 10:28:27.074807 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3925/7775] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:26 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1683 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:27.169877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2af164de-cb07-4049-a85a-e9145b032954 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:27.172123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2af164de-cb07-4049-a85a-e9145b032954 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:27.180302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2af164de-cb07-4049-a85a-e9145b032954 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:27.180931 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2af164de-cb07-4049-a85a-e9145b032954 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:27.181327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2af164de-cb07-4049-a85a-e9145b032954 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:27.182032 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2af164de-cb07-4049-a85a-e9145b032954 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:27.182501 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2af164de-cb07-4049-a85a-e9145b032954 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:27.182936 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2af164de-cb07-4049-a85a-e9145b032954 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:27.233439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2af164de-cb07-4049-a85a-e9145b032954 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action" status: 200 len: 38242 microversion: 2.1 time: 0.067434 Oct 27 10:28:27.234079 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3851/7776] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:28:27 2022] POST /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf/action => generated 38242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:28:28.203851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:28.204424 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:28.214724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:28.215311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:28.215862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:28.216863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:28.217415 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:28.217926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:28.248387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:28:28.272527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e79a3e08-9482-447a-bee3-4e89f9486830 req-913acf4a-bb47-432e-9dc6-20b5c6311e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c03d525-5567-4464-95f6-eb1657c93edf", "tag": "d375401a-6051-4528-9584-5f19b3f2a3cc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:28.283923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e79a3e08-9482-447a-bee3-4e89f9486830 req-913acf4a-bb47-432e-9dc6-20b5c6311e60 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:28.284409 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e79a3e08-9482-447a-bee3-4e89f9486830 req-913acf4a-bb47-432e-9dc6-20b5c6311e60 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:28.284845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e79a3e08-9482-447a-bee3-4e89f9486830 req-913acf4a-bb47-432e-9dc6-20b5c6311e60 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:28.298162 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e79a3e08-9482-447a-bee3-4e89f9486830 req-913acf4a-bb47-432e-9dc6-20b5c6311e60 service nova] Creating event network-changed:d375401a-6051-4528-9584-5f19b3f2a3cc for instance 3c03d525-5567-4464-95f6-eb1657c93edf on n-h1-858383-16 Oct 27 10:28:28.303352 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e79a3e08-9482-447a-bee3-4e89f9486830 req-913acf4a-bb47-432e-9dc6-20b5c6311e60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101289 Oct 27 10:28:28.304341 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3852/7777] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:28:28.355738 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-206f0f91-aa44-4514-a2ed-e8ec217fd9de tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 204 len: 0 microversion: 2.1 time: 0.156023 Oct 27 10:28:28.356533 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3926/7778] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:28:28 2022] DELETE /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:28:28.366087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:28.367090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:28.373811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:28.374308 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:28.374959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:28.375706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:28.376172 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:28.376605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:28.520407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:28.528010 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e0b7c4b-4f50-4a1d-b997-45ad336b2c3f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1689 microversion: 2.1 time: 0.166903 Oct 27 10:28:28.528680 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3853/7779] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:28 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:28:29.554380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:29.555088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:29.561844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:29.562337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:29.562786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:29.563477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:29.563967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:29.564403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:29.797440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:29.805969 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-48cff4fc-6678-4fa5-8564-657ac8d681ea tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1689 microversion: 2.1 time: 0.256498 Oct 27 10:28:29.806476 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3927/7780] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:29 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:30.829690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:30.831147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:30.839533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.840232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.840777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.841580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.842252 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.842924 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.870944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-adf63f16-029a-4be6-a268-8c660551b9af req-119903b1-ff4e-41fc-a80e-3af66a18f35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c03d525-5567-4464-95f6-eb1657c93edf", "name": "network-vif-deleted", "tag": "d375401a-6051-4528-9584-5f19b3f2a3cc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:30.888060 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-adf63f16-029a-4be6-a268-8c660551b9af req-119903b1-ff4e-41fc-a80e-3af66a18f35b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:30.888962 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-adf63f16-029a-4be6-a268-8c660551b9af req-119903b1-ff4e-41fc-a80e-3af66a18f35b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:30.891493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-adf63f16-029a-4be6-a268-8c660551b9af req-119903b1-ff4e-41fc-a80e-3af66a18f35b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:30.907133 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-adf63f16-029a-4be6-a268-8c660551b9af req-119903b1-ff4e-41fc-a80e-3af66a18f35b service nova] Creating event network-vif-deleted:d375401a-6051-4528-9584-5f19b3f2a3cc for instance 3c03d525-5567-4464-95f6-eb1657c93edf on n-h1-858383-16 Oct 27 10:28:30.918771 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-adf63f16-029a-4be6-a268-8c660551b9af req-119903b1-ff4e-41fc-a80e-3af66a18f35b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052157 Oct 27 10:28:30.923698 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3928/7781] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:30.924576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:30.935909 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0b2362b-8113-4f35-8430-a3ce7f4d21f9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 200 len: 1502 microversion: 2.1 time: 0.110313 Oct 27 10:28:30.936916 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3854/7782] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:30 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 1502 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:31.960116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:31.960833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 3c03d525-5567-4464-95f6-eb1657c93edf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:31.967356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:31.967938 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:31.968412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:31.969186 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:31.969649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:31.970083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:31.984939 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] HTTP exception thrown: Instance 3c03d525-5567-4464-95f6-eb1657c93edf could not be found. Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Request method failure captured: Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf HTTP/1.1 Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlznpjglSYA1CgEULfmM1zXhj4xb8pu96BHBDoCyOH7ngKASA76d-_1o2nfvuZzjMfCV3qRZcqaZePuM5poXlBXbGb9-PUJjjddlBlzvrla6ujwlt3YoDIypuNHOvB-lEs9METfJPyBL8aZUTp4ERHJ5QL9ZblfoZmh9Bz2h5P0nWYk Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f047fd54c1744ca98693fe4d24337fe"}]}] Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: d9cb615a635241008595a2b1f69b5a2b Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 3c03d525-5567-4464-95f6-eb1657c93edf could not be found. Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '3c03d525-5567-4464-95f6-eb1657c93edf'} Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c03d525-5567-4464-95f6-eb1657c93edf could not be found. Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c03d525-5567-4464-95f6-eb1657c93edf could not be found. Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:28:31.986594 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c03d525-5567-4464-95f6-eb1657c93edf could not be found. Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Returning 404 to user: Instance 3c03d525-5567-4464-95f6-eb1657c93edf could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb7e515d-2d64-4722-908d-afa490e35a88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf" status: 404 len: 111 microversion: 2.1 time: 0.034002 Oct 27 10:28:31.992749 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3929/7783] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:31 2022] GET /compute/v2.1/servers/3c03d525-5567-4464-95f6-eb1657c93edf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:28:35.373353 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-efc26e02-4198-4791-970b-10c17054d7d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '.version_select at 0x7f31aa4a30d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:35.403141 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-efc26e02-4198-4791-970b-10c17054d7d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-724127818" status: 202 len: 0 microversion: 2.1 time: 0.033769 Oct 27 10:28:35.404611 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3855/7784] 10.222.0.25 () {58 vars in 1281 bytes} [Thu Oct 27 10:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-724127818 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:28:35.432997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cc3ff567-044f-470d-a013-0786678713a5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: .version_select at 0x7f31a91a80d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1709176360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxNvM2OfGzMpwcp9LUgaRtHNMLPFWiGPTSv5xCBF9PLrZ6WhFjZApVm2bB3fej9a5SiJUbHQM0jlSXwcoHVk2cAJZyahOwAkY+0azVgMCuf9nqV8W6n5V6IX7FRMthzg=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:35.449044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-cc3ff567-044f-470d-a013-0786678713a5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:28:35.455124 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-cc3ff567-044f-470d-a013-0786678713a5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:28:35.481367 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cc3ff567-044f-470d-a013-0786678713a5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052236 Oct 27 10:28:35.481983 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3930/7785] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:28:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:41.459065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=34 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:41.463996 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-93917002", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "c5cc39c0-598f-4cc4-b287-300efff1a00e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1709176360", "security_groups": [{"name": "tempest-secgroup-smoke-1601741884"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:41.583651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] validate_networks() for [('c5cc39c0-598f-4cc4-b287-300efff1a00e', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:28:42.050323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:28:42.050951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:28:42.051836 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:28:42.052343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:28:42.052848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:28:42.064362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:42.064868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:42.065472 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:42.066301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:42.066849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:42.067930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:42.114757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:28:42.122461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:28:42.141720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:28:42.146264 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:28:42.216487 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3d64d4c2-5128-449d-974e-16259f85c86a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758958 Oct 27 10:28:42.219155 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3856/7786] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:28:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:28:42.233740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0dc0dd60-610a-4f8d-b177-53663d7ff738 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:42.234536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0dc0dd60-610a-4f8d-b177-53663d7ff738 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:42.241266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:42.365796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0dc0dd60-610a-4f8d-b177-53663d7ff738 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:42.374821 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0dc0dd60-610a-4f8d-b177-53663d7ff738 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1265 microversion: 2.1 time: 0.146801 Oct 27 10:28:42.376485 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3931/7787] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:42 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:43.399142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:43.399884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:43.406994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:43.407483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:43.407953 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:43.408657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:43.409153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:43.409580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:43.482435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:43.495045 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a733b572-3bf2-479d-9d89-ea94531b1be7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1317 microversion: 2.1 time: 0.100333 Oct 27 10:28:43.514573 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3857/7788] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:43 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1317 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:44.522943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:44.523664 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:44.558417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:44.558947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:44.559420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:44.561086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:44.561585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:44.562041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:44.759244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:44.771371 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a495b8d7-606b-45e5-b1e3-dffc71a80753 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1391 microversion: 2.1 time: 0.252895 Oct 27 10:28:44.772627 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3932/7789] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:44 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:45.454719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-aa90e6d6-7c0f-44bc-9ee6-9bc01ba2e8f9 req-6da74726-4a3b-457d-a663-7abd78156dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5660f10-1d35-4789-b441-d467fef99602", "tag": "73bad27d-d651-4e55-b0e3-aacf4a83ca3a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:45.474757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aa90e6d6-7c0f-44bc-9ee6-9bc01ba2e8f9 req-6da74726-4a3b-457d-a663-7abd78156dbe service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:45.475474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aa90e6d6-7c0f-44bc-9ee6-9bc01ba2e8f9 req-6da74726-4a3b-457d-a663-7abd78156dbe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:45.476737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-aa90e6d6-7c0f-44bc-9ee6-9bc01ba2e8f9 req-6da74726-4a3b-457d-a663-7abd78156dbe service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:45.493113 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-aa90e6d6-7c0f-44bc-9ee6-9bc01ba2e8f9 req-6da74726-4a3b-457d-a663-7abd78156dbe service nova] Creating event network-changed:73bad27d-d651-4e55-b0e3-aacf4a83ca3a for instance c5660f10-1d35-4789-b441-d467fef99602 on n-h1-858383-16 Oct 27 10:28:45.499243 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-aa90e6d6-7c0f-44bc-9ee6-9bc01ba2e8f9 req-6da74726-4a3b-457d-a663-7abd78156dbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053482 Oct 27 10:28:45.500436 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3858/7790] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:45.801753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:45.803934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:45.817543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:45.818646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:45.819509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:45.820937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:45.821698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:45.822328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:45.975602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:45.983378 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd99bc4b-380e-4b85-adcc-c4b7ec5bd45b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1391 microversion: 2.1 time: 0.189181 Oct 27 10:28:45.983977 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3933/7791] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:45 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:47.007895 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:47.008620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:47.016751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.017239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.017680 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.019031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:47.019486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:47.019944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:47.154548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:47.163603 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42280539-e721-4ff4-834d-9d0633dd4c78 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1391 microversion: 2.1 time: 0.160689 Oct 27 10:28:47.164193 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3859/7792] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:47 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:48.186783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:48.187835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:48.195413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.195903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.196368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.197102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:48.197579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:48.198053 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:48.343461 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:48.352692 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-62c0c75c-f331-491f-8d40-86b0302e7dfd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1391 microversion: 2.1 time: 0.169855 Oct 27 10:28:48.353277 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3934/7793] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:48 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:49.376965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:49.377689 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:49.385368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:49.385368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:49.385690 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:49.386238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:49.386699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:49.387127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:49.523583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:49.531197 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c7827c3c-64e0-4838-9f3c-2a27fa9e09e4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1391 microversion: 2.1 time: 0.158507 Oct 27 10:28:49.531807 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3860/7794] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:49 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:50.555276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:50.555971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:50.563439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:50.564468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:50.565811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:50.566562 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:50.567035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:50.567477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:50.717745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:50.726464 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a2eee0b2-351d-4c3b-8cba-339f25f24792 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1391 microversion: 2.1 time: 0.175647 Oct 27 10:28:50.727040 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3935/7795] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:50 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:51.749616 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:51.750207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:51.757846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.758344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.758789 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:51.759502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:51.759995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:51.760425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:51.906606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:51.914960 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-289624df-34b7-4820-8bfb-4fd921277ecc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1391 microversion: 2.1 time: 0.169239 Oct 27 10:28:51.915606 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3861/7796] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:51 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:52.941394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:52.942176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:52.944901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:52.945592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:52.952813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:52.953384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:52.953912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:52.954639 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:52.956769 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:52.957234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:53.120561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:53.131651 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b5662639-d4b3-4262-a729-553a91c177e3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1391 microversion: 2.1 time: 0.194764 Oct 27 10:28:53.132270 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3936/7797] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:52 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:53.161840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3373d1e9-40da-47d0-8f80-011be248a13c req-1bd46525-b35a-4cb8-80c3-4c70655f8b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5660f10-1d35-4789-b441-d467fef99602", "name": "network-vif-plugged", "status": "completed", "tag": "73bad27d-d651-4e55-b0e3-aacf4a83ca3a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:53.168587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:53.169650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:53.171165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:28:53.177438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3373d1e9-40da-47d0-8f80-011be248a13c req-1bd46525-b35a-4cb8-80c3-4c70655f8b1f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:53.178002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3373d1e9-40da-47d0-8f80-011be248a13c req-1bd46525-b35a-4cb8-80c3-4c70655f8b1f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:53.178447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3373d1e9-40da-47d0-8f80-011be248a13c req-1bd46525-b35a-4cb8-80c3-4c70655f8b1f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:53.192634 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3373d1e9-40da-47d0-8f80-011be248a13c req-1bd46525-b35a-4cb8-80c3-4c70655f8b1f service nova] Creating event network-vif-plugged:73bad27d-d651-4e55-b0e3-aacf4a83ca3a for instance c5660f10-1d35-4789-b441-d467fef99602 on n-h1-858383-16 Oct 27 10:28:53.198512 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3373d1e9-40da-47d0-8f80-011be248a13c req-1bd46525-b35a-4cb8-80c3-4c70655f8b1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042635 Oct 27 10:28:53.199315 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3862/7798] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:54.171651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:54.172338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:54.179357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:54.179895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:54.180355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:54.181079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:54.181558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:54.182010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:54.331420 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:54.339963 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e5c775f4-691c-47d6-a81f-e64632f9e5bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1391 microversion: 2.1 time: 0.172181 Oct 27 10:28:54.340570 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3937/7799] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:54 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:55.378882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:55.379628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:55.386101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:55.386591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:55.387033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:55.387760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:55.388219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:55.388646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:55.526526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:55.535856 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8476746a-f523-4198-af8e-fe3132f5c77f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1563 microversion: 2.1 time: 0.162030 Oct 27 10:28:55.536458 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3863/7800] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:55 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:55.560001 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:55.560694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:55.568698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:55.569110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:55.569612 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:55.570448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:55.570928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:55.571370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:55.747302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:55.756522 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a17ae6e9-715f-450d-a308-6f2b9134eb41 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1563 microversion: 2.1 time: 0.200503 Oct 27 10:28:55.757172 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3938/7801] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:55 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1563 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:28:57.794278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:28:57.795905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:28:57.796839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e9452569-3476-45f6-bff6-8e54d4003be3 req-d4e953b6-ab77-4dbf-a573-9e8f8a424744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5660f10-1d35-4789-b441-d467fef99602", "tag": "73bad27d-d651-4e55-b0e3-aacf4a83ca3a"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:28:57.802855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:57.803454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:57.803991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:57.804947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:57.805650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:57.806179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:57.819034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e9452569-3476-45f6-bff6-8e54d4003be3 req-d4e953b6-ab77-4dbf-a573-9e8f8a424744 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:28:57.819901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e9452569-3476-45f6-bff6-8e54d4003be3 req-d4e953b6-ab77-4dbf-a573-9e8f8a424744 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:28:57.821023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e9452569-3476-45f6-bff6-8e54d4003be3 req-d4e953b6-ab77-4dbf-a573-9e8f8a424744 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:28:57.844884 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e9452569-3476-45f6-bff6-8e54d4003be3 req-d4e953b6-ab77-4dbf-a573-9e8f8a424744 service nova] Creating event network-changed:73bad27d-d651-4e55-b0e3-aacf4a83ca3a for instance c5660f10-1d35-4789-b441-d467fef99602 on n-h1-858383-16 Oct 27 10:28:57.852109 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e9452569-3476-45f6-bff6-8e54d4003be3 req-d4e953b6-ab77-4dbf-a573-9e8f8a424744 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060461 Oct 27 10:28:57.853545 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3939/7802] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:28:57.955469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:28:57.964857 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e1c1a2cf-5b14-40c2-ab56-1dc7563cd1e9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1563 microversion: 2.1 time: 0.175200 Oct 27 10:28:57.965756 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3864/7803] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:28:57 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:29:33.278333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=7 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:33.279277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=44 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:29:33.285125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1296743c-b92a-4702-9012-1290f2d947f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:29:33.287679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1296743c-b92a-4702-9012-1290f2d947f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:29:33.294930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1296743c-b92a-4702-9012-1290f2d947f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:33.295434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1296743c-b92a-4702-9012-1290f2d947f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:33.295913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1296743c-b92a-4702-9012-1290f2d947f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:33.296646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1296743c-b92a-4702-9012-1290f2d947f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:29:33.297116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1296743c-b92a-4702-9012-1290f2d947f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:29:33.297552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1296743c-b92a-4702-9012-1290f2d947f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:29:33.352458 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1296743c-b92a-4702-9012-1290f2d947f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602/action" status: 200 len: 24570 microversion: 2.1 time: 0.076413 Oct 27 10:29:33.353291 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3940/7804] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:29:33 2022] POST /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602/action => generated 24570 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:30:03.820947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:03.821708 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=42 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:03.825908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0efba457-2268-4301-8661-36d47100970f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:03.828195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0efba457-2268-4301-8661-36d47100970f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:03.835425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0efba457-2268-4301-8661-36d47100970f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:03.835942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0efba457-2268-4301-8661-36d47100970f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:03.836388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0efba457-2268-4301-8661-36d47100970f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:03.837085 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0efba457-2268-4301-8661-36d47100970f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:03.837547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0efba457-2268-4301-8661-36d47100970f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:03.837978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0efba457-2268-4301-8661-36d47100970f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:03.912437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0efba457-2268-4301-8661-36d47100970f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602/action" status: 202 len: 0 microversion: 2.1 time: 0.093318 Oct 27 10:30:03.913086 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3865/7805] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:03 2022] POST /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:30:03.922503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:03.923905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:03.926521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:03.927288 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:03.933447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:03.933985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:03.934450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:03.935176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:03.935678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:03.936123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:04.174641 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:04.183009 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1479f5ab-c6c1-42f8-9dc0-7b3967e3c777 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1673 microversion: 2.1 time: 0.265046 Oct 27 10:30:04.183742 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3941/7806] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:03 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1673 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:05.213389 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:05.214095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:05.220582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:05.221352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:05.221799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:05.222531 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:05.222991 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:05.223424 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:05.429115 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:05.437229 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-93c88bbb-e945-44d2-9d2d-14a54b90145a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1678 microversion: 2.1 time: 0.230097 Oct 27 10:30:05.437820 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3866/7807] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:05 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:06.461722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:06.462330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:06.470017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:06.470513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:06.471222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:06.471949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:06.472980 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:06.473454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:06.611401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:06.619687 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e0a8faa8-6736-44f2-b7af-7b024681316f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1678 microversion: 2.1 time: 0.161742 Oct 27 10:30:06.620258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3942/7808] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:06 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:07.643521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:07.644137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:07.651071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:07.651587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:07.652038 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:07.652750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:07.653211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:07.653642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:07.790759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:07.798727 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6fcc690f-bc6d-42b6-aee9-2e9ef260a351 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1678 microversion: 2.1 time: 0.159159 Oct 27 10:30:07.799305 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3867/7809] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:07 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:08.822801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:08.823428 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:08.826430 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:30:08.826625 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:30:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 (ip 10.222.0.25) !!! Oct 27 10:30:08.836740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:08.837247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:08.837707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:08.838432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:08.838904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:08.839346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:08.990015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:08.998038 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-69e4f005-7d03-4ba1-ae33-02ca5f8fe7cd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1678 microversion: 2.1 time: 0.179163 Oct 27 10:30:08.998638 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3943/7810] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:08 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:10.022926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:10.023609 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:10.030950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:10.031447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:10.031941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:10.032661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:10.033126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:10.033561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:10.184182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:10.194638 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6eadac15-f448-4e18-9a2e-6dfbc9c59217 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1678 microversion: 2.1 time: 0.176032 Oct 27 10:30:10.195644 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3868/7811] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:10 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:11.219979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:11.220602 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:11.228399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.228902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.229355 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:11.230070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:11.230539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:11.230977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:11.374506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:11.382988 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b1c0646-6f8e-44a6-bae2-674eae357e7c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1678 microversion: 2.1 time: 0.166914 Oct 27 10:30:11.383608 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3944/7812] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:11 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:12.414766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:12.415374 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:12.422610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:12.423136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:12.423597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:12.424318 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:12.424843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:12.425317 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:12.569771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:12.577929 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-da9d581a-609a-4450-950a-13ce09c2d3f5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1678 microversion: 2.1 time: 0.167030 Oct 27 10:30:12.578576 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3869/7813] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:12 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:13.603955 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:13.604552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:13.611397 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:13.611940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:13.612398 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:13.613152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:13.613749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:13.614199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:13.755509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:13.764944 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f9e58d21-1a74-4b47-8917-8a6f92210dd3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1678 microversion: 2.1 time: 0.164267 Oct 27 10:30:13.765911 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3945/7814] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:13 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:14.789857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:14.790505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:14.797442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:14.797927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:14.798368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:14.799061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:14.799516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:14.799965 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:14.937042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:14.944910 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62e1c5f7-8c92-4e13-8c5d-bb53b7e33523 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1678 microversion: 2.1 time: 0.159583 Oct 27 10:30:14.945498 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3870/7815] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:14 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:30:15.969100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:30:15.969667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:15.977555 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:15.978058 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:15.978512 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:15.979229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:15.979728 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:15.980175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:16.126221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:30:16.134415 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a2ff68cc-9929-453d-9144-046a39d32cb7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1681 microversion: 2.1 time: 0.169435 Oct 27 10:30:16.135004 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3946/7816] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:30:15 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:30:50.366714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f9be7f1-094e-4c9f-9d29-c6ce77a16149 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:30:50.369001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f9be7f1-094e-4c9f-9d29-c6ce77a16149 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:30:50.371771 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:30:50.371946 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:30:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602/action (ip 10.222.0.25) !!! Oct 27 10:30:50.373706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:50.374387 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:30:50.384080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f9be7f1-094e-4c9f-9d29-c6ce77a16149 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.384576 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f9be7f1-094e-4c9f-9d29-c6ce77a16149 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.385022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f9be7f1-094e-4c9f-9d29-c6ce77a16149 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.385773 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f9be7f1-094e-4c9f-9d29-c6ce77a16149 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:30:50.386234 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f9be7f1-094e-4c9f-9d29-c6ce77a16149 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:30:50.386664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f9be7f1-094e-4c9f-9d29-c6ce77a16149 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:30:50.448040 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f9be7f1-094e-4c9f-9d29-c6ce77a16149 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602/action" status: 200 len: 69094 microversion: 2.1 time: 0.085151 Oct 27 10:30:50.448720 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3871/7817] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:30:50 2022] POST /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602/action => generated 69094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:31:07.511501 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=12 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:07.512886 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=36 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:07.517176 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ebe0e859-a4ce-4e5a-b0fc-b35c7a6b9b94 req-7851b2ae-e6aa-4708-8e85-e6f783a21c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5660f10-1d35-4789-b441-d467fef99602", "tag": "73bad27d-d651-4e55-b0e3-aacf4a83ca3a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:07.519035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:07.519806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:07.528371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:07.528779 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.529513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:07.529648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:07.529648 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.530670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.530670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:07.531278 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ebe0e859-a4ce-4e5a-b0fc-b35c7a6b9b94 req-7851b2ae-e6aa-4708-8e85-e6f783a21c25 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.531399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.531776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ebe0e859-a4ce-4e5a-b0fc-b35c7a6b9b94 req-7851b2ae-e6aa-4708-8e85-e6f783a21c25 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:07.532421 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ebe0e859-a4ce-4e5a-b0fc-b35c7a6b9b94 req-7851b2ae-e6aa-4708-8e85-e6f783a21c25 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.546419 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ebe0e859-a4ce-4e5a-b0fc-b35c7a6b9b94 req-7851b2ae-e6aa-4708-8e85-e6f783a21c25 service nova] Creating event network-changed:73bad27d-d651-4e55-b0e3-aacf4a83ca3a for instance c5660f10-1d35-4789-b441-d467fef99602 on n-h1-858383-16 Oct 27 10:31:07.551436 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ebe0e859-a4ce-4e5a-b0fc-b35c7a6b9b94 req-7851b2ae-e6aa-4708-8e85-e6f783a21c25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038740 Oct 27 10:31:07.552628 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3872/7818] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:07.558528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:31:07.646156 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83f71e68-c644-4794-872e-ec4858daba00 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 204 len: 0 microversion: 2.1 time: 0.136147 Oct 27 10:31:07.646949 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3947/7819] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:31:07 2022] DELETE /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:31:07.656644 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:07.657196 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:07.664208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.664712 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:07.665158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.665870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:07.666334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:07.666762 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:07.810098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:07.821952 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80133cdf-7360-4ac2-aeaa-076ca400449a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1687 microversion: 2.1 time: 0.170195 Oct 27 10:31:07.822629 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3873/7820] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:07 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:08.849701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:08.850483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:08.857940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:08.858449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.858905 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:08.859658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:08.860133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:08.860570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:09.010902 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:09.019728 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2f44a348-42ea-4afb-b4f1-61558d8ed2bb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1687 microversion: 2.1 time: 0.175468 Oct 27 10:31:09.021540 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3948/7821] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:08 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:09.882969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-34070268-f285-4ab6-bec6-bc82f85c70bc req-4586dc42-2c88-4766-aef2-5c6ad87c92e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5660f10-1d35-4789-b441-d467fef99602", "name": "network-vif-deleted", "tag": "73bad27d-d651-4e55-b0e3-aacf4a83ca3a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:09.894661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-34070268-f285-4ab6-bec6-bc82f85c70bc req-4586dc42-2c88-4766-aef2-5c6ad87c92e1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:09.894661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-34070268-f285-4ab6-bec6-bc82f85c70bc req-4586dc42-2c88-4766-aef2-5c6ad87c92e1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:09.897957 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-34070268-f285-4ab6-bec6-bc82f85c70bc req-4586dc42-2c88-4766-aef2-5c6ad87c92e1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:09.907666 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-34070268-f285-4ab6-bec6-bc82f85c70bc req-4586dc42-2c88-4766-aef2-5c6ad87c92e1 service nova] Creating event network-vif-deleted:73bad27d-d651-4e55-b0e3-aacf4a83ca3a for instance c5660f10-1d35-4789-b441-d467fef99602 on n-h1-858383-16 Oct 27 10:31:09.913828 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-34070268-f285-4ab6-bec6-bc82f85c70bc req-4586dc42-2c88-4766-aef2-5c6ad87c92e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034645 Oct 27 10:31:09.914532 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3874/7822] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:10.047607 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:10.048432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:10.056226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:10.056730 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:10.057187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:10.057912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:10.058523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:10.058969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:10.097370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:10.097866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:10.098315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:10.098828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lazy-loading 'fault' on Instance uuid c5660f10-1d35-4789-b441-d467fef99602 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:31:10.143632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:10.152776 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a252fb67-3e68-4bf2-95cb-314ccbe718f1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 200 len: 1355 microversion: 2.1 time: 0.110161 Oct 27 10:31:10.153355 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3949/7823] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:10 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 1355 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:11.178282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:11.179013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: c5660f10-1d35-4789-b441-d467fef99602] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:11.185574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:11.186071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:11.186513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:11.187224 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:11.187718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:11.188159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:11.202530 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] HTTP exception thrown: Instance c5660f10-1d35-4789-b441-d467fef99602 could not be found. Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Request method failure captured: Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 HTTP/1.1 Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlznpjglSYA1CgEULfmM1zXhj4xb8pu96BHBDoCyOH7ngKASA76d-_1o2nfvuZzjMfCV3qRZcqaZePuM5poXlBXbGb9-PUJjjddlBlzvrla6ujwlt3YoDIypuNHOvB-lEs9METfJPyBL8aZUTp4ERHJ5QL9ZblfoZmh9Bz2h5P0nWYk Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f047fd54c1744ca98693fe4d24337fe"}]}] Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d9cb615a635241008595a2b1f69b5a2b Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance c5660f10-1d35-4789-b441-d467fef99602 could not be found. Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'c5660f10-1d35-4789-b441-d467fef99602'} Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5660f10-1d35-4789-b441-d467fef99602 could not be found. Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5660f10-1d35-4789-b441-d467fef99602 could not be found. Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:31:11.204270 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5660f10-1d35-4789-b441-d467fef99602 could not be found. Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Returning 404 to user: Instance c5660f10-1d35-4789-b441-d467fef99602 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d032aff5-0267-46d4-99af-a613fe852f6e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602" status: 404 len: 111 microversion: 2.1 time: 0.033103 Oct 27 10:31:11.209864 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3875/7824] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:11 2022] GET /compute/v2.1/servers/c5660f10-1d35-4789-b441-d467fef99602 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:31:14.697601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-be4dedbd-6ad6-4662-93a7-6585aa94ddd2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '.version_select at 0x7f31a93e0e50>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:14.704189 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [None req-be4dedbd-6ad6-4662-93a7-6585aa94ddd2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [e73a6fbf-08ce-4173-adca-11259d20346d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:31:15.714195 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [None req-be4dedbd-6ad6-4662-93a7-6585aa94ddd2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [e73a6fbf-08ce-4173-adca-11259d20346d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41400. Oct 27 10:31:15.736356 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-be4dedbd-6ad6-4662-93a7-6585aa94ddd2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1709176360" status: 202 len: 0 microversion: 2.1 time: 1.042559 Oct 27 10:31:15.736957 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3950/7825] 10.222.0.25 () {58 vars in 1284 bytes} [Thu Oct 27 10:31:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1709176360 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:31:15.767027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-327ceadd-0d5b-4385-adfd-8d5d37886f69 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: .version_select at 0x7f31a8f52430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-435316414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESgXm6Ztkt/5xKzSoUg3cCdpOhbALrZp32g7HdBCg9+ZTOTfpgHxvKpZNIdj7Se7pwRJNMI187j1hnuTBzQOYpMHyn8MelIYXtZnE6Cb8CSBLj2nesGatIfKe+amqghfQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:15.786973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-327ceadd-0d5b-4385-adfd-8d5d37886f69 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:31:15.792235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-327ceadd-0d5b-4385-adfd-8d5d37886f69 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:31:15.820351 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-327ceadd-0d5b-4385-adfd-8d5d37886f69 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.057275 Oct 27 10:31:15.820972 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3876/7826] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:31:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:21.587709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:21.592191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-510525350", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "bf8f50dc-755b-4e49-bbf2-8183f9b6b854"}], "key_name": "tempest-TestNetworkAdvancedServerOps-435316414", "security_groups": [{"name": "tempest-secgroup-smoke-1020312535"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:21.722021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] validate_networks() for [('bf8f50dc-755b-4e49-bbf2-8183f9b6b854', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:31:22.206162 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:31:22.206634 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:31:22.207152 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:31:22.207599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:31:22.208069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:31:22.217748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:22.218250 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:22.218706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:22.219449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:22.219958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:22.220400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:22.237782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:31:22.243987 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:31:22.257331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:31:22.260349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:31:22.310890 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e00836eb-f694-404c-a0a7-2b88e6aed320 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.724901 Oct 27 10:31:22.318218 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3951/7827] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:31:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:31:22.321959 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:22.338735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62b8ce40-61e3-424e-a66d-e3cb2ba9ee4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:22.339588 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62b8ce40-61e3-424e-a66d-e3cb2ba9ee4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:22.425981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62b8ce40-61e3-424e-a66d-e3cb2ba9ee4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:22.439793 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62b8ce40-61e3-424e-a66d-e3cb2ba9ee4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1265 microversion: 2.1 time: 0.119460 Oct 27 10:31:22.452404 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3877/7828] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:22 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:23.465226 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:23.465856 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:23.475889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:23.476654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:23.477243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:23.478104 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:23.478571 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:23.479301 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:23.573806 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:23.585170 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d449f274-5194-44a8-bbac-cd757dbc27fb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1325 microversion: 2.1 time: 0.125135 Oct 27 10:31:23.587896 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3952/7829] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:23 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1325 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:24.609631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:24.610344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:24.617850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:24.618496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:24.619128 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:24.619977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:24.620541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:24.621079 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:24.836004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:24.843789 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee982bf8-4cdf-4ca1-9cc8-7851dd116ad6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1391 microversion: 2.1 time: 0.238420 Oct 27 10:31:24.844375 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3878/7830] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:24 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:25.213354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3bdf0109-5dcd-4def-9e78-2348125ddfb6 req-1cba23c7-1da3-4d7e-8643-fa1dcd88d8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1ea509-bab5-4f19-bd3f-76eef1b328ec", "tag": "68b55321-c24c-4daf-888f-72cfa56e2a6d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:25.227753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3bdf0109-5dcd-4def-9e78-2348125ddfb6 req-1cba23c7-1da3-4d7e-8643-fa1dcd88d8e4 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:25.228254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3bdf0109-5dcd-4def-9e78-2348125ddfb6 req-1cba23c7-1da3-4d7e-8643-fa1dcd88d8e4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:25.228703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3bdf0109-5dcd-4def-9e78-2348125ddfb6 req-1cba23c7-1da3-4d7e-8643-fa1dcd88d8e4 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:25.240077 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3bdf0109-5dcd-4def-9e78-2348125ddfb6 req-1cba23c7-1da3-4d7e-8643-fa1dcd88d8e4 service nova] Creating event network-changed:68b55321-c24c-4daf-888f-72cfa56e2a6d for instance da1ea509-bab5-4f19-bd3f-76eef1b328ec on n-h2-858383-16 Oct 27 10:31:25.245208 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3bdf0109-5dcd-4def-9e78-2348125ddfb6 req-1cba23c7-1da3-4d7e-8643-fa1dcd88d8e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035800 Oct 27 10:31:25.246122 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3953/7831] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:25.868621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:25.869237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:25.876119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:25.876613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:25.877059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:25.877757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:25.878219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:25.878648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:26.015846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:26.023726 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b2ca93c-e088-4782-840d-0cdccec8b18b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1391 microversion: 2.1 time: 0.158955 Oct 27 10:31:26.024321 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3879/7832] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:25 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:27.047777 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:27.048495 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:27.055142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:27.055736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:27.056199 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:27.056909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:27.057384 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:27.057831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:27.192705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:27.200815 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-183b169a-7618-438e-af3a-2a07baa23ed0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1391 microversion: 2.1 time: 0.157826 Oct 27 10:31:27.201164 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3954/7833] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:27 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:28.223070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:28.223653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:28.231352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:28.231866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:28.232307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:28.232997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:28.233452 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:28.233877 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:28.368723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:28.376533 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b7993ef-4fcf-4df3-8636-3e2b890d55bf tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1391 microversion: 2.1 time: 0.157903 Oct 27 10:31:28.377097 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3880/7834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:28 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:29.399931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:29.400558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:29.406775 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:29.407305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:29.407803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:29.408507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:29.408976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:29.409416 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:29.540863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:29.549188 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fbae6f0c-10f5-4269-984d-1eb93c1b532c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1391 microversion: 2.1 time: 0.153241 Oct 27 10:31:29.549762 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3955/7835] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:29 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:30.573215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:30.573899 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:30.580951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:30.581370 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:30.581820 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:30.582539 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:30.583087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:30.583521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:30.726908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:30.734966 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e1fab90-098f-48cd-b853-c37ada4c4ee4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1391 microversion: 2.1 time: 0.165612 Oct 27 10:31:30.735551 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3881/7836] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:30 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:31.759320 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:31.759981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:31.767265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:31.767812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:31.768274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:31.769004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:31.769482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:31.769926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:31.912215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:31.920702 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-31ab5b46-2e7b-4243-b6c2-100ee2608dc5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1391 microversion: 2.1 time: 0.166080 Oct 27 10:31:31.921295 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3956/7837] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:31 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:31.994893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-94b3a72e-7f23-42c1-9229-d8155fb3b687 req-81f6af73-7d29-4fe1-8834-33f515829783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1ea509-bab5-4f19-bd3f-76eef1b328ec", "name": "network-vif-plugged", "status": "completed", "tag": "68b55321-c24c-4daf-888f-72cfa56e2a6d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:32.007349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-94b3a72e-7f23-42c1-9229-d8155fb3b687 req-81f6af73-7d29-4fe1-8834-33f515829783 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:32.007929 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-94b3a72e-7f23-42c1-9229-d8155fb3b687 req-81f6af73-7d29-4fe1-8834-33f515829783 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:32.008379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-94b3a72e-7f23-42c1-9229-d8155fb3b687 req-81f6af73-7d29-4fe1-8834-33f515829783 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:32.027112 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-94b3a72e-7f23-42c1-9229-d8155fb3b687 req-81f6af73-7d29-4fe1-8834-33f515829783 service nova] Creating event network-vif-plugged:68b55321-c24c-4daf-888f-72cfa56e2a6d for instance da1ea509-bab5-4f19-bd3f-76eef1b328ec on n-h2-858383-16 Oct 27 10:31:32.029729 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-94b3a72e-7f23-42c1-9229-d8155fb3b687 req-81f6af73-7d29-4fe1-8834-33f515829783 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038604 Oct 27 10:31:32.030449 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3882/7838] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:32.945665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:32.955868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:32.958085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:32.958781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:32.968528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:32.969303 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:32.969758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:32.970486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:32.970952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:32.971524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:33.117927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:33.126461 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-051fa004-510e-4fbc-9f59-33ce38daf890 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1391 microversion: 2.1 time: 0.186223 Oct 27 10:31:33.127096 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3957/7839] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:32 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1391 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:34.147356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:31:34.152474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:34.153340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:34.159844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:34.160336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:34.160872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:34.161510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:34.161972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:34.162402 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:34.297949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:34.311110 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf80244b-bb71-4b55-85db-f3625e1f6508 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1563 microversion: 2.1 time: 0.164748 Oct 27 10:31:34.311727 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3883/7840] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:34 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:34.337655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:34.338263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:34.344963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:34.345439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:34.345883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:34.346842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:34.347315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:34.347780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:34.489949 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:34.503089 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e764cdb2-7c6c-47c5-81dd-d2ba7cdc69c3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1563 microversion: 2.1 time: 0.168958 Oct 27 10:31:34.504144 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3958/7841] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:34 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:31:36.523062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:31:36.524088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:31:36.540453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:36.540944 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:36.541381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:36.542105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:36.542742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:36.543181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:36.635189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-713aca12-b65c-4537-ba6c-04281498bb45 req-d875184d-d591-4c7c-a083-8b877a3095e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1ea509-bab5-4f19-bd3f-76eef1b328ec", "tag": "68b55321-c24c-4daf-888f-72cfa56e2a6d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:31:36.645016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-713aca12-b65c-4537-ba6c-04281498bb45 req-d875184d-d591-4c7c-a083-8b877a3095e7 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:31:36.645544 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-713aca12-b65c-4537-ba6c-04281498bb45 req-d875184d-d591-4c7c-a083-8b877a3095e7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:31:36.646222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-713aca12-b65c-4537-ba6c-04281498bb45 req-d875184d-d591-4c7c-a083-8b877a3095e7 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:31:36.660668 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-713aca12-b65c-4537-ba6c-04281498bb45 req-d875184d-d591-4c7c-a083-8b877a3095e7 service nova] Creating event network-changed:68b55321-c24c-4daf-888f-72cfa56e2a6d for instance da1ea509-bab5-4f19-bd3f-76eef1b328ec on n-h2-858383-16 Oct 27 10:31:36.666093 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-713aca12-b65c-4537-ba6c-04281498bb45 req-d875184d-d591-4c7c-a083-8b877a3095e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134076 Oct 27 10:31:36.666093 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3959/7842] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:31:36.700056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:31:36.708009 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf7e2617-f0e0-4663-b428-b8f0cd9a603f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1563 microversion: 2.1 time: 0.190108 Oct 27 10:31:36.708930 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3884/7843] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:31:36 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:32:08.005897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:08.006668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=42 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:08.057318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cf5fd248-f2c4-4f32-bb29-dd9ade87d493 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:08.059659 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-cf5fd248-f2c4-4f32-bb29-dd9ade87d493 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:08.065893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5fd248-f2c4-4f32-bb29-dd9ade87d493 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:08.067163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5fd248-f2c4-4f32-bb29-dd9ade87d493 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:08.067900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5fd248-f2c4-4f32-bb29-dd9ade87d493 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:08.068920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5fd248-f2c4-4f32-bb29-dd9ade87d493 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:08.069411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5fd248-f2c4-4f32-bb29-dd9ade87d493 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:08.069858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-cf5fd248-f2c4-4f32-bb29-dd9ade87d493 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:08.138457 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cf5fd248-f2c4-4f32-bb29-dd9ade87d493 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec/action" status: 200 len: 24569 microversion: 2.1 time: 0.138560 Oct 27 10:32:08.139107 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3960/7844] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:32:07 2022] POST /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec/action => generated 24569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:32:47.250429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:47.251498 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=38 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:47.253463 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:32:47.253679 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec/action (ip 10.222.0.25) !!! Oct 27 10:32:47.259530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:32:47.262022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:47.271597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:47.272056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:47.272510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:47.273293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:47.273772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:47.274215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:47.375880 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:47.382799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Old instance type m1.heat2, new instance type m1.heat {{(pid=120603) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 27 10:32:47.390682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:32:47.391110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:32:47.391625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:32:47.392053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:32:47.392478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:32:47.468030 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f76dba46-f9eb-4b74-8823-0d5efccbd4d7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec/action" status: 202 len: 0 microversion: 2.1 time: 0.219590 Oct 27 10:32:47.468663 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3885/7845] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:32:47 2022] POST /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:32:47.482971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:47.484234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:47.488351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:47.490892 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:32:47.503236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:47.503958 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:47.504580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:47.505800 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:47.506703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:47.507181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:47.689019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:47.701494 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-22af056e-e41f-44ca-8ab0-f7ca807d3344 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1691 microversion: 2.1 time: 0.226287 Oct 27 10:32:47.702218 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3961/7846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:47 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1691 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:48.727834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:48.728479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:48.735667 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:48.736237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:48.736743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:48.738061 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:48.738530 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:48.739220 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:48.877302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:48.885178 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6ef0f38-d505-4652-8d68-467a0fb9f854 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1691 microversion: 2.1 time: 0.162825 Oct 27 10:32:48.885782 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3886/7847] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:48 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:32:49.908511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:49.909773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:49.916920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:49.917429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:49.917890 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:49.918616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:49.919088 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:49.919536 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:50.066177 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:50.074412 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6177978f-357f-4ad5-b023-531c669c29ee tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.169774 Oct 27 10:32:50.075002 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3962/7848] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:49 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:51.099129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:51.099799 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:51.106620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:51.107104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:51.107540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:51.108266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:51.108720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:51.109147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:51.241890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:51.249651 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c38c0f4a-ceee-4509-b221-0c295d8a7ef8 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.155260 Oct 27 10:32:51.250226 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3887/7849] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:51 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:52.274094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:52.274768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:52.282146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:52.282656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:52.283148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:52.283935 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:52.284488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:52.284918 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:52.756654 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:52.764491 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ae36d39-e6c5-4292-bdf8-2c4d56d0b55d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.494339 Oct 27 10:32:52.765061 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3963/7850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:52 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:53.788678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:53.789312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:53.795726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:53.796213 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:53.796655 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:53.797358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:53.797815 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:53.798239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:53.938113 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:53.946431 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bbcfdf0e-9167-44da-a4ef-e7a633d21cf4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.162595 Oct 27 10:32:53.947032 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3888/7851] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:53 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:54.970268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:54.970895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:54.978434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:54.978937 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:54.979400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:54.980137 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:54.980621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:54.981049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:55.122809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:55.130930 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-522991fb-aac1-40e6-9ec1-3fd5fc334916 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.164464 Oct 27 10:32:55.131524 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3964/7852] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:54 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:56.154334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:56.154949 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:56.163095 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:56.163603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:56.164050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:56.164746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:56.165206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:56.165635 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:56.301046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:56.308975 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e01037c-fbb0-4d4b-922c-9813ff93c6dc tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.158603 Oct 27 10:32:56.309562 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3889/7853] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:56 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:57.332493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:57.333116 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:57.340039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:57.340533 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:57.341004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:57.341695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:57.342157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:57.342593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:57.474290 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:57.481984 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c449975-440f-4d7d-a2a7-3ff75773c21e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.153511 Oct 27 10:32:57.482552 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3965/7854] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:57 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:58.505630 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:58.506286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:58.513169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.513678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.514106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.514867 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:58.515266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:58.515726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:58.664092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:58.672979 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6411436f-603c-4ab9-abe9-95025b1057c1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.171889 Oct 27 10:32:58.673579 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3890/7855] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:58 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:32:59.697781 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:32:59.698363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:32:59.704510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:59.705008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:59.705466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:59.706752 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:32:59.707221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:32:59.707688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:32:59.868268 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:32:59.877195 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f6f4951-3596-4d66-9a4d-63eb9f252c34 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.183704 Oct 27 10:32:59.877939 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3966/7856] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:32:59 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:00.899920 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:00.900543 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:00.907362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:00.907885 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:00.908333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:00.909598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:00.910053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:00.910481 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:01.053791 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:01.061524 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-361722ef-2968-41b0-a586-824bb8cb8cdb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1696 microversion: 2.1 time: 0.165611 Oct 27 10:33:01.062104 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3891/7857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:00 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:02.085733 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:02.086411 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:02.093361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:02.093868 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:02.094330 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:02.095052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:02.095524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:02.096008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:02.246543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:02.256385 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-26a8effd-2adc-41f0-b19f-197f09e65ac5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1695 microversion: 2.1 time: 0.174656 Oct 27 10:33:02.257146 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3967/7858] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:02 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:02.461285 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3d863299-51fe-463a-b15d-3783ca53f27e req-363274ac-584a-4603-8b0f-a009f618a162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1ea509-bab5-4f19-bd3f-76eef1b328ec", "name": "network-vif-unplugged", "status": "completed", "tag": "68b55321-c24c-4daf-888f-72cfa56e2a6d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:02.471973 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3d863299-51fe-463a-b15d-3783ca53f27e req-363274ac-584a-4603-8b0f-a009f618a162 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:02.472728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3d863299-51fe-463a-b15d-3783ca53f27e req-363274ac-584a-4603-8b0f-a009f618a162 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:02.473221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3d863299-51fe-463a-b15d-3783ca53f27e req-363274ac-584a-4603-8b0f-a009f618a162 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:02.486305 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3d863299-51fe-463a-b15d-3783ca53f27e req-363274ac-584a-4603-8b0f-a009f618a162 service nova] Creating event network-vif-unplugged:68b55321-c24c-4daf-888f-72cfa56e2a6d for instance da1ea509-bab5-4f19-bd3f-76eef1b328ec on n-h1-858383-16 Oct 27 10:33:02.492020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [req-3d863299-51fe-463a-b15d-3783ca53f27e req-363274ac-584a-4603-8b0f-a009f618a162 service nova] Instance da1ea509-bab5-4f19-bd3f-76eef1b328ec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120603) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:33:02.504153 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3d863299-51fe-463a-b15d-3783ca53f27e req-363274ac-584a-4603-8b0f-a009f618a162 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046392 Oct 27 10:33:02.504763 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3892/7859] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:03.280709 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:03.281344 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:03.288468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:03.288977 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:03.289435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:03.290207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:03.290681 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:03.291123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:03.429603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:03.437554 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f480f6e8-aa89-4c6f-9e69-4bc191d1b0e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1695 microversion: 2.1 time: 0.160919 Oct 27 10:33:03.438140 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3968/7860] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:03 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:04.463281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:04.463923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:04.470141 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:04.470629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:04.471078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:04.472713 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:04.473177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:04.473637 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:04.549840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-479dde5a-3a4b-4c50-bb9e-7fff50d913b7 req-204cdcff-1cee-438d-b47f-4cc16d39cc79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1ea509-bab5-4f19-bd3f-76eef1b328ec", "tag": "68b55321-c24c-4daf-888f-72cfa56e2a6d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:04.560432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-479dde5a-3a4b-4c50-bb9e-7fff50d913b7 req-204cdcff-1cee-438d-b47f-4cc16d39cc79 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:04.560924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-479dde5a-3a4b-4c50-bb9e-7fff50d913b7 req-204cdcff-1cee-438d-b47f-4cc16d39cc79 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:04.561375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-479dde5a-3a4b-4c50-bb9e-7fff50d913b7 req-204cdcff-1cee-438d-b47f-4cc16d39cc79 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:04.575000 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-479dde5a-3a4b-4c50-bb9e-7fff50d913b7 req-204cdcff-1cee-438d-b47f-4cc16d39cc79 service nova] Creating event network-changed:68b55321-c24c-4daf-888f-72cfa56e2a6d for instance da1ea509-bab5-4f19-bd3f-76eef1b328ec on n-h1-858383-16 Oct 27 10:33:04.581572 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [req-479dde5a-3a4b-4c50-bb9e-7fff50d913b7 req-204cdcff-1cee-438d-b47f-4cc16d39cc79 service nova] Instance da1ea509-bab5-4f19-bd3f-76eef1b328ec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-16', 'n-h1-858383-16'} {{(pid=120602) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 27 10:33:04.593973 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-479dde5a-3a4b-4c50-bb9e-7fff50d913b7 req-204cdcff-1cee-438d-b47f-4cc16d39cc79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047920 Oct 27 10:33:04.595058 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3969/7861] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:04.611235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:04.619024 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ee0f23e7-857b-4948-b8ee-a48672a61d8c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1693 microversion: 2.1 time: 0.160889 Oct 27 10:33:04.619613 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3893/7862] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:04 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:05.643891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:05.644526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:05.650748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:05.651255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:05.651744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:05.652464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:05.652947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:05.653417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:05.800300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:05.808223 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57bfdf5e-7e1b-47a2-a456-44201f92bb88 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1693 microversion: 2.1 time: 0.169568 Oct 27 10:33:05.808812 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3970/7863] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:05 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:06.831515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:06.832294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:06.839372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:06.839904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:06.840545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:06.841347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:06.841804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:06.842235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:06.998473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:07.006323 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2efc020-6e0c-4d3c-a028-ce937bd10f47 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1690 microversion: 2.1 time: 0.178794 Oct 27 10:33:07.006905 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3894/7864] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:06 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:07.029159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f38778f-4f38-4771-bd58-ad6d78da2980 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:07.029817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f38778f-4f38-4771-bd58-ad6d78da2980 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:07.037460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f38778f-4f38-4771-bd58-ad6d78da2980 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:07.038068 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f38778f-4f38-4771-bd58-ad6d78da2980 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:07.038601 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f38778f-4f38-4771-bd58-ad6d78da2980 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:07.039403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f38778f-4f38-4771-bd58-ad6d78da2980 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:07.039974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f38778f-4f38-4771-bd58-ad6d78da2980 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:07.040491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f38778f-4f38-4771-bd58-ad6d78da2980 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:07.106442 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f38778f-4f38-4771-bd58-ad6d78da2980 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec/action" status: 204 len: 0 microversion: 2.1 time: 0.081014 Oct 27 10:33:07.107122 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3971/7865] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:33:07 2022] POST /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:33:07.116081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:07.116696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:07.122575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:07.123181 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:07.123673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:07.124503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:07.124970 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:07.125385 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:07.343060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:07.352408 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9dafed78-3dce-402a-adc7-20c81e03bd4e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1690 microversion: 2.1 time: 0.240832 Oct 27 10:33:07.352991 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3895/7866] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:07 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:33:07.374839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:07.375558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:07.381852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:07.382354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:07.382816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:07.383524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:07.384031 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:07.384477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:07.620203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:07.628595 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-64f56610-b33f-445c-9188-56fb4d862c40 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1690 microversion: 2.1 time: 0.257946 Oct 27 10:33:07.629182 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3972/7867] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:07 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1690 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:08.466414 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8c51985f-1141-4ad1-acb1-11f9d8c884ef req-2afa7277-04f7-41f5-ab76-8158277dfffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1ea509-bab5-4f19-bd3f-76eef1b328ec", "name": "network-vif-plugged", "status": "completed", "tag": "68b55321-c24c-4daf-888f-72cfa56e2a6d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:08.479357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8c51985f-1141-4ad1-acb1-11f9d8c884ef req-2afa7277-04f7-41f5-ab76-8158277dfffc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:08.479896 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8c51985f-1141-4ad1-acb1-11f9d8c884ef req-2afa7277-04f7-41f5-ab76-8158277dfffc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:08.480342 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8c51985f-1141-4ad1-acb1-11f9d8c884ef req-2afa7277-04f7-41f5-ab76-8158277dfffc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:08.494876 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8c51985f-1141-4ad1-acb1-11f9d8c884ef req-2afa7277-04f7-41f5-ab76-8158277dfffc service nova] Creating event network-vif-plugged:68b55321-c24c-4daf-888f-72cfa56e2a6d for instance da1ea509-bab5-4f19-bd3f-76eef1b328ec on n-h1-858383-16 Oct 27 10:33:08.500965 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8c51985f-1141-4ad1-acb1-11f9d8c884ef req-2afa7277-04f7-41f5-ab76-8158277dfffc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093427 Oct 27 10:33:08.501679 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3896/7868] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:33:08.652621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:33:08.653375 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:08.661434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:08.661946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:08.662402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:08.663127 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:08.663795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:08.664243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:08.799839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:33:08.808168 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-39ce6584-cc71-480f-8916-eea974f61563 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1682 microversion: 2.1 time: 0.159623 Oct 27 10:33:08.808754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3973/7869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:33:08 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:33:41.034067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=28 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:41.034821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:33:41.039144 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c034e0a-c55c-4639-bd7c-e30c9e258bcd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:33:41.041420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c034e0a-c55c-4639-bd7c-e30c9e258bcd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:33:41.049695 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c034e0a-c55c-4639-bd7c-e30c9e258bcd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:41.050214 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c034e0a-c55c-4639-bd7c-e30c9e258bcd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:41.050658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c034e0a-c55c-4639-bd7c-e30c9e258bcd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:41.051365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c034e0a-c55c-4639-bd7c-e30c9e258bcd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:33:41.051868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c034e0a-c55c-4639-bd7c-e30c9e258bcd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:33:41.052302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c034e0a-c55c-4639-bd7c-e30c9e258bcd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:33:41.108574 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c034e0a-c55c-4639-bd7c-e30c9e258bcd tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec/action" status: 200 len: 24575 microversion: 2.1 time: 0.076468 Oct 27 10:33:41.109245 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3897/7870] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:33:41 2022] POST /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec/action => generated 24575 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:34:04.991030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:04.991030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:04.992024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-761fb689-7db7-4d0e-b3ab-90a4d1ebb1d9 req-69d13303-c46b-4e9c-a170-c556c4e60654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1ea509-bab5-4f19-bd3f-76eef1b328ec", "tag": "68b55321-c24c-4daf-888f-72cfa56e2a6d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:04.995888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=26 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:04.996897 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:04.998555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:04.999236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:05.002708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:05.003435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:05.004451 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:05.005589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:05.005781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-761fb689-7db7-4d0e-b3ab-90a4d1ebb1d9 req-69d13303-c46b-4e9c-a170-c556c4e60654 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:05.006254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-761fb689-7db7-4d0e-b3ab-90a4d1ebb1d9 req-69d13303-c46b-4e9c-a170-c556c4e60654 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:05.006426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:05.006967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:05.007098 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-761fb689-7db7-4d0e-b3ab-90a4d1ebb1d9 req-69d13303-c46b-4e9c-a170-c556c4e60654 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:05.020911 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-761fb689-7db7-4d0e-b3ab-90a4d1ebb1d9 req-69d13303-c46b-4e9c-a170-c556c4e60654 service nova] Creating event network-changed:68b55321-c24c-4daf-888f-72cfa56e2a6d for instance da1ea509-bab5-4f19-bd3f-76eef1b328ec on n-h1-858383-16 Oct 27 10:34:05.026288 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-761fb689-7db7-4d0e-b3ab-90a4d1ebb1d9 req-69d13303-c46b-4e9c-a170-c556c4e60654 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041229 Oct 27 10:34:05.027407 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3898/7871] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:05.042229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:34:05.151321 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0f8ea97b-7e33-4b7b-b08d-7e10ea45c976 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 204 len: 0 microversion: 2.1 time: 0.168510 Oct 27 10:34:05.152376 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3974/7872] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:34:04 2022] DELETE /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:34:05.164105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:05.165110 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:05.174357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:05.175054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:05.175515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:05.177462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:05.177462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:05.177813 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:05.343545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:05.352917 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3680eca2-65ba-4ef2-bb4f-79f9853237a4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1688 microversion: 2.1 time: 0.194097 Oct 27 10:34:05.353920 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3899/7873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:05 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:06.379009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:06.379944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:06.387169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:06.387844 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:06.388549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:06.389500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:06.390157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:06.390782 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:06.532969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:06.540987 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aa9697fe-a09a-4c5a-a0fd-e35842fd4003 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1688 microversion: 2.1 time: 0.167243 Oct 27 10:34:06.541562 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3975/7874] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:06 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:07.158052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-06ee4b81-07d1-4eb6-9893-df3825d76cbc req-18cde027-d641-4e00-9d2a-37c8deb492fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1ea509-bab5-4f19-bd3f-76eef1b328ec", "name": "network-vif-deleted", "tag": "68b55321-c24c-4daf-888f-72cfa56e2a6d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:07.168388 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06ee4b81-07d1-4eb6-9893-df3825d76cbc req-18cde027-d641-4e00-9d2a-37c8deb492fa service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:07.168905 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06ee4b81-07d1-4eb6-9893-df3825d76cbc req-18cde027-d641-4e00-9d2a-37c8deb492fa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:07.169492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06ee4b81-07d1-4eb6-9893-df3825d76cbc req-18cde027-d641-4e00-9d2a-37c8deb492fa service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:07.182437 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-06ee4b81-07d1-4eb6-9893-df3825d76cbc req-18cde027-d641-4e00-9d2a-37c8deb492fa service nova] Creating event network-vif-deleted:68b55321-c24c-4daf-888f-72cfa56e2a6d for instance da1ea509-bab5-4f19-bd3f-76eef1b328ec on n-h1-858383-16 Oct 27 10:34:07.187478 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-06ee4b81-07d1-4eb6-9893-df3825d76cbc req-18cde027-d641-4e00-9d2a-37c8deb492fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086513 Oct 27 10:34:07.188145 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3900/7875] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:07.564743 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:07.565510 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:07.572302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:07.572803 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:07.573263 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:07.573974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:07.574438 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:07.574874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:07.608117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:07.608662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:07.609118 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:07.609688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lazy-loading 'fault' on Instance uuid da1ea509-bab5-4f19-bd3f-76eef1b328ec {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:34:07.658689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:07.666166 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0802aceb-a72d-4ac3-a77c-1b96dd3be1e2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 200 len: 1355 microversion: 2.1 time: 0.105911 Oct 27 10:34:07.666752 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3976/7876] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:07 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:08.691540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:08.692288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: da1ea509-bab5-4f19-bd3f-76eef1b328ec] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:08.698933 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:08.699442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:08.699930 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:08.700671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:08.701138 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:08.701580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:08.719913 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] HTTP exception thrown: Instance da1ea509-bab5-4f19-bd3f-76eef1b328ec could not be found. Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Request method failure captured: Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec HTTP/1.1 Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWlznpjglSYA1CgEULfmM1zXhj4xb8pu96BHBDoCyOH7ngKASA76d-_1o2nfvuZzjMfCV3qRZcqaZePuM5poXlBXbGb9-PUJjjddlBlzvrla6ujwlt3YoDIypuNHOvB-lEs9METfJPyBL8aZUTp4ERHJ5QL9ZblfoZmh9Bz2h5P0nWYk Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f047fd54c1744ca98693fe4d24337fe"}]}] Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: d9cb615a635241008595a2b1f69b5a2b Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance da1ea509-bab5-4f19-bd3f-76eef1b328ec could not be found. Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'da1ea509-bab5-4f19-bd3f-76eef1b328ec'} Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da1ea509-bab5-4f19-bd3f-76eef1b328ec could not be found. Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da1ea509-bab5-4f19-bd3f-76eef1b328ec could not be found. Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:34:08.721598 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da1ea509-bab5-4f19-bd3f-76eef1b328ec could not be found. Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Returning 404 to user: Instance da1ea509-bab5-4f19-bd3f-76eef1b328ec could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9db599f-9647-474a-910b-0f08f14c8927 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec" status: 404 len: 111 microversion: 2.1 time: 0.037080 Oct 27 10:34:08.729767 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3901/7877] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:08 2022] GET /compute/v2.1/servers/da1ea509-bab5-4f19-bd3f-76eef1b328ec => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:34:12.362833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-44ccca96-6e44-4091-b2d6-ed77f38dfc49 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '.version_select at 0x7f31a9480f70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:12.386988 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-44ccca96-6e44-4091-b2d6-ed77f38dfc49 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-435316414" status: 202 len: 0 microversion: 2.1 time: 0.028226 Oct 27 10:34:12.388281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3977/7878] 10.222.0.25 () {58 vars in 1281 bytes} [Thu Oct 27 10:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-435316414 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:34:12.419950 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff4c1afe-6494-4be4-8681-31f9ba229da3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: .version_select at 0x7f31aa4e41f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2038919378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxfepd5PKjvXg40+m/+MPU6zubH0J4MEgzydZRt44Qq2H0KNtBM8JZ14WwJVVrFQChfBQZGnJGAiggnzwbGCAKO2aQHBAFnjQSQ6rgTs4V1Geo1xNmcjI40CSjfcZSppQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:12.438934 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ff4c1afe-6494-4be4-8681-31f9ba229da3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:34:12.444233 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-ff4c1afe-6494-4be4-8681-31f9ba229da3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:34:12.459133 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ff4c1afe-6494-4be4-8681-31f9ba229da3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [12add418-71b3-44ec-8361-2be2532364fd] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:34:13.467342 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [None req-ff4c1afe-6494-4be4-8681-31f9ba229da3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [12add418-71b3-44ec-8361-2be2532364fd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41684. Oct 27 10:34:13.484505 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff4c1afe-6494-4be4-8681-31f9ba229da3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.070600 Oct 27 10:34:13.485128 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3902/7879] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:34:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:34:19.446305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:19.450722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1010318749", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "8f485c3a-dc87-4152-a6af-298cb1094370"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2038919378", "security_groups": [{"name": "tempest-secgroup-smoke-517262581"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:19.578483 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] validate_networks() for [('8f485c3a-dc87-4152-a6af-298cb1094370', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:34:20.009472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:34:20.010472 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:34:20.010967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:34:20.011540 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:34:20.012200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:34:20.027310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:20.028865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:20.030606 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:20.033073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:20.036062 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:20.036716 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:20.068037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:34:20.074971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:34:20.092888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:34:20.096445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:34:20.169669 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f2e3ad21-ea09-41c1-bf95-cc40f9f2e559 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.725091 Oct 27 10:34:20.170718 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3978/7880] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:34:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:34:20.181947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d4a2da34-6eca-44d0-976b-fc1dceb62444 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:20.182540 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d4a2da34-6eca-44d0-976b-fc1dceb62444 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:20.185685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:20.249771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d4a2da34-6eca-44d0-976b-fc1dceb62444 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:20.263222 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d4a2da34-6eca-44d0-976b-fc1dceb62444 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1267 microversion: 2.1 time: 0.084952 Oct 27 10:34:20.264409 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3903/7881] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:20 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:21.287070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-828140fc-f321-4238-bdb6-e8eda26b662b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:21.287982 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-828140fc-f321-4238-bdb6-e8eda26b662b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:21.380253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-828140fc-f321-4238-bdb6-e8eda26b662b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:21.388518 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-828140fc-f321-4238-bdb6-e8eda26b662b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1267 microversion: 2.1 time: 0.105379 Oct 27 10:34:21.389111 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3979/7882] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:21 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:22.411849 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-724cbafc-129b-4fb4-b929-9440a54c3f30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:22.412477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-724cbafc-129b-4fb4-b929-9440a54c3f30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:22.482752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-724cbafc-129b-4fb4-b929-9440a54c3f30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:22.491137 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-724cbafc-129b-4fb4-b929-9440a54c3f30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1267 microversion: 2.1 time: 0.082991 Oct 27 10:34:22.491910 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3904/7883] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:22 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:23.515133 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4913d9ce-c40c-4fc8-afcd-c4d6a2776f36 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:23.515810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4913d9ce-c40c-4fc8-afcd-c4d6a2776f36 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:23.572278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4913d9ce-c40c-4fc8-afcd-c4d6a2776f36 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:23.585892 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4913d9ce-c40c-4fc8-afcd-c4d6a2776f36 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1267 microversion: 2.1 time: 0.074757 Oct 27 10:34:23.586495 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3980/7884] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:23 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:24.623392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:24.624324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:24.632886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:24.633390 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:24.633840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.634569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:24.635028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:24.635781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:24.761331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:24.769533 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5ab61bf-a4a6-45b6-b28b-a1c29486d204 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1325 microversion: 2.1 time: 0.150216 Oct 27 10:34:24.770125 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3905/7885] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:24 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1325 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:25.793608 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:25.794267 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:25.801485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.802114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.802579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:25.803306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:25.803812 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:25.804260 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:26.058215 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:26.066725 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4a98c48b-34a4-46c9-944c-8f5c7713a4a3 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1392 microversion: 2.1 time: 0.277295 Oct 27 10:34:26.067323 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3981/7886] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:25 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1392 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:26.212766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-4ba3fe8b-0b8e-40c2-9d17-127d26ffa893 req-24f834c6-66aa-4207-8ce3-5b0bcfb0ccb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922a6b34-fcdb-4580-a2dd-bfa0e8533ca9", "tag": "967ff174-9056-43b5-84f6-572a744551c5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:26.235169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4ba3fe8b-0b8e-40c2-9d17-127d26ffa893 req-24f834c6-66aa-4207-8ce3-5b0bcfb0ccb2 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:26.235692 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4ba3fe8b-0b8e-40c2-9d17-127d26ffa893 req-24f834c6-66aa-4207-8ce3-5b0bcfb0ccb2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:26.236165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4ba3fe8b-0b8e-40c2-9d17-127d26ffa893 req-24f834c6-66aa-4207-8ce3-5b0bcfb0ccb2 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:26.248943 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-4ba3fe8b-0b8e-40c2-9d17-127d26ffa893 req-24f834c6-66aa-4207-8ce3-5b0bcfb0ccb2 service nova] Creating event network-changed:967ff174-9056-43b5-84f6-572a744551c5 for instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 on n-h1-858383-16 Oct 27 10:34:26.256315 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-4ba3fe8b-0b8e-40c2-9d17-127d26ffa893 req-24f834c6-66aa-4207-8ce3-5b0bcfb0ccb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048036 Oct 27 10:34:26.256952 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3906/7887] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:27.089940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:27.090503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:27.097506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:27.098274 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:27.098724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:27.099440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:27.099936 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:27.100378 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:27.249667 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:27.260843 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1c2e8766-3003-4660-97dd-757bd894c65f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1392 microversion: 2.1 time: 0.174831 Oct 27 10:34:27.261654 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3982/7888] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:27 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:28.288097 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:28.288807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:28.296148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:28.297316 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:28.297980 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:28.298691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:28.299148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:28.299600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:28.443833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:28.451731 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2641c6d6-20d0-4b27-bd90-cfb5449eb2d0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1392 microversion: 2.1 time: 0.169602 Oct 27 10:34:28.452332 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3907/7889] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:28 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:29.475279 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:29.475973 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:29.482205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:29.482701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:29.483195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:29.483943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:29.484524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:29.484968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:29.626077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:29.633793 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-46f6edea-ca11-4795-90f2-3522d700b596 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1392 microversion: 2.1 time: 0.163152 Oct 27 10:34:29.634362 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3983/7890] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:29 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:30.657801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:30.658422 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:30.665169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:30.665703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:30.666100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:30.666803 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:30.667295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:30.667757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:30.805864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:30.814638 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8e79393-35e7-4609-b3c5-e62c93797034 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1392 microversion: 2.1 time: 0.161634 Oct 27 10:34:30.815237 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3908/7891] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:30 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:31.838315 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:31.838967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:31.840837 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:31.847592 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.848339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.848851 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.849507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:31.849974 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:31.850414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:31.989423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:31.997717 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bf1e769b-c4b2-491e-8a07-2fca61af6e2d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1392 microversion: 2.1 time: 0.163348 Oct 27 10:34:31.998296 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3984/7892] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:31 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:32.799800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7b9b57ed-6b7d-4ccf-adc6-50da674b8a34 req-73f1363b-6981-4c59-9ee5-30c472158ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922a6b34-fcdb-4580-a2dd-bfa0e8533ca9", "name": "network-vif-plugged", "status": "completed", "tag": "967ff174-9056-43b5-84f6-572a744551c5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:32.805972 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:32.813407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7b9b57ed-6b7d-4ccf-adc6-50da674b8a34 req-73f1363b-6981-4c59-9ee5-30c472158ecc service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:32.813903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7b9b57ed-6b7d-4ccf-adc6-50da674b8a34 req-73f1363b-6981-4c59-9ee5-30c472158ecc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:32.814338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7b9b57ed-6b7d-4ccf-adc6-50da674b8a34 req-73f1363b-6981-4c59-9ee5-30c472158ecc service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:32.825755 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-7b9b57ed-6b7d-4ccf-adc6-50da674b8a34 req-73f1363b-6981-4c59-9ee5-30c472158ecc service nova] Creating event network-vif-plugged:967ff174-9056-43b5-84f6-572a744551c5 for instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 on n-h1-858383-16 Oct 27 10:34:32.832226 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7b9b57ed-6b7d-4ccf-adc6-50da674b8a34 req-73f1363b-6981-4c59-9ee5-30c472158ecc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035749 Oct 27 10:34:32.832860 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3909/7893] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:33.020642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:33.021189 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:33.028443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.028947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.029400 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:33.030115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:33.030583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:33.031021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:33.170414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:33.179009 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-729d1b73-961d-4f02-9a6a-28c9043b557e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1392 microversion: 2.1 time: 0.162407 Oct 27 10:34:33.179609 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3985/7894] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:33 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:34.203561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:34.204294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:34.210519 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:34.211009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:34.211448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:34.212170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:34.212628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:34.213052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:34.353397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:34.362331 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a058394-9146-4f04-a25d-bb97d0a016b5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1392 microversion: 2.1 time: 0.164262 Oct 27 10:34:34.363022 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3910/7895] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:34 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:34:35.386221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:35.386862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:35.388746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=10 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:35.390292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:35.396986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:35.397468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:35.397923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:35.398640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:35.399109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:35.399552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:35.536049 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:35.544022 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-feee8960-1ae7-45da-a54a-d60edc89799b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1565 microversion: 2.1 time: 0.161658 Oct 27 10:34:35.544626 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3986/7896] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:35 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:35.566814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:35.567403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:35.570272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:34:35.576007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:35.576490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:35.576927 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:35.577623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:35.578078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:35.578507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:35.717440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:35.726476 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d65fd905-d40c-4156-8aeb-d16285bbdc30 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1565 microversion: 2.1 time: 0.163435 Oct 27 10:34:35.727087 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3911/7897] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:35 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:34:37.340975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:34:37.342214 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:34:37.350057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-88c64f7a-55bd-44b2-8162-51a6efebc334 req-67c76e03-11fd-48bc-8dd8-0f335c78da09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922a6b34-fcdb-4580-a2dd-bfa0e8533ca9", "tag": "967ff174-9056-43b5-84f6-572a744551c5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:34:37.350621 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:37.350883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:37.351321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:37.352081 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:37.352556 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:37.353004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:37.362517 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-88c64f7a-55bd-44b2-8162-51a6efebc334 req-67c76e03-11fd-48bc-8dd8-0f335c78da09 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:34:37.363009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-88c64f7a-55bd-44b2-8162-51a6efebc334 req-67c76e03-11fd-48bc-8dd8-0f335c78da09 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:34:37.363447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-88c64f7a-55bd-44b2-8162-51a6efebc334 req-67c76e03-11fd-48bc-8dd8-0f335c78da09 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:34:37.375988 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-88c64f7a-55bd-44b2-8162-51a6efebc334 req-67c76e03-11fd-48bc-8dd8-0f335c78da09 service nova] Creating event network-changed:967ff174-9056-43b5-84f6-572a744551c5 for instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 on n-h1-858383-16 Oct 27 10:34:37.381442 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-88c64f7a-55bd-44b2-8162-51a6efebc334 req-67c76e03-11fd-48bc-8dd8-0f335c78da09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038309 Oct 27 10:34:37.382720 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3912/7898] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:34:37.584333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:34:37.592340 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d60b6796-bee2-4a6b-bcec-b22e278f40c6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1565 microversion: 2.1 time: 0.255236 Oct 27 10:34:37.593344 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3987/7899] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:34:37 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:11.255945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a3379b5-fee0-475b-bc39-5fe7d834017d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:11.258362 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a3379b5-fee0-475b-bc39-5fe7d834017d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:11.260649 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:11.261301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=36 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:11.267249 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a3379b5-fee0-475b-bc39-5fe7d834017d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:11.267812 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a3379b5-fee0-475b-bc39-5fe7d834017d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:11.268263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a3379b5-fee0-475b-bc39-5fe7d834017d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:11.268975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a3379b5-fee0-475b-bc39-5fe7d834017d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:11.269434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a3379b5-fee0-475b-bc39-5fe7d834017d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:11.269873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a3379b5-fee0-475b-bc39-5fe7d834017d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:11.322635 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a3379b5-fee0-475b-bc39-5fe7d834017d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action" status: 200 len: 24570 microversion: 2.1 time: 0.071175 Oct 27 10:35:11.323602 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3913/7900] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:35:11 2022] POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:35:41.737177 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:35:41.737826 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:41.738418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=44 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:41.743073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b1c1013-0b2d-4923-afae-ec6c3b4df573 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:41.750583 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1c1013-0b2d-4923-afae-ec6c3b4df573 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:41.751083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1c1013-0b2d-4923-afae-ec6c3b4df573 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:41.751531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6b1c1013-0b2d-4923-afae-ec6c3b4df573 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:41.774151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b1c1013-0b2d-4923-afae-ec6c3b4df573 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Going to try to stop instance {{(pid=120602) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 10:35:41.818347 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b1c1013-0b2d-4923-afae-ec6c3b4df573 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.083083 Oct 27 10:35:41.818955 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3988/7901] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:35:41 2022] POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:35:41.827887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:41.828601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:41.831364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:41.832254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:35:41.838747 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:41.839315 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:41.839816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:41.840537 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:41.840995 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:41.841426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:42.049492 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:42.057379 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb80c809-e345-4ded-ac20-b3fb2a98d5e0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1693 microversion: 2.1 time: 0.233838 Oct 27 10:35:42.057959 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3914/7902] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:41 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1693 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:43.083834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:43.084670 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:43.093684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:43.094191 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:43.094646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:43.095377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:43.095882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:43.096327 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:43.102363 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41824. Oct 27 10:35:43.283454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:43.291357 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c497d986-4310-47e7-9147-1a16a485aafb tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1693 microversion: 2.1 time: 0.214025 Oct 27 10:35:43.291964 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3989/7903] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:43 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1693 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:44.314757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:44.315380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:44.326780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:44.327292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:44.327781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:44.328579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:44.329001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:44.329731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:44.470535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:44.478907 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3af1d1ee-b32f-4119-9d1d-d5e3a386e099 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1693 microversion: 2.1 time: 0.168133 Oct 27 10:35:44.479427 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3915/7904] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:44 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:45.503740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:45.504360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:45.512405 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:45.512917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:45.513370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:45.514096 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:45.514565 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:45.515006 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:45.650706 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:45.658707 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66ab30a0-9256-40fe-87bb-773e177c67e6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1693 microversion: 2.1 time: 0.159501 Oct 27 10:35:45.659303 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3990/7905] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:45 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:35:46.682460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:46.683184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:46.690574 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:46.691209 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:46.691620 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:46.692344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:46.692829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:46.693245 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:46.842831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:46.852680 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea82a686-aca0-4c31-bb84-4e79caf3ea45 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1693 microversion: 2.1 time: 0.174083 Oct 27 10:35:46.853268 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3916/7906] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:46 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:47.878009 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:47.878622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:47.885640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:47.886143 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:47.886597 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:47.887326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:47.887896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:47.888340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:48.029205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:48.037673 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8470aee6-3b46-4413-9c4c-faef857b4fb5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1693 microversion: 2.1 time: 0.163536 Oct 27 10:35:48.038307 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3991/7907] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:47 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:49.061133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:49.061781 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:49.069397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:49.069893 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:49.070339 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:49.071051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:49.071513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:49.071969 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:49.213236 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:49.221258 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9315d635-580c-4d68-a55f-d7528f29149d tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1693 microversion: 2.1 time: 0.164150 Oct 27 10:35:49.222085 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3917/7908] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:49 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:50.244895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:50.245552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:50.253165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:50.253665 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:50.254125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:50.254840 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:50.255312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:50.255867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:50.396360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:50.411244 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2024d64b-ed10-4033-8bc4-37b977ad010c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1693 microversion: 2.1 time: 0.170215 Oct 27 10:35:50.411864 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3992/7909] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:50 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:51.435297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:51.435993 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:51.443549 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:51.444068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:51.444508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:51.445211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:51.445686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:51.446117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:51.579782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:51.587411 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6659c756-5cef-467e-842f-69ad535c3a14 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1693 microversion: 2.1 time: 0.156131 Oct 27 10:35:51.588008 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3918/7910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:51 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:52.610481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:52.611085 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:52.618334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:52.618831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:52.619280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:52.620020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:52.620484 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:52.620917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:52.764619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:52.773256 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-baf90e8d-51f6-41a7-ba57-893f7381f292 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1670 microversion: 2.1 time: 0.166749 Oct 27 10:35:52.773840 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3993/7911] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:52 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:53.876093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95778c88-aa80-459c-bd2f-b370c26bc932 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:53.878358 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95778c88-aa80-459c-bd2f-b370c26bc932 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:53.884618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95778c88-aa80-459c-bd2f-b370c26bc932 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:53.885112 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95778c88-aa80-459c-bd2f-b370c26bc932 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:53.885589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95778c88-aa80-459c-bd2f-b370c26bc932 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:53.886296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95778c88-aa80-459c-bd2f-b370c26bc932 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:53.886759 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95778c88-aa80-459c-bd2f-b370c26bc932 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:53.887190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95778c88-aa80-459c-bd2f-b370c26bc932 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:53.937798 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95778c88-aa80-459c-bd2f-b370c26bc932 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action" status: 200 len: 37668 microversion: 2.1 time: 0.065967 Oct 27 10:35:53.938466 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3919/7912] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:35:53 2022] POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action => generated 37668 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:35:53.950282 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-18e3abf8-71cb-4f11-8b42-087ad1bfb423 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:35:53.957205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18e3abf8-71cb-4f11-8b42-087ad1bfb423 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:53.957698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18e3abf8-71cb-4f11-8b42-087ad1bfb423 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:53.958144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-18e3abf8-71cb-4f11-8b42-087ad1bfb423 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:53.980642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-18e3abf8-71cb-4f11-8b42-087ad1bfb423 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Going to try to start instance {{(pid=120602) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 10:35:54.025291 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-18e3abf8-71cb-4f11-8b42-087ad1bfb423 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.078424 Oct 27 10:35:54.026218 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3994/7913] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:35:53 2022] POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:35:54.035780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:54.036585 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:54.044304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:54.044841 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:54.045269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:54.045982 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:54.047082 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:54.047592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:54.283066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:54.292595 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eae87d0b-67ce-42da-a7ac-720b4546c306 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1679 microversion: 2.1 time: 0.261558 Oct 27 10:35:54.293515 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3920/7914] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:54 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1679 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:35:55.318578 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:35:55.319287 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:35:55.325827 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:55.326332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:55.326785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:55.327524 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:35:55.328017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:35:55.328457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:35:55.466310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:35:55.474497 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ff750f33-29d9-4f28-af01-18bd56c634ba tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1683 microversion: 2.1 time: 0.161071 Oct 27 10:35:55.475072 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3995/7915] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:35:55 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:29.710772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d431367e-5924-4143-9fdb-ed7c589f56da tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:29.712981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d431367e-5924-4143-9fdb-ed7c589f56da tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:29.715699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=14 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:29.716313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=40 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:29.718348 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 27 10:36:29.720737 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:36:29.721056 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:36:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action (ip 10.222.0.25) !!! Oct 27 10:36:29.729356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d431367e-5924-4143-9fdb-ed7c589f56da tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:29.729855 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d431367e-5924-4143-9fdb-ed7c589f56da tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:29.730301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d431367e-5924-4143-9fdb-ed7c589f56da tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:29.731204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d431367e-5924-4143-9fdb-ed7c589f56da tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:29.731699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d431367e-5924-4143-9fdb-ed7c589f56da tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:29.732134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d431367e-5924-4143-9fdb-ed7c589f56da tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:29.801816 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d431367e-5924-4143-9fdb-ed7c589f56da tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action" status: 200 len: 62231 microversion: 2.1 time: 0.095053 Oct 27 10:36:29.802514 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3921/7916] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:36:29 2022] POST /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9/action => generated 62231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:36:46.876439 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:46.877063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:46.881399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=16 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:46.882158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:46.884194 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:46.885724 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:36:46.889306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:46.889934 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:46.890765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:46.892331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:46.892880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:46.893389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:46.926995 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:36:46.944000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1b7a8779-18d7-444e-ae23-2bfc8a382d71 req-23891db5-eea6-43f8-88a7-14c16f59d976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922a6b34-fcdb-4580-a2dd-bfa0e8533ca9", "tag": "967ff174-9056-43b5-84f6-572a744551c5"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:46.957611 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1b7a8779-18d7-444e-ae23-2bfc8a382d71 req-23891db5-eea6-43f8-88a7-14c16f59d976 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:46.957964 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1b7a8779-18d7-444e-ae23-2bfc8a382d71 req-23891db5-eea6-43f8-88a7-14c16f59d976 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:46.958687 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1b7a8779-18d7-444e-ae23-2bfc8a382d71 req-23891db5-eea6-43f8-88a7-14c16f59d976 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:46.973079 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1b7a8779-18d7-444e-ae23-2bfc8a382d71 req-23891db5-eea6-43f8-88a7-14c16f59d976 service nova] Creating event network-changed:967ff174-9056-43b5-84f6-572a744551c5 for instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 on n-h1-858383-16 Oct 27 10:36:46.981393 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1b7a8779-18d7-444e-ae23-2bfc8a382d71 req-23891db5-eea6-43f8-88a7-14c16f59d976 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106519 Oct 27 10:36:46.982905 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3922/7917] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:47.035854 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-80f08505-71e2-4783-96bc-47c9baeee660 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 204 len: 0 microversion: 2.1 time: 0.163643 Oct 27 10:36:47.039856 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3996/7918] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:36:46 2022] DELETE /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:36:47.052819 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:47.053625 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:47.061146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:47.061715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:47.062170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:47.063592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:47.064067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:47.064507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:47.212624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:47.221956 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f1bc3e2-cb43-4177-956d-5a2175f13a9f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1689 microversion: 2.1 time: 0.174745 Oct 27 10:36:47.222548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3923/7919] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:47 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:36:48.248404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:48.249034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:48.257018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:48.257169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:48.257614 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:48.258332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:48.258801 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:48.259305 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:48.474745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:48.484641 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-df06446a-d6d3-46ff-ba10-8000ab5049f6 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1689 microversion: 2.1 time: 0.240578 Oct 27 10:36:48.486383 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3997/7920] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:48 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1689 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:49.518439 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:49.519629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:49.530176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-325e1b52-641b-4946-bca7-7d988f8af406 req-2cc16326-dd7d-4fb1-82e6-6acbfca5eb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922a6b34-fcdb-4580-a2dd-bfa0e8533ca9", "name": "network-vif-deleted", "tag": "967ff174-9056-43b5-84f6-572a744551c5"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:49.535455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:49.537100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:49.537887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:49.541286 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:49.541447 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-325e1b52-641b-4946-bca7-7d988f8af406 req-2cc16326-dd7d-4fb1-82e6-6acbfca5eb39 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:49.541904 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-325e1b52-641b-4946-bca7-7d988f8af406 req-2cc16326-dd7d-4fb1-82e6-6acbfca5eb39 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:49.542117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:49.542346 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-325e1b52-641b-4946-bca7-7d988f8af406 req-2cc16326-dd7d-4fb1-82e6-6acbfca5eb39 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:49.542962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:49.554208 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-325e1b52-641b-4946-bca7-7d988f8af406 req-2cc16326-dd7d-4fb1-82e6-6acbfca5eb39 service nova] Creating event network-vif-deleted:967ff174-9056-43b5-84f6-572a744551c5 for instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 on n-h1-858383-16 Oct 27 10:36:49.559422 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-325e1b52-641b-4946-bca7-7d988f8af406 req-2cc16326-dd7d-4fb1-82e6-6acbfca5eb39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033221 Oct 27 10:36:49.560063 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3998/7921] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:36:49.631438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:36:49.639785 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9d99f60-f238-4a96-8bdd-ead909a56562 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 200 len: 1504 microversion: 2.1 time: 0.133016 Oct 27 10:36:49.640386 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3924/7922] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:49 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 1504 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:36:50.664737 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:50.665444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:36:50.671703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:50.672219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:50.672675 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:50.673372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:36:50.673841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:36:50.674278 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:36:50.691115 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] HTTP exception thrown: Instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 could not be found. Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Request method failure captured: Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 HTTP/1.1 Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlznpjglSYA1CgEULfmM1zXhj4xb8pu96BHBDoCyOH7ngKASA76d-_1o2nfvuZzjMfCV3qRZcqaZePuM5poXlBXbGb9-PUJjjddlBlzvrla6ujwlt3YoDIypuNHOvB-lEs9METfJPyBL8aZUTp4ERHJ5QL9ZblfoZmh9Bz2h5P0nWYk Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f047fd54c1744ca98693fe4d24337fe"}]}] Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: d9cb615a635241008595a2b1f69b5a2b Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 could not be found. Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '922a6b34-fcdb-4580-a2dd-bfa0e8533ca9'} Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 could not be found. Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 could not be found. Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:36:50.692783 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 could not be found. Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Returning 404 to user: Instance 922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f0dd0e14-489a-4328-b83d-394b03964ac2 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9" status: 404 len: 111 microversion: 2.1 time: 0.034664 Oct 27 10:36:50.698672 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 3999/7923] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:36:50 2022] GET /compute/v2.1/servers/922a6b34-fcdb-4580-a2dd-bfa0e8533ca9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:36:54.178603 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8cb4e4b-ba7f-4793-b0b0-be867bc3b04a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '.version_select at 0x7f31aa826790>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:36:54.210223 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8cb4e4b-ba7f-4793-b0b0-be867bc3b04a tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2038919378" status: 202 len: 0 microversion: 2.1 time: 0.035360 Oct 27 10:36:54.210961 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3925/7924] 10.222.0.25 () {58 vars in 1284 bytes} [Thu Oct 27 10:36:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2038919378 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:36:54.248581 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5ee1958d-3a19-4de3-907d-23579b53e8c0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: .version_select at 0x7f31a9d0eca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-490113907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuQISEq5LTqiLDTK3vA7AvlUq/J8m6vLze2j17DjsABr1JctyBQi9sEKv228Zx4tlC+AiQE45vciZKF3WmJsjqXegwVGVuhD0PE+NubDceic+Nc8D/8ZZJFOZgNPkwAtg=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:36:54.267920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5ee1958d-3a19-4de3-907d-23579b53e8c0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:36:54.274952 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-5ee1958d-3a19-4de3-907d-23579b53e8c0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:36:54.290366 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ee1958d-3a19-4de3-907d-23579b53e8c0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [e73a6fbf-08ce-4173-adca-11259d20346d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:36:55.298549 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [None req-5ee1958d-3a19-4de3-907d-23579b53e8c0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [e73a6fbf-08ce-4173-adca-11259d20346d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41910. Oct 27 10:36:55.313771 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5ee1958d-3a19-4de3-907d-23579b53e8c0 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.069055 Oct 27 10:36:55.314414 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4000/7925] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:36:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:01.697442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=14 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:01.702221 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1309438901", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "networks": [{"uuid": "db2489b4-47ce-4e00-a7b3-353ad8fe7c0d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-490113907", "security_groups": [{"name": "tempest-secgroup-smoke-1621392849"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:37:01.847017 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] validate_networks() for [('db2489b4-47ce-4e00-a7b3-353ad8fe7c0d', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:37:02.664659 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:37:02.665083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:37:02.666054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:37:02.666475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:37:02.666938 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:37:02.676771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:02.677254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:02.677907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:02.678638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:02.679096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:02.679520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:02.698951 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:37:02.704471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Getting quotas for user d9cb615a635241008595a2b1f69b5a2b and project 5f047fd54c1744ca98693fe4d24337fe. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:37:02.716878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:37:02.719737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:37:02.768137 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ad235f6-4b1e-465a-988a-4275996df19f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.072345 Oct 27 10:37:02.774780 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3926/7926] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:37:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:37:02.778258 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:02.783694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6b6a8924-8bb2-496b-89e8-0bb049cecaaa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:02.784326 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6b6a8924-8bb2-496b-89e8-0bb049cecaaa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:02.850357 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6b6a8924-8bb2-496b-89e8-0bb049cecaaa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:02.864854 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6b6a8924-8bb2-496b-89e8-0bb049cecaaa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1266 microversion: 2.1 time: 0.088362 Oct 27 10:37:02.866551 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4001/7927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:02 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:03.889392 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:03.890137 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:03.897581 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:03.898162 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:03.898703 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:03.899485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:03.900051 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:03.900547 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:03.967485 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:03.976061 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1e476d8-fb7d-4a28-8938-6745580b2de5 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1318 microversion: 2.1 time: 0.091409 Oct 27 10:37:03.977459 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3927/7928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:03 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1318 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:05.001710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:05.003011 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:05.012099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:05.012557 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:05.013240 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:05.013981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:05.014459 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:05.014907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:05.168589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:05.177141 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-709ab34e-c1e9-4e36-bd36-5d4282536c22 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1392 microversion: 2.1 time: 0.180209 Oct 27 10:37:05.177960 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4002/7929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:04 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:05.905434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a7661c59-bd39-46c9-82d8-954beb4f1db0 req-6634876b-8e12-4871-84cc-876725a63000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639f71f0-032d-4ec5-b77d-0efe163a1295", "tag": "25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:37:05.916569 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a7661c59-bd39-46c9-82d8-954beb4f1db0 req-6634876b-8e12-4871-84cc-876725a63000 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:05.917304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a7661c59-bd39-46c9-82d8-954beb4f1db0 req-6634876b-8e12-4871-84cc-876725a63000 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:05.917776 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a7661c59-bd39-46c9-82d8-954beb4f1db0 req-6634876b-8e12-4871-84cc-876725a63000 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:05.930601 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a7661c59-bd39-46c9-82d8-954beb4f1db0 req-6634876b-8e12-4871-84cc-876725a63000 service nova] Creating event network-changed:25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56 for instance 639f71f0-032d-4ec5-b77d-0efe163a1295 on n-h1-858383-16 Oct 27 10:37:05.936523 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a7661c59-bd39-46c9-82d8-954beb4f1db0 req-6634876b-8e12-4871-84cc-876725a63000 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034729 Oct 27 10:37:05.937454 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3928/7930] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:06.201920 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:06.203491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:06.209731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:06.209731 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:06.210911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:06.211394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:06.211891 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:06.212334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:06.375401 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:06.394404 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c611e6d-7e2c-41eb-9543-19d75d77e5c9 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1392 microversion: 2.1 time: 0.197253 Oct 27 10:37:06.395986 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4003/7931] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:06 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:07.421431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:07.422060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:07.428377 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:07.428873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:07.429320 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:07.430030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:07.430490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:07.430921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:07.571215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:07.578978 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48bce0c5-212c-4b2c-80c5-eeef75776057 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1392 microversion: 2.1 time: 0.162641 Oct 27 10:37:07.579435 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3929/7932] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:07 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:08.734205 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:08.735488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:08.741645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:08.742139 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:08.742589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:08.743294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:08.743794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:08.744228 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:08.890924 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:08.898838 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ff846d21-3d33-4ceb-8322-885b7b3c6b0e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1392 microversion: 2.1 time: 0.301094 Oct 27 10:37:08.899427 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4004/7933] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:08 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1392 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:09.923052 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:09.923699 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:09.930968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:09.931509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:09.931947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:09.932678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:09.933150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:09.933583 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:10.096118 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:10.104705 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1530b856-7594-41f9-93de-9212980c6458 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1392 microversion: 2.1 time: 0.186026 Oct 27 10:37:10.105662 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3930/7934] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:09 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:11.130164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:11.130834 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:11.138772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:11.139280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:11.139767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:11.141097 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:11.141563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:11.142000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:11.301265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:11.316822 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c4faf87c-527c-4a0d-a7b8-b9de48fa7058 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1392 microversion: 2.1 time: 0.189963 Oct 27 10:37:11.317898 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4005/7935] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:11 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:11.569206 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c2733ec4-04ff-49ec-a12f-703c3868aa09 req-832b43ea-b780-498a-a815-09f8ecfefb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639f71f0-032d-4ec5-b77d-0efe163a1295", "name": "network-vif-plugged", "status": "completed", "tag": "25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:37:11.580281 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c2733ec4-04ff-49ec-a12f-703c3868aa09 req-832b43ea-b780-498a-a815-09f8ecfefb0b service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:11.580775 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c2733ec4-04ff-49ec-a12f-703c3868aa09 req-832b43ea-b780-498a-a815-09f8ecfefb0b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:11.581217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c2733ec4-04ff-49ec-a12f-703c3868aa09 req-832b43ea-b780-498a-a815-09f8ecfefb0b service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:11.592640 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c2733ec4-04ff-49ec-a12f-703c3868aa09 req-832b43ea-b780-498a-a815-09f8ecfefb0b service nova] Creating event network-vif-plugged:25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56 for instance 639f71f0-032d-4ec5-b77d-0efe163a1295 on n-h1-858383-16 Oct 27 10:37:11.598297 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c2733ec4-04ff-49ec-a12f-703c3868aa09 req-832b43ea-b780-498a-a815-09f8ecfefb0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Oct 27 10:37:11.599297 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3931/7936] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:37:12.346696 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:12.347313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:12.354760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:12.355259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:12.355748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:12.356462 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:12.356928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:12.357368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:12.496229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:12.504689 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-e1209a74-f38a-4ba3-afe3-a92e757d6ed1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1392 microversion: 2.1 time: 0.162413 Oct 27 10:37:12.505258 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4006/7937] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:12 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:13.526448 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:13.527201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:13.532373 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:13.533105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:13.540262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:13.540752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:13.541195 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:13.541897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:13.542352 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:13.542777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:13.679727 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:13.687892 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-281579fe-6632-4b40-b3ea-4dddbb64bdae tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1565 microversion: 2.1 time: 0.163089 Oct 27 10:37:13.688494 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3932/7938] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:13 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:13.710423 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:13.711047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:13.713157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:13.719711 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:13.720216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:13.720695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:13.721413 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:13.721888 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:13.722329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:13.858023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:13.866042 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-123788dd-6d19-4f36-892b-d6a98dcee94c tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1565 microversion: 2.1 time: 0.159667 Oct 27 10:37:13.866635 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4007/7939] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:13 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:15.570401 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:37:15.571165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:15.573126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6cd8e3e5-864f-4662-aa0d-59cc4e5a3207 req-b05caa55-2bce-47df-91c7-112f3b156e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639f71f0-032d-4ec5-b77d-0efe163a1295", "tag": "25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:37:15.579942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:15.580454 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:15.581191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:15.581928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:15.582393 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:15.582829 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:15.585877 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6cd8e3e5-864f-4662-aa0d-59cc4e5a3207 req-b05caa55-2bce-47df-91c7-112f3b156e96 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:15.586499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6cd8e3e5-864f-4662-aa0d-59cc4e5a3207 req-b05caa55-2bce-47df-91c7-112f3b156e96 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:15.587037 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6cd8e3e5-864f-4662-aa0d-59cc4e5a3207 req-b05caa55-2bce-47df-91c7-112f3b156e96 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:15.599989 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6cd8e3e5-864f-4662-aa0d-59cc4e5a3207 req-b05caa55-2bce-47df-91c7-112f3b156e96 service nova] Creating event network-changed:25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56 for instance 639f71f0-032d-4ec5-b77d-0efe163a1295 on n-h1-858383-16 Oct 27 10:37:15.605787 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6cd8e3e5-864f-4662-aa0d-59cc4e5a3207 req-b05caa55-2bce-47df-91c7-112f3b156e96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036474 Oct 27 10:37:15.607000 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4008/7940] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:37:15.738871 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:37:15.755993 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cbd42543-de9a-4ffc-aff2-461c93909719 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1565 microversion: 2.1 time: 0.189610 Oct 27 10:37:15.757324 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3933/7941] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:37:15 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:37:49.056790 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:37:49.057475 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:37:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action (ip 10.222.0.25) !!! Oct 27 10:37:49.057967 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:49.058740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=38 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:37:49.063609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-059ebf50-830d-477f-aea5-35976689292e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:37:49.066027 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-059ebf50-830d-477f-aea5-35976689292e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:37:49.076013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059ebf50-830d-477f-aea5-35976689292e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:49.076516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059ebf50-830d-477f-aea5-35976689292e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:49.076970 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059ebf50-830d-477f-aea5-35976689292e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:49.077693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059ebf50-830d-477f-aea5-35976689292e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:37:49.078839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059ebf50-830d-477f-aea5-35976689292e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:37:49.079275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-059ebf50-830d-477f-aea5-35976689292e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:37:49.134290 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-059ebf50-830d-477f-aea5-35976689292e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action" status: 200 len: 24560 microversion: 2.1 time: 0.079761 Oct 27 10:37:49.134947 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4009/7942] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:37:49 2022] POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action => generated 24560 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:38:19.635663 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:19.636282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:19.638428 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:19.639093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=36 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:19.645719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:19.646211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:19.646653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:19.647368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:19.647852 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:19.648277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:19.675065 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lazy-loading 'flavor' on Instance uuid 639f71f0-032d-4ec5-b77d-0efe163a1295 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:38:19.751269 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ad811ce-7a0f-4afb-8b19-fb10431ad088 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action" status: 202 len: 0 microversion: 2.1 time: 0.120829 Oct 27 10:38:19.752074 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3934/7943] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:38:19 2022] POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:38:19.763551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:19.765969 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:19.769469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:19.770212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=4 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:19.776529 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:19.777045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:19.777506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:19.778236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:19.778714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:19.779160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:19.937683 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:19.946202 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-30123a90-c79b-4e6a-847b-f02952196fbe tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1692 microversion: 2.1 time: 0.187278 Oct 27 10:38:19.946819 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4010/7944] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:19 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1692 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:20.972282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:20.972994 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:20.979837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:20.980349 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:20.980794 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:20.981520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:20.981977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:20.982407 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:21.128015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:21.136503 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1eaa58d-c33e-4d90-b74d-8de1d98f16c7 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1692 microversion: 2.1 time: 0.170772 Oct 27 10:38:21.137103 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3935/7945] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:20 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:22.161175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:22.161919 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:22.169203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:22.169717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:22.170182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:22.171561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:22.172071 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:22.172518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:22.320521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:22.330016 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-98b1f1b7-2a65-49b4-82fb-940e6e41cb84 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1675 microversion: 2.1 time: 0.172711 Oct 27 10:38:22.330709 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4011/7946] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:22 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:23.433910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-84379050-7f97-4205-9f96-857cbdf2dcc4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:23.436314 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-84379050-7f97-4205-9f96-857cbdf2dcc4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:23.443203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84379050-7f97-4205-9f96-857cbdf2dcc4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:23.443735 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84379050-7f97-4205-9f96-857cbdf2dcc4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:23.444238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84379050-7f97-4205-9f96-857cbdf2dcc4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:23.445057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84379050-7f97-4205-9f96-857cbdf2dcc4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:23.445640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84379050-7f97-4205-9f96-857cbdf2dcc4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:23.446130 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-84379050-7f97-4205-9f96-857cbdf2dcc4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:23.508007 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-84379050-7f97-4205-9f96-857cbdf2dcc4 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action" status: 200 len: 36556 microversion: 2.1 time: 0.078034 Oct 27 10:38:23.508987 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3936/7947] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:38:23 2022] POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action => generated 36556 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 10:38:23.525944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-588312f6-7296-4a4a-9545-7d563fa81768 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:23.526631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-588312f6-7296-4a4a-9545-7d563fa81768 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:23.534649 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588312f6-7296-4a4a-9545-7d563fa81768 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:23.535156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588312f6-7296-4a4a-9545-7d563fa81768 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:23.535638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588312f6-7296-4a4a-9545-7d563fa81768 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:23.536389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588312f6-7296-4a4a-9545-7d563fa81768 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:23.536859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588312f6-7296-4a4a-9545-7d563fa81768 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:23.537299 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-588312f6-7296-4a4a-9545-7d563fa81768 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:23.632401 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-588312f6-7296-4a4a-9545-7d563fa81768 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action" status: 202 len: 0 microversion: 2.1 time: 0.110420 Oct 27 10:38:23.633067 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4012/7948] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:38:23 2022] POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:38:23.643488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:23.644251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:23.652555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:23.653372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:23.653809 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:23.655297 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:23.655876 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:23.656323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:23.836338 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:23.846022 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87574ff3-c8b6-4165-873f-1ab02c13426e tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1681 microversion: 2.1 time: 0.206993 Oct 27 10:38:23.846631 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3937/7949] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:23 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:38:24.874896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:24.875644 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:24.882504 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:24.883014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:24.883615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:24.884470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:24.884850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:24.885308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:25.055478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:25.067688 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9c25912a-3f3e-412d-b675-416adeeb93fa tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1681 microversion: 2.1 time: 0.198075 Oct 27 10:38:25.068842 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4013/7950] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:24 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:38:26.113464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:26.114586 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:26.126596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:26.127436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:26.128313 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:26.129527 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:26.130334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:26.131073 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:26.315284 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:26.325078 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a93f5993-0b56-4c3d-b1b0-23564ef92385 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1684 microversion: 2.1 time: 0.217807 Oct 27 10:38:26.325871 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3938/7951] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:26 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1684 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:26.477941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-354c9881-d224-49fa-874c-96dfb6bb3279 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:26.480323 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-354c9881-d224-49fa-874c-96dfb6bb3279 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:26.488156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354c9881-d224-49fa-874c-96dfb6bb3279 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:26.488701 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354c9881-d224-49fa-874c-96dfb6bb3279 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:26.489238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354c9881-d224-49fa-874c-96dfb6bb3279 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:26.489975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354c9881-d224-49fa-874c-96dfb6bb3279 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:26.490448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354c9881-d224-49fa-874c-96dfb6bb3279 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:26.490930 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-354c9881-d224-49fa-874c-96dfb6bb3279 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:26.543314 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-354c9881-d224-49fa-874c-96dfb6bb3279 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action" status: 200 len: 36556 microversion: 2.1 time: 0.069559 Oct 27 10:38:26.544271 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4014/7952] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:38:26 2022] POST /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295/action => generated 36556 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 10:38:27.680769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:27.681322 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:27.683446 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a832c19c-0887-4f2f-91e1-8d539617cf67 req-8661a66b-c6c2-433c-a7d4-79ba12ee7e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639f71f0-032d-4ec5-b77d-0efe163a1295", "tag": "25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:27.690420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:27.690952 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:27.692343 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:27.692674 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:27.693238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:27.695742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:27.695963 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a832c19c-0887-4f2f-91e1-8d539617cf67 req-8661a66b-c6c2-433c-a7d4-79ba12ee7e64 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:27.696072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a832c19c-0887-4f2f-91e1-8d539617cf67 req-8661a66b-c6c2-433c-a7d4-79ba12ee7e64 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:27.696435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a832c19c-0887-4f2f-91e1-8d539617cf67 req-8661a66b-c6c2-433c-a7d4-79ba12ee7e64 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:27.711125 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a832c19c-0887-4f2f-91e1-8d539617cf67 req-8661a66b-c6c2-433c-a7d4-79ba12ee7e64 service nova] Creating event network-changed:25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56 for instance 639f71f0-032d-4ec5-b77d-0efe163a1295 on n-h1-858383-16 Oct 27 10:38:27.716895 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a832c19c-0887-4f2f-91e1-8d539617cf67 req-8661a66b-c6c2-433c-a7d4-79ba12ee7e64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036965 Oct 27 10:38:27.717917 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4015/7953] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:38:27.724477 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:38:27.830363 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fb71d77-254b-419f-a293-a33b73983a9b tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 204 len: 0 microversion: 2.1 time: 0.153486 Oct 27 10:38:27.831362 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3939/7954] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:38:27 2022] DELETE /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:38:27.840488 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:27.841642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:27.850718 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:27.851645 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:27.852365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:27.853351 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:27.854093 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:27.854767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:28.009029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:28.023547 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-66d2e990-dd83-4701-974e-636297607638 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1690 microversion: 2.1 time: 0.186839 Oct 27 10:38:28.025124 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4016/7955] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:27 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:29.049831 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:29.050457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:29.057533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:29.058033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:29.058486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:29.059215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:29.059720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:29.060153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:29.209928 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:29.219498 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51dbdd76-9857-44b1-a81f-067520230337 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1690 microversion: 2.1 time: 0.174589 Oct 27 10:38:29.220129 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3940/7956] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:29 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:30.214744 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-698d57b2-c7d2-403a-b5b2-19bbfb24cc3d req-b28af041-6caa-4cb3-8b7e-ba77ee5143ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639f71f0-032d-4ec5-b77d-0efe163a1295", "name": "network-vif-deleted", "tag": "25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:30.230304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-698d57b2-c7d2-403a-b5b2-19bbfb24cc3d req-b28af041-6caa-4cb3-8b7e-ba77ee5143ed service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:30.230802 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-698d57b2-c7d2-403a-b5b2-19bbfb24cc3d req-b28af041-6caa-4cb3-8b7e-ba77ee5143ed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:30.231295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-698d57b2-c7d2-403a-b5b2-19bbfb24cc3d req-b28af041-6caa-4cb3-8b7e-ba77ee5143ed service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:30.245365 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:30.246716 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:30.252574 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-698d57b2-c7d2-403a-b5b2-19bbfb24cc3d req-b28af041-6caa-4cb3-8b7e-ba77ee5143ed service nova] Creating event network-vif-deleted:25fc0ca9-94ec-4d19-acd0-5ff6b8f96a56 for instance 639f71f0-032d-4ec5-b77d-0efe163a1295 on n-h1-858383-16 Oct 27 10:38:30.255121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:30.255664 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:30.256117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:30.256860 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:30.257337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:30.257772 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:30.259136 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-698d57b2-c7d2-403a-b5b2-19bbfb24cc3d req-b28af041-6caa-4cb3-8b7e-ba77ee5143ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052539 Oct 27 10:38:30.260358 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4017/7957] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:30.338403 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9cb615a635241008595a2b1f69b5a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f047fd54c1744ca98693fe4d24337fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:30.352470 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3200eb3d-9c81-48c4-9a0f-6f85f57b72ca tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 200 len: 1351 microversion: 2.1 time: 0.112437 Oct 27 10:38:30.353169 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3941/7958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:30 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:38:31.378356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:31.379070 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] [instance: 639f71f0-032d-4ec5-b77d-0efe163a1295] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:31.385616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:31.386121 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:31.386579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:31.387294 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:31.387792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:31.388234 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:31.402415 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] HTTP exception thrown: Instance 639f71f0-032d-4ec5-b77d-0efe163a1295 could not be found. Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Request method failure captured: Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 HTTP/1.1 Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWlznpjglSYA1CgEULfmM1zXhj4xb8pu96BHBDoCyOH7ngKASA76d-_1o2nfvuZzjMfCV3qRZcqaZePuM5poXlBXbGb9-PUJjjddlBlzvrla6ujwlt3YoDIypuNHOvB-lEs9METfJPyBL8aZUTp4ERHJ5QL9ZblfoZmh9Bz2h5P0nWYk Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f047fd54c1744ca98693fe4d24337fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f047fd54c1744ca98693fe4d24337fe"}]}] Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 5f047fd54c1744ca98693fe4d24337fe Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-649927205 Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: d9cb615a635241008595a2b1f69b5a2b Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestNetworkAdvancedServerOps-649927205-project Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 639f71f0-032d-4ec5-b77d-0efe163a1295 could not be found. Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '639f71f0-032d-4ec5-b77d-0efe163a1295'} Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639f71f0-032d-4ec5-b77d-0efe163a1295 could not be found. Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639f71f0-032d-4ec5-b77d-0efe163a1295 could not be found. Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:38:31.404145 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639f71f0-032d-4ec5-b77d-0efe163a1295 could not be found. Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Returning 404 to user: Instance 639f71f0-032d-4ec5-b77d-0efe163a1295 could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c39868a0-f379-47b2-b8ea-93932cc9e99f tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295" status: 404 len: 111 microversion: 2.1 time: 0.032917 Oct 27 10:38:31.409945 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4018/7959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:31 2022] GET /compute/v2.1/servers/639f71f0-032d-4ec5-b77d-0efe163a1295 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:38:35.398589 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4436743e-f1c6-4a4c-8e5f-b97b546d2bc1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] Calling method '.version_select at 0x7f31aa2118b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:35.422334 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4436743e-f1c6-4a4c-8e5f-b97b546d2bc1 tempest-TestNetworkAdvancedServerOps-649927205 tempest-TestNetworkAdvancedServerOps-649927205-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-490113907" status: 202 len: 0 microversion: 2.1 time: 0.028901 Oct 27 10:38:35.422939 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3942/7960] 10.222.0.25 () {58 vars in 1281 bytes} [Thu Oct 27 10:38:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-490113907 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:38:47.548408 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=18 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:47.549335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:47.729019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d1223a9d-8516-45d5-a3f5-166759537b44 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Action: 'create', calling method: .version_select at 0x7f3198797700>, body: {"keypair": {"name": "tempest-TestShelveInstance-593327595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5/90eTGaEEo75hjOCHr2fHEtHMe5QMAEIbXwGX5BVlTWWqGfR9OoInKmdlF4upuR0GAybvyeSI4pME4WPNUWF1706s3F1E8atRk+Ct7v/7tt+X5abo633at/aE2vjnaQ=="}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:47.745253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d1223a9d-8516-45d5-a3f5-166759537b44 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Getting quotas for project b89fe9e17828474aad0402777dd36267. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:38:47.752329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-d1223a9d-8516-45d5-a3f5-166759537b44 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Getting quotas for user 647ffddca6764050b247a63d837cd046 and project b89fe9e17828474aad0402777dd36267. Resources: {'key_pairs'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:38:47.777587 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d1223a9d-8516-45d5-a3f5-166759537b44 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.234734 Oct 27 10:38:47.778189 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4019/7961] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:38:47 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:48.932304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-916945675", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-593327595", "security_groups": [{"name": "tempest-secgroup-smoke-371193849"}], "networks": [{"uuid": "de7dd8f0-5c3a-4cf2-bffc-277f23d0fad3"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:48.946988 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:48.947671 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:38:49.055375 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] validate_networks() for [('de7dd8f0-5c3a-4cf2-bffc-277f23d0fad3', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:38:49.552522 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:38:49.552943 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:38:49.553438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:38:49.553850 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:38:49.554293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:38:49.563763 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:49.564251 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:49.564686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:49.565413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:49.565870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:49.566294 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:49.584009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Getting quotas for project b89fe9e17828474aad0402777dd36267. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:38:49.589697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Getting quotas for user 647ffddca6764050b247a63d837cd046 and project b89fe9e17828474aad0402777dd36267. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:38:49.603514 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:38:49.605878 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:38:49.656134 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e13a262-a088-4d69-a85e-5bd31bbeb4c1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727978 Oct 27 10:38:49.662989 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3943/7962] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:38:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:38:49.670035 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c03e36a8-5da9-40c2-94de-d43a0639f993 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:49.671356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c03e36a8-5da9-40c2-94de-d43a0639f993 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:49.735929 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c03e36a8-5da9-40c2-94de-d43a0639f993 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:49.744532 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c03e36a8-5da9-40c2-94de-d43a0639f993 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1245 microversion: 2.1 time: 0.079910 Oct 27 10:38:49.745217 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4020/7963] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:49 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:50.769792 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d4be1205-52ed-4eb5-9d98-58b0bc2b27e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:50.770432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d4be1205-52ed-4eb5-9d98-58b0bc2b27e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:50.838601 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d4be1205-52ed-4eb5-9d98-58b0bc2b27e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:50.847165 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d4be1205-52ed-4eb5-9d98-58b0bc2b27e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1245 microversion: 2.1 time: 0.082751 Oct 27 10:38:50.847707 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3944/7964] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:50 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:51.873370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9110b439-a23d-4538-8381-6b448b7adf71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:51.874069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9110b439-a23d-4538-8381-6b448b7adf71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:51.933794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9110b439-a23d-4538-8381-6b448b7adf71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:51.942275 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9110b439-a23d-4538-8381-6b448b7adf71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1245 microversion: 2.1 time: 0.074363 Oct 27 10:38:51.943162 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4021/7965] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:51 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:52.967039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:52.967688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:52.974545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:52.975031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:52.975466 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:52.976545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:52.976998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:52.977423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:53.042553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:53.051064 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ebca5b48-0dc0-46e3-981d-b4d98d6bcf72 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1249 microversion: 2.1 time: 0.088614 Oct 27 10:38:53.051653 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3945/7966] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:52 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:54.077858 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:54.079003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:54.087735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:54.087735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:54.087735 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:54.088231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:54.088703 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:54.089349 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:54.155141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:54.163118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-aed2f6d9-7a34-4e19-959d-3d63fb3939d3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1303 microversion: 2.1 time: 0.091697 Oct 27 10:38:54.163735 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4022/7967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:54 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:55.188843 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:55.189544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5493be80-aa9e-4a1e-9e8c-487ed683a430 req-b6fe5c27-cd6e-461c-b5a3-7f220447bb9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df48bc66-8a8d-47e4-8823-2276d9f8d63b", "tag": "1888849e-23aa-4d07-8d4d-5b5ea67e03cc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:38:55.190931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:55.199314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:55.200860 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:55.201550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:55.203295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:55.203554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5493be80-aa9e-4a1e-9e8c-487ed683a430 req-b6fe5c27-cd6e-461c-b5a3-7f220447bb9e service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:55.204066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5493be80-aa9e-4a1e-9e8c-487ed683a430 req-b6fe5c27-cd6e-461c-b5a3-7f220447bb9e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:55.204857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5493be80-aa9e-4a1e-9e8c-487ed683a430 req-b6fe5c27-cd6e-461c-b5a3-7f220447bb9e service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:55.205018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:55.205615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:55.218922 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5493be80-aa9e-4a1e-9e8c-487ed683a430 req-b6fe5c27-cd6e-461c-b5a3-7f220447bb9e service nova] Creating event network-changed:1888849e-23aa-4d07-8d4d-5b5ea67e03cc for instance df48bc66-8a8d-47e4-8823-2276d9f8d63b on n-h1-858383-16 Oct 27 10:38:55.225277 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5493be80-aa9e-4a1e-9e8c-487ed683a430 req-b6fe5c27-cd6e-461c-b5a3-7f220447bb9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043299 Oct 27 10:38:55.226194 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3946/7968] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:38:55.381275 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:55.389886 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0c02093d-142d-4ee0-a724-f5185a438998 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1370 microversion: 2.1 time: 0.205422 Oct 27 10:38:55.390492 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4023/7969] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:55 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:56.413458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:56.414139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:56.421553 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:56.422037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:56.422471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:56.423158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:56.423639 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:56.424067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:56.558202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:56.566871 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e365e29e-3f50-48a2-a920-380c01f809e8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1370 microversion: 2.1 time: 0.157703 Oct 27 10:38:56.567451 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3947/7970] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:56 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:57.589799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:57.590421 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:57.597404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:57.597901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:57.598348 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:57.599313 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:57.599809 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:57.600245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:57.736692 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:57.744952 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3c5e0e7a-fb0f-4065-89e5-740574c3fc69 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1370 microversion: 2.1 time: 0.159030 Oct 27 10:38:57.745558 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4024/7971] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:57 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:58.769174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:58.769737 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:58.777180 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:58.777654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:58.778093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:58.778824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:58.779311 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:58.779765 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:58.919760 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:38:58.927667 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-807b269c-a238-42c8-801c-4e10ffd116c5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1370 microversion: 2.1 time: 0.162609 Oct 27 10:38:58.928251 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3948/7972] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:58 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:38:59.951884 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:38:59.952506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:38:59.959493 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:59.960025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:59.960482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:38:59.961200 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:38:59.961671 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:38:59.962117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:39:00.114164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:39:00.122312 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fa26986b-97a3-45a1-ba68-2f455789d15e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1370 microversion: 2.1 time: 0.174753 Oct 27 10:39:00.122909 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4025/7973] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:38:59 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:39:00.144000 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:39:00.212087 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-bcddbbec-71be-43a5-be15-627528a6ce20 req-beeca493-b0ba-45b8-8379-85df8a45d77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df48bc66-8a8d-47e4-8823-2276d9f8d63b", "name": "network-vif-plugged", "status": "completed", "tag": "1888849e-23aa-4d07-8d4d-5b5ea67e03cc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:39:00.222429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bcddbbec-71be-43a5-be15-627528a6ce20 req-beeca493-b0ba-45b8-8379-85df8a45d77c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:39:00.222918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bcddbbec-71be-43a5-be15-627528a6ce20 req-beeca493-b0ba-45b8-8379-85df8a45d77c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:39:00.223360 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-bcddbbec-71be-43a5-be15-627528a6ce20 req-beeca493-b0ba-45b8-8379-85df8a45d77c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:39:00.236024 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-bcddbbec-71be-43a5-be15-627528a6ce20 req-beeca493-b0ba-45b8-8379-85df8a45d77c service nova] Creating event network-vif-plugged:1888849e-23aa-4d07-8d4d-5b5ea67e03cc for instance df48bc66-8a8d-47e4-8823-2276d9f8d63b on n-h1-858383-16 Oct 27 10:39:00.240907 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-bcddbbec-71be-43a5-be15-627528a6ce20 req-beeca493-b0ba-45b8-8379-85df8a45d77c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101386 Oct 27 10:39:00.241540 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3949/7974] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:39:01.145491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:01.146119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:39:01.153216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:39:01.153723 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:39:01.154172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:39:01.154893 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:39:01.155359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:39:01.155824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:39:01.297339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:39:01.305039 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a9745efc-b88e-42e5-8752-ec32fc18742b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1370 microversion: 2.1 time: 0.163443 Oct 27 10:39:01.305622 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4026/7975] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:39:01 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:39:02.327027 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:39:02.334668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:02.335457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:39:02.342288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:39:02.342779 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:39:02.343223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:39:02.343954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:39:02.344416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:39:02.344848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:39:02.481163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:39:02.489463 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b121feb9-a57b-4c60-8fce-d682855853d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1553 microversion: 2.1 time: 0.163988 Oct 27 10:39:02.490045 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3950/7976] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:39:02 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:39:02.512697 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:39:02.514280 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:39:02.515642 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=8 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:39:02.522429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:39:02.522927 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:39:02.523403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:39:02.524141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:39:02.524611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:39:02.525046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:39:02.664050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:39:02.672452 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ce929198-985b-42d4-b706-15c7e5de5d01 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1553 microversion: 2.1 time: 0.164247 Oct 27 10:39:02.673025 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4027/7977] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:39:02 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:39:04.351359 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ebff248e-a007-4bf4-8311-cd8bbac52266 req-d6eba948-83af-4408-8726-deff2fd9249a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df48bc66-8a8d-47e4-8823-2276d9f8d63b", "tag": "1888849e-23aa-4d07-8d4d-5b5ea67e03cc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:39:04.361817 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ebff248e-a007-4bf4-8311-cd8bbac52266 req-d6eba948-83af-4408-8726-deff2fd9249a service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:39:04.362301 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ebff248e-a007-4bf4-8311-cd8bbac52266 req-d6eba948-83af-4408-8726-deff2fd9249a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:39:04.362733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ebff248e-a007-4bf4-8311-cd8bbac52266 req-d6eba948-83af-4408-8726-deff2fd9249a service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:39:04.377380 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ebff248e-a007-4bf4-8311-cd8bbac52266 req-d6eba948-83af-4408-8726-deff2fd9249a service nova] Creating event network-changed:1888849e-23aa-4d07-8d4d-5b5ea67e03cc for instance df48bc66-8a8d-47e4-8823-2276d9f8d63b on n-h1-858383-16 Oct 27 10:39:04.382313 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ebff248e-a007-4bf4-8311-cd8bbac52266 req-d6eba948-83af-4408-8726-deff2fd9249a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035082 Oct 27 10:39:04.382923 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3951/7978] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:41:40.778115 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:41:40.778907 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:41:40.779750 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:40.780560 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=36 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:40.781526 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:41:40.781710 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b/action (ip 10.222.0.25) !!! Oct 27 10:41:40.783437 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:41:40.783607 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b/action (ip 10.222.0.25) !!! Oct 27 10:41:40.784672 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:41:40.784805 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b/action (ip 10.222.0.25) !!! Oct 27 10:41:40.790034 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:41:40.790585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:40.801907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:40.802412 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:40.802866 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:40.803616 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:40.804100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:40.804523 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:40.831148 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lazy-loading 'flavor' on Instance uuid df48bc66-8a8d-47e4-8823-2276d9f8d63b {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:41:41.243517 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dad56872-a8c9-4e40-82a1-48ac72164a58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "POST /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b/action" status: 202 len: 0 microversion: 2.1 time: 0.466927 Oct 27 10:41:41.244176 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4028/7979] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:41:40 2022] POST /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:41:41.252997 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:41:41.254409 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:41:41.255594 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:41.256887 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=32 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:41:41.259613 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:41:41.259832 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:41:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b (ip 10.222.0.25) !!! Oct 27 10:41:41.262164 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:41:41.262344 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:41:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b (ip 10.222.0.25) !!! Oct 27 10:41:41.275004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:41.276328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:41.294102 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:41.294884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:41.295744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:41.296863 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:41.298048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:41.299656 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:41.530205 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:41.538797 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0ec98f8-d76c-4a39-87dc-9b381dab88f5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.288987 Oct 27 10:41:41.539396 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3952/7980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:41 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:42.566030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:42.566848 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:42.576765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:42.577273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:42.577729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:42.578469 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:42.578981 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:42.579481 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:42.586490 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42334. Oct 27 10:41:42.587231 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42336. Oct 27 10:41:42.732030 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:42.741627 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a71e033-09c6-499a-826f-226251392a3a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.182703 Oct 27 10:41:42.742232 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4029/7981] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:42 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:43.765440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:43.766074 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:43.783546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:43.784092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:43.784534 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:43.785282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:43.785723 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:43.786151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:43.790859 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42340. Oct 27 10:41:43.791790 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42342. Oct 27 10:41:43.934744 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:43.942749 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8517851-dba0-47a3-bf9b-3bce7811c308 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.181450 Oct 27 10:41:43.943385 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3953/7982] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:43 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:41:44.971119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:44.972238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:44.984820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:44.985680 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:44.986458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:44.987780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:44.988609 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:44.989361 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:45.166749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:45.181936 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3cca7c8f-a608-41c9-a4ca-c8ad544e3cba tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.218186 Oct 27 10:41:45.182610 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4030/7983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:44 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:46.208319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:46.208923 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:46.215862 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:46.216354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:46.216796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:46.217500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:46.217962 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:46.218419 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:46.353645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:46.362146 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e1ff928-34a1-4265-bca9-373093478b24 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.157935 Oct 27 10:41:46.362755 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3954/7984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:46 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:47.386091 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:47.386710 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:47.394190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:47.394693 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:47.395138 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:47.395873 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:47.396337 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:47.396784 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:47.533445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:47.541272 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-83f5090e-80cc-4930-bcd6-d36a540a8c3d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.159147 Oct 27 10:41:47.541850 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4031/7985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:47 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:48.564554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:48.565166 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:48.571978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:48.572464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:48.572900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:48.573591 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:48.574062 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:48.574470 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:48.705126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:48.712845 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8dd474e7-9201-4ab9-bf68-3292f0a40b0b tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.152158 Oct 27 10:41:48.713426 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3955/7986] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:48 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:49.737181 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:49.737747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:49.744507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:49.745008 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:49.745456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:49.746154 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:49.746619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:49.747055 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:49.879815 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:49.887479 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-34033778-a042-4679-bcba-033319079322 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.154377 Oct 27 10:41:49.888083 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4032/7987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:49 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:50.910563 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:50.911168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:50.918046 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:50.918529 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:50.918967 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:50.919691 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:50.920147 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:50.920598 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:51.053626 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:51.061443 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68b97834-c36d-46ae-a317-67ba832b700e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.154869 Oct 27 10:41:51.061947 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3956/7988] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:50 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:52.085456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:52.086083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:52.093611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:52.094111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:52.094558 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:52.095264 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:52.095760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:52.096880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:52.228511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:52.236146 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a8913b78-813a-4c6e-b3f7-9598c1b7e65d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.154666 Oct 27 10:41:52.236824 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4033/7989] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:52 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:53.260071 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:53.260843 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:53.268037 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:53.268526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:53.268989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:53.269682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:53.270136 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:53.270557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:53.410013 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:53.417780 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36c103d4-1848-4d4d-b89d-3f20072890a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.161625 Oct 27 10:41:53.418350 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3957/7990] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:53 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:54.442120 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:54.442746 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:54.449749 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:54.450243 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:54.450688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:54.451380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:54.451871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:54.452308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:54.583244 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:54.591004 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3761d4cb-dfc8-4d6e-bf00-3626adbbaeab tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.153469 Oct 27 10:41:54.591585 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4034/7991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:54 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:55.614846 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:55.615423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:55.622198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:55.622685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:55.623129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:55.623864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:55.624327 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:55.624755 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:55.759940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:55.767718 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d44a14c-fdc1-4ebe-ba70-9fa2379418ea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.156851 Oct 27 10:41:55.768302 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3958/7992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:55 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:56.792916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:56.793579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:56.801080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:56.801568 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:56.802023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:56.802736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:56.803195 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:56.803650 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:56.939828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:56.948254 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-91408087-dbd7-44ac-b576-721a416a214f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.159357 Oct 27 10:41:56.948856 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4035/7993] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:56 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:57.972756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:57.973471 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:57.980557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:57.981045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:57.981479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:57.982168 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:57.982621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:57.983041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:58.119156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:58.127019 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dec4ddc1-158a-4b12-aaa1-2e8fe5cfd5ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1699 microversion: 2.1 time: 0.158800 Oct 27 10:41:58.127608 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3959/7994] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:57 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:41:59.151864 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:41:59.152477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:41:59.159338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:59.160435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:59.160880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:59.161580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:41:59.162043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:41:59.162477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:41:59.297450 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:41:59.310629 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bd644666-52d4-4062-aadb-a5328c6b6c3c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1699 microversion: 2.1 time: 0.162848 Oct 27 10:41:59.311681 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4036/7995] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:41:59 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:00.335440 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:00.336104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:00.343217 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:00.343777 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:00.344226 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:00.344947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:00.345416 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:00.345853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:00.484121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:00.492337 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aac274f0-a8b4-42b1-931e-52256f2bab90 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1699 microversion: 2.1 time: 0.161552 Oct 27 10:42:00.492934 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3960/7996] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:00 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1699 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:01.515813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:01.516584 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:01.523422 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:01.523988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:01.524445 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:01.525153 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:01.525632 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:01.526069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:01.661367 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:01.669058 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-14814721-32b9-4463-8606-ea197e484602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1699 microversion: 2.1 time: 0.157256 Oct 27 10:42:01.669853 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4037/7997] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:01 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:02.692546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:02.693177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:02.700482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:02.700983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:02.701427 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:02.702133 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:02.702618 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:02.703045 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:02.840092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:02.848221 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-02e542d1-9853-4312-9b6c-d6856f0e8dd8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1699 microversion: 2.1 time: 0.159515 Oct 27 10:42:02.848729 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3961/7998] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:02 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:02.993598 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-19b0bba5-45b7-414e-88dc-08e9f83d5a66 req-0389d40a-f723-42d5-93a9-e49bb0eab7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df48bc66-8a8d-47e4-8823-2276d9f8d63b", "name": "network-vif-plugged", "status": "completed", "tag": "1888849e-23aa-4d07-8d4d-5b5ea67e03cc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:03.005589 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-19b0bba5-45b7-414e-88dc-08e9f83d5a66 req-0389d40a-f723-42d5-93a9-e49bb0eab7ea service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:03.006102 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-19b0bba5-45b7-414e-88dc-08e9f83d5a66 req-0389d40a-f723-42d5-93a9-e49bb0eab7ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:03.014251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-19b0bba5-45b7-414e-88dc-08e9f83d5a66 req-0389d40a-f723-42d5-93a9-e49bb0eab7ea service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:03.030649 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-19b0bba5-45b7-414e-88dc-08e9f83d5a66 req-0389d40a-f723-42d5-93a9-e49bb0eab7ea service nova] Creating event network-vif-plugged:1888849e-23aa-4d07-8d4d-5b5ea67e03cc for instance df48bc66-8a8d-47e4-8823-2276d9f8d63b on n-h1-858383-16 Oct 27 10:42:03.036868 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-19b0bba5-45b7-414e-88dc-08e9f83d5a66 req-0389d40a-f723-42d5-93a9-e49bb0eab7ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048318 Oct 27 10:42:03.037992 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4038/7999] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:42:03.874811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:03.875462 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:03.883059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:03.883909 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:03.884371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:03.885120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:03.885613 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:03.886041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:04.072058 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:04.082557 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-16b9acf4-3e3b-4067-81c5-1173c263fe58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1694 microversion: 2.1 time: 0.212797 Oct 27 10:42:04.083149 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3962/8000] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:03 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:05.111722 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:05.112576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:05.119753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:05.120331 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:05.120850 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:05.121570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:05.122039 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:05.122474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:05.278594 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:05.287997 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-57b008f1-03f5-4630-964b-1056f7e3f765 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1694 microversion: 2.1 time: 0.181620 Oct 27 10:42:05.303984 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4039/8001] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:05 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:06.312752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:06.313368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:06.320541 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:06.321026 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:06.321461 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:06.322170 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:06.323597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:06.323597 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:06.524693 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:06.535001 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef261898-0b6a-4216-9548-199e27da1dcd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1694 microversion: 2.1 time: 0.226135 Oct 27 10:42:06.552651 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3963/8002] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:06 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1694 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:07.581324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:07.582045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:07.589478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:07.591298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:07.591298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:07.591651 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:07.592435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:07.593172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:07.781623 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:07.797992 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a85657e1-c116-4438-baf8-c2264de1d07f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1694 microversion: 2.1 time: 0.222890 Oct 27 10:42:07.811912 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4040/8003] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:07 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1694 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:08.837548 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:08.838337 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:08.846542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:08.847117 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:08.848207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:08.848989 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:08.849516 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:08.850266 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:09.016757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:09.029142 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea55b6fb-d22d-47cf-a30e-1d038111a602 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1694 microversion: 2.1 time: 0.195426 Oct 27 10:42:09.029754 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3964/8004] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:08 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:10.064393 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:10.066309 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:10.074170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:10.075094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:10.076236 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:10.077261 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:10.077992 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:10.078725 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:10.247756 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:10.256515 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d76ed6bc-f4b5-4acb-9547-6d70a95c8053 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1694 microversion: 2.1 time: 0.203969 Oct 27 10:42:10.257110 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4041/8005] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:10 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:11.280116 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:11.280746 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:11.289192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:11.289700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:11.290142 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:11.291282 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:11.292014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:11.292725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:11.296148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=79 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:11.465464 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:11.475164 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-169016a0-97a2-4053-8852-8e308c351576 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1694 microversion: 2.1 time: 0.197630 Oct 27 10:42:11.489091 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3965/8006] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:11 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:12.502538 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:12.503389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:12.511161 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=29 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:12.513087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:12.513956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:12.514500 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:12.515476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:12.516140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:12.516729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:12.520999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:12.700345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:12.708608 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-bdeb8846-b75f-475a-a180-e15151c2a643 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1694 microversion: 2.1 time: 0.210115 Oct 27 10:42:12.709219 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4042/8007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:12 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:13.733561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:13.734394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:13.737378 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=29 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:42:13.743669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:13.744109 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:13.744554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:13.745269 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:13.745720 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:13.746139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:13.881371 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:13.889358 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f675ec48-a206-471e-bcbb-965c50cf7483 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1676 microversion: 2.1 time: 0.159788 Oct 27 10:42:13.889940 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3966/8008] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:13 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:14.914392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:14.915043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:14.922158 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:14.922661 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:14.923146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:14.923900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:14.924354 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:14.924788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:15.062404 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:15.070479 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fbc35879-0ac9-41de-a58e-56d501bc8b1a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1676 microversion: 2.1 time: 0.160659 Oct 27 10:42:15.071073 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4043/8009] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:14 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:16.100395 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:16.101002 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:16.108053 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:16.108542 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:16.108984 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:16.109681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:16.110129 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:16.110557 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:16.617750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:16.626439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8d233c1-d6db-4be6-b4b4-1c084dae9fa4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1679 microversion: 2.1 time: 0.531205 Oct 27 10:42:16.627042 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3967/8010] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:16 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1679 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:16.650931 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:16.651635 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:16.659025 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:16.660173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:16.660631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:16.661366 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:16.661842 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:16.662286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:16.759882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120602) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 27 10:42:16.835553 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fca0dccc-3487-402c-b109-184ef0e9a194 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "POST /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b/action" status: 202 len: 0 microversion: 2.1 time: 0.188766 Oct 27 10:42:16.836431 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4044/8011] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:42:16 2022] POST /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:42:16.851449 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:16.852104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:16.862619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:16.863328 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:16.864159 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:16.865429 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:16.866261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:16.867028 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:17.028591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b079e781-4735-4269-8e0a-407e7beed6a2 req-b767a3b2-c76b-4559-aeb0-682d81d56add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df48bc66-8a8d-47e4-8823-2276d9f8d63b", "name": "network-vif-unplugged", "status": "completed", "tag": "1888849e-23aa-4d07-8d4d-5b5ea67e03cc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:17.046828 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b079e781-4735-4269-8e0a-407e7beed6a2 req-b767a3b2-c76b-4559-aeb0-682d81d56add service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:17.048172 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b079e781-4735-4269-8e0a-407e7beed6a2 req-b767a3b2-c76b-4559-aeb0-682d81d56add service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:17.049101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b079e781-4735-4269-8e0a-407e7beed6a2 req-b767a3b2-c76b-4559-aeb0-682d81d56add service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:17.063758 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:17.070835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.compute.server_external_events [req-b079e781-4735-4269-8e0a-407e7beed6a2 req-b767a3b2-c76b-4559-aeb0-682d81d56add service nova] Unable to find a host for instance df48bc66-8a8d-47e4-8823-2276d9f8d63b. Dropping event network-vif-unplugged {{(pid=120602) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 10:42:17.071897 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b079e781-4735-4269-8e0a-407e7beed6a2 req-b767a3b2-c76b-4559-aeb0-682d81d56add service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053619 Oct 27 10:42:17.071897 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4045/8012] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 27 10:42:17.085128 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f2adc96-ffbd-4ed8-9d7c-8e614de44d52 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1627 microversion: 2.1 time: 0.242122 Oct 27 10:42:17.086003 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3968/8013] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:16 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1627 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:18.122798 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:18.123363 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:18.130394 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:18.130894 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:18.131341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:18.132160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:18.132626 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:18.133059 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:18.303371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:18.319323 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4573ea93-e44d-442b-821b-69378531223c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.200372 Oct 27 10:42:18.320102 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4046/8014] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:18 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:19.347478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:19.348874 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:19.358341 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:19.359228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:19.359787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:19.360582 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:19.361043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:19.361476 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:19.526379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:19.535376 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7b7fad3-ae80-4403-8495-8dac07c0df5d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.192504 Oct 27 10:42:19.536415 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3969/8015] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:19 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:20.560018 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:20.560622 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:20.568576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:20.569083 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:20.569541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:20.570638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:20.571235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:20.571910 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:20.730178 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:20.755245 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd52aaa5-6136-483a-91a7-e9bb947b480e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.199110 Oct 27 10:42:20.759458 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4047/8016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:20 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:21.788070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:21.789575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:21.796981 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:21.797650 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:21.798093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:21.798883 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:21.799410 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:21.800442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:21.965816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:21.974280 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ba6c7678-b6c5-46ed-8217-0aa731bce85d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.190030 Oct 27 10:42:21.975304 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3970/8017] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:21 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:23.000876 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:23.002000 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:23.011111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:23.011646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:23.012140 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:23.012871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:23.013482 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:23.013808 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:23.174353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:23.183367 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8c29469c-4c92-4016-9854-571074773904 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.188354 Oct 27 10:42:23.184075 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4048/8018] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:22 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:24.208771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:24.209685 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:24.218119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:24.218714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:24.219267 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:24.220106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:24.220632 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:24.221173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:24.372718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:24.381334 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7ee75ea-d37c-47ba-94c4-55446c0cadc1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.177407 Oct 27 10:42:24.381978 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3971/8019] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:24 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:25.404880 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:25.405542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:25.413041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:25.413551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:25.414029 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:25.414736 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:25.415202 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:25.415676 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:25.582694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:25.591177 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c7a5e19c-ca7f-4d61-9860-983bdd4b0026 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.190132 Oct 27 10:42:25.591804 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4049/8020] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:25 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:26.619714 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:26.620526 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:26.629739 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:26.630250 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:26.630700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:26.631425 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:26.631915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:26.632350 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:26.794261 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:26.803513 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8748dde5-73a4-4e8c-9ec0-c20c0bdfe6b4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.188285 Oct 27 10:42:26.804135 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3972/8021] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:26 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:27.826585 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:27.827224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:27.834566 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:27.835063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:27.835525 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:27.836271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:27.836745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:27.837190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:27.973835 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:27.982427 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3b02502d-c6ac-4da1-b86e-8dc60d832250 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.159756 Oct 27 10:42:27.983017 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4050/8022] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:27 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:29.006272 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:29.006888 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:29.013915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:29.014411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:29.014853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:29.015592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:29.016056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:29.016489 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:29.158067 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:29.166628 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2aa03fe-75ab-4b18-b1b5-04fa46f475f7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.164228 Oct 27 10:42:29.167219 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3973/8023] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:29 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:30.191100 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:30.191829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:30.198762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:30.199265 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:30.199761 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:30.200477 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:30.200948 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:30.201387 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:30.337339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:30.345899 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-143bb460-3acb-477b-a382-f93e7a8bfe08 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.159243 Oct 27 10:42:30.346487 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4051/8024] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:30 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:31.371024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:31.371935 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:31.379347 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:31.379879 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:31.380323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:31.381047 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:31.381507 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:31.381940 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:31.547031 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:31.556006 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc300025-10fb-490c-8fb4-0ff49e706519 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.188980 Oct 27 10:42:31.556589 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3974/8025] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:31 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:32.578615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:32.579242 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:32.587043 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:32.587554 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:32.588033 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:32.588755 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:32.589219 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:32.589655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:32.742499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:32.750658 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c42b97c7-e76b-4266-a08f-c34b403050ef tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.176022 Oct 27 10:42:32.751241 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4052/8026] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:32 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:33.774939 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:33.775528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:33.782513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:33.782998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:33.783432 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:33.784140 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:33.784595 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:33.785645 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:33.923050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:33.930868 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3bc9cba4-65be-43c6-b60b-b5e1b4b68169 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.159873 Oct 27 10:42:33.931448 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3975/8027] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:33 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:34.954368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:34.954975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:34.963435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:34.963971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:34.964418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:34.965128 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:34.965707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:34.966023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:35.116107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:35.130467 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c4ffc59b-25be-44b0-9e6c-039cc0dcd584 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.179481 Oct 27 10:42:35.131583 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4053/8028] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:34 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:36.154556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:36.155192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:36.162171 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:36.162648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:36.163080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:36.163804 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:36.164273 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:36.164678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:36.295872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:36.304265 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f7f2def1-0e02-4c96-ba70-e7a81a5fede7 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.153591 Oct 27 10:42:36.304844 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3976/8029] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:36 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:37.116526 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2dc576ca-e067-46f2-becb-d4bcbb0deb4c req-36a7ec6a-fe48-4a3c-9ddf-a0612ca8cf50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df48bc66-8a8d-47e4-8823-2276d9f8d63b", "name": "network-vif-plugged", "status": "completed", "tag": "1888849e-23aa-4d07-8d4d-5b5ea67e03cc"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:42:37.128026 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2dc576ca-e067-46f2-becb-d4bcbb0deb4c req-36a7ec6a-fe48-4a3c-9ddf-a0612ca8cf50 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:37.129255 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2dc576ca-e067-46f2-becb-d4bcbb0deb4c req-36a7ec6a-fe48-4a3c-9ddf-a0612ca8cf50 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:37.129417 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2dc576ca-e067-46f2-becb-d4bcbb0deb4c req-36a7ec6a-fe48-4a3c-9ddf-a0612ca8cf50 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:37.140649 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2dc576ca-e067-46f2-becb-d4bcbb0deb4c req-36a7ec6a-fe48-4a3c-9ddf-a0612ca8cf50 service nova] Creating event network-vif-plugged:1888849e-23aa-4d07-8d4d-5b5ea67e03cc for instance df48bc66-8a8d-47e4-8823-2276d9f8d63b on n-h1-858383-16 Oct 27 10:42:37.145944 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2dc576ca-e067-46f2-becb-d4bcbb0deb4c req-36a7ec6a-fe48-4a3c-9ddf-a0612ca8cf50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 Oct 27 10:42:37.146762 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4054/8030] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:42:37.328105 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:37.328801 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:37.335561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:37.336077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:37.336515 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:37.337216 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:37.337700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:37.338123 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:37.470865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:37.479602 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6ea0769b-b674-49a6-bcbe-45172eb42215 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.155370 Oct 27 10:42:37.480218 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3977/8031] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:37 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:42:38.505047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:38.505768 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:38.512187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:38.512679 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:38.513134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:38.513863 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:38.514340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:38.514816 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:38.663109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:38.671307 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-17900613-b242-4b6c-9c65-fca902529fe4 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1685 microversion: 2.1 time: 0.171451 Oct 27 10:42:38.671942 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4055/8032] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:38 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:42:39.696271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:42:39.696818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:42:39.703718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:39.704211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:39.704658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:39.705354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:42:39.705816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:42:39.706241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:42:39.840958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:42:39.848919 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-649eed9e-3238-4135-9a89-efd4e1f67207 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1672 microversion: 2.1 time: 0.156627 Oct 27 10:42:39.849489 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3978/8033] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:42:39 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:26.015003 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:26.015805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:26.022707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=25 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:26.023766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=83 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:26.024603 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:44:26.024736 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:44:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 27 10:44:26.033109 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:26.033656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:26.041521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:26.042414 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:26.042615 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:26.043155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:26.047698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:26.050023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:26.078542 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Going to try to terminate instance {{(pid=120602) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:44:26.108578 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a778a6c8-2558-4eef-a0cc-422c4761d516 req-41ad1053-c3b0-4f9e-acb7-f863f4005781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df48bc66-8a8d-47e4-8823-2276d9f8d63b", "tag": "1888849e-23aa-4d07-8d4d-5b5ea67e03cc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:26.120363 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a778a6c8-2558-4eef-a0cc-422c4761d516 req-41ad1053-c3b0-4f9e-acb7-f863f4005781 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:26.120854 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a778a6c8-2558-4eef-a0cc-422c4761d516 req-41ad1053-c3b0-4f9e-acb7-f863f4005781 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:26.121293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a778a6c8-2558-4eef-a0cc-422c4761d516 req-41ad1053-c3b0-4f9e-acb7-f863f4005781 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:26.133659 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a778a6c8-2558-4eef-a0cc-422c4761d516 req-41ad1053-c3b0-4f9e-acb7-f863f4005781 service nova] Creating event network-changed:1888849e-23aa-4d07-8d4d-5b5ea67e03cc for instance df48bc66-8a8d-47e4-8823-2276d9f8d63b on n-h1-858383-16 Oct 27 10:44:26.140727 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a778a6c8-2558-4eef-a0cc-422c4761d516 req-41ad1053-c3b0-4f9e-acb7-f863f4005781 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119766 Oct 27 10:44:26.141550 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3979/8034] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:44:26.168353 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-193306e7-7217-4faa-b599-1e8c7f24585d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 204 len: 0 microversion: 2.1 time: 0.155130 Oct 27 10:44:26.169055 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4056/8035] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:44:26 2022] DELETE /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:44:26.179239 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:26.180621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:26.187910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:26.188406 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:26.188851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:26.189728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:26.190426 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:26.191243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:26.337280 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:26.345287 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-608a6128-f5d8-4fc7-ad03-ab47505ea89f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.171363 Oct 27 10:44:26.345873 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3980/8036] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:26 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:44:27.370687 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:27.371403 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:27.379822 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:27.380335 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:27.380794 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:27.381520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:27.381998 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:27.382444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:27.540237 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:27.548641 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0a7fc366-6c0e-4d80-aa77-4b0d622a627d tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1678 microversion: 2.1 time: 0.182897 Oct 27 10:44:27.549255 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4057/8037] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:27 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:28.339851 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-10a5aa1f-5363-4b33-ba90-af682627922f req-a1e44bbe-93b2-4de1-950c-bf0cd9dd8227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df48bc66-8a8d-47e4-8823-2276d9f8d63b", "name": "network-vif-deleted", "tag": "1888849e-23aa-4d07-8d4d-5b5ea67e03cc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:28.360520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-10a5aa1f-5363-4b33-ba90-af682627922f req-a1e44bbe-93b2-4de1-950c-bf0cd9dd8227 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:28.361295 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-10a5aa1f-5363-4b33-ba90-af682627922f req-a1e44bbe-93b2-4de1-950c-bf0cd9dd8227 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:28.361731 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-10a5aa1f-5363-4b33-ba90-af682627922f req-a1e44bbe-93b2-4de1-950c-bf0cd9dd8227 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:28.374036 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-10a5aa1f-5363-4b33-ba90-af682627922f req-a1e44bbe-93b2-4de1-950c-bf0cd9dd8227 service nova] Creating event network-vif-deleted:1888849e-23aa-4d07-8d4d-5b5ea67e03cc for instance df48bc66-8a8d-47e4-8823-2276d9f8d63b on n-h1-858383-16 Oct 27 10:44:28.379433 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-10a5aa1f-5363-4b33-ba90-af682627922f req-a1e44bbe-93b2-4de1-950c-bf0cd9dd8227 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120648 Oct 27 10:44:28.380084 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3981/8038] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:44:28.573291 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:28.573915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:28.580957 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:28.581466 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:28.581933 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:28.582666 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:28.583141 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:28.583795 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:28.626829 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:28.627478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:28.628016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:28.628563 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lazy-loading 'fault' on Instance uuid df48bc66-8a8d-47e4-8823-2276d9f8d63b {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:44:28.680455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:28.701292 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dc2ab76b-81cc-49cb-93df-9cbd532767a3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 200 len: 1335 microversion: 2.1 time: 0.131606 Oct 27 10:44:28.702378 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4058/8039] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:28 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:29.727961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:29.728668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: df48bc66-8a8d-47e4-8823-2276d9f8d63b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:29.735502 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:29.736041 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:29.736491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:29.737254 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:29.737715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:29.738153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:29.753941 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] HTTP exception thrown: Instance df48bc66-8a8d-47e4-8823-2276d9f8d63b could not be found. Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Request method failure captured: Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b HTTP/1.1 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWl-xV6T1ZI5tLtoC42lRgLfCPyNxERzMDWT-1vMV3vhcsRG_Zpa6g2I5lXnBjkYgd4DXUrfE-GnReYUGOjvr_Jc9lAgHgaC6iRHtnXq9IEzxLOm_xKIw0QUDoIEOi2-l2F2maKhxJs_7kFsKKMW5KeSunA5XyMDW-zC0nIrhIE08Zi0 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b89fe9e17828474aad0402777dd36267 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestShelveInstance-388949282 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b89fe9e17828474aad0402777dd36267"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b89fe9e17828474aad0402777dd36267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b89fe9e17828474aad0402777dd36267"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b89fe9e17828474aad0402777dd36267"}]}] Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestShelveInstance-388949282 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b89fe9e17828474aad0402777dd36267 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestShelveInstance-388949282 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestShelveInstance-388949282-project Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 647ffddca6764050b247a63d837cd046 Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestShelveInstance-388949282-project Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance df48bc66-8a8d-47e4-8823-2276d9f8d63b could not be found. Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': 'df48bc66-8a8d-47e4-8823-2276d9f8d63b'} Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df48bc66-8a8d-47e4-8823-2276d9f8d63b could not be found. Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df48bc66-8a8d-47e4-8823-2276d9f8d63b could not be found. Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:44:29.755676 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df48bc66-8a8d-47e4-8823-2276d9f8d63b could not be found. Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Returning 404 to user: Instance df48bc66-8a8d-47e4-8823-2276d9f8d63b could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e939a5b6-a4af-4513-8fb3-fdbe3a73892f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b" status: 404 len: 111 microversion: 2.1 time: 0.035589 Oct 27 10:44:29.765025 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3982/8040] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:29 2022] GET /compute/v2.1/servers/df48bc66-8a8d-47e4-8823-2276d9f8d63b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 10:44:29.938454 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b110e62a-7e52-473c-b8f6-8c4002b13df3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '.version_select at 0x7f31aa40d700>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:29.970001 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b110e62a-7e52-473c-b8f6-8c4002b13df3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-593327595" status: 202 len: 0 microversion: 2.1 time: 0.035927 Oct 27 10:44:29.971080 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4059/8041] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Oct 27 10:44:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-593327595 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:44:29.994698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5c5ff17-4cfa-4b40-9de7-881497857095 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Action: 'create', calling method: .version_select at 0x7f31aa1aa0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1244632550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5pM6knY4VO8DgFd27d8AhIuswgo6+eYJAs2fjhb6kPMWX+oSfps7gwby8E07Chof2NOQeVuw6sokUEWe0IJ+VZ+oIleDT2duM51ZHy+AyMKQxGQphc+wn9mNssnHV4EA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:30.010321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d5c5ff17-4cfa-4b40-9de7-881497857095 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Getting quotas for project b89fe9e17828474aad0402777dd36267. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:44:30.019394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-d5c5ff17-4cfa-4b40-9de7-881497857095 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Getting quotas for user 647ffddca6764050b247a63d837cd046 and project b89fe9e17828474aad0402777dd36267. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:44:30.050770 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5c5ff17-4cfa-4b40-9de7-881497857095 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.060133 Oct 27 10:44:30.051505 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3983/8042] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:44:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:44:48.644943 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:48.645708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:48.650310 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-521828099", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1244632550", "security_groups": [{"name": "tempest-secgroup-smoke-450965968"}], "networks": [{"uuid": "de7dd8f0-5c3a-4cf2-bffc-277f23d0fad3"}], "block_device_mapping_v2": [{"uuid": "7ccb0796-cd0a-44b3-bb74-8f37a58380ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:48.765839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] validate_networks() for [('de7dd8f0-5c3a-4cf2-bffc-277f23d0fad3', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:44:49.170247 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:44:49.170689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:44:49.171187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:44:49.171638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:44:49.172063 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:44:49.181353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:49.181853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:49.182306 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:49.183047 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:49.183521 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:49.183989 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:49.202576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Getting quotas for project b89fe9e17828474aad0402777dd36267. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:44:49.208015 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Getting quotas for user 647ffddca6764050b247a63d837cd046 and project b89fe9e17828474aad0402777dd36267. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:44:49.269997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:44:49.272173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ccb0796-cd0a-44b3-bb74-8f37a58380ff',volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:44:49.405182 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [d69669f5-5980-4210-99e9-6826d4f5f287] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:44:50.413541 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [d69669f5-5980-4210-99e9-6826d4f5f287] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42814. Oct 27 10:44:50.418050 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-657079d4-689d-4876-90ed-785a27cd20fc tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.775043 Oct 27 10:44:50.418808 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4060/8043] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:44:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 10:44:50.428173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=12 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:50.429897 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:50.430782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:44:50.434856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf7d3059-2598-43ee-9422-4c97379e8eec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:50.435487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf7d3059-2598-43ee-9422-4c97379e8eec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:50.502391 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf7d3059-2598-43ee-9422-4c97379e8eec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:50.510430 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf7d3059-2598-43ee-9422-4c97379e8eec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1088 microversion: 2.1 time: 0.084117 Oct 27 10:44:50.511014 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3984/8044] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:50 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:44:51.537498 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:51.538463 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:51.547456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:51.548013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:51.548474 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:51.549203 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:51.549678 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:51.550126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:51.680332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:51.689045 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5742a2cf-7cc6-413a-8e18-2ea2dee7871f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1186 microversion: 2.1 time: 0.157758 Oct 27 10:44:51.689673 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4061/8045] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:51 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1186 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:52.719394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:52.720821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:52.731554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:52.732368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:52.732975 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:52.733918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:52.734535 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:52.735296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:52.991094 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:52.999714 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fa55e03-b0fb-41a2-90bb-573db87b3f6e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1271 microversion: 2.1 time: 0.285423 Oct 27 10:44:53.000499 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3985/8046] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:52 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1271 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:44:53.374103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-3f9a5064-1441-44ef-8902-a381614a9eba req-00ca1dbb-cb91-4039-8f68-550be6650e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c29be0f-1adc-40a4-a81e-8ae921b6d1b9", "tag": "3eb8863e-5cb0-41c7-b255-20a813d6033d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:44:53.387390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3f9a5064-1441-44ef-8902-a381614a9eba req-00ca1dbb-cb91-4039-8f68-550be6650e2f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:53.388460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3f9a5064-1441-44ef-8902-a381614a9eba req-00ca1dbb-cb91-4039-8f68-550be6650e2f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:53.389090 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-3f9a5064-1441-44ef-8902-a381614a9eba req-00ca1dbb-cb91-4039-8f68-550be6650e2f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:53.427278 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-3f9a5064-1441-44ef-8902-a381614a9eba req-00ca1dbb-cb91-4039-8f68-550be6650e2f service nova] Creating event network-changed:3eb8863e-5cb0-41c7-b255-20a813d6033d for instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 on n-h2-858383-16 Oct 27 10:44:53.434583 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-3f9a5064-1441-44ef-8902-a381614a9eba req-00ca1dbb-cb91-4039-8f68-550be6650e2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080223 Oct 27 10:44:53.435754 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4062/8047] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:44:54.027191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:54.027922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:54.036302 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:54.037039 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:54.037704 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:54.038658 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:54.039478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:54.040121 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:54.282694 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:54.292044 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce808599-c260-4b8b-b07a-b26f9b2aadf9 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1271 microversion: 2.1 time: 0.271009 Oct 27 10:44:54.292773 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3986/8048] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:54 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:55.331111 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:55.331939 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:55.338862 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:55.339364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:55.339841 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:55.340552 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:55.341017 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:55.341453 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:55.492188 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:55.501172 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1cc27123-5527-4c12-94ad-4bd3b3c478ed tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1271 microversion: 2.1 time: 0.175351 Oct 27 10:44:55.501933 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4063/8049] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:55 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:56.526942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:56.527771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:56.534697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:56.535184 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:56.535654 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:56.536381 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:56.536824 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:56.537237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:56.679134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:56.687601 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59982a10-aed0-43e0-afcf-5a1c41fe03a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1271 microversion: 2.1 time: 0.165011 Oct 27 10:44:56.688212 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3987/8050] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:56 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:57.714698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:57.715324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:57.722753 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:57.723266 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:57.723773 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:57.724511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:57.724985 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:57.725780 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:57.884874 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:57.892593 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-7d97d955-1bbb-4078-a5ac-bea76d1c1047 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.183958 Oct 27 10:44:57.893328 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4064/8051] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:57 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:44:58.920238 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:44:58.920797 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:44:58.928642 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:58.929203 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:58.929660 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:58.930561 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:44:58.931077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:44:58.931646 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:44:59.083839 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:44:59.092880 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83c41f53-1fda-4b66-ae52-6883247cfaea tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.177105 Oct 27 10:44:59.093465 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3988/8052] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:44:58 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:00.116674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:00.117285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:00.120167 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:00.120859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:00.126865 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:00.127368 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:00.127847 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:00.128570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:00.129042 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:00.129485 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:00.267380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:00.275467 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8f32606e-71c8-4f39-b5be-ec95319e7cda tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.162725 Oct 27 10:45:00.276086 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4065/8053] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:00 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:45:01.298299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:01.298937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:01.301729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:45:01.307100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:01.307607 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:01.308048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:01.308750 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:01.309204 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:01.309627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:01.448869 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:01.456689 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37e38391-37e2-4fae-beaf-75338ca3e0bd tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.162278 Oct 27 10:45:01.457259 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3989/8054] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:01 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:45:02.480321 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:02.480996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:02.489360 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:02.489872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:02.490332 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:02.491079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:02.491549 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:02.492019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:02.664362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:02.677618 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b6e3e3c1-cb23-499e-92e6-3539ffbd2183 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.201082 Oct 27 10:45:02.678636 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4066/8055] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:02 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:03.702886 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:03.703460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:03.710296 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:03.710782 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:03.711366 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:03.712621 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:03.713066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:03.713496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:03.854604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:03.862562 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f63bfb3d-0d7f-4194-9c0a-bad0930e13ec tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.163693 Oct 27 10:45:03.863147 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3990/8056] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:03 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:04.886951 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:04.887771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:04.894663 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:04.895163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:04.895633 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:04.896339 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:04.896804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:04.897239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:05.042456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:05.051360 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-79529586-dd3e-4d55-9b07-d2895edd4d98 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.169475 Oct 27 10:45:05.052045 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4067/8057] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:04 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:06.087198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:06.088057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:06.097056 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:06.097558 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:06.098177 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:06.099228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:06.099756 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:06.100684 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:06.254634 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:06.263514 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-440aeaca-111b-4e1d-b6e4-7b35cfb2a620 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.180495 Oct 27 10:45:06.264193 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3991/8058] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:06 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:07.291990 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:07.293251 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:07.301788 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:07.302370 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:07.302799 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:07.303550 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:07.304103 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:07.304574 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:07.488175 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:07.498867 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-51bcab2a-e5ab-4f1e-b454-387faf573d42 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.215550 Oct 27 10:45:07.499490 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4068/8059] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:07 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:08.525418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:08.526066 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:08.533207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:08.533696 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:08.534134 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:08.534837 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:08.535292 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:08.535742 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:08.671211 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:08.678964 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-953caf85-1ad1-4be5-90cc-68db85da305e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.159384 Oct 27 10:45:08.679548 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3992/8060] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:08 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:09.426151 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-f524f6af-1b1b-40a0-8a0b-acf5d860c72a req-a52f82a2-c167-4d0e-a34a-0c88ca58fb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c29be0f-1adc-40a4-a81e-8ae921b6d1b9", "name": "network-vif-plugged", "status": "completed", "tag": "3eb8863e-5cb0-41c7-b255-20a813d6033d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:09.436045 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f524f6af-1b1b-40a0-8a0b-acf5d860c72a req-a52f82a2-c167-4d0e-a34a-0c88ca58fb1f service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:09.436548 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f524f6af-1b1b-40a0-8a0b-acf5d860c72a req-a52f82a2-c167-4d0e-a34a-0c88ca58fb1f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:09.436997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-f524f6af-1b1b-40a0-8a0b-acf5d860c72a req-a52f82a2-c167-4d0e-a34a-0c88ca58fb1f service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:09.449349 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-f524f6af-1b1b-40a0-8a0b-acf5d860c72a req-a52f82a2-c167-4d0e-a34a-0c88ca58fb1f service nova] Creating event network-vif-plugged:3eb8863e-5cb0-41c7-b255-20a813d6033d for instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 on n-h2-858383-16 Oct 27 10:45:09.455921 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-f524f6af-1b1b-40a0-8a0b-acf5d860c72a req-a52f82a2-c167-4d0e-a34a-0c88ca58fb1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085859 Oct 27 10:45:09.456664 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4069/8061] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:45:09.702748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:09.703369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:09.710325 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:09.710833 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:09.711915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:09.712629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:09.713093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:09.713533 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:09.845997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:09.854619 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7269077-3ee2-47e5-9f66-3b26620c7bc2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.155860 Oct 27 10:45:09.855193 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3993/8062] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:09 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:10.879248 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:10.880050 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:10.887694 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:10.888207 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:10.888674 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:10.890028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:10.890513 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:10.891213 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:11.037772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:11.048273 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d5efe101-f4cc-4946-a3e9-b2c6b3325d71 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1259 microversion: 2.1 time: 0.174170 Oct 27 10:45:11.048874 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4070/8063] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:10 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:45:12.071160 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:12.071942 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:12.079700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:12.080198 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:12.080638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:12.081356 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:12.081816 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:12.082243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:12.231190 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:12.239776 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0949e2f-5eba-4d5a-bc0f-42044d5be5f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1442 microversion: 2.1 time: 0.173118 Oct 27 10:45:12.240360 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3994/8064] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:12 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1442 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:12.261727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:45:12.262353 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:45:12.269166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:12.269662 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:12.270115 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:12.270810 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:12.271272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:12.271747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:12.406144 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:45:12.413882 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-51c5c894-9b57-4dca-9882-6721615cd06a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1442 microversion: 2.1 time: 0.156095 Oct 27 10:45:12.415062 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4071/8065] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:45:12 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:45:14.397891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-df20a9c9-8f1f-4788-bd49-c430ad3e0f53 req-53d7f754-a014-4c4f-9f52-bbd1554ff7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c29be0f-1adc-40a4-a81e-8ae921b6d1b9", "tag": "3eb8863e-5cb0-41c7-b255-20a813d6033d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:45:14.408840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df20a9c9-8f1f-4788-bd49-c430ad3e0f53 req-53d7f754-a014-4c4f-9f52-bbd1554ff7f5 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:45:14.409468 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df20a9c9-8f1f-4788-bd49-c430ad3e0f53 req-53d7f754-a014-4c4f-9f52-bbd1554ff7f5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:45:14.409978 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-df20a9c9-8f1f-4788-bd49-c430ad3e0f53 req-53d7f754-a014-4c4f-9f52-bbd1554ff7f5 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:45:14.422159 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-df20a9c9-8f1f-4788-bd49-c430ad3e0f53 req-53d7f754-a014-4c4f-9f52-bbd1554ff7f5 service nova] Creating event network-changed:3eb8863e-5cb0-41c7-b255-20a813d6033d for instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 on n-h2-858383-16 Oct 27 10:45:14.427800 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-df20a9c9-8f1f-4788-bd49-c430ad3e0f53 req-53d7f754-a014-4c4f-9f52-bbd1554ff7f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033859 Oct 27 10:45:14.428819 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3995/8066] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:08.813661 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:47:08.814558 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:47:08.815123 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:08.815896 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=60 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:08.816954 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:47:08.817100 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:47:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9/action (ip 10.222.0.25) !!! Oct 27 10:47:08.825669 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:08.826221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:08.834870 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.835295 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.835774 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.836480 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.836944 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.837381 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.861506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.objects.instance [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lazy-loading 'flavor' on Instance uuid 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 {{(pid=120602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 10:47:08.932885 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1abfbc8d-d9a5-46f5-ad12-762115266266 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "POST /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9/action" status: 202 len: 0 microversion: 2.1 time: 0.121265 Oct 27 10:47:08.933476 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4072/8067] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:47:08 2022] POST /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:47:08.940348 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:47:08.941263 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:47:08.941891 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=26 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:08.942629 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=62 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:08.944042 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:47:08.944370 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:47:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 (ip 10.222.0.25) !!! Oct 27 10:47:08.945368 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:47:08.945496 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:47:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 (ip 10.222.0.25) !!! Oct 27 10:47:08.950300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:08.951096 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:08.961192 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.961688 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.962148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:08.962844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:08.963299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:08.963757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:09.228818 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:09.236739 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9897a495-f6f9-4858-8c20-1884595681e5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.298676 Oct 27 10:47:09.237305 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3996/8068] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:08 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:10.263640 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:10.264364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:10.273322 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:10.273818 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:10.274273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:10.274978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:10.275444 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:10.275912 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:10.280737 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42936. Oct 27 10:47:10.281460 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42938. Oct 27 10:47:10.457789 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:10.466924 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2be2edaa-c1dd-42b5-b24a-e97b3d83e8a1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.210158 Oct 27 10:47:10.467666 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4073/8069] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:10 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:11.491040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:11.491701 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:11.500469 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:11.500958 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:11.501398 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:11.502091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:11.502544 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:11.503014 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:11.512362 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42946. Oct 27 10:47:11.523018 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42944. Oct 27 10:47:11.640921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:11.650373 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2f3fbbff-0b95-4127-95e1-db1c207d64a0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.163605 Oct 27 10:47:11.650950 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3997/8070] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:11 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:12.674131 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:12.674762 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:12.681631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:12.682134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:12.682619 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:12.683333 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:12.683839 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:12.684286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:12.821222 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:12.829030 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c3403630-51e5-4030-b17c-a78784f9c111 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.158952 Oct 27 10:47:12.829602 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4074/8071] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:12 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:47:13.854207 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:13.854806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:13.861536 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:13.862022 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:13.862460 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:13.863146 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:13.863624 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:13.864050 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:13.999019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:14.007272 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c80b0fc8-ba82-4015-a56a-94f654ae5c9c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.157769 Oct 27 10:47:14.007871 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3998/8072] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:13 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:47:15.031106 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:15.031786 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:15.039160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:15.039677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:15.040126 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:15.040830 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:15.041293 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:15.041729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:15.176464 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:15.184894 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-8e47d7d7-b2c7-469a-8563-f5af74c1cdde tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.157740 Oct 27 10:47:15.185471 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4075/8073] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:15 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:16.208834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:16.209459 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:16.216268 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:16.216751 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:16.217185 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:16.217872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:16.218321 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:16.218745 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:16.354080 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:16.361848 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62a67d36-b99d-43b8-b5b2-3ab8e3eeb252 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.157025 Oct 27 10:47:16.362419 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3999/8074] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:16 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:17.386425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:17.387044 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:17.393883 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:17.394377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:17.394823 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:17.395516 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:17.396004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:17.396499 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:17.529655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:17.537544 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-15b5a7ac-5e81-4101-aa5b-c9c38599dc33 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.155750 Oct 27 10:47:17.538186 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4076/8075] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:17 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:18.561478 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:18.562091 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:18.568872 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:18.569357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:18.569798 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:18.570490 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:18.570947 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:18.571382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:18.700455 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:18.708219 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d0c873c-aa81-4d87-a555-b977614b3ca5 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.150728 Oct 27 10:47:18.708799 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4000/8076] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:18 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:19.732688 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:19.733425 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:19.740298 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:19.742002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:19.742002 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:19.742684 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:19.743155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:19.743618 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:19.877452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:19.885204 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fd127390-19ab-443e-85e5-88153bdd13d8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.156432 Oct 27 10:47:19.885774 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4077/8077] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:19 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:20.908415 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:20.909034 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:20.916078 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:20.916565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:20.917004 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:20.917697 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:20.918156 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:20.918587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:21.049974 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:21.058439 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-40429e41-5a44-44f7-bb71-6a18545e97a2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.154045 Oct 27 10:47:21.059010 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4001/8078] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:20 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:22.082576 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:22.083239 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:22.091596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:22.092114 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:22.092580 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:22.093314 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:22.093792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:22.094245 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:22.235318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:22.243917 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-02026354-eb9d-462f-8cb6-cd7a66769c58 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.165273 Oct 27 10:47:22.244518 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4078/8079] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:22 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:23.267447 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:23.268088 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:23.275364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:23.275882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:23.276323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:23.277024 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:23.277475 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:23.277901 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:23.413399 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:23.421305 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0e6cbd6-4e71-43f4-8403-96b5bbe8d912 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1568 microversion: 2.1 time: 0.157753 Oct 27 10:47:23.421906 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4002/8080] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:23 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:23.443551 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:23.444192 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:23.451895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:23.452329 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:23.452785 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:23.453503 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:23.453971 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:23.454507 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:23.487253 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120602) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 27 10:47:23.554081 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ffac6f9a-b93a-406a-9059-9fbfa64052b2 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "POST /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9/action" status: 202 len: 0 microversion: 2.1 time: 0.114352 Oct 27 10:47:23.557661 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4079/8081] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:47:23 2022] POST /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:47:23.562908 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:23.563521 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:23.570090 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:23.570579 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:23.571232 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:23.572025 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:23.572718 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:23.573101 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:23.709653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:23.718690 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-056579e8-8f97-426e-b4c4-a717e329175a tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1516 microversion: 2.1 time: 0.159691 Oct 27 10:47:23.719357 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4003/8082] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:23 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:47:24.743455 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:24.744130 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:24.750468 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:24.750964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:24.751448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:24.752187 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:24.752655 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:24.753094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:24.886543 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:24.894882 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d295a564-5e1d-47ad-a0cf-915ee8d88daa tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1518 microversion: 2.1 time: 0.156325 Oct 27 10:47:24.895491 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4080/8083] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:24 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:25.924429 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-27c2b934-c94d-4855-a89c-d16407206bcf req-d889ff84-2e96-4179-bffd-6c40dc093717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c29be0f-1adc-40a4-a81e-8ae921b6d1b9", "name": "network-vif-unplugged", "status": "completed", "tag": "3eb8863e-5cb0-41c7-b255-20a813d6033d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:25.926882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:25.928681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:25.944673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:25.945165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:25.945600 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:25.946298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:25.946749 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:25.947179 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:25.953156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-27c2b934-c94d-4855-a89c-d16407206bcf req-d889ff84-2e96-4179-bffd-6c40dc093717 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:25.953646 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-27c2b934-c94d-4855-a89c-d16407206bcf req-d889ff84-2e96-4179-bffd-6c40dc093717 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:25.954080 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-27c2b934-c94d-4855-a89c-d16407206bcf req-d889ff84-2e96-4179-bffd-6c40dc093717 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:25.979182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.compute.server_external_events [req-27c2b934-c94d-4855-a89c-d16407206bcf req-d889ff84-2e96-4179-bffd-6c40dc093717 service nova] Unable to find a host for instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9. Dropping event network-vif-unplugged {{(pid=120602) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 10:47:25.983950 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-27c2b934-c94d-4855-a89c-d16407206bcf req-d889ff84-2e96-4179-bffd-6c40dc093717 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060223 Oct 27 10:47:25.987660 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4081/8084] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 10:47:26.120215 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:26.128178 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f40d371-b573-4561-9c0d-44b98e8897e0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1518 microversion: 2.1 time: 0.211716 Oct 27 10:47:26.128866 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4004/8085] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:25 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:27.151765 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:27.152517 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:27.161652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:27.162356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:27.162956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:27.164590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:27.165254 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:27.165917 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:27.302689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:27.311856 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-3f2e690f-052a-47e9-88bc-6363a8c0299c tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1518 microversion: 2.1 time: 0.164146 Oct 27 10:47:27.312464 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4082/8086] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:27 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:28.334434 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:28.335057 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:28.342729 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:28.343223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:28.343800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:28.344734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:28.345201 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:28.345633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:28.481610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:28.489661 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4623b8b9-e4c9-49bf-b90f-8df9de59acc3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1518 microversion: 2.1 time: 0.159144 Oct 27 10:47:28.490233 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4005/8087] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:28 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:29.512748 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:29.513377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:29.520221 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:29.520719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:29.521169 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:29.521867 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:29.522382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:29.523364 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:29.655975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:29.665542 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-a72a5e89-9326-430e-9d3a-00e4306f7178 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.156619 Oct 27 10:47:29.666138 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4083/8088] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:29 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:30.688766 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:30.689382 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:30.691817 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-392fa816-8fb2-463f-b8f0-3bb145284ad8 req-876b77b7-7b95-4eaf-89c6-181920db854d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c29be0f-1adc-40a4-a81e-8ae921b6d1b9", "tag": "3eb8863e-5cb0-41c7-b255-20a813d6033d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:30.698042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:30.698834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:30.699486 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:30.700575 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:30.701247 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:30.701859 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:30.703729 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-392fa816-8fb2-463f-b8f0-3bb145284ad8 req-876b77b7-7b95-4eaf-89c6-181920db854d service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:30.704232 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-392fa816-8fb2-463f-b8f0-3bb145284ad8 req-876b77b7-7b95-4eaf-89c6-181920db854d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:30.704766 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-392fa816-8fb2-463f-b8f0-3bb145284ad8 req-876b77b7-7b95-4eaf-89c6-181920db854d service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:30.716548 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-392fa816-8fb2-463f-b8f0-3bb145284ad8 req-876b77b7-7b95-4eaf-89c6-181920db854d service nova] Creating event network-changed:3eb8863e-5cb0-41c7-b255-20a813d6033d for instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 on n-h1-858383-16 Oct 27 10:47:30.722505 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-392fa816-8fb2-463f-b8f0-3bb145284ad8 req-876b77b7-7b95-4eaf-89c6-181920db854d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037256 Oct 27 10:47:30.723381 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4084/8089] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:47:30.841592 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:30.849479 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b4294cdc-8760-4fb8-b448-6951e04ba6b0 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.164832 Oct 27 10:47:30.850091 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4006/8090] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:30 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:31.874909 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:31.875685 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:31.881954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:31.882452 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:31.882907 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:31.883638 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:31.884631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:31.885067 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:32.019745 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:32.028110 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-820793d4-efc1-498d-a1ed-2b08b4e91a15 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.158212 Oct 27 10:47:32.028710 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4085/8091] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:31 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:33.050420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:33.051030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:33.058556 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:33.059048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:33.059491 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:33.060219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:33.060679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:33.061103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:33.193230 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:33.201014 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8b6e9b86-35b9-48a1-ae1b-02dc091038c8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.154497 Oct 27 10:47:33.201589 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4007/8092] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:33 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:34.223637 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:34.224272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:34.232341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:34.232849 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:34.233292 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:34.234010 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:34.234476 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:34.234915 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:34.379911 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:34.383449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:34.389439 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f6f649c8-7c7a-4a7b-8f04-a20e3a125ec8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.169713 Oct 27 10:47:34.390018 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4086/8093] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:34 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:35.412437 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:35.413076 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:35.420431 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:35.420918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:35.421364 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:35.422059 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:35.422520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:35.422948 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:35.552640 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:35.561068 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-86f2562e-a007-4b15-a580-0bdad2d8f426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.152544 Oct 27 10:47:35.561644 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4008/8094] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:35 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:36.584276 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:36.584956 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:36.593435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:36.593975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:36.594418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:36.595134 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:36.595631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:36.596076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:36.732570 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:36.740492 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-373fb37b-cca1-484a-9bdf-115d3c965ef1 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.160240 Oct 27 10:47:36.741062 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4087/8095] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:36 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:37.764333 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:37.764954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:37.771810 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:37.772300 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:37.772733 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:37.773423 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:37.773884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:37.774299 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:37.909577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:37.918174 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc422cdf-cb65-4376-b875-d501cbadb581 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.158611 Oct 27 10:47:37.918751 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4009/8096] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:37 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:38.941531 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:38.942095 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:38.944760 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:38.950599 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:38.951101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:38.951590 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:38.952316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:38.952767 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:38.953211 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:39.086996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:39.094955 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-5fc627db-00c8-423e-82a7-f900eb8e5fe6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.157489 Oct 27 10:47:39.095539 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4088/8097] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:38 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:40.118793 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:40.119413 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:40.122622 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=29 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:40.127868 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:40.128354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:40.128787 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:40.129473 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:40.129921 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:40.130344 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:40.133070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=85 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:47:40.265865 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:40.274375 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-947309cc-5c9c-496d-8c8a-091e3cb3e23f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.159494 Oct 27 10:47:40.274949 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4010/8098] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:40 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:41.298371 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:41.299019 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:41.305338 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:41.305833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:41.306281 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:41.306978 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:41.307443 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:41.307921 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:41.438595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:41.446390 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-dabd00f5-b7da-4a74-b4fc-d39dc9eab38e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.152142 Oct 27 10:47:41.446975 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4089/8099] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:41 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:42.403778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-06498f9c-f72d-4c43-867a-9b5bde80e27a req-1948df57-7495-4db0-9b8b-c0892c6dac48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c29be0f-1adc-40a4-a81e-8ae921b6d1b9", "name": "network-vif-plugged", "status": "completed", "tag": "3eb8863e-5cb0-41c7-b255-20a813d6033d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:47:42.414985 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06498f9c-f72d-4c43-867a-9b5bde80e27a req-1948df57-7495-4db0-9b8b-c0892c6dac48 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:42.415479 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06498f9c-f72d-4c43-867a-9b5bde80e27a req-1948df57-7495-4db0-9b8b-c0892c6dac48 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:42.415983 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-06498f9c-f72d-4c43-867a-9b5bde80e27a req-1948df57-7495-4db0-9b8b-c0892c6dac48 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:42.427415 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-06498f9c-f72d-4c43-867a-9b5bde80e27a req-1948df57-7495-4db0-9b8b-c0892c6dac48 service nova] Creating event network-vif-plugged:3eb8863e-5cb0-41c7-b255-20a813d6033d for instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 on n-h1-858383-16 Oct 27 10:47:42.430836 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [req-06498f9c-f72d-4c43-867a-9b5bde80e27a req-1948df57-7495-4db0-9b8b-c0892c6dac48 service nova] [3effb113-6057-4a8d-bc42-a2b3d45193a2] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:47:42.470182 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:42.470804 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:42.478016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:42.478491 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:42.478941 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:42.479699 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:42.480164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:42.480600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:42.615233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:42.623201 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-2cc1310c-f607-4bb7-8ee4-5f5ed7cd0794 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.156888 Oct 27 10:47:42.623801 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4090/8100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:42 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:47:43.437768 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [req-06498f9c-f72d-4c43-867a-9b5bde80e27a req-1948df57-7495-4db0-9b8b-c0892c6dac48 service nova] [3effb113-6057-4a8d-bc42-a2b3d45193a2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43036. Oct 27 10:47:43.441860 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-06498f9c-f72d-4c43-867a-9b5bde80e27a req-1948df57-7495-4db0-9b8b-c0892c6dac48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.042924 Oct 27 10:47:43.442479 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4011/8101] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:47:43.646385 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:43.647057 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:43.654448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:43.654940 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:43.655388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:43.656392 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:43.656853 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:43.657286 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:43.787410 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:43.795607 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ffc21342-04a7-45ee-a7cd-a57d9e0fecfb tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.153091 Oct 27 10:47:43.796183 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4091/8102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:43 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:44.819941 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:44.820748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:44.827679 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:44.828719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:44.829193 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:44.829918 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:44.830380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:44.830808 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:45.006151 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:45.015340 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b289b3f-94bf-4437-84b5-b5086a135e66 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1574 microversion: 2.1 time: 0.200567 Oct 27 10:47:45.015976 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4012/8103] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:44 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:47:46.040460 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:47:46.041110 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:47:46.048508 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:46.049005 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:46.049457 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:46.050163 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:47:46.050631 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:47:46.051073 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:47:46.184119 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:47:46.199540 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-266c939b-0a43-4f7a-8d96-cfa8e9ebe555 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1561 microversion: 2.1 time: 0.163062 Oct 27 10:47:46.200165 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4092/8104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:47:46 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:02.948903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:02.950260 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=13 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:02.950999 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=9 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:02.952271 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=36 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:02.955483 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:02.956021 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:02.958486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-205e6373-8e34-4d2c-9113-3a3221da7fed req-7b4f27fa-5ba4-4edb-b4df-87fd7db143df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c29be0f-1adc-40a4-a81e-8ae921b6d1b9", "tag": "3eb8863e-5cb0-41c7-b255-20a813d6033d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:02.964223 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:02.964821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:02.965331 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:02.966262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:02.966884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:02.967538 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:02.970682 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-205e6373-8e34-4d2c-9113-3a3221da7fed req-7b4f27fa-5ba4-4edb-b4df-87fd7db143df service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:02.971190 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-205e6373-8e34-4d2c-9113-3a3221da7fed req-7b4f27fa-5ba4-4edb-b4df-87fd7db143df service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:02.971672 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-205e6373-8e34-4d2c-9113-3a3221da7fed req-7b4f27fa-5ba4-4edb-b4df-87fd7db143df service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:02.986142 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-205e6373-8e34-4d2c-9113-3a3221da7fed req-7b4f27fa-5ba4-4edb-b4df-87fd7db143df service nova] Creating event network-changed:3eb8863e-5cb0-41c7-b255-20a813d6033d for instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 on n-h1-858383-16 Oct 27 10:49:02.992228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-205e6373-8e34-4d2c-9113-3a3221da7fed req-7b4f27fa-5ba4-4edb-b4df-87fd7db143df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043327 Oct 27 10:49:02.993598 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4093/8105] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:49:02.995814 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:49:03.080096 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a0489886-6a33-4993-812a-68a39f6b0cf6 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 204 len: 0 microversion: 2.1 time: 0.132977 Oct 27 10:49:03.083671 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4013/8106] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:49:02 2022] DELETE /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:49:03.093402 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:03.094224 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:03.100791 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:03.101923 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:03.102595 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:03.103390 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:03.104117 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:03.104720 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:03.247372 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:03.255315 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-b3a85b3f-12c1-4652-8de3-211138c0b202 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.167100 Oct 27 10:49:03.255959 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4094/8107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:03 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:04.280015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:04.280728 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:04.288806 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:04.289329 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:04.290400 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:04.291108 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:04.291587 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:04.292023 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:04.425666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:04.433544 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e84ac3be-b346-422b-a064-eddc2dc1af7f tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1567 microversion: 2.1 time: 0.157904 Oct 27 10:49:04.434044 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4014/8108] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:04 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:05.147677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-b842aea3-1307-4e07-a2ef-35543affdb75 req-8b6c0769-5f24-4175-b7f5-d8add05e60fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c29be0f-1adc-40a4-a81e-8ae921b6d1b9", "name": "network-vif-deleted", "tag": "3eb8863e-5cb0-41c7-b255-20a813d6033d"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:05.162086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b842aea3-1307-4e07-a2ef-35543affdb75 req-8b6c0769-5f24-4175-b7f5-d8add05e60fd service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:05.162573 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b842aea3-1307-4e07-a2ef-35543affdb75 req-8b6c0769-5f24-4175-b7f5-d8add05e60fd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:05.163014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-b842aea3-1307-4e07-a2ef-35543affdb75 req-8b6c0769-5f24-4175-b7f5-d8add05e60fd service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:05.181132 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-b842aea3-1307-4e07-a2ef-35543affdb75 req-8b6c0769-5f24-4175-b7f5-d8add05e60fd service nova] Creating event network-vif-deleted:3eb8863e-5cb0-41c7-b255-20a813d6033d for instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 on n-h1-858383-16 Oct 27 10:49:05.186706 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-b842aea3-1307-4e07-a2ef-35543affdb75 req-8b6c0769-5f24-4175-b7f5-d8add05e60fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042951 Oct 27 10:49:05.187289 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4095/8109] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:05.458092 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:05.459323 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:05.467106 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:05.467631 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:05.468083 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:05.468800 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:05.469262 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:05.469710 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:05.543528 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:05.552206 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c52fbcbb-58a4-4809-b118-0b0f4da5df9e tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1219 microversion: 2.1 time: 0.098025 Oct 27 10:49:05.553205 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4015/8110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:05 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:06.576170 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:06.576916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:06.583435 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:06.583903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:06.584356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:06.585069 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:06.585537 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:06.585979 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:06.654146 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:06.662116 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-ae2b9f69-48a5-4686-9dc3-5f33976f5c61 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1219 microversion: 2.1 time: 0.091183 Oct 27 10:49:06.662696 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4096/8111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:06 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:07.686525 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:07.687241 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:07.694450 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:07.694937 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:07.695379 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:07.696243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:07.696707 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:07.697139 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:07.766208 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:07.775302 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3205b06c-6632-40b3-a24e-a8607ee1d426 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1219 microversion: 2.1 time: 0.092711 Oct 27 10:49:07.776187 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4016/8112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:07 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:08.803486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:08.804164 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:08.812362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:08.812871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:08.813328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:08.814052 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:08.814532 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:08.814976 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:08.883740 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '647ffddca6764050b247a63d837cd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89fe9e17828474aad0402777dd36267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:08.892539 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9eabce41-f226-4925-a8de-44eb0ba0b0f8 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 200 len: 1219 microversion: 2.1 time: 0.094007 Oct 27 10:49:08.893062 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4097/8113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:08 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:09.915922 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:09.916673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] [instance: 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:09.923764 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:09.924354 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:09.924796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:09.925500 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:09.925963 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:09.926397 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:09.940659 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] HTTP exception thrown: Instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 could not be found. Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Request method failure captured: Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 HTTP/1.1 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWl-xV6T1ZI5tLtoC42lRgLfCPyNxERzMDWT-1vMV3vhcsRG_Zpa6g2I5lXnBjkYgd4DXUrfE-GnReYUGOjvr_Jc9lAgHgaC6iRHtnXq9IEzxLOm_xKIw0QUDoIEOi2-l2F2maKhxJs_7kFsKKMW5KeSunA5XyMDW-zC0nIrhIE08Zi0 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: b89fe9e17828474aad0402777dd36267 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestShelveInstance-388949282 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b89fe9e17828474aad0402777dd36267"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b89fe9e17828474aad0402777dd36267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b89fe9e17828474aad0402777dd36267"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b89fe9e17828474aad0402777dd36267"}]}] Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestShelveInstance-388949282 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: b89fe9e17828474aad0402777dd36267 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestShelveInstance-388949282 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestShelveInstance-388949282-project Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 647ffddca6764050b247a63d837cd046 Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestShelveInstance-388949282-project Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 could not be found. Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '7c29be0f-1adc-40a4-a81e-8ae921b6d1b9'} Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 could not be found. Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 could not be found. Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:49:09.942340 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 could not be found. Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Returning 404 to user: Instance 7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f96de27f-d9dc-4310-9a86-f32315710082 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9" status: 404 len: 111 microversion: 2.1 time: 0.032313 Oct 27 10:49:09.948457 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4017/8114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:09 2022] GET /compute/v2.1/servers/7c29be0f-1adc-40a4-a81e-8ae921b6d1b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:49:10.117456 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-19791282-719f-4b0e-bf0e-85c81907abb3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] Calling method '.version_select at 0x7f31ae4adf70>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:10.159228 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-19791282-719f-4b0e-bf0e-85c81907abb3 tempest-TestShelveInstance-388949282 tempest-TestShelveInstance-388949282-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1244632550" status: 202 len: 0 microversion: 2.1 time: 0.046185 Oct 27 10:49:10.159879 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4098/8115] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Oct 27 10:49:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1244632550 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 10:49:28.007099 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:28.008199 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:28.191725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5f252015-2a6f-4c80-a9f8-b5f2b7e5eebc tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Action: 'create', calling method: .version_select at 0x7f31a9007d30>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1904509449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaoVob1cW1bq1PxWZfDtC8KcRC3uKvGlHQSUPbEBd5YzM4JOWaXA6WU23Bs9eKUKNShIEfY0OEikKrHXeQKVFyOHTa7Q68aDdvxfJLGEjVJVsSSL8S4f6TK8hIUzIdPyA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:28.214283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5f252015-2a6f-4c80-a9f8-b5f2b7e5eebc tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Getting quotas for project 80d80e6d8c624fb1abbdf27d63f42b4e. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:49:28.224408 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-5f252015-2a6f-4c80-a9f8-b5f2b7e5eebc tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Getting quotas for user 04cf6c93de1b4ce4a3046fd9a3ae6c28 and project 80d80e6d8c624fb1abbdf27d63f42b4e. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:49:28.254991 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5f252015-2a6f-4c80-a9f8-b5f2b7e5eebc tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.253011 Oct 27 10:49:28.256045 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4018/8116] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Oct 27 10:49:28 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:29.373796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=22 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:29.374996 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:29.379561 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1877390182", "imageRef": "a5a38eaa-9305-45a5-98b3-c9ecee92f0b1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1904509449", "security_groups": [{"name": "tempest-secgroup-smoke-1776534194"}], "networks": [{"uuid": "e8d88299-09f3-4917-b835-818d7d43677b"}]}} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:29.495193 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.network.neutron [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] validate_networks() for [('e8d88299-09f3-4917-b835-818d7d43677b', None, None, None, None, None)] {{(pid=120602) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:49:29.973273 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Flavor limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:49:29.974036 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Image limits 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:49:29.974541 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Flavor pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:49:29.974964 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Image pref 0:0:0 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:49:29.975389 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.virt.hardware [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:49:29.985328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:29.985821 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:29.986272 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:29.987014 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:29.987478 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:29.987947 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:30.006328 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Getting quotas for project 80d80e6d8c624fb1abbdf27d63f42b4e. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:49:30.012324 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.quota [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Getting quotas for user 04cf6c93de1b4ce4a3046fd9a3ae6c28 and project 80d80e6d8c624fb1abbdf27d63f42b4e. Resources: {'cores', 'ram', 'instances'} {{(pid=120602) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:49:30.027509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Going to run 1 instances... {{(pid=120602) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:49:30.030196 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5a38eaa-9305-45a5-98b3-c9ecee92f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:49:30.080768 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-4a845cc6-c3ab-4538-aa00-411ee9a53395 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708750 Oct 27 10:49:30.081346 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4099/8117] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:49:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:49:30.094011 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ddeeed13-038b-49c4-9604-a89579978e5d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:30.094700 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ddeeed13-038b-49c4-9604-a89579978e5d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:30.155825 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-ddeeed13-038b-49c4-9604-a89579978e5d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:30.162822 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ddeeed13-038b-49c4-9604-a89579978e5d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1249 microversion: 2.1 time: 0.073662 Oct 27 10:49:30.163421 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4019/8118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:30 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1249 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:31.187016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:31.187668 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:31.194388 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:31.194889 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:31.195340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:31.196677 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:31.197145 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:31.197579 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:31.264300 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:31.272571 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-9f01c7ab-b237-40d3-92dd-5cb227e2086f tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1301 microversion: 2.1 time: 0.090309 Oct 27 10:49:31.287624 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4100/8119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:31 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:32.303675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:32.304291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:32.312290 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:32.312796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:32.313442 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:32.314150 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:32.314605 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:32.315030 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:32.574857 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:32.582658 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c56b249-b423-41fe-8d48-cb577f56ddce tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1375 microversion: 2.1 time: 0.283207 Oct 27 10:49:32.583437 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4020/8120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:32 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1375 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:33.098704 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-1a1a594a-bf67-442c-b02d-ed48b3333378 req-16927130-207d-4f43-aaff-952e62463a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ee1904-2537-4194-b00d-01f1246b5ee7", "tag": "8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:33.114312 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1a1a594a-bf67-442c-b02d-ed48b3333378 req-16927130-207d-4f43-aaff-952e62463a69 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:33.115165 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1a1a594a-bf67-442c-b02d-ed48b3333378 req-16927130-207d-4f43-aaff-952e62463a69 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:33.115603 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-1a1a594a-bf67-442c-b02d-ed48b3333378 req-16927130-207d-4f43-aaff-952e62463a69 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:33.128400 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-1a1a594a-bf67-442c-b02d-ed48b3333378 req-16927130-207d-4f43-aaff-952e62463a69 service nova] Creating event network-changed:8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf for instance 53ee1904-2537-4194-b00d-01f1246b5ee7 on n-h2-858383-16 Oct 27 10:49:33.133511 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-1a1a594a-bf67-442c-b02d-ed48b3333378 req-16927130-207d-4f43-aaff-952e62463a69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134743 Oct 27 10:49:33.134389 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4101/8121] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:33.607271 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:33.607904 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:33.614725 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:33.615148 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:33.615676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:33.616368 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:33.616821 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:33.617240 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:33.748009 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:33.755718 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f1f2bfc-d3e8-48ad-963b-80c952e86aae tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1375 microversion: 2.1 time: 0.152385 Oct 27 10:49:33.756286 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4021/8122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:33 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:34.779900 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:34.780611 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:34.787040 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:34.787545 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:34.788028 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:34.788747 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:34.789216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:34.790157 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:34.929593 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:34.937496 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-30bab38d-f196-4442-b8b7-b7e1278f06ec tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1375 microversion: 2.1 time: 0.162760 Oct 27 10:49:34.938078 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4102/8123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:34 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:35.962324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:35.962968 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:35.970853 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:35.971348 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:35.971807 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:35.972513 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:35.973191 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:35.973638 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:36.117726 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:36.125611 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8b35b6c8-6c15-420f-a9e1-d90c9c1bd841 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1375 microversion: 2.1 time: 0.168908 Oct 27 10:49:36.126200 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4022/8124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:35 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:37.149041 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:37.149636 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:37.156217 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:37.156719 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:37.157173 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:37.157895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:37.158365 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:37.158805 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:37.298259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:37.306452 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-1e6bafab-b593-4dd0-a2a4-947c56fc3aea tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1375 microversion: 2.1 time: 0.161488 Oct 27 10:49:37.307040 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4103/8125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:37 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:38.328915 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:38.330018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:38.337288 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:38.337780 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:38.338237 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:38.338961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:38.339420 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:38.339875 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:38.474231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:38.482274 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d310c7ff-f656-480a-a5d2-d48d2be5e813 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1375 microversion: 2.1 time: 0.157302 Oct 27 10:49:38.482845 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4023/8126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:38 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:38.659997 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-e8508478-d55a-41d7-a28e-326b982fbae5 req-aa687941-b617-4cdc-b472-6079675a5262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ee1904-2537-4194-b00d-01f1246b5ee7", "name": "network-vif-plugged", "status": "completed", "tag": "8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:38.671112 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e8508478-d55a-41d7-a28e-326b982fbae5 req-aa687941-b617-4cdc-b472-6079675a5262 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:38.671899 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e8508478-d55a-41d7-a28e-326b982fbae5 req-aa687941-b617-4cdc-b472-6079675a5262 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:38.672377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-e8508478-d55a-41d7-a28e-326b982fbae5 req-aa687941-b617-4cdc-b472-6079675a5262 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:38.684823 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-e8508478-d55a-41d7-a28e-326b982fbae5 req-aa687941-b617-4cdc-b472-6079675a5262 service nova] Creating event network-vif-plugged:8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf for instance 53ee1904-2537-4194-b00d-01f1246b5ee7 on n-h2-858383-16 Oct 27 10:49:38.689845 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-e8508478-d55a-41d7-a28e-326b982fbae5 req-aa687941-b617-4cdc-b472-6079675a5262 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Oct 27 10:49:38.690446 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4104/8127] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:49:39.505619 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:39.506231 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:39.513926 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:39.514418 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:39.514864 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:39.515560 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:39.516040 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:39.516496 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:39.650977 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:39.659026 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3256aad-8901-4786-8916-87b81a9d2b31 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1375 microversion: 2.1 time: 0.157503 Oct 27 10:49:39.659621 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4024/8128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:39 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:40.680076 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:40.681038 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=6 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:40.685913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:40.686707 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:40.693968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:40.694470 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:40.694925 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:40.695652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:40.696125 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:40.696567 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:40.831155 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:40.839540 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-28847857-8a0d-477a-85b8-b2d4898580e1 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1558 microversion: 2.1 time: 0.161366 Oct 27 10:49:40.840139 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4105/8129] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:40 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:40.862068 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:49:40.862633 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:49:40.864438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:49:40.870520 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:40.871001 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:40.871435 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:40.872173 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:40.872627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:40.873049 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:41.010035 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:49:41.018537 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23717f13-a8dc-4916-aafa-1d4c00275948 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1558 microversion: 2.1 time: 0.160207 Oct 27 10:49:41.019139 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4025/8130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:49:40 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:49:43.037434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-80c9242e-67d9-4a61-962c-01a2e9a67b86 req-3bfc2958-ec02-443f-b6c4-a59c61ec423c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ee1904-2537-4194-b00d-01f1246b5ee7", "tag": "8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:49:43.048340 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-80c9242e-67d9-4a61-962c-01a2e9a67b86 req-3bfc2958-ec02-443f-b6c4-a59c61ec423c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:49:43.048838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-80c9242e-67d9-4a61-962c-01a2e9a67b86 req-3bfc2958-ec02-443f-b6c4-a59c61ec423c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:49:43.049285 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-80c9242e-67d9-4a61-962c-01a2e9a67b86 req-3bfc2958-ec02-443f-b6c4-a59c61ec423c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:49:43.061171 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-80c9242e-67d9-4a61-962c-01a2e9a67b86 req-3bfc2958-ec02-443f-b6c4-a59c61ec423c service nova] Creating event network-changed:8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf for instance 53ee1904-2537-4194-b00d-01f1246b5ee7 on n-h2-858383-16 Oct 27 10:49:43.067049 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-80c9242e-67d9-4a61-962c-01a2e9a67b86 req-3bfc2958-ec02-443f-b6c4-a59c61ec423c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088461 Oct 27 10:49:43.068212 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4106/8131] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:19.555838 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:52:19.556744 n-d-858383-16 devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 10:52:19.557265 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:19.558054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=36 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:19.558971 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:52:19.559158 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:52:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7/action (ip 10.222.0.25) !!! Oct 27 10:52:19.560804 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:52:19.560975 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:52:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7/action (ip 10.222.0.25) !!! Oct 27 10:52:19.561789 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 10:52:19.561915 n-d-858383-16 devstack@n-api.service[120603]: Thu Oct 27 10:52:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7/action (ip 10.222.0.25) !!! Oct 27 10:52:19.567873 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-89dc8ad8-3b11-4fed-885c-ad7974f6cbba tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1919882710"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:19.570164 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-89dc8ad8-3b11-4fed-885c-ad7974f6cbba tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:19.583163 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89dc8ad8-3b11-4fed-885c-ad7974f6cbba tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:19.583596 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89dc8ad8-3b11-4fed-885c-ad7974f6cbba tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:19.584033 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89dc8ad8-3b11-4fed-885c-ad7974f6cbba tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:19.584743 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89dc8ad8-3b11-4fed-885c-ad7974f6cbba tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:19.585202 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89dc8ad8-3b11-4fed-885c-ad7974f6cbba tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:19.585657 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-89dc8ad8-3b11-4fed-885c-ad7974f6cbba tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:19.980384 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-89dc8ad8-3b11-4fed-885c-ad7974f6cbba tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "POST /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7/action" status: 202 len: 0 microversion: 2.1 time: 0.426368 Oct 27 10:52:19.981034 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4026/8132] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:52:19 2022] POST /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:52:27.524600 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:52:27.525500 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:52:27.526101 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:27.526882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=32 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:27.528112 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:52:27.528327 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 27 10:52:27.531326 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 10:52:27.531493 n-d-858383-16 devstack@n-api.service[120602]: Thu Oct 27 10:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 27 10:52:27.595913 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-473ce7eb-4edb-4f4f-abce-e96d7f111903 req-74142ca5-3d06-4617-a89e-bd66daa54500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ee1904-2537-4194-b00d-01f1246b5ee7", "name": "network-vif-plugged", "status": "completed", "tag": "8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:27.607020 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-473ce7eb-4edb-4f4f-abce-e96d7f111903 req-74142ca5-3d06-4617-a89e-bd66daa54500 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:27.607511 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-473ce7eb-4edb-4f4f-abce-e96d7f111903 req-74142ca5-3d06-4617-a89e-bd66daa54500 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:27.608013 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-473ce7eb-4edb-4f4f-abce-e96d7f111903 req-74142ca5-3d06-4617-a89e-bd66daa54500 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:27.618527 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-473ce7eb-4edb-4f4f-abce-e96d7f111903 req-74142ca5-3d06-4617-a89e-bd66daa54500 service nova] Creating event network-vif-plugged:8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf for instance 53ee1904-2537-4194-b00d-01f1246b5ee7 on n-h2-858383-16 Oct 27 10:52:27.624375 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-473ce7eb-4edb-4f4f-abce-e96d7f111903 req-74142ca5-3d06-4617-a89e-bd66daa54500 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101891 Oct 27 10:52:27.624991 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4107/8133] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 10:52:41.815372 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:41.816187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:41.820546 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-378675164", "imageRef": "525908b6-0923-40dc-936d-31455e8e5661", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1904509449", "security_groups": [{"name": "tempest-secgroup-smoke-1776534194"}], "networks": [{"uuid": "e8d88299-09f3-4917-b835-818d7d43677b"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:41.851279 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a5d496f-4dd6-4f32-8083-792c666ca6e4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43552. Oct 27 10:52:41.855814 n-d-858383-16 devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] [dfe90546-37b1-43c6-b11b-2210dd08c290] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43554. Oct 27 10:52:41.941545 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] validate_networks() for [('e8d88299-09f3-4917-b835-818d7d43677b', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 10:52:42.412748 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 10:52:42.413182 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 10:52:42.413681 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 10:52:42.414069 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 10:52:42.414482 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 10:52:42.424369 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:42.424858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:42.425291 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:42.426020 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:42.426487 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:42.426903 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:42.444811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Getting quotas for project 80d80e6d8c624fb1abbdf27d63f42b4e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 10:52:42.450380 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.quota [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Getting quotas for user 04cf6c93de1b4ce4a3046fd9a3ae6c28 and project 80d80e6d8c624fb1abbdf27d63f42b4e. Resources: {'cores', 'ram', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 10:52:42.463651 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 10:52:42.466187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='525908b6-0923-40dc-936d-31455e8e5661',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 10:52:42.522622 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8e4fcea1-5542-467c-93f7-04f0bbd4747a tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.709318 Oct 27 10:52:42.523349 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4027/8134] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Oct 27 10:52:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 10:52:42.533600 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:42.534991 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:42.539216 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-d906dcbd-1443-45f0-9589-93f13c589d0e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:42.539975 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-d906dcbd-1443-45f0-9589-93f13c589d0e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:42.556683 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43570. Oct 27 10:52:42.565691 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43568. Oct 27 10:52:42.675311 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-d906dcbd-1443-45f0-9589-93f13c589d0e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:42.683696 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-d906dcbd-1443-45f0-9589-93f13c589d0e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1248 microversion: 2.1 time: 0.152129 Oct 27 10:52:42.684486 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4108/8135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:42 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1248 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:43.708823 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:43.710145 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:43.716845 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:43.717673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:43.718126 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:43.718866 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:43.719324 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:43.719778 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:43.803070 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:43.814667 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8d8688a-770b-4853-a3db-0fb2ae570eb5 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1308 microversion: 2.1 time: 0.111870 Oct 27 10:52:43.815273 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4028/8136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:43 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:44.852046 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:44.852833 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:44.877878 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:44.878434 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:44.879004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:44.879871 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:44.880359 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:44.880881 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:45.259395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:45.269108 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-327eedc2-af3d-456c-b89a-f3e0dcfd9171 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.434211 Oct 27 10:52:45.273873 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4109/8137] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:44 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:45.711218 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b281154d-7325-4242-b703-12bedca143c3 req-29679540-f2c2-4649-8141-5d1b0ed0f323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ee1904-2537-4194-b00d-01f1246b5ee7", "name": "network-vif-unplugged", "status": "completed", "tag": "8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:45.743111 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b281154d-7325-4242-b703-12bedca143c3 req-29679540-f2c2-4649-8141-5d1b0ed0f323 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:45.743623 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b281154d-7325-4242-b703-12bedca143c3 req-29679540-f2c2-4649-8141-5d1b0ed0f323 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:45.749093 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b281154d-7325-4242-b703-12bedca143c3 req-29679540-f2c2-4649-8141-5d1b0ed0f323 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:45.769610 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b281154d-7325-4242-b703-12bedca143c3 req-29679540-f2c2-4649-8141-5d1b0ed0f323 service nova] Creating event network-vif-unplugged:8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf for instance 53ee1904-2537-4194-b00d-01f1246b5ee7 on n-h2-858383-16 Oct 27 10:52:45.784118 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b281154d-7325-4242-b703-12bedca143c3 req-29679540-f2c2-4649-8141-5d1b0ed0f323 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076691 Oct 27 10:52:45.785903 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4029/8138] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:46.301898 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:46.302695 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:46.315928 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:46.316465 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:46.316628 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b47c748d-f612-4aae-8d3e-08cc0d9d8642 req-d5311cd5-a399-4a59-9a6a-4c12a4b354f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ffa704-40e2-420b-a7dc-943ff90a25bf", "tag": "39b8d2db-78c1-403b-bff4-a56684a17f7b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:46.318166 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:46.321235 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:46.321772 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:46.322225 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:46.356100 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b47c748d-f612-4aae-8d3e-08cc0d9d8642 req-d5311cd5-a399-4a59-9a6a-4c12a4b354f0 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:46.356827 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b47c748d-f612-4aae-8d3e-08cc0d9d8642 req-d5311cd5-a399-4a59-9a6a-4c12a4b354f0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:46.357572 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b47c748d-f612-4aae-8d3e-08cc0d9d8642 req-d5311cd5-a399-4a59-9a6a-4c12a4b354f0 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:46.373758 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b47c748d-f612-4aae-8d3e-08cc0d9d8642 req-d5311cd5-a399-4a59-9a6a-4c12a4b354f0 service nova] Creating event network-changed:39b8d2db-78c1-403b-bff4-a56684a17f7b for instance 40ffa704-40e2-420b-a7dc-943ff90a25bf on n-h1-858383-16 Oct 27 10:52:46.378993 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b47c748d-f612-4aae-8d3e-08cc0d9d8642 req-d5311cd5-a399-4a59-9a6a-4c12a4b354f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066787 Oct 27 10:52:46.379874 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4030/8139] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:52:46.500448 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:46.510782 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-df894b72-df4a-4104-bdee-5083873f853d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.212799 Oct 27 10:52:46.512773 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4110/8140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:46 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:47.536463 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:47.537165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:47.543357 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:47.543884 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:47.544319 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:47.545005 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:47.545488 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:47.545907 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:47.696870 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:47.711157 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-032ac72e-8001-4178-bcf4-d2f628bf3390 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.179466 Oct 27 10:52:47.711793 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4031/8141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:47 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:48.736714 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:48.738156 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:48.745926 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:48.746658 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:48.747122 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:48.747895 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:48.748518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:48.748968 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:48.898308 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:48.907534 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-f38f1e03-7b2b-4bbe-a91f-5d088e904585 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.175318 Oct 27 10:52:48.908473 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4111/8142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:48 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:49.932043 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:49.932666 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:49.940604 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:49.941158 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:49.941610 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:49.942355 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:49.942844 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:49.943276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:50.097686 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:50.108508 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-157a8869-c372-4572-8cae-32d32372723e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.180537 Oct 27 10:52:50.109263 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4032/8143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:49 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:51.141159 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:51.141882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:51.148418 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:51.148916 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:51.149395 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:51.150539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:51.151016 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:51.151449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:51.305185 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:51.315266 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-c32e753f-9497-4306-80c5-e30ba2707421 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.181947 Oct 27 10:52:51.330260 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4112/8144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:51 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:52.344119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:52.344882 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:52.351669 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:52.352153 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:52.352802 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:52.353503 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:52.354243 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:52.354648 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:52.433999 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:52.457508 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:52.492155 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:52.500489 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a79fa473-38bf-4a94-882e-417227a257da tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.160284 Oct 27 10:52:52.501070 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4033/8145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:52 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:53.524259 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:53.525023 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:53.528302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell0:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:52:53.534732 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:53.535231 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:53.535724 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:53.536509 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:53.536903 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:53.537334 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:53.675094 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:53.683026 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-847045a1-c9d6-4bda-b8a9-23b4650a013b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.162675 Oct 27 10:52:53.683653 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4113/8146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:53 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:54.707706 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:54.708334 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:54.714678 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:54.715174 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:54.715834 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:54.716404 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:54.716960 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:54.717394 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:54.859228 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:54.867037 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5959fe11-bfb1-4288-bd2f-95b3412165dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.164322 Oct 27 10:52:54.867625 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4034/8147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:54 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:55.893229 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:55.893901 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:55.901787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:55.902302 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:55.902759 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:55.903486 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:55.903986 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:55.904432 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:56.041596 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:56.050215 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-0ab26c17-c966-4b76-8cd0-9ffe30aba5a6 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.161753 Oct 27 10:52:56.050800 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4114/8148] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:55 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:57.073307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:57.073954 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:57.081627 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:57.082119 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:57.082565 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:57.083276 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:57.083769 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:57.084200 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:57.222060 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:57.229990 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70c5746b-e306-42e3-a2c0-7eb0d92c312b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.160607 Oct 27 10:52:57.230561 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4035/8149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:57 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:58.254160 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:58.254811 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:58.263277 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:58.264399 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:58.264859 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:58.265652 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:58.266072 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:58.266518 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:58.415838 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:58.425355 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-59b709ef-1216-4a92-a1be-f6e072a473aa tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.175902 Oct 27 10:52:58.425952 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4115/8150] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:58 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:59.449187 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:52:59.449858 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:52:59.457961 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.458458 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.458902 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.459653 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.460120 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.460555 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:52:59.605509 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:52:59.614085 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-79140d3d-4b4e-48b3-96cf-fecf73a638e4 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.168977 Oct 27 10:52:59.614684 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4036/8151] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:52:59 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:52:59.987184 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-abb8ccfa-1a1f-4698-926e-b5900d58dcc3 req-8f27cff4-65c9-4f5d-b4fe-4567318cb858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ffa704-40e2-420b-a7dc-943ff90a25bf", "name": "network-vif-plugged", "status": "completed", "tag": "39b8d2db-78c1-403b-bff4-a56684a17f7b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:52:59.998796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-abb8ccfa-1a1f-4698-926e-b5900d58dcc3 req-8f27cff4-65c9-4f5d-b4fe-4567318cb858 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:52:59.999316 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-abb8ccfa-1a1f-4698-926e-b5900d58dcc3 req-8f27cff4-65c9-4f5d-b4fe-4567318cb858 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:52:59.999771 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-abb8ccfa-1a1f-4698-926e-b5900d58dcc3 req-8f27cff4-65c9-4f5d-b4fe-4567318cb858 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:00.011720 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-abb8ccfa-1a1f-4698-926e-b5900d58dcc3 req-8f27cff4-65c9-4f5d-b4fe-4567318cb858 service nova] Creating event network-vif-plugged:39b8d2db-78c1-403b-bff4-a56684a17f7b for instance 40ffa704-40e2-420b-a7dc-943ff90a25bf on n-h1-858383-16 Oct 27 10:53:00.017385 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-abb8ccfa-1a1f-4698-926e-b5900d58dcc3 req-8f27cff4-65c9-4f5d-b4fe-4567318cb858 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041812 Oct 27 10:53:00.018478 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4116/8152] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:53:00.638835 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:00.639474 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:00.646304 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:00.646784 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:00.647219 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:00.647946 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:00.648405 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:00.648848 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:00.782411 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:00.790664 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f22a64d7-e950-40ca-ba6e-3dee8af035f3 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1374 microversion: 2.1 time: 0.155756 Oct 27 10:53:00.791243 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4037/8153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:00 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:01.816087 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:01.816813 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:01.823212 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:01.823778 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:01.824238 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:01.824954 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:01.825426 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:01.825872 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:01.967610 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:01.976132 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-eb37a83b-3e53-4afb-91b5-4d416471b583 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1557 microversion: 2.1 time: 0.165872 Oct 27 10:53:01.976724 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4117/8154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:01 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:01.999647 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:53:02.000274 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:53:02.007554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:02.008077 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:02.008524 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:02.009235 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:02.009698 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:02.010127 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:02.158259 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:53:02.165950 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14086ed6-4491-47e8-b47e-6a34da3dc728 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1557 microversion: 2.1 time: 0.170836 Oct 27 10:53:02.166513 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4038/8155] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:53:01 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:53:03.811506 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-a53c1ca1-c877-4b55-abc7-f3153b6161a7 req-2aa242ec-cdb8-4fb9-8cba-3590e1720d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ffa704-40e2-420b-a7dc-943ff90a25bf", "tag": "39b8d2db-78c1-403b-bff4-a56684a17f7b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:53:03.821852 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a53c1ca1-c877-4b55-abc7-f3153b6161a7 req-2aa242ec-cdb8-4fb9-8cba-3590e1720d60 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:53:03.822352 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a53c1ca1-c877-4b55-abc7-f3153b6161a7 req-2aa242ec-cdb8-4fb9-8cba-3590e1720d60 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:53:03.822796 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-a53c1ca1-c877-4b55-abc7-f3153b6161a7 req-2aa242ec-cdb8-4fb9-8cba-3590e1720d60 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:53:03.835248 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-a53c1ca1-c877-4b55-abc7-f3153b6161a7 req-2aa242ec-cdb8-4fb9-8cba-3590e1720d60 service nova] Creating event network-changed:39b8d2db-78c1-403b-bff4-a56684a17f7b for instance 40ffa704-40e2-420b-a7dc-943ff90a25bf on n-h1-858383-16 Oct 27 10:53:03.840656 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-a53c1ca1-c877-4b55-abc7-f3153b6161a7 req-2aa242ec-cdb8-4fb9-8cba-3590e1720d60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032889 Oct 27 10:53:03.841281 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4118/8156] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:05.370719 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:05.371505 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=60 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:05.424771 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-202df68a-5264-4d15-b60b-85ab1f8d87dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1275920926"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:05.427283 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-202df68a-5264-4d15-b60b-85ab1f8d87dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:05.433532 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-202df68a-5264-4d15-b60b-85ab1f8d87dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:05.434015 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-202df68a-5264-4d15-b60b-85ab1f8d87dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:05.434453 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-202df68a-5264-4d15-b60b-85ab1f8d87dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:05.435189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-202df68a-5264-4d15-b60b-85ab1f8d87dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:05.435673 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-202df68a-5264-4d15-b60b-85ab1f8d87dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:05.436104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-202df68a-5264-4d15-b60b-85ab1f8d87dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:05.651398 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-202df68a-5264-4d15-b60b-85ab1f8d87dd tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "POST /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf/action" status: 202 len: 0 microversion: 2.1 time: 0.282432 Oct 27 10:55:05.652276 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4039/8157] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Oct 27 10:55:05 2022] POST /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 27 10:55:12.699025 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 10:55:12.701548 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 10:55:12.702345 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=24 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:12.703698 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=52 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:12.716922 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-2f2743c9-548d-4bfa-8d1f-21df326cd09e req-c95370d5-7a69-4487-b842-69ae62e36805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ffa704-40e2-420b-a7dc-943ff90a25bf", "name": "network-vif-plugged", "status": "completed", "tag": "39b8d2db-78c1-403b-bff4-a56684a17f7b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:12.730763 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2f2743c9-548d-4bfa-8d1f-21df326cd09e req-c95370d5-7a69-4487-b842-69ae62e36805 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:12.731382 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2f2743c9-548d-4bfa-8d1f-21df326cd09e req-c95370d5-7a69-4487-b842-69ae62e36805 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:12.731946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-2f2743c9-548d-4bfa-8d1f-21df326cd09e req-c95370d5-7a69-4487-b842-69ae62e36805 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:12.745210 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-2f2743c9-548d-4bfa-8d1f-21df326cd09e req-c95370d5-7a69-4487-b842-69ae62e36805 service nova] Creating event network-vif-plugged:39b8d2db-78c1-403b-bff4-a56684a17f7b for instance 40ffa704-40e2-420b-a7dc-943ff90a25bf on n-h1-858383-16 Oct 27 10:55:12.751118 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-2f2743c9-548d-4bfa-8d1f-21df326cd09e req-c95370d5-7a69-4487-b842-69ae62e36805 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055898 Oct 27 10:55:12.751822 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4119/8158] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:25.491298 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:25.493606 n-d-858383-16 devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:25.495705 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_api:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:25.496458 n-d-858383-16 devstack@n-api.service[120602]: DEBUG dbcounter [-] [120602] Writing DB stats nova_cell1:SELECT=2 {{(pid=120602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:55:25.501293 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:25.505510 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:25.516856 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:25.518169 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:25.518425 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e4d235a-1190-46de-910e-60dd5f0e443d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43910. Oct 27 10:55:25.520019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:25.521018 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:25.521662 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:25.522218 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [-] [99775108-7978-48a2-933a-cd24e742c7a2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43908. Oct 27 10:55:25.523019 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:25.553189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:55:25.563233 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6bf392f0-fbec-487e-b544-134a773a6b5c req-ad8999ee-b03f-446d-81e7-6283c9a5288c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ffa704-40e2-420b-a7dc-943ff90a25bf", "tag": "39b8d2db-78c1-403b-bff4-a56684a17f7b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:25.576489 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6bf392f0-fbec-487e-b544-134a773a6b5c req-ad8999ee-b03f-446d-81e7-6283c9a5288c service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:25.577539 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6bf392f0-fbec-487e-b544-134a773a6b5c req-ad8999ee-b03f-446d-81e7-6283c9a5288c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:25.578107 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6bf392f0-fbec-487e-b544-134a773a6b5c req-ad8999ee-b03f-446d-81e7-6283c9a5288c service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:25.591241 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6bf392f0-fbec-487e-b544-134a773a6b5c req-ad8999ee-b03f-446d-81e7-6283c9a5288c service nova] Creating event network-changed:39b8d2db-78c1-403b-bff4-a56684a17f7b for instance 40ffa704-40e2-420b-a7dc-943ff90a25bf on n-h1-858383-16 Oct 27 10:55:25.597579 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6bf392f0-fbec-487e-b544-134a773a6b5c req-ad8999ee-b03f-446d-81e7-6283c9a5288c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103869 Oct 27 10:55:25.598193 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4120/8159] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:25.643334 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54a13445-677a-47d1-91b0-4b42af2cf12d tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 204 len: 0 microversion: 2.1 time: 0.154377 Oct 27 10:55:25.644909 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4040/8160] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:55:25 2022] DELETE /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:55:25.654142 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:25.655079 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:25.662727 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:25.663520 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:25.664021 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:25.664758 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:25.665380 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:25.665831 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:25.811656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:25.820328 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-6a378659-dfba-4ffa-b67c-c63e75ff8f9e tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1682 microversion: 2.1 time: 0.171006 Oct 27 10:55:25.820908 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4121/8161] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:25 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:55:26.845048 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:26.845752 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:26.853757 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:26.854336 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:26.854840 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:26.855661 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:26.856580 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:26.857081 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:27.064997 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:27.074079 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d2be1bbf-6834-4300-9a3f-71ac22c35b99 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1682 microversion: 2.1 time: 0.233282 Oct 27 10:55:27.074667 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4041/8162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:26 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1682 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:28.061176 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-797d15d5-37b0-4fa1-8efb-f55f48e6e8e6 req-10aa7b15-3297-4a33-9b01-ba662ac9dfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ffa704-40e2-420b-a7dc-943ff90a25bf", "name": "network-vif-deleted", "tag": "39b8d2db-78c1-403b-bff4-a56684a17f7b"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:28.074717 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-797d15d5-37b0-4fa1-8efb-f55f48e6e8e6 req-10aa7b15-3297-4a33-9b01-ba662ac9dfb1 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:28.075304 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-797d15d5-37b0-4fa1-8efb-f55f48e6e8e6 req-10aa7b15-3297-4a33-9b01-ba662ac9dfb1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:28.075787 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-797d15d5-37b0-4fa1-8efb-f55f48e6e8e6 req-10aa7b15-3297-4a33-9b01-ba662ac9dfb1 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:28.089784 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-797d15d5-37b0-4fa1-8efb-f55f48e6e8e6 req-10aa7b15-3297-4a33-9b01-ba662ac9dfb1 service nova] Creating event network-vif-deleted:39b8d2db-78c1-403b-bff4-a56684a17f7b for instance 40ffa704-40e2-420b-a7dc-943ff90a25bf on n-h1-858383-16 Oct 27 10:55:28.094967 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-797d15d5-37b0-4fa1-8efb-f55f48e6e8e6 req-10aa7b15-3297-4a33-9b01-ba662ac9dfb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037533 Oct 27 10:55:28.095665 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4122/8163] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:28.100042 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:28.100675 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:28.109054 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:28.109554 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:28.110003 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:28.110900 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:28.111438 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:28.113277 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:28.181890 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:28.190171 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-306e8c05-3a87-4ebe-a5eb-184b36801c10 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 200 len: 1333 microversion: 2.1 time: 0.095155 Oct 27 10:55:28.190573 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4042/8164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:28 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 10:55:29.214086 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:29.214792 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 40ffa704-40e2-420b-a7dc-943ff90a25bf] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:29.221882 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:29.222373 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:29.222820 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:29.223515 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:29.224007 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:29.224440 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:29.238039 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.wsgi [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] HTTP exception thrown: Instance 40ffa704-40e2-420b-a7dc-943ff90a25bf could not be found. Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Request method failure captured: Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: request: GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf HTTP/1.1 Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: Accept: application/json Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: Accept-Encoding: identity Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: Connection: close Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: Content-Length: 0 Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: Content-Type: application/json Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: Host: 10.222.0.25 Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: Openstack-System-Scope: None Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: User-Agent: python-urllib3/1.26.12 Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Auth-Token: gAAAAABjWmIyG8Z3_pv6wHLxr9DrOuj7ka_PrEx0wGdi15CUa6Tal_nyKTZV9yZuznkRxQo67lHeViej4UYvPRiAnQG0JidL48-jQSsIRM_a6haSufwYAb_Y7u6YEY4Mepn56t85-V-trmHBONRSf0y8m4R63mnT24tZ-A0_LH-ZzwV66Vn_jVM Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Id: None Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Domain-Name: None Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Identity-Status: Confirmed Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Is-Admin-Project: True Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Id: default Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Domain-Name: Default Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Id: 80d80e6d8c624fb1abbdf27d63f42b4e Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Project-Name: tempest-TestSnapshotPattern-755099997 Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Role: member,reader Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Roles: member,reader Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80d80e6d8c624fb1abbdf27d63f42b4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_80d80e6d8c624fb1abbdf27d63f42b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80d80e6d8c624fb1abbdf27d63f42b4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/80d80e6d8c624fb1abbdf27d63f42b4e"}]}] Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant: tempest-TestSnapshotPattern-755099997 Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Id: 80d80e6d8c624fb1abbdf27d63f42b4e Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-Tenant-Name: tempest-TestSnapshotPattern-755099997 Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-User: tempest-TestSnapshotPattern-755099997-project Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Id: default Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-User-Domain-Name: Default Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-User-Id: 04cf6c93de1b4ce4a3046fd9a3ae6c28 Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: X-User-Name: tempest-TestSnapshotPattern-755099997-project Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: method: > Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: exception: Instance 40ffa704-40e2-420b-a7dc-943ff90a25bf could not be found. Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: action_args: {'id': '40ffa704-40e2-420b-a7dc-943ff90a25bf'} Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ffa704-40e2-420b-a7dc-943ff90a25bf could not be found. Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ffa704-40e2-420b-a7dc-943ff90a25bf could not be found. Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:29.239708 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ffa704-40e2-420b-a7dc-943ff90a25bf could not be found. Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: ERROR nova.api.openstack.wsgi Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Returning 404 to user: Instance 40ffa704-40e2-420b-a7dc-943ff90a25bf could not be found. {{(pid=120602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-fec29806-1be2-43a0-856b-4e9318d8c8ca tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf" status: 404 len: 111 microversion: 2.1 time: 0.031367 Oct 27 10:55:29.243099 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4123/8165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:29 2022] GET /compute/v2.1/servers/40ffa704-40e2-420b-a7dc-943ff90a25bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:55:30.585805 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:30.586312 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:30.587857 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-6cff8a4e-c459-49c1-badb-3a0d022f9dd4 req-160a6f19-2f74-41b3-a2ac-601920048fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ee1904-2537-4194-b00d-01f1246b5ee7", "tag": "8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:30.593084 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:30.593570 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:30.594007 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:30.594715 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:30.595165 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:30.595788 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:30.601077 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6cff8a4e-c459-49c1-badb-3a0d022f9dd4 req-160a6f19-2f74-41b3-a2ac-601920048fca service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:30.601824 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6cff8a4e-c459-49c1-badb-3a0d022f9dd4 req-160a6f19-2f74-41b3-a2ac-601920048fca service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:30.602362 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-6cff8a4e-c459-49c1-badb-3a0d022f9dd4 req-160a6f19-2f74-41b3-a2ac-601920048fca service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:30.614826 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-6cff8a4e-c459-49c1-badb-3a0d022f9dd4 req-160a6f19-2f74-41b3-a2ac-601920048fca service nova] Creating event network-changed:8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf for instance 53ee1904-2537-4194-b00d-01f1246b5ee7 on n-h2-858383-16 Oct 27 10:55:30.622247 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-6cff8a4e-c459-49c1-badb-3a0d022f9dd4 req-160a6f19-2f74-41b3-a2ac-601920048fca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038142 Oct 27 10:55:30.623100 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4124/8166] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:30.623484 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 10:55:30.713091 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe08ca69-b446-4cab-8745-520a0fc88898 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "DELETE /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 204 len: 0 microversion: 2.1 time: 0.130812 Oct 27 10:55:30.714234 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4043/8167] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Oct 27 10:55:30 2022] DELETE /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 10:55:30.724318 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:30.724988 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.compute.api [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120602) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:30.731689 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:30.732270 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:30.732656 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:30.733528 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:30.734004 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:30.734449 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:30.892341 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.policy [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120602) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:30.900792 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-197e0e29-7e8f-4098-8e56-922e8d79536b tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1683 microversion: 2.1 time: 0.182133 Oct 27 10:55:30.901384 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4125/8168] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:30 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:31.925189 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:31.925945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:31.932796 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:31.933307 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:31.933734 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:31.934436 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:31.934910 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:31.935326 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:32.150945 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.policy [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf6c93de1b4ce4a3046fd9a3ae6c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d80e6d8c624fb1abbdf27d63f42b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 10:55:32.158704 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-39dc42af-65fe-4266-85f8-d83dffbef6ad tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 200 len: 1564 microversion: 2.1 time: 0.237852 Oct 27 10:55:32.159866 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4044/8169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:31 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 1564 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 10:55:32.397946 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [req-002f7117-a416-41a2-9e40-21fbeff28266 req-f604b844-e991-40a8-bf8e-86aaca0d7911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ee1904-2537-4194-b00d-01f1246b5ee7", "name": "network-vif-deleted", "tag": "8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf"}]} {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 10:55:32.407377 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-002f7117-a416-41a2-9e40-21fbeff28266 req-f604b844-e991-40a8-bf8e-86aaca0d7911 service nova] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:32.407906 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-002f7117-a416-41a2-9e40-21fbeff28266 req-f604b844-e991-40a8-bf8e-86aaca0d7911 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:32.408356 n-d-858383-16 devstack@n-api.service[120602]: DEBUG oslo_concurrency.lockutils [req-002f7117-a416-41a2-9e40-21fbeff28266 req-f604b844-e991-40a8-bf8e-86aaca0d7911 service nova] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:32.420047 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.compute.server_external_events [req-002f7117-a416-41a2-9e40-21fbeff28266 req-f604b844-e991-40a8-bf8e-86aaca0d7911 service nova] Creating event network-vif-deleted:8961ae6b-af69-4ae9-81c5-9e0c5c3c4eaf for instance 53ee1904-2537-4194-b00d-01f1246b5ee7 on n-h2-858383-16 Oct 27 10:55:32.425168 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [req-002f7117-a416-41a2-9e40-21fbeff28266 req-f604b844-e991-40a8-bf8e-86aaca0d7911 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087432 Oct 27 10:55:32.425809 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4126/8170] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Oct 27 10:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 10:55:33.183103 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:33.183676 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [instance: 53ee1904-2537-4194-b00d-01f1246b5ee7] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 10:55:33.190577 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:33.191668 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:33.192104 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:33.192811 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Acquiring lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 10:55:33.193263 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 10:55:33.193682 n-d-858383-16 devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Lock "ca6a4242-3cb0-40b8-b656-fee1e0b6f427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 10:55:33.208430 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] HTTP exception thrown: Instance 53ee1904-2537-4194-b00d-01f1246b5ee7 could not be found. Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Request method failure captured: Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 HTTP/1.1 Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: Accept: application/json Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: Accept-Encoding: identity Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: Connection: close Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: Content-Length: 0 Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: Content-Type: application/json Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: Host: 10.222.0.25 Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: Openstack-System-Scope: None Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjWmIyG8Z3_pv6wHLxr9DrOuj7ka_PrEx0wGdi15CUa6Tal_nyKTZV9yZuznkRxQo67lHeViej4UYvPRiAnQG0JidL48-jQSsIRM_a6haSufwYAb_Y7u6YEY4Mepn56t85-V-trmHBONRSf0y8m4R63mnT24tZ-A0_LH-ZzwV66Vn_jVM Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Id: None Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Domain-Name: None Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Identity-Status: Confirmed Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Is-Admin-Project: True Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Id: default Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Domain-Name: Default Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Id: 80d80e6d8c624fb1abbdf27d63f42b4e Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Project-Name: tempest-TestSnapshotPattern-755099997 Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Role: member,reader Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Roles: member,reader Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80d80e6d8c624fb1abbdf27d63f42b4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_80d80e6d8c624fb1abbdf27d63f42b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/80d80e6d8c624fb1abbdf27d63f42b4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/80d80e6d8c624fb1abbdf27d63f42b4e"}]}] Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant: tempest-TestSnapshotPattern-755099997 Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Id: 80d80e6d8c624fb1abbdf27d63f42b4e Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestSnapshotPattern-755099997 Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-User: tempest-TestSnapshotPattern-755099997-project Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Id: default Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-User-Domain-Name: Default Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-User-Id: 04cf6c93de1b4ce4a3046fd9a3ae6c28 Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: X-User-Name: tempest-TestSnapshotPattern-755099997-project Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: method: > Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: exception: Instance 53ee1904-2537-4194-b00d-01f1246b5ee7 could not be found. Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: action_args: {'id': '53ee1904-2537-4194-b00d-01f1246b5ee7'} Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ee1904-2537-4194-b00d-01f1246b5ee7 could not be found. Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ee1904-2537-4194-b00d-01f1246b5ee7 could not be found. Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 10:55:33.210089 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ee1904-2537-4194-b00d-01f1246b5ee7 could not be found. Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Returning 404 to user: Instance 53ee1904-2537-4194-b00d-01f1246b5ee7 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-61242e6d-e82f-4cb5-bcbb-741ebac42904 tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7" status: 404 len: 111 microversion: 2.1 time: 0.032603 Oct 27 10:55:33.213998 n-d-858383-16 devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4045/8171] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Oct 27 10:55:33 2022] GET /compute/v2.1/servers/53ee1904-2537-4194-b00d-01f1246b5ee7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 10:55:33.386591 n-d-858383-16 devstack@n-api.service[120602]: DEBUG nova.api.openstack.wsgi [None req-cbb6907a-ada2-4064-acaf-0fc97699d3bb tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] Calling method '.version_select at 0x7f31ae656af0>' {{(pid=120602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 10:55:33.392229 n-d-858383-16 devstack@n-api.service[120602]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cbb6907a-ada2-4064-acaf-0fc97699d3bb tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [e73a6fbf-08ce-4173-adca-11259d20346d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 10:55:34.399894 n-d-858383-16 devstack@n-api.service[120602]: INFO oslo.messaging._drivers.impl_rabbit [None req-cbb6907a-ada2-4064-acaf-0fc97699d3bb tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] [e73a6fbf-08ce-4173-adca-11259d20346d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43986. Oct 27 10:55:34.420776 n-d-858383-16 devstack@n-api.service[120602]: INFO nova.api.openstack.requestlog [None req-cbb6907a-ada2-4064-acaf-0fc97699d3bb tempest-TestSnapshotPattern-755099997 tempest-TestSnapshotPattern-755099997-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1904509449" status: 202 len: 0 microversion: 2.1 time: 1.039210 Oct 27 10:55:34.421376 n-d-858383-16 devstack@n-api.service[120602]: [pid: 120602|app: 0|req: 4127/8172] 10.222.0.25 () {58 vars in 1257 bytes} [Thu Oct 27 10:55:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1904509449 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)